A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers writing requirements from an earth observation need in shaded cocoa agroforestry. The immediate decision is to identify sites for canopy assessment. Useful reference evidence includes cocoa canopy and overstory observations collected separately. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Shaded cocoa agroforestry
A shaded cocoa farm contains multiple vegetation layers whose contributions cannot always be separated in a satellite image. Large shade trees may dominate the upper canopy, while the cocoa plants of commercial interest occupy a lower layer. The first task is to define what the observation is intended to represent. Monitoring tree-cover change, evaluating shade structure and estimating a cocoa parameter are related objectives, but they should not be treated as interchangeable outputs.
Build a farm register that captures boundaries, management units and known differences in shade arrangement. Compare imagery at suitable dates and exclude contaminated observations, while recognising that stable upper-canopy greenness can conceal changes below it. Canopy openings, recent pruning, intercropping and storm damage may alter the signal for different reasons. Contextual information helps turn these patterns into questions for field investigation instead of unsupported explanations about cocoa health.
A validation visit should record cocoa condition and overstory characteristics separately. Photograph or describe the sampled area consistently, and retain its location and date so that it can be related to the observation footprint. Sampling only accessible farm edges risks overlooking different conditions in the interior. Reports should explain whether they describe whole-farm vegetation or a validated cocoa-specific measurement, and identify the additional evidence needed before a management recommendation can be made.
Translate a user decision into measurable behavior
A mission requirement should connect to a decision that someone needs to make with the observations. Begin by defining the target phenomenon, geographic area, relevant season and consequence of delay or error. A request to monitor crops is too broad to guide a spacecraft design. The useful question is which crop condition must be distinguished, at what field scale, how often, and with what confidence.
Translate these needs into product requirements before allocating spacecraft specifications. Consider spatial detail, spectral information, radiometric performance, location accuracy, usable revisit and delivery latency. Geometric revisit describes observation opportunities; clouds and acquisition constraints can make usable observations much less frequent. Define terms carefully so that a requirement for delivered, cloud screened coverage cannot be satisfied merely by showing an orbit access calculation.
Keep traceability through design and verification
Write individual requirements that can be checked using a stated method and acceptance criterion. Identify the conditions under which each applies, such as target brightness, viewing angle or operating temperature. Avoid combining several unrelated promises in one sentence. Retain a rationale and a link to the higher level need, allowing reviewers to understand why the requirement exists and what would change if it were relaxed.
Allocate performance across the payload, spacecraft, ground segment and processing chain. Image sharpness may depend on optics, detector sampling, motion and resampling. Delivery time may depend on acquisition planning, onboard storage, ground contacts and processing queues. Budgets make these contributions visible and expose conflicts between objectives. Preserve margin where uncertainty remains, and record assumptions rather than hiding them inside an optimistic headline specification.
Plan verification while writing the requirement. Inspection, analysis, demonstration and testing each provide different kinds of evidence. Define the test configuration, reference measurement, uncertainty and pass criterion early enough to influence the design. Verification asks whether the implemented system meets its requirements; validation asks whether that system serves the intended use. Representative users and realistic application examples can reveal an inadequate requirement even when every hardware test passes. Manage revisions through a controlled record that describes their consequences for dependent requirements, budgets and tests. This turns requirements into a working design tool rather than a document assembled only before a review.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Check readiness before an acquisition
An acquisition plan should consider the complete sequence needed to obtain a usable observation. Define the target, the required configuration, the timing opportunity, and the conditions under which the observation should proceed. For a spacecraft study, this includes the relationships between pointing, instrument operation, available resources, and data handling. For other observation platforms, the same principle applies: a valid measurement depends on more than the presence of a suitable sensor.
Use a readiness checklist tied to the intended acquisition rather than a generic declaration that the system is available. Confirm the relevant configuration, geographic information, time references, storage capacity, and expected data products. Identify conditions that require postponement or a revised plan. Where resource estimates are uncertain, state the assumption and test its consequences before treating it as an operational margin.
Review the acquisition after it occurs or after a representative simulation. Compare the planned sequence with the evidence actually produced, including metadata, coverage, and quality information. Record incomplete acquisitions as useful evidence about the workflow rather than silently excluding them from the record. Repeated reviews can reveal whether a limitation arises from planning, platform behaviour, instrument operation, or processing. This creates a disciplined route from an observation opportunity to a dependable measurement capability.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



