A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers optical payload choices for small satellites in fire-affected forest areas. The immediate decision is to prioritise post-event field assessment. Useful reference evidence includes dated disturbance evidence and representative recovery observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Fire-affected forest areas
A fire-affected forest can contain a mixture of changed canopy, exposed soil, surviving vegetation and areas whose appearance is influenced by shadow or smoke. A monitoring workflow should state whether it aims to map an affected area, describe change or follow recovery. These outputs require different interpretation rules and reference observations. An image pattern associated with disturbance is not by itself a complete measurement of ecological impact across every part of the landscape.
Use suitable observations before and after the event, while checking seasonal comparability and data quality. The available dates may constrain the timing of change only to an interval. During recovery, green ground vegetation can increase before the former forest structure returns. Track that distinction where the management objective concerns trees or habitat, and retain the supporting acquisition dates rather than presenting all changes in greenness as equivalent evidence of recovery.
Field validation should represent the range of mapped responses, including apparently unaffected locations and areas with ambiguous observations. Record the evidence of disturbance, vegetation layers and the spatial setting of each sample. If a product estimates severity or a restoration outcome, define the variable and collect reference information for that claim. A transparent first output can identify where observations support change and where additional field assessment is needed to understand its consequences.
Connect the optical design to the measurement
An optical Earth observation payload turns incoming radiance into sampled measurements. Its usefulness depends on more than the ground size represented by a pixel. The aperture, focal length, detector characteristics, spectral response and operating environment all influence the information that survives into the image. A mission should choose these features around a target measurement and its expected brightness, rather than treating pixel spacing as a complete performance specification.
Ground sampling distance describes the spacing of samples on the surface for a specified viewing geometry. Optical blur, detector response, motion and processing can reduce the detail that is actually resolved. The modulation transfer function expresses how contrast is retained across spatial frequencies and helps connect component performance with final image sharpness. Smaller pixels alone cannot recover detail removed by the optical system or excessive image motion.
Balance signal, packaging and calibration
A larger entrance aperture can collect more light, but it also creates demands on mass, volume, alignment and thermal control. Narrow spectral bands collect less energy than broader bands under otherwise comparable conditions. Longer integration can improve signal collection until motion, saturation or other constraints become limiting. The resulting trade must be evaluated for dark targets as well as bright land, and for the expected range of illumination and atmospheric conditions.
Small spacecraft packaging makes mechanical and thermal interfaces particularly consequential. Focus and alignment can shift as temperatures change, while launch loads and contamination can affect performance. Stray light from outside the intended field can bias measurements even when an image appears visually acceptable. Baffles, suitable materials, cleanliness procedures and representative testing help control these effects. Detector defects, nonuniform response and electronic noise also require characterization.
Plan radiometric, geometric and spectral calibration with the payload design. Establish how ground tests connect to measurements after launch, and how changes in response will be monitored. The calibration record should describe uncertainties and conditions, rather than just providing a correction file. Evaluate the complete imaging chain using representative scenes and realistic motion assumptions. A credible specification states where performance is expected, how it will be measured and which tradeoffs were accepted. It should not turn a detector data sheet into an unsupported claim about an entire spacecraft.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Define a representative reference sample
A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.
Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.
Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



