A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers optical payload choices for small satellites in seasonal dry woodlands. The immediate decision is to distinguish seasonal change from disturbance. Useful reference evidence includes leafing stage, disturbance evidence and land-management records. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Seasonal dry woodlands
Seasonal dry woodlands can change markedly in appearance as leaf cover, understory vegetation and soil exposure vary through the year. A sparse-looking canopy during one period may be part of an ordinary seasonal cycle rather than evidence of degradation. Interpretation should begin with the local seasonal context and the intended observation variable. Mapping woody cover, reviewing a disturbance alert and studying vegetation recovery require related but distinct forms of evidence.
Build comparisons using appropriate dates and quality-screened measurements, and examine whether an apparent change persists beyond a short seasonal fluctuation. Ground vegetation can contribute strongly where tree cover is open. Rainfall timing, grazing or other land management may alter that contribution without changing the woody component. A report should retain the observed area and acquisition dates so that a user can distinguish a current measurement from an inference made across a long image gap.
Field validation should record tree and ground-layer conditions separately where that distinction matters to the application. Include the leafing stage, signs of recent disturbance and the management context of each sampled area. A decline in a vegetation measure cannot identify its cause by itself. Evaluate mapped changes against representative observations across different canopy densities and seasonal states, and communicate where the available imagery supports a broad landscape interpretation rather than a precise inventory of individual trees.
Connect the optical design to the measurement
An optical Earth observation payload turns incoming radiance into sampled measurements. Its usefulness depends on more than the ground size represented by a pixel. The aperture, focal length, detector characteristics, spectral response and operating environment all influence the information that survives into the image. A mission should choose these features around a target measurement and its expected brightness, rather than treating pixel spacing as a complete performance specification.
Ground sampling distance describes the spacing of samples on the surface for a specified viewing geometry. Optical blur, detector response, motion and processing can reduce the detail that is actually resolved. The modulation transfer function expresses how contrast is retained across spatial frequencies and helps connect component performance with final image sharpness. Smaller pixels alone cannot recover detail removed by the optical system or excessive image motion.
Balance signal, packaging and calibration
A larger entrance aperture can collect more light, but it also creates demands on mass, volume, alignment and thermal control. Narrow spectral bands collect less energy than broader bands under otherwise comparable conditions. Longer integration can improve signal collection until motion, saturation or other constraints become limiting. The resulting trade must be evaluated for dark targets as well as bright land, and for the expected range of illumination and atmospheric conditions.
Small spacecraft packaging makes mechanical and thermal interfaces particularly consequential. Focus and alignment can shift as temperatures change, while launch loads and contamination can affect performance. Stray light from outside the intended field can bias measurements even when an image appears visually acceptable. Baffles, suitable materials, cleanliness procedures and representative testing help control these effects. Detector defects, nonuniform response and electronic noise also require characterization.
Plan radiometric, geometric and spectral calibration with the payload design. Establish how ground tests connect to measurements after launch, and how changes in response will be monitored. The calibration record should describe uncertainties and conditions, rather than just providing a correction file. Evaluate the complete imaging chain using representative scenes and realistic motion assumptions. A credible specification states where performance is expected, how it will be measured and which tradeoffs were accepted. It should not turn a detector data sheet into an unsupported claim about an entire spacecraft.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Match the timing of reference observations
The value of a reference measurement depends partly on how well its timing matches the observation being evaluated. A surface, crop, water body, or instrument state may change between the two measurements. Start by documenting the acquisition time of every source and the period over which the reference observation applies. Avoid treating a date entered during data upload as though it were necessarily the time when the measurement was collected.
Define an acceptable timing relationship for the application. A slowly changing structural feature may tolerate a broader comparison window than a rapidly changing surface condition. The window should be justified by the process being studied and by any available contextual records. If conditions change within that period, consider separating the observations into suitable groups rather than combining them under a single assumption of comparability.
Preserve information about interventions and events between observations. A management operation, rainfall episode, disturbance, or change in sensor configuration can alter the interpretation of a comparison. Record the event and decide whether the pair remains suitable for evaluation. Where the timing mismatch cannot be resolved, describe the comparison as qualified evidence. This is more informative than allowing an uncertain match to influence a performance statistic without explanation.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



