A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers atmospheric correction for comparable imagery during payload integration studies. The immediate decision is to plan integrated payload test sequences. Useful reference evidence includes measured instrument responses and traceable test configurations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Payload integration studies
A payload integration study examines how an observation instrument behaves as part of a wider spacecraft concept. The camera, optics, electronics, structure and processing path cannot be assessed solely as independent catalogue items. Begin by identifying the measurements the complete system must support and the conditions under which they should be demonstrated. A component description can inform the design, but it does not establish the performance of an integrated imaging chain.
Test planning should record the hardware configuration, operating settings, reference targets and environmental conditions relevant to each measurement. Changes between tests need to remain traceable so that an apparent improvement is not confused with a different test setup. Spectral alignment, image geometry and radiometric consistency may interact with mechanical or thermal behaviour. The investigation should identify those relationships rather than relying only on whether an acquired test image looks visually sharp or colourful.
Acceptance criteria should connect instrument measurements with the needs of the intended application. Retain uncertainties, unsuccessful tests and design changes as part of the evidence used to evaluate progress. A laboratory demonstration under one condition should not be described as flight-qualified capability without the necessary additional work. A useful result at this stage is an auditable account of integrated behaviour, the remaining measurement questions and the next tests needed to assess the proposed payload architecture.
Know which reflectance product is being compared
An optical satellite measures a signal that has interacted with both the surface and the atmosphere. Atmospheric correction estimates a surface-related reflectance quantity by accounting for relevant atmospheric contributions under a set of assumptions. This makes many comparisons more meaningful, especially across dates, but it does not turn every pixel into an exact ground measurement. The corrected product still carries uncertainty and may be unsuitable where clouds, strong haze, unusual illumination or difficult surface conditions violate the assumptions used by the processing method.
The processing level should match the analytical purpose. A visually useful image, a top-of-atmosphere reflectance product and a surface reflectance product can all represent the same acquisition while supporting different interpretations. Mixing these products inside one time series can create a discontinuity unrelated to the land. Record the product definition, processing version and quality information. Apply stored scale factors and offsets correctly before using numerical values in an index or model, and avoid assuming that all products from a named mission follow identical conventions.
Evaluate correction quality in the target landscape
A correction method should be examined in the landscape where its output will be used. Water, bright soil, complex terrain and vegetation can pose different challenges. Inspect the associated quality flags and review suspicious patterns against image context rather than accepting every corrected value automatically. Compare multiple dates and include stable reference areas when appropriate. A sudden change affecting many unrelated surfaces may indicate an acquisition or processing issue that deserves investigation before it is interpreted as an agricultural or environmental event.
A robust workflow treats correction quality and observation suitability as related but distinct decisions. Atmospheric correction does not remove clouds from the ground, and it does not resolve all effects of shadow, viewing geometry or surface mixing. Retain a policy for excluding unsuitable measurements and communicating gaps. If a processor update changes the historical record, assess the effect on derived statistics and alerts. The practical aim is a consistently defined observation series whose remaining limitations are understood, so that a user can evaluate a surface interpretation against the quality of its inputs.
Locate the uncertainty that matters to the decision
An uncertainty budget is a practical description of where a result could become unreliable. Begin with the observation chain: acquisition, calibration, geographic matching, reference measurements, feature calculation, modelling, and delivery. Identify the assumptions at each stage and ask which could materially change the interpretation. The purpose is not to assign a precise number to every limitation. It is to locate the sources that deserve attention for the intended decision.
Separate limitations that can be measured from those that currently require a qualitative description. Repeated measurements may help characterise variability, while comparisons with independent references can reveal systematic differences. Some uncertainties interact, so combining individual error estimates without examining their relationships can produce a misleading impression of precision. Keep the method of assessment visible and avoid treating an unexamined assumption as though it were a negligible contribution.
Use the budget to prioritise further work. The largest visible source of variation is not always the one whose reduction would most improve the decision. Consider which additional observation, test, or contextual record would change confidence in an actionable way. Revisit the budget when the application, observation source, or deployment conditions change. This turns uncertainty analysis into a guide for improving the workflow rather than a qualification added only after the result has been delivered.
Represent gaps without inventing observations
A monitoring sequence often contains periods without a usable observation. The reason may be cloud, shadow, missing coverage, a failed transfer, or a quality condition that excludes the data. Begin by representing these states explicitly. A missing observation is different from a low measurement, an unchanged surface, or a confirmed absence of the feature being studied. The distinction should survive both the analysis and the presentation of the result.
Define when a temporal gap is acceptable for the intended decision. A workflow may continue using the latest qualified observation, request another source, or suspend an alert until sufficient evidence is available. Whichever response is selected, show the age of the supporting observation. If interpolation is used for a suitable analytical purpose, preserve the distinction between an estimated value and a directly observed measurement, together with the assumptions needed to interpret it.
Review how gaps affect the coverage of the final evaluation. Locations with frequent missing data may differ systematically from those with regular observations. A performance estimate based only on clear, complete records can therefore describe a narrower population than the service is expected to support. Report usable coverage alongside analytical results and use recurring gaps to guide acquisition planning, reference collection, and the selection of complementary observation methods.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



