A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers testing whether a remote sensing model transfers at calibration reference sites. The immediate decision is to select repeatable calibration observations. Useful reference evidence includes target properties, measurement conditions and acquisition geometry. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Calibration reference sites
A calibration reference site is useful when its properties and observation conditions are understood well enough for a defined comparison. The relevant target depends on the instrument and measurement being evaluated. A site chosen for geometric checks may not provide the evidence needed for a radiometric assessment. Define the quantity being tested, the spatial area represented and the expected sources of variation before treating a convenient surface as a reliable reference.
Repeatable measurements require more than returning to the same coordinates. Illumination, atmosphere, surface condition, viewing geometry and the instrument operating state can all influence the result. Record the factors that matter to the chosen test and identify circumstances that make an observation unsuitable. The target should occupy an appropriate fraction of the measurement footprint, with enough surrounding context to assess mixing, alignment and other effects relevant to the comparison.
The evaluation should preserve measurement uncertainty and distinguish calibration evidence from an application demonstration. A successful comparison at one reference site does not establish performance under every mission condition. Repeat observations, independent checks and clear acceptance criteria strengthen the interpretation. The practical output is a traceable record of what was measured, under which conditions and against which reference, so that a later processing or hardware change can be assessed using a consistent and defensible basis.
Identify what changes between domains
A model trained on one region or season learns relationships present in its development data. Applying it elsewhere assumes those relationships remain useful. New crop varieties, forest types, soil colours, management practices, illumination, or sensor characteristics can violate that assumption. Define the intended transfer explicitly: a new district, another year, another sensor, or a different class distribution. Each change creates a different test. A model that transfers across nearby fields has not thereby demonstrated reliable performance across climates or observation systems.
Keep the measurement pipeline consistent before attributing differences to the model. Reflectance scaling, band order, cloud masking, spatial resolution, composite windows, and missing value handling can all change predictions. Sensors with similarly named bands may have different spectral responses. Harmonization can reduce some differences but does not establish equivalence for every target. Examine predictor distributions, missing data rates, and examples from the new setting. Flag inputs outside the conditions represented during training so that extrapolation remains visible.
Test the destination, then adapt carefully
Design evaluation splits around the intended deployment. Hold out geographic regions to test spatial transfer and later years to test temporal transfer, keeping neighboring samples or repeated observations of the same site together when needed. Report performance for meaningful destination groups rather than only a pooled score. Class prevalence affects some metrics, so interpret changes alongside the underlying confusion matrix or residual distributions. A random pixel split can look excellent while providing little evidence about performance in an unseen region.
If local labels are available, reserve a destination assessment set before fine tuning or recalibration. Use the remaining observations to compare straightforward baselines with more complex adaptation methods. Check whether improvement comes from genuine transfer or simply from adding representative local data. Retain an option to withhold predictions when input quality or novelty makes them unreliable. Document the training domain, destination evidence, preprocessing versions, and conditions where use is unsupported. Continue monitoring once new observations arrive, since seasonal and environmental shifts can emerge after an initial evaluation. Transferability is a measured property of a particular model, workflow, target, and destination; it should not be inferred from architecture name or strong performance on the original test set.
Locate the uncertainty that matters to the decision
An uncertainty budget is a practical description of where a result could become unreliable. Begin with the observation chain: acquisition, calibration, geographic matching, reference measurements, feature calculation, modelling, and delivery. Identify the assumptions at each stage and ask which could materially change the interpretation. The purpose is not to assign a precise number to every limitation. It is to locate the sources that deserve attention for the intended decision.
Separate limitations that can be measured from those that currently require a qualitative description. Repeated measurements may help characterise variability, while comparisons with independent references can reveal systematic differences. Some uncertainties interact, so combining individual error estimates without examining their relationships can produce a misleading impression of precision. Keep the method of assessment visible and avoid treating an unexamined assumption as though it were a negligible contribution.
Use the budget to prioritise further work. The largest visible source of variation is not always the one whose reduction would most improve the decision. Consider which additional observation, test, or contextual record would change confidence in an actionable way. Revisit the budget when the application, observation source, or deployment conditions change. This turns uncertainty analysis into a guide for improving the workflow rather than a qualification added only after the result has been delivered.
Match the timing of reference observations
The value of a reference measurement depends partly on how well its timing matches the observation being evaluated. A surface, crop, water body, or instrument state may change between the two measurements. Start by documenting the acquisition time of every source and the period over which the reference observation applies. Avoid treating a date entered during data upload as though it were necessarily the time when the measurement was collected.
Define an acceptable timing relationship for the application. A slowly changing structural feature may tolerate a broader comparison window than a rapidly changing surface condition. The window should be justified by the process being studied and by any available contextual records. If conditions change within that period, consider separating the observations into suitable groups rather than combining them under a single assumption of comparability.
Preserve information about interventions and events between observations. A management operation, rainfall episode, disturbance, or change in sensor configuration can alter the interpretation of a comparison. Record the event and decide whether the pair remains suitable for evaluation. Where the timing mismatch cannot be resolved, describe the comparison as qualified evidence. This is more informative than allowing an uncertain match to influence a performance statistic without explanation.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.


