A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers testing whether a remote sensing model transfers in humid tropical forests. The immediate decision is to prioritise forest-change inspections. Useful reference evidence includes canopy observations, disturbance evidence and representative plots. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Humid tropical forests
A humid tropical forest presents a complex upper canopy shaped by species mixtures, crown structure, terrain and disturbance history. Optical imagery can describe aspects of that visible surface, but it does not directly inventory every tree or the conditions beneath the canopy. Define whether the intended task concerns cover change, a disturbance alert or a forest parameter before interpreting an image pattern. These objectives require different reference information and different levels of spatial support.
Persistent cloud, shadow and haze can leave gaps in the observation record. A change map should show when usable evidence was available and whether a reported event is constrained to a broad interval between acquisitions. Terrain and canopy shadows can create additional differences that are unrelated to a new disturbance. Combine quality screening with an understanding of the landscape, and retain the dates and valid areas used to establish each mapped observation.
Field validation should distinguish a change in canopy appearance from the explanation for that change. Record plot or inspection locations, the area represented and the evidence used to identify disturbance or recovery. Tree measurements can support structural or biomass studies when collected and analysed for that purpose. A general vegetation index alone cannot establish forest carbon stocks. The practical monitoring product should state what was observed, how confidently it was located and which additional information supports its interpretation.
Identify what changes between domains
A model trained on one region or season learns relationships present in its development data. Applying it elsewhere assumes those relationships remain useful. New crop varieties, forest types, soil colours, management practices, illumination, or sensor characteristics can violate that assumption. Define the intended transfer explicitly: a new district, another year, another sensor, or a different class distribution. Each change creates a different test. A model that transfers across nearby fields has not thereby demonstrated reliable performance across climates or observation systems.
Keep the measurement pipeline consistent before attributing differences to the model. Reflectance scaling, band order, cloud masking, spatial resolution, composite windows, and missing value handling can all change predictions. Sensors with similarly named bands may have different spectral responses. Harmonization can reduce some differences but does not establish equivalence for every target. Examine predictor distributions, missing data rates, and examples from the new setting. Flag inputs outside the conditions represented during training so that extrapolation remains visible.
Test the destination, then adapt carefully
Design evaluation splits around the intended deployment. Hold out geographic regions to test spatial transfer and later years to test temporal transfer, keeping neighboring samples or repeated observations of the same site together when needed. Report performance for meaningful destination groups rather than only a pooled score. Class prevalence affects some metrics, so interpret changes alongside the underlying confusion matrix or residual distributions. A random pixel split can look excellent while providing little evidence about performance in an unseen region.
If local labels are available, reserve a destination assessment set before fine tuning or recalibration. Use the remaining observations to compare straightforward baselines with more complex adaptation methods. Check whether improvement comes from genuine transfer or simply from adding representative local data. Retain an option to withhold predictions when input quality or novelty makes them unreliable. Document the training domain, destination evidence, preprocessing versions, and conditions where use is unsupported. Continue monitoring once new observations arrive, since seasonal and environmental shifts can emerge after an initial evaluation. Transferability is a measured property of a particular model, workflow, target, and destination; it should not be inferred from architecture name or strong performance on the original test set.
Establish a metadata contract
Define a small set of metadata that every observation and derived product must carry through the workflow. Useful fields include a stable identifier, acquisition time, geographic reference, spatial coverage, measurement units, source version, and processing status. The purpose is not to collect every possible detail. It is to preserve the information required to interpret, compare, locate, and reproduce the observations that the application depends on.
Specify field names, allowed formats, and the meaning of missing values. A blank field, a value of zero, and a measurement below a detection threshold are different states and should remain distinguishable. Time zones, coordinate order, and unit conversions deserve particular attention because inconsistent conventions can produce plausible-looking results that are difficult to diagnose. Validate the metadata when information enters the system, while the source and collection context remain available.
Treat the metadata contract as part of the delivery interface. A product passed to another team should retain the identifiers needed to trace its source and processing history. If a transformation changes the meaning of a field, create a new field or document the change rather than reusing the original name silently. A clear contract reduces ambiguity between field collectors, analysts, software components, and the eventual users of the information.
Locate the uncertainty that matters to the decision
An uncertainty budget is a practical description of where a result could become unreliable. Begin with the observation chain: acquisition, calibration, geographic matching, reference measurements, feature calculation, modelling, and delivery. Identify the assumptions at each stage and ask which could materially change the interpretation. The purpose is not to assign a precise number to every limitation. It is to locate the sources that deserve attention for the intended decision.
Separate limitations that can be measured from those that currently require a qualitative description. Repeated measurements may help characterise variability, while comparisons with independent references can reveal systematic differences. Some uncertainties interact, so combining individual error estimates without examining their relationships can produce a misleading impression of precision. Keep the method of assessment visible and avoid treating an unexamined assumption as though it were a negligible contribution.
Use the budget to prioritise further work. The largest visible source of variation is not always the one whose reduction would most improve the decision. Consider which additional observation, test, or contextual record would change confidence in an actionable way. Revisit the budget when the application, observation source, or deployment conditions change. This turns uncertainty analysis into a guide for improving the workflow rather than a qualification added only after the result has been delivered.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



