A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers reading uncertainty in remote sensing products around protected horticulture sites. The immediate decision is to separate structural mapping from crop interpretation. Useful reference evidence includes cover material, structure boundaries and accessible crop observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Protected horticulture sites
Protected horticulture introduces an important distinction between observing a production site and observing the plants inside it. Greenhouse roofs, shade structures and covering materials can dominate the surface signal recorded from above. A satellite image may help map the extent or arrangement of these structures without providing a direct measurement of crop condition beneath them. Define the intended output clearly before selecting features or making claims about a growing operation.
A site inventory should distinguish covered areas, open-field production, service surfaces and neighbouring land cover. Changes in roof materials, maintenance or illumination can alter image appearance independently of the crop. Review the acquisition geometry and the scale at which individual structures are actually resolved. Where the management question requires plant-level information, consider what complementary measurements can be obtained inside the structure rather than assuming an outdoor crop workflow will transfer unchanged.
Validation should record the type and condition of covering materials as well as the boundaries and use of the structures. Crop observations collected inside should retain their own measurement context and should not be treated as though the satellite directly viewed the same surface. A useful initial application may be production-site mapping or monitoring land-use change around facilities. More specific crop interpretations require evidence that connects the observed signal with the underlying variable under the relevant covering conditions.
Identify what the uncertainty describes
A satellite product is the result of a measurement chain, rather than a direct copy of conditions on the ground. Detector noise, calibration, atmospheric correction, geolocation and retrieval assumptions can all affect the final value. Their importance changes with the target. A small location error may matter greatly beside a narrow river, while an imperfect aerosol correction may dominate a water reflectance estimate.
Start by reading the variable definition, units, spatial support and quality documentation. An uncertainty layer may describe an estimated standard deviation, a confidence interval, disagreement among models or another quantity entirely. These measures are not interchangeable. A model's class probability also does not automatically represent a calibrated probability that its label is correct. Check how the quantity was obtained and whether it has been evaluated against independent observations.
Carry uncertainty into the decision
Separate systematic differences from random variation. Averaging many observations can reduce independent random noise, but it does not remove a shared calibration bias. Nearby pixels and repeated observations may share errors, so treating every value as independent can produce confidence intervals that are too narrow. When comparing dates, consider whether the same processing method, sensor characteristics and environmental conditions apply.
Quality flags identify conditions that deserve screening or special treatment. They may indicate clouds, saturation, poor retrieval geometry or inputs outside a method's tested range. Preserve the original flags and record the filtering rule. A strict mask can improve reliability while leaving a sample that overrepresents clear weather or easier terrain. Report missing coverage alongside the measurements that remain.
For a practical assessment, perturb influential inputs within defensible ranges and examine how the result changes. Compare alternative valid processing choices, stratify errors by landscape or season and use independent reference data. Classification summaries should include class specific errors rather than relying on one overall accuracy figure. For continuous estimates, examine bias and the distribution of residuals as well as an aggregate error statistic. A useful final product states the tested domain, describes meaningful limitations and shows whether the uncertainty is small enough for the intended decision.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Organise imagery and results for reliable retrieval
A useful storage design helps people and software find the right observation without relying on informal knowledge of folder names. Separate immutable source data from temporary processing files and delivered products. Give each observation a stable identifier and preserve its acquisition metadata alongside the file. A predictable organisation reduces the chance that a later analysis accidentally uses a preview, an outdated result, or an intermediate product whose meaning has not been documented.
Choose an indexing scheme that reflects the questions the workflow needs to answer. Location, acquisition time, source, product type, and processing version are often useful search dimensions. The physical arrangement of files can differ from the logical catalogue, provided that the relationship is maintained reliably. Record checksums or other integrity information where appropriate, and test whether an observation can be recovered using the catalogue rather than a particular operator's memory.
Define retention rules for source, intermediate, and delivered information. Some intermediate products are inexpensive to reproduce, while others embody costly preparation or expert review. Keep the inputs and configuration needed to rebuild a result before removing reproducible files. Test backup and recovery procedures with representative products, including their metadata and geographic references. Reliable retrieval is demonstrated by a successful reconstruction of useful information, rather than by the existence of an untested copy.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



