A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers designing reproducible cloud processing workflows in shaded cocoa agroforestry. The immediate decision is to identify sites for canopy assessment. Useful reference evidence includes cocoa canopy and overstory observations collected separately. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Shaded cocoa agroforestry
A shaded cocoa farm contains multiple vegetation layers whose contributions cannot always be separated in a satellite image. Large shade trees may dominate the upper canopy, while the cocoa plants of commercial interest occupy a lower layer. The first task is to define what the observation is intended to represent. Monitoring tree-cover change, evaluating shade structure and estimating a cocoa parameter are related objectives, but they should not be treated as interchangeable outputs.
Build a farm register that captures boundaries, management units and known differences in shade arrangement. Compare imagery at suitable dates and exclude contaminated observations, while recognising that stable upper-canopy greenness can conceal changes below it. Canopy openings, recent pruning, intercropping and storm damage may alter the signal for different reasons. Contextual information helps turn these patterns into questions for field investigation instead of unsupported explanations about cocoa health.
A validation visit should record cocoa condition and overstory characteristics separately. Photograph or describe the sampled area consistently, and retain its location and date so that it can be related to the observation footprint. Sampling only accessible farm edges risks overlooking different conditions in the interior. Reports should explain whether they describe whole-farm vegetation or a validated cocoa-specific measurement, and identify the additional evidence needed before a management recommendation can be made.
Move the computation with a clear plan
Cloud processing can place analysis near a large satellite archive and reduce repeated transfers to a local computer. Its value depends on the workload. A small study may be easier to complete with a few downloaded scenes, while a continental time series benefits from selective reads and distributed processing. Begin with the geographic extent, dates, variables and output resolution that the analysis actually needs.
Inspect the storage format before choosing an execution pattern. Tiled imagery can support reading only intersecting blocks, and chunked multidimensional arrays can support selected time and spatial slices. These benefits depend on how data are organized and how the reader accesses them. Repeatedly opening complete remote files for tiny requests can waste time and bandwidth. Match processing chunks to source layout where practical, and avoid creating more small tasks than the scheduler can manage efficiently.
Make each run explainable and recoverable
Keep source identifiers, processing versions, input checksums where available, parameters and software dependencies with the workflow. Explicitly record projections, resampling methods, scale factors, masks and time aggregation rules. An output filename alone cannot capture these decisions. A small manifest linking inputs to outputs is useful when an archive is reprocessed or a result must be reproduced months later.
Develop on a representative subset that includes awkward cases such as missing bands, empty intersections and scenes with extensive cloud. Check numerical results and output metadata before expanding the workload. Design individual tasks so they can safely restart without duplicating completed results. Write intermediate output to a temporary location, verify it, and only then mark the task complete. Retain useful logs without recording access credentials.
Estimate storage, compute and data transfer costs together. Compression, unnecessary copies and repeated intermediate materialization can change the budget substantially. Monitor resource use during a pilot run and establish sensible limits before launching a large batch. Permissions should give each process the access it needs, and credentials should come from an appropriate secure mechanism. Finally, export an accessible result with provenance and quality information. A fast calculation becomes useful science only when another person can understand and inspect what was produced.
Design field observations around the information need
Field observations are most useful when they answer a defined question within the monitoring workflow. Begin by identifying the variable, condition, or management event that needs to be recorded and the geographic unit to which it applies. Distinguish direct measurements from an observer's interpretation. A consistent record of crop stage, management timing, and visible conditions can provide valuable context even when the field team is not collecting a complex set of measurements.
Prepare a collection protocol that reflects the variability of the site. Define where observations are made within a unit, how many locations are represented, and how the position and time are recorded. Avoid selecting only the most dramatic or convenient examples. Include apparently normal conditions and records that might challenge the remote interpretation. Where a measurement method has known limitations, preserve the information needed to assess whether those limitations affect the intended comparison.
Link field records to the corresponding remote observations without losing their original detail. Geographic matching, timing, and the scale represented by each record should remain visible. Review disagreements with the collecting team before changing a label or excluding an observation. A disagreement may reveal a timing mismatch, a mixed surface, or an incomplete interpretation rather than a simple error. The field programme should improve the understanding of the monitoring process as well as provide evidence for evaluating its outputs.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



