A useful observation programme begins with a decision that somebody can act on. Before selecting imagery or instruments, define the area of interest, the people responsible for inspecting it, and the time available for a response. This planning perspective connects remote measurements with the practical questions that shape a survey or monitoring service. The aim is to identify which observations would change a decision, how supporting evidence would be collected, and what should happen when information is incomplete. A clear plan makes later technical choices easier to assess against an operational purpose.
This working guide considers designing ground validation for satellite products across mixed smallholder farms. The immediate decision is to build a reliable farm-level inspection list. Useful reference evidence includes current crop inventory, plot boundaries and representative visits. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Mixed smallholder farms
A smallholder landscape can contain several crops, trees, buildings and paths within a compact area. Ownership boundaries may differ from the boundaries of the crop actually observed, and planting dates can vary between nearby plots. The first useful product is often a reliable inventory of what is being monitored. Record the crop, the planted area and the management question before deciding whether a satellite summary can represent that unit adequately.
Mixed pixels and boundary uncertainty deserve explicit attention. A value displayed over a small plot may include substantial contributions from neighbouring vegetation or other surfaces. Higher visual detail in the map does not remove this limitation. Use observation products appropriate for the plot size, review alignment carefully and retain information about valid coverage. Where satellite data do not resolve the required unit, complementary field observations may be more useful than a finer-looking interpretation.
A practical field programme should sample the diversity of crops, plot sizes and management conditions in the service area. Record location, date, crop stage and the circumstances that explain a mapped pattern. A model developed for one crop or estate should not be assumed to transfer directly to these mixed settings. Evaluate the specific farm-level decision, such as planning visits or updating an inventory, and communicate which conclusions are supported at plot scale and which remain broader landscape observations.
Start with the intended claim
Validation tests how well a product represents a defined quantity under specified conditions. It differs from calibration, which adjusts an instrument or model using reference information. Begin with the claim the product needs to support: class membership, surface reflectance, canopy height, water quality, or an area estimate. State the required spatial scale, time interval, and acceptable error. These choices determine the reference method and sample design. Collecting convenient field points first and deciding later what they prove usually leaves important conditions untested.
Reference measurements also contain uncertainty. Positioning error can place a sample in the wrong satellite pixel, a point instrument may not represent a heterogeneous footprint, and measurements made on different dates can describe real surface change. Record instrument calibration, sampling protocols, timestamps, coordinates, observation conditions, and uncertainty where available. For interpreted labels, retain the evidence used, class rules, and ambiguous cases. Agreement among interpreters is useful to examine, but agreement alone does not guarantee that the shared interpretation is correct.
Keep the assessment independent
Separate validation data from observations used to fit thresholds, train models, select features, or tune processing. If assessment sites repeatedly influence revisions, they have become development data and a fresh independent assessment is needed. Spatially clustered samples can make performance look stronger when neighboring training and test locations share conditions. Use a design that reflects the target population and report its limitations, including inaccessible areas or environmental conditions missing from the sample.
Choose metrics that match the product. For categorical maps, examine a confusion matrix and errors for individual classes, not just overall agreement. For continuous measurements, report bias and a suitable error measure alongside sample count and the range of reference values. Plot residuals against relevant conditions to expose failures hidden by an average. For area estimates, carry the probability sampling design through estimation and uncertainty calculations. Preserve rejected matchups and their reasons so that quality screening remains auditable. A useful validation report explains where the product works, where evidence is sparse, and which errors matter for the intended decision. Publishing reference protocols and assessment code makes later comparisons more credible and helps others reproduce the evaluation.
Translate the decision into observation requirements
Start with the decision that the information is intended to support. Describe the geographic unit, the time available for acting, and the consequence of an incorrect interpretation. A requirement such as detecting an unusual pattern across management blocks is different from identifying its cause. Keeping that distinction explicit helps a team select measurements that are relevant to the application and prevents later evaluation from drifting towards whatever result happens to be easiest to demonstrate.
Build a compact requirements matrix linking each decision to the evidence needed, the proposed observation source, and an acceptance condition. Include geographic accuracy, temporal relevance, quality screening, and the context required for interpretation. The matrix should also identify the evidence used to justify each requirement. An engineering preference or a convenient data source can inform a study, but neither should silently replace a documented information need.
Review the matrix with the people who will use the result. Ask how their response would change when information is delayed, incomplete, or uncertain. Record unresolved requirements as questions for a pilot rather than converting them into confident specifications. This produces a practical framework for comparing technical options, designing tests, and explaining why an observation is useful to the intended workflow.
Organise imagery and results for reliable retrieval
A useful storage design helps people and software find the right observation without relying on informal knowledge of folder names. Separate immutable source data from temporary processing files and delivered products. Give each observation a stable identifier and preserve its acquisition metadata alongside the file. A predictable organisation reduces the chance that a later analysis accidentally uses a preview, an outdated result, or an intermediate product whose meaning has not been documented.
Choose an indexing scheme that reflects the questions the workflow needs to answer. Location, acquisition time, source, product type, and processing version are often useful search dimensions. The physical arrangement of files can differ from the logical catalogue, provided that the relationship is maintained reliably. Record checksums or other integrity information where appropriate, and test whether an observation can be recovered using the catalogue rather than a particular operator's memory.
Define retention rules for source, intermediate, and delivered information. Some intermediate products are inexpensive to reproduce, while others embody costly preparation or expert review. Keep the inputs and configuration needed to rebuild a result before removing reproducible files. Test backup and recovery procedures with representative products, including their metadata and geographic references. Reliable retrieval is demonstrated by a successful reconstruction of useful information, rather than by the existence of an untested copy.
Bring the evidence back to the decision
The practical outcome should be a short observation plan that another team can follow. It should name the decision, the required evidence, the responsible roles, and the conditions that trigger a field visit or further analysis. Keep the plan small enough to test, then revise it using the results of real inspections. A useful monitoring workflow improves because its assumptions are examined systematically, and its observations remain connected to decisions throughout the process.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



