A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers viewing geometry and brdf effects in shaded cocoa agroforestry. The immediate decision is to identify sites for canopy assessment. Useful reference evidence includes cocoa canopy and overstory observations collected separately. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Shaded cocoa agroforestry
A shaded cocoa farm contains multiple vegetation layers whose contributions cannot always be separated in a satellite image. Large shade trees may dominate the upper canopy, while the cocoa plants of commercial interest occupy a lower layer. The first task is to define what the observation is intended to represent. Monitoring tree-cover change, evaluating shade structure and estimating a cocoa parameter are related objectives, but they should not be treated as interchangeable outputs.
Build a farm register that captures boundaries, management units and known differences in shade arrangement. Compare imagery at suitable dates and exclude contaminated observations, while recognising that stable upper-canopy greenness can conceal changes below it. Canopy openings, recent pruning, intercropping and storm damage may alter the signal for different reasons. Contextual information helps turn these patterns into questions for field investigation instead of unsupported explanations about cocoa health.
A validation visit should record cocoa condition and overstory characteristics separately. Photograph or describe the sampled area consistently, and retain its location and date so that it can be related to the observation footprint. Sampling only accessible farm edges risks overlooking different conditions in the interior. Reports should explain whether they describe whole-farm vegetation or a validated cocoa-specific measurement, and identify the additional evidence needed before a management recommendation can be made.
The observed surface has a direction-dependent response
A surface does not necessarily reflect incoming light equally in every direction. Its measured brightness can change as the positions of the Sun, surface and sensor change, even when the surface itself is similar. The bidirectional reflectance distribution function provides a framework for describing this directional behaviour. In practical image analysis, the relevant lesson is that a difference between observations may contain a geometry effect as well as a real surface change. Canopy structure, shadows and surface roughness can all influence that relationship.
The magnitude and pattern of a geometry effect depend on the landscape and spectral measurement. A row crop, closed forest and exposed soil need not behave in the same way. Terrain introduces another layer because slope and aspect alter local illumination. A simple brightness adjustment is not automatically an adequate solution. A workflow should first identify the type of comparison it needs and whether the available product already includes a relevant normalisation. Applying an additional correction without understanding prior processing can create a new inconsistency.
Normalise geometry with a clear purpose
Geometry normalisation uses a model or adjustment to express observations under a more consistent reference condition. It is an approximation designed for a defined purpose, and its performance should be checked rather than assumed. Keep the input geometry, model assumptions and processing version where they are available. Compare representative surfaces before and after the adjustment. A useful test examines whether the correction reduces systematic variation in stable areas while preserving changes that are supported independently by management records or field observations.
For an agricultural service, the importance of this effect depends on the size of the change being interpreted. A subtle trend can be more sensitive to residual geometry variation than a major harvest event. Evaluate whether an apparent improvement in a time series survives across seasons and fields, including those with different canopy arrangements. Retain a clear explanation of what has been normalised and what remains uncertain. Viewing geometry becomes manageable when it is treated as part of the measurement context instead of being attributed silently to crop condition or land-cover change.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Deliver quality flags that users can interpret
Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.
Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.
Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



