Remote observations show patterns, while practical decisions depend on explaining what those patterns could mean. Interpretation therefore requires more than locating a high or low value on a map. A useful analysis considers the timing of the observation, the physical processes that influence the measurement, and the information available from complementary sources. This perspective separates an observed signal from a proposed explanation and from an action recommended to a user. Keeping those stages distinct makes it easier to investigate alternative causes, communicate ambiguity, and choose a proportionate next step.
This working guide considers designing ground validation for satellite products in coastal payload studies. The immediate decision is to connect coastal applications to instrument requirements. Useful reference evidence includes water-reference measurements and documented observation conditions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Start with the intended claim
Validation tests how well a product represents a defined quantity under specified conditions. It differs from calibration, which adjusts an instrument or model using reference information. Begin with the claim the product needs to support: class membership, surface reflectance, canopy height, water quality, or an area estimate. State the required spatial scale, time interval, and acceptable error. These choices determine the reference method and sample design. Collecting convenient field points first and deciding later what they prove usually leaves important conditions untested.
Reference measurements also contain uncertainty. Positioning error can place a sample in the wrong satellite pixel, a point instrument may not represent a heterogeneous footprint, and measurements made on different dates can describe real surface change. Record instrument calibration, sampling protocols, timestamps, coordinates, observation conditions, and uncertainty where available. For interpreted labels, retain the evidence used, class rules, and ambiguous cases. Agreement among interpreters is useful to examine, but agreement alone does not guarantee that the shared interpretation is correct.
Keep the assessment independent
Separate validation data from observations used to fit thresholds, train models, select features, or tune processing. If assessment sites repeatedly influence revisions, they have become development data and a fresh independent assessment is needed. Spatially clustered samples can make performance look stronger when neighboring training and test locations share conditions. Use a design that reflects the target population and report its limitations, including inaccessible areas or environmental conditions missing from the sample.
Choose metrics that match the product. For categorical maps, examine a confusion matrix and errors for individual classes, not just overall agreement. For continuous measurements, report bias and a suitable error measure alongside sample count and the range of reference values. Plot residuals against relevant conditions to expose failures hidden by an average. For area estimates, carry the probability sampling design through estimation and uncertainty calculations. Preserve rejected matchups and their reasons so that quality screening remains auditable. A useful validation report explains where the product works, where evidence is sparse, and which errors matter for the intended decision. Publishing reference protocols and assessment code makes later comparisons more credible and helps others reproduce the evaluation.
The setting: Coastal payload studies
A coastal satellite payload study should specify which observations the proposed instrument is intended to support. Mapping visible water boundaries, distinguishing broad surface patterns and estimating a particular water variable create different requirements. Coastal measurements can contain contributions from atmosphere, water, seabed, surface reflection and nearby land. The study therefore needs a clear application definition before a spectral configuration is treated as sufficient evidence that a useful product can be delivered.
Early application trials can use suitable existing observations and representative field measurements to examine these requirements. Record the water types, acquisition conditions and spatial scales represented in each trial. A method that behaves well in one setting may not transfer to another coastal environment without further evaluation. Image detail and the ability to separate narrow features should be assessed through the actual measurement chain rather than inferred from the appearance of a concept rendering.
The resulting requirements should address spectral response, calibration, geometry and the timing of usable observations alongside power, pointing and data delivery. Reference campaigns need measurements that describe the target variable under conditions relevant to the intended use. A practical study links each proposed capability to a test and an application need. This allows a future coastal mission concept to develop through evidence rather than relying on a general promise that additional bands alone will resolve every interpretation problem.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Deliver quality flags that users can interpret
Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.
Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.
Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.
Bring the evidence back to the decision
A strong interpretation states what was observed, which explanations remain plausible, and what additional evidence would help distinguish them. Avoid presenting a convenient label as a confirmed cause when the measurements support only a broader pattern. Connect the proposed next step to the significance of the decision and the confidence available. This creates an interpretation that a field team, analyst, or project partner can examine, challenge, and improve as further observations become available.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



