A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers mapping flood extent with optical and radar imagery in turbid coastal waters. The immediate decision is to identify coastal sampling priorities. Useful reference evidence includes water samples, surface conditions and acquisition-time context. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Read the water signal in context
A flood extent map describes water visible at a particular observation time. It does not automatically describe maximum inundation, water depth, or the safety of a road. Begin by defining the event window, study boundary, permanent water baseline, and the smallest flooded area the analysis needs to represent. These decisions determine whether individual scenes, a time series, or several complementary sensors are appropriate. A satellite may pass after a short flood has already receded, so absence of mapped water is not evidence that flooding never occurred.
Optical imagery can separate open water from many surrounding surfaces because water strongly absorbs near infrared and shortwave infrared radiation. Clouds, cloud shadows, turbid water, floating vegetation, and dark roofs complicate that interpretation. Radar can observe through cloud and without sunlight, but its response depends on surface roughness, viewing geometry, polarization, and vegetation. Smooth open water often appears dark; wind can brighten it, while flooded vegetation can produce stronger returns. Neither a universal darkness threshold nor a single water index works reliably in every landscape.
Build and qualify an extent product
For optical analysis, use compatible reflectance products, inspect quality flags, and retain explicit masks for cloud and shadow. For radar, apply the corrections required by the selected product, account for terrain effects, and compare acquisitions with similar viewing geometry. A pre-event reference helps distinguish newly inundated land from reservoirs, wetlands, and persistent channels. Elevation and drainage information can expose implausible isolated detections, but a terrain rule should not silently remove real flooding behind an embankment.
Keep observed flood, permanent water, dry land, and unobserved areas as separate classes. Check results against independent reference observations collected close to acquisition time, including difficult boundaries and built environments. Document missed inundation and false alarms instead of reporting only a visually convincing example. Record acquisition timestamps, sensor and processing versions, thresholds, and validation limitations with the exported layer. When several dates are combined, identify the composite period clearly. An exposure overlay can then intersect the qualified extent with roads, settlements, or fields while preserving the distinction between observed water and inferred consequences.
The setting: Turbid coastal waters
Turbid coastal waters contain changing mixtures of suspended material, dissolved substances, biological components and surface reflections. Their image appearance may vary over short distances and between acquisitions. A monitoring design should identify which variable or pattern it aims to investigate rather than treating every colour difference as a direct water-quality measurement. Coastal geometry and the proximity of land also influence which parts of an image provide a defensible observation of water.
Review atmospheric conditions, cloud, shadow, sun glint and land adjacency before comparing spectral measurements. Shallow-bottom contributions can matter in some places, while deeper areas may present a different interpretation problem. A relationship developed for one water type should not be transferred automatically to another. Retain the valid observation mask and the dates supporting each map so that users can distinguish measured patterns from periods without suitable optical evidence.
Field validation should sample the range of conditions in which a model or interpretation rule will operate. Record collection time, location and the measurement method for the target variable, together with relevant surface conditions. Samples and imagery separated by a changing coastal event may not be comparable. A useful product can guide sampling or describe a consistent spectral pattern, with stronger numerical water-quality claims introduced only when their calibration and independent evaluation support the intended application.
Keep an auditable review record
A review record should explain how a result moved from an analytical output to an accepted interpretation or operational decision. Preserve the product identifier, the evidence considered, the reviewer role, and the outcome of the review. A short, consistent record is often more useful than an extensive free-text note that cannot be compared between cases. The objective is to make important decisions traceable without turning routine review into unnecessary administrative work.
Separate observations from conclusions within the record. Describe the evidence visible to the reviewer, the alternative explanations considered where relevant, and the reason for accepting, qualifying, or rejecting the result. If a correction is required, identify what should change and how the revised product relates to the earlier version. Keep unresolved questions visible so that they can be addressed by another observation or by the person responsible for the next action.
Use the accumulated record to improve the workflow. Recurring review reasons can reveal unclear requirements, missing contextual information, unstable processing steps, or an evaluation gap. Examine whether similar cases receive similar decisions across reviewers and over time. Preserve the relationship between feedback and subsequent revisions so that improvements can be assessed against the evidence that motivated them. An auditable record supports learning, accountability, and consistent delivery while allowing the technical process to evolve.
Check spatial alignment before comparison
A comparison between images, channels, maps, or field measurements assumes that the observations refer to the same locations at a suitable level of precision. Small alignment errors can become especially important near boundaries or narrow features. Before interpreting differences, inspect whether identifiable, stable features agree between the sources. A common coordinate reference is necessary for many workflows, but it does not by itself demonstrate accurate alignment.
Use control features that are appropriate for the observation scale and remain stable across the comparison period. Evaluate alignment in more than one part of the area, because a single location cannot reveal spatially varying distortion. Record the method used to estimate any correction and retain independent features for checking the corrected result. Where surfaces have genuinely changed, avoid using those changes as evidence of an alignment error.
Propagate the implications of remaining misalignment into the analysis. A workflow may exclude boundary pixels, summarise at a broader scale, or qualify interpretations for small features. The choice should follow the application rather than a preference for visually smooth output. Preserve both the original and corrected geographic references, and document resampling decisions so that future users can understand how measurements were moved onto a common spatial framework.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



