A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers mapping flood extent with optical and radar imagery around energy infrastructure sites. The immediate decision is to review visible changes around infrastructure. Useful reference evidence includes site boundaries, operation context and dated field observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Energy infrastructure sites
An energy infrastructure site can combine buildings, equipment, access routes, vegetation, water and managed open land. A remote observation may be useful for reviewing visible changes around the site, but its interpretation depends on the feature and decision being studied. Mapping land-cover change, documenting surrounding vegetation and investigating a water pattern are separate objectives. Establish the site boundary and the relevant observation units before selecting analytical features or thresholds.
Large structures can introduce shadows and geometric effects, while narrow management zones may contain mixed observations. Review whether the image resolution supports the detail presented in the report. A change in nearby vegetation may follow normal maintenance, seasonal development or another land-use activity. Preserve the acquisition dates and any available operational context so that an observed pattern can be investigated without assigning an unsupported explanation to it.
Validation should describe the actual surface or feature observed and the spatial area represented by each record. Measurements inside the site and observations of its surroundings may answer different questions and should remain distinguishable. A satellite-derived alert can support a site review without establishing equipment performance or a particular operational condition. Evaluate whether the product provides relevant, interpretable evidence for the intended monitoring task, including instances where follow-up found that a visible change was expected or temporary.
Read the water signal in context
A flood extent map describes water visible at a particular observation time. It does not automatically describe maximum inundation, water depth, or the safety of a road. Begin by defining the event window, study boundary, permanent water baseline, and the smallest flooded area the analysis needs to represent. These decisions determine whether individual scenes, a time series, or several complementary sensors are appropriate. A satellite may pass after a short flood has already receded, so absence of mapped water is not evidence that flooding never occurred.
Optical imagery can separate open water from many surrounding surfaces because water strongly absorbs near infrared and shortwave infrared radiation. Clouds, cloud shadows, turbid water, floating vegetation, and dark roofs complicate that interpretation. Radar can observe through cloud and without sunlight, but its response depends on surface roughness, viewing geometry, polarization, and vegetation. Smooth open water often appears dark; wind can brighten it, while flooded vegetation can produce stronger returns. Neither a universal darkness threshold nor a single water index works reliably in every landscape.
Build and qualify an extent product
For optical analysis, use compatible reflectance products, inspect quality flags, and retain explicit masks for cloud and shadow. For radar, apply the corrections required by the selected product, account for terrain effects, and compare acquisitions with similar viewing geometry. A pre-event reference helps distinguish newly inundated land from reservoirs, wetlands, and persistent channels. Elevation and drainage information can expose implausible isolated detections, but a terrain rule should not silently remove real flooding behind an embankment.
Keep observed flood, permanent water, dry land, and unobserved areas as separate classes. Check results against independent reference observations collected close to acquisition time, including difficult boundaries and built environments. Document missed inundation and false alarms instead of reporting only a visually convincing example. Record acquisition timestamps, sensor and processing versions, thresholds, and validation limitations with the exported layer. When several dates are combined, identify the composite period clearly. An exposure overlay can then intersect the qualified extent with roads, settlements, or fields while preserving the distinction between observed water and inferred consequences.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Match the timing of reference observations
The value of a reference measurement depends partly on how well its timing matches the observation being evaluated. A surface, crop, water body, or instrument state may change between the two measurements. Start by documenting the acquisition time of every source and the period over which the reference observation applies. Avoid treating a date entered during data upload as though it were necessarily the time when the measurement was collected.
Define an acceptable timing relationship for the application. A slowly changing structural feature may tolerate a broader comparison window than a rapidly changing surface condition. The window should be justified by the process being studied and by any available contextual records. If conditions change within that period, consider separating the observations into suitable groups rather than combining them under a single assumption of comparability.
Preserve information about interventions and events between observations. A management operation, rainfall episode, disturbance, or change in sensor configuration can alter the interpretation of a comparison. Record the event and decide whether the pair remains suitable for evaluation. Where the timing mismatch cannot be resolved, describe the comparison as qualified evidence. This is more informative than allowing an uncertain match to influence a performance statistic without explanation.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



