A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers estimating coastal water quality from ocean colour along river water corridors. The immediate decision is to prioritise river reaches for sampling. Useful reference evidence includes sampling time, river stage and reach-specific water observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: River water corridors
A river corridor can vary quickly in width, bank exposure, flow conditions and the surrounding land cover. A remotely observed reach may include water, sediment, vegetation and structures within the same footprint. Define the monitoring question before choosing an interpretation scale. Mapping the position of visible water, investigating a colour change and estimating a particular water-quality variable are different tasks, even where they draw on the same acquisition.
Spatial resolution and geometric alignment are critical for narrow reaches. A small offset can change how much bank or vegetation contributes to a measurement. Cloud, shadow, surface reflection and adjacency effects can further complicate optical interpretation. Compare suitable acquisitions and retain the exact dates supporting each reach summary. Where river conditions change rapidly, consider whether the available observation frequency is sufficient for the decision the service is intended to support.
Field sampling should identify the sampled reach, location and collection time, together with river conditions that affect comparability. A single bank-side sample may not describe the full width or a downstream reach observed at another time. A spectral anomaly can help select an investigation site without establishing its cause. More specific claims require a validated relationship with representative measurements, while a transparent water and reach inventory can already make a sampling programme more systematic.
Identify the quantity behind the colour
Coastal water colour carries information about materials that absorb and scatter light, including phytoplankton pigments, suspended particles, and dissolved organic matter. A satellite measures radiation reaching the sensor; estimating water quality requires separating the atmospheric contribution and then interpreting the remaining water signal. Specify the target variable and units before choosing an algorithm. Chlorophyll concentration, turbidity, suspended sediment concentration, and water clarity are related in some settings, but they are not interchangeable measurements.
Coasts are especially difficult because several optically active constituents can vary independently. A band ratio calibrated for clear offshore water may fail in a sediment rich estuary. Reflected light from nearby land can contaminate coastal pixels, sun glint can dominate the surface signal, and shallow bottoms can influence apparent colour. Cloud, haze, whitecaps, and mixed land water pixels further reduce usable coverage. Selecting an atmospheric correction method and applying its quality flags are scientific choices, not merely file preparation. Examine spectra and spatial patterns before accepting a plausible looking concentration map.
Match observations to a changing coast
Design validation around the speed of coastal change. Field measurements taken several hours away from the satellite overpass may describe another water mass after tides, currents, or river discharge have shifted conditions. Record sampling time, position, depth, instrument calibration, laboratory methods, and the spatial variability around each station. Satellite pixels integrate an area, while a bottle sample represents a much smaller volume. Use suitable matchups and inspect surrounding pixels rather than pairing every station with the nearest value automatically.
Develop or select retrieval relationships using samples that span the expected range of conditions. Reserve independent data for evaluation and report bias, error, valid sample count, and cases rejected by quality screening. Compare algorithms on the same matchups to avoid misleading differences caused by sampling. Provide acquisition dates, water masks, uncertainty information, and clearly labeled units with every map. A surface optical product does not establish conditions throughout the water column, and a pigment estimate does not by itself identify a harmful species or toxin. Used with field observations and local hydrology, the imagery can reveal spatial gradients and help prioritize where additional sampling is needed.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



