A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers estimating coastal water quality from ocean colour across estuarine mixing zones. The immediate decision is to plan sampling across estuarine gradients. Useful reference evidence includes tidal stage, sample timing and water-variable measurements. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Estuarine mixing zones
An estuary connects river inflow, coastal water, tidal conditions and complex shorelines. The resulting image pattern may change even when a monitoring team has not altered its methods. A useful design begins with a specific question, such as mapping visible water or investigating a persistent spectral gradient. It should not assume that one relationship describes every part of the estuary or that a single acquisition represents conditions throughout a tidal cycle.
Comparison units should account for channels, shallow margins and locations where land and water are mixed within an observation. Review cloud and atmospheric quality, surface reflection and geometric alignment before interpreting a difference between dates. Tidal and inflow context can help explain the setting but does not replace measurements of the target variable. Preserve the acquisition times and valid areas so that a mapped feature can be evaluated against the conditions under which it was observed.
A validation plan should represent different water types and spatial positions across the mixing zone. Collect the timing and location of samples consistently, and consider whether conditions changed between sampling and acquisition. A spectral boundary may help organise an investigation without proving a particular source or ecological consequence. More specific interpretations require evidence designed for those claims, while an auditable record of observed patterns and sampling priorities can already improve the structure of a monitoring programme.
Identify the quantity behind the colour
Coastal water colour carries information about materials that absorb and scatter light, including phytoplankton pigments, suspended particles, and dissolved organic matter. A satellite measures radiation reaching the sensor; estimating water quality requires separating the atmospheric contribution and then interpreting the remaining water signal. Specify the target variable and units before choosing an algorithm. Chlorophyll concentration, turbidity, suspended sediment concentration, and water clarity are related in some settings, but they are not interchangeable measurements.
Coasts are especially difficult because several optically active constituents can vary independently. A band ratio calibrated for clear offshore water may fail in a sediment rich estuary. Reflected light from nearby land can contaminate coastal pixels, sun glint can dominate the surface signal, and shallow bottoms can influence apparent colour. Cloud, haze, whitecaps, and mixed land water pixels further reduce usable coverage. Selecting an atmospheric correction method and applying its quality flags are scientific choices, not merely file preparation. Examine spectra and spatial patterns before accepting a plausible looking concentration map.
Match observations to a changing coast
Design validation around the speed of coastal change. Field measurements taken several hours away from the satellite overpass may describe another water mass after tides, currents, or river discharge have shifted conditions. Record sampling time, position, depth, instrument calibration, laboratory methods, and the spatial variability around each station. Satellite pixels integrate an area, while a bottle sample represents a much smaller volume. Use suitable matchups and inspect surrounding pixels rather than pairing every station with the nearest value automatically.
Develop or select retrieval relationships using samples that span the expected range of conditions. Reserve independent data for evaluation and report bias, error, valid sample count, and cases rejected by quality screening. Compare algorithms on the same matchups to avoid misleading differences caused by sampling. Provide acquisition dates, water masks, uncertainty information, and clearly labeled units with every map. A surface optical product does not establish conditions throughout the water column, and a pigment estimate does not by itself identify a harmful species or toxin. Used with field observations and local hydrology, the imagery can reveal spatial gradients and help prioritize where additional sampling is needed.
Define a representative reference sample
A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.
Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.
Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.
Translate the decision into observation requirements
Start with the decision that the information is intended to support. Describe the geographic unit, the time available for acting, and the consequence of an incorrect interpretation. A requirement such as detecting an unusual pattern across management blocks is different from identifying its cause. Keeping that distinction explicit helps a team select measurements that are relevant to the application and prevents later evaluation from drifting towards whatever result happens to be easiest to demonstrate.
Build a compact requirements matrix linking each decision to the evidence needed, the proposed observation source, and an acceptance condition. Include geographic accuracy, temporal relevance, quality screening, and the context required for interpretation. The matrix should also identify the evidence used to justify each requirement. An engineering preference or a convenient data source can inform a study, but neither should silently replace a documented information need.
Review the matrix with the people who will use the result. Ask how their response would change when information is delayed, incomplete, or uncertain. Record unresolved requirements as questions for a pilot rather than converting them into confident specifications. This produces a practical framework for comparing technical options, designing tests, and explaining why an observation is useful to the intended workflow.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



