A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers radiometric calibration and reflectance consistency in turbid coastal waters. The immediate decision is to identify coastal sampling priorities. Useful reference evidence includes water samples, surface conditions and acquisition-time context. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Define the quantity that the instrument records
Radiometric calibration establishes a documented relationship between an instrument's recorded output and the physical quantity it is intended to represent. A stored pixel value may be a digital number, a scaled radiance or reflectance value, or another processed representation. Those alternatives should not be treated as interchangeable. The calibration chain explains how the recorded signal becomes an interpretable measurement and which corrections have already been applied. Understanding that chain is essential before comparing dates, combining bands or transferring a model between instruments.
Instrument response can vary across detectors, channels and operating conditions. Calibration therefore concerns more than selecting one conversion coefficient. A study may need to consider offsets, response differences, noise, saturation and changes in behaviour over time. The appropriate characterisation depends on the instrument and its intended use. For a future payload concept, these are requirements to investigate rather than capabilities established by an attractive render. The presence of a multispectral camera alone does not demonstrate that its channels produce consistent, quantitatively comparable observations.
Track consistency through the complete chain
At the product level, begin with the supplier's definitions and metadata. Check scale factors, additive offsets, fill values and valid ranges before deriving an index or statistical summary. Preserve the processing version so that an output can be reproduced later. Inspect whether extreme values correspond to real surfaces or to invalid observations. When a dataset is updated, compare representative old and new results rather than assuming that a familiar file name guarantees an unchanged numerical meaning throughout the archive.
Validation should cover the full chain that supports the stated application. A stable response in a laboratory test is valuable evidence, while operational imagery introduces additional effects from atmosphere, geometry and scene complexity. Use independent references suited to the measurement scale and report the relevant uncertainty. Maintain a record of corrections and their limitations when delivering results to users. A traceable radiometric workflow supports meaningful comparisons and helps separate a change in the observation system from a change in the landscape that a monitoring service is trying to describe.
The setting: Turbid coastal waters
Turbid coastal waters contain changing mixtures of suspended material, dissolved substances, biological components and surface reflections. Their image appearance may vary over short distances and between acquisitions. A monitoring design should identify which variable or pattern it aims to investigate rather than treating every colour difference as a direct water-quality measurement. Coastal geometry and the proximity of land also influence which parts of an image provide a defensible observation of water.
Review atmospheric conditions, cloud, shadow, sun glint and land adjacency before comparing spectral measurements. Shallow-bottom contributions can matter in some places, while deeper areas may present a different interpretation problem. A relationship developed for one water type should not be transferred automatically to another. Retain the valid observation mask and the dates supporting each map so that users can distinguish measured patterns from periods without suitable optical evidence.
Field validation should sample the range of conditions in which a model or interpretation rule will operate. Record collection time, location and the measurement method for the target variable, together with relevant surface conditions. Samples and imagery separated by a changing coastal event may not be comparable. A useful product can guide sampling or describe a consistent spectral pattern, with stronger numerical water-quality claims introduced only when their calibration and independent evaluation support the intended application.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



