A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers harmonising satellite observation time series along changing sandy shorelines. The immediate decision is to review shoreline positions over time. Useful reference evidence includes acquisition context, field positions and consistent shoreline definitions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Changing sandy shorelines
A shoreline is not always one fixed boundary that every observation measures in the same way. The visible water edge, a vegetation boundary and another mapped coastal indicator can represent different features. A monitoring programme should define its chosen shoreline consistently before comparing dates. Tidal conditions, wave state, seasonal beach changes and the geometry of the image can all influence the position recorded, even without a lasting change in the coast.
Spatial resolution and alignment determine the precision with which a boundary can be located. A sharply drawn line on a map should not imply more positional certainty than the observations support. Compare acquisitions under suitable conditions and retain the information needed to examine their differences. Mixed pixels, shadows and narrow coastal features may require manual review or an uncertainty zone rather than an automatic interpretation at every location.
Field validation should use the same shoreline definition as the image analysis and record when and how a position was measured. A visit under different water conditions may represent a different boundary even if its coordinates are accurate. Evaluate change over appropriate distances and periods, and avoid treating every small mapped displacement as erosion or deposition. A transparent product shows the observed positions, their dates and the uncertainty relevant to the decision being considered.
More observations require a common measurement definition
Combining observations from different satellites can increase the information available through time, but the resulting series needs a common analytical definition. Instruments may differ in spectral response, spatial sampling, viewing geometry and processing history. Two bands with similar names are not necessarily equivalent measurements. Harmonisation addresses selected differences so that observations can be used together more consistently. It should be understood as a documented processing approach with remaining limitations, rather than a guarantee that every value from every sensor is interchangeable.
A suitable workflow begins with the variables that need to be compared. Identify the input products, their physical meaning and the transformations already applied. A common grid helps organise observations spatially, while atmospheric correction, geometry normalisation and spectral adjustments may address other differences. These operations have distinct purposes. Applying only one of them should not be described as complete harmonisation. Retain sensor identity and acquisition metadata even when the user sees one combined series, because those attributes remain valuable for diagnosing an apparent discontinuity.
Validate continuity before interpreting a longer record
Test continuity using overlapping or otherwise comparable observations and independent evidence where available. Inspect several surface types and canopy conditions rather than evaluating only one convenient landscape. A consistent average relationship can still hide a meaningful difference for a particular crop or season. Examine how the combined record affects the final product, including index thresholds, fitted timing metrics and change alerts. The relevant question is whether the remaining differences are acceptable for that application, not merely whether the images appear similar on a map.
A longer record also requires a stable policy for quality screening and updates. Changes in input collections, calibration or processing versions can affect historical outputs. Version the workflow and preserve enough information to reproduce earlier results when necessary. When a series crosses a known processing change, evaluate the transition explicitly. A harmonised dataset can provide a strong foundation for monitoring, but field context and validation still determine the usefulness of its interpretation. Maintaining traceability allows additional observations to improve coverage without concealing their origins or implying a precision that has not been demonstrated.
Define a representative reference sample
A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.
Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.
Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.
Organise imagery and results for reliable retrieval
A useful storage design helps people and software find the right observation without relying on informal knowledge of folder names. Separate immutable source data from temporary processing files and delivered products. Give each observation a stable identifier and preserve its acquisition metadata alongside the file. A predictable organisation reduces the chance that a later analysis accidentally uses a preview, an outdated result, or an intermediate product whose meaning has not been documented.
Choose an indexing scheme that reflects the questions the workflow needs to answer. Location, acquisition time, source, product type, and processing version are often useful search dimensions. The physical arrangement of files can differ from the logical catalogue, provided that the relationship is maintained reliably. Record checksums or other integrity information where appropriate, and test whether an observation can be recovered using the catalogue rather than a particular operator's memory.
Define retention rules for source, intermediate, and delivered information. Some intermediate products are inexpensive to reproduce, while others embody costly preparation or expert review. Keep the inputs and configuration needed to rebuild a result before removing reproducible files. Test backup and recovery procedures with representative products, including their metadata and geographic references. Reliable retrieval is demonstrated by a successful reconstruction of useful information, rather than by the existence of an untested copy.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



