A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers turning collected imagery into delivered data within seasonal wetland areas. The immediate decision is to review changes in inundation and cover. Useful reference evidence includes water presence, vegetation structure and dated site observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Seasonal wetland areas
A seasonal wetland is a changing combination of open water, wet soil, emergent vegetation and drier surfaces. An image feature that separates water from land during one period may behave differently when vegetation becomes denser or the surface changes. Define the mapping objective and its seasonal context carefully. Monitoring visible inundation, describing vegetation change and assessing an ecological outcome require different reference information and should not be merged into one unqualified indicator.
The observation footprint may mix several wetland components, particularly along narrow channels and patchy margins. Optical data can be limited by clouds and by vegetation that obscures water below. Complementary observations can add useful information, but they describe different physical properties and need their own interpretation. Retain dates, quality information and the spatial support used in each result so that a user can judge what the observations actually establish.
Field validation should record water presence and vegetation conditions separately at known locations. Sampling only easily reached dry margins may misrepresent the interior or the range of seasonal states. A change in mapped extent can help select sites for review without explaining its cause. More specific conclusions about habitat condition or management success need measurements aligned with those outcomes. A transparent monitoring record should distinguish observed surface changes from interpretations supported by additional field evidence.
Start with the data that must reach users
A satellite camera's collection rate and a radio's advertised bit rate do not determine how much useful imagery reaches the ground. The complete data path includes detector output, onboard processing, storage, contact scheduling, transmission and ground processing. Each stage can constrain delivery. Begin with an observation plan and estimate the data it generates, including spectral bands, sampling, encoding, metadata and housekeeping information.
Distinguish raw payload rate from the net rate available for science files. Framing, error control, protocol overhead and operational interruptions reduce effective throughput. Compression can lower volume, but its value depends on scene content and acceptable information loss. Test a representative range of imagery and assess whether any lossy approach alters the measurements needed by the application. A visually pleasing result is not sufficient evidence for quantitative analysis.
Model contacts, storage and recovery together
Ground contacts depend on orbit geometry, station location, visibility constraints and access to the station schedule. The highest rate may be available only during part of a pass. A link budget combines transmitter power, antenna gains, propagation loss, receiver performance and other losses to assess whether the required performance is feasible. Antenna orientation and spacecraft pointing must be consistent with imaging, power generation and other operating demands.
Use a time ordered simulation to track the stored data backlog. Add each planned acquisition and subtract the amount that can actually be delivered during usable contacts. Include missed passes, reduced rates and retransmission policy where relevant. Storage must accommodate plausible disruptions as well as nominal operation. Define priorities and deletion rules before the buffer fills, preserving the metadata needed to identify what was collected and what was lost.
The ground segment needs more than an antenna. It must authenticate commands where applicable, receive and verify files, detect gaps, maintain acquisition records and feed the processing pipeline. Measure latency from observation to the user's usable product, since a successfully received file may still wait for calibration or quality checks. End to end tests should exercise realistic file sizes and interrupted transfers. A sound delivery plan balances collection ambition with energy, contact time and processing capacity, so that an observation schedule produces a dependable flow of usable information.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Preserve a reproducible processing history
A result should be linked to the inputs and processing choices that produced it. Record source identifiers, software versions, configuration values, reference data versions, and the time of processing. The record does not need to expose every internal implementation detail to the end user. It must preserve enough information for the producing team to investigate a result, reproduce a comparison, and explain why a revised product differs from an earlier version.
Version changes that can affect the meaning of the output. Updated boundaries, a new quality mask, revised calibration, different model parameters, or altered aggregation rules can all change results even when the source imagery is unchanged. Avoid overwriting an earlier product without retaining a suitable history. A clear relationship between versions helps users distinguish an improvement in processing from a real change in the observed surface.
Use representative regression cases when modifying the workflow. Select cases that cover ordinary conditions and known failure modes, then compare meaningful outputs before and after the change. Investigate differences against the intended purpose of the revision rather than assuming that a closer visual match is always preferable. Preserve the review decision with the version record. Reproducibility becomes practical when the team can trace a result through a documented sequence of inputs, transformations, tests, and delivery decisions.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



