A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers turning collected imagery into delivered data around active construction sites. The immediate decision is to prioritise sites requiring progress review. Useful reference evidence includes dated site records and consistently located surface observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Start with the data that must reach users
A satellite camera's collection rate and a radio's advertised bit rate do not determine how much useful imagery reaches the ground. The complete data path includes detector output, onboard processing, storage, contact scheduling, transmission and ground processing. Each stage can constrain delivery. Begin with an observation plan and estimate the data it generates, including spectral bands, sampling, encoding, metadata and housekeeping information.
Distinguish raw payload rate from the net rate available for science files. Framing, error control, protocol overhead and operational interruptions reduce effective throughput. Compression can lower volume, but its value depends on scene content and acceptable information loss. Test a representative range of imagery and assess whether any lossy approach alters the measurements needed by the application. A visually pleasing result is not sufficient evidence for quantitative analysis.
Model contacts, storage and recovery together
Ground contacts depend on orbit geometry, station location, visibility constraints and access to the station schedule. The highest rate may be available only during part of a pass. A link budget combines transmitter power, antenna gains, propagation loss, receiver performance and other losses to assess whether the required performance is feasible. Antenna orientation and spacecraft pointing must be consistent with imaging, power generation and other operating demands.
Use a time ordered simulation to track the stored data backlog. Add each planned acquisition and subtract the amount that can actually be delivered during usable contacts. Include missed passes, reduced rates and retransmission policy where relevant. Storage must accommodate plausible disruptions as well as nominal operation. Define priorities and deletion rules before the buffer fills, preserving the metadata needed to identify what was collected and what was lost.
The ground segment needs more than an antenna. It must authenticate commands where applicable, receive and verify files, detect gaps, maintain acquisition records and feed the processing pipeline. Measure latency from observation to the user's usable product, since a successfully received file may still wait for calibration or quality checks. End to end tests should exercise realistic file sizes and interrupted transfers. A sound delivery plan balances collection ambition with energy, contact time and processing capacity, so that an observation schedule produces a dependable flow of usable information.
The setting: Construction site change
A construction site can progress through clearing, ground works, temporary storage, structural development and surface finishing. A satellite image may reveal some visible changes without establishing whether the project has reached a contractual or operational milestone. Define the monitoring objective in terms of observable surfaces and the decisions the information should support. Site boundaries and a reliable sequence of dated records provide the context needed to distinguish project activity from changes in neighbouring land.
The size and arrangement of features determine what the image can resolve. Stockpiles, temporary access routes and partly completed structures may be mixed with other surfaces within an observation. Shadows and acquisition geometry can also change the appearance of buildings. Compare quality-screened observations and retain the dates supporting each mapped change. A map should not imply that every visible feature was measured independently or that its physical dimensions are known more precisely than the data allow.
Validation should use dated site observations that describe the same area and feature definition as the analysis. Record temporary works and other context that might explain an apparent change. A remote observation can help select a site for review, while more specific statements about project progress need relevant project records. Evaluate whether the product provides useful and timely evidence for that review, including examples where a conspicuous image change had an ordinary or temporary explanation.
Translate the decision into observation requirements
Start with the decision that the information is intended to support. Describe the geographic unit, the time available for acting, and the consequence of an incorrect interpretation. A requirement such as detecting an unusual pattern across management blocks is different from identifying its cause. Keeping that distinction explicit helps a team select measurements that are relevant to the application and prevents later evaluation from drifting towards whatever result happens to be easiest to demonstrate.
Build a compact requirements matrix linking each decision to the evidence needed, the proposed observation source, and an acceptance condition. Include geographic accuracy, temporal relevance, quality screening, and the context required for interpretation. The matrix should also identify the evidence used to justify each requirement. An engineering preference or a convenient data source can inform a study, but neither should silently replace a documented information need.
Review the matrix with the people who will use the result. Ask how their response would change when information is delayed, incomplete, or uncertain. Record unresolved requirements as questions for a pilot rather than converting them into confident specifications. This produces a practical framework for comparing technical options, designing tests, and explaining why an observation is useful to the intended workflow.
Deliver quality flags that users can interpret
Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.
Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.
Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



