A convincing image can still contain measurements that are unsuitable for a particular task. Quality control asks whether the inputs, transformations, and outputs meet the requirements of the intended application. This perspective follows evidence through the workflow, from acquisition metadata and reference observations to the final interpretation. It encourages teams to define acceptance conditions before seeing the result, rather than adjusting them to favour a preferred conclusion. The purpose is a repeatable way to distinguish usable observations, observations requiring qualification, and observations that should be excluded from a decision.
This working guide considers designing ground validation for satellite products within mission readiness studies. The immediate decision is to connect mission claims to measured evidence. Useful reference evidence includes documented requirements, test results and unresolved design questions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Start with the intended claim
Validation tests how well a product represents a defined quantity under specified conditions. It differs from calibration, which adjusts an instrument or model using reference information. Begin with the claim the product needs to support: class membership, surface reflectance, canopy height, water quality, or an area estimate. State the required spatial scale, time interval, and acceptable error. These choices determine the reference method and sample design. Collecting convenient field points first and deciding later what they prove usually leaves important conditions untested.
Reference measurements also contain uncertainty. Positioning error can place a sample in the wrong satellite pixel, a point instrument may not represent a heterogeneous footprint, and measurements made on different dates can describe real surface change. Record instrument calibration, sampling protocols, timestamps, coordinates, observation conditions, and uncertainty where available. For interpreted labels, retain the evidence used, class rules, and ambiguous cases. Agreement among interpreters is useful to examine, but agreement alone does not guarantee that the shared interpretation is correct.
Keep the assessment independent
Separate validation data from observations used to fit thresholds, train models, select features, or tune processing. If assessment sites repeatedly influence revisions, they have become development data and a fresh independent assessment is needed. Spatially clustered samples can make performance look stronger when neighboring training and test locations share conditions. Use a design that reflects the target population and report its limitations, including inaccessible areas or environmental conditions missing from the sample.
Choose metrics that match the product. For categorical maps, examine a confusion matrix and errors for individual classes, not just overall agreement. For continuous measurements, report bias and a suitable error measure alongside sample count and the range of reference values. Plot residuals against relevant conditions to expose failures hidden by an average. For area estimates, carry the probability sampling design through estimation and uncertainty calculations. Preserve rejected matchups and their reasons so that quality screening remains auditable. A useful validation report explains where the product works, where evidence is sparse, and which errors matter for the intended decision. Publishing reference protocols and assessment code makes later comparisons more credible and helps others reproduce the evaluation.
The setting: Mission readiness studies
A mission readiness study connects the intended application with the evidence available from the spacecraft and ground system. A target launch year or an attractive rendering can help communicate a vision, but neither establishes that the observation service is ready. Begin with the capabilities the mission is supposed to demonstrate and identify how each will be assessed. Requirements should remain traceable to user needs rather than accumulating as an unrelated list of desirable specifications.
The review should consider the observation payload, pointing, power, communications, processing and delivery as parts of one chain. A promising subsystem test may still leave an important gap elsewhere in that chain. Record the conditions under which each result was obtained, the applicable uncertainty and the design version it represents. Changes in architecture or application requirements should trigger a review of which earlier evidence remains relevant and which measurements need to be repeated.
Progress can be organised around clear evidence milestones, including application trials, integrated testing and documented end-to-end demonstrations. Keep unresolved questions visible and distinguish a proposed capability from a measured one. A finding that leads to a design change is valuable information when it improves the match between the mission and its intended use. The practical result is a defensible account of readiness, remaining work and the conditions that must be satisfied before a stronger public performance claim can be supported.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Check readiness before an acquisition
An acquisition plan should consider the complete sequence needed to obtain a usable observation. Define the target, the required configuration, the timing opportunity, and the conditions under which the observation should proceed. For a spacecraft study, this includes the relationships between pointing, instrument operation, available resources, and data handling. For other observation platforms, the same principle applies: a valid measurement depends on more than the presence of a suitable sensor.
Use a readiness checklist tied to the intended acquisition rather than a generic declaration that the system is available. Confirm the relevant configuration, geographic information, time references, storage capacity, and expected data products. Identify conditions that require postponement or a revised plan. Where resource estimates are uncertain, state the assumption and test its consequences before treating it as an operational margin.
Review the acquisition after it occurs or after a representative simulation. Compare the planned sequence with the evidence actually produced, including metadata, coverage, and quality information. Record incomplete acquisitions as useful evidence about the workflow rather than silently excluding them from the record. Repeated reviews can reveal whether a limitation arises from planning, platform behaviour, instrument operation, or processing. This creates a disciplined route from an observation opportunity to a dependable measurement capability.
Bring the evidence back to the decision
Quality control is most useful when its results travel with the information being delivered. Preserve the reasons for accepting or rejecting an observation, and expose limitations that could change the user's interpretation. Review recurring failures as clues about the design of the workflow. A clear quality record supports consistent comparisons between operators and processing versions, while helping the team decide whether a problem originates in acquisition, preparation, interpretation, or the underlying observation requirements.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



