A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers keeping earth observation data usable over time within mission readiness studies. The immediate decision is to connect mission claims to measured evidence. Useful reference evidence includes documented requirements, test results and unresolved design questions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Define the responsibilities around the files
Data governance is the set of practical decisions that makes an archive trustworthy and usable. It covers who can publish a product, who maintains its description, how corrections are approved and how users discover changes. These responsibilities matter even for a small project. Without them, an attractive map may become detached from its source scenes, processing method and known limitations.
Assign stable identifiers to datasets and distinguish a collection from its individual files. Record the producer, contact route, geographic extent, time coverage, coordinate reference system, units and missing value conventions. Describe the processing level and whether the values represent measurements, corrected observations or model estimates. A clear data dictionary is especially important when a compact code or numeric flag carries a meaning that would otherwise remain implicit.
Preserve context as products evolve
Maintain provenance from source acquisition through processing and publication. Preserve source identifiers, algorithm versions, parameter settings and links to validation material. When a correction changes values, create a traceable version rather than silently replacing a file and leaving its description untouched. Explain the reason for the revision and whether earlier analyses should be revisited. Checksums help detect changes or corruption but cannot establish that a scientific interpretation is correct.
Access rules should reflect the actual data and agreements involved. Public satellite imagery does not automatically make every associated field record or derived dataset unrestricted. Location records may reveal sensitive ecological sites, and field photographs may include identifiable people. Review the relevant terms before combining or distributing sources, and express reuse conditions in plain language with a suitable license where appropriate. Preserve acknowledgement and citation requirements alongside the data.
Plan retention, backups and recovery before storage becomes crowded. Keep essential documentation and reproducible processing materials with the deliverable, while identifying intermediate files that can be regenerated. Test that a restored copy opens correctly and has the expected metadata. A release checklist should include file integrity, machine readable metadata, readable documentation and a useful contact path. Periodic stewardship reviews can detect broken links, obsolete formats and orphaned responsibilities. The aim is a product that remains interpretable after the original analyst has moved on.
The setting: Mission readiness studies
A mission readiness study connects the intended application with the evidence available from the spacecraft and ground system. A target launch year or an attractive rendering can help communicate a vision, but neither establishes that the observation service is ready. Begin with the capabilities the mission is supposed to demonstrate and identify how each will be assessed. Requirements should remain traceable to user needs rather than accumulating as an unrelated list of desirable specifications.
The review should consider the observation payload, pointing, power, communications, processing and delivery as parts of one chain. A promising subsystem test may still leave an important gap elsewhere in that chain. Record the conditions under which each result was obtained, the applicable uncertainty and the design version it represents. Changes in architecture or application requirements should trigger a review of which earlier evidence remains relevant and which measurements need to be repeated.
Progress can be organised around clear evidence milestones, including application trials, integrated testing and documented end-to-end demonstrations. Keep unresolved questions visible and distinguish a proposed capability from a measured one. A finding that leads to a design change is valuable information when it improves the match between the mission and its intended use. The practical result is a defensible account of readiness, remaining work and the conditions that must be satisfied before a stronger public performance claim can be supported.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Check readiness before an acquisition
An acquisition plan should consider the complete sequence needed to obtain a usable observation. Define the target, the required configuration, the timing opportunity, and the conditions under which the observation should proceed. For a spacecraft study, this includes the relationships between pointing, instrument operation, available resources, and data handling. For other observation platforms, the same principle applies: a valid measurement depends on more than the presence of a suitable sensor.
Use a readiness checklist tied to the intended acquisition rather than a generic declaration that the system is available. Confirm the relevant configuration, geographic information, time references, storage capacity, and expected data products. Identify conditions that require postponement or a revised plan. Where resource estimates are uncertain, state the assumption and test its consequences before treating it as an operational margin.
Review the acquisition after it occurs or after a representative simulation. Compare the planned sequence with the evidence actually produced, including metadata, coverage, and quality information. Record incomplete acquisitions as useful evidence about the workflow rather than silently excluding them from the record. Repeated reviews can reveal whether a limitation arises from planning, platform behaviour, instrument operation, or processing. This creates a disciplined route from an observation opportunity to a dependable measurement capability.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



