Methods Editorial draft

Keeping Earth observation data usable over time across sediment-runoff catchments — a quality-control guide

Explore keeping earth observation data usable over time across sediment-runoff catchments. Practical guidance for quality control and defensible observations.

ShareLinkedInFacebookXWhatsApp

Editorial draft. This generated working guide combines technical guidance with an illustrative context and requires individual editorial review.

Editorial illustration: Keeping Earth observation data usable over time across sediment-runoff catchments — a quality-control guide
Original editorial illustration for this article. Shapes and colours are conceptual, not measured observation data.

A convincing image can still contain measurements that are unsuitable for a particular task. Quality control asks whether the inputs, transformations, and outputs meet the requirements of the intended application. This perspective follows evidence through the workflow, from acquisition metadata and reference observations to the final interpretation. It encourages teams to define acceptance conditions before seeing the result, rather than adjusting them to favour a preferred conclusion. The purpose is a repeatable way to distinguish usable observations, observations requiring qualification, and observations that should be excluded from a decision.

This working guide considers keeping earth observation data usable over time across sediment-runoff catchments. The immediate decision is to connect sampling priorities across land and water. Useful reference evidence includes timed water samples, runoff context and land-cover observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.

Define the responsibilities around the files

Data governance is the set of practical decisions that makes an archive trustworthy and usable. It covers who can publish a product, who maintains its description, how corrections are approved and how users discover changes. These responsibilities matter even for a small project. Without them, an attractive map may become detached from its source scenes, processing method and known limitations.

Assign stable identifiers to datasets and distinguish a collection from its individual files. Record the producer, contact route, geographic extent, time coverage, coordinate reference system, units and missing value conventions. Describe the processing level and whether the values represent measurements, corrected observations or model estimates. A clear data dictionary is especially important when a compact code or numeric flag carries a meaning that would otherwise remain implicit.

Preserve context as products evolve

Maintain provenance from source acquisition through processing and publication. Preserve source identifiers, algorithm versions, parameter settings and links to validation material. When a correction changes values, create a traceable version rather than silently replacing a file and leaving its description untouched. Explain the reason for the revision and whether earlier analyses should be revisited. Checksums help detect changes or corruption but cannot establish that a scientific interpretation is correct.

Access rules should reflect the actual data and agreements involved. Public satellite imagery does not automatically make every associated field record or derived dataset unrestricted. Location records may reveal sensitive ecological sites, and field photographs may include identifiable people. Review the relevant terms before combining or distributing sources, and express reuse conditions in plain language with a suitable license where appropriate. Preserve acknowledgement and citation requirements alongside the data.

Plan retention, backups and recovery before storage becomes crowded. Keep essential documentation and reproducible processing materials with the deliverable, while identifying intermediate files that can be regenerated. Test that a restored copy opens correctly and has the expected metadata. A release checklist should include file integrity, machine readable metadata, readable documentation and a useful contact path. Periodic stewardship reviews can detect broken links, obsolete formats and orphaned responsibilities. The aim is a product that remains interpretable after the original analyst has moved on.

The setting: Sediment-runoff catchments

A catchment monitoring project connects land-cover patterns, drainage pathways and observations of receiving waters. These evidence streams operate at different spatial and temporal scales. A bare land patch or a bright water plume may be relevant to a sampling question, but an image alone does not establish that one caused the other. Define whether the task is mapping potential source areas, tracking a visible water pattern or evaluating a particular sediment-related variable.

Maintain suitable land and water masks and compare acquisitions with their rainfall and flow context where that information is available. Clouds can obscure the period of greatest interest, and conditions may change rapidly after runoff events. Land adjacency, shallow water and surface reflections can also affect optical interpretation. A useful monitoring record identifies the dates and valid areas supporting each observation instead of presenting a continuous causal story across missing measurements.

Field validation should collect water measurements with clear location, timing and sampling methods, alongside the evidence used to describe land conditions. Sampling only the most obvious plume may overlook other parts of the response or ordinary background variation. More specific source attribution needs an investigation designed for that claim. A practical first product can organise catchment observations and prioritise coordinated sampling, while keeping remotely observed associations distinct from explanations established through additional measurements.

Define a representative reference sample

A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.

Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.

Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.

Use observation labels with consistent meanings

A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.

Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.

Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.

Bring the evidence back to the decision

Quality control is most useful when its results travel with the information being delivered. Preserve the reasons for accepting or rejecting an observation, and expose limitations that could change the user's interpretation. Review recurring failures as clues about the design of the workflow. A clear quality record supports consistent comparisons between operators and processing versions, while helping the team decide whether a problem originates in acquisition, preparation, interpretation, or the underlying observation requirements.

Sources & further reading

  1. USGS: Data management
  2. USGS: Documenting data quality

Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.

ShareLinkedInFacebookXWhatsApp
A CONVERSATION STARTS HERE

Build the next
perspective with us.

Tell the TechnoGIS team where you would like to collaborate.

Opens your email app so you can review and send your enquiry.