Methods Editorial draft

Reading uncertainty in remote sensing products within cloud-based analysis teams — an uncertainty guide

Explore reading uncertainty in remote sensing products within cloud-based analysis teams. Practical guidance for uncertainty and defensible observations.

ShareLinkedInFacebookXWhatsApp

Editorial draft. This generated working guide combines technical guidance with an illustrative context and requires individual editorial review.

Editorial illustration: Reading uncertainty in remote sensing products within cloud-based analysis teams — an uncertainty guide
Original editorial illustration for this article. Shapes and colours are conceptual, not measured observation data.

Every observation and interpretation contains uncertainty, but the sources and consequences of that uncertainty differ between applications. Some arise from acquisition conditions, others from reference measurements, processing choices, or the transfer of a model to a new setting. This perspective examines how those sources affect the decision a user is considering. It encourages teams to describe uncertainty in a form that can influence action, rather than adding a generic qualification at the end of a report. The objective is to support proportionate decisions while keeping the limits of the available evidence understandable.

This working guide considers reading uncertainty in remote sensing products within cloud-based analysis teams. The immediate decision is to make analytical results reproducible. Useful reference evidence includes input versions, processing parameters and independent product checks. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.

The setting: Cloud-based analysis teams

A cloud-based analysis team needs to connect a scientific method with repeatable processing and an interpretable result. The same nominal dataset can produce different outputs when input versions, masks, resampling choices or analytical parameters differ. Begin by defining the product and the decisions it is intended to support. A visually successful demonstration is useful, but it does not establish that the workflow will behave consistently across regions, seasons or repeated processing runs.

The processing record should identify input observations, acquisition times, quality screening, software or method versions and the parameters relevant to interpretation. Preserve missing-data conditions and distinguish an analytical result from a task that merely completed without a technical error. For field-level products, boundary versions and the spatial support used for summaries also matter. These details make it possible to explain why two apparently similar runs produced different maps or numerical values.

Validation should include checks of both the analytical claim and the delivery process. Compare representative outputs with suitable reference observations, and test whether another operator can reproduce the result from the recorded inputs. Retain limitations in the product metadata rather than relying on informal knowledge held by one team member. A dependable cloud service makes a chain of evidence accessible, allowing users to understand what was observed, how it was processed and which conclusions the available validation supports.

Identify what the uncertainty describes

A satellite product is the result of a measurement chain, rather than a direct copy of conditions on the ground. Detector noise, calibration, atmospheric correction, geolocation and retrieval assumptions can all affect the final value. Their importance changes with the target. A small location error may matter greatly beside a narrow river, while an imperfect aerosol correction may dominate a water reflectance estimate.

Start by reading the variable definition, units, spatial support and quality documentation. An uncertainty layer may describe an estimated standard deviation, a confidence interval, disagreement among models or another quantity entirely. These measures are not interchangeable. A model's class probability also does not automatically represent a calibrated probability that its label is correct. Check how the quantity was obtained and whether it has been evaluated against independent observations.

Carry uncertainty into the decision

Separate systematic differences from random variation. Averaging many observations can reduce independent random noise, but it does not remove a shared calibration bias. Nearby pixels and repeated observations may share errors, so treating every value as independent can produce confidence intervals that are too narrow. When comparing dates, consider whether the same processing method, sensor characteristics and environmental conditions apply.

Quality flags identify conditions that deserve screening or special treatment. They may indicate clouds, saturation, poor retrieval geometry or inputs outside a method's tested range. Preserve the original flags and record the filtering rule. A strict mask can improve reliability while leaving a sample that overrepresents clear weather or easier terrain. Report missing coverage alongside the measurements that remain.

For a practical assessment, perturb influential inputs within defensible ranges and examine how the result changes. Compare alternative valid processing choices, stratify errors by landscape or season and use independent reference data. Classification summaries should include class specific errors rather than relying on one overall accuracy figure. For continuous estimates, examine bias and the distribution of residuals as well as an aggregate error statistic. A useful final product states the tested domain, describes meaningful limitations and shows whether the uncertainty is small enough for the intended decision.

Use observation labels with consistent meanings

A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.

Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.

Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.

Keep an auditable review record

A review record should explain how a result moved from an analytical output to an accepted interpretation or operational decision. Preserve the product identifier, the evidence considered, the reviewer role, and the outcome of the review. A short, consistent record is often more useful than an extensive free-text note that cannot be compared between cases. The objective is to make important decisions traceable without turning routine review into unnecessary administrative work.

Separate observations from conclusions within the record. Describe the evidence visible to the reviewer, the alternative explanations considered where relevant, and the reason for accepting, qualifying, or rejecting the result. If a correction is required, identify what should change and how the revised product relates to the earlier version. Keep unresolved questions visible so that they can be addressed by another observation or by the person responsible for the next action.

Use the accumulated record to improve the workflow. Recurring review reasons can reveal unclear requirements, missing contextual information, unstable processing steps, or an evaluation gap. Examine whether similar cases receive similar decisions across reviewers and over time. Preserve the relationship between feedback and subsequent revisions so that improvements can be assessed against the evidence that motivated them. An auditable record supports learning, accountability, and consistent delivery while allowing the technical process to evolve.

Bring the evidence back to the decision

Useful uncertainty communication identifies the limitation, explains how it could affect the result, and connects it to a practical response. Some decisions can proceed with a qualified estimate; others require another observation or an independent check. Preserve uncertainty information through processing and delivery so that it is available at the point of use. This makes the analysis more accountable and gives the team a clearer basis for deciding which additional evidence would most improve the outcome.

Sources & further reading

  1. USGS: Documenting data quality
  2. NASA Earthdata: Quality metadata

Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.

ShareLinkedInFacebookXWhatsApp
A CONVERSATION STARTS HERE

Build the next
perspective with us.

Tell the TechnoGIS team where you would like to collaborate.

Opens your email app so you can review and send your enquiry.