Methods Editorial draft

Designing ground validation for satellite products around active construction sites — an uncertainty guide

Explore designing ground validation for satellite products around active construction sites. Practical guidance for uncertainty and defensible observations.

ShareLinkedInFacebookXWhatsApp

Editorial draft. This generated working guide combines technical guidance with an illustrative context and requires individual editorial review.

Editorial illustration: Designing ground validation for satellite products around active construction sites — an uncertainty guide
Original editorial illustration for this article. Shapes and colours are conceptual, not measured observation data.

Every observation and interpretation contains uncertainty, but the sources and consequences of that uncertainty differ between applications. Some arise from acquisition conditions, others from reference measurements, processing choices, or the transfer of a model to a new setting. This perspective examines how those sources affect the decision a user is considering. It encourages teams to describe uncertainty in a form that can influence action, rather than adding a generic qualification at the end of a report. The objective is to support proportionate decisions while keeping the limits of the available evidence understandable.

This working guide considers designing ground validation for satellite products around active construction sites. The immediate decision is to prioritise sites requiring progress review. Useful reference evidence includes dated site records and consistently located surface observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.

Start with the intended claim

Validation tests how well a product represents a defined quantity under specified conditions. It differs from calibration, which adjusts an instrument or model using reference information. Begin with the claim the product needs to support: class membership, surface reflectance, canopy height, water quality, or an area estimate. State the required spatial scale, time interval, and acceptable error. These choices determine the reference method and sample design. Collecting convenient field points first and deciding later what they prove usually leaves important conditions untested.

Reference measurements also contain uncertainty. Positioning error can place a sample in the wrong satellite pixel, a point instrument may not represent a heterogeneous footprint, and measurements made on different dates can describe real surface change. Record instrument calibration, sampling protocols, timestamps, coordinates, observation conditions, and uncertainty where available. For interpreted labels, retain the evidence used, class rules, and ambiguous cases. Agreement among interpreters is useful to examine, but agreement alone does not guarantee that the shared interpretation is correct.

Keep the assessment independent

Separate validation data from observations used to fit thresholds, train models, select features, or tune processing. If assessment sites repeatedly influence revisions, they have become development data and a fresh independent assessment is needed. Spatially clustered samples can make performance look stronger when neighboring training and test locations share conditions. Use a design that reflects the target population and report its limitations, including inaccessible areas or environmental conditions missing from the sample.

Choose metrics that match the product. For categorical maps, examine a confusion matrix and errors for individual classes, not just overall agreement. For continuous measurements, report bias and a suitable error measure alongside sample count and the range of reference values. Plot residuals against relevant conditions to expose failures hidden by an average. For area estimates, carry the probability sampling design through estimation and uncertainty calculations. Preserve rejected matchups and their reasons so that quality screening remains auditable. A useful validation report explains where the product works, where evidence is sparse, and which errors matter for the intended decision. Publishing reference protocols and assessment code makes later comparisons more credible and helps others reproduce the evaluation.

The setting: Construction site change

A construction site can progress through clearing, ground works, temporary storage, structural development and surface finishing. A satellite image may reveal some visible changes without establishing whether the project has reached a contractual or operational milestone. Define the monitoring objective in terms of observable surfaces and the decisions the information should support. Site boundaries and a reliable sequence of dated records provide the context needed to distinguish project activity from changes in neighbouring land.

The size and arrangement of features determine what the image can resolve. Stockpiles, temporary access routes and partly completed structures may be mixed with other surfaces within an observation. Shadows and acquisition geometry can also change the appearance of buildings. Compare quality-screened observations and retain the dates supporting each mapped change. A map should not imply that every visible feature was measured independently or that its physical dimensions are known more precisely than the data allow.

Validation should use dated site observations that describe the same area and feature definition as the analysis. Record temporary works and other context that might explain an apparent change. A remote observation can help select a site for review, while more specific statements about project progress need relevant project records. Evaluate whether the product provides useful and timely evidence for that review, including examples where a conspicuous image change had an ordinary or temporary explanation.

Maintain the geographic units of analysis

Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.

Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.

Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.

Preserve a reproducible processing history

A result should be linked to the inputs and processing choices that produced it. Record source identifiers, software versions, configuration values, reference data versions, and the time of processing. The record does not need to expose every internal implementation detail to the end user. It must preserve enough information for the producing team to investigate a result, reproduce a comparison, and explain why a revised product differs from an earlier version.

Version changes that can affect the meaning of the output. Updated boundaries, a new quality mask, revised calibration, different model parameters, or altered aggregation rules can all change results even when the source imagery is unchanged. Avoid overwriting an earlier product without retaining a suitable history. A clear relationship between versions helps users distinguish an improvement in processing from a real change in the observed surface.

Use representative regression cases when modifying the workflow. Select cases that cover ordinary conditions and known failure modes, then compare meaningful outputs before and after the change. Investigate differences against the intended purpose of the revision rather than assuming that a closer visual match is always preferable. Preserve the review decision with the version record. Reproducibility becomes practical when the team can trace a result through a documented sequence of inputs, transformations, tests, and delivery decisions.

Bring the evidence back to the decision

Useful uncertainty communication identifies the limitation, explains how it could affect the result, and connects it to a practical response. Some decisions can proceed with a qualified estimate; others require another observation or an independent check. Preserve uncertainty information through processing and delivery so that it is available at the point of use. This makes the analysis more accountable and gives the team a clearer basis for deciding which additional evidence would most improve the outcome.

Sources & further reading

  1. USGS Landsat calibration and validation
  2. USGS land cover monitoring and validation

Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.

ShareLinkedInFacebookXWhatsApp
A CONVERSATION STARTS HERE

Build the next
perspective with us.

Tell the TechnoGIS team where you would like to collaborate.

Opens your email app so you can review and send your enquiry.