Data quality Editorial draft

Cloud and shadow screening for optical imagery across sediment-runoff catchments — a quality-control guide

Explore cloud and shadow screening for optical imagery across sediment-runoff catchments. Practical guidance for quality control and defensible observations.

ShareLinkedInFacebookXWhatsApp

Editorial draft. This generated working guide combines technical guidance with an illustrative context and requires individual editorial review.

Editorial illustration: Cloud and shadow screening for optical imagery across sediment-runoff catchments — a quality-control guide
Original editorial illustration for this article. Shapes and colours are conceptual, not measured observation data.

A convincing image can still contain measurements that are unsuitable for a particular task. Quality control asks whether the inputs, transformations, and outputs meet the requirements of the intended application. This perspective follows evidence through the workflow, from acquisition metadata and reference observations to the final interpretation. It encourages teams to define acceptance conditions before seeing the result, rather than adjusting them to favour a preferred conclusion. The purpose is a repeatable way to distinguish usable observations, observations requiring qualification, and observations that should be excluded from a decision.

This working guide considers cloud and shadow screening for optical imagery across sediment-runoff catchments. The immediate decision is to connect sampling priorities across land and water. Useful reference evidence includes timed water samples, runoff context and land-cover observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.

A quality mask changes the evidence available

Clouds and their shadows can produce strong changes in optical imagery that have little to do with the condition of the land beneath them. A quality mask identifies observations that should be excluded or treated cautiously for a particular analysis. It is not simply a cosmetic step used to improve an image. The mask determines which measurements contribute to an index, field statistic or time-series model. Its assumptions therefore belong in the analytical record and should remain available when a result is reviewed.

A scene with a low overall cloud percentage can still be unsuitable for a particular farm. Conversely, a partly cloudy scene may contain useful observations over the target fields. Evaluate quality at the area of interest rather than relying only on scene-level metadata. Cloud edges, haze and shadow boundaries can be difficult to classify consistently. Depending on the application, an additional exclusion around a flagged feature may be appropriate. The effect of that choice on usable coverage should be measured instead of hidden.

Check the mask as part of the result

Inspect representative successful and unsuccessful cases before adopting a mask rule across a large archive. Check whether bright soil, roofs, water or dark vegetation are being confused with cloud or shadow. Compare automatic flags with image context and, where available, independent observations. A mask that removes too much valid data can be harmful, while one that retains contamination can create false alerts. The acceptable balance depends on the downstream task and the costs of missed observations and misleading interpretations.

Each delivered field result should state the acquisition date and the fraction of the relevant area supported by valid measurements. If too little remains, a missing result can be more informative than a precise-looking number based on an unrepresentative fragment. Keep observation gaps visible in charts and maps. When the masking method or product version changes, assess how the update affects historical comparability. Treating cloud and shadow screening as part of the evidence chain makes the final agricultural or environmental interpretation easier to audit and more dependable in practice.

The setting: Sediment-runoff catchments

A catchment monitoring project connects land-cover patterns, drainage pathways and observations of receiving waters. These evidence streams operate at different spatial and temporal scales. A bare land patch or a bright water plume may be relevant to a sampling question, but an image alone does not establish that one caused the other. Define whether the task is mapping potential source areas, tracking a visible water pattern or evaluating a particular sediment-related variable.

Maintain suitable land and water masks and compare acquisitions with their rainfall and flow context where that information is available. Clouds can obscure the period of greatest interest, and conditions may change rapidly after runoff events. Land adjacency, shallow water and surface reflections can also affect optical interpretation. A useful monitoring record identifies the dates and valid areas supporting each observation instead of presenting a continuous causal story across missing measurements.

Field validation should collect water measurements with clear location, timing and sampling methods, alongside the evidence used to describe land conditions. Sampling only the most obvious plume may overlook other parts of the response or ordinary background variation. More specific source attribution needs an investigation designed for that claim. A practical first product can organise catchment observations and prioritise coordinated sampling, while keeping remotely observed associations distinct from explanations established through additional measurements.

Deliver quality flags that users can interpret

Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.

Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.

Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.

Match coastal observations with changing conditions

Coastal observations can be influenced by conditions that change within a day as well as across seasons. The meaning of an image or reference measurement may depend on water level, currents, recent weather, and the state of the surrounding land. Begin by documenting the exact acquisition time and the contextual records relevant to the question. A comparison based only on calendar dates can conceal differences that are important to interpretation.

Define which conditions need to be comparable across observations. A shoreline analysis, an intertidal habitat study, and an investigation of water appearance can require different timing assumptions. Select reference locations and measurement procedures that address the specific application. Preserve information about observation depth, sampling position, and the duration represented by a reference measurement where those details affect the comparison.

Review apparent differences against the physical and observational context before assigning a cause. A change in visible extent or spectral response may reflect the state of the water and atmosphere as well as a change in the feature being studied. Where suitable contextual information is unavailable, qualify the comparison or use additional observations to test competing explanations. A dependable coastal workflow makes its timing assumptions explicit and preserves the information needed to reconsider them when further evidence becomes available.

Bring the evidence back to the decision

Quality control is most useful when its results travel with the information being delivered. Preserve the reasons for accepting or rejecting an observation, and expose limitations that could change the user's interpretation. Review recurring failures as clues about the design of the workflow. A clear quality record supports consistent comparisons between operators and processing versions, while helping the team decide whether a problem originates in acquisition, preparation, interpretation, or the underlying observation requirements.

Sources & further reading

  1. USGS — Landsat Collection 2 Quality Assessment Bands
  2. NASA — HLS atmospheric correction and quality screening

Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.

ShareLinkedInFacebookXWhatsApp
A CONVERSATION STARTS HERE

Build the next
perspective with us.

Tell the TechnoGIS team where you would like to collaborate.

Opens your email app so you can review and send your enquiry.