Data quality Editorial draft

Cloud and shadow screening for optical imagery in onion production beds — a quality-control guide

Explore cloud and shadow screening for optical imagery in onion production beds. Practical guidance for quality control and defensible observations.

ShareLinkedInFacebookXWhatsApp

Editorial draft. This generated working guide combines technical guidance with an illustrative context and requires individual editorial review.

Editorial illustration: Cloud and shadow screening for optical imagery in onion production beds — a quality-control guide
Original editorial illustration for this article. Shapes and colours are conceptual, not measured observation data.

A convincing image can still contain measurements that are unsuitable for a particular task. Quality control asks whether the inputs, transformations, and outputs meet the requirements of the intended application. This perspective follows evidence through the workflow, from acquisition metadata and reference observations to the final interpretation. It encourages teams to define acceptance conditions before seeing the result, rather than adjusting them to favour a preferred conclusion. The purpose is a repeatable way to distinguish usable observations, observations requiring qualification, and observations that should be excluded from a decision.

This working guide considers cloud and shadow screening for optical imagery in onion production beds. The immediate decision is to review beds with uneven establishment. Useful reference evidence includes planting dates, bed cover and crop-stage observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.

The setting: Onion production beds

Onion fields can retain a strong soil contribution in optical imagery because of their canopy form and the arrangement of production beds. The proportion of exposed soil, the stage of the crop and the condition of neighbouring surfaces all matter to interpretation. A useful monitoring design begins by identifying whether it needs a field-level development indicator or more detailed bed-level information. The image data must genuinely support the scale at which conclusions are presented.

Maintain planting and management records alongside the image sequence, and distinguish normal stage differences from unusual spatial patterns. Small fields may contain only a limited number of observations that are not mixed with boundaries, tracks or other crops. Quality screening should account for this limitation rather than treating every nominal pixel as an independent view of onions. Comparable acquisition and processing conditions strengthen the interpretation of changes between reporting periods.

Field visits should record crop stage, stand continuity and the condition of the soil and bed surfaces contributing to the image. Sample across the mapped range, including areas that look typical, and preserve the location and date of each observation. A general reflectance pattern cannot directly establish bulb production or a named cause of stress. Those claims need appropriate measurements, while a transparent inspection-priority workflow can be evaluated through the outcomes of practical scouting visits.

A quality mask changes the evidence available

Clouds and their shadows can produce strong changes in optical imagery that have little to do with the condition of the land beneath them. A quality mask identifies observations that should be excluded or treated cautiously for a particular analysis. It is not simply a cosmetic step used to improve an image. The mask determines which measurements contribute to an index, field statistic or time-series model. Its assumptions therefore belong in the analytical record and should remain available when a result is reviewed.

A scene with a low overall cloud percentage can still be unsuitable for a particular farm. Conversely, a partly cloudy scene may contain useful observations over the target fields. Evaluate quality at the area of interest rather than relying only on scene-level metadata. Cloud edges, haze and shadow boundaries can be difficult to classify consistently. Depending on the application, an additional exclusion around a flagged feature may be appropriate. The effect of that choice on usable coverage should be measured instead of hidden.

Check the mask as part of the result

Inspect representative successful and unsuccessful cases before adopting a mask rule across a large archive. Check whether bright soil, roofs, water or dark vegetation are being confused with cloud or shadow. Compare automatic flags with image context and, where available, independent observations. A mask that removes too much valid data can be harmful, while one that retains contamination can create false alerts. The acceptable balance depends on the downstream task and the costs of missed observations and misleading interpretations.

Each delivered field result should state the acquisition date and the fraction of the relevant area supported by valid measurements. If too little remains, a missing result can be more informative than a precise-looking number based on an unrepresentative fragment. Keep observation gaps visible in charts and maps. When the masking method or product version changes, assess how the update affects historical comparability. Treating cloud and shadow screening as part of the evidence chain makes the final agricultural or environmental interpretation easier to audit and more dependable in practice.

Prioritise alerts using evidence and consequence

An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.

Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.

Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.

Deliver quality flags that users can interpret

Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.

Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.

Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.

Bring the evidence back to the decision

Quality control is most useful when its results travel with the information being delivered. Preserve the reasons for accepting or rejecting an observation, and expose limitations that could change the user's interpretation. Review recurring failures as clues about the design of the workflow. A clear quality record supports consistent comparisons between operators and processing versions, while helping the team decide whether a problem originates in acquisition, preparation, interpretation, or the underlying observation requirements.

Sources & further reading

  1. USGS — Landsat Collection 2 Quality Assessment Bands
  2. NASA — HLS atmospheric correction and quality screening

Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.

ShareLinkedInFacebookXWhatsApp
A CONVERSATION STARTS HERE

Build the next
perspective with us.

Tell the TechnoGIS team where you would like to collaborate.

Opens your email app so you can review and send your enquiry.