A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers mixed pixels and field boundary effects in irrigated rice systems. The immediate decision is to identify fields needing irrigation review. Useful reference evidence includes field stage, inundation records and irrigation observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Irrigated rice systems
An irrigated rice landscape changes from preparation and inundation to crop establishment, canopy development and harvest. Water and vegetation contribute differently to the observed signal at these stages. A field should therefore be interpreted with its planting calendar and irrigation status, not only its latest colour on a map. Accurate paddy boundaries are valuable because bunds, channels, neighbouring fields and settlements can occupy a substantial share of a small observation unit.
Organise the analysis around field-level sequences rather than a mosaic assembled from unrelated dates. In cloudy periods, identify gaps explicitly and consider which complementary observations are suitable for the question. Optical and radar measurements describe different physical properties, so their agreement or disagreement needs interpretation. An observation consistent with inundation is not by itself a complete account of irrigation delivery, field depth or the cause of a management problem.
A practical field visit records crop stage, water condition, planting method and the time of inspection. Irrigation managers may need a list of fields with unusual timing, while crop specialists may need areas of uneven development. These outputs require different validation records. Evaluate whether the information arrives early enough to support a decision, and retain observations of fields that were not flagged to understand missed events as well as false alerts.
A pixel can represent several surface components
A satellite pixel represents an observation over a ground area, influenced by the instrument's spatial response and the scene within it. That area may contain several materials, such as crop canopy, soil, shade, water or a road. A mixed response is therefore common, especially near boundaries and in fragmented landscapes. It should not be treated automatically as a processing defect. The analytical question is whether the mixture supports the intended interpretation and whether a model trained under one mixture remains applicable under another.
Field geometry affects the number and character of observations available. A compact large field can contain many interior pixels, while a narrow or irregular field may consist mostly of boundary observations. Simply counting pixels does not establish how much independent information a dataset provides. Resampling onto a finer grid also does not remove the original mixing. Before selecting a monitoring product, examine the relationship between field dimensions, relevant landscape features and the measured spatial characteristics of the imagery that will support the service.
Choose a reporting unit that the data can support
Boundary exclusions can help investigate sensitivity to neighbouring surfaces, but they need a consistent rule and a clear purpose. Excluding a fixed distance may remove much of a small field while leaving a substantial interior in a larger one. Report the area retained and consider whether the remaining pixels represent the management unit fairly. Compare full-field and interior summaries during method development. A large difference can reveal a boundary or mixture problem that deserves attention before an alert is presented as a crop condition.
Validation should use observations collected at a scale compatible with the satellite interpretation. A measurement from a single plant or a small isolated plot may not describe the larger mixed area observed from orbit. Document the spatial support of both datasets and consider stratified sampling across relevant components. If the application requires information finer than the data can support, seek a suitable complementary source or change the question. Recognising mixed pixels helps an analyst design a credible product instead of assigning field-level precision to an observation that contains several different surfaces.
Check spatial alignment before comparison
A comparison between images, channels, maps, or field measurements assumes that the observations refer to the same locations at a suitable level of precision. Small alignment errors can become especially important near boundaries or narrow features. Before interpreting differences, inspect whether identifiable, stable features agree between the sources. A common coordinate reference is necessary for many workflows, but it does not by itself demonstrate accurate alignment.
Use control features that are appropriate for the observation scale and remain stable across the comparison period. Evaluate alignment in more than one part of the area, because a single location cannot reveal spatially varying distortion. Record the method used to estimate any correction and retain independent features for checking the corrected result. Where surfaces have genuinely changed, avoid using those changes as evidence of an alignment error.
Propagate the implications of remaining misalignment into the analysis. A workflow may exclude boundary pixels, summarise at a broader scale, or qualify interpretations for small features. The choice should follow the application rather than a preference for visually smooth output. Preserve both the original and corrected geographic references, and document resampling decisions so that future users can understand how measurements were moved onto a common spatial framework.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



