A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers how pointing and motion affect satellite imagery in rainfed rice landscapes. The immediate decision is to focus visits after uneven rainfall. Useful reference evidence includes planting dates, field moisture observations and crop stage. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Separate the different pointing requirements
A camera can point near its intended target while still producing an image with poor geometry or blur. Pointing accuracy describes how closely the spacecraft achieves a commanded orientation. Pointing knowledge describes how well that orientation is estimated. Stability concerns changes over a relevant interval, including the detector integration period. These quantities serve different purposes and should be specified separately with a clear reference frame and time basis.
Orientation estimates combine information from sensors such as gyroscopes, Sun sensors and star trackers, depending on the architecture. Actuators then change or maintain the attitude. Reaction wheels exchange angular momentum with the spacecraft, while magnetic torquers interact with Earth's magnetic field and may support momentum management. Their suitability depends on the orbit, operating modes and disturbance environment. A component's advertised accuracy does not automatically become the pointing performance of the integrated spacecraft.
Evaluate the complete image motion budget
Ground features move across a detector because the spacecraft travels along its orbit and may rotate during imaging. Exposure time, scan timing and any motion compensation must be consistent with that movement. Residual motion during integration spreads signal across pixels and reduces contrast. High frequency vibration can produce a different image effect from slow drift, so one average attitude error may conceal an important problem.
Build an image motion budget that includes control behavior, structural response, actuator disturbances and timing uncertainties. Consider the mechanical path between attitude sensors and the optical payload: a flexible interface can change their relative alignment. Thermal distortion can also alter boresight alignment over an orbit. Test realistic operating combinations, including wheel speeds and other mechanisms that may run during an exposure, and assess whether laboratory support equipment affects the measurement.
Geometric processing uses orbit information, attitude knowledge, timing and an Earth model to locate observations. Ground control and image matching can improve some errors, but processing cannot always restore information lost to blur. For repeat observations, test relative registration as well as absolute location. Report residual errors across the field and across relevant operating conditions. A useful requirement links a user consequence, such as registration between spectral bands, to a measurable spacecraft or payload behavior and a verification method. This keeps pointing discussions connected to the quality of the delivered imagery.
The setting: Rainfed rice landscapes
Rainfed rice fields often follow planting calendars shaped by local rainfall, water retention and household decisions. Nearby fields may begin their crop cycles at different times, and some areas may remain unplanted during a reporting period. A monitoring system needs to separate these timing differences from potentially unusual crop development. Start with field boundaries and a record of whether a crop was actually established, together with the best available estimate of its establishment date.
Interpreting an image sequence requires attention to both vegetation and the recent water context. Soil background, temporary standing water and incomplete canopy cover can strongly influence early observations. Rainfall information can help describe the season, but it should not be treated as a direct measurement of water available to every field. Differences in drainage, soil properties and topographic position can create contrasting conditions within a short distance.
Use the analysis to select field questions that can be checked, such as delayed establishment or uneven canopy development. Record crop stage, recent management, visible water conditions and the circumstances that affected planting. Where production estimates are proposed, connect them to representative harvest observations rather than relying on an index threshold. Results should show observation dates and missing periods so that users can judge how current the evidence is before arranging an inspection.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Keep an auditable review record
A review record should explain how a result moved from an analytical output to an accepted interpretation or operational decision. Preserve the product identifier, the evidence considered, the reviewer role, and the outcome of the review. A short, consistent record is often more useful than an extensive free-text note that cannot be compared between cases. The objective is to make important decisions traceable without turning routine review into unnecessary administrative work.
Separate observations from conclusions within the record. Describe the evidence visible to the reviewer, the alternative explanations considered where relevant, and the reason for accepting, qualifying, or rejecting the result. If a correction is required, identify what should change and how the revised product relates to the earlier version. Keep unresolved questions visible so that they can be addressed by another observation or by the person responsible for the next action.
Use the accumulated record to improve the workflow. Recurring review reasons can reveal unclear requirements, missing contextual information, unstable processing steps, or an evaluation gap. Examine whether similar cases receive similar decisions across reviewers and over time. Preserve the relationship between feedback and subsequent revisions so that improvements can be assessed against the evidence that motivated them. An auditable record supports learning, accountability, and consistent delivery while allowing the technical process to evolve.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



