A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers how pointing and motion affect satellite imagery around energy infrastructure sites. The immediate decision is to review visible changes around infrastructure. Useful reference evidence includes site boundaries, operation context and dated field observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Energy infrastructure sites
An energy infrastructure site can combine buildings, equipment, access routes, vegetation, water and managed open land. A remote observation may be useful for reviewing visible changes around the site, but its interpretation depends on the feature and decision being studied. Mapping land-cover change, documenting surrounding vegetation and investigating a water pattern are separate objectives. Establish the site boundary and the relevant observation units before selecting analytical features or thresholds.
Large structures can introduce shadows and geometric effects, while narrow management zones may contain mixed observations. Review whether the image resolution supports the detail presented in the report. A change in nearby vegetation may follow normal maintenance, seasonal development or another land-use activity. Preserve the acquisition dates and any available operational context so that an observed pattern can be investigated without assigning an unsupported explanation to it.
Validation should describe the actual surface or feature observed and the spatial area represented by each record. Measurements inside the site and observations of its surroundings may answer different questions and should remain distinguishable. A satellite-derived alert can support a site review without establishing equipment performance or a particular operational condition. Evaluate whether the product provides relevant, interpretable evidence for the intended monitoring task, including instances where follow-up found that a visible change was expected or temporary.
Separate the different pointing requirements
A camera can point near its intended target while still producing an image with poor geometry or blur. Pointing accuracy describes how closely the spacecraft achieves a commanded orientation. Pointing knowledge describes how well that orientation is estimated. Stability concerns changes over a relevant interval, including the detector integration period. These quantities serve different purposes and should be specified separately with a clear reference frame and time basis.
Orientation estimates combine information from sensors such as gyroscopes, Sun sensors and star trackers, depending on the architecture. Actuators then change or maintain the attitude. Reaction wheels exchange angular momentum with the spacecraft, while magnetic torquers interact with Earth's magnetic field and may support momentum management. Their suitability depends on the orbit, operating modes and disturbance environment. A component's advertised accuracy does not automatically become the pointing performance of the integrated spacecraft.
Evaluate the complete image motion budget
Ground features move across a detector because the spacecraft travels along its orbit and may rotate during imaging. Exposure time, scan timing and any motion compensation must be consistent with that movement. Residual motion during integration spreads signal across pixels and reduces contrast. High frequency vibration can produce a different image effect from slow drift, so one average attitude error may conceal an important problem.
Build an image motion budget that includes control behavior, structural response, actuator disturbances and timing uncertainties. Consider the mechanical path between attitude sensors and the optical payload: a flexible interface can change their relative alignment. Thermal distortion can also alter boresight alignment over an orbit. Test realistic operating combinations, including wheel speeds and other mechanisms that may run during an exposure, and assess whether laboratory support equipment affects the measurement.
Geometric processing uses orbit information, attitude knowledge, timing and an Earth model to locate observations. Ground control and image matching can improve some errors, but processing cannot always restore information lost to blur. For repeat observations, test relative registration as well as absolute location. Report residual errors across the field and across relevant operating conditions. A useful requirement links a user consequence, such as registration between spectral bands, to a measurable spacecraft or payload behavior and a verification method. This keeps pointing discussions connected to the quality of the delivered imagery.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



