A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers how pointing and motion affect satellite imagery in coastal payload studies. The immediate decision is to connect coastal applications to instrument requirements. Useful reference evidence includes water-reference measurements and documented observation conditions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Separate the different pointing requirements
A camera can point near its intended target while still producing an image with poor geometry or blur. Pointing accuracy describes how closely the spacecraft achieves a commanded orientation. Pointing knowledge describes how well that orientation is estimated. Stability concerns changes over a relevant interval, including the detector integration period. These quantities serve different purposes and should be specified separately with a clear reference frame and time basis.
Orientation estimates combine information from sensors such as gyroscopes, Sun sensors and star trackers, depending on the architecture. Actuators then change or maintain the attitude. Reaction wheels exchange angular momentum with the spacecraft, while magnetic torquers interact with Earth's magnetic field and may support momentum management. Their suitability depends on the orbit, operating modes and disturbance environment. A component's advertised accuracy does not automatically become the pointing performance of the integrated spacecraft.
Evaluate the complete image motion budget
Ground features move across a detector because the spacecraft travels along its orbit and may rotate during imaging. Exposure time, scan timing and any motion compensation must be consistent with that movement. Residual motion during integration spreads signal across pixels and reduces contrast. High frequency vibration can produce a different image effect from slow drift, so one average attitude error may conceal an important problem.
Build an image motion budget that includes control behavior, structural response, actuator disturbances and timing uncertainties. Consider the mechanical path between attitude sensors and the optical payload: a flexible interface can change their relative alignment. Thermal distortion can also alter boresight alignment over an orbit. Test realistic operating combinations, including wheel speeds and other mechanisms that may run during an exposure, and assess whether laboratory support equipment affects the measurement.
Geometric processing uses orbit information, attitude knowledge, timing and an Earth model to locate observations. Ground control and image matching can improve some errors, but processing cannot always restore information lost to blur. For repeat observations, test relative registration as well as absolute location. Report residual errors across the field and across relevant operating conditions. A useful requirement links a user consequence, such as registration between spectral bands, to a measurable spacecraft or payload behavior and a verification method. This keeps pointing discussions connected to the quality of the delivered imagery.
The setting: Coastal payload studies
A coastal satellite payload study should specify which observations the proposed instrument is intended to support. Mapping visible water boundaries, distinguishing broad surface patterns and estimating a particular water variable create different requirements. Coastal measurements can contain contributions from atmosphere, water, seabed, surface reflection and nearby land. The study therefore needs a clear application definition before a spectral configuration is treated as sufficient evidence that a useful product can be delivered.
Early application trials can use suitable existing observations and representative field measurements to examine these requirements. Record the water types, acquisition conditions and spatial scales represented in each trial. A method that behaves well in one setting may not transfer to another coastal environment without further evaluation. Image detail and the ability to separate narrow features should be assessed through the actual measurement chain rather than inferred from the appearance of a concept rendering.
The resulting requirements should address spectral response, calibration, geometry and the timing of usable observations alongside power, pointing and data delivery. Reference campaigns need measurements that describe the target variable under conditions relevant to the intended use. A practical study links each proposed capability to a test and an application need. This allows a future coastal mission concept to develop through evidence rather than relying on a general promise that additional bands alone will resolve every interpretation problem.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Deliver quality flags that users can interpret
Quality information should describe the condition of an observation in terms that remain useful through the workflow. A single valid or invalid label may be sufficient for some calculations, but operational users often need to know why an observation was qualified. Distinguish acquisition limitations, processing failures, uncertain reference matches, and conditions that make interpretation ambiguous. These categories point towards different responses and should not be merged without a clear purpose.
Define a small, documented set of flags with stable meanings. Record whether a flag applies to a complete scene, a geographic unit, an individual measurement, or a derived result. A unit containing a mixture of qualified and unqualified observations may also require a coverage measure. Include the rule used to combine flags when summarising data so that a favourable average does not conceal a substantial fraction of unusable input.
Test the flags with the people receiving the product. Ask what they would do differently for each state and whether the terminology supports that choice. Keep the original flags available even if the interface presents a simpler summary. When flag definitions change, version the rules and review their effects on historical comparisons. Useful quality communication makes the condition of the evidence visible at the moment when a user decides how much confidence to place in the result.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



