A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers connecting drone surveys with satellite observations in coastal payload studies. The immediate decision is to connect coastal applications to instrument requirements. Useful reference evidence includes water-reference measurements and documented observation conditions. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Coastal payload studies
A coastal satellite payload study should specify which observations the proposed instrument is intended to support. Mapping visible water boundaries, distinguishing broad surface patterns and estimating a particular water variable create different requirements. Coastal measurements can contain contributions from atmosphere, water, seabed, surface reflection and nearby land. The study therefore needs a clear application definition before a spectral configuration is treated as sufficient evidence that a useful product can be delivered.
Early application trials can use suitable existing observations and representative field measurements to examine these requirements. Record the water types, acquisition conditions and spatial scales represented in each trial. A method that behaves well in one setting may not transfer to another coastal environment without further evaluation. Image detail and the ability to separate narrow features should be assessed through the actual measurement chain rather than inferred from the appearance of a concept rendering.
The resulting requirements should address spectral response, calibration, geometry and the timing of usable observations alongside power, pointing and data delivery. Reference campaigns need measurements that describe the target variable under conditions relevant to the intended use. A practical study links each proposed capability to a test and an application need. This allows a future coastal mission concept to develop through evidence rather than relying on a general promise that additional bands alone will resolve every interpretation problem.
Give each platform a clear role
Drone surveys and satellites observe the same landscape at different scales and with different constraints. A drone can collect detailed local observations at a selected time, while satellites provide repeated coverage over larger regions. Combining them is useful when the local survey answers a specific question: checking crop rows, describing canopy gaps, measuring a surface, or supporting reference interpretation. Define that role before planning the flight. A detailed orthomosaic does not automatically become accurate reference data merely because its pixels are small.
Radiometric consistency requires attention to exposure settings, sensor response, illumination, and calibration targets where appropriate. Geometric quality depends on camera calibration, flight geometry, image overlap, tie points, and the accuracy of positioning and ground control. Surface reconstruction can struggle over water, moving vegetation, uniform textures, or repeated patterns. Keep independent checkpoints separate from control points used to fit the reconstruction, and evaluate horizontal and vertical accuracy against the requirements of the intended measurement.
Compare like with like
Align coordinate systems, vertical datums where relevant, and acquisition times before comparing products. A field can change after irrigation, rainfall, harvest, or a different sun angle, so a convenient date may not represent the satellite overpass. Satellite bands also have different spectral response functions from a drone camera. Matching band names does not guarantee that their reflectance values are equivalent. Describe these differences and select a comparison that the measurements can support.
Aggregate drone observations to the satellite pixel footprint or another justified analysis unit rather than simply sharpening the satellite grid. Include edge effects, positional uncertainty, and spatial heterogeneity in the comparison. A satellite pixel may mix trees, soil, shade, and roads that the drone resolves individually. Sample drone sites across the conditions present in the larger region; surveying only easy access sites can bias a calibration model. Keep training and evaluation locations independent when drone products support machine learning. Deliver the local survey with flight dates, processing settings, calibration records, accuracy checks, and known gaps. The combined workflow should make the relationship between local detail and regional inference explicit, including where the drone sample does not justify extrapolation.
Design an evaluation that reflects deployment
A model evaluation should resemble the conditions in which the model will be used. Start by identifying which relationships the development data share: nearby locations, repeated observations of the same unit, common collection teams, or measurements from a single period. These relationships can make records less independent than they appear. An evaluation that ignores them may test the ability to recognise familiar conditions rather than the ability to operate in a new setting.
Choose a split strategy that matches the intended transfer. Holding out locations, seasons, operational units, or acquisition conditions can answer different questions. Document which question each split is designed to address, and keep the held-out evidence separate while selecting features and tuning the method. Repeatedly inspecting the same evaluation set to improve a model gradually makes that set part of development, even if it retains its original label.
Report results at a scale that is meaningful to the user. A strong average can hide poor performance for important subgroups or unusual conditions. Examine error patterns and retain examples of both successful and unsuccessful predictions. Where the evidence covers only a limited range of conditions, describe that range explicitly. The evaluation then becomes a practical guide to suitable use, further testing, and the collection of additional reference observations.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



