A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers geolocation accuracy for field-level monitoring across urban tree canopies. The immediate decision is to prioritise tree-canopy inventory updates. Useful reference evidence includes crown boundaries, tree records and dated site observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Absolute location and relative alignment answer different questions
Geolocation describes where an observation is placed on Earth. For a field-level application, its quality affects which measurements are assigned to each management unit and whether an alert can be found during inspection. Absolute accuracy concerns the relationship with a suitable geographic reference. Relative alignment concerns the relationship between observations, such as images from different dates. A series can align well internally while still being displaced from a field boundary dataset. Both relationships should be considered when they matter to the intended decision.
The geographic reference includes more than a familiar coordinate system label. Map projection, datum, axis order, units and any relevant height reference can affect how data are combined. Field boundaries also have an origin and uncertainty of their own. A boundary drawn from an old image may not represent the current cultivated area, even if the satellite product is positioned correctly. Preserve the provenance of both the image and vector data, and distinguish a positional mismatch from a real change in land management.
Test accuracy at the management scale
Accuracy assessment needs independent, appropriate reference information distributed across the area of interest. Choosing only easy points can underrepresent difficult terrain or surface conditions. Define the feature being measured and check that it is identifiable at the image's spatial scale. Report the evaluation method and the distribution of residuals, rather than relying only on a single average error. A visual overlay is useful for finding issues, but it is not a substitute for an assessment designed around the accuracy claim being made.
The acceptable error depends on the task. A displacement that has little effect on a large plantation block may be consequential for a narrow field or a small validation plot. Evaluate how plausible location errors influence the derived statistic or operational instruction. Where necessary, revise the reporting unit, improve the reference data or obtain a complementary observation. The objective is not an impressive accuracy number in isolation. It is a defensible connection between the satellite measurement, the field record and the place where a person will use the result.
The setting: Urban tree canopies
Urban trees occur among buildings, roads, gardens, utility corridors and other surfaces that complicate a remotely observed canopy pattern. A useful monitoring task might concern the extent of tree cover, a change in a park or an update to a municipal inventory. These tasks do not automatically provide a measurement of individual tree condition. Decide which spatial unit and management decision are relevant before presenting the imagery as a detailed tree assessment.
Building shadows, small crowns and mixed pixels deserve careful treatment. A street tree can be narrower than the observation footprint, while a large park canopy may support a more stable area-level summary. Compare acquisitions with suitable quality and geometry, and inspect whether seasonal foliage changes or recent maintenance explain the result. Existing inventory records can help interpret a pattern, but their dates and positional accuracy should also be reviewed.
Field validation should distinguish the presence and extent of a canopy from a diagnosis about the tree beneath it. Record tree or plot locations, crown context, recent management and the observations needed by the intended application. If the service supports maintenance planning, evaluate whether it improves the selection of useful inspection sites. Questions about structural safety, species identity or specific causes of decline require appropriate additional evidence rather than inference from a vegetation response alone.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Design an evaluation that reflects deployment
A model evaluation should resemble the conditions in which the model will be used. Start by identifying which relationships the development data share: nearby locations, repeated observations of the same unit, common collection teams, or measurements from a single period. These relationships can make records less independent than they appear. An evaluation that ignores them may test the ability to recognise familiar conditions rather than the ability to operate in a new setting.
Choose a split strategy that matches the intended transfer. Holding out locations, seasons, operational units, or acquisition conditions can answer different questions. Document which question each split is designed to address, and keep the held-out evidence separate while selecting features and tuning the method. Repeatedly inspecting the same evaluation set to improve a model gradually makes that set part of development, even if it retains its original label.
Report results at a scale that is meaningful to the user. A strong average can hide poor performance for important subgroups or unusual conditions. Examine error patterns and retain examples of both successful and unsuccessful predictions. Where the evidence covers only a limited range of conditions, describe that range explicitly. The evaluation then becomes a practical guide to suitable use, further testing, and the collection of additional reference observations.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



