A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers measuring forest cover without confusing canopy and land use across peatland forest landscapes. The immediate decision is to select locations for hydrological field review. Useful reference evidence includes water-level records, land-cover observations and dated site visits. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Peatland forest landscapes
A peatland forest landscape connects vegetation, water conditions, drainage features and land-management history. A satellite image can reveal patterns relevant to these relationships, but a canopy response does not directly measure the depth or condition of the peat below it. Define the monitoring objective carefully. Mapping cover change, identifying areas for hydrological inspection and evaluating a carbon-related parameter require different observations and should not be presented as a single interchangeable result.
A landscape inventory should distinguish forest, open peat, managed land, canals and other surface types that contribute to an observation. Seasonal water conditions and the timing of management events may affect the image record. Optical observations can be limited by cloud and haze, while complementary measurements require their own interpretation. Track usable acquisitions and preserve uncertainty about the timing of a change when it falls within a gap between observations.
Field validation should retain water-level measurements and canopy or land-cover observations as separate evidence streams. Record the date, location and spatial setting of each sample, including its relationship to drainage infrastructure where relevant. A vegetation pattern may help focus a visit without establishing the cause of a hydrological change. More specific claims about emissions, peat condition or restoration performance need suitable measurements and an evaluation method that addresses those variables directly rather than inferring them from greenness alone.
Define what the map measures
Forest cover is not a single self-evident quantity. One project may need the fraction of a pixel occupied by tree crowns; another may need a categorical forest mask based on canopy cover, height, and minimum area. A land use inventory may treat temporarily cleared forest differently from a map of visible tree cover. Write the definition before collecting labels, and identify how plantations, orchards, mangroves, sparse woodland, and urban trees will be handled. A consistent definition matters as much as a sophisticated classifier when comparing places or years.
Optical observations provide information about foliage, moisture, and seasonal behavior, but similar vegetation types can have overlapping spectra. A green pixel does not establish tree height or distinguish a natural forest from a plantation. Time series can capture leaf emergence, dry season persistence, and disturbances that a single image misses. Radar adds sensitivity to vegetation structure and moisture, although relationships vary with wavelength, geometry, and forest conditions. Combining observations can improve discrimination when each input has a clear role and compatible spatial support.
Make estimates comparable and testable
Prepare a stable analysis grid, inspect geolocation, and apply consistent atmospheric and quality screening to optical inputs. Choose seasonal windows that suit the local ecology rather than assuming one calendar works everywhere. When clear observations are sparse, report the observation count and the age of the composite. Train with examples spanning forest types, canopy densities, topography, and confusing nonforest classes. Keep independent assessment locations separate from training areas, especially where neighboring pixels share the same stand.
Evaluate omission and commission errors for forest and relevant subclasses. A high overall accuracy can conceal poor performance in a rare forest type or along fragmented edges. For area reporting, use a probability sample and an estimator appropriate to its design rather than treating classified pixel counts as exact. Compare annual products with the same class definitions and processing assumptions. Abrupt canopy loss can indicate harvesting, fire, storms, or conversion, and the image alone may not identify the cause. Preserve that distinction in summaries, and accompany trend estimates with uncertainty and a description of what canopy recovery does and does not establish.
Match the timing of reference observations
The value of a reference measurement depends partly on how well its timing matches the observation being evaluated. A surface, crop, water body, or instrument state may change between the two measurements. Start by documenting the acquisition time of every source and the period over which the reference observation applies. Avoid treating a date entered during data upload as though it were necessarily the time when the measurement was collected.
Define an acceptable timing relationship for the application. A slowly changing structural feature may tolerate a broader comparison window than a rapidly changing surface condition. The window should be justified by the process being studied and by any available contextual records. If conditions change within that period, consider separating the observations into suitable groups rather than combining them under a single assumption of comparability.
Preserve information about interventions and events between observations. A management operation, rainfall episode, disturbance, or change in sensor configuration can alter the interpretation of a comparison. Record the event and decide whether the pair remains suitable for evaluation. Where the timing mismatch cannot be resolved, describe the comparison as qualified evidence. This is more informative than allowing an uncertain match to influence a performance statistic without explanation.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



