A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers radiometric calibration and reflectance consistency in fire-affected forest areas. The immediate decision is to prioritise post-event field assessment. Useful reference evidence includes dated disturbance evidence and representative recovery observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Define the quantity that the instrument records
Radiometric calibration establishes a documented relationship between an instrument's recorded output and the physical quantity it is intended to represent. A stored pixel value may be a digital number, a scaled radiance or reflectance value, or another processed representation. Those alternatives should not be treated as interchangeable. The calibration chain explains how the recorded signal becomes an interpretable measurement and which corrections have already been applied. Understanding that chain is essential before comparing dates, combining bands or transferring a model between instruments.
Instrument response can vary across detectors, channels and operating conditions. Calibration therefore concerns more than selecting one conversion coefficient. A study may need to consider offsets, response differences, noise, saturation and changes in behaviour over time. The appropriate characterisation depends on the instrument and its intended use. For a future payload concept, these are requirements to investigate rather than capabilities established by an attractive render. The presence of a multispectral camera alone does not demonstrate that its channels produce consistent, quantitatively comparable observations.
Track consistency through the complete chain
At the product level, begin with the supplier's definitions and metadata. Check scale factors, additive offsets, fill values and valid ranges before deriving an index or statistical summary. Preserve the processing version so that an output can be reproduced later. Inspect whether extreme values correspond to real surfaces or to invalid observations. When a dataset is updated, compare representative old and new results rather than assuming that a familiar file name guarantees an unchanged numerical meaning throughout the archive.
Validation should cover the full chain that supports the stated application. A stable response in a laboratory test is valuable evidence, while operational imagery introduces additional effects from atmosphere, geometry and scene complexity. Use independent references suited to the measurement scale and report the relevant uncertainty. Maintain a record of corrections and their limitations when delivering results to users. A traceable radiometric workflow supports meaningful comparisons and helps separate a change in the observation system from a change in the landscape that a monitoring service is trying to describe.
The setting: Fire-affected forest areas
A fire-affected forest can contain a mixture of changed canopy, exposed soil, surviving vegetation and areas whose appearance is influenced by shadow or smoke. A monitoring workflow should state whether it aims to map an affected area, describe change or follow recovery. These outputs require different interpretation rules and reference observations. An image pattern associated with disturbance is not by itself a complete measurement of ecological impact across every part of the landscape.
Use suitable observations before and after the event, while checking seasonal comparability and data quality. The available dates may constrain the timing of change only to an interval. During recovery, green ground vegetation can increase before the former forest structure returns. Track that distinction where the management objective concerns trees or habitat, and retain the supporting acquisition dates rather than presenting all changes in greenness as equivalent evidence of recovery.
Field validation should represent the range of mapped responses, including apparently unaffected locations and areas with ambiguous observations. Record the evidence of disturbance, vegetation layers and the spatial setting of each sample. If a product estimates severity or a restoration outcome, define the variable and collect reference information for that claim. A transparent first output can identify where observations support change and where additional field assessment is needed to understand its consequences.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Match the timing of reference observations
The value of a reference measurement depends partly on how well its timing matches the observation being evaluated. A surface, crop, water body, or instrument state may change between the two measurements. Start by documenting the acquisition time of every source and the period over which the reference observation applies. Avoid treating a date entered during data upload as though it were necessarily the time when the measurement was collected.
Define an acceptable timing relationship for the application. A slowly changing structural feature may tolerate a broader comparison window than a rapidly changing surface condition. The window should be justified by the process being studied and by any available contextual records. If conditions change within that period, consider separating the observations into suitable groups rather than combining them under a single assumption of comparability.
Preserve information about interventions and events between observations. A management operation, rainfall episode, disturbance, or change in sensor configuration can alter the interpretation of a comparison. Record the event and decide whether the pair remains suitable for evaluation. Where the timing mismatch cannot be resolved, describe the comparison as qualified evidence. This is more informative than allowing an uncertain match to influence a performance statistic without explanation.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



