A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers satellite time series and crop phenology in maize production fields. The immediate decision is to prioritise uneven-development scouting. Useful reference evidence includes emergence dates, plant stand notes and field stage. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Describe a seasonal trajectory
Phenology concerns the timing of recurring biological development. In an agricultural image series, a changing canopy can create a trajectory associated with establishment, growth, maturity and harvest. The trajectory is an indirect observation of those processes. Satellite measurements do not necessarily identify each agronomic stage on their own. A useful interpretation connects the series with crop type, planting information and field observations. This helps distinguish an unexpected development pattern from a normal difference in variety, management or seasonal timing.
The first design choice is the unit of comparison. A management block, planting cohort or crop zone may provide a more meaningful series than a broad administrative area containing several crops. Keep the spatial unit consistent and track changes to its boundary. Record which summary statistic is used and how many valid observations support it. A smooth line can be visually persuasive even when it connects only a few reliable dates. The chart should make gaps and uncertain periods visible instead of implying continuous knowledge.
Evaluate timing and missing observations
Timing metrics require explicit definitions. The date of a measured increase, the date inferred from a fitted curve and the date recorded by a field team may differ. Decide which quantity is needed and how it will be evaluated. Smoothing can reduce noise, but an overly flexible or overly rigid method can alter the apparent timing of an event. Compare candidate settings against independent observations and inspect whether they behave sensibly during short seasons, interrupted growth and abrupt management changes.
A practical monitoring service also needs a policy for delayed and missing data. Optical cloud cover can obscure a critical part of a season, and a later observation may only confirm that a transition occurred within an interval. Report that interval where appropriate. Do not replace an unavailable observation with an unlabelled estimate. Over several seasons, evaluate whether the derived timing information improves planning or interpretation and whether the relationship remains stable. The goal is a defensible seasonal description that supports a field decision, with its temporal uncertainty retained.
The setting: Maize production fields
Maize fields can differ in emergence date, variety, plant density and management even within the same growing region. An image comparison is more meaningful when those differences are recorded. Early in the cycle, visible soil and row arrangement can influence a field summary substantially. Later, the canopy may become dense enough that some vegetation measures respond less clearly to additional growth. Interpret the observations in relation to the crop stage and the variable of interest.
Construct a field timeline that marks establishment, important field operations and the dates of usable observations. A decline or delayed increase in a signal can suggest a place to investigate, but several explanations may be possible. Soil conditions, weeds, storm effects and crop timing can produce patterns that require field context. Avoid turning a general anomaly map into a specific diagnosis without measurements that distinguish between these alternatives.
A scouting plan should include representative normal areas as well as the locations ranked most unusual. Record crop stage, stand continuity, visible damage and management information consistently. Production models require their own training and evaluation data, ideally covering different fields and seasons. For operational use, assess whether a satellite-derived priority list helps the field team find relevant conditions efficiently, and report the observation age whenever weather leaves a gap in the current image sequence.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Design an evaluation that reflects deployment
A model evaluation should resemble the conditions in which the model will be used. Start by identifying which relationships the development data share: nearby locations, repeated observations of the same unit, common collection teams, or measurements from a single period. These relationships can make records less independent than they appear. An evaluation that ignores them may test the ability to recognise familiar conditions rather than the ability to operate in a new setting.
Choose a split strategy that matches the intended transfer. Holding out locations, seasons, operational units, or acquisition conditions can answer different questions. Document which question each split is designed to address, and keep the held-out evidence separate while selecting features and tuning the method. Repeatedly inspecting the same evaluation set to improve a model gradually makes that set part of development, even if it retains its original label.
Report results at a scale that is meaningful to the user. A strong average can hide poor performance for important subgroups or unusual conditions. Examine error patterns and retain examples of both successful and unsuccessful predictions. Where the evidence covers only a limited range of conditions, describe that range explicitly. The evaluation then becomes a practical guide to suitable use, further testing, and the collection of additional reference observations.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



