A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers building a spacecraft power and energy budget in agricultural payload studies. The immediate decision is to define testable agricultural observation requirements. Useful reference evidence includes application trials and traceable payload measurement specifications. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Agricultural payload studies
An agricultural satellite payload study should begin with the information needed by its intended users. A proposed observation might support crop-stage comparison, vegetation mapping or a field-inspection priority, and each use can imply different requirements. A list of spectral channels is only one part of that definition. The study should establish which variable or pattern is being investigated, the landscape scale at which it matters and the evidence that would show the resulting information is useful.
Candidate methods can be explored using suitable existing imagery and field measurements before the independent payload design is finalised. These trials help identify which observations add useful information and which conditions create ambiguity. Record the spatial support, acquisition timing and calibration assumptions behind the results. Performance demonstrated in one application setting should remain evidence for that setting until the wider range of crops, management systems and conditions has been evaluated.
Payload requirements should connect those findings to measurable instrument and system properties. Spectral response, image geometry, radiometric consistency and delivery timing belong in the same discussion as platform constraints. A concept illustration does not establish that these requirements have already been met. The practical output of this stage is a traceable set of application needs, test methods and design decisions, allowing researchers and engineers to discuss what should be demonstrated before stronger mission claims are made.
Distinguish power from stored energy
A spacecraft electrical power system must generate energy, store it when necessary and distribute it reliably to the loads. Power describes the rate of energy use, while energy describes consumption over an interval. A transmitter may have a high instantaneous demand even if it operates briefly. Conversely, a modest continuous load can dominate the daily energy budget. Both views are needed to size the system.
List operating modes and their duration: standby, imaging, processing, communication, safe mode and any relevant transitions. Include heaters, power conversion losses and supporting electronics rather than counting only the camera and radio. Identify loads that overlap in time and those that can be scheduled separately. Peak current and startup behavior can challenge distribution hardware even when the average energy balance appears comfortable.
Check realistic orbit and lifetime conditions
Solar generation depends on illumination, array orientation, temperature and the condition of the cells and associated hardware. Eclipse intervals require stored energy, and imaging or communication pointing may reduce favorable Sun exposure. Evaluate the time sequence across representative orbits rather than comparing one average generation number with one average load. Consider the expected decline in performance over the mission and apply clearly justified design margins.
Battery sizing must consider usable capacity under the planned temperature, discharge rate and cycling conditions. Nominal capacity alone does not describe what is safely available in service. Charging limits, allowed depth of discharge, ageing and monitoring requirements influence the operating envelope. Thermal design and power planning therefore need to evolve together. A heater can protect a battery while consuming the energy that the battery is expected to deliver.
The distribution system should detect and isolate relevant faults while preserving essential functions. Define which loads are shed when energy becomes scarce and what conditions allow them to return. Safe mode needs its own verified energy balance and a credible path toward recovery. Telemetry should support comparison between predicted and measured generation, consumption and battery behavior. Test the budget with realistic duty cycles, instrument startup sequences and communication sessions, then update the model using measured component performance. A defensible power plan explains the worst cases and the assumptions behind its reserve, allowing observation schedules to be adjusted before they threaten spacecraft survival.
Design an evaluation that reflects deployment
A model evaluation should resemble the conditions in which the model will be used. Start by identifying which relationships the development data share: nearby locations, repeated observations of the same unit, common collection teams, or measurements from a single period. These relationships can make records less independent than they appear. An evaluation that ignores them may test the ability to recognise familiar conditions rather than the ability to operate in a new setting.
Choose a split strategy that matches the intended transfer. Holding out locations, seasons, operational units, or acquisition conditions can answer different questions. Document which question each split is designed to address, and keep the held-out evidence separate while selecting features and tuning the method. Repeatedly inspecting the same evaluation set to improve a model gradually makes that set part of development, even if it retains its original label.
Report results at a scale that is meaningful to the user. A strong average can hide poor performance for important subgroups or unusual conditions. Examine error patterns and retain examples of both successful and unsuccessful predictions. Where the evidence covers only a limited range of conditions, describe that range explicitly. The evaluation then becomes a practical guide to suitable use, further testing, and the collection of additional reference observations.
Prioritise alerts using evidence and consequence
An alert is a request for attention, so its design should consider both the evidence available and the cost of responding. Begin by distinguishing a measured change, a proposed interpretation, and the action expected from the recipient. A large numerical difference is not automatically the most urgent case. The significance of the location, the age of the observation, the confidence in the interpretation, and the consequences of delay can all influence priority.
Create a review queue with enough context to support consistent decisions. Useful information can include the supporting dates, quality qualifications, previous observations, geographic unit, and the reason the case entered the queue. Define when an alert can be closed, escalated, or held for another observation. A documented rule is easier to improve than an informal practice that depends entirely on the memory of the operator reviewing the result.
Collect feedback from inspections and operational responses. Record alerts that led to a useful finding, alerts that required no action, and important conditions that the system failed to flag. Review these outcomes across different settings rather than relying only on a total count of alerts. The objective is a queue that directs limited attention towards meaningful decisions, while generating evidence for adjusting thresholds, improving context, and reducing repeated sources of unnecessary work.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



