A method that produces a plausible result has not automatically demonstrated that it works for its intended users. Validation requires a defined question, suitable reference evidence, and an evaluation design that reflects how the method will be used. This perspective examines which observations should be compared, how they should be sampled, and which errors matter in practice. It also considers the difference between evidence used to develop a method and evidence reserved for evaluating it. The objective is a test that can reveal weaknesses as well as confirm useful performance.
This working guide considers building a spacecraft power and energy budget within ground-station data delivery. The immediate decision is to test delivery of usable observation products. Useful reference evidence includes transfer records, acquisition metadata and complete product checks. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Ground-station data delivery
A ground-station workflow connects acquired observations with the data products a user eventually receives. Successful communication is one part of that chain, while completeness, timing, processing and interpretation determine whether the observation is useful. Define what the delivery system must preserve, including acquisition identifiers, instrument settings, timing and the metadata needed for later calibration or geolocation. A received file should not automatically be treated as a complete and ready-to-use image product.
A test sequence should follow data from a known input through transfer, storage, processing and delivery. Record missing segments, failed attempts and changes in processing state instead of hiding them behind a simple success label. The operational question may concern when an agricultural user receives a current observation or whether a researcher can reproduce a product. These uses require traceable timestamps and a clear distinction between preliminary material and the version accepted for analysis.
Validation can use controlled test data and documented end-to-end checks before any independent satellite service becomes operational. Assess whether the delivered product retains its expected content and whether failures are represented clearly enough for a user to respond appropriately. A concept timetable cannot establish actual service availability. The practical output is evidence about the delivery workflow, its measured constraints and the information users need to judge the age, completeness and processing status of an observation.
Distinguish power from stored energy
A spacecraft electrical power system must generate energy, store it when necessary and distribute it reliably to the loads. Power describes the rate of energy use, while energy describes consumption over an interval. A transmitter may have a high instantaneous demand even if it operates briefly. Conversely, a modest continuous load can dominate the daily energy budget. Both views are needed to size the system.
List operating modes and their duration: standby, imaging, processing, communication, safe mode and any relevant transitions. Include heaters, power conversion losses and supporting electronics rather than counting only the camera and radio. Identify loads that overlap in time and those that can be scheduled separately. Peak current and startup behavior can challenge distribution hardware even when the average energy balance appears comfortable.
Check realistic orbit and lifetime conditions
Solar generation depends on illumination, array orientation, temperature and the condition of the cells and associated hardware. Eclipse intervals require stored energy, and imaging or communication pointing may reduce favorable Sun exposure. Evaluate the time sequence across representative orbits rather than comparing one average generation number with one average load. Consider the expected decline in performance over the mission and apply clearly justified design margins.
Battery sizing must consider usable capacity under the planned temperature, discharge rate and cycling conditions. Nominal capacity alone does not describe what is safely available in service. Charging limits, allowed depth of discharge, ageing and monitoring requirements influence the operating envelope. Thermal design and power planning therefore need to evolve together. A heater can protect a battery while consuming the energy that the battery is expected to deliver.
The distribution system should detect and isolate relevant faults while preserving essential functions. Define which loads are shed when energy becomes scarce and what conditions allow them to return. Safe mode needs its own verified energy balance and a credible path toward recovery. Telemetry should support comparison between predicted and measured generation, consumption and battery behavior. Test the budget with realistic duty cycles, instrument startup sequences and communication sessions, then update the model using measured component performance. A defensible power plan explains the worst cases and the assumptions behind its reserve, allowing observation schedules to be adjusted before they threaten spacecraft survival.
Locate the uncertainty that matters to the decision
An uncertainty budget is a practical description of where a result could become unreliable. Begin with the observation chain: acquisition, calibration, geographic matching, reference measurements, feature calculation, modelling, and delivery. Identify the assumptions at each stage and ask which could materially change the interpretation. The purpose is not to assign a precise number to every limitation. It is to locate the sources that deserve attention for the intended decision.
Separate limitations that can be measured from those that currently require a qualitative description. Repeated measurements may help characterise variability, while comparisons with independent references can reveal systematic differences. Some uncertainties interact, so combining individual error estimates without examining their relationships can produce a misleading impression of precision. Keep the method of assessment visible and avoid treating an unexamined assumption as though it were a negligible contribution.
Use the budget to prioritise further work. The largest visible source of variation is not always the one whose reduction would most improve the decision. Consider which additional observation, test, or contextual record would change confidence in an actionable way. Revisit the budget when the application, observation source, or deployment conditions change. This turns uncertainty analysis into a guide for improving the workflow rather than a qualification added only after the result has been delivered.
Define a representative reference sample
A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.
Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.
Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.
Bring the evidence back to the decision
The validation record should explain the population represented by the test, the reference observations used, and the limitations of the comparison. Report meaningful errors alongside useful successes, and retain examples that challenge the method. Treat wider deployment as a new opportunity to evaluate transfer across relevant conditions. A well-designed validation programme gives users a defensible basis for deciding where the method is useful, where additional evidence is needed, and where another approach may be appropriate.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



