A workflow that succeeds on a small study area may encounter different constraints when the number of observations, locations, or users increases. Scaling requires attention to processing capacity, data organisation, reference coverage, and the effort needed to review results. This perspective looks beyond whether a calculation can run on a larger dataset. It asks whether the complete service can preserve its meaning, quality, and delivery commitments as its scope expands. The objective is a design that identifies bottlenecks early and increases throughput without silently weakening the evidence available to users.
This working guide considers keeping earth observation data usable over time in potato growing fields. The immediate decision is to focus scouting within potato fields. Useful reference evidence includes emergence records, canopy stage and representative plot observations. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
Define the responsibilities around the files
Data governance is the set of practical decisions that makes an archive trustworthy and usable. It covers who can publish a product, who maintains its description, how corrections are approved and how users discover changes. These responsibilities matter even for a small project. Without them, an attractive map may become detached from its source scenes, processing method and known limitations.
Assign stable identifiers to datasets and distinguish a collection from its individual files. Record the producer, contact route, geographic extent, time coverage, coordinate reference system, units and missing value conventions. Describe the processing level and whether the values represent measurements, corrected observations or model estimates. A clear data dictionary is especially important when a compact code or numeric flag carries a meaning that would otherwise remain implicit.
Preserve context as products evolve
Maintain provenance from source acquisition through processing and publication. Preserve source identifiers, algorithm versions, parameter settings and links to validation material. When a correction changes values, create a traceable version rather than silently replacing a file and leaving its description untouched. Explain the reason for the revision and whether earlier analyses should be revisited. Checksums help detect changes or corruption but cannot establish that a scientific interpretation is correct.
Access rules should reflect the actual data and agreements involved. Public satellite imagery does not automatically make every associated field record or derived dataset unrestricted. Location records may reveal sensitive ecological sites, and field photographs may include identifiable people. Review the relevant terms before combining or distributing sources, and express reuse conditions in plain language with a suitable license where appropriate. Preserve acknowledgement and citation requirements alongside the data.
Plan retention, backups and recovery before storage becomes crowded. Keep essential documentation and reproducible processing materials with the deliverable, while identifying intermediate files that can be regenerated. Test that a restored copy opens correctly and has the expected metadata. A release checklist should include file integrity, machine readable metadata, readable documentation and a useful contact path. Periodic stewardship reviews can detect broken links, obsolete formats and orphaned responsibilities. The aim is a product that remains interpretable after the original analyst has moved on.
The setting: Potato growing fields
Potato monitoring begins with the distinction between the canopy visible from above and the crop component ultimately harvested below ground. Establishment timing, variety, row structure and management can create different canopy patterns across fields. An image service should specify whether it is supporting crop-stage assessment, identifying areas for inspection or estimating a defined production variable. These objectives require different reference measurements and should not be combined into one unqualified vegetation score.
Maintain a field timeline that includes planting, emergence and the operations that can affect canopy appearance. Early observations may contain a large soil contribution, while later observations may show a more continuous canopy. Cloud and shadow contamination, field edges and neighbouring land cover can alter summaries at either stage. Compare observations using suitable quality rules and retain the acquisition dates so that a recent-looking map does not conceal an old measurement.
A field team should collect consistent crop-stage and canopy observations across both flagged and typical areas. Record management context and sampling support rather than relying on an isolated photograph. A vegetation change cannot establish the presence of a specific disease, and a canopy index is not a direct measurement of tuber yield. Evaluate any production model with appropriate harvest data and independent assessment, while keeping the simpler inspection-priority product transparent about what it actually observes.
Maintain the geographic units of analysis
Many observation services summarise measurements within a field, management block, catchment, forest unit, or other mapped boundary. The meaning of that summary depends on whether the boundary accurately represents the unit being discussed. Start with a clear source for the geometry and record its date, coordinate reference, and intended use. A boundary drawn for visual orientation may require additional checking before it becomes a measurement unit.
Inspect overlaps, gaps, narrow fragments, and features that may have changed since mapping. A geometrically valid polygon can still describe an outdated operational unit. Ask the responsible team how divisions, mergers, new infrastructure, and management changes are recorded. Where pixels or reference measurements cross a boundary, define how they are assigned or excluded so that results remain comparable between analysts and processing runs.
Version the boundaries alongside the observations. If a unit changes, preserve a relationship between the previous and revised geometry rather than replacing the history without explanation. Comparisons through time should identify whether they use a constant spatial unit or the operational units valid at each date. This makes it easier to distinguish a change in the measured surface from a change introduced by the geography used to summarise it.
Define a representative reference sample
A reference sample should represent the situations in which a method will be used. Begin by defining the target population: locations, time periods, management conditions, surface types, or instrument states that belong within the intended application. A collection of convenient observations may be valuable for exploration, but it does not automatically support conclusions about that wider population. Make the scope of the sample visible before calculating a summary of performance.
Consider a stratified design when important conditions are unevenly represented. Relevant strata might include different landscape types, developmental stages, observation quality levels, or ranges of the variable being estimated. Choose sample locations within those groups using a documented rule, and retain the information needed to understand their selection. Where access restrictions affect the sample, record the excluded conditions so that the limits of the resulting evaluation remain clear.
Keep development and evaluation evidence separate where the purpose of the study requires an independent test. Nearby observations or repeated measurements can share information, so a random split of individual records may overstate independence. A split organised by location, period, or operational unit can provide a more demanding comparison. The appropriate design follows the intended deployment, the structure of the observations, and the errors that matter to the user.
Bring the evidence back to the decision
Expansion should be guided by measured workload, visible quality conditions, and an understanding of which tasks require expert attention. Test the workflow under representative data volumes before treating a successful demonstration as evidence of operational capacity. Preserve a route for investigating individual observations even when most processing is automated. A scalable service keeps its results traceable and useful as it grows, with clear choices about where to automate, where to review, and where to invest in additional evidence.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



