A workflow that succeeds on a small study area may encounter different constraints when the number of observations, locations, or users increases. Scaling requires attention to processing capacity, data organisation, reference coverage, and the effort needed to review results. This perspective looks beyond whether a calculation can run on a larger dataset. It asks whether the complete service can preserve its meaning, quality, and delivery commitments as its scope expands. The objective is a design that identifies bottlenecks early and increases throughput without silently weakening the evidence available to users.
This working guide considers keeping earth observation data usable over time within urban green-space mosaics. The immediate decision is to select green-space locations for assessment. Useful reference evidence includes canopy cover, surface context and appropriately timed measurements. The case is an illustrative planning context, with assumptions to check against the actual sensor, landscape and project requirements.
The setting: Urban green-space mosaics
Urban green spaces form mosaics of trees, grass, bare ground, paths, buildings and water. The observation needed depends on whether the project concerns vegetation cover, land-surface temperature or a particular use of the space. These are distinct variables. Visible and near-infrared imagery can describe vegetation-related patterns, while a temperature study requires suitable thermal measurements and an interpretation that respects what those measurements represent rather than treating greenness as a temperature sensor.
Define park or management boundaries and inspect how surrounding urban surfaces contribute to each observation. Shade, seasonal foliage and maintenance can affect vegetation comparisons, while acquisition timing matters strongly to a thermal interpretation. Data from different instruments may also have different spatial support. A fine-looking display should not suggest that a coarse thermal measurement resolves the same detail as an optical image or an individual tree inventory.
Field validation should record the target variable with methods and timing suited to the intended claim. Canopy observations, surface measurements and information about how people use a site provide different evidence streams. A remotely observed pattern may help choose assessment locations without establishing a complete account of human exposure or park performance. Evaluate the specific management decision, and communicate the scale, observation time and uncertainty that determine how the resulting map can be used.
Define the responsibilities around the files
Data governance is the set of practical decisions that makes an archive trustworthy and usable. It covers who can publish a product, who maintains its description, how corrections are approved and how users discover changes. These responsibilities matter even for a small project. Without them, an attractive map may become detached from its source scenes, processing method and known limitations.
Assign stable identifiers to datasets and distinguish a collection from its individual files. Record the producer, contact route, geographic extent, time coverage, coordinate reference system, units and missing value conventions. Describe the processing level and whether the values represent measurements, corrected observations or model estimates. A clear data dictionary is especially important when a compact code or numeric flag carries a meaning that would otherwise remain implicit.
Preserve context as products evolve
Maintain provenance from source acquisition through processing and publication. Preserve source identifiers, algorithm versions, parameter settings and links to validation material. When a correction changes values, create a traceable version rather than silently replacing a file and leaving its description untouched. Explain the reason for the revision and whether earlier analyses should be revisited. Checksums help detect changes or corruption but cannot establish that a scientific interpretation is correct.
Access rules should reflect the actual data and agreements involved. Public satellite imagery does not automatically make every associated field record or derived dataset unrestricted. Location records may reveal sensitive ecological sites, and field photographs may include identifiable people. Review the relevant terms before combining or distributing sources, and express reuse conditions in plain language with a suitable license where appropriate. Preserve acknowledgement and citation requirements alongside the data.
Plan retention, backups and recovery before storage becomes crowded. Keep essential documentation and reproducible processing materials with the deliverable, while identifying intermediate files that can be regenerated. Test that a restored copy opens correctly and has the expected metadata. A release checklist should include file integrity, machine readable metadata, readable documentation and a useful contact path. Periodic stewardship reviews can detect broken links, obsolete formats and orphaned responsibilities. The aim is a product that remains interpretable after the original analyst has moved on.
Use observation labels with consistent meanings
A reference label should describe an observation that another person could recognise or reproduce. Broad terms such as good, damaged, or unusual can conceal substantial differences between collection teams. Begin by defining the feature or condition being recorded, the observation unit, and the evidence needed to assign a label. Where possible, distinguish a direct measurement from an interpretation made by the observer.
Provide a short collection guide with examples, boundary cases, and a way to record uncertainty. Train observers using shared cases before relying on independently collected labels. If two observers disagree, preserve the disagreement long enough to understand its cause. It may reveal an unclear definition, a genuinely ambiguous condition, a difference in observation scale, or a problem in matching the reference record to the remote measurement.
Retain the context that makes the label interpretable. Location, time, collection method, observer role, and relevant surface conditions can be essential for later review. Changes to the label scheme should be documented and related to earlier versions where a defensible correspondence exists. Consistent labels do not eliminate uncertainty, but they make it possible to investigate disagreement, evaluate analytical methods, and identify where better definitions or additional measurements would improve the evidence.
Budget the complete processing workflow
A processing budget should cover the complete path from source observations to a maintained product. Data access and computing are only part of that path. Include preparation, geographic updates, reference collection, expert review, delivery, and support where those activities belong to the service. A calculation that runs cheaply on a small demonstration can still require substantial effort when the surrounding work is repeated across many locations.
Measure representative tasks rather than assuming that every observation costs the same amount to process. Record data volume, processing time, retry frequency, manual interventions, and the conditions that create unusually demanding cases. Separate fixed setup work from work that grows with the number of observations or users. These records support decisions about batching, caching, storage policy, and the point at which a different processing design becomes worthwhile.
Connect the budget to a defined level of service. Faster delivery, more frequent observation, broader coverage, or more detailed review can each change the resources required. Describe these trade-offs before promising a delivery pattern that the workflow has not demonstrated. Review the budget using operational evidence and preserve enough detail to understand changes between processing versions. The aim is a sustainable service whose resource choices remain aligned with the information that users value.
Bring the evidence back to the decision
Expansion should be guided by measured workload, visible quality conditions, and an understanding of which tasks require expert attention. Test the workflow under representative data volumes before treating a successful demonstration as evidence of operational capacity. Preserve a route for investigating individual observations even when most processing is automated. A scalable service keeps its results traceable and useful as it grows, with clear choices about where to automate, where to review, and where to invest in additional evidence.
Sources & further reading
Explore the bhumisat spacecraft concept and our vision towards 2030, or return to the journal.



