Icechunk-ERA5: a daily updating, performance-optimized ARCO data cube, with 86 years of 43 surface and pressure-level variables. Available now on the Earthmover Data Marketplace .

Every nation's data deserves modern infrastructure

Agencies worldwide hold petabytes of weather, ocean, climate, and Earth-observation data locked in legacy formats. Earthmover makes it cloud-native, AI-ready, and governed — built on the open-source standards our team created and maintains, deployed on your cloud, with your data never leaving your control.

In production for the UK's ARIA, piloted with NASA, and adopted by NOAA's National Weather Service — while the open-source standards our team builds run at NOAA, NASA, USGS, ECMWF, the UK Met Office, and beyond.

100×
faster timeseries access in NASA's published Icechunk benchmark
The Access Gap

The data is invaluable. The access is stuck in the 1990s.

Governments steward some of the largest and most valuable scientific archives on Earth — tens of petabytes of weather, ocean, climate, and Earth-observation data. Most of it sits in legacy HDF5, NetCDF, and GRIB files that are slow to access and hard to govern.

  • Legacy formats at petabyte scale: agencies steward 50–70 PB across object storage with no analysis-ready, cloud-optimized layout — so every analysis starts with a download-and-reprocess step.
  • AI mandates stall on legacy data: teams are now required to make archives AI-ready, but you can't stream thousands of NetCDF or GRIB granules straight to a GPU — training and inference bottleneck on preprocessing.
  • Slow access blocks science: pulling one timeseries from a granule-based archive can mean touching thousands of files. In NASA's own benchmark, a one-month timeseries from GPM IMERG meant querying 1,488 separate granules.
  • Reproducibility isn't built in: research and operational model releases need versioned, citable data states that legacy archives simply don't provide.
  • Governance and procurement friction: agencies need RBAC, SSO, audit logging, and data-residency guarantees — and a vendor that fits national procurement vehicles instead of fighting them.

The data is already paid for. The bottleneck is access — and now AI-readiness. Both are solvable infrastructure problems, not a reason to migrate a hundred petabytes.

One platform, three mission contexts

Operational, research, and public dissemination — on one data layer

01

Operational

Mission-critical forecasting and monitoring at the highest reliability bar.

02

Research

Reproducible, version-pinned model data for science line offices.

03

Public dissemination

Open, analysis-ready data delivered to the public and partners at zero friction.

Capabilities

Built for the agency mission

AI-ready by default

Icechunk presents archival HDF5, NetCDF, and GRIB as analysis-ready Zarr cubes that stream straight to training and inference — version-pinned so every AI experiment is reproducible.

Modernize in place

Convert legacy HDF5, NetCDF, and GRIB to cloud-native Zarr and Icechunk — phased, dataset by dataset, with no rip-and-replace.

Reproducible by design

Icechunk versioning gives every model release an immutable, citable tag — so a research line office can track model states from one release to the next.

Your cloud, your data

Data stays in the agency's own S3, GCS, or Azure — including S3-compatible sovereign and on-prem stores. Earthmover holds only catalog metadata and the control plane, never the bytes.

Standards-based delivery

Flux serves OGC-standard APIs — EDR, Tiles, OPeNDAP — so existing tools and partners connect without custom integration.

Enterprise governance

SSO and SAML (Okta, Azure AD, ADFS), RBAC, MFA, and three-layer audit logging across infrastructure, application, and identity.

Measured, not marketed

A 100× speedup — with no data migration

Extracting a one-month precipitation timeseries from 1,488 GPM IMERG granules. Icechunk virtualizes the archive as a single analysis-ready Zarr cube directly on S3 — the same access pattern that feeds modern AI training.

Icechunk on S3 3s Legacy on-prem (POSIX) 45s Naïve cloud (open_mfdataset) 5 min

Time to extract a one-month timeseries · lower is better

Why Earthmover for government

We wrote the open source your scientists already use

For more than a decade, Earthmover's team has built the foundational open-source technology that lets scientific data work in the cloud — authoring and maintaining Zarr, Icechunk, Xarray, and Pangeo. These are the standards your scientists already run, adopted across NOAA, NASA, USGS, ECMWF, and the UK Met Office. That track record makes us the strongest continuity, AI-readiness, and anti-lock-in answer a government buyer can get.

  • Continuity by design: if Earthmover ceased to exist tomorrow, your data is still in open formats, readable with a single line of Python — no proprietary engine, no migration.
  • Data residency first: your data stays in your bucket, you control the IAM, and we never store your bytes.
  • Procurement-ready: available via AWS Marketplace, as a direct award, or as a platform component subcontracted through a prime integrator — registered for U.S. federal procurement and deployable under sovereign frameworks elsewhere.
  • Honest on compliance: SOC 2 Type II audit in progress, with data-residency and customer-VPC deployment options for the strictest environments.

Modernize your agency's data — in place, in open standards.