Convert Zarr to Icechunk with just a few clicks!
Arraylake makes it trivial to ingest and view existing Zarr stores in the cloud.
Tom Nicholas
Software Engineer
blog · tag
#Arraylake
15 posts
NVIDIA: Building a Low-Latency Earth-2 Nowcasting Pipeline with Earthmover
NVIDIA and Earthmover built a low-latency nowcasting workflow that turns Meteosat satellite observations into a two-hour nowcast using Earth-2 StormScope-EU, and serves it directly from versioned data through map tiles and SQL.
Negin Sobhani
Senior Machine Learning Performance Engineer, NVIDIA
Aaron Spring
Data and AI Freelancer
Jussi Leinonen
Senior Solution Architect, NVIDIA
Marius Koch
Senior Solution Architect, NVIDIA
Science data comes in tables and tensors
Apache Iceberg comes to Arraylake. Tables now live alongside Icechunk arrays in the same catalog, under the same permissions, in your own buckets — queryable from DuckDB, Spark, Trino, Snowflake, and Zax-SQL.
Joe Hamman
CTO & Co-founder
Matt Iannucci
Staff Engineer
Our compute roadmap: introducing Zax SQL
We're introducing Zax, a new query and compute engine for multidimensional scientific data, and Zax-SQL, the first interface to it. Zax plans your computation for you, so you are no longer responsible for tuning chunk sizes, worker counts, and memory limits.
Ryan Abernathey
CEO & Co-founder
Brian Davis
Head of Product
Joe Hamman
CTO & Co-founder
Deepak Cherian
Principal Research Engineer
Sebastian Galkin
Head of Engineering
Announcing the Arraylake Community Tier
Arraylake's refreshed Community Tier unlocks powerful developer capabilities and open-science workflows for free: create your own repos, bring your own object store or use 10 GB of managed storage, and serve data through Earthmover Compute with 50 compute credits per month.
Lindsey Nield
Senior Engineer
Brian Davis
Head of Product
Product Announcement: Teams in Arraylake
Teams is here for Arraylake paid accounts: group users and API keys, grant roles once, and every member inherits them. Group-level access management for growing data teams.
Brian Davis
Head of Product
Matt Iannucci
Staff Engineer
Multiscale overviews in Arraylake: GeoZarr-Powered Pyramids in Flux - and How to Generate Them in Icechunk
Overviews, Multiscales, and Pyramids—oh my! We’re introducing multiscale support across Arraylake and Flux Tiles, powered by GeoZarr conventions. This post bridges the product and the data pipeline: how Flux uses precomputed overviews for efficient multiscale visualization, and how to generate those overviews so your datasets can take advantage of this capability.
Lindsey Nield
Senior Engineer
The University of Southern Mississippi makes 90 million ocean profiles conversational: AQUAVIEW's approach to the World Ocean Database
How AQUAVIEW reorganized NOAA's World Ocean Database around instrument types, powered it with Arraylake, and built a natural language interface that turns hours-long data workflows into seconds.
Henry Jones PhD
Director of Research Development and Scientific Entrepreneurship, University of Southern Mississippi
Joshua Hill PhD
Director, Institute for Advanced Analytics and Society, University of Southern Mississippi
Virtual chunks that just work — but securely
Delivering enterprise-grade access control for virtual chunks - surprisingly subtle!
Tom Nicholas
Software Engineer
Sebastian Galkin
Head of Engineering
Old format, no problem!: Cloud-optimizing the GOES-16 archive as Virtual Zarr
Access billions of chunks of satellite imagery as a single Zarr store, without copying any data!
Tom Nicholas
Software Engineer
Announcing the Arraylake MCP Server
The Arraylake MCP server is now publicly available. Connect Claude, ChatGPT, Cursor, or any MCP-compatible client to your Arraylake data and let an AI assistant discover repositories, inspect schemas, query Flux, and render interactive maps.
Matt Iannucci
Staff Engineer
Ship fast, break nothing: Engineering rigor in Icechunk with property and stateful testing
How we engineer rigor into Icechunk and its upstream brethren using property and stateful testing techniques. Also, a cautionary tale.
Deepak Cherian
Principal Research Engineer
Sebastian Galkin
Head of Engineering
How Kettle Uses Earthmover to Power Wildfire Risk Modeling at Scale
The Company Kettle is not a typical insurance company. Using AI to build smarter insurance products, Kettle provides insurance for property owners in areas affected by catastrophic climate events, with a particular focus on wildfire. Their AI models consume over 130 terabytes of satellite, weather,
Margaret Francis
COO
Evolving our Tensor Storage Engine: A Preview of Icechunk 2
A preview of Icechunk 2, featuring node rename, chunk reindexing, rectilinear grids, repository-level metadata, and significant performance improvements with a smooth migration path from Icechunk 1.
Sebastian Galkin
Head of Engineering
Announcing Fine-Grained Access Controls
Arraylake now supports fine-grained, repository-level permissions with admin, write, and read privilege levels, giving teams precise control over data access and secure sharing with external collaborators.
Brian Davis
Head of Product
Related Posts
Blog Tags
access controls access-control agents ai AI weather AIFS announcement architecture arraylake Arraylake aurora Big Data biology blog post blog-post case study case-study chat cirrus climate risk cloud cloud native compliance compute conference data archives data cube data infrastructure data workflows dev note dynamical earth observation earth-2 earth-observation energy engineering enterprise era5 event FAIR feature release financial-services flux forecast fundamentals garbage collection geospatial GOES-R governance grib guest-post hrrr hugging-face hypothesis iceberg icechunk Icechunk IFS LangChain LangGraph marketplace mcp NASA natural language processing NCEI netCDF NetCDF noaa NOAA nowcasting nvidia nws oceanography open data open science open source performance product property-testing public-sector python Python Radar rust Rust scverse security serverless shuttle single-cell soc2 sql tables tabular data teams technical tensorops tensors testing third-wheel toxiproxy trust vector data virtual-zarr virtualizarr virtualization weather wildfire WOD xarray Xarray zarr Zarr zax zero-copy-ingest