Ship fast, break nothing: Engineering rigor in Icechunk with concurrency & fault injection testing
We describe our approach to rigor in Icechunk 2 including concurrency permutation testing and more!
Deepak Cherian
Principal Research Engineer
blog · tag
#Rust
2 posts
Announcing Icechunk!
Earthmover announces Icechunk, an open-source transactional storage engine for Zarr that brings ACID transactions, time travel, data versioning, and high-performance Rust-based I/O to multidimensional array data in cloud object storage.
Ryan Abernathey
CEO & Co-founder
Related Posts
Blog Tags
access controls access-control ai AI weather AIFS announcement arraylake Arraylake aurora Big Data blog post blog-post case study case-study chat cirrus climate risk cloud cloud native compliance compute conference data cube data infrastructure data workflows dev note dynamical earth observation earth-observation energy engineering enterprise era5 event FAIR feature release financial-services flux fundamentals garbage collection geospatial GOES-R governance grib guest-post hrrr hugging-face hypothesis iceberg icechunk Icechunk IFS LangChain LangGraph marketplace mcp NASA natural language processing NCEI netCDF NetCDF noaa NOAA nws oceanography open data open science open source performance product property-testing public-sector python Python Radar rust Rust security serverless shuttle soc2 sql tables tabular data teams technical tensorops tensors testing third-wheel toxiproxy trust vector data virtual-zarr virtualizarr weather wildfire WOD xarray Xarray zarr Zarr zax