Author: Sebastian Galkin
Evolving our Tensor Storage Engine: A Preview of Icechunk 2
Earthmover is building the cloud platform for scientific data, focusing on weather, climate and geospatial use cases. In these domains,...
Read more
Sebastian Galkin
Staff Engineer
Everything you need to know about Icechunk garbage collection
We will talk about two powerful Icechunk operations: expiration and garbage collection. They are related, so we usually refer to...
Read more
Sebastian Galkin
Staff Engineer
Icechunk: Efficient storage of versioned array data
We recently got an interesting question in Icechunk’s community Slack channel (thank you Iury Simoes-Sousa for motivating this post): I’m...
Read more
Sebastian Galkin
Staff Engineer
Learning about Icechunk consistency with a clichéd but instructive example
In this post we’ll show what can happen when more than one process write to the same Icechunk repository concurrently,...
Read more
Sebastian Galkin
Staff Engineer
Exploring Icechunk scalability: untangling S3’s prefix story
We at Earthmover recently released the Icechunk tensor storage engine, a novel cloud-optimized storage format and library for large-scale array data. Built...
Read more
Sebastian Galkin
Staff Engineer