Raster, vector, point cloud: every geospatial format solves the same core
problems, including linearization, chunking, compression, and metadata. Let’s
build a format from scratch to see these concerns in practice.
Raster, vector, point cloud: every geospatial format solves the same core
problems, including linearization, chunking, compression, and metadata. Let’s
build a format from scratch to see these concerns in practice.
When configured equivalently, COG and Zarr store the exact same data bytes.
So what actually distinguishes one raster format from another? Metadata. We
get philosophical about what metadata even is, examine how TIFF and Zarr each
represent it, tour the various ways geospatial coordinate information is
encoded across formats, ask where metadata should live, and make the case that
formal, versioned conventions are what truly enable interoperability.
What happens if we question current assumptions around Cloud-Native
Geospatial (CNG) and imagine what it could be if we were to redefine it with
new technologies? The Coalesced Chunk Retrieval Protocol (CCRP) is one idea
born of this thinking, aiming to help make CNG more efficient and easier for
both data consumers and producers.
Compression is a fundamental and increasingly critical part of modern data
storage and processing. But compression is often naively miscategorized as a
single processing step. A better understanding of the steps in compression
pipelines, the priciples behind them, and how to measure their effectiveness
will enable us to move beyond the default compression settings and realize
gains from more effective compression techniques.
Raster data formats are chunked internally, but the cloud has exposed these
internal implementation details. We dig into the finer details of chunking to
understand how chunking has become something tyrannical, dictating how we can
and can’t access data efficiently. Part 2 of 2.
Raster data formats are chunked internally, but the cloud has exposed these
internal implementation details. We dig into the finer details of chunking to
understand how chunking has become something tyrannical, dictating how we can
and can’t access data efficiently. Part 1 of 2.
A day-long capacity-building workshop for professionals new to working with
cloud-native formats and workflows: an introduction to cloud-native
geospatial for Earth observation, followed by a deep dive into cloud-native
raster formats.