virtualized

BRAN2023 daily ocean fields, virtualized as kerchunk Parquet reference stores.

Zarr explorer →
Browse every store in this repository in the browser: the chunk grid coloured by compressed byte size, per-chunk references (URL, offset, length), byte profiles through depth and time, store-to-store metadata comparison, a SQL console over the refs, and decoded values where the data server allows it.

The stores index 180-192 monthly netCDF files of the CSIRO Bluelink Reanalysis (BRAN2023) served by NCI THREDDS. No data is copied: each Zarr chunk is a row in a refs.N.parq file pointing at a byte range of the original netCDF.

Where the references live. The reference stores are currently served from this GitHub repository. Storage will move to source.coop or an equivalent open object store. Future moves will be made operational: the explorer, the example code and the links here will be updated to follow the stores, so that the published entry points keep working.

Source, scripts and access examples (xarray, GDAL, terra): github.com/mdsumner/virtualized