From 7c5e61c808b7ec35390fd18f92638271fd9c94a9 Mon Sep 17 00:00:00 2001 From: Julius Busecke Date: Wed, 24 Apr 2024 00:47:43 -0400 Subject: [PATCH 1/2] Patch info for v2.0 Beta --- docs/overview.rst | 15 +++++++++++++-- 1 file changed, 13 insertions(+), 2 deletions(-) diff --git a/docs/overview.rst b/docs/overview.rst index 77d194e..3937e7d 100644 --- a/docs/overview.rst +++ b/docs/overview.rst @@ -25,13 +25,24 @@ Python users are encouraged to use `xarray `_) - ``s3://cmip6-pds`` (part of the `AWS Open Data Sponsorship Program `_) -The data is primarily `Zarr `_-formatted, with a predetermined and well-defined directory structure to ensure that it is properly organized and classified. -This directory structure is reflected in the master CSV files located at the root of each bucket, which enumerates all available Zarr stores using their containing directory names as columns to allow for sorting and filtering. +.. warning:: + The AWS S3 storage copy mechanism is currently broken and thus data might be out of sync. + Progress on reimplementing a sync between buckets is tracked `here `_. + +The `Zarr `_-formatted data is currently ingested using `Pangeo-Forge `_ recipes as part of the `NSF LEAP Project `_ (`more info `_) + +The base organization of Zarr stores is reflected in the master CSV files located at the root of each bucket, which enumerates all available Zarr stores and their facets (components of the instance_id) to allow for sorting and filtering. + +.. warning:: + **Parts of the information below is superseeded by the new `Pangeo-ESGF CMIP6 Zarr Data 2.0` (currently in Beta testing)** + Please refer to the `repository `_ for up to date information, particularly how to `access new data `_ and `request new data to be ingested `_. + This page will be updated once the `beta testing phase is complete `_. Zarr storage format ------------------- From 867445ce301e904b75c707acd6734b2e1ab80c5f Mon Sep 17 00:00:00 2001 From: Julius Busecke Date: Wed, 24 Apr 2024 00:51:01 -0400 Subject: [PATCH 2/2] Update overview.rst --- docs/overview.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/overview.rst b/docs/overview.rst index 3937e7d..95d1004 100644 --- a/docs/overview.rst +++ b/docs/overview.rst @@ -42,7 +42,7 @@ The base organization of Zarr stores is reflected in the master CSV files locate .. warning:: **Parts of the information below is superseeded by the new `Pangeo-ESGF CMIP6 Zarr Data 2.0` (currently in Beta testing)** Please refer to the `repository `_ for up to date information, particularly how to `access new data `_ and `request new data to be ingested `_. - This page will be updated once the `beta testing phase is complete `_. + This page will be updated once the `beta testing phase is complete `_. Zarr storage format -------------------