esmvaltool-dask-paper

Additional material to reproduce the results of Schlund et al. (2025). Results are based on ESMValTool v2.8.0 and v2.11.0.

Quick Start

To install the exact same set of dependencies for ESMValTool versions 2.8.0 and 2.11.0 as used in the paper, conda environment files are provided (envs/).

ESMValTool recipes can be run with

esmvaltool run --config_file <path/to/config-user.yml> <path/to/recipe.yml>

Recipes (recipes/) and configuration (config/) files are available in this repository. If absolute paths to diagnostic scripts are given in a recipe, these paths need to be adapted so that they to point to the files given in this repository. Dask configuration files need to be located at ~/.esmvaltool/dask.yml.

All recipes have been run on a compute node on DKRZ's Levante to avoid interference from processes run by other uses (which would be the case on a shared node). This ensures that all results are comparable. The following salloc command has been used to allocate the resources:

salloc --x11 --account=<ACCOUNT_ID> --partition=compute --nodes=1 --mem=0 --time=08:00:00"

Contents

Configuration files (config/)

Contains the following files:

• config-user.yml: ESMValTool user configuration file, can be specified for an esmvaltool run via the command line argument --config_file.
• dask_*.yml: ESMValTool Dask configuration files for the different setups investigated in the paper. Must be put into ~/.esmvaltool/dask.yml. For the setup that uses 2 nodes, the scheduler needs to be started outside of ESMValTool to avoid waiting until resources are granted (see details in dask_512G.yml).

ESMValTool diagnostic scripts (diag_scripts/)

Contains ESMValTool diagnostic scripts used in the paper. Absolute paths to diagnostic scripts in the recipes need to be adapted so that the paths point to these files.

Conda environment files (envs/)

Contains conda environment files that can be used to install the exact same set of dependencies for ESMValTool versions 2.8.0 and 2.11.0 that have been used to conduct the analysis of this paper.

Figures and files to produce them (figs/)

Contains figures and corresponding files to produce them.

ESMValTool recipes (recipes/)

Contains ESMValTool recipes used in the paper. Absolute paths to diagnostic scripts in the recipes need to be adapted so that the paths point to the diagnostic scripts given in this repository.

• recipe_section-3-1_multi-model-analysis_*.yml: Reproduce multi-model analysis presented in Section 3.1 of the paper.
• recipe_section-3-2_high-res-model-analysis_*.yml: Reproduce high-resolution model analysis presented in Section 3.2 of the paper.
• recipe_section-3-3_single-preprocessors_*.yml: Reproduce individual preprocessor analysis presented in Section 3.3 of the paper.

Note: Different recipes for the different ESMValTool versions exist to account for small API changes between ESMValTool v2.8.0 and v2.11.0.