Rerun diagnostic without rerunning the preprocessor

[rswamina]

My job takes a long time because preprocessor takes long. Is there a way to simply rerun the diagnostic alone and using preproceed output frim a previous run?

[ledm]

Yes, there is!

There should be a line in the preprocessor output, towards the end saying something like:

INFO    [20355] To re-run this diagnostic script, run:

If you can't find it, try doing this:

grep -A 1 're-run this diagnostic script' recipe_[OUTPUT_LOCATION]/run/main_log.txt

Like it says, to re-run the diagnostic, just copy, paste and run that command.

Also, you may find that the output files already exist and this causes the diagnostic to fail. To resolve this issue, you should append -i command at the end of the command.
The final command will look something like:

 cd /gws/nopw/j04/ukesm/ldemora/ESMValTool_output/recipe_time_series_20210430_132410/run/time_series/diagnostic_timeseries; MPLBACKEND="Agg" /home/users/ldemora/miniconda3/envs/esmvaltool_gwt/bin/python3.9 /home/users/ldemora/workspace/ESMValTool_private/ESMValTool-private/esmvaltool/diag_scripts/ocean/diagnostic_timeseries.py /gws/nopw/j04/ukesm/ldemora/ESMValTool_output/recipe_time_series_20250430_132410/run/time_series/diagnostic_timeseries/settings.yml -i

Note that you will have one of these files for each diagnostic script, so if you have several scripts in your recipe, you may need to do this for each one.