INFO [2894349] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! INFO [2894349] Package versions INFO [2894349] ---------------- INFO [2894349] ESMValCore: 2.12.0 INFO [2894349] ESMValTool: 2.12.0 INFO [2894349] ---------------- INFO [2894349] Reading configuration files from: /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/yanchun/.config/esmvaltool (default user configuration directory) INFO [2894349] Writing program log files to: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/main_log.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/main_log_debug.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/cmor_log.txt INFO [2894349] Starting the Earth System Model Evaluation Tool at time: 2025-06-20 15:00:31 UTC INFO [2894349] ---------------------------------------------------------------------- INFO [2894349] RECIPE = /projects/NS16000B-datalake/noresmvaltool/esmvaltool/tested_recipes/atmosphere/recipe_cvdp.yml INFO [2894349] RUNDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run INFO [2894349] WORKDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/work INFO [2894349] PREPROCDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/preproc INFO [2894349] PLOTDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/plots INFO [2894349] ---------------------------------------------------------------------- INFO [2894349] Running tasks using at most 256 processes INFO [2894349] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [2894349] If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. INFO [2894349] Creating tasks from recipe INFO [2894349] Creating tasks for diagnostic diagnostic1 INFO [2894349] Creating diagnostic task diagnostic1/cvdp INFO [2894349] Creating preprocessor task diagnostic1/ts INFO [2894349] Creating preprocessor 'default' task for variable 'ts' WARNING [2894349] Configured 'CMIP6' rootpaths '/scratch/yanchun/ESGF' do not exist INFO [2894349] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2894349] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2894349] Found input files for Dataset: ts, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [2894349] Found input files for Dataset: ts, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [2894349] Found input files for Dataset: ts, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [2894349] PreprocessingTask diagnostic1/ts created. INFO [2894349] Creating preprocessor task diagnostic1/tas INFO [2894349] Creating preprocessor 'default' task for variable 'tas' INFO [2894349] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2894349] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2894349] Found input files for Dataset: tas, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [2894349] Found input files for Dataset: tas, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [2894349] Found input files for Dataset: tas, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [2894349] PreprocessingTask diagnostic1/tas created. INFO [2894349] Creating preprocessor task diagnostic1/pr INFO [2894349] Creating preprocessor 'default' task for variable 'pr' INFO [2894349] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2894349] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2894349] Found input files for Dataset: pr, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [2894349] Found input files for Dataset: pr, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [2894349] Found input files for Dataset: pr, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [2894349] PreprocessingTask diagnostic1/pr created. INFO [2894349] Creating preprocessor task diagnostic1/psl INFO [2894349] Creating preprocessor 'default' task for variable 'psl' INFO [2894349] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2894349] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2894349] Found input files for Dataset: psl, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [2894349] Found input files for Dataset: psl, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [2894349] Found input files for Dataset: psl, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [2894349] PreprocessingTask diagnostic1/psl created. INFO [2894349] These tasks will be executed: diagnostic1/ts, diagnostic1/pr, diagnostic1/psl, diagnostic1/tas, diagnostic1/cvdp INFO [2894349] Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/recipe_cvdp_filled.yml INFO [2894349] Using Dask threaded scheduler. The distributed scheduler is recommended, please read https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration how to use a distributed scheduler. INFO [2894349] Running 5 tasks using 5 processes INFO [2894349] Using the threaded Dask scheduler with 60 worker threads per preprocessing task. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#f5 for more information. INFO [2894490] Starting task diagnostic1/ts in process [2894490] INFO [2894491] Starting task diagnostic1/tas in process [2894491] INFO [2894492] Starting task diagnostic1/pr in process [2894492] INFO [2894493] Starting task diagnostic1/psl in process [2894493] INFO [2894349] Progress: 4 tasks running, 1 tasks waiting for ancestors, 0/5 done INFO [2894490] Computing and saving data for preprocessing task diagnostic1/ts INFO [2894493] Computing and saving data for preprocessing task diagnostic1/psl INFO [2894491] Computing and saving data for preprocessing task diagnostic1/tas INFO [2894492] Computing and saving data for preprocessing task diagnostic1/pr INFO [2894490] diagnostic1/ts [########################################] | 100% Completed | 3.00 s INFO [2894490] Successfully completed task diagnostic1/ts (priority 1) in 0:00:04.726057 INFO [2894493] diagnostic1/psl [########################################] | 100% Completed | 3.00 s INFO [2894493] Successfully completed task diagnostic1/psl (priority 4) in 0:00:04.743602 INFO [2894491] diagnostic1/tas [########################################] | 100% Completed | 3.00 s INFO [2894491] Successfully completed task diagnostic1/tas (priority 2) in 0:00:04.881154 INFO [2894349] Progress: 2 tasks running, 1 tasks waiting for ancestors, 2/5 done INFO [2894349] Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done INFO [2894492] diagnostic1/pr [########################################] | 100% Completed | 3.00 s INFO [2894492] Successfully completed task diagnostic1/pr (priority 3) in 0:00:05.192609 INFO [2894349] Progress: 0 tasks running, 1 tasks waiting for ancestors, 4/5 done INFO [2894349] Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done INFO [2894494] Starting task diagnostic1/cvdp in process [2894494] INFO [2894494] Running command ['/nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python', '/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py', '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/diagnostic1/cvdp/settings.yml'] INFO [2894494] Writing output to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/work/diagnostic1/cvdp INFO [2894494] Writing plots to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/plots/diagnostic1/cvdp INFO [2894494] Writing log to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/diagnostic1/cvdp/log.txt INFO [2894494] To re-run this diagnostic script, run: cd /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/diagnostic1/cvdp; MPLBACKEND="Agg" /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/diagnostic1/cvdp/settings.yml INFO [2894494] Maximum memory used (estimate): 2.1 GB INFO [2894494] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [2894494] Successfully completed task diagnostic1/cvdp (priority 0) in 0:16:54.202951 INFO [2894349] Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done INFO [2894349] Successfully completed all tasks. INFO [2894349] Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/run/recipe_cvdp_filled.yml INFO [2894349] Wrote recipe output to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031/index.html INFO [2894349] It looks like you are connected to a remote machine via SSH. To show the output html file, you can try the following command on your local machine: server=10.11.162.160 && port=31415 && ssh -t -L ${port}:localhost:${port} yanchun@${server} /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python -m http.server ${port} -d /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_150031 Then visit http://localhost:31415 in your browser INFO [2894349] If the port 31415 is already in use, you can replace it with any other free one (e.g., 12789). If you are connected through a jump host, replace the server IP address 10.11.162.160 with your SSH server name INFO [2894349] Ending the Earth System Model Evaluation Tool at time: 2025-06-20 15:17:32 UTC INFO [2894349] Time for running the recipe was: 0:17:00.403908 INFO [2894349] Maximum memory used (estimate): 7.1 GB INFO [2894349] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [2894349] Removing `preproc` directory containing preprocessed data INFO [2894349] If this data is further needed, then set `remove_preproc_dir` to `false` in your configuration INFO [2894349] Run was successful