INFO [2847485] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! INFO [2847485] Package versions INFO [2847485] ---------------- INFO [2847485] ESMValCore: 2.12.0 INFO [2847485] ESMValTool: 2.12.0 INFO [2847485] ---------------- INFO [2847485] Reading configuration files from: /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/yanchun/.config/esmvaltool (default user configuration directory) INFO [2847485] Writing program log files to: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/main_log.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/main_log_debug.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/cmor_log.txt INFO [2847485] Starting the Earth System Model Evaluation Tool at time: 2025-06-20 13:29:37 UTC INFO [2847485] ---------------------------------------------------------------------- INFO [2847485] RECIPE = /projects/NS16000B-datalake/noresmvaltool/esmvaltool/tested_recipes/atmosphere/recipe_cvdp.yml INFO [2847485] RUNDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run INFO [2847485] WORKDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/work INFO [2847485] PREPROCDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/preproc INFO [2847485] PLOTDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/plots INFO [2847485] ---------------------------------------------------------------------- INFO [2847485] Running tasks using at most 256 processes INFO [2847485] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [2847485] If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. INFO [2847485] Creating tasks from recipe INFO [2847485] Creating tasks for diagnostic diagnostic1 INFO [2847485] Creating diagnostic task diagnostic1/cvdp INFO [2847485] Creating preprocessor task diagnostic1/ts INFO [2847485] Creating preprocessor 'default' task for variable 'ts' WARNING [2847485] Configured 'CMIP6' rootpaths '/scratch/yanchun/ESGF' do not exist INFO [2847485] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2847485] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2847485] PreprocessingTask diagnostic1/ts created. INFO [2847485] Creating preprocessor task diagnostic1/tas INFO [2847485] Creating preprocessor 'default' task for variable 'tas' INFO [2847485] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2847485] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2847485] PreprocessingTask diagnostic1/tas created. INFO [2847485] Creating preprocessor task diagnostic1/pr INFO [2847485] Creating preprocessor 'default' task for variable 'pr' INFO [2847485] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2847485] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2847485] PreprocessingTask diagnostic1/pr created. INFO [2847485] Creating preprocessor task diagnostic1/psl INFO [2847485] Creating preprocessor 'default' task for variable 'psl' INFO [2847485] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2847485] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2847485] PreprocessingTask diagnostic1/psl created. INFO [2847485] These tasks will be executed: diagnostic1/ts, diagnostic1/psl, diagnostic1/cvdp, diagnostic1/pr, diagnostic1/tas INFO [2847485] Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/recipe_cvdp_filled.yml INFO [2847485] Using Dask threaded scheduler. The distributed scheduler is recommended, please read https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration how to use a distributed scheduler. INFO [2847485] Running 5 tasks using 5 processes INFO [2847485] Using the threaded Dask scheduler with 60 worker threads per preprocessing task. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#f5 for more information. INFO [2847639] Starting task diagnostic1/ts in process [2847639] INFO [2847640] Starting task diagnostic1/tas in process [2847640] INFO [2847641] Starting task diagnostic1/pr in process [2847641] INFO [2847642] Starting task diagnostic1/psl in process [2847642] INFO [2847485] Progress: 4 tasks running, 1 tasks waiting for ancestors, 0/5 done INFO [2847639] Computing and saving data for preprocessing task diagnostic1/ts INFO [2847641] Computing and saving data for preprocessing task diagnostic1/pr INFO [2847642] Computing and saving data for preprocessing task diagnostic1/psl INFO [2847640] Computing and saving data for preprocessing task diagnostic1/tas INFO [2847639] diagnostic1/ts [########################################] | 100% Completed | 2.00 s INFO [2847639] Successfully completed task diagnostic1/ts (priority 1) in 0:00:02.912146 INFO [2847641] diagnostic1/pr [########################################] | 100% Completed | 2.00 s INFO [2847641] Successfully completed task diagnostic1/pr (priority 3) in 0:00:03.020879 INFO [2847642] diagnostic1/psl [########################################] | 100% Completed | 2.00 s INFO [2847642] Successfully completed task diagnostic1/psl (priority 4) in 0:00:03.069730 INFO [2847485] Progress: 3 tasks running, 1 tasks waiting for ancestors, 1/5 done INFO [2847640] diagnostic1/tas [########################################] | 100% Completed | 2.00 s INFO [2847640] Successfully completed task diagnostic1/tas (priority 2) in 0:00:03.112825 INFO [2847485] Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done INFO [2847485] Progress: 0 tasks running, 1 tasks waiting for ancestors, 4/5 done INFO [2847643] Starting task diagnostic1/cvdp in process [2847643] INFO [2847643] Running command ['/nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python', '/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py', '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/diagnostic1/cvdp/settings.yml'] INFO [2847643] Writing output to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/work/diagnostic1/cvdp INFO [2847643] Writing plots to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/plots/diagnostic1/cvdp INFO [2847643] Writing log to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/diagnostic1/cvdp/log.txt INFO [2847643] To re-run this diagnostic script, run: cd /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/diagnostic1/cvdp; MPLBACKEND="Agg" /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/diagnostic1/cvdp/settings.yml INFO [2847485] Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done INFO [2847643] Maximum memory used (estimate): 2.1 GB INFO [2847643] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [2847643] Successfully completed task diagnostic1/cvdp (priority 0) in 0:09:31.855905 INFO [2847485] Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done INFO [2847485] Successfully completed all tasks. INFO [2847485] Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/run/recipe_cvdp_filled.yml INFO [2847485] Wrote recipe output to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936/index.html INFO [2847485] It looks like you are connected to a remote machine via SSH. To show the output html file, you can try the following command on your local machine: server=10.11.162.160 && port=31415 && ssh -t -L ${port}:localhost:${port} yanchun@${server} /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python -m http.server ${port} -d /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_132936 Then visit http://localhost:31415 in your browser INFO [2847485] If the port 31415 is already in use, you can replace it with any other free one (e.g., 12789). If you are connected through a jump host, replace the server IP address 10.11.162.160 with your SSH server name INFO [2847485] Ending the Earth System Model Evaluation Tool at time: 2025-06-20 13:39:13 UTC INFO [2847485] Time for running the recipe was: 0:09:36.577430 INFO [2847485] Maximum memory used (estimate): 6.3 GB INFO [2847485] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [2847485] Removing `preproc` directory containing preprocessed data INFO [2847485] If this data is further needed, then set `remove_preproc_dir` to `false` in your configuration INFO [2847485] Run was successful