INFO [1062662] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! INFO [1062662] Package versions INFO [1062662] ---------------- INFO [1062662] ESMValCore: 2.12.0 INFO [1062662] ESMValTool: 2.12.0 INFO [1062662] ---------------- INFO [1062662] Reading configuration files from: /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/yanchun/.config/esmvaltool (default user configuration directory) INFO [1062662] Writing program log files to: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/run/main_log.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/run/main_log_debug.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/run/cmor_log.txt INFO [1062662] Starting the Earth System Model Evaluation Tool at time: 2025-06-23 13:14:28 UTC INFO [1062662] ---------------------------------------------------------------------- INFO [1062662] RECIPE = /projects/NS16000B-datalake/noresmvaltool/esmvaltool/tested_recipes/atmosphere/recipe_cvdp.yml INFO [1062662] RUNDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/run INFO [1062662] WORKDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/work INFO [1062662] PREPROCDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/preproc INFO [1062662] PLOTDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250623_131421/plots INFO [1062662] ---------------------------------------------------------------------- INFO [1062662] Running tasks using at most 256 processes INFO [1062662] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [1062662] If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. INFO [1062662] Creating tasks from recipe INFO [1062662] Creating tasks for diagnostic diagnostic1 INFO [1062662] Creating diagnostic task diagnostic1/cvdp INFO [1062662] Creating preprocessor task diagnostic1/ts INFO [1062662] Creating preprocessor 'default' task for variable 'ts' WARNING [1062662] Configured 'CMIP6' rootpaths '/scratch/yanchun/ESGF' do not exist INFO [1062662] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [1062662] Found input files for Dataset: ts, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1062662] Found input files for Dataset: ts, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 ERROR [1062662] No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'ts', 'dataset': 'EC-Earth3-CC', 'project': 'CMIP6', 'mip': 'Amon', 'short_name': 'ts', 'activity': 'CMIP', 'alias': 'EC-Earth3-CC', 'ensemble': 'r1i1p1f1', 'exp': 'historical', 'frequency': 'mon', 'grid': 'gr', 'institute': ['EC-Earth-Consortium'], 'long_name': 'Surface Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'ts', 'recipe_dataset_index': 3, 'standard_name': 'surface_temperature', 'timerange': '1950/2005', 'units': 'K'} session: 'recipe_cvdp_20250623_131421' ERROR [1062662] Looked for files matching /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/ts/gr/*/ts_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr*.nc /projects/NS9034K/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/ts/gr/*/ts_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr*.nc /scratch/yanchun/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/ts/gr/*/ts_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr*.nc ERROR [1062662] Set 'log_level' to 'debug' to get more information INFO [1062662] Found input files for Dataset: ts, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [1062662] Found input files for Dataset: ts, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [1062662] Creating preprocessor task diagnostic1/tas INFO [1062662] Creating preprocessor 'default' task for variable 'tas' INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3-CC, CMIP, historical, r1i1p1f1, gr, v20210113 INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [1062662] Found input files for Dataset: tas, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [1062662] PreprocessingTask diagnostic1/tas created. INFO [1062662] Creating preprocessor task diagnostic1/pr INFO [1062662] Creating preprocessor 'default' task for variable 'pr' INFO [1062662] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [1062662] Found input files for Dataset: pr, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1062662] Found input files for Dataset: pr, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [1062662] Found input files for Dataset: pr, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [1062662] Found input files for Dataset: pr, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [1062662] Creating preprocessor task diagnostic1/psl INFO [1062662] Creating preprocessor 'default' task for variable 'psl' INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, EC-Earth3-CC, CMIP, historical, r1i1p1f1, gr, v20210113 INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, MRI-ESM2-0, CMIP, historical, r1i1p1f1, gn, v20190222 INFO [1062662] Found input files for Dataset: psl, Amon, CMIP6, UKESM1-0-LL, CMIP, historical, r1i1p1f2, gn, v20190406 INFO [1062662] PreprocessingTask diagnostic1/psl created. ERROR [1062662] Could not create all tasks ERROR [1062662] Missing data for preprocessor diagnostic1/ts: - Missing data for Dataset: ts, Amon, CMIP6, EC-Earth3-CC, CMIP, historical, r1i1p1f1, gr ERROR [1062662] Missing data for preprocessor diagnostic1/pr: - No input data available for years 1950-1983 in files: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198401-198412.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198501-198512.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198601-198612.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198701-198712.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198801-198812.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_198901-198912.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199001-199012.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199101-199112.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199201-199212.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199301-199312.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199401-199412.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199501-199512.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199601-199612.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199701-199712.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199801-199812.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_199901-199912.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200001-200012.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200101-200112.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200201-200212.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200301-200312.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200401-200412.nc /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/historical/r1i1p1f1/Amon/pr/gr/v20210113/pr_Amon_EC-Earth3-CC_historical_r1i1p1f1_gr_200501-200512.nc ERROR [1062662] Not all input files required to run the recipe could be found. ERROR [1062662] If the files are available locally, please check your `rootpath` and `drs` settings in your configuration file(s) ERROR [1062662] To automatically download the required files to `download_dir: /scratch/yanchun/ESGF/rawdata/model`, use `search_esgf: when_missing` or `search_esgf: always` in your configuration file(s), or run the recipe with the command line argument --search_esgf=when_missing or --search_esgf=always INFO [1062662] Note that automatic download is only available for files that are hosted on the ESGF, i.e. for projects: CMIP3, CMIP5, CMIP6, CORDEX, and obs4MIPs INFO [1062662] Maximum memory used (estimate): 0.3 GB INFO [1062662] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [1062662] Could not create all tasks