2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:576 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:577 Package versions 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:578 ---------------- 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:579 ESMValCore: 2.12.0 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:581 ESMValTool: 2.12.0 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:582 ---------------- 2025-06-20 13:53:08,268 UTC [2867280] INFO esmvalcore._main:583 Reading configuration files from: /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/yanchun/.config/esmvaltool (default user configuration directory) 2025-06-20 13:53:08,269 UTC [2867280] INFO esmvalcore._main:587 Writing program log files to: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/main_log.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/main_log_debug.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/cmor_log.txt 2025-06-20 13:53:08,584 UTC [2867280] INFO esmvalcore._main:93 Starting the Earth System Model Evaluation Tool at time: 2025-06-20 13:53:08 UTC 2025-06-20 13:53:08,584 UTC [2867280] INFO esmvalcore._main:98 ---------------------------------------------------------------------- 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:99 RECIPE = /projects/NS16000B-datalake/noresmvaltool/esmvaltool/tested_recipes/atmosphere/recipe_cvdp.yml 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:100 RUNDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:101 WORKDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/work 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:102 PREPROCDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:103 PLOTDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/plots 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:104 ---------------------------------------------------------------------- 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:107 Running tasks using at most 256 processes 2025-06-20 13:53:08,585 UTC [2867280] INFO esmvalcore._main:109 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2025-06-20 13:53:08,592 UTC [2867280] INFO esmvalcore._main:113 If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. 2025-06-20 13:53:08,593 UTC [2867280] DEBUG esmvalcore._recipe.check:67 Checking recipe against schema /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/_recipe/recipe_schema.yml 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable ts in diagnostic diagnostic1 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: ts, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable tas in diagnostic diagnostic1 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: tas, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable pr in diagnostic diagnostic1 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: pr, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable psl in diagnostic diagnostic1 2025-06-20 13:53:08,603 UTC [2867280] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: psl, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:53:08,604 UTC [2867280] DEBUG esmvalcore._recipe.recipe:879 Retrieving diagnostics from recipe 2025-06-20 13:53:08,604 UTC [2867280] DEBUG esmvalcore._recipe.recipe:909 Setting script for diagnostic diagnostic1 2025-06-20 13:53:08,604 UTC [2867280] INFO esmvalcore._recipe.recipe:1119 Creating tasks from recipe 2025-06-20 13:53:08,604 UTC [2867280] INFO esmvalcore._recipe.recipe:1128 Creating tasks for diagnostic diagnostic1 2025-06-20 13:53:08,604 UTC [2867280] INFO esmvalcore._recipe.recipe:1041 Creating diagnostic task diagnostic1/cvdp 2025-06-20 13:53:08,604 UTC [2867280] DEBUG esmvalcore._task:397 No local diagnostic script found. Attempting to load the script from the base repository. 2025-06-20 13:53:08,605 UTC [2867280] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/ts 2025-06-20 13:53:08,605 UTC [2867280] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'ts' 2025-06-20 13:53:08,605 UTC [2867280] WARNING esmvalcore.local:471 Configured 'CMIP6' rootpaths '/scratch/yanchun/ESGF' do not exist 2025-06-20 13:53:08,606 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,607 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,607 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,608 UTC [2867280] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable ts of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,608 UTC [2867280] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: ts, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:53:08,608 UTC [2867280] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/ts created. 2025-06-20 13:53:08,608 UTC [2867280] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/ts will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc 2025-06-20 13:53:08,608 UTC [2867280] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/tas 2025-06-20 13:53:08,608 UTC [2867280] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'tas' 2025-06-20 13:53:08,618 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,618 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,619 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,619 UTC [2867280] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable tas of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,619 UTC [2867280] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: tas, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:53:08,620 UTC [2867280] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/tas created. 2025-06-20 13:53:08,620 UTC [2867280] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/tas will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc 2025-06-20 13:53:08,620 UTC [2867280] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/pr 2025-06-20 13:53:08,620 UTC [2867280] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'pr' 2025-06-20 13:53:08,620 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,621 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,621 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,622 UTC [2867280] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable pr of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,622 UTC [2867280] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: pr, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:53:08,622 UTC [2867280] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/pr created. 2025-06-20 13:53:08,622 UTC [2867280] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/pr will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc 2025-06-20 13:53:08,622 UTC [2867280] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/psl 2025-06-20 13:53:08,622 UTC [2867280] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'psl' 2025-06-20 13:53:08,622 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,623 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,623 UTC [2867280] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:53:08,624 UTC [2867280] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable psl of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,624 UTC [2867280] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: psl, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:53:08,624 UTC [2867280] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/psl created. 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/psl will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:962 Linking tasks for diagnostic diagnostic1 script cvdp 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/ts matches ['diagnostic1/ts'] 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/tas matches ['diagnostic1/tas'] 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/pr matches ['diagnostic1/pr'] 2025-06-20 13:53:08,625 UTC [2867280] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/psl matches ['diagnostic1/psl'] 2025-06-20 13:53:08,625 UTC [2867280] INFO esmvalcore._recipe.recipe:1171 These tasks will be executed: diagnostic1/tas, diagnostic1/cvdp, diagnostic1/ts, diagnostic1/pr, diagnostic1/psl 2025-06-20 13:53:08,627 UTC [2867280] DEBUG esmvalcore._main:133 Recipe summary: DiagnosticTask: diagnostic1/cvdp script: cvdp/cvdp_wrapper.py settings: {'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'log_level': 'info', 'output_file_type': 'png', 'plot_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/plots/diagnostic1/cvdp', 'profile_diagnostic': False, 'quickplot': {'plot_type': 'pcolormesh'}, 'recipe': PosixPath('recipe_cvdp.yml'), 'run_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp', 'script': 'cvdp', 'version': '2.12.0', 'work_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/work/diagnostic1/cvdp'} ancestors: PreprocessingTask: diagnostic1/ts order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/tas order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/pr order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/psl order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc')}} ancestors: None 2025-06-20 13:53:08,631 UTC [2867280] INFO esmvalcore._recipe.recipe:1238 Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/recipe_cvdp_filled.yml 2025-06-20 13:53:08,631 UTC [2867280] DEBUG esmvalcore.config._dask:170 Using Dask profile 'local_threaded' 2025-06-20 13:53:08,631 UTC [2867280] DEBUG esmvalcore.config._dask:174 Using additional Dask settings {'scheduler': 'threads'} 2025-06-20 13:53:08,631 UTC [2867280] INFO esmvalcore.config._dask:196 Using Dask threaded scheduler. The distributed scheduler is recommended, please read https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration how to use a distributed scheduler. 2025-06-20 13:53:08,631 UTC [2867280] INFO esmvalcore._task:905 Running 5 tasks using 5 processes 2025-06-20 13:53:08,631 UTC [2867280] INFO esmvalcore._task:885 Using the threaded Dask scheduler with 60 worker threads per preprocessing task. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#f5 for more information. 2025-06-20 13:53:08,691 UTC [2867423] INFO esmvalcore._task:289 Starting task diagnostic1/ts in process [2867423] 2025-06-20 13:53:08,691 UTC [2867424] INFO esmvalcore._task:289 Starting task diagnostic1/tas in process [2867424] 2025-06-20 13:53:08,692 UTC [2867425] INFO esmvalcore._task:289 Starting task diagnostic1/pr in process [2867425] 2025-06-20 13:53:08,692 UTC [2867426] INFO esmvalcore._task:289 Starting task diagnostic1/psl in process [2867426] 2025-06-20 13:53:08,746 UTC [2867424] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:53:08,746 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:53:08,747 UTC [2867423] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:53:08,747 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:53:08,748 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/fixed_files/ts_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,748 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/fixed_files/tas_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,749 UTC [2867425] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:53:08,749 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:53:08,750 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/fixed_files/pr_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,767 UTC [2867426] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:53:08,767 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:53:08,768 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/fixed_files/psl_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,775 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:53:08,775 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:53:08,775 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:53:08,775 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:53:08,775 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:53:08,775 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:53:08,775 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:53:08,775 UTC [2867426] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,775 UTC [2867425] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,775 UTC [2867423] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,775 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:53:08,776 UTC [2867424] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,789 UTC [2867280] INFO esmvalcore._task:960 Progress: 4 tasks running, 1 tasks waiting for ancestors, 0/5 done 2025-06-20 13:53:08,869 UTC [2867423] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,869 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:53:08,874 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,875 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:53:08,876 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:53:08,876 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:53:08,877 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'ts' 2025-06-20 13:53:08,882 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:53:08,882 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:53:08,891 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:53:08,893 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,893 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:53:08,893 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'ts' 2025-06-20 13:53:08,894 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:53:08,894 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:53:08,894 UTC [2867423] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:53:08,896 UTC [2867423] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc') 2025-06-20 13:53:08,896 UTC [2867423] DEBUG esmvalcore.preprocessor._io:497 Saving cube: surface_temperature / (K) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'GT' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'ts' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc 2025-06-20 13:53:08,923 UTC [2867426] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,923 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:53:08,927 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,928 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:53:08,929 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:53:08,929 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:53:08,930 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'psl' 2025-06-20 13:53:08,934 UTC [2867424] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,934 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:53:08,935 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:53:08,935 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:53:08,939 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,940 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:53:08,941 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:53:08,941 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:53:08,942 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2025-06-20 13:53:08,944 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:53:08,945 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,945 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:53:08,946 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'psl' 2025-06-20 13:53:08,946 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:53:08,947 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:53:08,947 UTC [2867426] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:53:08,947 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:53:08,948 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:53:08,948 UTC [2867426] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc') 2025-06-20 13:53:08,948 UTC [2867426] DEBUG esmvalcore.preprocessor._io:497 Saving cube: air_pressure_at_mean_sea_level / (Pa) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'PMSL' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'psl' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc 2025-06-20 13:53:08,957 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:53:08,958 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,958 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:53:08,959 UTC [2867425] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:53:08,959 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:53:08,959 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2025-06-20 13:53:08,959 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:53:08,960 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:53:08,960 UTC [2867424] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:53:08,962 UTC [2867424] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc') 2025-06-20 13:53:08,962 UTC [2867424] DEBUG esmvalcore.preprocessor._io:497 Saving cube: air_temperature / (K) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: height 2.0 m Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'ST' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'tas' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc 2025-06-20 13:53:08,963 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,964 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:53:08,965 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:53:08,965 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:53:08,966 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'pr' 2025-06-20 13:53:08,971 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:53:08,972 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:53:08,981 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:53:08,983 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:53:08,983 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:53:08,984 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'pr' 2025-06-20 13:53:08,984 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:53:08,985 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:53:08,985 UTC [2867425] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:53:08,986 UTC [2867425] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc') 2025-06-20 13:53:08,986 UTC [2867425] DEBUG esmvalcore.preprocessor._io:497 Saving cube: precipitation_flux / (kg m-2 s-1) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'PCP' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'pr' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc 2025-06-20 13:53:08,995 UTC [2867423] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/ts 2025-06-20 13:53:09,043 UTC [2867426] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/psl 2025-06-20 13:53:09,075 UTC [2867425] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/pr 2025-06-20 13:53:09,090 UTC [2867424] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/tas 2025-06-20 13:53:09,998 UTC [2867423] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/ts [########################################] | 100% Completed | 1.00 s 2025-06-20 13:53:10,001 UTC [2867423] INFO esmvalcore._task:295 Successfully completed task diagnostic1/ts (priority 1) in 0:00:01.309419 2025-06-20 13:53:10,047 UTC [2867426] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/psl [########################################] | 100% Completed | 1.00 s 2025-06-20 13:53:10,050 UTC [2867426] INFO esmvalcore._task:295 Successfully completed task diagnostic1/psl (priority 4) in 0:00:01.357882 2025-06-20 13:53:10,079 UTC [2867425] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/pr [########################################] | 100% Completed | 1.00 s 2025-06-20 13:53:10,082 UTC [2867425] INFO esmvalcore._task:295 Successfully completed task diagnostic1/pr (priority 3) in 0:00:01.390001 2025-06-20 13:53:10,094 UTC [2867424] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/tas [########################################] | 100% Completed | 1.00 s 2025-06-20 13:53:10,097 UTC [2867424] INFO esmvalcore._task:295 Successfully completed task diagnostic1/tas (priority 2) in 0:00:01.405112 2025-06-20 13:53:10,190 UTC [2867280] INFO esmvalcore._task:960 Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done 2025-06-20 13:53:10,191 UTC [2867280] INFO esmvalcore._task:960 Progress: 0 tasks running, 1 tasks waiting for ancestors, 4/5 done 2025-06-20 13:53:10,199 UTC [2867427] INFO esmvalcore._task:289 Starting task diagnostic1/cvdp in process [2867427] 2025-06-20 13:53:10,202 UTC [2867427] INFO esmvalcore._task:564 Running command ['/nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python', '/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py', '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp/settings.yml'] 2025-06-20 13:53:10,202 UTC [2867427] DEBUG esmvalcore._task:565 in environment {'MPLBACKEND': 'Agg'} 2025-06-20 13:53:10,202 UTC [2867427] DEBUG esmvalcore._task:567 in current working directory: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp 2025-06-20 13:53:10,202 UTC [2867427] INFO esmvalcore._task:568 Writing output to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/work/diagnostic1/cvdp 2025-06-20 13:53:10,202 UTC [2867427] INFO esmvalcore._task:569 Writing plots to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/plots/diagnostic1/cvdp 2025-06-20 13:53:10,202 UTC [2867427] INFO esmvalcore._task:570 Writing log to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp/log.txt 2025-06-20 13:53:10,202 UTC [2867427] INFO esmvalcore._task:580 To re-run this diagnostic script, run: cd /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp; MPLBACKEND="Agg" /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135308/run/diagnostic1/cvdp/settings.yml 2025-06-20 13:53:10,291 UTC [2867280] INFO esmvalcore._task:960 Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done 2025-06-20 13:53:12,282 UTC [2867280] INFO esmvalcore._task:141 Maximum memory used (estimate): 2.5 GB 2025-06-20 13:53:12,282 UTC [2867280] INFO esmvalcore._task:144 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.