2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:576 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! 2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:577 Package versions 2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:578 ---------------- 2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:579 ESMValCore: 2.12.0 2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:581 ESMValTool: 2.12.0 2025-06-20 13:57:22,447 UTC [2869641] INFO esmvalcore._main:582 ---------------- 2025-06-20 13:57:22,448 UTC [2869641] INFO esmvalcore._main:583 Reading configuration files from: /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/yanchun/.config/esmvaltool (default user configuration directory) 2025-06-20 13:57:22,448 UTC [2869641] INFO esmvalcore._main:587 Writing program log files to: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/main_log.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/main_log_debug.txt /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/cmor_log.txt 2025-06-20 13:57:22,734 UTC [2869641] INFO esmvalcore._main:93 Starting the Earth System Model Evaluation Tool at time: 2025-06-20 13:57:22 UTC 2025-06-20 13:57:22,734 UTC [2869641] INFO esmvalcore._main:98 ---------------------------------------------------------------------- 2025-06-20 13:57:22,734 UTC [2869641] INFO esmvalcore._main:99 RECIPE = /projects/NS16000B-datalake/noresmvaltool/esmvaltool/tested_recipes/atmosphere/recipe_cvdp.yml 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:100 RUNDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:101 WORKDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/work 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:102 PREPROCDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:103 PLOTDIR = /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/plots 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:104 ---------------------------------------------------------------------- 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:107 Running tasks using at most 256 processes 2025-06-20 13:57:22,735 UTC [2869641] INFO esmvalcore._main:109 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2025-06-20 13:57:22,742 UTC [2869641] INFO esmvalcore._main:113 If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. 2025-06-20 13:57:22,743 UTC [2869641] DEBUG esmvalcore._recipe.check:67 Checking recipe against schema /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/_recipe/recipe_schema.yml 2025-06-20 13:57:22,753 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable ts in diagnostic diagnostic1 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: ts, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable tas in diagnostic diagnostic1 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: tas, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable pr in diagnostic diagnostic1 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: pr, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:360 Populating list of datasets for variable psl in diagnostic diagnostic1 2025-06-20 13:57:22,754 UTC [2869641] DEBUG esmvalcore._recipe.to_datasets:386 Found Dataset: psl, Amon, CMIP6, CanESM5, historical, r1i1p1f1, gn 2025-06-20 13:57:22,755 UTC [2869641] DEBUG esmvalcore._recipe.recipe:879 Retrieving diagnostics from recipe 2025-06-20 13:57:22,755 UTC [2869641] DEBUG esmvalcore._recipe.recipe:909 Setting script for diagnostic diagnostic1 2025-06-20 13:57:22,755 UTC [2869641] INFO esmvalcore._recipe.recipe:1119 Creating tasks from recipe 2025-06-20 13:57:22,755 UTC [2869641] INFO esmvalcore._recipe.recipe:1128 Creating tasks for diagnostic diagnostic1 2025-06-20 13:57:22,755 UTC [2869641] INFO esmvalcore._recipe.recipe:1041 Creating diagnostic task diagnostic1/cvdp 2025-06-20 13:57:22,755 UTC [2869641] DEBUG esmvalcore._task:397 No local diagnostic script found. Attempting to load the script from the base repository. 2025-06-20 13:57:22,755 UTC [2869641] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/ts 2025-06-20 13:57:22,755 UTC [2869641] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'ts' 2025-06-20 13:57:22,756 UTC [2869641] WARNING esmvalcore.local:471 Configured 'CMIP6' rootpaths '/scratch/yanchun/ESGF' do not exist 2025-06-20 13:57:22,756 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,758 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,758 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/*/ts_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,758 UTC [2869641] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable ts of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,759 UTC [2869641] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: ts, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:57:22,759 UTC [2869641] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/ts created. 2025-06-20 13:57:22,759 UTC [2869641] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/ts will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc 2025-06-20 13:57:22,759 UTC [2869641] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/tas 2025-06-20 13:57:22,759 UTC [2869641] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'tas' 2025-06-20 13:57:22,767 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,768 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,768 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,769 UTC [2869641] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable tas of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,769 UTC [2869641] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: tas, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:57:22,769 UTC [2869641] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/tas created. 2025-06-20 13:57:22,769 UTC [2869641] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/tas will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc 2025-06-20 13:57:22,769 UTC [2869641] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/pr 2025-06-20 13:57:22,769 UTC [2869641] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'pr' 2025-06-20 13:57:22,770 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,770 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,771 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/*/pr_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,771 UTC [2869641] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable pr of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,771 UTC [2869641] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: pr, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:57:22,772 UTC [2869641] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/pr created. 2025-06-20 13:57:22,772 UTC [2869641] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/pr will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc 2025-06-20 13:57:22,772 UTC [2869641] INFO esmvalcore._recipe.recipe:1103 Creating preprocessor task diagnostic1/psl 2025-06-20 13:57:22,772 UTC [2869641] INFO esmvalcore._recipe.recipe:739 Creating preprocessor 'default' task for variable 'psl' 2025-06-20 13:57:22,772 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,773 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/projects/NS9034K/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,773 UTC [2869641] DEBUG esmvalcore.local:445 Looking for files matching [PosixPath('/scratch/yanchun/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/*/psl_Amon_CanESM5_historical_r1i1p1f1_gn*.nc')] 2025-06-20 13:57:22,773 UTC [2869641] DEBUG esmvalcore._recipe.recipe:313 Using input files for variable psl of dataset CanESM5: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,774 UTC [2869641] INFO esmvalcore._recipe.recipe:597 Found input files for Dataset: psl, Amon, CMIP6, CanESM5, CMIP, historical, r1i1p1f1, gn, v20190429 2025-06-20 13:57:22,774 UTC [2869641] INFO esmvalcore._recipe.recipe:766 PreprocessingTask diagnostic1/psl created. 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:767 PreprocessingTask diagnostic1/psl will create the files: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:962 Linking tasks for diagnostic diagnostic1 script cvdp 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/ts matches ['diagnostic1/ts'] 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/tas matches ['diagnostic1/tas'] 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/pr matches ['diagnostic1/pr'] 2025-06-20 13:57:22,774 UTC [2869641] DEBUG esmvalcore._recipe.recipe:975 Pattern diagnostic1/psl matches ['diagnostic1/psl'] 2025-06-20 13:57:22,774 UTC [2869641] INFO esmvalcore._recipe.recipe:1171 These tasks will be executed: diagnostic1/cvdp, diagnostic1/tas, diagnostic1/ts, diagnostic1/pr, diagnostic1/psl 2025-06-20 13:57:22,776 UTC [2869641] DEBUG esmvalcore._main:133 Recipe summary: DiagnosticTask: diagnostic1/cvdp script: cvdp/cvdp_wrapper.py settings: {'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'log_level': 'info', 'output_file_type': 'png', 'plot_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/plots/diagnostic1/cvdp', 'profile_diagnostic': False, 'quickplot': {'plot_type': 'pcolormesh'}, 'recipe': PosixPath('recipe_cvdp.yml'), 'run_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp', 'script': 'cvdp', 'version': '2.12.0', 'work_dir': '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/work/diagnostic1/cvdp'} ancestors: PreprocessingTask: diagnostic1/ts order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/tas order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/pr order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc')}} ancestors: None PreprocessingTask: diagnostic1/psl order: ['remove_supplementary_variables', 'save'] PreprocessorFile: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc input files: [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'remove_supplementary_variables': {}, 'save': {'compress': False, 'compute': False, 'filename': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc')}} ancestors: None 2025-06-20 13:57:22,780 UTC [2869641] INFO esmvalcore._recipe.recipe:1238 Wrote recipe with version numbers and wildcards to: file:///nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/recipe_cvdp_filled.yml 2025-06-20 13:57:22,780 UTC [2869641] DEBUG esmvalcore.config._dask:170 Using Dask profile 'local_threaded' 2025-06-20 13:57:22,780 UTC [2869641] DEBUG esmvalcore.config._dask:174 Using additional Dask settings {'scheduler': 'threads'} 2025-06-20 13:57:22,781 UTC [2869641] INFO esmvalcore.config._dask:196 Using Dask threaded scheduler. The distributed scheduler is recommended, please read https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-configuration how to use a distributed scheduler. 2025-06-20 13:57:22,781 UTC [2869641] INFO esmvalcore._task:905 Running 5 tasks using 5 processes 2025-06-20 13:57:22,781 UTC [2869641] INFO esmvalcore._task:885 Using the threaded Dask scheduler with 60 worker threads per preprocessing task. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#f5 for more information. 2025-06-20 13:57:22,838 UTC [2869782] INFO esmvalcore._task:289 Starting task diagnostic1/ts in process [2869782] 2025-06-20 13:57:22,838 UTC [2869783] INFO esmvalcore._task:289 Starting task diagnostic1/tas in process [2869783] 2025-06-20 13:57:22,838 UTC [2869784] INFO esmvalcore._task:289 Starting task diagnostic1/pr in process [2869784] 2025-06-20 13:57:22,839 UTC [2869785] INFO esmvalcore._task:289 Starting task diagnostic1/psl in process [2869785] 2025-06-20 13:57:22,856 UTC [2869782] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:57:22,856 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:57:22,857 UTC [2869785] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:57:22,857 UTC [2869784] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:57:22,857 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:57:22,857 UTC [2869783] DEBUG esmvalcore.esgf._download:560 All required data is available locally, not downloading anything. 2025-06-20 13:57:22,857 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:57:22,857 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_file 2025-06-20 13:57:22,858 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/fixed_files/ts_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,858 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/fixed_files/psl_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,858 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/fixed_files/pr_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,858 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_file' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) output_dir = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/fixed_files/tas_Amon_CMIP6_CanESM5_CMIP_historical_r1i1p1f1_gn_v20190429_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,859 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:57:22,859 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:57:22,859 UTC [2869782] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,859 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:57:22,859 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:57:22,859 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:57:22,860 UTC [2869785] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,860 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:57:22,860 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step load 2025-06-20 13:57:22,860 UTC [2869784] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,860 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'load' on the data LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc') loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) ignore_warnings = None 2025-06-20 13:57:22,860 UTC [2869783] DEBUG esmvalcore.preprocessor._io:103 Loading: /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,927 UTC [2869782] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,927 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:57:22,928 UTC [2869785] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,929 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:57:22,931 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,932 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,932 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:57:22,933 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:57:22,933 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:57:22,933 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:57:22,934 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:57:22,934 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:57:22,934 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'ts' 2025-06-20 13:57:22,935 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'psl' 2025-06-20 13:57:22,935 UTC [2869641] INFO esmvalcore._task:960 Progress: 4 tasks running, 1 tasks waiting for ancestors, 0/5 done 2025-06-20 13:57:22,939 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:57:22,939 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:57:22,939 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:57:22,940 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:57:22,944 UTC [2869784] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,944 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:57:22,945 UTC [2869783] DEBUG esmvalcore.preprocessor._io:151 Done with loading /nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc 2025-06-20 13:57:22,945 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_metadata 2025-06-20 13:57:22,948 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:57:22,948 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,948 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:57:22,949 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:57:22,949 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,949 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'ts', timerange = '1950/2005', variable_group = 'ts', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'ts', standard_name = 'surface_temperature', long_name = 'Surface Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,949 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:57:22,950 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'psl', timerange = '1950/2005', variable_group = 'psl', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'psl', standard_name = 'air_pressure_at_mean_sea_level', long_name = 'Sea Level Pressure', units = 'Pa', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,950 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:57:22,950 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step concatenate 2025-06-20 13:57:22,950 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:57:22,950 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'ts' 2025-06-20 13:57:22,950 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:57:22,950 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:57:22,951 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'psl' 2025-06-20 13:57:22,951 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:57:22,951 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'pr' 2025-06-20 13:57:22,951 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:57:22,951 UTC [2869782] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:57:22,951 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = 2025-06-20 13:57:22,951 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_metadata 2025-06-20 13:57:22,952 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:57:22,952 UTC [2869785] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:57:22,952 UTC [2869782] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/ts/gn/v20190429/ts_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc') 2025-06-20 13:57:22,952 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2025-06-20 13:57:22,953 UTC [2869785] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/psl/gn/v20190429/psl_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc') 2025-06-20 13:57:22,953 UTC [2869782] DEBUG esmvalcore.preprocessor._io:497 Saving cube: surface_temperature / (K) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'GT' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'ts' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/ts/CMIP6_CanESM5_Amon_historical_r1i1p1f1_ts_gn_1950-2005.nc 2025-06-20 13:57:22,954 UTC [2869785] DEBUG esmvalcore.preprocessor._io:497 Saving cube: air_pressure_at_mean_sea_level / (Pa) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'PMSL' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'psl' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/psl/CMIP6_CanESM5_Amon_historical_r1i1p1f1_psl_gn_1950-2005.nc 2025-06-20 13:57:22,955 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:57:22,956 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:57:22,957 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step clip_timerange 2025-06-20 13:57:22,958 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) timerange = '1950/2005' 2025-06-20 13:57:22,965 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:57:22,966 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'pr', timerange = '1950/2005', variable_group = 'pr', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'pr', standard_name = 'precipitation_flux', long_name = 'Precipitation', units = 'kg m-2 s-1', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,966 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:57:22,966 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step fix_data 2025-06-20 13:57:22,967 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'pr' 2025-06-20 13:57:22,967 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:57:22,968 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:57:22,968 UTC [2869784] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:57:22,968 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) session = Session({'auxiliary_data_dir': PosixPath('/nird/datalake/NS16000B/esmvaltool-data/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvalcore/config-developer.yml'), 'dask': {'profiles': {'debug': {'scheduler': 'synchronous'}, 'local_distributed': {'cluster': {'type': 'distributed.LocalCluster'}}, 'local_threaded': {'scheduler': 'threads'}}, 'use': 'local_threaded'}, 'diagnostics': None, 'download_dir': PosixPath('/scratch/yanchun/ESGF/rawdata/model'), 'drs': {'CMIP3': 'ESGF', 'CMIP5': 'ESGF', 'CMIP6': 'ESGF', 'CORDEX': 'ESGF', 'obs4MIPs': 'ESGF'}, 'exit_on_warning': False, 'extra_facets_dir': [], 'log_level': 'info', 'logging': {'log_progress_interval': 0.0}, 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP5': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'CMIP6': [PosixPath('/nird/datalake/NS9560K/ESGF'), PosixPath('/projects/NS9034K'), PosixPath('/scratch/yanchun/ESGF')], 'OBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'OBS6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata'), PosixPath('/scratch/yanchun/ESGF/obsdata')], 'RAWOBS': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/rawdata/obs'), PosixPath('/scratch/yanchun/ESGF/rawdata/obs')], 'default': [PosixPath('/nird/home/yanchun/climate_data')], 'native6': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obsdata')], 'obs4MIPs': [PosixPath('/nird/datalake/NS16000B/esmvaltool-data/obs4MIPs'), PosixPath('/scratch/yanchun/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'never', 'skip_nonexistent': False, 'write_ncl_interface': False}), mip = 'Amon', dataset = 'CanESM5', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', short_name = 'tas', timerange = '1950/2005', variable_group = 'tas', diagnostic = 'diagnostic1', recipe_dataset_index = 0, alias = 'CanESM5', institute = ['CCCma'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190429' 2025-06-20 13:57:22,968 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step cmor_check_data 2025-06-20 13:57:22,969 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2025-06-20 13:57:22,969 UTC [2869784] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/pr/gn/v20190429/pr_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc') 2025-06-20 13:57:22,969 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step add_supplementary_variables 2025-06-20 13:57:22,970 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) supplementary_cubes = [] 2025-06-20 13:57:22,970 UTC [2869783] DEBUG esmvalcore.preprocessor:411 Running preprocessor step save 2025-06-20 13:57:22,969 UTC [2869784] DEBUG esmvalcore.preprocessor._io:497 Saving cube: precipitation_flux / (kg m-2 s-1) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'PCP' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'pr' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/pr/CMIP6_CanESM5_Amon_historical_r1i1p1f1_pr_gn_1950-2005.nc 2025-06-20 13:57:22,971 UTC [2869783] DEBUG esmvalcore.preprocessor:358 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/nird/datalake/NS9560K/ESGF/CMIP6/CMIP/CCCma/CanESM5/historical/r1i1p1f1/Amon/tas/gn/v20190429/tas_Amon_CanESM5_historical_r1i1p1f1_gn_185001-201412.nc')] with function argument(s) compress = False, compute = False, filename = PosixPath('/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc') 2025-06-20 13:57:22,971 UTC [2869783] DEBUG esmvalcore.preprocessor._io:497 Saving cube: air_temperature / (K) (time: 672; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: height 2.0 m Cell methods: 0 area: time: mean Attributes: CCCma_model_hash '3dedf95315d603326fde4f5340dc0519d80d10c0' CCCma_parent_runid 'rc3-pictrl' CCCma_pycmor_hash '33c30511acc319a98240633965a04ca99c26427e' CCCma_runid 'rc3.1-his01' Conventions 'CF-1.7 CMIP-6.2' YMDH_branch_time_in_child '1850:01:01:00' YMDH_branch_time_in_parent '5201:01:01:00' activity_id 'CMIP' branch_method 'Spin-up documentation' branch_time_in_child np.float64(0.0) branch_time_in_parent np.float64(1223115.0) cmor_version '3.4.0' contact 'ec.cccma.info-info.ccmac.ec@canada.ca' data_specs_version '01.00.29' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacella' forcing_index np.int32(1) frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.CCCma.CanESM5.historical.none.r1i ...' grid 'T63L49 native atmosphere, T63 Linear Gaussian Grid; 128 x 64 longitude/latitude; ...' grid_label 'gn' initialization_index np.int32(1) institution 'Canadian Centre for Climate Modelling and Analysis, Environment and Climate ...' institution_id 'CCCma' license 'CMIP6 model data produced by The Government of Canada (Canadian Centre ...' mip_era 'CMIP6' nominal_resolution '500 km' original_name 'ST' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'CanESM5' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index np.int32(1) product 'model-output' realization_index np.int32(1) realm 'atmos' references 'Geophysical Model Development Special issue on CanESM5 (https://www.ge ...' source 'CanESM5 (2019): \naerosol: interactive\natmos: CanAM5 (T63L49 native atmosphere, ...' source_id 'CanESM5' source_type 'AOGCM' sub_experiment 'none' sub_experiment_id 'none' table_id 'Amon' table_info 'Creation Date:(20 February 2019) MD5:374fbe5a2bcca535c40f7f23da271e49' title 'CanESM5 output prepared for CMIP6' variable_id 'tas' variant_label 'r1i1p1f1' version 'v20190429' with lazy data to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/preproc/diagnostic1/tas/CMIP6_CanESM5_Amon_historical_r1i1p1f1_tas_gn_1950-2005.nc 2025-06-20 13:57:23,072 UTC [2869783] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/tas 2025-06-20 13:57:23,078 UTC [2869782] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/ts 2025-06-20 13:57:23,078 UTC [2869785] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/psl 2025-06-20 13:57:23,116 UTC [2869784] INFO esmvalcore.preprocessor:747 Computing and saving data for preprocessing task diagnostic1/pr 2025-06-20 13:57:24,075 UTC [2869783] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/tas [########################################] | 100% Completed | 1.00 s 2025-06-20 13:57:24,078 UTC [2869783] INFO esmvalcore._task:295 Successfully completed task diagnostic1/tas (priority 2) in 0:00:01.239953 2025-06-20 13:57:24,081 UTC [2869785] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/psl [########################################] | 100% Completed | 1.00 s 2025-06-20 13:57:24,081 UTC [2869782] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/ts [########################################] | 100% Completed | 1.00 s 2025-06-20 13:57:24,084 UTC [2869785] INFO esmvalcore._task:295 Successfully completed task diagnostic1/psl (priority 4) in 0:00:01.244720 2025-06-20 13:57:24,084 UTC [2869782] INFO esmvalcore._task:295 Successfully completed task diagnostic1/ts (priority 1) in 0:00:01.245787 2025-06-20 13:57:24,120 UTC [2869784] INFO esmvalcore.preprocessor._dask_progress:143 diagnostic1/pr [########################################] | 100% Completed | 1.00 s 2025-06-20 13:57:24,123 UTC [2869784] INFO esmvalcore._task:295 Successfully completed task diagnostic1/pr (priority 3) in 0:00:01.284124 2025-06-20 13:57:24,137 UTC [2869641] INFO esmvalcore._task:960 Progress: 0 tasks running, 1 tasks waiting for ancestors, 4/5 done 2025-06-20 13:57:24,144 UTC [2869786] INFO esmvalcore._task:289 Starting task diagnostic1/cvdp in process [2869786] 2025-06-20 13:57:24,147 UTC [2869786] INFO esmvalcore._task:564 Running command ['/nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python', '/nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py', '/nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp/settings.yml'] 2025-06-20 13:57:24,147 UTC [2869786] DEBUG esmvalcore._task:565 in environment {'MPLBACKEND': 'Agg'} 2025-06-20 13:57:24,147 UTC [2869786] DEBUG esmvalcore._task:567 in current working directory: /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp 2025-06-20 13:57:24,147 UTC [2869786] INFO esmvalcore._task:568 Writing output to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/work/diagnostic1/cvdp 2025-06-20 13:57:24,147 UTC [2869786] INFO esmvalcore._task:569 Writing plots to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/plots/diagnostic1/cvdp 2025-06-20 13:57:24,147 UTC [2869786] INFO esmvalcore._task:570 Writing log to /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp/log.txt 2025-06-20 13:57:24,147 UTC [2869786] INFO esmvalcore._task:580 To re-run this diagnostic script, run: cd /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp; MPLBACKEND="Agg" /nird/datalake/NS16000B/esmvaltool-env/2.12.0/bin/python /nird/datalake/NS16000B/esmvaltool-env/2.12.0/lib/python3.12/site-packages/esmvaltool/diag_scripts/cvdp/cvdp_wrapper.py /nird/datalake/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cvdp_20250620_135722/run/diagnostic1/cvdp/settings.yml 2025-06-20 13:57:24,237 UTC [2869641] INFO esmvalcore._task:960 Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done 2025-06-20 13:57:27,464 UTC [2869641] INFO esmvalcore._task:141 Maximum memory used (estimate): 2.7 GB 2025-06-20 13:57:27,522 UTC [2869641] INFO esmvalcore._task:144 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.