INFO [222344] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Veronika Eyring (PI; DLR, Germany - veronika.eyring@dlr.de) Bouwe Andela (NLESC, Netherlands - b.andela@esciencecenter.nl) Bjoern Broetz (DLR, Germany - bjoern.broetz@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (NLESC, Netherlands - n.drost@esciencecenter.nl) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [222344] Using config file ~/.esmvaltool/config-ipcc.yml INFO [222344] Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/main_log_debug.txt INFO [222344] Starting the Earth System Model Evaluation Tool v2.1.0 at time: 2021-03-11 22:18:12 UTC INFO [222344] ---------------------------------------------------------------------- INFO [222344] RECIPE = /nird/home/olivie/your-recipes/recipe_validation_CMIP6.yml INFO [222344] RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run INFO [222344] WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/work INFO [222344] PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/preproc INFO [222344] PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/plots INFO [222344] ---------------------------------------------------------------------- INFO [222344] Running tasks using at most 1 processes INFO [222344] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [222344] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [222344] Creating tasks from recipe INFO [222344] Creating tasks for diagnostic validation_with_ERA-Interim INFO [222344] Creating preprocessor task validation_with_ERA-Interim/tas INFO [222344] Creating preprocessor 'pp_rad' task for variable 'tas' INFO [222344] Using input files for variable tas of dataset CESM2: /projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_CESM2_historical_r1i1p1f1_gn_185001-201412.nc INFO [222344] Using input files for variable tas of dataset NorESM2-LM: /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_195001-195912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_197001-197912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_196001-196912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_192001-192912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_200001-200912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_190001-190912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_191001-191912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_198001-198912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_193001-193912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_194001-194912.nc INFO [222344] Using input files for variable tas of dataset ERA-Interim: /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199801-199812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199401-199412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198201-198212.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198501-198512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198001-198012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198401-198412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198701-198712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199601-199612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199501-199512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_200001-200012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199101-199112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199301-199312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198901-198912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198301-198312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199901-199912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198601-198612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198801-198812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199701-199712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198101-198112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199001-199012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199201-199212.nc INFO [222344] PreprocessingTask validation_with_ERA-Interim/tas created. It will create the files: /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/preproc/validation_with_ERA-Interim/tas/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/preproc/validation_with_ERA-Interim/tas/CMIP6_CESM2_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/preproc/validation_with_ERA-Interim/tas/OBS6_ERA-Interim_reanaly_1_Amon_tas_1980-2000.nc INFO [222344] Creating diagnostic task validation_with_ERA-Interim/lat_lon INFO [222344] Creating diagnostic task validation_with_ERA-Interim/zonal_mean INFO [222344] Creating diagnostic task validation_with_ERA-Interim/meridional_mean INFO [222344] These tasks will be executed: validation_with_ERA-Interim/zonal_mean, validation_with_ERA-Interim/lat_lon, validation_with_ERA-Interim/meridional_mean, validation_with_ERA-Interim/tas INFO [222344] Running 4 tasks sequentially INFO [222344] Starting task validation_with_ERA-Interim/tas in process [222344] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [222344] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] INFO [222344] Successfully completed task validation_with_ERA-Interim/tas (priority 0) in 0:00:44.551916 INFO [222344] Starting task validation_with_ERA-Interim/lat_lon in process [222344] INFO [222344] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/lat_lon/settings.yml'] INFO [222344] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/work/validation_with_ERA-Interim/lat_lon INFO [222344] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/plots/validation_with_ERA-Interim/lat_lon INFO [222344] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/lat_lon/log.txt INFO [222344] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/lat_lon; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/lat_lon/settings.yml INFO [222344] Maximum memory used (estimate): 1.9 GB INFO [222344] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [222344] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/lat_lon/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/lat_lon INFO [222344] Successfully completed task validation_with_ERA-Interim/lat_lon (priority 1) in 0:00:20.170211 INFO [222344] Starting task validation_with_ERA-Interim/zonal_mean in process [222344] INFO [222344] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/zonal_mean/settings.yml'] INFO [222344] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/work/validation_with_ERA-Interim/zonal_mean INFO [222344] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/plots/validation_with_ERA-Interim/zonal_mean INFO [222344] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/zonal_mean/log.txt INFO [222344] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/zonal_mean; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/zonal_mean/settings.yml INFO [222344] Maximum memory used (estimate): 3.1 GB INFO [222344] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [222344] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/zonal_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/zonal_mean INFO [222344] Successfully completed task validation_with_ERA-Interim/zonal_mean (priority 2) in 0:00:17.151434 INFO [222344] Starting task validation_with_ERA-Interim/meridional_mean in process [222344] INFO [222344] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/meridional_mean/settings.yml'] INFO [222344] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/work/validation_with_ERA-Interim/meridional_mean INFO [222344] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/plots/validation_with_ERA-Interim/meridional_mean INFO [222344] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/meridional_mean/log.txt INFO [222344] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/meridional_mean; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/meridional_mean/settings.yml INFO [222344] Maximum memory used (estimate): 2.9 GB INFO [222344] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [222344] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210311_221811/run/validation_with_ERA-Interim/meridional_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/meridional_mean INFO [222344] Successfully completed task validation_with_ERA-Interim/meridional_mean (priority 3) in 0:00:16.192625 INFO [222344] Ending the Earth System Model Evaluation Tool v2.1.0 at time: 2021-03-11 22:19:53 UTC INFO [222344] Time for running the recipe was: 0:01:41.633350 INFO [222344] Maximum memory used (estimate): 4.1 GB INFO [222344] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [222344] Run was successful