INFO [22078] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Veronika Eyring (PI; DLR, Germany - veronika.eyring@dlr.de) Bouwe Andela (NLESC, Netherlands - b.andela@esciencecenter.nl) Bjoern Broetz (DLR, Germany - bjoern.broetz@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (NLESC, Netherlands - n.drost@esciencecenter.nl) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [22078] Using config file ~/.esmvaltool/config-ipcc.yml INFO [22078] Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/main_log_debug.txt INFO [22078] Starting the Earth System Model Evaluation Tool v2.1.0 at time: 2021-03-12 14:04:12 UTC INFO [22078] ---------------------------------------------------------------------- INFO [22078] RECIPE = /nird/home/olivie/your-recipes/recipe_validation_CMIP6.yml INFO [22078] RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run INFO [22078] WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/work INFO [22078] PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/preproc INFO [22078] PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/plots INFO [22078] ---------------------------------------------------------------------- INFO [22078] Running tasks using at most 1 processes INFO [22078] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [22078] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [22078] Creating tasks from recipe INFO [22078] Creating tasks for diagnostic validation_with_ERA-Interim INFO [22078] Creating preprocessor task validation_with_ERA-Interim/tas INFO [22078] Creating preprocessor 'pp_rad' task for variable 'tas' INFO [22078] Using input files for variable tas of dataset CESM2: /projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_CESM2_historical_r1i1p1f1_gn_185001-201412.nc INFO [22078] Using input files for variable tas of dataset NorESM2-LM: /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_195001-195912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_197001-197912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_196001-196912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_192001-192912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_200001-200912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_190001-190912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_191001-191912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_198001-198912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_193001-193912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_194001-194912.nc INFO [22078] Using input files for variable tas of dataset ERA-Interim: /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199801-199812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199401-199412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198201-198212.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198501-198512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198001-198012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198401-198412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198701-198712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199601-199612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199501-199512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_200001-200012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199101-199112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199301-199312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198901-198912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198301-198312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199901-199912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198601-198612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198801-198812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199701-199712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198101-198112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199001-199012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199201-199212.nc INFO [22078] PreprocessingTask validation_with_ERA-Interim/tas created. It will create the files: /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/preproc/validation_with_ERA-Interim/tas/CMIP6_CESM2_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/preproc/validation_with_ERA-Interim/tas/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/preproc/validation_with_ERA-Interim/tas/OBS6_ERA-Interim_reanaly_1_Amon_tas_1980-2000.nc INFO [22078] Creating diagnostic task validation_with_ERA-Interim/lat_lon INFO [22078] Creating diagnostic task validation_with_ERA-Interim/zonal_mean INFO [22078] Creating diagnostic task validation_with_ERA-Interim/meridional_mean INFO [22078] These tasks will be executed: validation_with_ERA-Interim/tas, validation_with_ERA-Interim/zonal_mean, validation_with_ERA-Interim/meridional_mean, validation_with_ERA-Interim/lat_lon INFO [22078] Running 4 tasks sequentially INFO [22078] Starting task validation_with_ERA-Interim/tas in process [22078] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [22078] /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] INFO [22078] Successfully completed task validation_with_ERA-Interim/tas (priority 0) in 0:00:43.544810 INFO [22078] Starting task validation_with_ERA-Interim/lat_lon in process [22078] INFO [22078] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/lat_lon/settings.yml'] INFO [22078] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/work/validation_with_ERA-Interim/lat_lon INFO [22078] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/plots/validation_with_ERA-Interim/lat_lon INFO [22078] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/lat_lon/log.txt INFO [22078] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/lat_lon; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/lat_lon/settings.yml INFO [22078] Maximum memory used (estimate): 1.8 GB INFO [22078] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [22078] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/lat_lon/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/lat_lon INFO [22078] Successfully completed task validation_with_ERA-Interim/lat_lon (priority 1) in 0:00:16.202645 INFO [22078] Starting task validation_with_ERA-Interim/zonal_mean in process [22078] INFO [22078] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/zonal_mean/settings.yml'] INFO [22078] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/work/validation_with_ERA-Interim/zonal_mean INFO [22078] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/plots/validation_with_ERA-Interim/zonal_mean INFO [22078] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/zonal_mean/log.txt INFO [22078] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/zonal_mean; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/zonal_mean/settings.yml INFO [22078] Maximum memory used (estimate): 2.4 GB INFO [22078] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [22078] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/zonal_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/zonal_mean INFO [22078] Successfully completed task validation_with_ERA-Interim/zonal_mean (priority 2) in 0:00:16.217617 INFO [22078] Starting task validation_with_ERA-Interim/meridional_mean in process [22078] INFO [22078] Running command ['/conda/esmvaltool/2.1.0/bin/python', '/conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/meridional_mean/settings.yml'] INFO [22078] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/work/validation_with_ERA-Interim/meridional_mean INFO [22078] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/plots/validation_with_ERA-Interim/meridional_mean INFO [22078] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/meridional_mean/log.txt INFO [22078] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/meridional_mean; MPLBACKEND="Agg" /conda/esmvaltool/2.1.0/bin/python /conda/esmvaltool/2.1.0/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/meridional_mean/settings.yml WARNING [22078] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/olivie/tmp/recipe_validation_CMIP6_20210312_140412/run/validation_with_ERA-Interim/meridional_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/meridional_mean INFO [22078] Successfully completed task validation_with_ERA-Interim/meridional_mean (priority 3) in 0:00:16.337538 INFO [22078] Ending the Earth System Model Evaluation Tool v2.1.0 at time: 2021-03-12 14:05:47 UTC INFO [22078] Time for running the recipe was: 0:01:35.295990 INFO [22078] Maximum memory used (estimate): 4.2 GB INFO [22078] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [22078] Run was successful