INFO [6087] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Veronika Eyring (PI; DLR, Germany - veronika.eyring@dlr.de) Bouwe Andela (NLESC, Netherlands - b.andela@esciencecenter.nl) Bjoern Broetz (DLR, Germany - bjoern.broetz@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (NLESC, Netherlands - n.drost@esciencecenter.nl) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [6087] Using config file ~/.esmvaltool/config-user.yml INFO [6087] Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/main_log_debug.txt INFO [6087] Starting the Earth System Model Evaluation Tool v2.0.0 at time: 2020-11-18 15:37:01 UTC INFO [6087] ---------------------------------------------------------------------- INFO [6087] RECIPE = /nird/home/u1/jang/data/esmvaltool/recipe_validation_CMIP6.yml INFO [6087] RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run INFO [6087] WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/work INFO [6087] PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/preproc INFO [6087] PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/plots INFO [6087] ---------------------------------------------------------------------- INFO [6087] Running tasks using at most 1 processes INFO [6087] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [6087] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [6087] Creating tasks from recipe INFO [6087] Creating tasks for diagnostic validation_with_ERA-Interim INFO [6087] Creating preprocessor task validation_with_ERA-Interim/tas INFO [6087] Creating preprocessor 'pp_rad' task for variable 'tas' INFO [6087] Using input files for variable tas of dataset CESM2: /projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_CESM2_historical_r1i1p1f1_gn_185001-201412.nc INFO [6087] Using input files for variable tas of dataset NorESM2-LM: /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_195001-195912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_197001-197912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_196001-196912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_192001-192912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_200001-200912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_190001-190912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_191001-191912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_198001-198912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_193001-193912.nc /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_194001-194912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_195001-195912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_197001-197912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_196001-196912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_192001-192912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_200001-200912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_190001-190912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_191001-191912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_198001-198912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_193001-193912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_194001-194912.nc INFO [6087] Using input files for variable tas of dataset ERA-Interim: /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199801-199812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199401-199412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198201-198212.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198501-198512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198001-198012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198401-198412.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198701-198712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199601-199612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199501-199512.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_200001-200012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199101-199112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199301-199312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198901-198912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198301-198312.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199901-199912.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198601-198612.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198801-198812.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199701-199712.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_198101-198112.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199001-199012.nc /projects/NS9252K/obsdata/Tier3/ERA-Interim/OBS6_ERA-Interim_reanaly_1_Amon_tas_199201-199212.nc INFO [6087] PreprocessingTask validation_with_ERA-Interim/tas created. It will create the files: /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/preproc/validation_with_ERA-Interim/tas/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/preproc/validation_with_ERA-Interim/tas/CMIP6_CESM2_Amon_historical_r1i1p1f1_tas_1900-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/preproc/validation_with_ERA-Interim/tas/OBS6_ERA-Interim_reanaly_1_Amon_tas_1980-2000.nc INFO [6087] Creating diagnostic task validation_with_ERA-Interim/lat_lon INFO [6087] Creating diagnostic task validation_with_ERA-Interim/zonal_mean INFO [6087] Creating diagnostic task validation_with_ERA-Interim/meridional_mean INFO [6087] These tasks will be executed: validation_with_ERA-Interim/meridional_mean, validation_with_ERA-Interim/zonal_mean, validation_with_ERA-Interim/lat_lon, validation_with_ERA-Interim/tas INFO [6087] Running 4 tasks sequentially INFO [6087] Starting task validation_with_ERA-Interim/tas in process [6087] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] WARNING [6087] /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/iris/fileformats/netcdf.py:395: UserWarning: WARNING: missing_value not used since it cannot be safely cast to variable data type var = variable[keys] INFO [6087] Successfully completed task validation_with_ERA-Interim/tas (priority 0) in 0:00:57.060475 INFO [6087] Starting task validation_with_ERA-Interim/lat_lon in process [6087] INFO [6087] Running command ['/nird/home/jang/miniconda3/envs/esmvaltool/bin/python', '/nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/lat_lon/settings.yml'] INFO [6087] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/work/validation_with_ERA-Interim/lat_lon INFO [6087] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/plots/validation_with_ERA-Interim/lat_lon INFO [6087] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/lat_lon/log.txt INFO [6087] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/lat_lon; MPLBACKEND="Agg" /nird/home/jang/miniconda3/envs/esmvaltool/bin/python /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/lat_lon/settings.yml INFO [6087] Maximum memory used (estimate): 3.0 GB INFO [6087] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [6087] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/lat_lon/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/lat_lon INFO [6087] Successfully completed task validation_with_ERA-Interim/lat_lon (priority 1) in 0:00:21.369607 INFO [6087] Starting task validation_with_ERA-Interim/zonal_mean in process [6087] INFO [6087] Running command ['/nird/home/jang/miniconda3/envs/esmvaltool/bin/python', '/nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/zonal_mean/settings.yml'] INFO [6087] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/work/validation_with_ERA-Interim/zonal_mean INFO [6087] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/plots/validation_with_ERA-Interim/zonal_mean INFO [6087] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/zonal_mean/log.txt INFO [6087] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/zonal_mean; MPLBACKEND="Agg" /nird/home/jang/miniconda3/envs/esmvaltool/bin/python /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/zonal_mean/settings.yml INFO [6087] Maximum memory used (estimate): 1.9 GB INFO [6087] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [6087] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/zonal_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/zonal_mean INFO [6087] Successfully completed task validation_with_ERA-Interim/zonal_mean (priority 2) in 0:00:14.360763 INFO [6087] Starting task validation_with_ERA-Interim/meridional_mean in process [6087] INFO [6087] Running command ['/nird/home/jang/miniconda3/envs/esmvaltool/bin/python', '/nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/meridional_mean/settings.yml'] INFO [6087] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/work/validation_with_ERA-Interim/meridional_mean INFO [6087] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/plots/validation_with_ERA-Interim/meridional_mean INFO [6087] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/meridional_mean/log.txt INFO [6087] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/meridional_mean; MPLBACKEND="Agg" /nird/home/jang/miniconda3/envs/esmvaltool/bin/python /nird/home/jang/miniconda3/envs/esmvaltool/lib/python3.8/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/meridional_mean/settings.yml INFO [6087] Maximum memory used (estimate): 1.7 GB INFO [6087] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [6087] No provenance information was written to /projects/NS2345K/www/diagnostics/esmvaltool/jang/tmp/recipe_validation_CMIP6_20201118_153700/run/validation_with_ERA-Interim/meridional_mean/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script validation.py in task validation_with_ERA-Interim/meridional_mean INFO [6087] Successfully completed task validation_with_ERA-Interim/meridional_mean (priority 3) in 0:00:15.253582 INFO [6087] Ending the Earth System Model Evaluation Tool v2.0.0 at time: 2020-11-18 15:38:55 UTC INFO [6087] Time for running the recipe was: 0:01:54.238948 INFO [6087] Maximum memory used (estimate): 3.1 GB INFO [6087] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [6087] Run was successful