2020-11-19 17:02:54,511 UTC [99723] INFO esmvalcore._main:379 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Veronika Eyring (PI; DLR, Germany - veronika.eyring@dlr.de) Bouwe Andela (NLESC, Netherlands - b.andela@esciencecenter.nl) Bjoern Broetz (DLR, Germany - bjoern.broetz@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (NLESC, Netherlands - n.drost@esciencecenter.nl) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2020-11-19 17:02:54,512 UTC [99723] INFO esmvalcore._main:381 Using config file .esmvaltool/config-ipcc.yml 2020-11-19 17:02:54,512 UTC [99723] INFO esmvalcore._main:382 Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/run/main_log_debug.txt 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:59 Starting the Earth System Model Evaluation Tool v2.1.0 at time: 2020-11-19 17:02:54 UTC 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:63 ---------------------------------------------------------------------- 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:64 RECIPE = /nird/home/michaelsch/your-recipes/recipe_validation_CMIP6.yml 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:65 RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/run 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:66 WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/work 2020-11-19 17:02:54,514 UTC [99723] INFO esmvalcore._main:67 PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/preproc 2020-11-19 17:02:54,515 UTC [99723] INFO esmvalcore._main:68 PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/michaelsch/tmp/recipe_validation_CMIP6_20201119_170254/plots 2020-11-19 17:02:54,515 UTC [99723] INFO esmvalcore._main:69 ---------------------------------------------------------------------- 2020-11-19 17:02:54,515 UTC [99723] INFO esmvalcore._main:73 Running tasks using at most 1 processes 2020-11-19 17:02:54,515 UTC [99723] INFO esmvalcore._main:75 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2020-11-19 17:02:54,515 UTC [99723] INFO esmvalcore._main:78 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2020-11-19 17:02:54,532 UTC [99723] DEBUG esmvalcore._recipe_checks:48 Checking recipe against schema /conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/recipe_schema.yml 2020-11-19 17:02:54,557 UTC [99723] DEBUG esmvalcore._recipe:978 Retrieving diagnostics from recipe 2020-11-19 17:02:54,557 UTC [99723] DEBUG esmvalcore._recipe:1094 Populating list of variables for diagnostic validation_with_ERA-Interim 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._config:196 Retrieving institutes for dataset CESM2 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._config:196 Retrieving institutes for dataset NorESM2-LM 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._config:196 Retrieving institutes for dataset ERA-Interim 2020-11-19 17:02:54,559 UTC [99723] DEBUG esmvalcore._recipe:1224 Setting script for diagnostic validation_with_ERA-Interim 2020-11-19 17:02:54,560 UTC [99723] INFO esmvalcore._recipe:1288 Creating tasks from recipe 2020-11-19 17:02:54,560 UTC [99723] INFO esmvalcore._recipe:1293 Creating tasks for diagnostic validation_with_ERA-Interim 2020-11-19 17:02:54,560 UTC [99723] INFO esmvalcore._recipe:1298 Creating preprocessor task validation_with_ERA-Interim/tas 2020-11-19 17:02:54,560 UTC [99723] INFO esmvalcore._recipe:889 Creating preprocessor 'pp_rad' task for variable 'tas' 2020-11-19 17:02:54,560 UTC [99723] DEBUG esmvalcore._recipe:94 If not present: adding keys from CMOR table to {'preprocessor': 'pp_rad', 'variable_group': 'tas', 'short_name': 'tas', 'diagnostic': 'validation_with_ERA-Interim', 'dataset': 'CESM2', 'project': 'CMIP6', 'mip': 'Amon', 'exp': 'historical', 'ensemble': 'r1i1p1f1', 'grid': 'gn', 'start_year': 1900, 'end_year': 2000, 'recipe_dataset_index': 0, 'institute': ['NCAR'], 'activity': 'CMIP', 'alias': 'CMIP6_CESM2'} 2020-11-19 17:02:54,560 UTC [99723] DEBUG esmvalcore._recipe:94 If not present: adding keys from CMOR table to {'preprocessor': 'pp_rad', 'variable_group': 'tas', 'short_name': 'tas', 'diagnostic': 'validation_with_ERA-Interim', 'dataset': 'NorESM2-LM', 'project': 'CMIP6', 'mip': 'Amon', 'exp': 'historical', 'ensemble': 'r1i1p1f1', 'grid': 'gn', 'start_year': 1900, 'end_year': 2000, 'recipe_dataset_index': 1, 'institute': ['NCC'], 'activity': 'CMIP', 'alias': 'CMIP6_NorESM2-LM'} 2020-11-19 17:02:54,560 UTC [99723] DEBUG esmvalcore._recipe:94 If not present: adding keys from CMOR table to {'preprocessor': 'pp_rad', 'variable_group': 'tas', 'short_name': 'tas', 'diagnostic': 'validation_with_ERA-Interim', 'dataset': 'ERA-Interim', 'project': 'OBS6', 'mip': 'Amon', 'type': 'reanaly', 'version': 1, 'start_year': 1980, 'end_year': 2000, 'tier': 3, 'recipe_dataset_index': 2, 'alias': 'OBS6'} 2020-11-19 17:02:54,561 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,561 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,561 UTC [99723] DEBUG esmvalcore._config:186 Retrieving OBS6 configuration 2020-11-19 17:02:54,561 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,699 UTC [99723] DEBUG esmvalcore._data_finder:206 Found /projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/ 2020-11-19 17:02:54,715 UTC [99723] DEBUG esmvalcore._data_finder:209 Skipping non-existent /projects/NS9034K/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/{latestversion} 2020-11-19 17:02:54,715 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,716 UTC [99723] DEBUG esmvalcore._data_finder:23 Looking for files matching ['tas_Amon_CESM2_historical_r1i1p1f1_gn*.nc'] in ['/projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/'] 2020-11-19 17:02:54,717 UTC [99723] DEBUG esmvalcore._data_finder:75 Found start_year 1850 and end_year 2014 2020-11-19 17:02:54,718 UTC [99723] INFO esmvalcore._recipe:549 Using input files for variable tas of dataset CESM2: /projects/NS9252K/ESGF/CMIP6/CMIP/NCAR/CESM2/historical/r1i1p1f1/Amon/tas/gn/latest/tas_Amon_CESM2_historical_r1i1p1f1_gn_185001-201412.nc 2020-11-19 17:02:54,718 UTC [99723] DEBUG esmvalcore._data_finder:75 Found start_year 1850 and end_year 2014 2020-11-19 17:02:54,777 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,854 UTC [99723] DEBUG esmvalcore._data_finder:206 Found /projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/ 2020-11-19 17:02:54,976 UTC [99723] DEBUG esmvalcore._data_finder:206 Found /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/ 2020-11-19 17:02:54,977 UTC [99723] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2020-11-19 17:02:54,977 UTC [99723] DEBUG esmvalcore._data_finder:23 Looking for files matching ['tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn*.nc'] in ['/projects/NS9252K/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/', '/projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/latest/'] 2020-11-19 17:02:55,517 UTC [99723] INFO esmvalcore._task:116 Maximum memory used (estimate): 0.0 GB 2020-11-19 17:02:55,517 UTC [99723] INFO esmvalcore._task:118 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.