2021-01-04 15:08:08,762 UTC [84313] INFO esmvalcore._main:379 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Veronika Eyring (PI; DLR, Germany - veronika.eyring@dlr.de) Bouwe Andela (NLESC, Netherlands - b.andela@esciencecenter.nl) Bjoern Broetz (DLR, Germany - bjoern.broetz@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (NLESC, Netherlands - n.drost@esciencecenter.nl) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2021-01-04 15:08:08,762 UTC [84313] INFO esmvalcore._main:381 Using config file config-ipcc.yml 2021-01-04 15:08:08,762 UTC [84313] INFO esmvalcore._main:382 Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/run/main_log_debug.txt 2021-01-04 15:08:08,763 UTC [84313] INFO esmvalcore._main:59 Starting the Earth System Model Evaluation Tool v2.1.0 at time: 2021-01-04 15:08:08 UTC 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:63 ---------------------------------------------------------------------- 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:64 RECIPE = /projects/NS9560K/users/tjiputra/evt_run/my_recipe_seaice.yml 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:65 RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/run 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:66 WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/work 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:67 PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/preproc 2021-01-04 15:08:08,764 UTC [84313] INFO esmvalcore._main:68 PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/plots 2021-01-04 15:08:08,765 UTC [84313] INFO esmvalcore._main:69 ---------------------------------------------------------------------- 2021-01-04 15:08:08,765 UTC [84313] INFO esmvalcore._main:73 Running tasks using at most 1 processes 2021-01-04 15:08:08,765 UTC [84313] INFO esmvalcore._main:75 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2021-01-04 15:08:08,765 UTC [84313] INFO esmvalcore._main:78 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2021-01-04 15:08:08,766 UTC [84313] DEBUG esmvalcore._recipe_checks:48 Checking recipe against schema /conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/recipe_schema.yml 2021-01-04 15:08:08,794 UTC [84313] INFO esmvalcore._recipe:962 NCL script detected, checking NCL version 2021-01-04 15:08:09,025 UTC [84313] INFO esmvalcore._recipe_checks:37 Found NCL version 6.6.2 2021-01-04 15:08:09,027 UTC [84313] DEBUG esmvalcore._recipe:978 Retrieving diagnostics from recipe 2021-01-04 15:08:09,028 UTC [84313] DEBUG esmvalcore._recipe:1094 Populating list of variables for diagnostic seaice_tsline_NH 2021-01-04 15:08:09,028 UTC [84313] DEBUG esmvalcore._config:196 Retrieving institutes for dataset NorESM2-LM 2021-01-04 15:08:09,028 UTC [84313] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2021-01-04 15:08:09,029 UTC [84313] DEBUG esmvalcore._config:196 Retrieving institutes for dataset NorESM2-LM 2021-01-04 15:08:09,029 UTC [84313] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2021-01-04 15:08:09,029 UTC [84313] DEBUG esmvalcore._recipe:1224 Setting script for diagnostic seaice_tsline_NH 2021-01-04 15:08:09,029 UTC [84313] DEBUG esmvalcore._recipe:1094 Populating list of variables for diagnostic seaice_tsline_SH 2021-01-04 15:08:09,030 UTC [84313] DEBUG esmvalcore._config:196 Retrieving institutes for dataset NorESM2-LM 2021-01-04 15:08:09,030 UTC [84313] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2021-01-04 15:08:09,030 UTC [84313] DEBUG esmvalcore._config:196 Retrieving institutes for dataset NorESM2-LM 2021-01-04 15:08:09,030 UTC [84313] DEBUG esmvalcore._config:209 Retrieving activity_id for experiment historical 2021-01-04 15:08:09,030 UTC [84313] DEBUG esmvalcore._recipe:1224 Setting script for diagnostic seaice_tsline_SH 2021-01-04 15:08:09,031 UTC [84313] INFO esmvalcore._recipe:1288 Creating tasks from recipe 2021-01-04 15:08:09,031 UTC [84313] INFO esmvalcore._recipe:1293 Creating tasks for diagnostic seaice_tsline_NH 2021-01-04 15:08:09,031 UTC [84313] INFO esmvalcore._recipe:1298 Creating preprocessor task seaice_tsline_NH/sic 2021-01-04 15:08:09,032 UTC [84313] INFO esmvalcore._recipe:889 Creating preprocessor 'default' task for variable 'sic' 2021-01-04 15:08:09,032 UTC [84313] DEBUG esmvalcore._recipe:94 If not present: adding keys from CMOR table to {'mip': 'SImon', 'project': 'CMIP6', 'exp': 'historical', 'ensemble': 'r1i1p1', 'start_year': 1979, 'end_year': 2004, 'variable_group': 'sic', 'short_name': 'sic', 'diagnostic': 'seaice_tsline_NH', 'preprocessor': 'default', 'dataset': 'NorESM2-LM', 'recipe_dataset_index': 0, 'institute': ['NCC'], 'activity': 'CMIP', 'alias': 'r1i1p1'} 2021-01-04 15:08:09,032 UTC [84313] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2021-01-04 15:08:09,033 UTC [84313] DEBUG esmvalcore._config:186 Retrieving CMIP6 configuration 2021-01-04 15:08:09,765 UTC [84313] INFO esmvalcore._task:116 Maximum memory used (estimate): 0.0 GB 2021-01-04 15:08:09,766 UTC [84313] INFO esmvalcore._task:118 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2021-01-04 15:08:09,767 UTC [84313] ERROR esmvalcore._main:437 Program terminated abnormally, see stack trace below for more information Traceback (most recent call last): File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_main.py", line 430, in run fire.Fire(ESMValTool()) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/fire/core.py", line 138, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/fire/core.py", line 463, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/fire/core.py", line 672, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_main.py", line 407, in run process_recipe(recipe_file=recipe, config_user=cfg) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_main.py", line 94, in process_recipe recipe = read_recipe_file(recipe_file, config_user) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 71, in read_recipe_file return Recipe(raw_recipe, File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 951, in __init__ self.tasks = self.initialize_tasks() if initialize_tasks else None File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 1299, in initialize_tasks task = _get_preprocessor_task( File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 917, in _get_preprocessor_task task = _get_single_preprocessor_task( File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 776, in _get_single_preprocessor_task products = _get_preprocessor_products( File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 742, in _get_preprocessor_products ancestors = _get_ancestors(variable, config_user) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 547, in _get_ancestors filenames) = _get_input_files(variable, config_user) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_recipe.py", line 530, in _get_input_files filenames) = get_input_filelist(variable=variable, File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_data_finder.py", line 237, in get_input_filelist (files, dirnames, filenames) = _find_input_files(variable, rootpath, drs) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_data_finder.py", line 224, in _find_input_files input_dirs = _find_input_dirs(variable, rootpath, drs) File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_data_finder.py", line 198, in _find_input_dirs for dirname_template in _replace_tags(path_template, variable): File "/conda/esmvaltool/2.0.0/lib/python3.8/site-packages/esmvalcore/_data_finder.py", line 106, in _replace_tags raise KeyError("Dataset key {} must be specified for {}, check " KeyError: "Dataset key grid must be specified for {'mip': 'SImon', 'project': 'CMIP6', 'exp': 'historical', 'ensemble': 'r1i1p1', 'start_year': 1979, 'end_year': 2004, 'variable_group': 'sic', 'short_name': 'siconc', 'diagnostic': 'seaice_tsline_NH', 'preprocessor': 'default', 'dataset': 'NorESM2-LM', 'recipe_dataset_index': 0, 'institute': ['NCC'], 'activity': 'CMIP', 'alias': 'r1i1p1', 'original_short_name': 'siconc', 'standard_name': 'sea_ice_area_fraction', 'long_name': 'Sea-Ice Area Percentage (Ocean Grid)', 'units': '%', 'modeling_realm': ['seaIce'], 'frequency': 'mon', 'filename': '/projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/my_recipe_seaice_20210104_150808/preproc/seaice_tsline_NH/sic/CMIP6_NorESM2-LM_SImon_historical_r1i1p1_sic_1979-2004.nc'}, check your recipe entry" 2021-01-04 15:08:09,772 UTC [84313] INFO esmvalcore._main:441 If you suspect this is a bug or need help, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues and attach the run/recipe_*.yml and run/main_log_debug.txt files from the output directory.