INFO [144306] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [144306] Using config file ~/.esmvaltool/config-ipcc.yml INFO [144306] Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/main_log_debug.txt INFO [144306] Starting the Earth System Model Evaluation Tool v2.2.0 at time: 2021-12-03 13:16:00 UTC INFO [144306] ---------------------------------------------------------------------- INFO [144306] RECIPE = /nird/home/tjiputra/tjiputra-recipes/KeyCLIM_perfmetrics_so_Arctic.yml INFO [144306] RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run INFO [144306] WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/work INFO [144306] PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc INFO [144306] PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/plots INFO [144306] ---------------------------------------------------------------------- INFO [144306] Running tasks using at most 1 processes INFO [144306] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [144306] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [144306] Creating tasks from recipe INFO [144306] Creating tasks for diagnostic maps_WOA_so INFO [144306] Creating preprocessor task maps_WOA_so/so INFO [144306] Creating preprocessor 'prep_map_3D' task for variable 'so' INFO [144306] Using input files for variable so of dataset NorESM2-LM: /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-LM_historical_r1i1p1f1_gr_201001-201412.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-LM_historical_r1i1p1f1_gr_200001-200912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-LM_historical_r1i1p1f1_gr_199001-199912.nc INFO [144306] Using input files for variable so of dataset NorESM2-MM: /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_historical_r1i1p1f1_gr_199001-199912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_historical_r1i1p1f1_gr_200001-200912.nc /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_historical_r1i1p1f1_gr_201001-201412.nc INFO [144306] Using input files for variable so of dataset NorESM2-MM: /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/v20210521/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/v20210521/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/v20210521/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-piAerOxid/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-piAerOxid_r1i1p1f1_gr_200001-200912.nc INFO [144306] Using input files for variable so of dataset NorESM2-MM: /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-snow/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-snow_r1i1p1f1_gr_201001-201412.nc INFO [144306] Using input files for variable so of dataset NorESM2-MM: /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-iceSheet/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-iceSheet_r1i1p1f1_gr_200001-200912.nc INFO [144306] Using input files for variable so of dataset NorESM2-MM: /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/latest/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_201001-201412.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_200001-200912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_199001-199912.nc /projects/NS9252K/KeyCLIM_CMOR/CMIP/NCC/NorESM2-MM/hist-cloud/r1i1p1f1/Omon/so/gr/v20211028/so_Omon_NorESM2-MM_hist-cloud_r1i1p1f1_gr_201001-201412.nc INFO [144306] Using input files for variable so of dataset WOA: /projects/NS9252K/obsdata/Tier2/WOA/OBS6_WOA_clim_2018_Omon_so_200001-200012.nc INFO [144306] PreprocessingTask maps_WOA_so/so created. It will create the files: /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/KeyCLIM_NorESM2-MM_Omon_hist-snow_r1i1p1f1_so_1995-2014.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/CMIP6_NorESM2-MM_Omon_historical_r1i1p1f1_so_1995-2014.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/KeyCLIM_NorESM2-MM_Omon_hist-iceSheet_r1i1p1f1_so_1995-2014.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/KeyCLIM_NorESM2-MM_Omon_hist-cloud_r1i1p1f1_so_1995-2014.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/OBS6_WOA_clim_2018_Omon_so_2000-2000.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/KeyCLIM_NorESM2-MM_Omon_hist-piAerOxid_r1i1p1f1_so_1995-2014.nc /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/preproc/maps_WOA_so/so/CMIP6_NorESM2-LM_Omon_historical_r1i1p1f1_so_1995-2014.nc INFO [144306] Creating diagnostic task maps_WOA_so/model_vs_obs INFO [144306] These tasks will be executed: maps_WOA_so/so, maps_WOA_so/model_vs_obs INFO [144306] Running 2 tasks sequentially INFO [144306] Starting task maps_WOA_so/so in process [144306] WARNING [144306] There were warnings in variable so: Coordinate lev units meters converted to m INFO [144306] Successfully completed task maps_WOA_so/so (priority 0) in 1:47:22.347337 INFO [144306] Starting task maps_WOA_so/model_vs_obs in process [144306] INFO [144306] Running command ['/nird/home/tjiputra/.conda/envs/ce2coast/bin/python3.9', '/nird/home/tjiputra/CE2COAST/ESMValTool/esmvaltool/diag_scripts/ocean/diagnostic_maps_multimodel_KeyCLIM.py', '/projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/maps_WOA_so/model_vs_obs/settings.yml'] INFO [144306] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/work/maps_WOA_so/model_vs_obs INFO [144306] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/plots/maps_WOA_so/model_vs_obs INFO [144306] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/maps_WOA_so/model_vs_obs/log.txt INFO [144306] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/maps_WOA_so/model_vs_obs; MPLBACKEND="Agg" /nird/home/tjiputra/.conda/envs/ce2coast/bin/python3.9 /nird/home/tjiputra/CE2COAST/ESMValTool/esmvaltool/diag_scripts/ocean/diagnostic_maps_multimodel_KeyCLIM.py /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/maps_WOA_so/model_vs_obs/settings.yml INFO [144306] Maximum memory used (estimate): 0.2 GB INFO [144306] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [144306] Maximum memory used (estimate): 13.8 GB INFO [144306] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [144306] Program terminated abnormally, see stack trace below for more information: Traceback (most recent call last): File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_main.py", line 433, in run fire.Fire(ESMValTool()) File "/nird/home/tjiputra/.conda/envs/ce2coast/lib/python3.9/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/nird/home/tjiputra/.conda/envs/ce2coast/lib/python3.9/site-packages/fire/core.py", line 466, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/nird/home/tjiputra/.conda/envs/ce2coast/lib/python3.9/site-packages/fire/core.py", line 681, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_main.py", line 410, in run process_recipe(recipe_file=recipe, config_user=cfg) File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_main.py", line 104, in process_recipe recipe.run() File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_recipe.py", line 1380, in run self.tasks.run(max_parallel_tasks=self._cfg['max_parallel_tasks']) File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_task.py", line 674, in run self._run_sequential() File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_task.py", line 685, in _run_sequential task.run() File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_task.py", line 252, in run self.output_files = self._run(input_files) File "/nird/home/tjiputra/CE2COAST/ESMValCore/esmvalcore/_task.py", line 545, in _run raise DiagnosticError( esmvalcore._task.DiagnosticError: Diagnostic script ocean/diagnostic_maps_multimodel_KeyCLIM.py failed with return code 1. See the log in /projects/NS2345K/www/diagnostics/esmvaltool/tjiputra/tmp/KeyCLIM_perfmetrics_so_Arctic_20211203_131559/run/maps_WOA_so/model_vs_obs/log.txt INFO [144306] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.