INFO [2655329] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [2655329] Package versions INFO [2655329] ---------------- INFO [2655329] ESMValCore: 2.8.0 INFO [2655329] ESMValTool: 2.8.0 INFO [2655329] ---------------- INFO [2655329] Using config file /nird/home/yanchun/.esmvaltool/config-user.yml INFO [2655329] Writing program log files to: /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/main_log.txt /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/main_log_debug.txt INFO [2655329] Starting the Earth System Model Evaluation Tool at time: 2023-05-19 09:24:54 UTC INFO [2655329] ---------------------------------------------------------------------- INFO [2655329] RECIPE = /nird/home/yanchun/projects/NICEST2/recipes/recipe_cbf.yml INFO [2655329] RUNDIR = /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run INFO [2655329] WORKDIR = /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/work INFO [2655329] PREPROCDIR = /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/preproc INFO [2655329] PLOTDIR = /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/plots INFO [2655329] ---------------------------------------------------------------------- INFO [2655329] Running tasks using at most 256 processes INFO [2655329] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [2655329] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [2655329] Creating tasks from recipe INFO [2655329] Creating tasks for diagnostic map INFO [2655329] Creating diagnostic task map/script1 INFO [2655329] Creating preprocessor task map/psl INFO [2655329] Creating preprocessor 'prepare_map' task for variable 'psl' INFO [2655329] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [2655329] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r2i1p1f1, gn, v20190920 INFO [2655329] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-LM, CMIP, historical, r3i1p1f1, gn, v20190920 INFO [2655329] Found input files for Dataset: psl, Amon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [2655329] Found input files for Dataset: psl, Amon, OBS6, ERA-20C, 1 INFO [2655329] PreprocessingTask map/psl created. INFO [2655329] These tasks will be executed: map/script1, map/psl INFO [2655329] Wrote recipe with version numbers and wildcards to: file:///projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/recipe_cbf_filled.yml INFO [2655329] Running 2 tasks using 2 processes INFO [2655467] Starting task map/psl in process [2655467] INFO [2655329] Progress: 1 tasks running, 1 tasks waiting for ancestors, 0/2 done WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] There were warnings in variable psl: Added guessed bounds to coordinate lon from var lon Added guessed bounds to coordinate lat from var lat Added guessed bounds to coordinate time from var psl loaded from file /scratch/yanchun/ESGF/obsdata/Tier3/ERA-20C/OBS6_ERA-20C_reanaly_1_Amon_psl_190001-201012.nc WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data WARNING [2655467] /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:2481: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = fill_value is not None and fill_value in data INFO [2655467] Successfully completed task map/psl (priority 1) in 0:00:32.342659 INFO [2655329] Progress: 0 tasks running, 1 tasks waiting for ancestors, 1/2 done INFO [2655468] Starting task map/script1 in process [2655468] INFO [2655329] Progress: 1 tasks running, 0 tasks waiting for ancestors, 1/2 done INFO [2655468] Running command ['/conda/esmvaltool/2.8.0/bin/python', '/nird/home/yanchun/projects/NICEST2/diag_scripts/cbf/diag_cbfs.py', '/projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/map/script1/settings.yml'] INFO [2655468] Writing output to /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/work/map/script1 INFO [2655468] Writing plots to /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/plots/map/script1 INFO [2655468] Writing log to /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/map/script1/log.txt INFO [2655468] To re-run this diagnostic script, run: cd /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/map/script1; MPLBACKEND="Agg" /conda/esmvaltool/2.8.0/bin/python /nird/home/yanchun/projects/NICEST2/diag_scripts/cbf/diag_cbfs.py /projects/NS2345K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_cbf_20230519_092454/run/map/script1/settings.yml INFO [2655468] Maximum memory used (estimate): 1.0 GB INFO [2655468] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [2655468] Invalid ancestor file /path/to/input_file_1.nc specified for recording provenance of /path/to/result.nc, created by diagnostic script /nird/home/yanchun/projects/NICEST2/diag_scripts/cbf/diag_cbfs.py in task map/script1 WARNING [2655468] Invalid ancestor file /path/to/input_file_2.nc specified for recording provenance of /path/to/result.nc, created by diagnostic script /nird/home/yanchun/projects/NICEST2/diag_scripts/cbf/diag_cbfs.py in task map/script1 WARNING [2655468] The reference file /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/references/author20journal.bibtex does not exist, citation information incomplete. INFO [2655329] Maximum memory used (estimate): 2.7 GB INFO [2655329] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [2655329] Program terminated abnormally, see stack trace below for more information: multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/conda/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 590, in _run self._collect_provenance() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 674, in _collect_provenance _write_citation_files(product.filename, product.provenance) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_citation.py", line 81, in _write_citation_files _save_citation_bibtex(product_name, tags, cmip6_json_urls) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_citation.py", line 104, in _save_citation_bibtex with open(f'{product_name}_citation.bibtex', 'w') as file: FileNotFoundError: [Errno 2] No such file or directory: '/path/to/result_citation.bibtex' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 122, in process_recipe recipe.run() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1308, in run self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks']) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 724, in run self._run_parallel(max_parallel_tasks) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 767, in _run_parallel _copy_results(task, running[task]) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 790, in _copy_results task.output_files, task.products = future.get() File "/conda/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 774, in get raise self._value File "/conda/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 590, in _run self._collect_provenance() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 674, in _collect_provenance _write_citation_files(product.filename, product.provenance) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_citation.py", line 81, in _write_citation_files _save_citation_bibtex(product_name, tags, cmip6_json_urls) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_citation.py", line 104, in _save_citation_bibtex with open(f'{product_name}_citation.bibtex', 'w') as file: FileNotFoundError: [Errno 2] No such file or directory: '/path/to/result_citation.bibtex' INFO [2655329] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.