INFO [2619527] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [2619527] Package versions INFO [2619527] ---------------- INFO [2619527] ESMValCore: 2.8.0 INFO [2619527] ESMValTool: 2.8.0 INFO [2619527] ---------------- INFO [2619527] Using config file /nird/home/yanchun/.esmvaltool/config-NS9560K.yml INFO [2619527] Writing program log files to: /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/main_log.txt /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/main_log_debug.txt INFO [2619527] Starting the Earth System Model Evaluation Tool at time: 2023-05-19 06:43:49 UTC INFO [2619527] ---------------------------------------------------------------------- INFO [2619527] RECIPE = /nird/home/yanchun/diagnostics/noresmvaltool/esmvaltool/tested_recipes/examples/recipe_python.yml INFO [2619527] RUNDIR = /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run INFO [2619527] WORKDIR = /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/work INFO [2619527] PREPROCDIR = /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/preproc INFO [2619527] PLOTDIR = /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/plots INFO [2619527] ---------------------------------------------------------------------- INFO [2619527] Running tasks using at most 8 processes INFO [2619527] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [2619527] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [2619527] For Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, supplementaries: areacella, *, *, *: ignoring supplementary variable 'areacella', unable to expand wildcards 'mip', 'exp', 'ensemble', 'institute', 'product'. INFO [2619527] Creating tasks from recipe INFO [2619527] Creating tasks for diagnostic map INFO [2619527] Creating diagnostic task map/script1 INFO [2619527] Creating preprocessor task map/tas INFO [2619527] Creating preprocessor 'to_degrees_c' task for variable 'tas' INFO [2619527] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 INFO [2619527] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 INFO [2619527] PreprocessingTask map/tas created. INFO [2619527] Creating tasks for diagnostic timeseries INFO [2619527] Creating diagnostic task timeseries/script1 INFO [2619527] Creating preprocessor task timeseries/tas_amsterdam INFO [2619527] Creating preprocessor 'annual_mean_amsterdam' task for variable 'tas_amsterdam' INFO [2619527] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 INFO [2619527] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 INFO [2619527] PreprocessingTask timeseries/tas_amsterdam created. INFO [2619527] Creating preprocessor task timeseries/tas_global INFO [2619527] Creating preprocessor 'annual_mean_global' task for variable 'tas_global' INFO [2619527] Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214, supplementaries: areacella, fx, 1pctCO2, v20190613 WARNING [2619527] Preprocessor function area_statistics works best when at least one supplementary variable of ['areacella', 'areacello'] is defined in the recipe for Dataset: {'diagnostic': 'timeseries', 'variable_group': 'tas_global', 'dataset': 'bcc-csm1-1', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'tas', 'alias': 'CMIP5', 'caption': 'Annual global mean {long_name} according to {dataset}.', 'ensemble': 'r1i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['BCC'], 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'preprocessor': 'annual_mean_global', 'product': ['output1', 'output2'], 'recipe_dataset_index': 1, 'standard_name': 'air_temperature', 'timerange': '1850/2000', 'units': 'K'} session: 'recipe_python_20230519_064348'. INFO [2619527] Found input files for Dataset: tas, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 INFO [2619527] PreprocessingTask timeseries/tas_global created. INFO [2619527] These tasks will be executed: timeseries/script1, timeseries/tas_global, map/tas, timeseries/tas_amsterdam, map/script1 INFO [2619527] Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/recipe_python_filled.yml INFO [2619527] Running 5 tasks using 5 processes INFO [2619668] Starting task map/tas in process [2619668] INFO [2619669] Starting task timeseries/tas_amsterdam in process [2619669] INFO [2619670] Starting task timeseries/tas_global in process [2619670] INFO [2619527] Progress: 3 tasks running, 2 tasks waiting for ancestors, 0/5 done INFO [2619669] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) INFO [2619668] Successfully completed task map/tas (priority 1) in 0:00:00.936393 INFO [2619527] Progress: 2 tasks running, 2 tasks waiting for ancestors, 1/5 done INFO [2619671] Starting task map/script1 in process [2619671] INFO [2619671] Running command ['/conda/esmvaltool/2.8.0/bin/python', '/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py', '/projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1/settings.yml'] INFO [2619671] Writing output to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/work/map/script1 INFO [2619671] Writing plots to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/plots/map/script1 INFO [2619671] Writing log to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1/log.txt INFO [2619671] To re-run this diagnostic script, run: cd /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1; MPLBACKEND="Agg" /conda/esmvaltool/2.8.0/bin/python /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1/settings.yml INFO [2619527] Progress: 3 tasks running, 1 tasks waiting for ancestors, 1/5 done WARNING [2619670] There were warnings in variable areacella: Long name for areacella changed from Grid-Cell Area for Atmospheric Variables to Grid-Cell Area for Atmospheric Grid Variables loaded from file /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/BCC/BCC-ESM1/1pctCO2/r1i1p1f1/fx/areacella/gn/v20190613/areacella_fx_BCC-ESM1_1pctCO2_r1i1p1f1_gn.nc INFO [2619669] Extracting data for Amsterdam, Noord-Holland, Nederland (52.3730796 °N, 4.8924534 °E) INFO [2619669] Generated PreprocessorFile: /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/preproc/timeseries/tas_amsterdam/MultiModelMean_historical_Amon_tas_1850-2000.nc INFO [2619669] Successfully completed task timeseries/tas_amsterdam (priority 3) in 0:00:02.596168 INFO [2619527] Progress: 2 tasks running, 1 tasks waiting for ancestors, 2/5 done INFO [2619670] Successfully completed task timeseries/tas_global (priority 4) in 0:00:02.705475 INFO [2619527] Progress: 1 tasks running, 1 tasks waiting for ancestors, 3/5 done INFO [2619672] Starting task timeseries/script1 in process [2619672] INFO [2619672] Running command ['/conda/esmvaltool/2.8.0/bin/python', '/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py', '/projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/timeseries/script1/settings.yml'] INFO [2619672] Writing output to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/work/timeseries/script1 INFO [2619672] Writing plots to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/plots/timeseries/script1 INFO [2619672] Writing log to /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/timeseries/script1/log.txt INFO [2619672] To re-run this diagnostic script, run: cd /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/timeseries/script1; MPLBACKEND="Agg" /conda/esmvaltool/2.8.0/bin/python /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/timeseries/script1/settings.yml INFO [2619527] Progress: 2 tasks running, 0 tasks waiting for ancestors, 3/5 done INFO [2619671] Maximum memory used (estimate): 0.5 GB INFO [2619671] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [2619527] Maximum memory used (estimate): 3.6 GB INFO [2619527] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [2619527] Program terminated abnormally, see stack trace below for more information: multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/conda/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 593, in _run raise DiagnosticError( esmvalcore._task.DiagnosticError: Diagnostic script examples/diagnostic.py failed with return code 1. See the log in /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1/log.txt """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 122, in process_recipe recipe.run() File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1308, in run self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks']) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 724, in run self._run_parallel(max_parallel_tasks) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 767, in _run_parallel _copy_results(task, running[task]) File "/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 790, in _copy_results task.output_files, task.products = future.get() File "/conda/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 774, in get raise self._value esmvalcore._task.DiagnosticError: Diagnostic script examples/diagnostic.py failed with return code 1. See the log in /projects/NS2980K/www/yanchun/esmvaltool2.8.0/recipe_python_20230519_064348/run/map/script1/log.txt INFO [2619527] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.