INFO [1388404] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [1388404] Package versions INFO [1388404] ---------------- INFO [1388404] ESMValCore: 2.8.0 INFO [1388404] ESMValTool: 2.8.0 INFO [1388404] ---------------- INFO [1388404] Using config file /nird/home/tomast/.esmvaltool/config-user.yml INFO [1388404] Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/run/main_log_debug.txt INFO [1388404] Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. WARNING [1388404] ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. INFO [1388404] Starting the Earth System Model Evaluation Tool at time: 2023-07-04 14:10:16 UTC INFO [1388404] ---------------------------------------------------------------------- INFO [1388404] RECIPE = /projects/NS2980K/home/tomast/ESMValTool/noresmvaltool/esmvaltool/new_recipes/recipe_ocean_arctic_bgc.yml INFO [1388404] RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/run INFO [1388404] WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/work INFO [1388404] PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/preproc INFO [1388404] PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/plots INFO [1388404] ---------------------------------------------------------------------- INFO [1388404] Running tasks using at most 256 processes INFO [1388404] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [1388404] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [1388404] Creating tasks from recipe INFO [1388404] Creating tasks for diagnostic diag_ice_NHW_hist INFO [1388404] Creating diagnostic task diag_ice_NHW_hist/Global_seaice_timeseries INFO [1388404] Creating preprocessor task diag_ice_NHW_hist/siconc INFO [1388404] Creating preprocessor 'timeseries_NHW_ice_extent_hist' task for variable 'siconc' INFO [1388404] Found input files for Dataset: siconc, SImon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1388404] PreprocessingTask diag_ice_NHW_hist/siconc created. INFO [1388404] Creating tasks for diagnostic diag_ice_NHS_hist INFO [1388404] Creating diagnostic task diag_ice_NHS_hist/Global_seaice_timeseries INFO [1388404] Creating preprocessor task diag_ice_NHS_hist/siconc INFO [1388404] Creating preprocessor 'timeseries_NHS_ice_extent_ssp' task for variable 'siconc' INFO [1388404] Found input files for Dataset: siconc, SImon, CMIP6, NorESM2-MM, CMIP, historical, r1i1p1f1, gn, v20191108 INFO [1388404] PreprocessingTask diag_ice_NHS_hist/siconc created. INFO [1388404] These tasks will be executed: diag_ice_NHS_hist/Global_seaice_timeseries, diag_ice_NHW_hist/Global_seaice_timeseries, diag_ice_NHS_hist/siconc, diag_ice_NHW_hist/siconc INFO [1388404] Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230704_141014/run/recipe_ocean_arctic_bgc_filled.yml INFO [1388404] Running 4 tasks using 4 processes INFO [1388562] Starting task diag_ice_NHW_hist/siconc in process [1388562] INFO [1388563] Starting task diag_ice_NHS_hist/siconc in process [1388563] INFO [1388404] Progress: 2 tasks running, 2 tasks waiting for ancestors, 0/4 done WARNING [1388562] /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/analysis/trajectory.py:296: UserWarning: Warning: converting a masked element to nan. points = np.array([coord.points.flatten()[0]] * trajectory_size) ERROR [1388563] Can not concatenate cubes into a single one: failed to concatenate into a single cube. An unexpected problem prevented concatenation. Expected only a single cube, found 2. ERROR [1388563] Resulting cubes: ERROR [1388563] sea_ice_area_fraction / (%) (time: 360; cell index along second dimension: 384; cell index along first dimension: 360) Dimension coordinates: time x - - cell index along second dimension - x - cell index along first dimension - - x Auxiliary coordinates: latitude - x x longitude - x x Scalar coordinates: area_type sea_ice Cell methods: 0 area: mean where sea 1 time: mean Attributes: Conventions 'CF-1.7 CMIP-6.2' activity_id 'CMIP' branch_method 'Hybrid-restart from year 1200-01-01 of piControl' branch_time 0.0 branch_time_in_child -674885 branch_time_in_parent -236885 cmor_version '3.5.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' data_specs_version '01.00.31' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacello' forcing_index 1 frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.NCC.NorESM2-MM.historical.none.r1 ...' grid 'tripolar grid with 1deg nominal resolution' grid_label 'gn' initialization_index 1 institution 'NorESM Climate modeling Consortium consisting of CICERO (Center for International ...' institution_id 'NCC' license 'CMIP6 model data produced by NCC is licensed under a Creative Commons Attribution ...' mip_era 'CMIP6' model_id 'NorESM2-MM' nominal_resolution '100 km' original_name 'aice' original_units '1' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'NorESM2-MM' parent_sub_experiment_id 'none' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index 1 product 'model-output' realization_index 1 realm 'seaIce' run_variant 'N/A' source 'NorESM2-MM (2017): \naerosol: OsloAero\natmos: CAM-OSLO (1 degree resolution; ...' source_id 'NorESM2-MM' source_type 'AOGCM AER BGC' sub_experiment 'none' sub_experiment_id 'none' table_id 'SImon' table_info 'Creation Date:(24 July 2019) MD5:0bb394a356ef9d214d027f1aca45853e' title 'NorESM2-MM output prepared for CMIP6' variable_id 'siconc' variant_label 'r1i1p1f1' ERROR [1388563] From Cell(point=cftime.DatetimeNoLeap(1980, 1, 16, 12, 0, 0, 0, has_year_zero=True), bound=(cftime.DatetimeNoLeap(1980, 1, 1, 0, 0, 0, 0, has_year_zero=True), cftime.DatetimeNoLeap(1980, 2, 1, 0, 0, 0, 0, has_year_zero=True))) to Cell(point=cftime.DatetimeNoLeap(2009, 12, 16, 12, 0, 0, 0, has_year_zero=True), bound=(cftime.DatetimeNoLeap(2009, 12, 1, 0, 0, 0, 0, has_year_zero=True), cftime.DatetimeNoLeap(2010, 1, 1, 0, 0, 0, 0, has_year_zero=True))) ERROR [1388563] sea_ice_area_fraction / (%) (time: 60; cell index along second dimension: 384; cell index along first dimension: 360) Dimension coordinates: time x - - cell index along second dimension - x - cell index along first dimension - - x Auxiliary coordinates: latitude - x x longitude - x x Scalar coordinates: area_type sea_ice Cell methods: 0 area: mean where sea 1 time: mean Attributes: Conventions 'CF-1.7 CMIP-6.2' activity_id 'CMIP' branch_method 'Hybrid-restart from year 1200-01-01 of piControl' branch_time 0.0 branch_time_in_child -674885 branch_time_in_parent -236885 cmor_version '3.5.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' data_specs_version '01.00.31' experiment 'all-forcing simulation of the recent past' experiment_id 'historical' external_variables 'areacello' forcing_index 1 frequency 'mon' further_info_url 'https://furtherinfo.es-doc.org/CMIP6.NCC.NorESM2-MM.historical.none.r1 ...' grid 'tripolar grid with 1deg nominal resolution' grid_label 'gn' initialization_index 1 institution 'NorESM Climate modeling Consortium consisting of CICERO (Center for International ...' institution_id 'NCC' license 'CMIP6 model data produced by NCC is licensed under a Creative Commons Attribution ...' mip_era 'CMIP6' model_id 'NorESM2-MM' nominal_resolution '100 km' original_name 'aice' original_units '1' parent_activity_id 'CMIP' parent_experiment_id 'piControl' parent_mip_era 'CMIP6' parent_source_id 'NorESM2-MM' parent_sub_experiment_id 'none' parent_time_units 'days since 1850-1-1 00:00:00' parent_variant_label 'r1i1p1f1' physics_index 1 product 'model-output' realization_index 1 realm 'seaIce' run_variant 'N/A' source 'NorESM2-MM (2017): \naerosol: OsloAero\natmos: CAM-OSLO (1 degree resolution; ...' source_id 'NorESM2-MM' source_type 'AOGCM AER BGC' sub_experiment 'none' sub_experiment_id 'none' table_id 'SImon' table_info 'Creation Date:(24 July 2019) MD5:0bb394a356ef9d214d027f1aca45853e' title 'NorESM2-MM output prepared for CMIP6' variable_id 'siconc' variant_label 'r1i1p1f1' ERROR [1388563] From Cell(point=cftime.DatetimeNoLeap(2010, 1, 16, 12, 0, 0, 0, has_year_zero=True), bound=(cftime.DatetimeNoLeap(2010, 1, 1, 0, 0, 0, 0, has_year_zero=True), cftime.DatetimeNoLeap(2010, 2, 1, 0, 0, 0, 0, has_year_zero=True))) to Cell(point=cftime.DatetimeNoLeap(2014, 12, 16, 12, 0, 0, 0, has_year_zero=True), bound=(cftime.DatetimeNoLeap(2014, 12, 1, 0, 0, 0, 0, has_year_zero=True), cftime.DatetimeNoLeap(2015, 1, 1, 0, 0, 0, 0, has_year_zero=True))) ERROR [1388563] Failed to run preprocessor function 'concatenate' on the data [, , , ] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/SImon/siconc/gn/v20191108/siconc_SImon_NorESM2-MM_historical_r1i1p1f1_gn_198001-198912.nc'), LocalFile('/projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/SImon/siconc/gn/v20191108/siconc_SImon_NorESM2-MM_historical_r1i1p1f1_gn_199001-199912.nc'), LocalFile('/projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/SImon/siconc/gn/v20191108/siconc_SImon_NorESM2-MM_historical_r1i1p1f1_gn_200001-200912.nc'), LocalFile('/projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-MM/historical/r1i1p1f1/SImon/siconc/gn/v20191108/siconc_SImon_NorESM2-MM_historical_r1i1p1f1_gn_201001-201412.nc')] with function argument(s) INFO [1388404] Maximum memory used (estimate): 1.2 GB INFO [1388404] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [1388404] Program terminated abnormally, see stack trace below for more information: multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 670, in _run product.apply(step, self.debug) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 470, in apply self.cubes = preprocess(self.cubes, step, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 481, in cubes self._cubes = [ File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 482, in ds._load_with_callback(callback) for ds in self.datasets File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 688, in _load_with_callback cube = self._load(callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 765, in _load result = preprocess( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 375, in preprocess result.append(_run_preproc_function(function, items, settings, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 328, in _run_preproc_function return function(items, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 241, in concatenate result = _by_two_concatenation([result, cube]) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 198, in _by_two_concatenation _get_concatenation_error(concatenated) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 217, in _get_concatenation_error raise ValueError(f'Can not concatenate cubes: {msg}') ValueError: Can not concatenate cubes: failed to concatenate into a single cube. An unexpected problem prevented concatenation. Expected only a single cube, found 2. """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 122, in process_recipe recipe.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1308, in run self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks']) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 724, in run self._run_parallel(max_parallel_tasks) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 767, in _run_parallel _copy_results(task, running[task]) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 790, in _copy_results task.output_files, task.products = future.get() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 774, in get raise self._value File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 670, in _run product.apply(step, self.debug) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 470, in apply self.cubes = preprocess(self.cubes, step, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 481, in cubes self._cubes = [ File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 482, in ds._load_with_callback(callback) for ds in self.datasets File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 688, in _load_with_callback cube = self._load(callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 765, in _load result = preprocess( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 375, in preprocess result.append(_run_preproc_function(function, items, settings, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 328, in _run_preproc_function return function(items, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 241, in concatenate result = _by_two_concatenation([result, cube]) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 198, in _by_two_concatenation _get_concatenation_error(concatenated) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 217, in _get_concatenation_error raise ValueError(f'Can not concatenate cubes: {msg}') ValueError: Can not concatenate cubes: failed to concatenate into a single cube. An unexpected problem prevented concatenation. Expected only a single cube, found 2. INFO [1388404] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.