2023-07-06 10:15:34,286 UTC [2415115] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-07-06 10:15:34,286 UTC [2415115] INFO esmvalcore._main:496 Package versions 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:497 ---------------- 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:501 ---------------- 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:502 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2023-07-06 10:15:34,287 UTC [2415115] INFO esmvalcore._main:503 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/run/main_log_debug.txt 2023-07-06 10:15:34,472 UTC [2415115] INFO esmvalcore.config._esgf_pyclient:116 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2023-07-06 10:15:34,472 UTC [2415115] WARNING esmvalcore.config._esgf_pyclient:181 ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. 2023-07-06 10:15:34,934 UTC [2415115] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-07-06 10:15:34 UTC 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:90 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/noresmvaltool/esmvaltool/new_recipes/recipe_ocean_arctic_bgc.yml 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:91 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/run 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:92 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/work 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/preproc 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:94 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ocean_arctic_bgc_20230706_101533/plots 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-07-06 10:15:34,935 UTC [2415115] INFO esmvalcore._main:98 Running tasks using at most 256 processes 2023-07-06 10:15:34,936 UTC [2415115] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-07-06 10:15:34,936 UTC [2415115] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-07-06 10:15:34,938 UTC [2415115] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-07-06 10:15:34,976 UTC [2415115] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable o2min in diagnostic diag_ice_NHW_hist 2023-07-06 10:15:34,976 UTC [2415115] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: o2min, Omon, CMIP6, NorESM2-MM, hist-eddy, r1i1p1f1, gr 2023-07-06 10:15:34,977 UTC [2415115] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable o2min in diagnostic diag_ice_NHS_hist 2023-07-06 10:15:34,977 UTC [2415115] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: o2min, Omon, CMIP6, NorESM2-MM, hist-eddy, r1i1p1f1, gr 2023-07-06 10:15:34,977 UTC [2415115] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-07-06 10:15:34,977 UTC [2415115] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic diag_ice_NHW_hist 2023-07-06 10:15:34,977 UTC [2415115] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic diag_ice_NHS_hist 2023-07-06 10:15:34,978 UTC [2415115] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-07-06 10:15:34,978 UTC [2415115] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic diag_ice_NHW_hist 2023-07-06 10:15:34,978 UTC [2415115] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task diag_ice_NHW_hist/Global_seaice_timeseries 2023-07-06 10:15:34,979 UTC [2415115] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diag_ice_NHW_hist/o2min 2023-07-06 10:15:34,979 UTC [2415115] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'timeseries_NHW_ice_extent_hist' task for variable 'o2min' 2023-07-06 10:15:34,980 UTC [2415115] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic diag_ice_NHS_hist 2023-07-06 10:15:34,980 UTC [2415115] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task diag_ice_NHS_hist/Global_seaice_timeseries 2023-07-06 10:15:34,980 UTC [2415115] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diag_ice_NHS_hist/o2min 2023-07-06 10:15:34,980 UTC [2415115] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'timeseries_NHS_ice_extent_hist' task for variable 'o2min' 2023-07-06 10:15:34,981 UTC [2415115] ERROR esmvalcore._recipe.recipe:960 Could not create all tasks 2023-07-06 10:15:34,981 UTC [2415115] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diag_ice_NHW_hist/o2min: - Dataset key 'activity' must be specified for {'exp': 'hist-eddy', 'preprocessor': 'timeseries_NHW_ice_extent_hist', 'mip': 'Omon', 'grid': 'gr', 'dataset': 'NorESM2-MM', 'project': 'CMIP6', 'ensemble': 'r1i1p1f1', 'short_name': 'o2min', 'timerange': '1984/2014', 'variable_group': 'o2min', 'diagnostic': 'diag_ice_NHW_hist', 'recipe_dataset_index': 0, 'alias': 'NorESM2-MM', 'institute': ['NCC'], 'original_short_name': 'o2min', 'standard_name': 'mole_concentration_of_dissolved_molecular_oxygen_in_sea_water_at_shallowest_local_minimum_in_vertical_profile', 'long_name': 'Oxygen Minimum Concentration', 'units': 'mol m-3', 'modeling_realm': ['ocnBgchem'], 'frequency': 'mon'}, check your recipe entry 2023-07-06 10:15:34,981 UTC [2415115] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diag_ice_NHS_hist/o2min: - Dataset key 'activity' must be specified for {'exp': 'hist-eddy', 'preprocessor': 'timeseries_NHS_ice_extent_hist', 'mip': 'Omon', 'grid': 'gr', 'dataset': 'NorESM2-MM', 'project': 'CMIP6', 'ensemble': 'r1i1p1f1', 'short_name': 'o2min', 'timerange': '1984/2014', 'variable_group': 'o2min', 'diagnostic': 'diag_ice_NHS_hist', 'recipe_dataset_index': 0, 'alias': 'NorESM2-MM', 'institute': ['NCC'], 'original_short_name': 'o2min', 'standard_name': 'mole_concentration_of_dissolved_molecular_oxygen_in_sea_water_at_shallowest_local_minimum_in_vertical_profile', 'long_name': 'Oxygen Minimum Concentration', 'units': 'mol m-3', 'modeling_realm': ['ocnBgchem'], 'frequency': 'mon'}, check your recipe entry 2023-07-06 10:15:35,479 UTC [2415115] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.0 GB 2023-07-06 10:15:35,480 UTC [2415115] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-07-06 10:15:35,480 UTC [2415115] ERROR esmvalcore._main:526 Could not create all tasks 2023-07-06 10:15:35,481 UTC [2415115] DEBUG esmvalcore._main:527 Stack trace for debugging: Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 119, in process_recipe recipe = read_recipe_file(recipe_file, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 82, in read_recipe_file return Recipe(raw_recipe, session, recipe_file=filename) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 917, in __init__ self.tasks = self.initialize_tasks() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1279, in initialize_tasks tasks = self._create_tasks() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1267, in _create_tasks raise recipe_error esmvalcore.exceptions.RecipeError: Could not create all tasks