2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:492 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:493 Package versions 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:494 ---------------- 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:495 ESMValCore: 2.10.0 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:497 ESMValTool: 2.10.0 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:498 ---------------- 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:499 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2023-12-27 15:22:46,941 UTC [724258] INFO esmvalcore._main:500 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/main_log_debug.txt 2023-12-27 15:22:47,088 UTC [724258] INFO esmvalcore.config._esgf_pyclient:116 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2023-12-27 15:22:47,089 UTC [724258] WARNING esmvalcore.config._esgf_pyclient:181 ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:91 Starting the Earth System Model Evaluation Tool at time: 2023-12-27 15:22:47 UTC 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:96 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/recipes-2.10.0/standard_recipes/examples/recipe_ncl.yml 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:97 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:98 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/work 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:99 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:100 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/plots 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:101 ---------------------------------------------------------------------- 2023-12-27 15:22:47,854 UTC [724258] INFO esmvalcore._main:104 Running tasks using at most 256 processes 2023-12-27 15:22:47,855 UTC [724258] INFO esmvalcore._main:106 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-12-27 15:22:47,855 UTC [724258] INFO esmvalcore._main:109 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-12-27 15:22:47,855 UTC [724258] WARNING esmvalcore.config._dask:18 Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. 2023-12-27 15:22:47,856 UTC [724258] DEBUG esmvalcore._recipe.check:54 Checking recipe against schema /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-12-27 15:22:47,864 UTC [724258] INFO esmvalcore._recipe.recipe:766 NCL script detected, checking NCL version 2023-12-27 15:22:53,858 UTC [724258] INFO esmvalcore._recipe.check:43 Found NCL version 6.6.2 2023-12-27 15:22:53,862 UTC [724258] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable ta in diagnostic example 2023-12-27 15:22:53,863 UTC [724258] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: ta, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1 2023-12-27 15:22:53,863 UTC [724258] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: ta, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1 2023-12-27 15:22:53,863 UTC [724258] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: ta, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-12-27 15:22:53,863 UTC [724258] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: ta, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-12-27 15:22:53,863 UTC [724258] DEBUG esmvalcore._recipe.recipe:781 Retrieving diagnostics from recipe 2023-12-27 15:22:53,864 UTC [724258] DEBUG esmvalcore._recipe.recipe:809 Setting script for diagnostic example 2023-12-27 15:22:53,864 UTC [724258] INFO esmvalcore._recipe.recipe:999 Creating tasks from recipe 2023-12-27 15:22:53,864 UTC [724258] INFO esmvalcore._recipe.recipe:1008 Creating tasks for diagnostic example 2023-12-27 15:22:53,864 UTC [724258] INFO esmvalcore._recipe.recipe:930 Creating diagnostic task example/test_ta 2023-12-27 15:22:53,865 UTC [724258] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task example/ta 2023-12-27 15:22:53,865 UTC [724258] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'preprocessor_1' task for variable 'ta' 2023-12-27 15:22:53,865 UTC [724258] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-12-27 15:22:53,866 UTC [724258] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-12-27 15:22:53,881 UTC [724258] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-12-27 15:22:53,889 UTC [724258] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc 2023-12-27 15:22:53,891 UTC [724258] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable ta of dataset bcc-csm1-1: /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-12-27 15:22:53,891 UTC [724258] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: ta, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 2023-12-27 15:22:53,892 UTC [724258] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc 2023-12-27 15:22:54,156 UTC [724258] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable ta of dataset GFDL-ESM2G: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-12-27 15:22:54,156 UTC [724258] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: ta, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1, v20120412 2023-12-27 15:22:54,157 UTC [724258] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-27 15:22:54,604 UTC [724258] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable ta of dataset MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-12-27 15:22:54,604 UTC [724258] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: ta, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-12-27 15:22:54,605 UTC [724258] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc 2023-12-27 15:22:54,607 UTC [724258] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable ta of dataset CanESM2: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-12-27 15:22:54,607 UTC [724258] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: ta, Amon, CMIP5, CanESM2, historical, r1i1p1, v20120718 2023-12-27 15:22:54,608 UTC [724258] INFO esmvalcore._recipe.recipe:677 PreprocessingTask example/ta created. 2023-12-27 15:22:54,608 UTC [724258] DEBUG esmvalcore._recipe.recipe:678 PreprocessingTask example/ta will create the files: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:22:54,609 UTC [724258] DEBUG esmvalcore._recipe.recipe:858 Linking tasks for diagnostic example script test_ta 2023-12-27 15:22:54,609 UTC [724258] DEBUG esmvalcore._recipe.recipe:867 Pattern example/ta matches ['example/ta'] 2023-12-27 15:22:54,609 UTC [724258] INFO esmvalcore._recipe.recipe:1048 These tasks will be executed: example/test_ta, example/ta 2023-12-27 15:22:54,610 UTC [724258] DEBUG esmvalcore._main:128 Recipe summary: DiagnosticTask: example/test_ta script: examples/diagnostic.ncl settings: {'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'colormap': 'WhiteBlueGreenYellowRed', 'exit_on_ncl_warning': False, 'log_level': 'info', 'ncdf': 'default', 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/plots/example/test_ta', 'profile_diagnostic': False, 'projection': 'Mollweide', 'realms': ['atmos'], 'recipe': PosixPath('recipe_ncl.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta', 'script': 'test_ta', 'themes': ['phys'], 'version': '2.10.0', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/work/example/test_ta'} ancestors: PreprocessingTask: example/ta order: ['extract_levels', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc')}} ancestors: None 2023-12-27 15:22:54,615 UTC [724258] INFO esmvalcore._recipe.recipe:1111 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/recipe_ncl_filled.yml 2023-12-27 15:22:54,615 UTC [724258] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-27 15:22:54,615 UTC [724258] INFO esmvalcore.config._dask:70 Using the Dask basic scheduler. 2023-12-27 15:22:54,616 UTC [724258] INFO esmvalcore._task:760 Running 2 tasks using 2 processes 2023-12-27 15:22:54,639 UTC [724693] INFO esmvalcore._task:261 Starting task example/ta in process [724693] 2023-12-27 15:22:54,736 UTC [724258] INFO esmvalcore._task:793 Progress: 1 tasks running, 1 tasks waiting for ancestors, 0/2 done 2023-12-27 15:23:04,837 UTC [724693] DEBUG esmvalcore.preprocessor:651 Running block ['extract_levels'] 2023-12-27 15:23:04,837 UTC [724693] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:23:04,838 UTC [724693] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-27 15:23:04,838 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-27 15:23:04,839 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/fixed_files/ta_Amon_CMIP5_bcc-csm1-1_historical_r1i1p1_v1_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-12-27 15:23:04,842 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-27 15:23:04,843 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) ignore_warnings = None 2023-12-27 15:23:04,843 UTC [724693] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-12-27 15:24:33,489 UTC [724693] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-12-27 15:24:33,489 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-27 15:24:33,493 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-12-27 15:24:33,494 UTC [724693] DEBUG esmvalcore.cmor._fixes.fix:399 Aligned plev points with CMOR points (for file /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc) 2023-12-27 15:24:33,499 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-27 15:24:33,501 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = 2023-12-27 15:24:33,501 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-27 15:24:33,501 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:33,505 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-27 15:24:33,506 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) timerange = '2000/2002' 2023-12-27 15:24:33,514 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-27 15:24:33,515 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-12-27 15:24:33,516 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-27 15:24:33,516 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:33,517 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-27 15:24:33,517 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) supplementary_cubes = [] 2023-12-27 15:24:33,517 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step extract_levels 2023-12-27 15:24:33,518 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-12-27 15:24:33,520 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-27 15:24:33,521 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-12-27 15:24:33,521 UTC [724693] DEBUG esmvalcore.preprocessor._io:452 Saving cube: air_temperature / (K) (time: 36; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: air_pressure 85000.0 Pa Cell methods: 0 time: mean (interval: 20 mintues) Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_bcc-csm1-1_historical_r0i0p0.nc ...' branch_time 470.0 cmor_version '2.5.6' contact 'Dr. Tongwen Wu (twwu@cma.gov.cn)' experiment 'historical' experiment_id 'historical' forcing 'Nat Ant GHG SD Oz Sl Vl SS Ds BC OC' frequency 'mon' initialization_method 1 institute_id 'BCC' institution 'Beijing Climate Center(BCC),China Meteorological Administration,China' model_id 'bcc-csm1-1' modeling_realm 'atmos' original_name 'T' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'bcc-csm1-1:atmosphere: BCC_AGCM2.1 (T42L26); land: BCC_AVIM1.0;ocean: ...' table_id 'Table Amon (11 April 2011) 1cfdc7322cf2f4a32614826fab42c1ab' title 'bcc-csm1-1 model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:34,323 UTC [724693] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:34,324 UTC [724693] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-27 15:24:34,324 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-27 15:24:34,325 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/fixed_files/ta_Amon_CMIP5_GFDL-ESM2G_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-27 15:24:42,926 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/fixed_files/ta_Amon_CMIP5_GFDL-ESM2G_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-27 15:24:42,926 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-27 15:24:42,926 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-27 15:24:42,926 UTC [724693] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc 2023-12-27 15:24:45,671 UTC [724693] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc 2023-12-27 15:24:45,671 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-27 15:24:45,672 UTC [724693] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-12-27 15:24:50,411 UTC [724693] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-12-27 15:24:50,411 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-27 15:24:50,417 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [, , , , , , , ] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-27 15:24:50,418 UTC [724693] DEBUG esmvalcore.cmor._fixes.fix:399 Aligned plev points with CMOR points (for file /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc) 2023-12-27 15:24:50,421 UTC [724693] DEBUG esmvalcore.cmor._fixes.fix:399 Aligned plev points with CMOR points (for file /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc) 2023-12-27 15:24:50,423 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-27 15:24:50,426 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [, ] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = 2023-12-27 15:24:50,427 UTC [724693] DEBUG esmvalcore.preprocessor._io:260 Using air_temperature / (K) (time: 60; air_pressure: 17; latitude: 90; longitude: 144) Dimension coordinates: time x - - - air_pressure - x - - latitude - - x - longitude - - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation areacella: area ...' branch_time '58765' contact 'gfdl.climate.model.info@noaa.gov' experiment 'historical' experiment_id 'historical' forcing 'GHG,SD,Oz,LU,Sl,Vl,SS,BC,MD,OC (GHG includes CO2, CH4, N2O, CFC11, CFC12, ...' frequency 'mon' gfdl_experiment_name 'ESM2G-C2_all_historical_HC2' initialization_method 1 institute_id 'NOAA GFDL' institution 'NOAA GFDL(201 Forrestal Rd, Princeton, NJ, 08540)' model_id 'GFDL-ESM2G' modeling_realm 'atmos' original_name 'temp' original_units 'K' parent_experiment_id 'historicalMisc' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output1' project_id 'CMIP5' realization 1 references "The GFDL Data Portal (http://nomads.gfdl.noaa.gov/) provides access to ..." source 'GFDL-ESM2G 2010 ocean: TOPAZ (TOPAZ1p2,Tripolar360x210L63); atmosphere: ...' table_id 'Table Amon (31 Jan 2011)' title 'NOAA GFDL GFDL-ESM2G, historical (run 1) experiment output for CMIP5 A ...' valid_range array([100., 350.], dtype=float32) 2023-12-27 15:24:50,428 UTC [724693] DEBUG esmvalcore.preprocessor._io:294 Using air_temperature / (K) (time: 60; air_pressure: 17; latitude: 90; longitude: 144) Dimension coordinates: time x - - - air_pressure - x - - latitude - - x - longitude - - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation areacella: area ...' branch_time '58765' contact 'gfdl.climate.model.info@noaa.gov' experiment 'historical' experiment_id 'historical' forcing 'GHG,SD,Oz,LU,Sl,Vl,SS,BC,MD,OC (GHG includes CO2, CH4, N2O, CFC11, CFC12, ...' frequency 'mon' gfdl_experiment_name 'ESM2G-C2_all_historical_HC2' initialization_method 1 institute_id 'NOAA GFDL' institution 'NOAA GFDL(201 Forrestal Rd, Princeton, NJ, 08540)' model_id 'GFDL-ESM2G' modeling_realm 'atmos' original_name 'temp' original_units 'K' parent_experiment_id 'historicalMisc' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output1' project_id 'CMIP5' realization 1 references "The GFDL Data Portal (http://nomads.gfdl.noaa.gov/) provides access to ..." source 'GFDL-ESM2G 2010 ocean: TOPAZ (TOPAZ1p2,Tripolar360x210L63); atmosphere: ...' table_id 'Table Amon (31 Jan 2011)' title 'NOAA GFDL GFDL-ESM2G, historical (run 1) experiment output for CMIP5 A ...' valid_range array([100., 350.], dtype=float32) 2023-12-27 15:24:50,432 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-27 15:24:50,433 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:50,434 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-27 15:24:50,435 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-12-27 15:24:50,437 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-27 15:24:50,438 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-27 15:24:50,438 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-27 15:24:50,439 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:50,439 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-27 15:24:50,440 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-27 15:24:50,440 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step extract_levels 2023-12-27 15:24:50,441 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-12-27 15:24:50,442 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-27 15:24:50,444 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-12-27 15:24:50,444 UTC [724693] DEBUG esmvalcore.preprocessor._io:452 Saving cube: air_temperature / (K) (time: 36; latitude: 90; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: air_pressure 85000.0 Pa Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation areacella: area ...' branch_time '58765' contact 'gfdl.climate.model.info@noaa.gov' experiment 'historical' experiment_id 'historical' forcing 'GHG,SD,Oz,LU,Sl,Vl,SS,BC,MD,OC (GHG includes CO2, CH4, N2O, CFC11, CFC12, ...' frequency 'mon' gfdl_experiment_name 'ESM2G-C2_all_historical_HC2' initialization_method 1 institute_id 'NOAA GFDL' institution 'NOAA GFDL(201 Forrestal Rd, Princeton, NJ, 08540)' model_id 'GFDL-ESM2G' modeling_realm 'atmos' original_name 'temp' original_units 'K' parent_experiment_id 'historicalMisc' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output1' project_id 'CMIP5' realization 1 references "The GFDL Data Portal (http://nomads.gfdl.noaa.gov/) provides access to ..." source 'GFDL-ESM2G 2010 ocean: TOPAZ (TOPAZ1p2,Tripolar360x210L63); atmosphere: ...' table_id 'Table Amon (31 Jan 2011)' title 'NOAA GFDL GFDL-ESM2G, historical (run 1) experiment output for CMIP5 A ...' valid_range array([100., 350.], dtype=float32) with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:50,812 UTC [724693] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:50,812 UTC [724693] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-27 15:24:50,813 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-27 15:24:50,813 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/fixed_files/ta_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-27 15:24:51,587 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-27 15:24:51,587 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-27 15:24:51,587 UTC [724693] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-12-27 15:24:59,407 UTC [724693] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-12-27 15:24:59,407 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-27 15:24:59,408 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-27 15:24:59,410 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-27 15:24:59,411 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = 2023-12-27 15:24:59,411 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-27 15:24:59,412 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:59,412 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-27 15:24:59,413 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-12-27 15:24:59,573 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-27 15:24:59,574 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-27 15:24:59,575 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-27 15:24:59,575 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:24:59,576 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-27 15:24:59,576 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-27 15:24:59,576 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step extract_levels 2023-12-27 15:24:59,577 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-12-27 15:24:59,579 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-27 15:24:59,581 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-12-27 15:24:59,581 UTC [724693] DEBUG esmvalcore.preprocessor._io:452 Saving cube: air_temperature / (K) (time: 36; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: air_pressure 85000.0 Pa Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:59,844 UTC [724693] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:24:59,844 UTC [724693] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-27 15:24:59,844 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-27 15:24:59,845 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/fixed_files/ta_Amon_CMIP5_CanESM2_historical_r1i1p1_v20120718_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-12-27 15:24:59,845 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-27 15:24:59,845 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-27 15:24:59,845 UTC [724693] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-12-27 15:27:05,083 UTC [724693] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-12-27 15:27:05,083 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-27 15:27:05,085 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-12-27 15:27:05,090 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-27 15:27:05,091 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-27 15:27:05,091 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-27 15:27:05,092 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:27:05,097 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-27 15:27:05,098 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-12-27 15:27:05,105 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-27 15:27:05,107 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': True}), preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-12-27 15:27:05,107 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-27 15:27:05,108 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-12-27 15:27:05,108 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-27 15:27:05,108 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-27 15:27:05,109 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step extract_levels 2023-12-27 15:27:05,109 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-12-27 15:27:05,111 UTC [724693] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-27 15:27:05,112 UTC [724693] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-12-27 15:27:05,112 UTC [724693] DEBUG esmvalcore.preprocessor._io:452 Saving cube: air_temperature / (K) (time: 36; latitude: 64; longitude: 128) Dimension coordinates: time x - - latitude - x - longitude - - x Scalar coordinates: air_pressure 85000.0 Pa Cell methods: 0 time: mean (interval: 15 minutes) Attributes: CCCma_data_licence '1) GRANT OF LICENCE - The Government of Canada (Environment Canada) is ...' CCCma_parent_runid 'IGA' CCCma_runid 'IGM' Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_CanESM2_historical_r0i0p0.nc ...' branch_time 171915.0 branch_time_YMDH '2321:01:01:00' cmor_version '2.5.4' contact 'cccma_info@ec.gc.ca' experiment 'historical' experiment_id 'historical' forcing 'GHG,Oz,SA,BC,OC,LU,Sl,Vl (GHG includes CO2,CH4,N2O,CFC11,effective CFC ...' frequency 'mon' initialization_method 1 institute_id 'CCCma' institution 'CCCma (Canadian Centre for Climate Modelling and Analysis, Victoria, BC, ...' model_id 'CanESM2' modeling_realm 'atmos' original_name 'T' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'http://www.cccma.ec.gc.ca/models' source 'CanESM2 2010 atmosphere: CanAM4 (AGCM15i, T63L35) ocean: CanOM4 (OGCM4.0, ...' table_id 'Table Amon (31 January 2011) 53b766a395ac41696af40aab76a49ae5' title 'CanESM2 model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-12-27 15:27:19,551 UTC [724693] DEBUG esmvalcore._task:177 Writing NCL configuration file /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/preproc/example/ta/ta_info.ncl 2023-12-27 15:27:19,552 UTC [724693] INFO esmvalcore._task:266 Successfully completed task example/ta (priority 1) in 0:04:24.913091 2023-12-27 15:27:19,565 UTC [724258] INFO esmvalcore._task:793 Progress: 0 tasks running, 1 tasks waiting for ancestors, 1/2 done 2023-12-27 15:27:19,571 UTC [724694] INFO esmvalcore._task:261 Starting task example/test_ta in process [724694] 2023-12-27 15:27:19,574 UTC [724694] DEBUG esmvalcore._task:177 Writing NCL configuration file /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta/settings.ncl 2023-12-27 15:27:19,575 UTC [724694] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.10.0/bin/ncl', '-n', '-p', '/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.ncl'] 2023-12-27 15:27:19,575 UTC [724694] DEBUG esmvalcore._task:503 in environment {'diag_scripts': '/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts', 'settings': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta/settings.ncl')} 2023-12-27 15:27:19,575 UTC [724694] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta 2023-12-27 15:27:19,575 UTC [724694] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/work/example/test_ta 2023-12-27 15:27:19,575 UTC [724694] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/plots/example/test_ta 2023-12-27 15:27:19,575 UTC [724694] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta/log.txt 2023-12-27 15:27:19,575 UTC [724694] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta; diag_scripts="/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts" settings="/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta/settings.ncl" /projects/NS2980K/conda/esmvaltool2.10.0/bin/ncl -n -p /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/examples/diagnostic.ncl 2023-12-27 15:27:19,666 UTC [724258] INFO esmvalcore._task:793 Progress: 1 tasks running, 0 tasks waiting for ancestors, 1/2 done 2023-12-27 15:27:50,633 UTC [724694] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.2 GB 2023-12-27 15:27:50,634 UTC [724694] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-27 15:27:50,635 UTC [724694] DEBUG esmvalcore._task:591 Script examples/diagnostic.ncl completed successfully 2023-12-27 15:27:50,635 UTC [724694] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/example/test_ta/diagnostic_provenance.yml 2023-12-27 15:27:50,710 UTC [724694] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-27 15:27:50,710 UTC [724694] DEBUG PIL.PngImagePlugin:190 STREAM b'bKGD' 41 6 2023-12-27 15:27:50,710 UTC [724694] DEBUG PIL.PngImagePlugin:726 b'bKGD' 41 6 (unknown) 2023-12-27 15:27:50,710 UTC [724694] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 59 8192 2023-12-27 15:27:50,739 UTC [724694] DEBUG esmvalcore._task:685 Collecting provenance of task example/test_ta took 0.1 seconds 2023-12-27 15:27:50,739 UTC [724694] INFO esmvalcore._task:266 Successfully completed task example/test_ta (priority 0) in 0:00:31.167922 2023-12-27 15:27:50,787 UTC [724258] INFO esmvalcore._task:793 Progress: 0 tasks running, 0 tasks waiting for ancestors, 2/2 done 2023-12-27 15:27:50,787 UTC [724258] INFO esmvalcore._task:798 Successfully completed all tasks. 2023-12-27 15:27:50,809 UTC [724258] INFO esmvalcore._recipe.recipe:1076 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/run/recipe_ncl_filled.yml 2023-12-27 15:27:50,866 UTC [724258] INFO esmvalcore.experimental.recipe_output:244 Wrote recipe output to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_ncl_20231227_152246/index.html 2023-12-27 15:27:50,866 UTC [724258] INFO esmvalcore._main:133 Ending the Earth System Model Evaluation Tool at time: 2023-12-27 15:27:50 UTC 2023-12-27 15:27:50,866 UTC [724258] INFO esmvalcore._main:136 Time for running the recipe was: 0:05:03.012072 2023-12-27 15:27:51,346 UTC [724258] INFO esmvalcore._task:128 Maximum memory used (estimate): 1.3 GB 2023-12-27 15:27:51,347 UTC [724258] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-27 15:27:51,347 UTC [724258] INFO esmvalcore._main:470 Removing `preproc` directory containing preprocessed data 2023-12-27 15:27:51,347 UTC [724258] INFO esmvalcore._main:473 If this data is further needed, then set `remove_preproc_dir` to `false` in your user configuration file 2023-12-27 15:27:51,515 UTC [724258] INFO esmvalcore._main:450 Run was successful