2023-05-22 14:25:29,669 UTC [362240] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:496 Package versions 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:497 ---------------- 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:501 ---------------- 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:502 Using config file /projects/NS2980K/home/tomast/ESMValTool/rundir_ipcc_node/esmvaltool2.8.0/config-NS9560K.yml 2023-05-22 14:25:29,670 UTC [362240] INFO esmvalcore._main:503 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/main_log_debug.txt 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-05-22 14:25:30 UTC 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:90 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/rundir_ipcc_node/esmvaltool2.8.0/examples/recipe_ncl.yml 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:91 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:92 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/work 2023-05-22 14:25:30,259 UTC [362240] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc 2023-05-22 14:25:30,260 UTC [362240] INFO esmvalcore._main:94 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/plots 2023-05-22 14:25:30,260 UTC [362240] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-05-22 14:25:30,261 UTC [362240] INFO esmvalcore._main:98 Running tasks using at most 8 processes 2023-05-22 14:25:30,261 UTC [362240] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-05-22 14:25:30,261 UTC [362240] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-05-22 14:25:30,262 UTC [362240] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-05-22 14:25:30,275 UTC [362240] INFO esmvalcore._recipe.recipe:999 NCL script detected, checking NCL version 2023-05-22 14:25:30,373 UTC [362240] INFO esmvalcore._recipe.check:41 Found NCL version 6.6.2 2023-05-22 14:25:30,381 UTC [362240] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable ta in diagnostic example 2023-05-22 14:25:30,382 UTC [362240] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ta, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1 2023-05-22 14:25:30,382 UTC [362240] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ta, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1 2023-05-22 14:25:30,382 UTC [362240] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ta, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-22 14:25:30,383 UTC [362240] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ta, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-05-22 14:25:30,383 UTC [362240] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-05-22 14:25:30,383 UTC [362240] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic example 2023-05-22 14:25:30,384 UTC [362240] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-05-22 14:25:30,384 UTC [362240] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic example 2023-05-22 14:25:30,384 UTC [362240] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task example/test_ta 2023-05-22 14:25:30,384 UTC [362240] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task example/ta 2023-05-22 14:25:30,384 UTC [362240] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'preprocessor_1' task for variable 'ta' 2023-05-22 14:25:30,384 UTC [362240] DEBUG esmvalcore.config._config:48 Loading extra facets from /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-05-22 14:25:30,385 UTC [362240] DEBUG esmvalcore.config._config:48 Loading extra facets from /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-05-22 14:25:30,413 UTC [362240] DEBUG esmvalcore.config._config:48 Loading extra facets from /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-05-22 14:25:30,419 UTC [362240] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1*.nc 2023-05-22 14:25:30,423 UTC [362240] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ta of dataset bcc-csm1-1: /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-05-22 14:25:30,423 UTC [362240] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ta, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1, v1 2023-05-22 14:25:30,425 UTC [362240] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1*.nc 2023-05-22 14:25:30,428 UTC [362240] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ta of dataset GFDL-ESM2G: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-05-22 14:25:30,428 UTC [362240] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ta, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1, v20120412 2023-05-22 14:25:30,429 UTC [362240] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-22 14:25:30,432 UTC [362240] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ta of dataset MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-05-22 14:25:30,432 UTC [362240] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ta, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-05-22 14:25:30,433 UTC [362240] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/ta/ta_Amon_CanESM2_historical_r1i1p1*.nc 2023-05-22 14:25:30,435 UTC [362240] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ta of dataset CanESM2: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-22 14:25:30,435 UTC [362240] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ta, Amon, CMIP5, CanESM2, historical, r1i1p1, v20120718 2023-05-22 14:25:30,437 UTC [362240] INFO esmvalcore._recipe.recipe:873 PreprocessingTask example/ta created. 2023-05-22 14:25:30,437 UTC [362240] DEBUG esmvalcore._recipe.recipe:874 PreprocessingTask example/ta will create the files: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:30,438 UTC [362240] DEBUG esmvalcore._recipe.recipe:1091 Linking tasks for diagnostic example script test_ta 2023-05-22 14:25:30,438 UTC [362240] DEBUG esmvalcore._recipe.recipe:1100 Pattern example/ta matches ['example/ta'] 2023-05-22 14:25:30,438 UTC [362240] INFO esmvalcore._recipe.recipe:1281 These tasks will be executed: example/ta, example/test_ta 2023-05-22 14:25:30,439 UTC [362240] DEBUG esmvalcore._main:120 Recipe summary: DiagnosticTask: example/test_ta script: examples/diagnostic.ncl settings: {'auxiliary_data_dir': PosixPath('/projects/NS9252K/share/esmvaltool/auxiliary_data'), 'colormap': 'WhiteBlueGreenYellowRed', 'exit_on_ncl_warning': False, 'log_level': 'info', 'ncdf': 'default', 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/plots/example/test_ta', 'profile_diagnostic': False, 'projection': 'Mollweide', 'realms': ['atmos'], 'recipe': PosixPath('recipe_ncl.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta', 'script': 'test_ta', 'themes': ['phys'], 'version': '2.8.0', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/work/example/test_ta'} ancestors: PreprocessingTask: example/ta order: ['load', 'extract_levels', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'load': {'callback': 'default'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'load': {'callback': 'default'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'load': {'callback': 'default'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] settings: {'extract_levels': {'levels': 85000, 'scheme': 'nearest'}, 'load': {'callback': 'default'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc')}} ancestors: None 2023-05-22 14:25:30,444 UTC [362240] INFO esmvalcore._recipe.recipe:1344 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/recipe_ncl_filled.yml 2023-05-22 14:25:30,444 UTC [362240] INFO esmvalcore._task:746 Running 2 tasks using 2 processes 2023-05-22 14:25:30,478 UTC [362911] INFO esmvalcore._task:259 Starting task example/ta in process [362911] 2023-05-22 14:25:30,573 UTC [362240] INFO esmvalcore._task:778 Progress: 1 tasks running, 1 tasks waiting for ancestors, 0/2 done 2023-05-22 14:25:30,684 UTC [362911] DEBUG esmvalcore.preprocessor:660 Running block ['extract_levels'] 2023-05-22 14:25:30,684 UTC [362911] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:30,685 UTC [362911] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-22 14:25:30,686 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-22 14:25:30,686 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/fixed_files/ta_Amon_CMIP5_GFDL-ESM2G_historical_r1i1p1_v20120412_'), add_unique_suffix = True, preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-05-22 14:25:30,688 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/fixed_files/ta_Amon_CMIP5_GFDL-ESM2G_historical_r1i1p1_v20120412_'), add_unique_suffix = True, preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-05-22 14:25:30,688 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-22 14:25:30,688 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) callback = 'default' 2023-05-22 14:25:30,688 UTC [362911] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc 2023-05-22 14:25:30,739 UTC [362911] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc 2023-05-22 14:25:30,740 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) callback = 'default' 2023-05-22 14:25:30,740 UTC [362911] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-05-22 14:25:30,758 UTC [362911] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc 2023-05-22 14:25:30,758 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-22 14:25:30,767 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [, , , , , , , ] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-05-22 14:25:30,774 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-22 14:25:30,777 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [, ] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) 2023-05-22 14:25:30,781 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-22 14:25:30,782 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:30,784 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-22 14:25:30,785 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-05-22 14:25:30,790 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_data 2023-05-22 14:25:30,791 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'GFDL-ESM2G', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 1, alias = 'GFDL-ESM2G', product = ['output1', 'output2'], institute = ['NOAA-GFDL'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-05-22 14:25:30,791 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_data 2023-05-22 14:25:30,792 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:30,793 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step add_supplementary_variables 2023-05-22 14:25:30,794 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-05-22 14:25:30,794 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step extract_levels 2023-05-22 14:25:30,795 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-05-22 14:25:30,797 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step save 2023-05-22 14:25:30,799 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_199601-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/v20120412/ta/ta_Amon_GFDL-ESM2G_historical_r1i1p1_200101-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-05-22 14:25:30,799 UTC [362911] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_GFDL-ESM2G_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:31,384 UTC [362911] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:31,385 UTC [362911] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-22 14:25:31,385 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-22 14:25:31,385 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/fixed_files/ta_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-05-22 14:25:31,386 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-22 14:25:31,386 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) callback = 'default' 2023-05-22 14:25:31,386 UTC [362911] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-05-22 14:25:31,480 UTC [362911] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc 2023-05-22 14:25:31,480 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-22 14:25:31,481 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-05-22 14:25:31,483 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-22 14:25:31,484 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) 2023-05-22 14:25:31,484 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-22 14:25:31,485 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:31,486 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-22 14:25:31,487 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-05-22 14:25:31,490 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_data 2023-05-22 14:25:31,491 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'MPI-ESM-LR', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 2, alias = 'MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-05-22 14:25:31,491 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_data 2023-05-22 14:25:31,492 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:31,492 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step add_supplementary_variables 2023-05-22 14:25:31,493 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-05-22 14:25:31,493 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step extract_levels 2023-05-22 14:25:31,494 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-05-22 14:25:31,496 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step save 2023-05-22 14:25:31,498 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ta/ta_Amon_MPI-ESM-LR_historical_r1i1p1_200001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-05-22 14:25:31,498 UTC [362911] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:31,758 UTC [362911] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:31,758 UTC [362911] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-22 14:25:31,758 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-22 14:25:31,758 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/fixed_files/ta_Amon_CMIP5_bcc-csm1-1_historical_r1i1p1_v1_'), add_unique_suffix = True, preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-05-22 14:25:31,759 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-22 14:25:31,759 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) callback = 'default' 2023-05-22 14:25:31,759 UTC [362911] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-05-22 14:25:31,789 UTC [362911] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc 2023-05-22 14:25:31,789 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-22 14:25:31,791 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-05-22 14:25:31,797 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-22 14:25:31,798 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) 2023-05-22 14:25:31,798 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-22 14:25:31,799 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:31,804 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-22 14:25:31,805 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) timerange = '2000/2002' 2023-05-22 14:25:31,816 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_data 2023-05-22 14:25:31,817 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'bcc-csm1-1', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 0, alias = 'bcc-csm1-1', product = ['output1', 'output2'], institute = ['BCC'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v1' 2023-05-22 14:25:31,817 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_data 2023-05-22 14:25:31,818 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:31,818 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step add_supplementary_variables 2023-05-22 14:25:31,819 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) supplementary_cubes = [] 2023-05-22 14:25:31,819 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step extract_levels 2023-05-22 14:25:31,820 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-05-22 14:25:31,822 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step save 2023-05-22 14:25:31,823 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/v1/ta/ta_Amon_bcc-csm1-1_historical_r1i1p1_185001-201212.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-05-22 14:25:31,823 UTC [362911] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_bcc-csm1-1_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:32,053 UTC [362911] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:32,053 UTC [362911] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-22 14:25:32,054 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-22 14:25:32,054 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/fixed_files/ta_Amon_CMIP5_CanESM2_historical_r1i1p1_v20120718_'), add_unique_suffix = True, preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-22 14:25:32,054 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-22 14:25:32,054 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) callback = 'default' 2023-05-22 14:25:32,054 UTC [362911] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-22 14:25:32,846 UTC [362911] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-22 14:25:32,846 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-22 14:25:32,848 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-22 14:25:32,854 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-22 14:25:32,855 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) 2023-05-22 14:25:32,855 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-22 14:25:32,856 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:32,861 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-22 14:25:32,862 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-05-22 14:25:32,872 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_data 2023-05-22 14:25:32,873 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , preprocessor = 'preprocessor_1', reference_dataset = 'MPI-ESM-LR', mip = 'Amon', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'ta', timerange = '2000/2002', variable_group = 'ta', diagnostic = 'example', recipe_dataset_index = 3, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'ta', standard_name = 'air_temperature', long_name = 'Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-22 14:25:32,873 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_data 2023-05-22 14:25:32,874 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'ta' 2023-05-22 14:25:32,874 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step add_supplementary_variables 2023-05-22 14:25:32,875 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-05-22 14:25:32,875 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step extract_levels 2023-05-22 14:25:32,876 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'extract_levels' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) levels = 85000, scheme = 'nearest' 2023-05-22 14:25:32,878 UTC [362911] DEBUG esmvalcore.preprocessor:369 Running preprocessor step save 2023-05-22 14:25:32,879 UTC [362911] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/ta/ta_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc') 2023-05-22 14:25:32,879 UTC [362911] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/CMIP5_CanESM2_Amon_historical_r1i1p1_ta_2000-2002.nc 2023-05-22 14:25:33,117 UTC [362911] DEBUG esmvalcore._task:175 Writing NCL configuration file /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/preproc/example/ta/ta_info.ncl 2023-05-22 14:25:33,117 UTC [362911] INFO esmvalcore._task:264 Successfully completed task example/ta (priority 1) in 0:00:02.639223 2023-05-22 14:25:33,177 UTC [362240] INFO esmvalcore._task:778 Progress: 0 tasks running, 1 tasks waiting for ancestors, 1/2 done 2023-05-22 14:25:33,184 UTC [362912] INFO esmvalcore._task:259 Starting task example/test_ta in process [362912] 2023-05-22 14:25:33,188 UTC [362912] DEBUG esmvalcore._task:175 Writing NCL configuration file /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta/settings.ncl 2023-05-22 14:25:33,188 UTC [362912] INFO esmvalcore._task:500 Running command ['/conda/esmvaltool/2.8.0/bin/ncl', '-n', '-p', '/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.ncl'] 2023-05-22 14:25:33,188 UTC [362912] DEBUG esmvalcore._task:501 in environment {'diag_scripts': '/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts', 'settings': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta/settings.ncl')} 2023-05-22 14:25:33,189 UTC [362912] DEBUG esmvalcore._task:503 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta 2023-05-22 14:25:33,189 UTC [362912] INFO esmvalcore._task:504 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/work/example/test_ta 2023-05-22 14:25:33,189 UTC [362912] INFO esmvalcore._task:505 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/plots/example/test_ta 2023-05-22 14:25:33,189 UTC [362912] INFO esmvalcore._task:506 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta/log.txt 2023-05-22 14:25:33,189 UTC [362912] INFO esmvalcore._task:516 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta; diag_scripts="/conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts" settings="/projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta/settings.ncl" /conda/esmvaltool/2.8.0/bin/ncl -n -p /conda/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.ncl 2023-05-22 14:25:33,278 UTC [362240] INFO esmvalcore._task:778 Progress: 1 tasks running, 0 tasks waiting for ancestors, 1/2 done 2023-05-22 14:25:34,192 UTC [362912] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.0 GB 2023-05-22 14:25:34,193 UTC [362912] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-22 14:25:34,193 UTC [362912] DEBUG esmvalcore._task:589 Script examples/diagnostic.ncl completed successfully 2023-05-22 14:25:34,194 UTC [362912] DEBUG esmvalcore._task:608 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/example/test_ta/diagnostic_provenance.yml 2023-05-22 14:25:34,285 UTC [362912] DEBUG PIL.PngImagePlugin:204 STREAM b'IHDR' 16 13 2023-05-22 14:25:34,285 UTC [362912] DEBUG PIL.PngImagePlugin:204 STREAM b'bKGD' 41 6 2023-05-22 14:25:34,285 UTC [362912] DEBUG PIL.PngImagePlugin:754 b'bKGD' 41 6 (unknown) 2023-05-22 14:25:34,285 UTC [362912] DEBUG PIL.PngImagePlugin:204 STREAM b'IDAT' 59 8192 2023-05-22 14:25:34,369 UTC [362912] DEBUG esmvalcore._task:683 Collecting provenance of task example/test_ta took 0.2 seconds 2023-05-22 14:25:34,369 UTC [362912] INFO esmvalcore._task:264 Successfully completed task example/test_ta (priority 0) in 0:00:01.184718 2023-05-22 14:25:34,379 UTC [362240] INFO esmvalcore._task:778 Progress: 0 tasks running, 0 tasks waiting for ancestors, 2/2 done 2023-05-22 14:25:34,380 UTC [362240] INFO esmvalcore._task:783 Successfully completed all tasks. 2023-05-22 14:25:34,409 UTC [362240] INFO esmvalcore._recipe.recipe:1309 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/run/recipe_ncl_filled.yml 2023-05-22 14:25:34,469 UTC [362240] INFO esmvalcore.experimental.recipe_output:205 Wrote recipe output to: file:///projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_ncl_20230522_142529/index.html 2023-05-22 14:25:34,470 UTC [362240] INFO esmvalcore._main:125 Ending the Earth System Model Evaluation Tool at time: 2023-05-22 14:25:34 UTC 2023-05-22 14:25:34,470 UTC [362240] INFO esmvalcore._main:128 Time for running the recipe was: 0:00:04.211059 2023-05-22 14:25:34,696 UTC [362240] INFO esmvalcore._task:126 Maximum memory used (estimate): 1.7 GB 2023-05-22 14:25:34,697 UTC [362240] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-22 14:25:34,697 UTC [362240] INFO esmvalcore._main:473 Removing `preproc` directory containing preprocessed data 2023-05-22 14:25:34,698 UTC [362240] INFO esmvalcore._main:476 If this data is further needed, then set `remove_preproc_dir` to `false` in your user configuration file 2023-05-22 14:25:34,699 UTC [362240] INFO esmvalcore._main:453 Run was successful