2023-12-28 00:00:28,981 UTC [935055] INFO esmvalcore._main:492 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-12-28 00:00:28,981 UTC [935055] INFO esmvalcore._main:493 Package versions 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:494 ---------------- 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:495 ESMValCore: 2.10.0 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:497 ESMValTool: 2.10.0 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:498 ---------------- 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:499 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2023-12-28 00:00:28,982 UTC [935055] INFO esmvalcore._main:500 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/main_log_debug.txt 2023-12-28 00:00:29,133 UTC [935055] INFO esmvalcore.config._esgf_pyclient:116 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2023-12-28 00:00:29,133 UTC [935055] WARNING esmvalcore.config._esgf_pyclient:181 ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. 2023-12-28 00:00:29,557 UTC [935055] INFO esmvalcore._main:91 Starting the Earth System Model Evaluation Tool at time: 2023-12-28 00:00:29 UTC 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:96 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/recipes-2.10.0/standard_recipes/atmosphere/recipe_validation.yml 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:97 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:98 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:99 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:100 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:101 ---------------------------------------------------------------------- 2023-12-28 00:00:29,558 UTC [935055] INFO esmvalcore._main:104 Running tasks using at most 256 processes 2023-12-28 00:00:29,559 UTC [935055] INFO esmvalcore._main:106 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-12-28 00:00:29,559 UTC [935055] INFO esmvalcore._main:109 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-12-28 00:00:29,559 UTC [935055] WARNING esmvalcore.config._dask:18 Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. 2023-12-28 00:00:29,652 UTC [935055] DEBUG esmvalcore._recipe.check:54 Checking recipe against schema /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-12-28 00:00:29,668 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable rtnt in diagnostic validation_with_CERES-EBAF 2023-12-28 00:00:29,669 UTC [935055] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-12-28 00:00:29,669 UTC [935055] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-12-28 00:00:29,685 UTC [935055] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-12-28 00:00:29,689 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:00:29,690 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2023-12-28 00:00:29,690 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:00:29,690 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:00:29,690 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:00:29,691 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:00:29,691 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:00:29,694 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:00:29,694 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:00:29,713 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-28 00:00:29,714 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-28 00:00:29,888 UTC [935055] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=rtnt HTTP/1.1" 200 1232 2023-12-28 00:00:29,888 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-28 00:00:30,784 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:00:30,786 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2023-12-28 00:00:30,786 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:00:30,786 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rtnt, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-12-28 00:00:30,787 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:00:33,675 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2023-12-28 00:00:33,675 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:00:33,675 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:00:33,675 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:00:33,676 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:00:33,676 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:00:33,678 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:00:33,678 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:00:47,292 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2023-12-28 00:00:49,180 UTC [935055] DEBUG requests_cache.session:253 Stale response; attempting to re-send request 2023-12-28 00:00:49,181 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-28 00:00:49,343 UTC [935055] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=NorESM1-M&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NCC&cmor_table=Amon&product=output1%2Coutput2&variable=rtnt HTTP/1.1" 200 1229 2023-12-28 00:00:49,344 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-28 00:01:10,108 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:10,110 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2023-12-28 00:01:10,110 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:01:10,110 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rtnt, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2023-12-28 00:01:10,111 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2023-12-28 00:01:10,317 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'} 2023-12-28 00:01:10,317 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:10,317 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:10,317 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:10,318 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:10,318 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:10,319 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:10,319 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:10,320 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2023-12-28 00:01:10,320 UTC [935055] DEBUG requests_cache.session:253 Stale response; attempting to re-send request 2023-12-28 00:01:10,320 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-28 00:01:10,479 UTC [935055] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=obs4MIPs&source_id=CERES-EBAF&time_frequency=mon&variable=rtnt HTTP/1.1" 200 1055 2023-12-28 00:01:10,480 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-28 00:01:11,373 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:11,375 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'}: none 2023-12-28 00:01:11,375 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:01:11,375 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rtnt, Amon, obs4MIPs, CERES-EBAF, v20160610 2023-12-28 00:01:11,375 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable rsut in diagnostic validation_with_CERES-EBAF 2023-12-28 00:01:11,375 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rsut, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-12-28 00:01:11,376 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rsut, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2023-12-28 00:01:11,376 UTC [935055] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: rsut, Amon, obs4MIPs, CERES-EBAF, v20160610 2023-12-28 00:01:11,376 UTC [935055] DEBUG esmvalcore._recipe.recipe:781 Retrieving diagnostics from recipe 2023-12-28 00:01:11,376 UTC [935055] DEBUG esmvalcore._recipe.recipe:809 Setting script for diagnostic validation_with_CERES-EBAF 2023-12-28 00:01:11,377 UTC [935055] INFO esmvalcore._recipe.recipe:999 Creating tasks from recipe 2023-12-28 00:01:11,377 UTC [935055] INFO esmvalcore._recipe.recipe:1008 Creating tasks for diagnostic validation_with_CERES-EBAF 2023-12-28 00:01:11,377 UTC [935055] INFO esmvalcore._recipe.recipe:930 Creating diagnostic task validation_with_CERES-EBAF/lat_lon 2023-12-28 00:01:11,377 UTC [935055] INFO esmvalcore._recipe.recipe:930 Creating diagnostic task validation_with_CERES-EBAF/zonal_mean 2023-12-28 00:01:11,377 UTC [935055] INFO esmvalcore._recipe.recipe:930 Creating diagnostic task validation_with_CERES-EBAF/meridional_mean 2023-12-28 00:01:11,378 UTC [935055] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task validation_with_CERES-EBAF/rtnt 2023-12-28 00:01:11,378 UTC [935055] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'pp_rad_derive_var' task for variable 'rtnt' 2023-12-28 00:01:11,378 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:11,379 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2023-12-28 00:01:11,379 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:11,379 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:11,379 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:11,379 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:11,380 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:11,381 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:11,381 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:11,382 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400) 2023-12-28 00:01:11,382 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:11,382 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2023-12-28 00:01:11,382 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:01:11,382 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:11,383 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:11,384 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rsdt'} 2023-12-28 00:01:11,384 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:11,384 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:11,384 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:11,384 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:11,384 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:11,386 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:11,386 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:11,386 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-28 00:01:11,386 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-28 00:01:11,565 UTC [935055] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=rsdt HTTP/1.1" 200 None 2023-12-28 00:01:11,599 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-28 00:01:11,882 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:11,885 UTC [935055] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'atmos' for cmip5.output1.MPI-M.MPI-ESM-LR.historical.mon.atmos.Amon.r1i1p1.v20120315.rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,885 UTC [935055] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120315' for cmip5.output1.MPI-M.MPI-ESM-LR.historical.mon.atmos.Amon.r1i1p1.v20120315.rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,885 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rsdt'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-28 00:01:11,886 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-28 00:01:11,886 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:11,890 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:11,896 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsdt of dataset CMIP5 MPI-ESM-LR: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc (will be downloaded) 2023-12-28 00:01:11,896 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,896 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rlut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,896 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rtnt, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-12-28 00:01:11,896 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:11,897 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2023-12-28 00:01:11,897 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:11,897 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:11,897 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:11,898 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:11,898 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:11,899 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:11,899 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:11,900 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400) 2023-12-28 00:01:11,900 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:11,900 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2023-12-28 00:01:11,900 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:01:11,901 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:11,901 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:11,906 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:11,910 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:11,914 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsdt of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,914 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,914 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rlut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:11,914 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rtnt, Amon, CMIP5, NorESM1-M, historical, r1i1p1, v20120412 2023-12-28 00:01:11,914 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2023-12-28 00:01:11,915 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'} 2023-12-28 00:01:11,915 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:11,915 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:11,915 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:11,915 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:11,915 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:11,917 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:11,917 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:11,917 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400) 2023-12-28 00:01:11,917 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:11,918 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'}: none 2023-12-28 00:01:11,918 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: 2023-12-28 00:01:11,918 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2023-12-28 00:01:11,918 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsdt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsdt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsdt_*.nc 2023-12-28 00:01:11,919 UTC [935055] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rsdt'} 2023-12-28 00:01:11,919 UTC [935055] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-28 00:01:11,919 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-28 00:01:11,919 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-28 00:01:11,919 UTC [935055] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-28 00:01:11,919 UTC [935055] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-28 00:01:11,921 UTC [935055] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-28 00:01:11,921 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-28 00:01:11,921 UTC [935055] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2023-12-28 00:01:11,921 UTC [935055] DEBUG requests_cache.session:253 Stale response; attempting to re-send request 2023-12-28 00:01:11,922 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-28 00:01:12,070 UTC [935055] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=obs4MIPs&source_id=CERES-EBAF&time_frequency=mon&variable=rsdt HTTP/1.1" 200 2986 2023-12-28 00:01:12,071 UTC [935055] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-28 00:01:12,121 UTC [935055] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-28 00:01:12,123 UTC [935055] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'atmos' for obs4MIPs.CERES-EBAF.v20160610.rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:12,123 UTC [935055] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20160610' for obs4MIPs.CERES-EBAF.v20160610.rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:12,123 UTC [935055] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rsdt'}: ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] 2023-12-28 00:01:12,123 UTC [935055] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] 2023-12-28 00:01:12,123 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc 2023-12-28 00:01:12,124 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rlut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rlut_*.nc 2023-12-28 00:01:12,124 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsdt of dataset obs4MIPs: /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc (will be downloaded) 2023-12-28 00:01:12,125 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:12,125 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rlut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:12,125 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rtnt, Amon, obs4MIPs, CERES-EBAF, v20160610 2023-12-28 00:01:12,127 UTC [935055] INFO esmvalcore._recipe.recipe:677 PreprocessingTask validation_with_CERES-EBAF/rtnt created. 2023-12-28 00:01:12,127 UTC [935055] DEBUG esmvalcore._recipe.recipe:678 PreprocessingTask validation_with_CERES-EBAF/rtnt will create the files: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2023-12-28 00:01:12,127 UTC [935055] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task validation_with_CERES-EBAF/rsut 2023-12-28 00:01:12,127 UTC [935055] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'pp_rad' task for variable 'rsut' 2023-12-28 00:01:12,127 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-12-28 00:01:12,128 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:12,128 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rsut, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-12-28 00:01:12,129 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc 2023-12-28 00:01:12,130 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:12,130 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rsut, Amon, CMIP5, NorESM1-M, historical, r1i1p1, v20120412 2023-12-28 00:01:12,130 UTC [935055] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc 2023-12-28 00:01:12,131 UTC [935055] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable rsut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:12,131 UTC [935055] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: rsut, Amon, obs4MIPs, CERES-EBAF, v20160610 2023-12-28 00:01:12,132 UTC [935055] INFO esmvalcore._recipe.recipe:677 PreprocessingTask validation_with_CERES-EBAF/rsut created. 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:678 PreprocessingTask validation_with_CERES-EBAF/rsut will create the files: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:858 Linking tasks for diagnostic validation_with_CERES-EBAF script lat_lon 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:858 Linking tasks for diagnostic validation_with_CERES-EBAF script zonal_mean 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:858 Linking tasks for diagnostic validation_with_CERES-EBAF script meridional_mean 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2023-12-28 00:01:12,132 UTC [935055] DEBUG esmvalcore._recipe.recipe:867 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2023-12-28 00:01:12,132 UTC [935055] INFO esmvalcore._recipe.recipe:1048 These tasks will be executed: validation_with_CERES-EBAF/rtnt, validation_with_CERES-EBAF/meridional_mean, validation_with_CERES-EBAF/lat_lon, validation_with_CERES-EBAF/zonal_mean, validation_with_CERES-EBAF/rsut 2023-12-28 00:01:12,134 UTC [935055] DEBUG esmvalcore._main:128 Recipe summary: DiagnosticTask: validation_with_CERES-EBAF/meridional_mean script: validation.py settings: {'analysis_type': 'meridional_mean', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/meridional_mean', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean', 'save_cubes': True, 'script': 'meridional_mean', 'seasonal_analysis': True, 'title': '', 'version': '2.10.0', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/meridional_mean'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} ancestors: None DiagnosticTask: validation_with_CERES-EBAF/zonal_mean script: validation.py settings: {'analysis_type': 'zonal_mean', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/zonal_mean', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean', 'save_cubes': True, 'script': 'zonal_mean', 'seasonal_analysis': True, 'title': '', 'version': '2.10.0', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/zonal_mean'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} ancestors: None DiagnosticTask: validation_with_CERES-EBAF/lat_lon script: validation.py settings: {'analysis_type': 'lat_lon', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/lat_lon', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon', 'save_cubes': True, 'script': 'lat_lon', 'seasonal_analysis': False, 'title': '', 'version': '2.10.0', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/lat_lon'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} ancestors: None 2023-12-28 00:01:12,141 UTC [935055] INFO esmvalcore._recipe.recipe:1111 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/recipe_validation_filled.yml 2023-12-28 00:01:12,141 UTC [935055] INFO esmvalcore.esgf._download:540 Will download 182.17 MB Will download the following files: 138.08 MB ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 44.09 MB ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] Downloading 182.17 MB.. 2023-12-28 00:01:12,161 UTC [935055] DEBUG esmvalcore.esgf._download:461 Downloading http://aims3.llnl.gov/thredds/fileServer/cmip5_css02_data/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/rsdt/1/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc to /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc.mfxotg9x 2023-12-28 00:01:12,161 UTC [935055] DEBUG esmvalcore.esgf._download:461 Downloading https://dpesgf03.nccs.nasa.gov/thredds/fileServer/obs4MIPs/NASA-LaRC/observations/atmos/rsdt/mon/grid/NASA-LaRC/CERES-EBAF/v20140728/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc to /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc.j7naaric 2023-12-28 00:01:12,162 UTC [935055] DEBUG urllib3.connectionpool:244 Starting new HTTP connection (1): aims3.llnl.gov:80 2023-12-28 00:01:12,163 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): dpesgf03.nccs.nasa.gov:443 2023-12-28 00:01:12,846 UTC [935055] DEBUG urllib3.connectionpool:546 http://aims3.llnl.gov:80 "GET /thredds/fileServer/cmip5_css02_data/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/rsdt/1/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc HTTP/1.1" 301 17 2023-12-28 00:01:12,847 UTC [935055] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): aims3.llnl.gov:443 2023-12-28 00:01:13,213 UTC [935055] DEBUG urllib3.connectionpool:546 https://dpesgf03.nccs.nasa.gov:443 "GET /thredds/fileServer/obs4MIPs/NASA-LaRC/observations/atmos/rsdt/mon/grid/NASA-LaRC/CERES-EBAF/v20140728/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc HTTP/1.1" 200 44090540 2023-12-28 00:01:13,716 UTC [935055] DEBUG urllib3.connectionpool:546 https://aims3.llnl.gov:443 "GET /thredds/fileServer/cmip5_css02_data/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/rsdt/1/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc HTTP/1.1" 200 138078436 2023-12-28 00:01:15,841 UTC [935055] INFO esmvalcore.esgf._download:490 Downloaded /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc (44.09 MB) in 3.66 seconds (12.03 MB/s) from dpesgf03.nccs.nasa.gov 2023-12-28 00:01:26,478 UTC [935055] INFO esmvalcore.esgf._download:490 Downloaded /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc (138.08 MB) in 14.3 seconds (9.65 MB/s) from aims3.llnl.gov 2023-12-28 00:01:26,482 UTC [935055] INFO esmvalcore.esgf._download:569 Downloaded 182.17 MB in 14.34 seconds (12.7 MB/s) 2023-12-28 00:01:26,482 UTC [935055] INFO esmvalcore.esgf._download:581 Successfully downloaded all requested files. 2023-12-28 00:01:26,482 UTC [935055] INFO esmvalcore.config._dask:70 Using the Dask basic scheduler. 2023-12-28 00:01:26,482 UTC [935055] INFO esmvalcore._task:760 Running 5 tasks using 5 processes 2023-12-28 00:01:26,517 UTC [935459] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/rsut in process [935459] 2023-12-28 00:01:26,517 UTC [935458] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/rtnt in process [935458] 2023-12-28 00:01:26,614 UTC [935055] INFO esmvalcore._task:793 Progress: 2 tasks running, 3 tasks waiting for ancestors, 0/5 done 2023-12-28 00:01:34,951 UTC [935459] DEBUG esmvalcore.preprocessor:651 Running block ['regrid'] 2023-12-28 00:01:34,951 UTC [935459] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc 2023-12-28 00:01:34,952 UTC [935459] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:34,952 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:34,953 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:34,954 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:34,955 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:34,955 UTC [935459] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:36,026 UTC [935458] DEBUG esmvalcore.preprocessor:651 Running block ['derive', 'regrid'] 2023-12-28 00:01:36,026 UTC [935458] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2023-12-28 00:01:36,027 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:36,027 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:36,028 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsdt_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:36,029 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:36,030 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:36,030 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:36,078 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:36,078 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:36,081 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:36,087 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:36,087 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:36,088 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:36,088 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:36,088 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:36,092 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2023-12-28 00:01:36,092 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:36,093 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:36,101 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:36,102 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:36,103 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:36,103 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:36,103 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:36,104 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:36,104 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:36,104 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:36,105 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:36,105 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:36,105 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:36,105 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,974 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,974 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:38,975 UTC [935459] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,975 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:38,976 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:38,978 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:38,981 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,981 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:38,982 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:38,982 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:38,983 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:38,983 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,983 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:38,984 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:38,984 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:38,985 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:38,987 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:38,987 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:38,987 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:38,989 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:38,989 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:38,990 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:38,994 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:38,995 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:38,995 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:38,996 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:38,996 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:38,996 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:38,996 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:38,997 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:38,997 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rlut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:38,997 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:38,997 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:38,997 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:38,998 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:38,999 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:38,999 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:39,000 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:39,000 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:39,001 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:39,001 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:39,001 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:39,009 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:39,010 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc') 2023-12-28 00:01:39,011 UTC [935459] DEBUG esmvalcore.preprocessor._io:452 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc 2023-12-28 00:01:39,318 UTC [935459] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc 2023-12-28 00:01:39,319 UTC [935459] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:39,319 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:39,320 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:39,348 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:39,348 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:39,348 UTC [935459] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:41,273 UTC [935459] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:41,273 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:41,275 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:41,280 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:41,280 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:41,281 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:41,281 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:41,282 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:41,428 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:41,428 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:41,429 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:41,435 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:41,436 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:41,436 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:41,437 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:41,437 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:41,438 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:41,438 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:41,438 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:41,441 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:41,442 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc') 2023-12-28 00:01:41,442 UTC [935459] DEBUG esmvalcore.preprocessor._io:452 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc 2023-12-28 00:01:41,902 UTC [935459] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2023-12-28 00:01:41,903 UTC [935459] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:41,903 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:41,903 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:41,904 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:41,904 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:41,904 UTC [935459] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:43,818 UTC [935459] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:43,818 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:43,819 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:43,821 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:43,821 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:43,822 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2023-12-28 00:01:43,822 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:43,822 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:43,823 UTC [935459] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:43,823 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:43,824 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2023-12-28 00:01:43,826 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:43,827 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:43,828 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:43,828 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:43,828 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:43,829 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:43,829 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:43,830 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:43,831 UTC [935459] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:43,831 UTC [935459] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc') 2023-12-28 00:01:43,832 UTC [935459] DEBUG esmvalcore.preprocessor._io:452 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2023-12-28 00:01:46,405 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:46,405 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:46,407 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:46,411 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:46,411 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:46,412 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:46,412 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:46,413 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:46,417 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2023-12-28 00:01:46,417 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:46,417 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:46,424 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:46,425 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2023-12-28 00:01:46,425 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:46,426 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:46,426 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:46,426 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:46,426 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step derive 2023-12-28 00:01:46,429 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2023-12-28 00:01:46,439 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:46,439 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:46,443 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:46,444 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc') 2023-12-28 00:01:46,445 UTC [935458] DEBUG esmvalcore.preprocessor._io:452 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2023-12-28 00:01:47,138 UTC [935459] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/rsut (priority 4) in 0:00:20.620436 2023-12-28 00:01:47,245 UTC [935055] INFO esmvalcore._task:793 Progress: 1 tasks running, 3 tasks waiting for ancestors, 1/5 done 2023-12-28 00:01:47,264 UTC [935458] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2023-12-28 00:01:47,264 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:47,265 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:47,265 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsdt_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:47,266 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:47,266 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:47,266 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,830 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,830 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:48,831 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,836 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,836 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:48,837 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:48,837 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:48,837 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:48,841 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2023-12-28 00:01:48,841 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:48,841 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:48,847 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:48,848 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,848 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:48,849 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:48,849 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:48,850 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:48,850 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:48,850 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:48,850 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,851 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:48,851 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:48,851 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,872 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,873 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:48,874 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,878 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:48,878 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:48,879 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:48,879 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:48,880 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:48,883 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:48,883 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:48,884 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:48,890 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:48,891 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,891 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:48,891 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:48,892 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:48,892 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:48,892 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:48,892 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:48,893 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rlut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:48,893 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:48,893 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:48,893 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:50,319 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:50,319 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:50,321 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:50,325 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2023-12-28 00:01:50,325 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:50,326 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2023-12-28 00:01:50,326 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:50,326 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:50,330 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2023-12-28 00:01:50,330 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:50,330 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2023-12-28 00:01:50,336 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:50,337 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2023-12-28 00:01:50,337 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:50,338 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:50,338 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:50,339 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:50,339 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step derive 2023-12-28 00:01:50,341 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2023-12-28 00:01:50,346 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:50,347 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:50,349 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:50,350 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc') 2023-12-28 00:01:50,351 UTC [935458] DEBUG esmvalcore.preprocessor._io:452 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2023-12-28 00:01:51,010 UTC [935458] DEBUG esmvalcore.preprocessor:658 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2023-12-28 00:01:51,010 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:51,011 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:51,011 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsdt_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,012 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:51,012 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:51,012 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,023 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,023 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:51,025 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,026 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,026 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:51,027 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2023-12-28 00:01:51,027 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:51,028 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:51,029 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2023-12-28 00:01:51,029 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:51,029 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2023-12-28 00:01:51,031 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:51,032 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,033 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:51,033 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2023-12-28 00:01:51,033 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:51,034 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:51,034 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:51,034 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:51,035 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rsut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,035 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:51,035 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:51,035 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,046 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,046 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:51,048 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,049 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:51,049 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:51,050 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2023-12-28 00:01:51,050 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:51,051 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:51,052 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2023-12-28 00:01:51,052 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:51,052 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2023-12-28 00:01:51,054 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:51,055 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,056 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:51,056 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2023-12-28 00:01:51,056 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:51,057 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:51,057 UTC [935458] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-12-28 00:01:51,057 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_file 2023-12-28 00:01:51,058 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/fixed_files/rlut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:51,058 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step load 2023-12-28 00:01:51,058 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2023-12-28 00:01:51,058 UTC [935458] DEBUG esmvalcore.preprocessor._io:145 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:52,408 UTC [935458] DEBUG esmvalcore.preprocessor._io:176 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:52,408 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_metadata 2023-12-28 00:01:52,409 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:52,411 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2023-12-28 00:01:52,411 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step concatenate 2023-12-28 00:01:52,412 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2023-12-28 00:01:52,412 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_metadata 2023-12-28 00:01:52,412 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:52,413 UTC [935458] WARNING esmvalcore.cmor.check:258 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2023-12-28 00:01:52,413 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step clip_timerange 2023-12-28 00:01:52,414 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2023-12-28 00:01:52,416 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step fix_data 2023-12-28 00:01:52,417 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': None, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': True, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': False, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', variable_group = 'rtnt', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2023-12-28 00:01:52,417 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step cmor_check_data 2023-12-28 00:01:52,418 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2023-12-28 00:01:52,418 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step add_supplementary_variables 2023-12-28 00:01:52,418 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2023-12-28 00:01:52,418 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step derive 2023-12-28 00:01:52,421 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2023-12-28 00:01:52,425 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step regrid 2023-12-28 00:01:52,426 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2023-12-28 00:01:52,427 UTC [935458] DEBUG esmvalcore.preprocessor:364 Running preprocessor step save 2023-12-28 00:01:52,428 UTC [935458] DEBUG esmvalcore.preprocessor:318 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc') 2023-12-28 00:01:52,428 UTC [935458] DEBUG esmvalcore.preprocessor._io:452 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2023-12-28 00:01:55,967 UTC [935458] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/rtnt (priority 3) in 0:00:29.449200 2023-12-28 00:01:56,052 UTC [935055] INFO esmvalcore._task:793 Progress: 0 tasks running, 3 tasks waiting for ancestors, 2/5 done 2023-12-28 00:01:56,060 UTC [935460] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/lat_lon in process [935460] 2023-12-28 00:01:56,062 UTC [935461] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/zonal_mean in process [935461] 2023-12-28 00:01:56,063 UTC [935460] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.10.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon/settings.yml'] 2023-12-28 00:01:56,063 UTC [935460] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2023-12-28 00:01:56,063 UTC [935460] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon 2023-12-28 00:01:56,063 UTC [935460] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/lat_lon 2023-12-28 00:01:56,063 UTC [935460] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/lat_lon 2023-12-28 00:01:56,063 UTC [935460] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon/log.txt 2023-12-28 00:01:56,063 UTC [935460] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.10.0/bin/python /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon/settings.yml 2023-12-28 00:01:56,063 UTC [935462] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/meridional_mean in process [935462] 2023-12-28 00:01:56,064 UTC [935461] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.10.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean/settings.yml'] 2023-12-28 00:01:56,064 UTC [935461] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2023-12-28 00:01:56,064 UTC [935461] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean 2023-12-28 00:01:56,064 UTC [935461] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/zonal_mean 2023-12-28 00:01:56,064 UTC [935461] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/zonal_mean 2023-12-28 00:01:56,064 UTC [935461] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean/log.txt 2023-12-28 00:01:56,065 UTC [935461] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.10.0/bin/python /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean/settings.yml 2023-12-28 00:01:56,066 UTC [935462] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.10.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean/settings.yml'] 2023-12-28 00:01:56,066 UTC [935462] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2023-12-28 00:01:56,066 UTC [935462] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean 2023-12-28 00:01:56,066 UTC [935462] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/meridional_mean 2023-12-28 00:01:56,066 UTC [935462] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/meridional_mean 2023-12-28 00:01:56,066 UTC [935462] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean/log.txt 2023-12-28 00:01:56,066 UTC [935462] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.10.0/bin/python /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean/settings.yml 2023-12-28 00:01:56,153 UTC [935055] INFO esmvalcore._task:793 Progress: 3 tasks running, 0 tasks waiting for ancestors, 2/5 done 2023-12-28 00:02:14,084 UTC [935461] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.5 GB 2023-12-28 00:02:14,086 UTC [935461] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-28 00:02:14,086 UTC [935461] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2023-12-28 00:02:14,087 UTC [935461] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/zonal_mean/diagnostic_provenance.yml 2023-12-28 00:02:14,391 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,391 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,391 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,391 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 38855 2023-12-28 00:02:14,617 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,617 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,618 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,618 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 37958 2023-12-28 00:02:14,814 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,814 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,815 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,815 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 40155 2023-12-28 00:02:14,845 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,845 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,845 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,845 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 39274 2023-12-28 00:02:14,915 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,915 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,915 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,915 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 37288 2023-12-28 00:02:14,944 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,944 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,945 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,945 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 36896 2023-12-28 00:02:14,974 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:14,975 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:14,975 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:14,975 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 41803 2023-12-28 00:02:15,003 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,003 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,003 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,003 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 40767 2023-12-28 00:02:15,032 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,032 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,032 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,032 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 43251 2023-12-28 00:02:15,066 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,066 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,066 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,066 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 41884 2023-12-28 00:02:15,095 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,095 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,095 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,095 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 41602 2023-12-28 00:02:15,124 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,124 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,124 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,124 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 38603 2023-12-28 00:02:15,153 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,153 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,153 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,153 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 44949 2023-12-28 00:02:15,181 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,181 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,182 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,182 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 42303 2023-12-28 00:02:15,210 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,210 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,210 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,210 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 40536 2023-12-28 00:02:15,245 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,245 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,246 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,246 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 38460 2023-12-28 00:02:15,276 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,276 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,276 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,276 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 58407 2023-12-28 00:02:15,306 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:15,306 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:15,306 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:15,306 UTC [935461] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 44484 2023-12-28 00:02:15,479 UTC [935461] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/zonal_mean took 1.4 seconds 2023-12-28 00:02:15,479 UTC [935461] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/zonal_mean (priority 1) in 0:00:19.417267 2023-12-28 00:02:15,666 UTC [935055] INFO esmvalcore._task:793 Progress: 2 tasks running, 0 tasks waiting for ancestors, 3/5 done 2023-12-28 00:02:22,109 UTC [935462] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.4 GB 2023-12-28 00:02:22,110 UTC [935462] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-28 00:02:22,110 UTC [935462] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2023-12-28 00:02:22,111 UTC [935462] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/meridional_mean/diagnostic_provenance.yml 2023-12-28 00:02:22,827 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:22,827 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:22,827 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:22,827 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 61992 2023-12-28 00:02:24,425 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:24,425 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:24,425 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:24,425 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 61441 2023-12-28 00:02:25,056 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:25,056 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:25,056 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:25,056 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 57255 2023-12-28 00:02:25,493 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:25,493 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:25,493 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:25,493 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65491 2023-12-28 00:02:25,725 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:25,725 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:25,725 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:25,725 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 60704 2023-12-28 00:02:26,321 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:26,321 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:26,321 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:26,321 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 61842 2023-12-28 00:02:26,748 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:26,748 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:26,748 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:26,748 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 62595 2023-12-28 00:02:26,779 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:26,779 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:26,779 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:26,779 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 64329 2023-12-28 00:02:26,810 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:26,810 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:26,810 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:26,810 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:26,947 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:26,947 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:26,947 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:26,947 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 62430 2023-12-28 00:02:27,885 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:27,885 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:27,885 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:27,885 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:28,107 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,107 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,107 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,107 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:28,320 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,320 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,320 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,320 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:28,887 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,887 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,887 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,887 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:28,920 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,920 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,920 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,920 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:28,956 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,956 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,956 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,956 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 57778 2023-12-28 00:02:28,990 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:28,990 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:28,990 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:28,990 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:29,023 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:29,024 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:29,024 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:29,024 UTC [935462] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:33,127 UTC [935460] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.5 GB 2023-12-28 00:02:33,128 UTC [935460] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-28 00:02:33,128 UTC [935460] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2023-12-28 00:02:33,128 UTC [935460] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/validation_with_CERES-EBAF/lat_lon/diagnostic_provenance.yml 2023-12-28 00:02:33,145 UTC [935462] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/meridional_mean took 11.0 seconds 2023-12-28 00:02:33,145 UTC [935462] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/meridional_mean (priority 2) in 0:00:37.081765 2023-12-28 00:02:33,278 UTC [935055] INFO esmvalcore._task:793 Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done 2023-12-28 00:02:33,368 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:33,368 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:33,368 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:33,368 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:33,775 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:33,775 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:33,775 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:33,775 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:34,389 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:34,389 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:34,389 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:34,389 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:34,473 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:34,473 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:34,473 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:34,473 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:35,341 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:35,341 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:35,341 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:35,341 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:35,916 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:35,916 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:35,916 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:35,916 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:37,191 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:37,191 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:37,191 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:37,191 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:38,475 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:38,476 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:38,476 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:38,476 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:38,503 UTC [935460] WARNING esmvalcore._task:646 No ancestor files specified for recording provenance of /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/lat_lon/alltime/vs_rsut.png, created by diagnostic script validation.py in task validation_with_CERES-EBAF/lat_lon 2023-12-28 00:02:38,505 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:38,505 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:38,505 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:38,505 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:38,647 UTC [935460] WARNING esmvalcore._task:646 No ancestor files specified for recording provenance of /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/plots/validation_with_CERES-EBAF/lat_lon/alltime/vs_rtnt.png, created by diagnostic script validation.py in task validation_with_CERES-EBAF/lat_lon 2023-12-28 00:02:40,155 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IHDR' 16 13 2023-12-28 00:02:40,155 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'tEXt' 41 57 2023-12-28 00:02:40,155 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'pHYs' 110 9 2023-12-28 00:02:40,155 UTC [935460] DEBUG PIL.PngImagePlugin:190 STREAM b'IDAT' 131 65536 2023-12-28 00:02:40,257 UTC [935460] WARNING esmvalcore._task:646 No ancestor files specified for recording provenance of /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/lat_lon/vs_rsut.nc, created by diagnostic script validation.py in task validation_with_CERES-EBAF/lat_lon 2023-12-28 00:02:40,261 UTC [935460] WARNING esmvalcore._task:646 No ancestor files specified for recording provenance of /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/work/validation_with_CERES-EBAF/lat_lon/vs_rtnt.nc, created by diagnostic script validation.py in task validation_with_CERES-EBAF/lat_lon 2023-12-28 00:02:40,264 UTC [935460] WARNING esmvalcore._task:681 Valid ancestor files for diagnostic script validation.py in task validation_with_CERES-EBAF/lat_lon are: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2023-12-28 00:02:40,265 UTC [935460] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/lat_lon took 7.1 seconds 2023-12-28 00:02:40,265 UTC [935460] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/lat_lon (priority 0) in 0:00:44.204704 2023-12-28 00:02:40,283 UTC [935055] INFO esmvalcore._task:793 Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done 2023-12-28 00:02:40,283 UTC [935055] INFO esmvalcore._task:798 Successfully completed all tasks. 2023-12-28 00:02:40,314 UTC [935055] INFO esmvalcore._recipe.recipe:1076 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/run/recipe_validation_filled.yml 2023-12-28 00:02:40,485 UTC [935055] INFO esmvalcore.experimental.recipe_output:244 Wrote recipe output to: file:///projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_validation_20231228_000028/index.html 2023-12-28 00:02:40,485 UTC [935055] INFO esmvalcore._main:133 Ending the Earth System Model Evaluation Tool at time: 2023-12-28 00:02:40 UTC 2023-12-28 00:02:40,485 UTC [935055] INFO esmvalcore._main:136 Time for running the recipe was: 0:02:10.928274 2023-12-28 00:02:40,976 UTC [935055] INFO esmvalcore._task:128 Maximum memory used (estimate): 3.2 GB 2023-12-28 00:02:40,976 UTC [935055] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-28 00:02:40,977 UTC [935055] INFO esmvalcore._main:470 Removing `preproc` directory containing preprocessed data 2023-12-28 00:02:40,977 UTC [935055] INFO esmvalcore._main:473 If this data is further needed, then set `remove_preproc_dir` to `false` in your user configuration file 2023-12-28 00:02:40,987 UTC [935055] INFO esmvalcore._main:450 Run was successful