2025-01-31 16:50:42,027 UTC [2300506] INFO esmvalcore._main:507 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2025-01-31 16:50:42,027 UTC [2300506] INFO esmvalcore._main:508 Package versions 2025-01-31 16:50:42,027 UTC [2300506] INFO esmvalcore._main:509 ---------------- 2025-01-31 16:50:42,027 UTC [2300506] INFO esmvalcore._main:510 ESMValCore: 2.11.1 2025-01-31 16:50:42,028 UTC [2300506] INFO esmvalcore._main:512 ESMValTool: 2.11.0 2025-01-31 16:50:42,028 UTC [2300506] INFO esmvalcore._main:513 ---------------- 2025-01-31 16:50:42,028 UTC [2300506] INFO esmvalcore._main:514 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2025-01-31 16:50:42,028 UTC [2300506] INFO esmvalcore._main:515 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/main_log_debug.txt /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/cmor_log.txt 2025-01-31 16:50:42,155 UTC [2300506] INFO esmvalcore.config._esgf_pyclient:62 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2025-01-31 16:50:42,269 UTC [2300506] INFO esmvalcore._main:91 Starting the Earth System Model Evaluation Tool at time: 2025-01-31 16:50:42 UTC 2025-01-31 16:50:42,269 UTC [2300506] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2025-01-31 16:50:42,269 UTC [2300506] INFO esmvalcore._main:96 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/recipes-2.11.0/standard_recipes/atmosphere/recipe_validation.yml 2025-01-31 16:50:42,270 UTC [2300506] INFO esmvalcore._main:97 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run 2025-01-31 16:50:42,270 UTC [2300506] INFO esmvalcore._main:98 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work 2025-01-31 16:50:42,270 UTC [2300506] INFO esmvalcore._main:99 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc 2025-01-31 16:50:42,271 UTC [2300506] INFO esmvalcore._main:100 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots 2025-01-31 16:50:42,271 UTC [2300506] INFO esmvalcore._main:101 ---------------------------------------------------------------------- 2025-01-31 16:50:42,271 UTC [2300506] INFO esmvalcore._main:104 Running tasks using at most 16 processes 2025-01-31 16:50:42,271 UTC [2300506] INFO esmvalcore._main:106 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2025-01-31 16:50:42,271 UTC [2300506] INFO esmvalcore._main:109 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2025-01-31 16:50:42,271 UTC [2300506] WARNING esmvalcore.config._dask:18 Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. 2025-01-31 16:50:42,273 UTC [2300506] DEBUG esmvalcore._recipe.check:61 Checking recipe against schema /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe_schema.yml 2025-01-31 16:50:42,289 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:347 Populating list of datasets for variable rtnt in diagnostic validation_with_CERES-EBAF 2025-01-31 16:50:42,289 UTC [2300506] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2025-01-31 16:50:42,290 UTC [2300506] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2025-01-31 16:50:42,303 UTC [2300506] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2025-01-31 16:50:42,307 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:42,403 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2025-01-31 16:50:42,403 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:42,403 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:42,404 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:42,404 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:42,404 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:42,406 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:42,406 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:42,409 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2025-01-31 16:50:42,409 UTC [2300506] DEBUG requests_cache.session:284 Stale response; attempting to re-send request 2025-01-31 16:50:42,410 UTC [2300506] DEBUG urllib3.connectionpool:1049 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2025-01-31 16:50:42,560 UTC [2300506] DEBUG urllib3.connectionpool:544 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=rtnt HTTP/1.1" 200 1276 2025-01-31 16:50:42,561 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-write cache checks: Passed 2025-01-31 16:50:42,568 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:42,568 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2025-01-31 16:50:42,568 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:42,569 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rtnt, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2025-01-31 16:50:42,569 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:42,576 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2025-01-31 16:50:42,576 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:42,576 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:42,576 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:42,576 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:42,576 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:42,578 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:42,578 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:42,591 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2025-01-31 16:50:42,591 UTC [2300506] DEBUG requests_cache.session:284 Stale response; attempting to re-send request 2025-01-31 16:50:42,591 UTC [2300506] DEBUG urllib3.connectionpool:1049 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2025-01-31 16:50:42,751 UTC [2300506] DEBUG urllib3.connectionpool:544 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=NorESM1-M&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NCC&cmor_table=Amon&product=output1%2Coutput2&variable=rtnt HTTP/1.1" 200 1273 2025-01-31 16:50:42,752 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-write cache checks: Passed 2025-01-31 16:50:42,921 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:42,921 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2025-01-31 16:50:42,921 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:42,922 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rtnt, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2025-01-31 16:50:42,922 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2025-01-31 16:50:42,934 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'} 2025-01-31 16:50:42,934 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:42,934 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:42,934 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:42,935 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:42,935 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:42,936 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:42,936 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:42,936 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2025-01-31 16:50:42,936 UTC [2300506] DEBUG requests_cache.session:284 Stale response; attempting to re-send request 2025-01-31 16:50:42,937 UTC [2300506] DEBUG urllib3.connectionpool:1049 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2025-01-31 16:50:43,078 UTC [2300506] DEBUG urllib3.connectionpool:544 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=obs4MIPs&source_id=CERES-EBAF&time_frequency=mon&variable=rtnt HTTP/1.1" 200 1099 2025-01-31 16:50:43,078 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-write cache checks: Passed 2025-01-31 16:50:43,084 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:43,084 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'}: none 2025-01-31 16:50:43,084 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:43,084 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rtnt, Amon, obs4MIPs, CERES-EBAF, v20160610 2025-01-31 16:50:43,084 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:347 Populating list of datasets for variable rsut in diagnostic validation_with_CERES-EBAF 2025-01-31 16:50:43,085 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rsut, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2025-01-31 16:50:43,085 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rsut, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2025-01-31 16:50:43,085 UTC [2300506] DEBUG esmvalcore._recipe.to_datasets:371 Found Dataset: rsut, Amon, obs4MIPs, CERES-EBAF, v20160610 2025-01-31 16:50:43,085 UTC [2300506] DEBUG esmvalcore._recipe.recipe:801 Retrieving diagnostics from recipe 2025-01-31 16:50:43,085 UTC [2300506] DEBUG esmvalcore._recipe.recipe:829 Setting script for diagnostic validation_with_CERES-EBAF 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:1019 Creating tasks from recipe 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:1028 Creating tasks for diagnostic validation_with_CERES-EBAF 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:950 Creating diagnostic task validation_with_CERES-EBAF/lat_lon 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:950 Creating diagnostic task validation_with_CERES-EBAF/zonal_mean 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:950 Creating diagnostic task validation_with_CERES-EBAF/meridional_mean 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:1003 Creating preprocessor task validation_with_CERES-EBAF/rtnt 2025-01-31 16:50:43,086 UTC [2300506] INFO esmvalcore._recipe.recipe:673 Creating preprocessor 'pp_rad_derive_var' task for variable 'rtnt' 2025-01-31 16:50:43,087 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,087 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2025-01-31 16:50:43,087 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:43,088 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:43,088 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:43,088 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:43,088 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:43,089 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:43,089 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:43,090 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400) 2025-01-31 16:50:43,090 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:43,090 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2025-01-31 16:50:43,090 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:43,090 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,091 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,133 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,153 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,178 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsdt of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,178 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,178 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rlut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,178 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rtnt, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2025-01-31 16:50:43,178 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,179 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'} 2025-01-31 16:50:43,179 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:43,179 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:43,179 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:43,179 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:43,180 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:43,181 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:43,181 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:43,181 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400) 2025-01-31 16:50:43,181 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:43,181 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'NorESM1-M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'rtnt'}: none 2025-01-31 16:50:43,181 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:43,182 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rtnt/rtnt_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,182 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,186 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,189 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,191 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsdt of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,191 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,191 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rlut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,191 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rtnt, Amon, CMIP5, NorESM1-M, historical, r1i1p1, v20120412 2025-01-31 16:50:43,192 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2025-01-31 16:50:43,192 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'} 2025-01-31 16:50:43,192 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:43,192 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:43,192 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:43,193 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:43,193 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:43,194 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:43,194 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:43,194 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400) 2025-01-31 16:50:43,194 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:43,194 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rtnt'}: none 2025-01-31 16:50:43,194 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: 2025-01-31 16:50:43,195 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rtnt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rtnt_*.nc 2025-01-31 16:50:43,195 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsdt_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsdt_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsdt_*.nc 2025-01-31 16:50:43,195 UTC [2300506] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rsdt'} 2025-01-31 16:50:43,195 UTC [2300506] DEBUG requests_cache.backends:66 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2025-01-31 16:50:43,195 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2025-01-31 16:50:43,196 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2025-01-31 16:50:43,196 UTC [2300506] DEBUG requests_cache.backends.base:322 Initialized SQLiteDict with serializer: None 2025-01-31 16:50:43,196 UTC [2300506] DEBUG requests_cache.backends.sqlite:252 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2025-01-31 16:50:43,197 UTC [2300506] DEBUG requests_cache.policy.actions:103 Cache directives from request headers: CacheDirectives() 2025-01-31 16:50:43,197 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-read cache checks: Passed 2025-01-31 16:50:43,197 UTC [2300506] DEBUG requests_cache.policy.actions:217 Post-read cache actions: CacheActions(expire_after=86400, resend_request=True) 2025-01-31 16:50:43,197 UTC [2300506] DEBUG requests_cache.session:284 Stale response; attempting to re-send request 2025-01-31 16:50:43,198 UTC [2300506] DEBUG urllib3.connectionpool:1049 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2025-01-31 16:50:43,345 UTC [2300506] DEBUG urllib3.connectionpool:544 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=obs4MIPs&source_id=CERES-EBAF&time_frequency=mon&variable=rsdt HTTP/1.1" 200 3031 2025-01-31 16:50:43,345 UTC [2300506] DEBUG requests_cache.policy.actions:368 Pre-write cache checks: Passed 2025-01-31 16:50:43,351 UTC [2300506] DEBUG requests_cache.backends.base:115 Closing backend connections 2025-01-31 16:50:43,351 UTC [2300506] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'atmos' for obs4MIPs.CERES-EBAF.v20160610.rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:43,351 UTC [2300506] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20160610' for obs4MIPs.CERES-EBAF.v20160610.rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:43,351 UTC [2300506] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'obs4MIPs', 'source_id': 'CERES-EBAF', 'time_frequency': 'mon', 'variable': 'rsdt'}: ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] 2025-01-31 16:50:43,351 UTC [2300506] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] 2025-01-31 16:50:43,352 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc 2025-01-31 16:50:43,352 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rlut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rlut_*.nc 2025-01-31 16:50:43,352 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsdt of dataset obs4MIPs: /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc (will be downloaded) 2025-01-31 16:50:43,366 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:43,374 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rlut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:43,375 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rtnt, Amon, obs4MIPs, CERES-EBAF, v20160610 2025-01-31 16:50:43,376 UTC [2300506] INFO esmvalcore._recipe.recipe:697 PreprocessingTask validation_with_CERES-EBAF/rtnt created. 2025-01-31 16:50:43,376 UTC [2300506] DEBUG esmvalcore._recipe.recipe:698 PreprocessingTask validation_with_CERES-EBAF/rtnt will create the files: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2025-01-31 16:50:43,376 UTC [2300506] INFO esmvalcore._recipe.recipe:1003 Creating preprocessor task validation_with_CERES-EBAF/rsut 2025-01-31 16:50:43,376 UTC [2300506] INFO esmvalcore._recipe.recipe:673 Creating preprocessor 'pp_rad' task for variable 'rsut' 2025-01-31 16:50:43,376 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2025-01-31 16:50:43,377 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset CMIP5 MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,377 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rsut, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2025-01-31 16:50:43,378 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/*/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1*.nc 2025-01-31 16:50:43,379 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset CMIP5 NorESM1-M: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:43,379 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rsut, Amon, CMIP5, NorESM1-M, historical, r1i1p1, v20120412 2025-01-31 16:50:43,379 UTC [2300506] DEBUG esmvalcore.local:439 Looking for files matching: /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_*.nc /scratch/tomast/ESGF/obs4MIPs/Tier1/CERES-EBAF/rsut_*.nc 2025-01-31 16:50:43,379 UTC [2300506] DEBUG esmvalcore._recipe.recipe:270 Using input files for variable rsut of dataset obs4MIPs: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:43,379 UTC [2300506] INFO esmvalcore._recipe.recipe:536 Found input files for Dataset: rsut, Amon, obs4MIPs, CERES-EBAF, v20160610 2025-01-31 16:50:43,380 UTC [2300506] INFO esmvalcore._recipe.recipe:697 PreprocessingTask validation_with_CERES-EBAF/rsut created. 2025-01-31 16:50:43,380 UTC [2300506] DEBUG esmvalcore._recipe.recipe:698 PreprocessingTask validation_with_CERES-EBAF/rsut will create the files: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc 2025-01-31 16:50:43,380 UTC [2300506] DEBUG esmvalcore._recipe.recipe:878 Linking tasks for diagnostic validation_with_CERES-EBAF script lat_lon 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:878 Linking tasks for diagnostic validation_with_CERES-EBAF script zonal_mean 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:878 Linking tasks for diagnostic validation_with_CERES-EBAF script meridional_mean 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rtnt matches ['validation_with_CERES-EBAF/rtnt'] 2025-01-31 16:50:43,381 UTC [2300506] DEBUG esmvalcore._recipe.recipe:887 Pattern validation_with_CERES-EBAF/rsut matches ['validation_with_CERES-EBAF/rsut'] 2025-01-31 16:50:43,381 UTC [2300506] INFO esmvalcore._recipe.recipe:1068 These tasks will be executed: validation_with_CERES-EBAF/lat_lon, validation_with_CERES-EBAF/meridional_mean, validation_with_CERES-EBAF/zonal_mean, validation_with_CERES-EBAF/rsut, validation_with_CERES-EBAF/rtnt 2025-01-31 16:50:43,382 UTC [2300506] DEBUG esmvalcore._main:128 Recipe summary: DiagnosticTask: validation_with_CERES-EBAF/lat_lon script: validation.py settings: {'analysis_type': 'lat_lon', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/lat_lon', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon', 'save_cubes': True, 'script': 'lat_lon', 'seasonal_analysis': False, 'title': '', 'version': '2.11.1', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/lat_lon'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} ancestors: None DiagnosticTask: validation_with_CERES-EBAF/meridional_mean script: validation.py settings: {'analysis_type': 'meridional_mean', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/meridional_mean', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean', 'save_cubes': True, 'script': 'meridional_mean', 'seasonal_analysis': True, 'title': '', 'version': '2.11.1', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/meridional_mean'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} ancestors: None DiagnosticTask: validation_with_CERES-EBAF/zonal_mean script: validation.py settings: {'analysis_type': 'zonal_mean', 'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'cmip_era': 'CMIP5', 'control_model': 'MPI-ESM-LR', 'exper_model': 'NorESM1-M', 'log_level': 'info', 'observational_datasets': ['CERES-EBAF'], 'output_file_type': 'png', 'plot_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/zonal_mean', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_validation.yml'), 'run_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean', 'save_cubes': True, 'script': 'zonal_mean', 'seasonal_analysis': True, 'title': '', 'version': '2.11.1', 'work_dir': '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/zonal_mean'} ancestors: PreprocessingTask: validation_with_CERES-EBAF/rtnt order: ['derive', 'regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc input files: [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'derive': {'long_name': 'TOA Net downward Total Radiation', 'short_name': 'rtnt', 'standard_name': '', 'units': 'W m-2'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc')}} ancestors: None PreprocessingTask: validation_with_CERES-EBAF/rsut order: ['regrid', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc')}} PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] settings: {'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc')}} ancestors: None 2025-01-31 16:50:43,389 UTC [2300506] INFO esmvalcore._recipe.recipe:1131 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/recipe_validation_filled.yml 2025-01-31 16:50:43,389 UTC [2300506] INFO esmvalcore.esgf._download:543 Will download 44.09 MB Will download the following files: 44.09 MB ESGFFile:obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc on hosts ['dpesgf03.nccs.nasa.gov'] Downloading 44.09 MB.. 2025-01-31 16:50:43,399 UTC [2300506] DEBUG esmvalcore.esgf._download:461 Downloading https://dpesgf03.nccs.nasa.gov/thredds/fileServer/obs4MIPs/NASA-LaRC/observations/atmos/rsdt/mon/grid/NASA-LaRC/CERES-EBAF/v20140728/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc to /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc.mxn_s3_1 2025-01-31 16:50:43,400 UTC [2300506] DEBUG urllib3.connectionpool:1049 Starting new HTTPS connection (1): dpesgf03.nccs.nasa.gov:443 2025-01-31 16:50:44,129 UTC [2300506] DEBUG urllib3.connectionpool:544 https://dpesgf03.nccs.nasa.gov:443 "GET /thredds/fileServer/obs4MIPs/NASA-LaRC/observations/atmos/rsdt/mon/grid/NASA-LaRC/CERES-EBAF/v20140728/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc HTTP/1.1" 200 44090540 2025-01-31 16:50:45,763 UTC [2300506] INFO esmvalcore.esgf._download:493 Downloaded /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc (44.09 MB) in 2.35 seconds (18.77 MB/s) from dpesgf03.nccs.nasa.gov 2025-01-31 16:50:45,763 UTC [2300506] INFO esmvalcore.esgf._download:572 Downloaded 44.09 MB in 2.37 seconds (18.57 MB/s) 2025-01-31 16:50:45,763 UTC [2300506] INFO esmvalcore.esgf._download:584 Successfully downloaded all requested files. 2025-01-31 16:50:45,764 UTC [2300506] INFO esmvalcore.config._dask:70 Using the Dask basic scheduler. 2025-01-31 16:50:45,764 UTC [2300506] INFO esmvalcore._task:760 Running 5 tasks using 5 processes 2025-01-31 16:50:45,806 UTC [2300664] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/rsut in process [2300664] 2025-01-31 16:50:45,806 UTC [2300663] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/rtnt in process [2300663] 2025-01-31 16:50:45,903 UTC [2300506] INFO esmvalcore._task:793 Progress: 2 tasks running, 3 tasks waiting for ancestors, 0/5 done 2025-01-31 16:50:46,027 UTC [2300664] DEBUG esmvalcore.preprocessor:674 Running block ['regrid'] 2025-01-31 16:50:46,027 UTC [2300664] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc 2025-01-31 16:50:46,028 UTC [2300664] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:46,028 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:46,029 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:46,030 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:46,030 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:46,030 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:46,031 UTC [2300664] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,166 UTC [2300663] DEBUG esmvalcore.preprocessor:674 Running block ['derive', 'regrid'] 2025-01-31 16:50:46,166 UTC [2300663] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2025-01-31 16:50:46,167 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:46,167 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:46,168 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsdt_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:46,170 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:46,170 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:46,170 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:46,170 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,566 UTC [2300664] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,566 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:46,570 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' source_file '/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/histori ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/00_load.nc 2025-01-31 16:50:46,665 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,665 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:46,667 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' source_file '/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/histori ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/00_load.nc 2025-01-31 16:50:46,928 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:46,931 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:46,938 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,939 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:46,939 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:46,953 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:46,955 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:46,960 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:46,960 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:46,960 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:47,213 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:47,214 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:47,215 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,215 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/02_concatenate.nc 2025-01-31 16:50:47,216 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:47,218 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:47,218 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,218 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/02_concatenate.nc 2025-01-31 16:50:47,462 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:47,463 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:47,468 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2025-01-31 16:50:47,468 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,468 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:47,469 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:47,470 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:47,475 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:47,475 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,475 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:47,715 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:47,716 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:47,716 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:47,717 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:47,724 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,725 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:47,726 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,726 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:47,805 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:47,806 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:47,806 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,807 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/05_fix_data.nc 2025-01-31 16:50:47,810 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:47,811 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:47,811 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,812 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/05_fix_data.nc 2025-01-31 16:50:47,885 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:47,886 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:47,886 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,887 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:47,892 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:47,893 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:47,893 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,893 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:47,965 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:47,966 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:47,966 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,966 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsdt_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:47,976 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:47,976 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:47,976 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:47,977 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:48,047 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:48,047 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:48,048 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:48,048 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:48,048 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:48,048 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:48,048 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,057 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:48,058 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:48,059 UTC [2300664] DEBUG esmvalcore.preprocessor._regrid:607 Loaded regridding scheme Linear('mask') 2025-01-31 16:50:48,063 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,064 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/08_regrid.nc 2025-01-31 16:50:48,072 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,072 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,073 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' source_file '/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/histori ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/00_load.nc 2025-01-31 16:50:48,232 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:48,234 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc') 2025-01-31 16:50:48,234 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005.nc 2025-01-31 16:50:48,305 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:48,307 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:48,312 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,312 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,313 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:48,435 UTC [2300664] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc 2025-01-31 16:50:48,436 UTC [2300664] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:48,436 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:48,437 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:48,437 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:48,437 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:48,437 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:48,437 UTC [2300664] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,548 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:48,549 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:48,549 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,549 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/02_concatenate.nc 2025-01-31 16:50:48,665 UTC [2300664] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,665 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,666 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' source_file '/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amo ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/00_load.nc 2025-01-31 16:50:48,772 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:48,773 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:48,777 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:48,777 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,777 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:48,802 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:48,804 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:48,809 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:48,809 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,810 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:48,934 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:48,935 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:48,935 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:48,936 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/02_concatenate.nc 2025-01-31 16:50:49,013 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:49,014 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:49,021 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,021 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:49,048 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:49,049 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:49,053 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:49,053 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,053 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:49,100 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:49,101 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:49,102 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,102 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/05_fix_data.nc 2025-01-31 16:50:49,166 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:49,167 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:49,173 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,174 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:49,176 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:49,177 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:49,178 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,178 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:49,261 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:49,262 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:49,262 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,262 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rsut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:49,264 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:49,265 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:49,265 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,266 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/05_fix_data.nc 2025-01-31 16:50:49,341 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:49,341 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:49,342 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rlut_Amon_CMIP5_MPI-ESM-LR_historical_r1i1p1_v20120315_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:49,342 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:49,342 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:49,342 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:49,342 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:49,356 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:49,357 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:49,357 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,358 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:49,442 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:49,442 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:49,442 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,443 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:49,526 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:49,527 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:49,527 UTC [2300664] DEBUG esmvalcore.preprocessor._regrid:607 Loaded regridding scheme Linear('mask') 2025-01-31 16:50:49,531 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,532 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/08_regrid.nc 2025-01-31 16:50:49,628 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:49,629 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,629 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' source_file '/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/histori ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/00_load.nc 2025-01-31 16:50:49,674 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:49,675 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc') 2025-01-31 16:50:49,675 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005.nc 2025-01-31 16:50:49,827 UTC [2300664] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2025-01-31 16:50:49,827 UTC [2300664] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:49,827 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:49,828 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:49,829 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] 2025-01-31 16:50:49,829 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:49,829 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:49,829 UTC [2300664] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:49,876 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:49,879 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:49,885 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:49,885 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,885 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:49,902 UTC [2300664] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:49,902 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,903 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_file '/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EB ...' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/00_load.nc 2025-01-31 16:50:49,977 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:49,978 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:49,980 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:49,980 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:49,981 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/01_fix_metadata.nc 2025-01-31 16:50:50,055 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:50,056 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2025-01-31 16:50:50,056 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,056 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/02_concatenate.nc 2025-01-31 16:50:50,130 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:50,131 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:50,132 UTC [2300664] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:50,132 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,133 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/03_cmor_check_metadata.nc 2025-01-31 16:50:50,142 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:50,143 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:50,143 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,143 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/02_concatenate.nc 2025-01-31 16:50:50,231 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:50,232 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2025-01-31 16:50:50,235 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,236 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/04_clip_timerange.nc 2025-01-31 16:50:50,316 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:50,317 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad', dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', variable_group = 'rsut', diagnostic = 'validation_with_CERES-EBAF', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:50,318 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,318 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/05_fix_data.nc 2025-01-31 16:50:50,386 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:50,387 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:50,391 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2025-01-31 16:50:50,392 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,392 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:50,399 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:50,400 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:50,400 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,400 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/06_cmor_check_data.nc 2025-01-31 16:50:50,480 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:50,481 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:50,481 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,482 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/07_add_supplementary_variables.nc 2025-01-31 16:50:50,561 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:50,562 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:50,563 UTC [2300664] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,563 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012/08_regrid.nc 2025-01-31 16:50:50,623 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:50,624 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:50,632 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,632 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:50,639 UTC [2300664] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:50,640 UTC [2300664] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc') 2025-01-31 16:50:50,640 UTC [2300664] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rsut/obs4MIPs_CERES-EBAF_rsut_2001-2012.nc 2025-01-31 16:50:50,717 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:50,718 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'MPI-ESM-LR', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 0, alias = 'CMIP5_MPI-ESM-LR', product = ['output1', 'output2'], institute = ['MPI-M'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120315' 2025-01-31 16:50:50,718 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,719 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/05_fix_data.nc 2025-01-31 16:50:50,728 UTC [2300664] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/rsut (priority 4) in 0:00:04.921280 2025-01-31 16:50:50,790 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:50,791 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:50,792 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,792 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:50,870 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:50,871 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:50,871 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,871 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rlut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:50,907 UTC [2300506] INFO esmvalcore._task:793 Progress: 1 tasks running, 3 tasks waiting for ancestors, 1/5 done 2025-01-31 16:50:50,944 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step derive 2025-01-31 16:50:50,946 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2025-01-31 16:50:50,957 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:50,958 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 96; longitude: 192) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005/00_derive.nc 2025-01-31 16:50:51,153 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:51,154 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:51,155 UTC [2300663] DEBUG esmvalcore.preprocessor._regrid:607 Loaded regridding scheme Linear('mask') 2025-01-31 16:50:51,160 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:51,161 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005/01_regrid.nc 2025-01-31 16:50:51,431 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:51,432 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsdt/rsdt_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rsut/rsut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/rlut/rlut_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc') 2025-01-31 16:50:51,432 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_MPI-ESM-LR_historical_r0i0p0.nc ...' branch_time 10957.0 cmor_version '2.5.9' contact 'cmip5-mpi-esm@dkrz.de' experiment 'historical' experiment_id 'historical' forcing 'GHG Oz SD Sl Vl LU' frequency 'mon' initialization_method 1 institute_id 'MPI-M' institution 'Max Planck Institute for Meteorology' model_id 'MPI-ESM-LR' modeling_realm 'atmos' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 references 'ECHAM6: n/a; JSBACH: Raddatz et al., 2007. Will the tropical land biosphere ...' source 'MPI-ESM-LR 2011; URL: http://svn.zmaw.de/svn/cosmos/branches/releases/mpi-esm-cmip5/src/mod; ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'MPI-ESM-LR model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_MPI-ESM-LR_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2025-01-31 16:50:51,733 UTC [2300663] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2025-01-31 16:50:51,733 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:51,733 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:51,734 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsdt_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:51,734 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:51,734 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:51,734 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:51,734 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:52,009 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:52,009 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,010 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' source_file '/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amo ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/00_load.nc 2025-01-31 16:50:52,156 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:52,158 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:52,163 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:52,163 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,164 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:52,283 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:52,285 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:52,285 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,286 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/02_concatenate.nc 2025-01-31 16:50:52,404 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:52,405 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:52,408 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2025-01-31 16:50:52,409 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,409 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:52,525 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:52,526 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:52,534 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,534 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:52,619 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:52,620 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsdt', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:52,620 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,621 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/05_fix_data.nc 2025-01-31 16:50:52,705 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:52,706 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:52,706 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,706 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:52,789 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:52,790 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:52,790 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,790 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSNTOA+FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsdt_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:52,873 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:52,873 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:52,874 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:52,874 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:52,874 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:52,874 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:52,874 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:52,897 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:52,897 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:52,898 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' source_file '/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amo ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/00_load.nc 2025-01-31 16:50:53,015 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:53,016 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:53,021 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:53,021 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,021 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:53,152 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:53,153 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:53,153 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,154 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/02_concatenate.nc 2025-01-31 16:50:53,264 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:53,265 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:53,269 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:53,269 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,269 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:53,378 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:53,379 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:53,385 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,385 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:53,468 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:53,470 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rsut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:53,470 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,470 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/05_fix_data.nc 2025-01-31 16:50:53,561 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:53,562 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:53,562 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,562 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:53,646 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:53,646 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:53,646 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,647 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FSUTOA' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rsut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:53,729 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:53,730 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:53,730 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rlut_Amon_CMIP5_NorESM1-M_historical_r1i1p1_v20120412_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:53,730 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] 2025-01-31 16:50:53,730 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:53,731 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:53,731 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:53,990 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:53,990 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:53,991 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' source_file '/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amo ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/00_load.nc 2025-01-31 16:50:54,123 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:54,124 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:54,129 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc 2025-01-31 16:50:54,129 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,129 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/01_fix_metadata.nc 2025-01-31 16:50:54,249 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:54,250 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = 2025-01-31 16:50:54,250 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,251 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/02_concatenate.nc 2025-01-31 16:50:54,368 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:54,368 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:54,372 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2025-01-31 16:50:54,372 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,373 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 1872; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/03_cmor_check_metadata.nc 2025-01-31 16:50:54,483 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:54,484 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2001/2005' 2025-01-31 16:50:54,490 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,490 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/04_clip_timerange.nc 2025-01-31 16:50:54,576 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:54,578 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'NorESM1-M', project = 'CMIP5', mip = 'Amon', exp = 'historical', ensemble = 'r1i1p1', short_name = 'rlut', timerange = '2001/2005', recipe_dataset_index = 1, alias = 'CMIP5_NorESM1-M', product = ['output1', 'output2'], institute = ['NCC'], original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120412' 2025-01-31 16:50:54,578 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,579 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/05_fix_data.nc 2025-01-31 16:50:54,671 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:54,671 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:54,672 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,672 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/06_cmor_check_data.nc 2025-01-31 16:50:54,756 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:54,756 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:54,756 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,757 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rlut_2001-2005/07_add_supplementary_variables.nc 2025-01-31 16:50:54,840 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step derive 2025-01-31 16:50:54,842 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2025-01-31 16:50:54,850 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:54,850 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 96; longitude: 144) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005/00_derive.nc 2025-01-31 16:50:55,092 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:55,093 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:55,093 UTC [2300663] DEBUG esmvalcore.preprocessor._regrid:607 Loaded regridding scheme Linear('mask') 2025-01-31 16:50:55,097 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:55,098 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005/01_regrid.nc 2025-01-31 16:50:55,471 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:55,472 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsdt/rsdt_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rsut/rsut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc'), LocalFile('/projects/NS9034K/CMIP5/output1/NCC/NorESM1-M/historical/mon/atmos/Amon/r1i1p1/v20120412/rlut/rlut_Amon_NorESM1-M_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc') 2025-01-31 16:50:55,472 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 60; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_NorESM1-M_historical_r0i0p0.nc ...' branch_time 255135.0 cmor_version '2.6.0' contact 'Please send any requests or bug reports to noresm-ncc@met.no.' experiment 'historical' experiment_id 'historical' forcing 'GHG, SA, Oz, Sl, Vl, BC, OC' frequency 'mon' initialization_method 1 institute_id 'NCC' institution 'Norwegian Climate Centre' model_id 'NorESM1-M' modeling_realm 'atmos' original_name 'FLUT' original_units 'W/m2' parent_experiment 'pre-industrial control' parent_experiment_id 'piControl' parent_experiment_rip 'r1i1p1' physics_version 1 product 'output' project_id 'CMIP5' realization 1 source 'NorESM1-M 2011 atmosphere: CAM-Oslo (CAM4-Oslo-noresm-ver1_cmip5-r112, ...' table_id 'Table Amon (27 April 2011) a5a1c518f52ae340313ba0aada03f862' title 'NorESM1-M model output prepared for CMIP5 historical' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/CMIP5_NorESM1-M_Amon_historical_r1i1p1_rtnt_2001-2005.nc 2025-01-31 16:50:55,860 UTC [2300663] DEBUG esmvalcore.preprocessor:681 Applying single-model steps to PreprocessorFile: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2025-01-31 16:50:55,860 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:55,860 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:55,861 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsdt_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:55,861 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] 2025-01-31 16:50:55,861 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:55,861 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:55,862 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:55,874 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:55,874 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:55,874 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_file '/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B ...' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/00_load.nc 2025-01-31 16:50:55,955 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:55,957 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:55,959 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file /scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:55,959 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:55,960 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/01_fix_metadata.nc 2025-01-31 16:50:56,039 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:56,040 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2025-01-31 16:50:56,040 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,041 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/02_concatenate.nc 2025-01-31 16:50:56,128 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:56,128 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:56,130 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsdt: rsdt: attribute positive not present loaded from file 2025-01-31 16:50:56,130 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,130 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/03_cmor_check_metadata.nc 2025-01-31 16:50:56,206 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:56,207 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2025-01-31 16:50:56,210 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,210 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/04_clip_timerange.nc 2025-01-31 16:50:56,289 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:56,290 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsdt', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsdt', standard_name = 'toa_incoming_shortwave_flux', long_name = 'TOA Incident Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:56,290 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,291 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/05_fix_data.nc 2025-01-31 16:50:56,378 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:56,379 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsdt' 2025-01-31 16:50:56,379 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,380 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/06_cmor_check_data.nc 2025-01-31 16:50:56,461 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:56,462 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:56,462 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,462 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_incoming_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'solar_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsdt_2001-2012/07_add_supplementary_variables.nc 2025-01-31 16:50:56,548 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:56,548 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:56,549 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rsut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:56,549 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] 2025-01-31 16:50:56,549 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:56,549 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:56,549 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:56,562 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:56,562 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,563 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_file '/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EB ...' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/00_load.nc 2025-01-31 16:50:56,648 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:56,651 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:56,654 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:56,655 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,655 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/01_fix_metadata.nc 2025-01-31 16:50:56,735 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:56,736 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2025-01-31 16:50:56,737 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,737 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/02_concatenate.nc 2025-01-31 16:50:56,812 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:56,814 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:56,815 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rsut: rsut: attribute positive not present loaded from file 2025-01-31 16:50:56,816 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,817 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/03_cmor_check_metadata.nc 2025-01-31 16:50:56,893 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:56,894 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2025-01-31 16:50:56,898 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,898 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/04_clip_timerange.nc 2025-01-31 16:50:56,979 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:56,980 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rsut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rsut', standard_name = 'toa_outgoing_shortwave_flux', long_name = 'TOA Outgoing Shortwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:56,980 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:56,981 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/05_fix_data.nc 2025-01-31 16:50:57,057 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:57,058 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rsut' 2025-01-31 16:50:57,058 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,059 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/06_cmor_check_data.nc 2025-01-31 16:50:57,137 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:57,138 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:57,138 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,139 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_shortwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_sw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rsut_2001-2012/07_add_supplementary_variables.nc 2025-01-31 16:50:57,218 UTC [2300663] DEBUG esmvalcore.esgf._download:538 All required data is available locally, not downloading anything. 2025-01-31 16:50:57,218 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_file 2025-01-31 16:50:57,219 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) output_dir = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/fixed_files/rlut_Amon_obs4MIPs_CERES-EBAF_v20160610_'), add_unique_suffix = True, session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:57,219 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] 2025-01-31 16:50:57,219 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step load 2025-01-31 16:50:57,219 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) ignore_warnings = None 2025-01-31 16:50:57,219 UTC [2300663] DEBUG esmvalcore.preprocessor._io:98 Loading: /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:57,307 UTC [2300663] DEBUG esmvalcore.preprocessor._io:134 Done with loading /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:57,307 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,308 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_file '/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EB ...' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/00_load.nc 2025-01-31 16:50:57,381 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_metadata 2025-01-31 16:50:57,383 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:57,385 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file /projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc 2025-01-31 16:50:57,385 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,385 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/01_fix_metadata.nc 2025-01-31 16:50:57,458 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step concatenate 2025-01-31 16:50:57,459 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = 2025-01-31 16:50:57,459 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,459 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/02_concatenate.nc 2025-01-31 16:50:57,542 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_metadata 2025-01-31 16:50:57,543 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:57,544 UTC [2300663] WARNING esmvalcore.cmor.check:261 There were warnings in variable rlut: rlut: attribute positive not present loaded from file 2025-01-31 16:50:57,544 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,545 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 170; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/03_cmor_check_metadata.nc 2025-01-31 16:50:57,616 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step clip_timerange 2025-01-31 16:50:57,617 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) timerange = '2001/2012' 2025-01-31 16:50:57,620 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,620 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/04_clip_timerange.nc 2025-01-31 16:50:57,695 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step fix_data 2025-01-31 16:50:57,696 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , session = Session({'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'check_level': , 'compress_netcdf': False, 'config_developer_file': PosixPath('/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvalcore/config-developer.yml'), 'config_file': PosixPath('/nird/home/tomast/.esmvaltool/config-user.yml'), 'diagnostics': None, 'download_dir': PosixPath('/scratch/tomast/ESGF'), 'drs': {'CMIP3': 'DKRZ', 'CMIP5': 'DKRZ', 'CMIP6': 'DKRZ', 'CORDEX': 'DKRZ', 'OBS': 'default', 'OBS6': 'default', 'ana4mips': 'default', 'native6': 'default', 'obs4MIPs': 'default'}, 'exit_on_warning': False, 'extra_facets_dir': (), 'log_level': 'info', 'max_datasets': None, 'max_parallel_tasks': 16, 'max_years': None, 'output_dir': PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output'), 'output_file_type': 'png', 'profile_diagnostic': False, 'remove_preproc_dir': False, 'resume_from': [], 'rootpath': {'CMIP3': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip3')], 'CMIP5': [PosixPath('/projects/NS9560K-datalake/ESGF/cmip5/output1'), PosixPath('/projects/NS9034K/CMIP5/output1'), PosixPath('/scratch/tomast/ESGF/cmip5/output1')], 'CMIP6': [PosixPath('/projects/NS9560K-datalake/ESGF/CMIP6'), PosixPath('/projects/NS9034K/CMIP6'), PosixPath('/projects/NS2980K-datalake/shared/external/CMIP6'), PosixPath('/projects/NS9252K/KeyCLIM_CMOR'), PosixPath('/scratch/tomast/ESGF/CMIP6')], 'OBS': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'OBS6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obsdata')], 'RAWOBS': [PosixPath('/projects/NS9560K-datalake/ESGF/rawdata/obs'), PosixPath('/scratch/tomast/ESGF/rawdata/obs')], 'ana4mips': [PosixPath('/projects/NS9560K-datalake/ESGF/ana4mips'), PosixPath('/scratch/tomast/ESGF/ana4mips')], 'default': [PosixPath('/scratch/tomast/ESGF/obsdata')], 'native6': [PosixPath('/projects/NS9560K-datalake/ESGF/obsdata/native6'), PosixPath('/scratch/tomast/ESGF/obsdata/native6')], 'obs4MIPs': [PosixPath('/projects/NS9560K-datalake/ESGF/obs4MIPs'), PosixPath('/projects/NS9560K-datalake/ESGF/obsdata'), PosixPath('/scratch/tomast/ESGF/obs4MIPs')]}, 'run_diagnostic': True, 'save_intermediary_cubes': True, 'search_esgf': 'when_missing', 'skip_nonexistent': False, 'write_ncl_interface': False}), preprocessor = 'pp_rad_derive_var', derive = True, force_derivation = False, dataset = 'CERES-EBAF', project = 'obs4MIPs', mip = 'Amon', level = 'L3B', version = 'v20160610', tier = 1, short_name = 'rlut', timerange = '2001/2012', recipe_dataset_index = 2, alias = 'obs4MIPs', original_short_name = 'rlut', standard_name = 'toa_outgoing_longwave_flux', long_name = 'TOA Outgoing Longwave Radiation', units = 'W m-2', modeling_realm = [], frequency = 'mon' 2025-01-31 16:50:57,696 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,697 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/05_fix_data.nc 2025-01-31 16:50:57,776 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step cmor_check_data 2025-01-31 16:50:57,777 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) check_level = , cmor_table = 'obs4MIPs', mip = 'Amon', frequency = 'mon', short_name = 'rlut' 2025-01-31 16:50:57,777 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,778 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/06_cmor_check_data.nc 2025-01-31 16:50:57,856 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step add_supplementary_variables 2025-01-31 16:50:57,857 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) supplementary_cubes = [] 2025-01-31 16:50:57,857 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,858 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: toa_outgoing_longwave_flux / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Cell methods: 0 time: mean Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/obs4MIPs_CERES-EBAF_rlut_2001-2012/07_add_supplementary_variables.nc 2025-01-31 16:50:57,935 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step derive 2025-01-31 16:50:57,938 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'derive' on the data [, , ] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) short_name = 'rtnt', standard_name = '', long_name = 'TOA Net downward Total Radiation', units = 'W m-2' 2025-01-31 16:50:57,944 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:57,945 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012/00_derive.nc 2025-01-31 16:50:58,104 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step regrid 2025-01-31 16:50:58,105 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) target_grid = '1x1', scheme = 'linear' 2025-01-31 16:50:58,106 UTC [2300663] DEBUG esmvalcore.preprocessor:412 Result [] 2025-01-31 16:50:58,106 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012/01_regrid.nc 2025-01-31 16:50:58,265 UTC [2300663] DEBUG esmvalcore.preprocessor:387 Running preprocessor step save 2025-01-31 16:50:58,267 UTC [2300663] DEBUG esmvalcore.preprocessor:341 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/scratch/tomast/ESGF/obs4MIPs/CERES-EBAF/v20160610/rsdt_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rsut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier1/CERES-EBAF/rlut_CERES-EBAF_L3B_Ed2-8_200003-201404.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc') 2025-01-31 16:50:58,267 UTC [2300663] DEBUG esmvalcore.preprocessor._io:408 Saving cube: TOA Net downward Total Radiation / (W m-2) (time: 144; latitude: 180; longitude: 360) Dimension coordinates: time x - - latitude - x - longitude - - x Attributes: Conventions 'CF-1.4' associated_files 'baseURL: http://cmip-pcmdi.llnl.gov/CMIP5/dataLocation gridspecFile: gridspec_atmos_fx_Obs-CERES-EBAF_obs_r0i0p0.nc ...' cmor_version '2.8.3' contact 'Norman Loeb, norman.g.loeb@nasa.gov' data_structure 'grid' experiment_id 'obs' frequency 'mon' institute_id 'NASA-LaRC' institution 'NASA Langley Research Center, Hampton, Va, USA' instrument 'CERES' mip_specs 'CMIP5' model_id 'Obs-CERES-EBAF' modeling_realm 'atmos' obs_project 'EBAF' original_name 'toa_lw_all_mon' processing_level 'L3B' processing_version 'Ed2.8' product 'observations' project_id 'obs4MIPs' realm 'atmos' references 'http://ceres.larc.nasa.gov/cmip5_data.php' source 'CERES retrievals' source_id 'CERES-EBAF' source_type 'satellite_retrieval' table_id 'Table Amon_obs (10 March 2011) c2e3700dd6af44ea84f7aba06c34ca30' title 'Obs-CERES-EBAF model output prepared for obs4MIPs OBSERVATIONS' with lazy data to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/preproc/validation_with_CERES-EBAF/rtnt/obs4MIPs_CERES-EBAF_rtnt_2001-2012.nc 2025-01-31 16:50:58,444 UTC [2300663] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/rtnt (priority 3) in 0:00:12.637487 2025-01-31 16:50:58,514 UTC [2300506] INFO esmvalcore._task:793 Progress: 0 tasks running, 3 tasks waiting for ancestors, 2/5 done 2025-01-31 16:50:58,521 UTC [2300665] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/lat_lon in process [2300665] 2025-01-31 16:50:58,523 UTC [2300666] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/zonal_mean in process [2300666] 2025-01-31 16:50:58,523 UTC [2300665] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.11.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon/settings.yml'] 2025-01-31 16:50:58,524 UTC [2300665] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2025-01-31 16:50:58,524 UTC [2300665] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon 2025-01-31 16:50:58,524 UTC [2300665] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/lat_lon 2025-01-31 16:50:58,524 UTC [2300665] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/lat_lon 2025-01-31 16:50:58,524 UTC [2300665] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon/log.txt 2025-01-31 16:50:58,524 UTC [2300665] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.11.0/bin/python /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon/settings.yml 2025-01-31 16:50:58,524 UTC [2300667] INFO esmvalcore._task:261 Starting task validation_with_CERES-EBAF/meridional_mean in process [2300667] 2025-01-31 16:50:58,525 UTC [2300666] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.11.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean/settings.yml'] 2025-01-31 16:50:58,525 UTC [2300666] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2025-01-31 16:50:58,525 UTC [2300666] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean 2025-01-31 16:50:58,525 UTC [2300666] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/zonal_mean 2025-01-31 16:50:58,525 UTC [2300666] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/zonal_mean 2025-01-31 16:50:58,525 UTC [2300666] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean/log.txt 2025-01-31 16:50:58,525 UTC [2300666] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.11.0/bin/python /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean/settings.yml 2025-01-31 16:50:58,526 UTC [2300667] INFO esmvalcore._task:502 Running command ['/projects/NS2980K/conda/esmvaltool2.11.0/bin/python', '/projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py', '/projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean/settings.yml'] 2025-01-31 16:50:58,527 UTC [2300667] DEBUG esmvalcore._task:503 in environment {'MPLBACKEND': 'Agg'} 2025-01-31 16:50:58,527 UTC [2300667] DEBUG esmvalcore._task:505 in current working directory: /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean 2025-01-31 16:50:58,527 UTC [2300667] INFO esmvalcore._task:506 Writing output to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/work/validation_with_CERES-EBAF/meridional_mean 2025-01-31 16:50:58,527 UTC [2300667] INFO esmvalcore._task:507 Writing plots to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/plots/validation_with_CERES-EBAF/meridional_mean 2025-01-31 16:50:58,527 UTC [2300667] INFO esmvalcore._task:508 Writing log to /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean/log.txt 2025-01-31 16:50:58,527 UTC [2300667] INFO esmvalcore._task:518 To re-run this diagnostic script, run: cd /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean; MPLBACKEND="Agg" /projects/NS2980K/conda/esmvaltool2.11.0/bin/python /projects/NS2980K/conda/esmvaltool2.11.0/lib/python3.11/site-packages/esmvaltool/diag_scripts/validation.py /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean/settings.yml 2025-01-31 16:50:58,652 UTC [2300506] INFO esmvalcore._task:793 Progress: 3 tasks running, 0 tasks waiting for ancestors, 2/5 done 2025-01-31 16:51:07,549 UTC [2300667] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.5 GB 2025-01-31 16:51:07,549 UTC [2300666] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.5 GB 2025-01-31 16:51:07,551 UTC [2300667] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2025-01-31 16:51:07,551 UTC [2300666] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2025-01-31 16:51:07,551 UTC [2300666] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2025-01-31 16:51:07,551 UTC [2300667] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2025-01-31 16:51:07,551 UTC [2300666] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/zonal_mean/diagnostic_provenance.yml 2025-01-31 16:51:07,551 UTC [2300667] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/meridional_mean/diagnostic_provenance.yml 2025-01-31 16:51:07,748 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,748 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,748 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,748 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 36294 2025-01-31 16:51:07,750 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,750 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,751 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,751 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 61033 2025-01-31 16:51:07,775 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,775 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,775 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,775 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 34911 2025-01-31 16:51:07,780 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,780 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,780 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,780 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 59742 2025-01-31 16:51:07,805 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,805 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,805 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,805 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 37627 2025-01-31 16:51:07,812 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,812 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,812 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,812 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 56464 2025-01-31 16:51:07,835 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,836 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,836 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,836 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 35974 2025-01-31 16:51:07,844 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,844 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,844 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,844 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 63429 2025-01-31 16:51:07,862 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,862 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,862 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,862 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 34539 2025-01-31 16:51:07,872 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,872 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,872 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,872 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 59563 2025-01-31 16:51:07,888 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,888 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,888 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,888 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 33520 2025-01-31 16:51:07,900 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,900 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,900 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,900 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 60188 2025-01-31 16:51:07,915 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,915 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,915 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,915 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 39072 2025-01-31 16:51:07,928 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,928 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,928 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,928 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 61620 2025-01-31 16:51:07,943 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,943 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,943 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,943 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 37466 2025-01-31 16:51:07,958 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,958 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,958 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,958 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 62299 2025-01-31 16:51:07,970 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,970 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,970 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,970 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 40674 2025-01-31 16:51:07,987 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,987 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,987 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,987 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:07,996 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:07,996 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:07,996 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:07,996 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 38813 2025-01-31 16:51:08,015 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,015 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,015 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,015 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 60883 2025-01-31 16:51:08,023 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,023 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,023 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,023 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 39280 2025-01-31 16:51:08,045 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,045 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,045 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,045 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,052 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,052 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,052 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,053 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 35522 2025-01-31 16:51:08,076 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,076 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,076 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,076 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,080 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,080 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,080 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,080 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 42342 2025-01-31 16:51:08,105 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,105 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,105 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,105 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,107 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,107 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,107 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,108 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 39292 2025-01-31 16:51:08,134 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,134 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,134 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,134 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,134 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,134 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,135 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,135 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 38200 2025-01-31 16:51:08,163 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,163 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,163 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,163 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 35206 2025-01-31 16:51:08,165 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,165 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,165 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,165 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65055 2025-01-31 16:51:08,191 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,191 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,191 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,191 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 57780 2025-01-31 16:51:08,195 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,196 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,196 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,196 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 55870 2025-01-31 16:51:08,221 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,221 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,221 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,221 UTC [2300666] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 43989 2025-01-31 16:51:08,224 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,224 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,224 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,224 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,255 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:08,255 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:08,255 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:08,255 UTC [2300667] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:08,518 UTC [2300666] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/zonal_mean took 1.0 seconds 2025-01-31 16:51:08,518 UTC [2300666] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/zonal_mean (priority 1) in 0:00:09.994930 2025-01-31 16:51:08,575 UTC [2300667] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/meridional_mean took 1.0 seconds 2025-01-31 16:51:08,576 UTC [2300667] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/meridional_mean (priority 2) in 0:00:10.050997 2025-01-31 16:51:08,851 UTC [2300506] INFO esmvalcore._task:793 Progress: 1 tasks running, 0 tasks waiting for ancestors, 4/5 done 2025-01-31 16:51:17,577 UTC [2300665] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.6 GB 2025-01-31 16:51:17,578 UTC [2300665] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2025-01-31 16:51:17,578 UTC [2300665] DEBUG esmvalcore._task:591 Script validation.py completed successfully 2025-01-31 16:51:17,579 UTC [2300665] DEBUG esmvalcore._task:610 Collecting provenance from /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/validation_with_CERES-EBAF/lat_lon/diagnostic_provenance.yml 2025-01-31 16:51:17,738 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,738 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,738 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,738 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,772 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,772 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,772 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,772 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,803 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,803 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,803 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,803 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,835 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,835 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,835 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,835 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,864 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,865 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,865 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,865 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,898 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,898 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,898 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,898 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,933 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,933 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,933 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,933 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:17,969 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:17,969 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:17,969 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:17,969 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:18,001 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:18,001 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:18,001 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:18,001 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:18,033 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IHDR' 16 13 2025-01-31 16:51:18,033 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'tEXt' 41 57 2025-01-31 16:51:18,033 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'pHYs' 110 9 2025-01-31 16:51:18,033 UTC [2300665] DEBUG PIL.PngImagePlugin:198 STREAM b'IDAT' 131 65536 2025-01-31 16:51:18,122 UTC [2300665] DEBUG esmvalcore._task:685 Collecting provenance of task validation_with_CERES-EBAF/lat_lon took 0.5 seconds 2025-01-31 16:51:18,123 UTC [2300665] INFO esmvalcore._task:266 Successfully completed task validation_with_CERES-EBAF/lat_lon (priority 0) in 0:00:19.601847 2025-01-31 16:51:18,158 UTC [2300506] INFO esmvalcore._task:793 Progress: 0 tasks running, 0 tasks waiting for ancestors, 5/5 done 2025-01-31 16:51:18,158 UTC [2300506] INFO esmvalcore._task:798 Successfully completed all tasks. 2025-01-31 16:51:18,191 UTC [2300506] INFO esmvalcore._recipe.recipe:1096 Wrote recipe with version numbers and wildcards to: file:///projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/recipe_validation_filled.yml 2025-01-31 16:51:18,236 UTC [2300506] INFO esmvalcore.experimental.recipe_output:278 Wrote recipe output to: file:///projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/index.html 2025-01-31 16:51:18,236 UTC [2300506] INFO esmvalcore.experimental.recipe_output:248 It looks like you are connected to a remote machine via SSH. To show the output html file, you can try the following command on your local machine: server=10.11.120.250 && port=31415 && ssh -t -L ${port}:localhost:${port} tomast@${server} /projects/NS2980K/conda/esmvaltool2.11.0/bin/python -m http.server ${port} -d /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042 Then visit http://localhost:31415 in your browser 2025-01-31 16:51:18,236 UTC [2300506] INFO esmvalcore.experimental.recipe_output:256 If the port 31415 is already in use, you can replace it with any other free one (e.g., 12789). If you are connected through a jump host, replace the server IP address 10.11.120.250 with your SSH server name 2025-01-31 16:51:18,236 UTC [2300506] INFO esmvalcore._main:133 Ending the Earth System Model Evaluation Tool at time: 2025-01-31 16:51:18 UTC 2025-01-31 16:51:18,236 UTC [2300506] INFO esmvalcore._main:136 Time for running the recipe was: 0:00:35.966778 2025-01-31 16:51:18,288 UTC [2300506] INFO esmvalcore._task:128 Maximum memory used (estimate): 3.7 GB 2025-01-31 16:51:18,289 UTC [2300506] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2025-01-31 16:51:18,290 UTC [2300506] WARNING esmvalcore._main:460 Input data is not (fully) CMOR-compliant, see /projects/NS2980K/www/tomast/esmvaltool2.11.0/output/recipe_validation_20250131_165042/run/cmor_log.txt for details 2025-01-31 16:51:18,290 UTC [2300506] INFO esmvalcore._main:465 Run was successful