2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:492 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:493 Package versions 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:494 ---------------- 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:495 ESMValCore: 2.10.0 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:497 ESMValTool: 2.10.0 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:498 ---------------- 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:499 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2023-12-27 23:11:02,837 UTC [920192] INFO esmvalcore._main:500 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/run/main_log_debug.txt 2023-12-27 23:11:02,986 UTC [920192] INFO esmvalcore.config._esgf_pyclient:116 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2023-12-27 23:11:02,987 UTC [920192] WARNING esmvalcore.config._esgf_pyclient:181 ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. 2023-12-27 23:11:03,083 UTC [920192] INFO esmvalcore._main:91 Starting the Earth System Model Evaluation Tool at time: 2023-12-27 23:11:03 UTC 2023-12-27 23:11:03,083 UTC [920192] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-12-27 23:11:03,083 UTC [920192] INFO esmvalcore._main:96 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/recipes-2.10.0/standard_recipes/land/recipe_landcover.yml 2023-12-27 23:11:03,083 UTC [920192] INFO esmvalcore._main:97 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/run 2023-12-27 23:11:03,083 UTC [920192] INFO esmvalcore._main:98 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/work 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:99 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/preproc 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:100 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.10.0/output/recipe_landcover_20231227_231102/plots 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:101 ---------------------------------------------------------------------- 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:104 Running tasks using at most 256 processes 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:106 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-12-27 23:11:03,084 UTC [920192] INFO esmvalcore._main:109 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-12-27 23:11:03,084 UTC [920192] WARNING esmvalcore.config._dask:18 Using the Dask basic scheduler. This may lead to slow computations and out-of-memory errors. Note that the basic scheduler may still be the best choice for preprocessor functions that are not lazy. In that case, you can safely ignore this warning. See https://docs.esmvaltool.org/projects/ESMValCore/en/latest/quickstart/configure.html#dask-distributed-configuration for more information. 2023-12-27 23:11:03,084 UTC [920192] DEBUG esmvalcore._recipe.check:54 Checking recipe against schema /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-12-27 23:11:03,096 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable baresoilFrac in diagnostic landcover 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: baresoilFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: baresoilFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable grassFrac in diagnostic landcover 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: grassFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: grassFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable treeFrac in diagnostic landcover 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: treeFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1 2023-12-27 23:11:03,097 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: treeFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable shrubFrac in diagnostic landcover 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: shrubFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: shrubFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:343 Populating list of datasets for variable cropFrac in diagnostic landcover 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: cropFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.to_datasets:367 Found Dataset: cropFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.recipe:781 Retrieving diagnostics from recipe 2023-12-27 23:11:03,098 UTC [920192] DEBUG esmvalcore._recipe.recipe:809 Setting script for diagnostic landcover 2023-12-27 23:11:03,099 UTC [920192] INFO esmvalcore._recipe.recipe:999 Creating tasks from recipe 2023-12-27 23:11:03,099 UTC [920192] INFO esmvalcore._recipe.recipe:1008 Creating tasks for diagnostic landcover 2023-12-27 23:11:03,099 UTC [920192] INFO esmvalcore._recipe.recipe:930 Creating diagnostic task landcover/landcover 2023-12-27 23:11:03,100 UTC [920192] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task landcover/baresoilFrac 2023-12-27 23:11:03,100 UTC [920192] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'prep0' task for variable 'baresoilFrac' 2023-12-27 23:11:03,100 UTC [920192] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-12-27 23:11:03,101 UTC [920192] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-12-27 23:11:03,118 UTC [920192] DEBUG esmvalcore.config._config:45 Loading extra facets from /projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-12-27 23:11:03,122 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc 2023-12-27 23:11:03,122 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'baresoilFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'baresoilFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Bare Soil Fraction', 'modeling_realm': ['land'], 'original_short_name': 'baresoilFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:11:03,123 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc 2023-12-27 23:11:03,123 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:11:03,124 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/baresoilFrac/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/baresoilFrac/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/baresoilFrac/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc 2023-12-27 23:11:03,126 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'baresoilFrac'} 2023-12-27 23:11:03,126 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:11:03,126 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:11:03,126 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:11:03,127 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:11:03,127 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:11:03,130 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:11:03,130 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:11:03,130 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:11:03,131 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-12-27 23:12:46,198 UTC [920192] DEBUG esmvalcore.esgf._search:129 Unable to connect to https://esgf.ceda.ac.uk/esg-search due to HTTPSConnectionPool(host='esgf.ceda.ac.uk', port=443): Max retries exceeded with url: /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=baresoilFrac (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1006)'))) 2023-12-27 23:12:46,198 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf-node.llnl.gov/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'baresoilFrac'} 2023-12-27 23:12:46,198 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:12:46,198 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:12:46,198 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:12:46,199 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:12:46,199 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:12:46,201 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:12:46,201 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:12:46,201 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:12:46,201 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf-node.llnl.gov:443 2023-12-27 23:12:47,094 UTC [920192] DEBUG urllib3.connectionpool:546 https://esgf-node.llnl.gov:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=baresoilFrac HTTP/1.1" 200 None 2023-12-27 23:12:47,261 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-27 23:12:47,533 UTC [920192] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-27 23:12:47,533 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:47,534 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:47,534 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:47,534 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:47,534 UTC [920192] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'baresoilFrac'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:47,535 UTC [920192] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:47,535 UTC [920192] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable baresoilFrac of dataset CMIP5: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/baresoilFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc (will be downloaded) 2023-12-27 23:12:47,535 UTC [920192] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: baresoilFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1, v20120625 2023-12-27 23:12:47,536 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc 2023-12-27 23:12:47,536 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'baresoilFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'baresoilFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Bare Soil Fraction', 'modeling_realm': ['land'], 'original_short_name': 'baresoilFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:47,537 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_baresoilFrac[_.]*nc 2023-12-27 23:12:47,537 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:47,537 UTC [920192] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task landcover/grassFrac 2023-12-27 23:12:47,537 UTC [920192] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'prep0' task for variable 'grassFrac' 2023-12-27 23:12:47,537 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc 2023-12-27 23:12:47,537 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'grassFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'grassFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Natural Grass Fraction', 'modeling_realm': ['land'], 'original_short_name': 'grassFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:47,538 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc 2023-12-27 23:12:47,538 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:47,538 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/grassFrac/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/grassFrac/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/grassFrac/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc 2023-12-27 23:12:47,538 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf-node.llnl.gov/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'grassFrac'} 2023-12-27 23:12:47,538 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:12:47,539 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:12:47,539 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:12:47,539 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:12:47,539 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:12:47,541 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:12:47,541 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:12:47,541 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:12:47,542 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf-node.llnl.gov:443 2023-12-27 23:12:48,581 UTC [920192] DEBUG urllib3.connectionpool:546 https://esgf-node.llnl.gov:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=grassFrac HTTP/1.1" 200 None 2023-12-27 23:12:48,748 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-27 23:12:48,810 UTC [920192] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-27 23:12:48,811 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:48,811 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:48,811 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:48,811 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:48,812 UTC [920192] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'grassFrac'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:48,812 UTC [920192] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:48,812 UTC [920192] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable grassFrac of dataset CMIP5: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/grassFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc (will be downloaded) 2023-12-27 23:12:48,812 UTC [920192] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: grassFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1, v20120625 2023-12-27 23:12:48,812 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc 2023-12-27 23:12:48,813 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'grassFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'grassFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Natural Grass Fraction', 'modeling_realm': ['land'], 'original_short_name': 'grassFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:48,813 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_grassFrac[_.]*nc 2023-12-27 23:12:48,813 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:48,813 UTC [920192] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task landcover/treeFrac 2023-12-27 23:12:48,813 UTC [920192] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'prep0' task for variable 'treeFrac' 2023-12-27 23:12:48,813 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc 2023-12-27 23:12:48,814 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'treeFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'treeFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Tree Cover Fraction', 'modeling_realm': ['land'], 'original_short_name': 'treeFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:48,814 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc 2023-12-27 23:12:48,814 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:48,814 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/treeFrac/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/treeFrac/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/treeFrac/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc 2023-12-27 23:12:48,815 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf-node.llnl.gov/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'treeFrac'} 2023-12-27 23:12:48,815 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:12:48,815 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:12:48,815 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:12:48,815 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:12:48,815 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:12:48,817 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:12:48,817 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:12:48,817 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:12:48,818 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf-node.llnl.gov:443 2023-12-27 23:12:49,541 UTC [920192] DEBUG urllib3.connectionpool:546 https://esgf-node.llnl.gov:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=treeFrac HTTP/1.1" 200 None 2023-12-27 23:12:49,709 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-27 23:12:49,774 UTC [920192] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'treeFrac'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:49,775 UTC [920192] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:49,776 UTC [920192] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable treeFrac of dataset CMIP5: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/treeFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc (will be downloaded) 2023-12-27 23:12:49,776 UTC [920192] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: treeFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1, v20120625 2023-12-27 23:12:49,776 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc 2023-12-27 23:12:49,776 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'treeFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'treeFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Tree Cover Fraction', 'modeling_realm': ['land'], 'original_short_name': 'treeFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:49,776 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_treeFrac[_.]*nc 2023-12-27 23:12:49,777 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:49,777 UTC [920192] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task landcover/shrubFrac 2023-12-27 23:12:49,777 UTC [920192] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'prep0' task for variable 'shrubFrac' 2023-12-27 23:12:49,777 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc 2023-12-27 23:12:49,777 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'shrubFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'shrubFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Shrub Fraction', 'modeling_realm': ['land'], 'original_short_name': 'shrubFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:49,778 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc 2023-12-27 23:12:49,778 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:49,778 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/shrubFrac/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/shrubFrac/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/shrubFrac/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc 2023-12-27 23:12:49,778 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf-node.llnl.gov/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'shrubFrac'} 2023-12-27 23:12:49,778 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:12:49,779 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:12:49,779 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:12:49,779 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:12:49,779 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:12:49,781 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:12:49,781 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:12:49,781 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:12:49,781 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf-node.llnl.gov:443 2023-12-27 23:12:50,487 UTC [920192] DEBUG urllib3.connectionpool:546 https://esgf-node.llnl.gov:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=shrubFrac HTTP/1.1" 200 None 2023-12-27 23:12:50,655 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-27 23:12:50,760 UTC [920192] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'shrubFrac'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:50,761 UTC [920192] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:50,762 UTC [920192] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable shrubFrac of dataset CMIP5: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/shrubFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc (will be downloaded) 2023-12-27 23:12:50,762 UTC [920192] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: shrubFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1, v20120625 2023-12-27 23:12:50,762 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc 2023-12-27 23:12:50,762 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'shrubFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'shrubFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Shrub Fraction', 'modeling_realm': ['land'], 'original_short_name': 'shrubFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:50,763 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_shrubFrac[_.]*nc 2023-12-27 23:12:50,763 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:50,763 UTC [920192] INFO esmvalcore._recipe.recipe:983 Creating preprocessor task landcover/cropFrac 2023-12-27 23:12:50,763 UTC [920192] INFO esmvalcore._recipe.recipe:653 Creating preprocessor 'prep0' task for variable 'cropFrac' 2023-12-27 23:12:50,763 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc 2023-12-27 23:12:50,764 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'cropFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'cropFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Crop Fraction', 'modeling_realm': ['land'], 'original_short_name': 'cropFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:50,764 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc 2023-12-27 23:12:50,764 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:50,764 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/cropFrac/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/cropFrac/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/*/cropFrac/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1*.nc 2023-12-27 23:12:50,765 UTC [920192] DEBUG esmvalcore.esgf._search:116 Searching https://esgf-node.llnl.gov/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'cropFrac'} 2023-12-27 23:12:50,765 UTC [920192] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-12-27 23:12:50,765 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-12-27 23:12:50,765 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-12-27 23:12:50,765 UTC [920192] DEBUG requests_cache.backends.base:384 Initialized SQLiteDict with serializer: None 2023-12-27 23:12:50,765 UTC [920192] DEBUG requests_cache.backends.sqlite:234 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-12-27 23:12:50,767 UTC [920192] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-12-27 23:12:50,767 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-read cache checks: Passed 2023-12-27 23:12:50,767 UTC [920192] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-12-27 23:12:50,768 UTC [920192] DEBUG urllib3.connectionpool:1052 Starting new HTTPS connection (1): esgf-node.llnl.gov:443 2023-12-27 23:12:51,676 UTC [920192] DEBUG urllib3.connectionpool:546 https://esgf-node.llnl.gov:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=rcp85&time_frequency=mon&institute=MPI-M&cmor_table=Lmon&product=output1%2Coutput2&variable=cropFrac HTTP/1.1" 200 None 2023-12-27 23:12:51,844 UTC [920192] DEBUG requests_cache.policy.actions:344 Pre-write cache checks: Passed 2023-12-27 23:12:51,905 UTC [920192] DEBUG requests_cache.backends.base:106 Closing backend connections 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'modeling_realm' from 'None' to 'land' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._download:272 Correcting facet 'version' from 'None' to 'v20120625' for cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.mon.land.Lmon.r1i1p1.v20120625.cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._search:154 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'rcp85', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Lmon', 'product': 'output1,output2', 'variable': 'cropFrac'}: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_210101-230012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:51,906 UTC [920192] DEBUG esmvalcore.esgf._search:364 Selected files: ESGFFile:cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc on hosts ['aims3.llnl.gov', 'esgf.ceda.ac.uk', 'esgf.nci.org.au', 'esgf1.dkrz.de'] 2023-12-27 23:12:51,907 UTC [920192] DEBUG esmvalcore._recipe.recipe:263 Using input files for variable cropFrac of dataset CMIP5: /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/rcp85/mon/land/Lmon/r1i1p1/v20120625/cropFrac_Lmon_MPI-ESM-LR_rcp85_r1i1p1_200601-210012.nc (will be downloaded) 2023-12-27 23:12:51,907 UTC [920192] INFO esmvalcore._recipe.recipe:520 Found input files for Dataset: cropFrac, Lmon, CMIP5, MPI-ESM-LR, rcp85, r1i1p1, v20120625 2023-12-27 23:12:51,907 UTC [920192] DEBUG esmvalcore.local:444 Looking for files matching: /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc 2023-12-27 23:12:51,907 UTC [920192] ERROR esmvalcore._recipe.check:120 No input files found for Dataset: {'diagnostic': 'landcover', 'variable_group': 'cropFrac', 'dataset': 'ESACCI-LANDCOVER', 'project': 'OBS', 'mip': 'Lmon', 'short_name': 'cropFrac', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Crop Fraction', 'modeling_realm': ['land'], 'original_short_name': 'cropFrac', 'preprocessor': 'prep0', 'recipe_dataset_index': 1, 'reference_dataset': 'ESACCI-LANDCOVER', 'standard_name': 'area_fraction', 'tier': 2, 'timerange': '2008/2012', 'type': 'sat', 'units': '%', 'version': 'L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg'} session: 'recipe_landcover_20231227_231102' 2023-12-27 23:12:51,907 UTC [920192] ERROR esmvalcore._recipe.check:126 Looked for files matching /projects/NS9560K-datalake/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/ESACCI-LANDCOVER/OBS_ESACCI-LANDCOVER_sat_L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg_Lmon_cropFrac[_.]*nc 2023-12-27 23:12:51,907 UTC [920192] ERROR esmvalcore._recipe.check:127 Set 'log_level' to 'debug' to get more information 2023-12-27 23:12:51,907 UTC [920192] ERROR esmvalcore._recipe.recipe:727 Could not create all tasks 2023-12-27 23:12:51,908 UTC [920192] ERROR esmvalcore._recipe.recipe:729 Missing data for preprocessor landcover/baresoilFrac: - Missing data for Dataset: baresoilFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:12:51,908 UTC [920192] ERROR esmvalcore._recipe.recipe:729 Missing data for preprocessor landcover/grassFrac: - Missing data for Dataset: grassFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:12:51,908 UTC [920192] ERROR esmvalcore._recipe.recipe:729 Missing data for preprocessor landcover/treeFrac: - Missing data for Dataset: treeFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:12:51,908 UTC [920192] ERROR esmvalcore._recipe.recipe:729 Missing data for preprocessor landcover/shrubFrac: - Missing data for Dataset: shrubFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:12:51,908 UTC [920192] ERROR esmvalcore._recipe.recipe:729 Missing data for preprocessor landcover/cropFrac: - Missing data for Dataset: cropFrac, Lmon, OBS, ESACCI-LANDCOVER, L4-LCCS-Map-300m-P5Y-aggregated-0.500000Deg 2023-12-27 23:12:52,179 UTC [920192] INFO esmvalcore._task:128 Maximum memory used (estimate): 0.3 GB 2023-12-27 23:12:52,180 UTC [920192] INFO esmvalcore._task:130 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-12-27 23:12:52,181 UTC [920192] ERROR esmvalcore._main:523 Could not create all tasks 2023-12-27 23:12:52,181 UTC [920192] DEBUG esmvalcore._main:524 Stack trace for debugging: Traceback (most recent call last): File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_main.py", line 518, in run fire.Fire(ESMValTool()) File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( ^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_main.py", line 405, in run self._run(recipe, session) File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_main.py", line 447, in _run process_recipe(recipe_file=recipe, session=session) File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_main.py", line 127, in process_recipe recipe = read_recipe_file(recipe_file, session) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe.py", line 73, in read_recipe_file return Recipe(raw_recipe, session, recipe_file=filename) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe.py", line 720, in __init__ self.tasks = self.initialize_tasks() ^^^^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe.py", line 1046, in initialize_tasks tasks = self._create_tasks() ^^^^^^^^^^^^^^^^^^^^ File "/projects/NS2980K/conda/esmvaltool2.10.0/lib/python3.11/site-packages/esmvalcore/_recipe/recipe.py", line 1034, in _create_tasks raise recipe_error esmvalcore.exceptions.RecipeError: Could not create all tasks