2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:496 Package versions 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:497 ---------------- 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:501 ---------------- 2023-06-22 21:32:14,174 UTC [1511606] INFO esmvalcore._main:502 Using config file /nird/home/tomast/.esmvaltool/config-user.yml 2023-06-22 21:32:14,175 UTC [1511606] INFO esmvalcore._main:503 Writing program log files to: /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/run/main_log.txt /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/run/main_log_debug.txt 2023-06-22 21:32:14,345 UTC [1511606] INFO esmvalcore.config._esgf_pyclient:116 Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. 2023-06-22 21:32:14,346 UTC [1511606] WARNING esmvalcore.config._esgf_pyclient:181 ESGF credentials missing, only data that is accessible without logging in will be available. See https://esgf.github.io/esgf-user-support/user_guide.html for instructions on how to create an account if you do not have one yet. Next, configure your system so esmvaltool can use your credentials. This can be done using the keyring package, or you can just enter them in /nird/home/tomast/.esmvaltool/esgf-pyclient.yml. keyring ======= First install the keyring package (requires a supported backend, see https://pypi.org/project/keyring/): $ pip install keyring Next, set your username and password by running the commands: $ keyring set ESGF hostname $ keyring set ESGF username $ keyring set ESGF password To check that you entered your credentials correctly, run: $ keyring get ESGF hostname $ keyring get ESGF username $ keyring get ESGF password configuration file ================== You can store the hostname, username, and password or your OpenID account in a plain text in the file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml like this: logon: hostname: "your-hostname" username: "your-username" password: "your-password" or your can configure an interactive log in: logon: interactive: true Note that storing your password in plain text in the configuration file is less secure. On shared systems, make sure the permissions of the file are set so only you can read it, i.e. $ ls -l /nird/home/tomast/.esmvaltool/esgf-pyclient.yml shows permissions -rw-------. 2023-06-22 21:32:14,803 UTC [1511606] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-06-22 21:32:14 UTC 2023-06-22 21:32:14,803 UTC [1511606] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:90 RECIPE = /projects/NS2980K/home/tomast/ESMValTool/recipes-2.8.0/recipe_lauer22jclim_fig2_taylor.yml 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:91 RUNDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/run 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:92 WORKDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/work 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/preproc 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:94 PLOTDIR = /projects/NS2980K/www/tomast/esmvaltool2.8.0/recipe_lauer22jclim_fig2_taylor_20230622_213214/plots 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:98 Running tasks using at most 255 processes 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-06-22 21:32:14,804 UTC [1511606] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-06-22 21:32:14,806 UTC [1511606] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-06-22 21:32:14,975 UTC [1511606] INFO esmvalcore._recipe.recipe:999 NCL script detected, checking NCL version 2023-06-22 21:32:15,319 UTC [1511606] INFO esmvalcore._recipe.check:41 Found NCL version 6.6.2 2023-06-22 21:32:15,399 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable clt in diagnostic clouds_tay 2023-06-22 21:32:15,400 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-06-22 21:32:15,400 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, ACCESS1-3, historical, r1i1p1 2023-06-22 21:32:15,400 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1 2023-06-22 21:32:15,400 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, bcc-csm1-1-m, historical, r1i1p1 2023-06-22 21:32:15,401 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, BNU-ESM, historical, r1i1p1 2023-06-22 21:32:15,401 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-06-22 21:32:15,401 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CCSM4, historical, r1i1p1 2023-06-22 21:32:15,402 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CESM1-BGC, historical, r1i1p1 2023-06-22 21:32:15,402 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CESM1-CAM5, historical, r1i1p1 2023-06-22 21:32:15,402 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CESM1-FASTCHEM, historical, r1i1p1 2023-06-22 21:32:15,402 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CESM1-WACCM, historical, r1i1p1 2023-06-22 21:32:15,402 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CMCC-CESM, historical, r1i1p1 2023-06-22 21:32:15,403 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CMCC-CM, historical, r1i1p1 2023-06-22 21:32:15,403 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, CSIRO-Mk3-6-0, historical, r1i1p1 2023-06-22 21:32:15,403 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, FGOALS-g2, historical, r1i1p1 2023-06-22 21:32:15,404 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, FIO-ESM, historical, r1i1p1 2023-06-22 21:32:15,404 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GFDL-CM3, historical, r1i1p1 2023-06-22 21:32:15,404 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1 2023-06-22 21:32:15,404 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GFDL-ESM2M, historical, r1i1p1 2023-06-22 21:32:15,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GISS-E2-H-CC, historical, r1i1p1 2023-06-22 21:32:15,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GISS-E2-H, historical, r1i1p1 2023-06-22 21:32:15,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GISS-E2-R-CC, historical, r1i1p1 2023-06-22 21:32:15,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, GISS-E2-R, historical, r1i1p1 2023-06-22 21:32:15,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, HadGEM2-CC, historical, r1i1p1 2023-06-22 21:32:15,406 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, HadGEM2-ES, historical, r1i1p1 2023-06-22 21:32:15,406 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, inmcm4, historical, r1i1p1 2023-06-22 21:32:15,406 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, IPSL-CM5A-LR, historical, r1i1p1 2023-06-22 21:32:15,406 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, IPSL-CM5A-MR, historical, r1i1p1 2023-06-22 21:32:15,407 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, IPSL-CM5B-LR, historical, r1i1p1 2023-06-22 21:32:15,407 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MIROC4h, historical, r1i1p1 2023-06-22 21:32:15,407 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MIROC5, historical, r1i1p1 2023-06-22 21:32:15,407 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MIROC-ESM-CHEM, historical, r1i1p1 2023-06-22 21:32:15,408 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MIROC-ESM, historical, r1i1p1 2023-06-22 21:32:15,408 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-06-22 21:32:15,408 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MPI-ESM-MR, historical, r1i1p1 2023-06-22 21:32:15,408 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MPI-ESM-P, historical, r1i1p1 2023-06-22 21:32:15,409 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MRI-CGCM3, historical, r1i1p1 2023-06-22 21:32:15,409 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, MRI-ESM1, historical, r1i1p1 2023-06-22 21:32:15,409 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, NorESM1-ME, historical, r1i1p1 2023-06-22 21:32:15,409 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2023-06-22 21:32:15,410 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, AWI-ESM-1-1-LR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,410 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, BCC-CSM2-MR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,410 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CAMS-CSM1-0, historical, r1i1p1f1, gn 2023-06-22 21:32:15,410 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CESM2-FV2, historical, r1i1p1f1, gn 2023-06-22 21:32:15,411 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CESM2, historical, r1i1p1f1, gn 2023-06-22 21:32:15,411 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CESM2-WACCM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,411 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CNRM-CM6-1-HR, historical, r1i1p1f2, gr 2023-06-22 21:32:15,411 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CNRM-CM6-1, historical, r1i1p1f2, gr 2023-06-22 21:32:15,412 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, CNRM-ESM2-1, historical, r1i1p1f2, gr 2023-06-22 21:32:15,412 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, FGOALS-g3, historical, r1i1p1f1, gn 2023-06-22 21:32:15,412 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, GFDL-CM4, historical, r1i1p1f1, gr1 2023-06-22 21:32:15,412 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, GFDL-ESM4, historical, r1i1p1f1, gr1 2023-06-22 21:32:15,413 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, GISS-E2-1-G, historical, r1i1p1f1, gn 2023-06-22 21:32:15,413 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, GISS-E2-1-H, historical, r1i1p1f1, gn 2023-06-22 21:32:15,413 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, HadGEM3-GC31-LL, historical, r1i1p1f3, gn 2023-06-22 21:32:15,413 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, IPSL-CM6A-LR, historical, r3i1p1f1, gr 2023-06-22 21:32:15,414 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, KACE-1-0-G, historical, r1i1p1f1, gr 2023-06-22 21:32:15,414 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MIROC6, historical, r1i1p1f1, gn 2023-06-22 21:32:15,414 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MIROC-ES2L, historical, r1i1p1f2, gn 2023-06-22 21:32:15,414 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MPI-ESM-1-2-HAM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,415 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MPI-ESM1-2-HR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,415 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MPI-ESM1-2-LR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,415 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, MRI-ESM2-0, historical, r1i1p1f1, gn 2023-06-22 21:32:15,415 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, NESM3, historical, r1i1p1f1, gn 2023-06-22 21:32:15,416 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, NorESM2-LM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,416 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, SAM0-UNICON, historical, r1i1p1f1, gn 2023-06-22 21:32:15,416 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, TaiESM1, historical, r1i1p1f1, gn 2023-06-22 21:32:15,417 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, CMIP6, UKESM1-0-LL, historical, r1i1p1f2, gn 2023-06-22 21:32:15,417 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, OBS, ESACCI-CLOUD, historical, AVHRR-AMPM-fv3.0 2023-06-22 21:32:15,417 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, OBS, CLARA-AVHRR, historical, V002_01 2023-06-22 21:32:15,417 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, OBS, PATMOS-x, historical, NOAA 2023-06-22 21:32:15,417 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, OBS, MODIS, historical, MYD08-M3 2023-06-22 21:32:15,418 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, native6, ERA5, historical, v1 2023-06-22 21:32:15,418 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clt, Amon, OBS6, ERA-Interim, historical, 1 2023-06-22 21:32:15,418 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable clivi in diagnostic clouds_tay 2023-06-22 21:32:15,418 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-06-22 21:32:15,419 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, ACCESS1-3, historical, r1i1p1 2023-06-22 21:32:15,419 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1 2023-06-22 21:32:15,419 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, bcc-csm1-1-m, historical, r1i1p1 2023-06-22 21:32:15,419 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, BNU-ESM, historical, r1i1p1 2023-06-22 21:32:15,420 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-06-22 21:32:15,420 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CCSM4, historical, r1i1p1 2023-06-22 21:32:15,420 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CESM1-BGC, historical, r1i1p1 2023-06-22 21:32:15,420 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CESM1-CAM5, historical, r1i1p1 2023-06-22 21:32:15,421 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CESM1-FASTCHEM, historical, r1i1p1 2023-06-22 21:32:15,421 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CESM1-WACCM, historical, r1i1p1 2023-06-22 21:32:15,421 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CMCC-CESM, historical, r1i1p1 2023-06-22 21:32:15,421 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CMCC-CM, historical, r1i1p1 2023-06-22 21:32:15,422 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, CSIRO-Mk3-6-0, historical, r1i1p1 2023-06-22 21:32:15,422 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, FGOALS-g2, historical, r1i1p1 2023-06-22 21:32:15,422 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, FIO-ESM, historical, r1i1p1 2023-06-22 21:32:15,422 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GFDL-CM3, historical, r1i1p1 2023-06-22 21:32:15,423 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1 2023-06-22 21:32:15,423 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GFDL-ESM2M, historical, r1i1p1 2023-06-22 21:32:15,423 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GISS-E2-H-CC, historical, r1i1p1 2023-06-22 21:32:15,423 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GISS-E2-H, historical, r1i1p1 2023-06-22 21:32:15,424 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GISS-E2-R-CC, historical, r1i1p1 2023-06-22 21:32:15,424 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, GISS-E2-R, historical, r1i1p1 2023-06-22 21:32:15,424 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, HadGEM2-CC, historical, r1i1p1 2023-06-22 21:32:15,424 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, HadGEM2-ES, historical, r1i1p1 2023-06-22 21:32:15,425 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, inmcm4, historical, r1i1p1 2023-06-22 21:32:15,425 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, IPSL-CM5A-LR, historical, r1i1p1 2023-06-22 21:32:15,425 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, IPSL-CM5A-MR, historical, r1i1p1 2023-06-22 21:32:15,425 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, IPSL-CM5B-LR, historical, r1i1p1 2023-06-22 21:32:15,425 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MIROC4h, historical, r1i1p1 2023-06-22 21:32:15,426 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MIROC5, historical, r1i1p1 2023-06-22 21:32:15,426 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MIROC-ESM-CHEM, historical, r1i1p1 2023-06-22 21:32:15,426 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MIROC-ESM, historical, r1i1p1 2023-06-22 21:32:15,426 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-06-22 21:32:15,427 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MPI-ESM-MR, historical, r1i1p1 2023-06-22 21:32:15,427 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MPI-ESM-P, historical, r1i1p1 2023-06-22 21:32:15,427 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MRI-CGCM3, historical, r1i1p1 2023-06-22 21:32:15,427 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, MRI-ESM1, historical, r1i1p1 2023-06-22 21:32:15,428 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, NorESM1-ME, historical, r1i1p1 2023-06-22 21:32:15,428 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP5, NorESM1-M, historical, r1i1p1 2023-06-22 21:32:15,428 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, AWI-ESM-1-1-LR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,428 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, BCC-CSM2-MR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,428 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CAMS-CSM1-0, historical, r1i1p1f1, gn 2023-06-22 21:32:15,429 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CESM2-FV2, historical, r1i1p1f1, gn 2023-06-22 21:32:15,429 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CESM2, historical, r1i1p1f1, gn 2023-06-22 21:32:15,429 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CESM2-WACCM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,429 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CNRM-CM6-1-HR, historical, r1i1p1f2, gr 2023-06-22 21:32:15,430 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CNRM-CM6-1, historical, r1i1p1f2, gr 2023-06-22 21:32:15,430 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, CNRM-ESM2-1, historical, r1i1p1f2, gr 2023-06-22 21:32:15,430 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, FGOALS-g3, historical, r1i1p1f1, gn 2023-06-22 21:32:15,430 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, GFDL-CM4, historical, r1i1p1f1, gr1 2023-06-22 21:32:15,431 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, GFDL-ESM4, historical, r1i1p1f1, gr1 2023-06-22 21:32:15,431 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, GISS-E2-1-G, historical, r1i1p1f1, gn 2023-06-22 21:32:15,431 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, GISS-E2-1-H, historical, r1i1p1f1, gn 2023-06-22 21:32:15,431 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, HadGEM3-GC31-LL, historical, r1i1p1f3, gn 2023-06-22 21:32:15,432 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, IPSL-CM6A-LR, historical, r3i1p1f1, gr 2023-06-22 21:32:15,432 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, KACE-1-0-G, historical, r1i1p1f1, gr 2023-06-22 21:32:15,432 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MIROC6, historical, r1i1p1f1, gn 2023-06-22 21:32:15,432 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MIROC-ES2L, historical, r1i1p1f2, gn 2023-06-22 21:32:15,433 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MPI-ESM-1-2-HAM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,433 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MPI-ESM1-2-HR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,433 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MPI-ESM1-2-LR, historical, r1i1p1f1, gn 2023-06-22 21:32:15,434 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, MRI-ESM2-0, historical, r1i1p1f1, gn 2023-06-22 21:32:15,434 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, NESM3, historical, r1i1p1f1, gn 2023-06-22 21:32:15,434 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, NorESM2-LM, historical, r1i1p1f1, gn 2023-06-22 21:32:15,434 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, SAM0-UNICON, historical, r1i1p1f1, gn 2023-06-22 21:32:15,435 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, TaiESM1, historical, r1i1p1f1, gn 2023-06-22 21:32:15,435 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, CMIP6, UKESM1-0-LL, historical, r1i1p1f2, gn 2023-06-22 21:32:15,435 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, OBS, ESACCI-CLOUD, historical, AVHRR-AMPM-fv3.0 2023-06-22 21:32:15,435 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, OBS, CLOUDSAT-L2, historical, P1-R05-gridbox-average-noprecip 2023-06-22 21:32:15,435 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, OBS, CLARA-AVHRR, historical, V002_01 2023-06-22 21:32:15,436 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, OBS, MODIS, historical, MYD08-M3 2023-06-22 21:32:15,436 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, native6, ERA5, historical, v1 2023-06-22 21:32:15,436 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: clivi, Amon, OBS6, ERA-Interim, historical, 1 2023-06-22 21:32:15,436 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable lwp in diagnostic clouds_tay 2023-06-22 21:32:15,437 UTC [1511606] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-06-22 21:32:15,438 UTC [1511606] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-06-22 21:32:15,466 UTC [1511606] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-06-22 21:32:15,472 UTC [1511606] WARNING esmvalcore.local:426 'CMIP5' rootpaths '/scratch/tomast/ESGF/cmip5/output1' set in config-user.yml do not exist 2023-06-22 21:32:15,472 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-06-22 21:32:15,476 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'ACCESS1.0', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-BOM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:15,476 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:15,476 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:15,476 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:15,477 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:15,477 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:15,480 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:15,480 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:15,480 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:15,481 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:15,859 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=ACCESS1.0&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CSIRO-BOM&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1273 2023-06-22 21:32:15,860 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:15,869 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:15,870 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'ACCESS1.0', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-BOM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:15,870 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:15,870 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-06-22 21:32:15,871 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-3_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CSIRO-BOM/ACCESS1-3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CSIRO-BOM/ACCESS1-3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-3_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_ACCESS1-3_historical_r1i1p1*.nc 2023-06-22 21:32:15,875 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'ACCESS1.3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-BOM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:15,875 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:15,875 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:15,875 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:15,875 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:15,875 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:15,877 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:15,877 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:15,877 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:15,878 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:16,039 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=ACCESS1.3&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CSIRO-BOM&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1271 2023-06-22 21:32:16,040 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:16,045 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:16,046 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'ACCESS1.3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-BOM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:16,046 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:16,046 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, ACCESS1-3, historical, r1i1p1 2023-06-22 21:32:16,047 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/BCC/bcc-csm1-1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1_historical_r1i1p1*.nc 2023-06-22 21:32:16,066 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'BCC-CSM1.1', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:16,066 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:16,066 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:16,066 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:16,066 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:16,067 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:16,068 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:16,068 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:16,068 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:16,069 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:16,230 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=BCC-CSM1.1&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=BCC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1266 2023-06-22 21:32:16,230 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:16,236 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:16,237 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'BCC-CSM1.1', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:16,237 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:16,237 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, bcc-csm1-1, historical, r1i1p1 2023-06-22 21:32:16,238 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/BCC/bcc-csm1-1-m/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1-m_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/BCC/bcc-csm1-1-m/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1-m_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/BCC/bcc-csm1-1-m/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1-m_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/BCC/bcc-csm1-1-m/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1-m_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/BCC/bcc-csm1-1-m/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_bcc-csm1-1-m_historical_r1i1p1*.nc 2023-06-22 21:32:16,241 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'BCC-CSM1.1(m)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:16,241 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:16,241 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:16,241 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:16,241 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:16,241 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:16,243 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:16,243 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:16,243 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:16,244 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:16,388 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=BCC-CSM1.1%28m%29&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=BCC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1269 2023-06-22 21:32:16,388 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:16,394 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:16,395 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'BCC-CSM1.1(m)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:16,395 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:16,395 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, bcc-csm1-1-m, historical, r1i1p1 2023-06-22 21:32:16,396 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/BNU/BNU-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_BNU-ESM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/BNU/BNU-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_BNU-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/BNU/BNU-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_BNU-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/BNU/BNU-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_BNU-ESM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/BNU/BNU-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_BNU-ESM_historical_r1i1p1*.nc 2023-06-22 21:32:16,418 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'BNU-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BNU', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:16,418 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:16,418 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:16,419 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:16,419 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:16,419 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:16,421 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:16,421 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:16,421 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:16,421 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:16,564 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=BNU-ESM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=BNU&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1263 2023-06-22 21:32:16,564 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:16,639 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:16,640 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'BNU-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'BNU', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:16,640 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:16,641 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, BNU-ESM, historical, r1i1p1 2023-06-22 21:32:16,641 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CanESM2_historical_r1i1p1*.nc 2023-06-22 21:32:16,644 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CanESM2', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CCCma,CCCMA', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:16,644 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:16,644 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:16,644 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:16,645 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:16,645 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:16,646 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:16,646 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:16,647 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:16,647 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:16,801 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CanESM2&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CCCma%2CCCCMA&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1289 2023-06-22 21:32:16,802 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:16,885 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:16,886 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CanESM2', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CCCma,CCCMA', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:16,886 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:16,886 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-06-22 21:32:16,887 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NCAR/CCSM4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CCSM4_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NCAR/CCSM4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CCSM4_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NCAR/CCSM4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CCSM4_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NCAR/CCSM4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CCSM4_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NCAR/CCSM4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CCSM4_historical_r1i1p1*.nc 2023-06-22 21:32:16,891 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CCSM4', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:16,891 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:16,891 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:16,891 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:16,891 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:16,891 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:16,893 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:16,893 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:16,893 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:16,894 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:17,044 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CCSM4&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NCAR&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1263 2023-06-22 21:32:17,045 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:17,053 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:17,054 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CCSM4', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:17,054 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:17,054 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CCSM4, historical, r1i1p1 2023-06-22 21:32:17,055 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NSF-DOE-NCAR/CESM1-BGC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-BGC_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NSF-DOE-NCAR/CESM1-BGC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-BGC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-BGC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-BGC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NSF-DOE-NCAR/CESM1-BGC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-BGC_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-BGC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-BGC_historical_r1i1p1*.nc 2023-06-22 21:32:17,072 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CESM1(BGC)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:17,072 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:17,072 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:17,072 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:17,072 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:17,073 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:17,074 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:17,074 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:17,074 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:17,075 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:17,218 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CESM1%28BGC%29&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NSF-DOE-NCAR&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1275 2023-06-22 21:32:17,218 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:17,223 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:17,224 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CESM1(BGC)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:17,224 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:17,224 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CESM1-BGC, historical, r1i1p1 2023-06-22 21:32:17,225 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NSF-DOE-NCAR/CESM1-CAM5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-CAM5_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NSF-DOE-NCAR/CESM1-CAM5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-CAM5_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-CAM5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-CAM5_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NSF-DOE-NCAR/CESM1-CAM5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-CAM5_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-CAM5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-CAM5_historical_r1i1p1*.nc 2023-06-22 21:32:17,229 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CESM1(CAM5)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:17,229 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:17,229 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:17,230 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:17,230 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:17,230 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:17,232 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:17,232 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:17,232 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:17,232 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:17,375 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CESM1%28CAM5%29&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NSF-DOE-NCAR&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1276 2023-06-22 21:32:17,375 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:17,429 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:17,430 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CESM1(CAM5)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:17,430 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:17,430 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CESM1-CAM5, historical, r1i1p1 2023-06-22 21:32:17,431 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NSF-DOE-NCAR/CESM1-FASTCHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-FASTCHEM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NSF-DOE-NCAR/CESM1-FASTCHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-FASTCHEM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-FASTCHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-FASTCHEM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NSF-DOE-NCAR/CESM1-FASTCHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-FASTCHEM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-FASTCHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-FASTCHEM_historical_r1i1p1*.nc 2023-06-22 21:32:17,433 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CESM1(FASTCHEM)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:17,433 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:17,433 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:17,434 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:17,434 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:17,434 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:17,436 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:17,436 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:17,436 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:17,436 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:17,685 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CESM1%28FASTCHEM%29&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NSF-DOE-NCAR&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1282 2023-06-22 21:32:17,685 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:17,733 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:17,734 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CESM1(FASTCHEM)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:17,734 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:17,734 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CESM1-FASTCHEM, historical, r1i1p1 2023-06-22 21:32:17,735 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NSF-DOE-NCAR/CESM1-WACCM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-WACCM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NSF-DOE-NCAR/CESM1-WACCM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-WACCM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-WACCM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-WACCM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NSF-DOE-NCAR/CESM1-WACCM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-WACCM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NSF-DOE-NCAR/CESM1-WACCM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CESM1-WACCM_historical_r1i1p1*.nc 2023-06-22 21:32:17,738 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CESM1(WACCM)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:17,738 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:17,738 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:17,738 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:17,738 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:17,738 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:17,740 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:17,740 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:17,740 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:17,741 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:17,886 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CESM1%28WACCM%29&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NSF-DOE-NCAR&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1277 2023-06-22 21:32:17,886 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:17,892 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:17,893 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CESM1(WACCM)', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NSF-DOE-NCAR', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:17,893 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:17,893 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CESM1-WACCM, historical, r1i1p1 2023-06-22 21:32:17,894 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CMCC/CMCC-CESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CESM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CMCC/CMCC-CESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CMCC/CMCC-CESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CMCC/CMCC-CESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CESM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CMCC/CMCC-CESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CESM_historical_r1i1p1*.nc 2023-06-22 21:32:17,915 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CMCC-CESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CMCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:17,915 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:17,915 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:17,916 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:17,916 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:17,916 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:17,917 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:17,918 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:17,918 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:17,918 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,064 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CMCC-CESM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CMCC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1266 2023-06-22 21:32:18,065 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:18,070 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:18,071 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CMCC-CESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CMCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:18,071 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:18,072 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CMCC-CESM, historical, r1i1p1 2023-06-22 21:32:18,072 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CMCC/CMCC-CM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CMCC/CMCC-CM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CMCC/CMCC-CM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CMCC/CMCC-CM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CMCC/CMCC-CM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CMCC-CM_historical_r1i1p1*.nc 2023-06-22 21:32:18,081 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CMCC-CM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CMCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:18,081 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:18,081 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:18,081 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:18,081 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:18,081 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:18,083 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:18,083 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:18,083 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:18,084 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,231 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CMCC-CM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CMCC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1264 2023-06-22 21:32:18,232 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:18,274 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:18,275 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CMCC-CM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CMCC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:18,275 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:18,276 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CMCC-CM, historical, r1i1p1 2023-06-22 21:32:18,276 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-QCCCE/CSIRO-Mk3-6-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CSIRO-Mk3-6-0_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/CSIRO-QCCCE/CSIRO-Mk3-6-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CSIRO-Mk3-6-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-QCCCE/CSIRO-Mk3-6-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CSIRO-Mk3-6-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/CSIRO-QCCCE/CSIRO-Mk3-6-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CSIRO-Mk3-6-0_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/CSIRO-QCCCE/CSIRO-Mk3-6-0/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_CSIRO-Mk3-6-0_historical_r1i1p1*.nc 2023-06-22 21:32:18,279 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'CSIRO-Mk3.6.0', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-QCCCE', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:18,279 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:18,279 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:18,280 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:18,280 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:18,280 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:18,282 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:18,282 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:18,282 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:18,282 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,428 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=CSIRO-Mk3.6.0&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=CSIRO-QCCCE&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1277 2023-06-22 21:32:18,429 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:18,479 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:18,480 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'CSIRO-Mk3.6.0', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'CSIRO-QCCCE', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:18,480 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:18,481 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, CSIRO-Mk3-6-0, historical, r1i1p1 2023-06-22 21:32:18,481 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/LASG-CESS/FGOALS-g2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FGOALS-g2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/LASG-CESS/FGOALS-g2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FGOALS-g2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/LASG-CESS/FGOALS-g2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FGOALS-g2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/LASG-CESS/FGOALS-g2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FGOALS-g2_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/LASG-CESS/FGOALS-g2/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FGOALS-g2_historical_r1i1p1*.nc 2023-06-22 21:32:18,483 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'FGOALS-g2', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'LASG-CESS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:18,483 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:18,483 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:18,483 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:18,484 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:18,484 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:18,485 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:18,485 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:18,486 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:18,486 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,637 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=FGOALS-g2&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=LASG-CESS&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1272 2023-06-22 21:32:18,638 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:18,643 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:18,644 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'FGOALS-g2', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'LASG-CESS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:18,644 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:18,645 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, FGOALS-g2, historical, r1i1p1 2023-06-22 21:32:18,645 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/FIO/FIO-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FIO-ESM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/FIO/FIO-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FIO-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/FIO/FIO-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FIO-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/FIO/FIO-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FIO-ESM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/FIO/FIO-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_FIO-ESM_historical_r1i1p1*.nc 2023-06-22 21:32:18,667 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'FIO-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'FIO', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:18,667 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:18,667 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:18,667 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:18,667 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:18,667 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:18,669 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:18,669 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:18,669 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:18,670 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,813 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=FIO-ESM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=FIO&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1263 2023-06-22 21:32:18,814 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:18,819 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:18,820 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'FIO-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'FIO', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:18,820 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:18,820 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, FIO-ESM, historical, r1i1p1 2023-06-22 21:32:18,821 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NOAA-GFDL/GFDL-CM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-CM3_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NOAA-GFDL/GFDL-CM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-CM3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-CM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-CM3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NOAA-GFDL/GFDL-CM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-CM3_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NOAA-GFDL/GFDL-CM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-CM3_historical_r1i1p1*.nc 2023-06-22 21:32:18,823 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GFDL-CM3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:18,824 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:18,824 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:18,824 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:18,824 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:18,824 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:18,826 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:18,826 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:18,826 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:18,827 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:18,979 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GFDL-CM3&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NOAA-GFDL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1271 2023-06-22 21:32:18,980 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:19,038 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:19,039 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GFDL-CM3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:19,039 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:19,040 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GFDL-CM3, historical, r1i1p1 2023-06-22 21:32:19,040 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2G_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2G/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2G_historical_r1i1p1*.nc 2023-06-22 21:32:19,044 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GFDL-ESM2G', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:19,044 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:19,044 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:19,044 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:19,045 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:19,045 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:19,046 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:19,046 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:19,047 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:19,047 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:19,196 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GFDL-ESM2G&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NOAA-GFDL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1273 2023-06-22 21:32:19,197 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:19,404 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:19,404 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GFDL-ESM2G', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:19,405 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:19,405 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GFDL-ESM2G, historical, r1i1p1 2023-06-22 21:32:19,406 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NOAA-GFDL/GFDL-ESM2M/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2M_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NOAA-GFDL/GFDL-ESM2M/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2M/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2M_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NOAA-GFDL/GFDL-ESM2M/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2M_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NOAA-GFDL/GFDL-ESM2M/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GFDL-ESM2M_historical_r1i1p1*.nc 2023-06-22 21:32:19,449 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GFDL-ESM2M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:19,450 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:19,450 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:19,450 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:19,450 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:19,450 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:19,452 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:19,452 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:19,452 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:19,453 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:19,600 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GFDL-ESM2M&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NOAA-GFDL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1272 2023-06-22 21:32:19,600 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:19,605 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:19,606 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GFDL-ESM2M', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NOAA-GFDL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:19,606 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:19,607 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GFDL-ESM2M, historical, r1i1p1 2023-06-22 21:32:19,607 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NASA-GISS/GISS-E2-H-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H-CC_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NASA-GISS/GISS-E2-H-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NASA-GISS/GISS-E2-H-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NASA-GISS/GISS-E2-H-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H-CC_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NASA-GISS/GISS-E2-H-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H-CC_historical_r1i1p1*.nc 2023-06-22 21:32:19,624 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GISS-E2-H-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:19,624 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:19,624 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:19,624 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:19,625 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:19,625 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:19,626 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:19,626 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:19,627 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:19,627 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:19,818 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GISS-E2-H-CC&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NASA-GISS&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1275 2023-06-22 21:32:19,818 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:19,823 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:19,824 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GISS-E2-H-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:19,824 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:19,824 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GISS-E2-H-CC, historical, r1i1p1 2023-06-22 21:32:19,825 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NASA-GISS/GISS-E2-H/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NASA-GISS/GISS-E2-H/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NASA-GISS/GISS-E2-H/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NASA-GISS/GISS-E2-H/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NASA-GISS/GISS-E2-H/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-H_historical_r1i1p1*.nc 2023-06-22 21:32:19,847 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GISS-E2-H', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:19,884 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:19,884 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:19,885 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:19,885 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:19,885 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:19,887 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:19,887 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:19,887 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:19,887 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:20,037 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GISS-E2-H&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NASA-GISS&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1271 2023-06-22 21:32:20,037 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:20,078 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:20,079 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GISS-E2-H', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:20,079 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:20,079 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GISS-E2-H, historical, r1i1p1 2023-06-22 21:32:20,080 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NASA-GISS/GISS-E2-R-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R-CC_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NASA-GISS/GISS-E2-R-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NASA-GISS/GISS-E2-R-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NASA-GISS/GISS-E2-R-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R-CC_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NASA-GISS/GISS-E2-R-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R-CC_historical_r1i1p1*.nc 2023-06-22 21:32:20,085 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GISS-E2-R-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:20,085 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:20,085 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:20,086 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:20,086 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:20,086 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:20,088 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:20,088 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:20,088 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:20,088 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:20,233 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GISS-E2-R-CC&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NASA-GISS&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1274 2023-06-22 21:32:20,234 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:20,275 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:20,276 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GISS-E2-R-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:20,276 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:20,277 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GISS-E2-R-CC, historical, r1i1p1 2023-06-22 21:32:20,277 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/NASA-GISS/GISS-E2-R/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/NASA-GISS/GISS-E2-R/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/NASA-GISS/GISS-E2-R/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/NASA-GISS/GISS-E2-R/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/NASA-GISS/GISS-E2-R/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_GISS-E2-R_historical_r1i1p1*.nc 2023-06-22 21:32:20,280 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'GISS-E2-R', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:20,280 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:20,281 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:20,281 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:20,281 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:20,281 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:20,283 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:20,283 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:20,283 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:20,283 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:20,432 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=GISS-E2-R&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=NASA-GISS&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1272 2023-06-22 21:32:20,433 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:20,438 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:20,439 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'GISS-E2-R', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'NASA-GISS', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:20,439 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:20,439 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, GISS-E2-R, historical, r1i1p1 2023-06-22 21:32:20,440 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MOHC/HadGEM2-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-CC_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MOHC/HadGEM2-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MOHC/HadGEM2-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-CC_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MOHC/HadGEM2-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-CC_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MOHC/HadGEM2-CC/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-CC_historical_r1i1p1*.nc 2023-06-22 21:32:20,463 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'HadGEM2-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MOHC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:20,464 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:20,464 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:20,464 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:20,464 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:20,464 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:20,466 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:20,466 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:20,466 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:20,467 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:20,626 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=HadGEM2-CC&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MOHC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1268 2023-06-22 21:32:20,627 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:20,671 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:20,672 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'HadGEM2-CC', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MOHC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:20,672 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:20,673 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, HadGEM2-CC, historical, r1i1p1 2023-06-22 21:32:20,673 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/INPE/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/INPE/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/INPE/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/INPE/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/INPE/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MOHC/HadGEM2-ES/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_HadGEM2-ES_historical_r1i1p1*.nc 2023-06-22 21:32:20,677 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'HadGEM2-ES', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'INPE,MOHC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:20,677 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:20,677 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:20,677 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:20,677 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:20,678 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:20,679 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:20,679 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:20,679 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:20,680 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:20,852 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=HadGEM2-ES&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=INPE%2CMOHC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1290 2023-06-22 21:32:20,853 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:20,897 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:20,898 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'HadGEM2-ES', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'INPE,MOHC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:20,898 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:20,898 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, HadGEM2-ES, historical, r1i1p1 2023-06-22 21:32:20,899 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/INM/inmcm4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_inmcm4_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/INM/inmcm4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_inmcm4_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/INM/inmcm4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_inmcm4_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/INM/inmcm4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_inmcm4_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/INM/inmcm4/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_inmcm4_historical_r1i1p1*.nc 2023-06-22 21:32:20,902 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'INM-CM4', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'INM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:20,902 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:20,902 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:20,902 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:20,903 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:20,903 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:20,904 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:20,905 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:20,905 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:20,905 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:21,057 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=INM-CM4&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=INM&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1263 2023-06-22 21:32:21,058 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:21,063 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:21,064 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'INM-CM4', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'INM', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:21,064 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:21,064 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, inmcm4, historical, r1i1p1 2023-06-22 21:32:21,065 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/IPSL/IPSL-CM5A-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-LR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/IPSL/IPSL-CM5A-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/IPSL/IPSL-CM5A-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/IPSL/IPSL-CM5A-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/IPSL/IPSL-CM5A-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-LR_historical_r1i1p1*.nc 2023-06-22 21:32:21,068 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'IPSL-CM5A-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:21,068 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:21,068 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:21,068 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:21,069 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:21,069 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:21,070 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:21,070 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:21,071 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:21,071 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:21,245 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=IPSL-CM5A-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=IPSL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1270 2023-06-22 21:32:21,246 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:21,251 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:21,252 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'IPSL-CM5A-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:21,252 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:21,252 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, IPSL-CM5A-LR, historical, r1i1p1 2023-06-22 21:32:21,253 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/IPSL/IPSL-CM5A-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-MR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/IPSL/IPSL-CM5A-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-MR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/IPSL/IPSL-CM5A-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-MR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/IPSL/IPSL-CM5A-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-MR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/IPSL/IPSL-CM5A-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5A-MR_historical_r1i1p1*.nc 2023-06-22 21:32:21,255 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'IPSL-CM5A-MR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:21,255 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:21,255 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:21,256 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:21,256 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:21,256 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:21,258 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:21,258 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:21,258 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:21,258 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:21,401 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=IPSL-CM5A-MR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=IPSL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1269 2023-06-22 21:32:21,402 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:21,443 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:21,444 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'IPSL-CM5A-MR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:21,444 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:21,444 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, IPSL-CM5A-MR, historical, r1i1p1 2023-06-22 21:32:21,445 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/IPSL/IPSL-CM5B-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5B-LR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/IPSL/IPSL-CM5B-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5B-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/IPSL/IPSL-CM5B-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5B-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/IPSL/IPSL-CM5B-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5B-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/IPSL/IPSL-CM5B-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_IPSL-CM5B-LR_historical_r1i1p1*.nc 2023-06-22 21:32:21,448 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'IPSL-CM5B-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:21,448 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:21,448 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:21,449 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:21,449 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:21,449 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:21,451 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:21,451 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:21,451 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:21,451 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:21,594 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=IPSL-CM5B-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=IPSL&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1269 2023-06-22 21:32:21,595 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:21,643 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:21,644 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'IPSL-CM5B-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'IPSL', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:21,644 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:21,645 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, IPSL-CM5B-LR, historical, r1i1p1 2023-06-22 21:32:21,645 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MIROC/MIROC4h/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC4h_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MIROC/MIROC4h/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC4h_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MIROC/MIROC4h/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC4h_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MIROC/MIROC4h/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC4h_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MIROC/MIROC4h/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC4h_historical_r1i1p1*.nc 2023-06-22 21:32:21,696 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MIROC4h', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:21,696 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:21,696 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:21,696 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:21,696 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:21,696 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:21,698 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:21,698 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:21,698 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:21,699 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:21,856 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MIROC4h&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MIROC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1266 2023-06-22 21:32:21,856 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:21,861 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:21,862 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MIROC4h', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:21,862 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:21,863 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MIROC4h, historical, r1i1p1 2023-06-22 21:32:21,863 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MIROC/MIROC5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC5_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MIROC/MIROC5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC5_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MIROC/MIROC5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC5_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MIROC/MIROC5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC5_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MIROC/MIROC5/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC5_historical_r1i1p1*.nc 2023-06-22 21:32:21,866 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MIROC5', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:21,866 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:21,866 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:21,866 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:21,866 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:21,866 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:21,868 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:21,868 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:21,868 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:21,869 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:22,121 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MIROC5&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MIROC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1266 2023-06-22 21:32:22,121 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:22,126 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:22,127 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MIROC5', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:22,127 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:22,127 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MIROC5, historical, r1i1p1 2023-06-22 21:32:22,128 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MIROC/MIROC-ESM-CHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM-CHEM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MIROC/MIROC-ESM-CHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM-CHEM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MIROC/MIROC-ESM-CHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM-CHEM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MIROC/MIROC-ESM-CHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM-CHEM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MIROC/MIROC-ESM-CHEM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM-CHEM_historical_r1i1p1*.nc 2023-06-22 21:32:22,131 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MIROC-ESM-CHEM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:22,131 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:22,131 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:22,131 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:22,132 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:22,132 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:22,133 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:22,133 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:22,133 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:22,134 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:22,293 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MIROC-ESM-CHEM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MIROC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1273 2023-06-22 21:32:22,294 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:22,341 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:22,341 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MIROC-ESM-CHEM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:22,342 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:22,342 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MIROC-ESM-CHEM, historical, r1i1p1 2023-06-22 21:32:22,342 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MIROC/MIROC-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MIROC/MIROC-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MIROC/MIROC-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MIROC/MIROC-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MIROC/MIROC-ESM/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MIROC-ESM_historical_r1i1p1*.nc 2023-06-22 21:32:22,355 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MIROC-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:22,355 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:22,355 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:22,356 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:22,356 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:22,356 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:22,358 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:22,359 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:22,359 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:22,360 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:22,503 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MIROC-ESM&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MIROC&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1267 2023-06-22 21:32:22,503 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:22,546 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:22,547 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MIROC-ESM', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MIROC', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:22,547 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:22,547 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MIROC-ESM, historical, r1i1p1 2023-06-22 21:32:22,548 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-06-22 21:32:22,550 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:22,550 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:22,550 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:22,551 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:22,551 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:22,551 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:22,553 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:22,553 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:22,553 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:22,554 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:22,712 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-LR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1269 2023-06-22 21:32:22,712 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:22,718 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:22,719 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:22,719 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:22,719 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-06-22 21:32:22,720 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-MR_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MPI-M/MPI-ESM-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-MR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-MR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MPI-M/MPI-ESM-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-MR_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-MR/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-MR_historical_r1i1p1*.nc 2023-06-22 21:32:22,724 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-MR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:22,724 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:22,724 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:22,724 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:22,724 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:22,724 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:22,726 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:22,726 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:22,726 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:22,727 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:22,873 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-MR&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1268 2023-06-22 21:32:22,874 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:22,879 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:22,880 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-MR', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:22,880 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:22,881 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MPI-ESM-MR, historical, r1i1p1 2023-06-22 21:32:22,881 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-P/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-P_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MPI-M/MPI-ESM-P/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-P_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-P/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-P_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MPI-M/MPI-ESM-P/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-P_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MPI-M/MPI-ESM-P/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MPI-ESM-P_historical_r1i1p1*.nc 2023-06-22 21:32:22,884 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MPI-ESM-P', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:22,884 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:22,884 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:22,884 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:22,885 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:22,885 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:22,886 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:22,886 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:22,887 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:22,887 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:23,031 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MPI-ESM-P&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MPI-M&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1267 2023-06-22 21:32:23,031 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:23,084 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:23,085 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MPI-ESM-P', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MPI-M', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:23,085 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:23,086 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MPI-ESM-P, historical, r1i1p1 2023-06-22 21:32:23,086 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MRI/MRI-CGCM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-CGCM3_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MRI/MRI-CGCM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-CGCM3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MRI/MRI-CGCM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-CGCM3_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MRI/MRI-CGCM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-CGCM3_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MRI/MRI-CGCM3/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-CGCM3_historical_r1i1p1*.nc 2023-06-22 21:32:23,089 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MRI-CGCM3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MRI', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:23,089 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:23,089 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:23,089 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:23,090 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:23,090 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:23,091 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:23,091 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:23,092 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:23,092 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:23,246 UTC [1511606] DEBUG urllib3.connectionpool:546 https://esgf.ceda.ac.uk:443 "GET /esg-search/search?format=application%2Fsolr%2Bjson&limit=500&distrib=true&offset=0&type=File&project=CMIP5&model=MRI-CGCM3&ensemble=r1i1p1&experiment=historical&time_frequency=mon&institute=MRI&cmor_table=Amon&product=output1%2Coutput2&variable=lwp HTTP/1.1" 200 1266 2023-06-22 21:32:23,246 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-write cache checks: Passed 2023-06-22 21:32:23,285 UTC [1511606] DEBUG requests_cache.backends.base:103 Closing backend connections 2023-06-22 21:32:23,286 UTC [1511606] DEBUG esmvalcore.esgf._search:155 Found the following files matching facets {'project': 'CMIP5', 'model': 'MRI-CGCM3', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MRI', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'}: none 2023-06-22 21:32:23,286 UTC [1511606] DEBUG esmvalcore.esgf._search:365 Selected files: 2023-06-22 21:32:23,286 UTC [1511606] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: lwp, Amon, CMIP5, MRI-CGCM3, historical, r1i1p1 2023-06-22 21:32:23,287 UTC [1511606] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MRI/MRI-ESM1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-ESM1_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output2/MRI/MRI-ESM1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-ESM1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MRI/MRI-ESM1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-ESM1_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output2/MRI/MRI-ESM1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-ESM1_historical_r1i1p1*.nc /scratch/tomast/ESGF/cmip5/output1/MRI/MRI-ESM1/historical/mon/atmos/Amon/r1i1p1/*/lwp/lwp_Amon_MRI-ESM1_historical_r1i1p1*.nc 2023-06-22 21:32:23,291 UTC [1511606] DEBUG esmvalcore.esgf._search:117 Searching https://esgf.ceda.ac.uk/esg-search for datasets using facets={'project': 'CMIP5', 'model': 'MRI-ESM1', 'ensemble': 'r1i1p1', 'experiment': 'historical', 'time_frequency': 'mon', 'institute': 'MRI', 'cmor_table': 'Amon', 'product': 'output1,output2', 'variable': 'lwp'} 2023-06-22 21:32:23,291 UTC [1511606] DEBUG requests_cache.backends:63 Initializing backend: None /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results 2023-06-22 21:32:23,291 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: SerializerPipeline(name=pickle, n_stages=2) 2023-06-22 21:32:23,291 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:responses 2023-06-22 21:32:23,292 UTC [1511606] DEBUG requests_cache.backends.base:370 Initialized SQLiteDict with serializer: None 2023-06-22 21:32:23,292 UTC [1511606] DEBUG requests_cache.backends.sqlite:219 Opening connection to /nird/home/tomast/.esmvaltool/cache/pyesgf-search-results.sqlite:redirects 2023-06-22 21:32:23,293 UTC [1511606] DEBUG requests_cache.policy.actions:91 Cache directives from request headers: CacheDirectives() 2023-06-22 21:32:23,293 UTC [1511606] DEBUG requests_cache.policy.actions:330 Pre-read cache checks: Passed 2023-06-22 21:32:23,294 UTC [1511606] DEBUG requests_cache.policy.actions:205 Post-read cache actions: CacheActions(expire_after=86400, send_request=True) 2023-06-22 21:32:23,294 UTC [1511606] DEBUG urllib3.connectionpool:1048 Starting new HTTPS connection (1): esgf.ceda.ac.uk:443 2023-06-22 21:32:23,441 UTC [1511606] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.5 GB 2023-06-22 21:32:23,442 UTC [1511606] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.