INFO [739779] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ Earth System Model Evaluation Tool A community tool for the evaluation of Earth system models. https://esmvaltool.org The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth System Models (ESMs) that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. Tutorial: https://tutorial.esmvaltool.org Documentation: https://docs.esmvaltool.org Contact: esmvaltool-dev@listserv.dfn.de If you find this software useful for your research, please cite it using https://doi.org/10.5281/zenodo.3387139 for ESMValCore or https://doi.org/10.5281/zenodo.3401363 for ESMValTool or any of the reference papers listed at https://esmvaltool.org/references/. Have fun! INFO [739779] Package versions INFO [739779] ---------------- INFO [739779] ESMValCore: 2.13.0 INFO [739779] ESMValTool: 2.13.0 INFO [739779] ---------------- INFO [739779] Reading configuration files from: /nird/datapeak/NS2980K/conda/esmvaltool2.13.0/lib/python3.13/site-packages/esmvalcore/config/configurations/defaults (defaults) /nird/home/tomast/.config/esmvaltool (default user configuration directory) INFO [739779] Writing program log files to: /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/run/main_log.txt /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/run/main_log_debug.txt /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/run/cmor_log.txt INFO [739779] Starting the Earth System Model Evaluation Tool at time: 2025-11-24 12:24:00 UTC INFO [739779] ---------------------------------------------------------------------- INFO [739779] RECIPE = /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover.yml INFO [739779] RUNDIR = /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/run INFO [739779] WORKDIR = /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/work INFO [739779] PREPROCDIR = /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/preproc INFO [739779] PLOTDIR = /nird/datalake/NS2980K/www/tomast/esmvaltool2.13.0/output/recipe_albedolandcover_20251124_122359/plots INFO [739779] ---------------------------------------------------------------------- INFO [739779] Running tasks using at most 8 processes INFO [739779] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [739779] If you experience memory problems, try reducing 'max_parallel_tasks' in your configuration. INFO [739779] Using default ESGF configuration, configuration file /nird/home/tomast/.esmvaltool/esgf-pyclient.yml not present. INFO [739779] For Dataset: albDiffiTr13, Amon, OBS, Duveiller2018, v2018, supplementaries: sftlf, *, *: ignoring supplementary variable 'sftlf', unable to expand wildcards 'mip', 'version'. INFO [739779] Creating tasks from recipe INFO [739779] Creating tasks for diagnostic albedolandcover_cmip5 INFO [739779] Creating diagnostic task albedolandcover_cmip5/albedolandcover INFO [739779] Creating preprocessor task albedolandcover_cmip5/treeFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'treeFrac' INFO [739779] Found input files for Dataset: treeFrac, Lmon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120625, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/treeFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/snc INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'snc' INFO [739779] Found input files for Dataset: snc, LImon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20111006, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/snc created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/alb INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'alb' INFO [739779] Found input files for Dataset: alb, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315, supplementaries: sftlf, fx, r0i0p0 INFO [739779] PreprocessingTask albedolandcover_cmip5/alb created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/cropFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'cropFrac' INFO [739779] Found input files for Dataset: cropFrac, Lmon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120625, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/cropFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/grassFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'grassFrac' INFO [739779] Found input files for Dataset: grassFrac, Lmon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120625, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/grassFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/shrubFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'shrubFrac' INFO [739779] Found input files for Dataset: shrubFrac, Lmon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120625, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/shrubFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip5/pastureFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'pastureFrac' INFO [739779] Found input files for Dataset: pastureFrac, Lmon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120625, supplementaries: sftlf, fx, r0i0p0, v20120315 INFO [739779] PreprocessingTask albedolandcover_cmip5/pastureFrac created. INFO [739779] Creating tasks for diagnostic albedolandcover_cmip6 INFO [739779] Creating diagnostic task albedolandcover_cmip6/albedolandcover INFO [739779] Creating preprocessor task albedolandcover_cmip6/treeFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'treeFrac' INFO [739779] Found input files for Dataset: treeFrac, Lmon, CMIP6, HadGEM3-GC31-LL, CMIP, historical, r1i1p1f3, gn, v20190624, supplementaries: sftlf, fx, piControl, r1i1p1f1, v20190709 INFO [739779] PreprocessingTask albedolandcover_cmip6/treeFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip6/snc INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'snc' INFO [739779] Found input files for Dataset: snc, LImon, CMIP6, HadGEM3-GC31-LL, CMIP, historical, r1i1p1f3, gn, v20190624, supplementaries: sftlf, fx, piControl, r1i1p1f1, v20190709 INFO [739779] PreprocessingTask albedolandcover_cmip6/snc created. INFO [739779] Creating preprocessor task albedolandcover_cmip6/alb INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'alb' INFO [739779] Found input files for Dataset: alb, Amon, CMIP6, HadGEM3-GC31-LL, CMIP, historical, r1i1p1f3, gn, v20190624, supplementaries: sftlf, fx, piControl, r1i1p1f1, v20190709 INFO [739779] PreprocessingTask albedolandcover_cmip6/alb created. INFO [739779] Creating preprocessor task albedolandcover_cmip6/grassFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'grassFrac' INFO [739779] Found input files for Dataset: grassFrac, Lmon, CMIP6, HadGEM3-GC31-LL, CMIP, historical, r1i1p1f3, gn, v20190624, supplementaries: sftlf, fx, piControl, r1i1p1f1, v20190709 INFO [739779] PreprocessingTask albedolandcover_cmip6/grassFrac created. INFO [739779] Creating preprocessor task albedolandcover_cmip6/shrubFrac INFO [739779] Creating preprocessor 'pp_cmip' task for variable 'shrubFrac' INFO [739779] Found input files for Dataset: shrubFrac, Lmon, CMIP6, HadGEM3-GC31-LL, CMIP, historical, r1i1p1f3, gn, v20190624, supplementaries: sftlf, fx, piControl, r1i1p1f1, v20190709 INFO [739779] PreprocessingTask albedolandcover_cmip6/shrubFrac created. INFO [739779] Creating tasks for diagnostic albedolandcover_obs INFO [739779] Creating diagnostic task albedolandcover_obs/albedolandcover INFO [739779] Creating preprocessor task albedolandcover_obs/albDiffiTr13 INFO [739779] Creating preprocessor 'pp_obs' task for variable 'albDiffiTr13' WARNING [739779] Preprocessor function mask_landsea works best when at least one supplementary variable of ['sftlf', 'sftof'] is defined in the recipe for Dataset: {'diagnostic': 'albedolandcover_obs', 'variable_group': 'albDiffiTr13', 'dataset': 'Duveiller2018', 'project': 'OBS', 'mip': 'Amon', 'short_name': 'albDiffiTr13', 'alias': 'Duveiller2018', 'frequency': 'mon', 'long_name': 'Difference in Surface Albedo for Vegetation Cover Transition ' 'from Forest to Crops and Grasses', 'modeling_realm': ['atmos'], 'original_short_name': 'albDiffiTr13', 'preprocessor': 'pp_obs', 'recipe_dataset_index': 0, 'standard_name': '', 'tier': 2, 'timerange': '2010/2010', 'type': 'clim', 'units': '1', 'version': 'v2018'} session: 'recipe_albedolandcover_20251124_122359'. ERROR [739779] No input files found for Dataset: {'diagnostic': 'albedolandcover_obs', 'variable_group': 'albDiffiTr13', 'dataset': 'Duveiller2018', 'project': 'OBS', 'mip': 'Amon', 'short_name': 'albDiffiTr13', 'alias': 'Duveiller2018', 'frequency': 'mon', 'long_name': 'Difference in Surface Albedo for Vegetation Cover Transition ' 'from Forest to Crops and Grasses', 'modeling_realm': ['atmos'], 'original_short_name': 'albDiffiTr13', 'preprocessor': 'pp_obs', 'recipe_dataset_index': 0, 'standard_name': '', 'tier': 2, 'timerange': '2010/2010', 'type': 'clim', 'units': '1', 'version': 'v2018'} session: 'recipe_albedolandcover_20251124_122359' ERROR [739779] Looked for files matching /nird/datalake/NS16000B/esmvaltool-data/obsdata/Tier2/Duveiller2018/OBS_Duveiller2018_clim_v2018_Amon_albDiffiTr13[_.]*nc /scratch/tomast/ESGF/obsdata/Tier2/Duveiller2018/OBS_Duveiller2018_clim_v2018_Amon_albDiffiTr13[_.]*nc ERROR [739779] Set 'log_level' to 'debug' to get more information ERROR [739779] Could not create all tasks ERROR [739779] Missing data for preprocessor albedolandcover_obs/albDiffiTr13: - Missing data for Dataset: albDiffiTr13, Amon, OBS, Duveiller2018, v2018 INFO [739779] Maximum memory used (estimate): 0.3 GB INFO [739779] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [739779] Could not create all tasks