Search NASA⌕ Search

SEARCH · Search NASA

Results for “model skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Inconsistent Strategies to Spin up Models in CMIP5: Implications for Ocean Biogeochemical Model Performance Assessment

During the fifth phase of the Coupled Model Intercomparison Project (CMIP5) substantial efforts were made to systematically assess the skill of Earth system models. One goal was to check how realistically representative marine biogeochemical tracer distributions could be reproduced by models. In routine assessments model historical hindcasts were compared with available modern biogeochemical observations. However, these assessments considered neither how close modeled biogeochemical reservoirs were to equilibrium nor the sensitivity of model performance to initial conditions or to the spin-up protocols. Here, we explore how the large diversity in spin-up protocols used for marine biogeochemistry in CMIP5 Earth system models (ESMs) contributes to model-to-model differences in the simulated fields. We take advantage of a 500-year spin-up simulation of IPSL-CM5A-LR to quantify the influence of the spin-up protocol on model ability to reproduce relevant data fields. Amplification of biases in selected biogeochemical fields (O2, NO3, Alk-DIC) is assessed as a function of spin-up duration. We demonstrate that a relationship between spin-up duration and assessment metrics emerges from our model results and holds when confronted with a larger ensemble of CMIP5 models. This shows that drift has implications for performance assessment in addition to possibly aliasing estimates of climate change impact. Our study suggests that differences in spin-up protocols could explain a substantial part of model disparities, constituting a source of model-to- model uncertainty. This requires more attention in future model intercomparison exercises in order to provide quantitatively more correct ESM results on marine biogeochemistry and carbon cycle feedbacks.

histories↗

Assessing the Viability of Using GEOS-Forecast Product for Landslides Forecasting: A Step Toward Early Warning System

Landslides across the globe are mostly triggered by extreme rainfall events affecting infrastructure, transportation and livelihoods. The risks are rarely quantified due to lack of data, analytical skills and limited modeling techniques. Knowledge of local to global scale landslide risks provides communities and national agencies the ability to adapt disaster management practices to mitigate and recover from these hazards. In order to minimize the risks and improve characterization of community resilience to landslides, it is vital to have reliable information about the factors triggering landslides such as rainfall, well ahead in time. Forecasting potential landslide activity and impacts can be achieved through reliable precipitation forecast models. However, it is challenging because of the temporal and spatial variability of precipitation, an important factor in triggering landslides. Evaluation of the precipitation field, associated errors, and sampling uncertainties is integral for development of efficient and reliable landslide forecasting and early warning system. This study develops a methodology to assess the viability of using a precipitation field provided by a global model and its potential integration in the landslide forecasting system. The study focuses on the comparison between the IMERG (Integrated Multi-satellitE Retrievals for Global Precipitation Mission) and GEOS (NASA Goddard Earth Observing System)-Forecast product over contiguous United States (CONUS). GEOS model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The framework is tested on the GEOS-Forecast Model initialized at 00 UTC using daily IMERG early product as reference using both categorical and continuous statistics. The categorical statistics includes the probability of detection (POD), success ratio (SR), critical success index (CSI), and the hit bias. Continuous statistics such as correlation, normalized standard deviation, and root-mean-square error are also evaluated. Overall, GEOS-Forecast precipitation field over the analysis period (~1 year) show underestimation with respect to IMERG early for the daily accumulated rainfall. However, the probability distribution function and cumulative distribution function of both show similar patterns. In terms of correlations, POD, SR, CSI, hit bias, the performance varies with respect to the rainfall threshold used.

Sana Khan↗

DroughtCast: A Machine Learning Forecast of the United States Drought Monitor

Drought is one of the most ecologically and economically devastating natural phenomena affecting the United States, causing the U.S. economy billions of dollars in damage, and driving widespread degradation of ecosystem health. Many drought indices are implemented to monitor the current extent and status of drought so stakeholders such as farmers and local governments can appropriately respond. Methods toforecast drought conditions weeks to months in advance are less common but would provide a more effective early warning system to enhance drought response, mitigation, and adaptation planning. To resolve this issue, we introduce DroughtCast, a machine learning framework for forecasting the United States Drought Monitor (USDM). DroughtCast operates on the knowledge that recent anomalies in hydrology and meteorology drive future changes in drought conditions. We use simulated meteorology and satellite observed soil moisture as inputs into a recurrent neural network to accurately forecast the USDM between 1 and 12 weeks into the future. Our analysis shows that precipitation, soil moisture, and temperature are the most important input variables when forecasting future drought conditions. Additionally, a case study of the 2017 Northern Plains Flash Drought shows that DroughtCast was able to forecast a very extreme drought event up to 12 weeks before its onset. Given the favorable forecasting skill of the model, DroughtCast may provide a promising tool for land managers and local governments in preparing for and mitigating the effects of drought.

Machine Learning↗

Incorrect computation of Madden-Julian oscillation prediction skill

The Madden–Julian oscillation (MJO) is a major tropical weather system and one of the largest sources of predictability for subseasonal-to-seasonal weather forecasts. Skillful prediction of the MJO has been a highly active area of research due to its large socio-economic impacts. Silini et al., herein S21, developed a machine learning model to predict the MJO, which they claimed to have an MJO prediction skill of 26–27 days over all seasons and 45 days for December–February (DJF) winter. If true, this would make the skill of their model competitive with that of the state-of-the-art dynamical MJO prediction systems at 20–35 days. However, here we show that the MJO prediction was calculated incorrectly in S21, which spuriously increased the performance of their model. Correctly computed skill of their model was substantially lower than that reported in S21; the skill for all seasons drops to 11–12 days and the skill for forecasts initialized during DJF drops to 15 days. Our findings clarify that the S21 machine learning model is not competitive with state-of-the-art numerical weather prediction models in predicting the MJO.

54 ENVIRONMENTAL SCIENCES↗

Contributions of Precipitation and Soil Moisture Observations to the Skill of Soil Moisture Estimates in a Land Data Assimilation System

The contributions of precipitation and soil moisture observations to the skill of soil moisture estimates from a land data assimilation system are assessed. Relative to baseline estimates from the Modern Era Retrospective-analysis for Research and Applications (MERRA), the study investigates soil moisture skill derived from (i) model forcing corrections based on large-scale, gauge- and satellite-based precipitation observations and (ii) assimilation of surface soil moisture retrievals from the Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E). Soil moisture skill is measured against in situ observations in the continental United States at 44 single-profile sites within the Soil Climate Analysis Network (SCAN) for which skillful AMSR-E retrievals are available and at four CalVal watersheds with high-quality distributed sensor networks that measure soil moisture at the scale of land model and satellite estimates. The average skill (in terms of the anomaly time series correlation coefficient R) of AMSR-E retrievals is R=0.39 versus SCAN and R=0.53 versus CalVal measurements. The skill of MERRA surface and root-zone soil moisture is R=0.42 and R=0.46, respectively, versus SCAN measurements, and MERRA surface moisture skill is R=0.56 versus CalVal measurements. Adding information from either precipitation observations or soil moisture retrievals increases surface soil moisture skill levels by IDDeltaR=0.06-0.08, and root zone soil moisture skill levels by DeltaR=0.05-0.07. Adding information from both sources increases surface soil moisture skill levels by DeltaR=0.13, and root zone soil moisture skill by DeltaR=0.11, demonstrating that precipitation corrections and assimilation of satellite soil moisture retrievals contribute similar and largely independent amounts of information.

Reichle, Rolf H.↗

CEDAR-GEM Challenge for Systematic Assessment of Ionosphere/Thermosphere Models in Predicting TEC During the 2006 December Storm Event

In order to assess current modeling capability of reproducing storm impacts on total electron content (TEC), we considered quantities such as TEC, TEC changes compared to quiet time values, and the maximum value of the TEC and TEC changes during a storm. We compared the quantities obtained from ionospheric models against ground-based GPS TEC measurements during the 2006 AGU storm event (14-15 December 2006) in the selected eight longitude sectors. We used 15 simulations obtained from eight ionospheric models, including empirical, physics-based, coupled ionosphere-thermosphere, and data assimilation models. To quantitatively evaluate performance of the models in TEC prediction during the storm, we calculated skill scores such as RMS error, Normalized RMS error (NRMSE), ratio of the modeled to observed maximum increase (Yield), and the difference between the modeled peak time and observed peak time. Furthermore, to investigate latitudinal dependence of the performance of the models, the skill scores were calculated for five latitude regions. Our study shows that RMSE of TEC and TEC changes of the model simulations range from about 3 TECU (total electron content unit, 1 TECU = 1016 el m2) (in high latitudes) to about 13 TECU (in low latitudes), which is larger than latitudinal average GPS TEC error of about 2 TECU. Most model simulations predict TEC better than TEC changes in terms of NRMSE and the difference in peak time, while the opposite holds true in terms of Yield. Model performance strongly depends on the quantities considered, the type of metrics used, and the latitude considered.

Shim, J. S.↗

Downscaling Soil Moisture in the Southern Great Plains Through a Calibrated Multifractal Model for Land Surface Modeling Applications

Accounting for small-scale spatial heterogeneity of soil moisture (theta) is required to enhance the predictive skill of land surface models. In this paper, we present the results of the development, calibration, and performance evaluation of a downscaling model based on multifractal theory using aircraft!based (800 m) theta estimates collected during the southern Great Plains experiment in 1997 (SGP97).We first demonstrate the presence of scale invariance and multifractality in theta fields of nine square domains of size 25.6 x 25.6 sq km, approximately a satellite footprint. Then, we estimate the downscaling model parameters and evaluate the model performance using a set of different calibration approaches. Results reveal that small-scale theta distributions are adequately reproduced across the entire region when coarse predictors include a dynamic component (i.e., the spatial mean soil moisture ) and a stationary contribution accounting for static features (i.e., topography, soil texture, vegetation). For wet conditions, we found similar multifractal properties of soil moisture across all domains, which we ascribe to the signature of rainfall spatial variability. For drier states, the theta fields in the northern domains are more intermittent than in southern domains, likely because of differences in the distribution of vegetation coverage. Through our analyses, we propose a regional downscaling relation for coarse, satellite-based soil moisture estimates, based on ancillary information (static and dynamic landscape features), which can be used in the study area to characterize statistical properties of small-scale theta distribution required by land surface models and data assimilation systems.

Mascaro, Giuseppe↗

General purpose architecture for intelligent computer-aided training

An intelligent computer-aided training system having a general modular architecture is provided for use in a wide variety of training tasks and environments. It is comprised of a user interface which permits the trainee to access the same information available in the task environment and serves as a means for the trainee to assert actions to the system; a domain expert which is sufficiently intelligent to use the same information available to the trainee and carry out the task assigned to the trainee; a training session manager for examining the assertions made by the domain expert and by the trainee for evaluating such trainee assertions and providing guidance to the trainee which are appropriate to his acquired skill level; a trainee model which contains a history of the trainee interactions with the system together with summary evaluative data; an intelligent training scenario generator for designing increasingly complex training exercises based on the current skill level contained in the trainee model and on any weaknesses or deficiencies that the trainee has exhibited in previous interactions; and a blackboard that provides a common fact base for communication between the other components of the system. Preferably, the domain expert contains a list of 'mal-rules' which typifies errors that are usually made by novice trainees. Also preferably, the training session manager comprises an intelligent error detection means and an intelligent error handling means. The present invention utilizes a rule-based language having a control structure whereby a specific message passing protocol is utilized with respect to tasks which are procedural or step-by-step in structure. The rules can be activated by the trainee in any order to reach the solution by any valid or correct path.

Loftin, R. Bowen↗

Predictability of the 1997 and 1998 South Asian Summer Monsoons

The predictability of the 1997 and 1998 south Asian summer monsoon winds is examined from an ensemble of 10 Atmospheric General Circulation Model (AGCM) simulations with prescribed sea surface temperatures (SSTs) and soil moisture, The simulations are started in September 1996 so that they have lost all memory of the atmospheric initial conditions for the periods of interest. The model simulations show that the 1998 monsoon is considerably more predictable than the 1997 monsoon. During May and June of 1998 the predictability of the low-level wind anomalies is largely associated with a local response to anomalously warm Indian Ocean SSTs. Predictability increases late in the season (July and August) as a result of the strengthening of the anomalous Walker circulation and the associated development of easterly low level wind anomalies that extend westward across India and the Arabian Sea. During these months the model is also the most skillful with the observations showing a similar late-season westward extension of the easterly CD wind anomalies. The model shows little predictability or skill in the low level winds over southeast Asia during, 1997. Predictable wind anomalies do occur over the western Indian Ocean and Indonesia, however, over the Indian Ocean they are a response to SST anomalies that were wind driven and they show no skill. The reduced predictability in the low level winds during 1997 appears to be the result of a weaker (compared with 1998) simulated anomalous Walker circulation, while the reduced skill is associated with pronounced intraseasonal activity that is not well captured by the model. Remarkably, the model does produce an ensemble mean Madden-Julian Oscillation (MJO) response that is approximately in phase with (though weaker than) the observed MJ0 anomalies. This is consistent with the idea that SST coupling may play an important role in the MJO.

Schubert, Siegfred D.↗

Toward Integrated Seasonal Predictions of Land and Ocean Carbon Flux: Lessons from the 2015-16 El Nino

Seasonal forecasts made by coupled atmosphere-ocean general circulation models (GCMs) are increasingly able to provide skillful forecasts of climate anomalies. At some centers, the capabilities of these models are being expanded to represent carbon-climate feedbacks including ocean biogeochemistry (OB), terrestrial biosphere (TB) interactions, and fires. These advances raise the question of whether such models can support skillful forecasts of carbon fluxes.Here, we examine whether land and ocean carbon flux anomalies associated with the 2015-16 El Nino could have been predicted months in advance. This El Nino was noteworthy for the magnitude of the ocean temperature perturbation, the skill with which this perturbation was predicted, and the extensive satellite observations that can be used to track its impact. We explore this topic using NASA's Goddard Earth Observing System (GEOS) model, which routinely produces an ensemble of seasonal climate forecasts, and a suite of offline dynamical and statistical models that estimate carbon flux processes. Using GEOS forecast fields from 2015-16 to force flux model hindcasts shows that these models are able to reproduce significant features observed by satellites. Specifically, OB hindcasts are able to predict anomalies in chlorophyll distributions with lead times of 3-4 months. The ability of TB hindcasts to reproduce NDVI anomalies is driven by the skill of the climate forecast, which is greatest at short lead times over tropical landmasses. Statistical fire forecasts driven by ocean climate indices are able to predict burned area in the tropics with lead times of 3-12 months. We also integrate the ocean and land hindcast fluxes into the GEOS GCM to examine the magnitude of the atmospheric carbon dioxide anomaly and compare with satellite and ground-based observations.While seasonal forecasting remains an active area of research, these results demonstrate that forecasts of carbon flux processes can support a variety of applications, potentially allowing scientists to understand carbon-climate feedbacks as they happen and to capitalize on more flexible satellite technologies that allow areas of interest to be targeted with lead times of weeks to months. We also provide a first glimpse at the spring 2019 carbon forecast using the GEOS-based forecasting system.

Ott, L.↗

Tropical intraseasonal oscillation and its prediction by the NMC operational model

Results are presented of an investigation of the tropical intraseasonal oscillation (ISO) and its impact on the extended-range forecast in the NMC operational model during Phase II (14 December 1986-31 March 1987) of the Dynamical Extended Range Forecast. Based on principal component analysis of the velocity potential and streamfunction, evidence was found of tropical-extratropical interaction associated with the ISO. The NMC model possess significant forecast skills for the principal streamfunction and velocity potential modes up to the first ten days. Results of the error growth analysis suggest that the principal modes of velocity potential have large errors comparable to the model random errors. By comparison, the initial errors in the streamfunction are much smaller. The error growth for both tropical and extratropical modes are found to be significantly suppressed during periods of strong ISO relative to periods of weak ISO. The increase in extratropical forecast skill is likely due to (1) the model's ability to better capture ISO signals in the tropics and (2) the increased coupling between the tropics and extratropics during periods of strong ISO.

Lau, K.-M.↗

Acquisition and production of skilled behavior in dynamic decision-making tasks: Modeling strategic behavior in human-automation interaction: Why and aid can (and should) go unused

Advances in computer and control technology offer the opportunity for task-offload aiding in human-machine systems. A task-offload aid (e.g., an autopilot, an intelligent assistant) can be selectively engaged by the human operator to dynamically delegate tasks to an automated system. Successful design and performance prediction in such systems requires knowledge of the factors influencing the strategy the operator develops and uses for managing interaction with the task-offload aid. A model is presented that shows how such strategies can be predicted as a function of three task context properties (frequency and duration of secondary tasks and costs of delaying secondary tasks) and three aid design properties (aid engagement and disengagement times, aid performance relative to human performance). Sensitivity analysis indicates how each of these contextual and design factors affect the optimal aid aid usage strategy and attainable system performance. The model is applied to understanding human-automation interaction in laboratory experiments on human supervisory control behavior. The laboratory task allowed subjects freedom to determine strategies for using an autopilot in a dynamic, multi-task environment. Modeling results suggested that many subjects may indeed have been acting appropriately by not using the autopilot in the way its designers intended. Although autopilot function was technically sound, this aid was not designed with due regard to the overall task context in which it was placed. These results demonstrate the need for additional research on how people may strategically manage their own resources, as well as those provided by automation, in an effort to keep workload and performance at acceptable levels.

Kirlik, Alex↗

A Dynamic Landslide Hazard Monitoring Framework for the Lower Mekong Region

The Lower Mekong region is one of the most landslide-prone areas of the world. Despite the need for dynamic characterization of landslide hazard zones within the region, it is largely understudied for several reasons. Dynamic and integrated understanding of landslide processes requires landslide inventories across the region, which have not been available previously. Computational limitations also hamper regional landslide hazard assessment, including accessing and processing remotely sensed information. Finally, open-source software and modelling packages are required to address regional landslide hazard analysis. Leveraging an open-source data-driven global Landslide Hazard Assessment for Situational Awareness model framework, this study develops a region-specific dynamic landslide hazard system leveraging satellite-based Earth observation data to assess landslide hazards across the lower Mekong region. A set of landslide inventories were prepared from high-resolution optical imagery using advanced image-processing techniques. Several static and dynamic explanatory variables (i.e., rainfall, soil moisture, slope, relief, distance to roads, distance to faults, distance to rivers) were considered during the model development phase. An extreme gradient boosting decision tree model was trained for the monsoon period of 2015–2019 and the model was evaluated with independent inventory information for the 2020 monsoon period. The model performance demonstrated considerable skill using receiver operating characteristic curve statistics, with Area Under the Curve values exceeding 0.95. The model architecture was designed to use near-real-time data, and it can be implemented in a cloud computing environment (i.e., Google Cloud Platform) for the routine assessment of landslide hazards in the Lower Mekong region. This work was developed in collaboration with scientists at the Asian Disaster Preparedness Center as part of the NASA SERVIR Program’s Mekong hub. The goal of this work is to develop a suite of tools and services on accessible open-source platforms that support and enable stakeholder communities to better assess landslide hazard and exposure at local to regional scales for decision making and planning.

Nishan Kumar Biswas↗

The MOSAiC Distributed Network: Observing the coupled Arctic system with multidisciplinary, coordinated platforms

Central Arctic properties and processes are important to the regional and global coupled climate system. The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) Distributed Network (DN) of autonomous ice-tethered systems aimed to bridge gaps in our understanding of temporal and spatial scales, in particular with respect to the resolution of Earth system models. By characterizing variability around local measurements made at a Central Observatory, the DN covers both the coupled system interactions involving the ocean-ice-atmosphere interfaces as well as three-dimensional processes in the ocean, sea ice, and atmosphere. The more than 200 autonomous instruments (“buoys”) were of varying complexity and set up at different sites mostly within 50 km of the Central Observatory. During an exemplary midwinter month, the DN observations captured the spatial variability of atmospheric processes on sub-monthly time scales, but less so for monthly means. They show significant variability in snow depth and ice thickness, and provide a temporally and spatially resolved characterization of ice motion and deformation, showing coherency at the DN scale but less at smaller spatial scales. Ocean data show the background gradient across the DN as well as spatially dependent time variability due to local mixed layer sub-mesoscale and mesoscale processes, influenced by a variable ice cover. The second case (May–June 2020) illustrates the utility of the DN during the absence of manually obtained data by providing continuity of physical and biological observations during this key transitional period. We show examples of synergies between the extensive MOSAiC remote sensing observations and numerical modeling, such as estimating the skill of ice drift forecasts and evaluating coupled system modeling. The MOSAiC DN has been proven to enable analysis of local to mesoscale processes in the coupled atmosphere-ice-ocean system and has the potential to improve model parameterizations of important, unresolved processes in the future.

54 ENVIRONMENTAL SCIENCES↗

A Performance Analysis on Soil Dielectric Models Over Organic Soils in Alaska for Passive Microwave Remote Sensing of Soil Moisture

Passive microwave remote sensing of soil moisture (SM) requires a physically based dielectric model that quantitatively converts the volumetric SM into the soil bulk dielectric constant. Mironov 2009 is the dielectric model used in the operational SM retrieval algorithms of the NASA Soil Moisture Active Passive (SMAP) and the ESA Soil Moisture and Ocean Salinity (SMOS) missions. However, Mironov 2009 suffers a challenge in deriving SM over organic soils, as it does not account for the impact of soil organic matter (SOM) on the soil bulk dielectric constant. To this end, we presented a comparative performance analysis of nine advanced soil dielectric models over organic soil in Alaska, four of which incorporate SOM. In the framework of the SMAP single-channel algorithm at vertical polarization (SCA-V), SM retrievals from different dielectric models were derived using an iterative optimization scheme. The skills of the different dielectric models over organic soils were reflected by the performance of their respective SM retrievals, which was measured by four conventional statistical metrics, calculated by comparing satellite-based SM time series with in-situ benchmarks. Overall, SM retrievals of organic-soil-based dielectric models tended to overestimate, while those from mineral-soil-based models displayed dry biases. All the models showed comparable values of unbiased root-mean-square error (ubRMSE) and Pearson Correlation (R), but Mironov 2019 exhibited a slight but consistent edge over the others. An integrated consideration of the model inputs, the physical basis, and the validated accuracy indicated that the separate use of Mironov 2009 and Mironov 2019 in the SMAP SCA-V for mineral soils (SOM < 15%) and organic soils (SOM ≥ 15%) would be the preferred option.

Soil Moisture↗

Desktop Modeling and Simulation: Parsimonious, yet Effective Discrete-Event Simulation Analysis

This paper evaluates how quickly students can be trained to construct useful discrete-event simulation models using Excel The typical supply chain used by many large national retailers is described, and an Excel-based simulation model is constructed of it The set of programming and simulation skills required for development of that model are then determined we conclude that six hours of training are required to teach the skills to MBA students . The simulation presented here contains all fundamental functionallty of a simulation model, and so our result holds for any discrete-event simulation model. We argue therefore that Industry workers with the same technical skill set as students having completed one year in an MBA program can be quickly trained to construct simulation models. This result gives credence to the efficacy of Desktop Modeling and Simulation whereby simulation analyses can be quickly developed, run, and analyzed with widely available software, namely Excel.

Bradley, James R.↗

Similarity Assessment of Land Surface Model Outputs in the North American Land Data Assimilation System

Multimodel ensembles are often used to produce ensemble mean estimates that tend to have increased simulation skill over any individual model output. If multimodel outputs are too similar, an individual LSM would add little additional information to the multimodel ensemble, whereas if the models are too dissimilar, it may be indicative of systematic errors in their formulations or configurations. The article presents a formal similarity assessment of the North American Land Data Assimilation System (NLDAS) multimodel ensemble outputs to assess their utility to the ensemble, using a confirmatory factor analysis. Outputs from four NLDAS Phase 2 models currently running in operations at NOAA/NCEP and four new/ upgraded models that are under consideration for the next phase of NLDAS are employed in this study. The results show that the runoff estimates from the LSMs were most dissimilar whereas the models showed greater similarity for root zone soil moisture, snow water equivalent, and terrestrial water storage. Generally, the NLDAS operational models showed weaker association with the common factor of the ensemble and the newer versions of the LSMs showed stronger association with the common factor, with the model similarity increasing at longer time scales. Trade-offs between the similarity metrics and accuracy measures indicated that the NLDAS operational models demonstrate a larger span in the similarity-accuracy space compared to the new LSMs. The results of the article indicate that simultaneous consideration of model similarity and accuracy at the relevant time scales is necessary in the development of multimodel ensemble.

land surface models↗