Evaluating Ecohydrological Model Sensitivity to Input Variability with an Information-Theory-Based Approach
Explore the source record for details and available documents.
Mozhgan A. Farahani↗
SEARCH · Search NASA
Results for “Model Sensitivity”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Model sensitivities in LES predictions of buoyant methane fire plumes.
Abstract not provided.
Koo, Heeseok↗
Model sensitivities in LES predictions of buoyant methane fire plumes.
Abstract not provided.
Koo, Heeseok↗
The doubled CO2 climate and the sensitivity of the modeled hydrologic cycle
Four doubled CO2 experiments with the GISS general circulation model are compared to investigate the consistency of changes in water availability over the United States. The experiments compare the influence of model sensitivity, model resolution, and the sea-surface temperature gradient. The results show that the general mid-latitude drying over land is dependent upon the degree of mid-latitude eddy energy decrease, and thus the degree of high-latitude temperature change amplification. There is a general tendency in the experiments for the northern and western United States to become wetter, while the southern and eastern portions dry. However, there is much variability from run to run, with different regions showing different degrees of sensitivity to the parameters tested. The results for the western United States depend most on model resolution; those for the central United States, on the sea-surface temperature gradient and the degree of mid-latitude ocean warming; and those for the eastern United States, on model sensitivity. The changes in particular seasons depend on changes in other seasons, and will therefore be sensitive to the realism of the ground hydrology parameterization.
Rind, D.↗
Quantifying model prediction sensitivity to model-form uncertainty
Computational and mathematical models are essential to understanding complex systems and phenomena. However, when developing such models, limited knowledge and/or resources necessitates the use of simplifying assumptions. It is therefore crucial to quantify the impact of such simplifying assumptions on the reliability and accuracy of resulting model predictions. This work develops a first-of-its-kind approach to quantify the impact of physics modeling assumptions on predictions. Here, we leverage the emerging field of model-form uncertainty (MFU) representations, which are parameterized modifications to modeling assumptions, in combination with grouped Sobol’ indices to quantitatively measure an assumption’s importance. Specifically, we compute the grouped Sobol’ index for the MFU representation’s parameters as a single importance measure of the assumption for which the MFU representation characterizes uncertainty. To ensure this approach is robust to the subjective choice of how to parameterize a MFU representation, we establish bounds for the difference between sensitivity results for two different MFU representations based on differences in model prediction statistics. The capabilities associated with this approach are demonstrated on three exemplar problems: an upscaled subsurface contaminant transport problem, ablation modeling for hypersonic flight, and nuclear waste repository modeling. We found that our grouped approach is able to assess the impact of modeling assumptions on predictions and offers computational advantages over classical Sobol’ index computation while providing more interpretable results.
97 MATHEMATICS AND COMPUTING↗
Quantifying Model Prediction Sensitivity to Model-Form Uncertainty
Explore the source record for details and available documents.
Portone, Teresa↗
A model of nitrous oxide evolution from soil driven by rainfall events. I - Model structure and sensitivity. II - Model applications
Simulations of N2O and CO2 emissions from soils were conducted with a rain-event driven, process-oriented model (DNDC) of nitrogen and carbon cycling processes in soils. The magnitude and trends of simulated N2O (or N2O + N2) and CO2 emissions were consistent with the results obtained in field experiments. The successful simulation of these emissions from the range of soil types examined demonstrates that the DNDC will be a useful tool for the study of linkages among climate, soil-atmosphere interactions, land use, and trace gas fluxes.
Changsheng, LI↗
Efficient Distance-based Global Sensitivity Analysis for Terrestrial Ecosystem Modeling
Sensitivity analysis in terrestrial ecosystem modeling is important for understanding controlling processes, guiding model development, and targeting new observations to reduce parameter and prediction uncertainty. Complex and computationally expensive terrestrial ecosystem models (TEM) limit the number of ensemble simulations, requiring sophisticated and efficient methods to analyze sensitivities of multiple model responses to different types of parameter uncertainties. In this study, we propose a distance-based global sensitivity analysis (DGSA) method. DGSA first classifies model response samples into a small set of discrete classes and then calculates the distance between parameter frequency distributions in different classes to measure the parameter sensitivity. The principle is that, if the parameter distribution is the same in each class, then the model response is insensitive to the parameter, while a large difference in the distributions indicates the parameter is influential to the response. Built on this idea, DGSA can be applied to analyze sensitivity of a single and a group of responses to different kinds of parameter uncertainties including continuous, discrete and even stochastic. Besides the main-effect sensitivity from a single parameter, DGSA can also quantify the sensitivity from parameter interactions. Additionally, DGSA is computationally efficient which can use a small number of model evaluations to obtain an accurate and statistically significant result. We applied DGSA to two TEMs, one having eight parameters and three kinds of model responses, and the other having 47 parameters and a long-period response. We demonstrated that DGSA can be used for sensitivity problems with multiple responses and high-dimensional parameters efficiently.
Lu, Dan↗
Dynamical System Scaling Application to Zircaloy Cladding Thermal Response During Reactivity-Initiated Accident Experiment
New fuel design and development currently requires 20 to 25 years to be qualified for use by the nuclear power industry. The thermal-hydraulics community has taken advantage of scaling theory to design reduced scale experiments that correctly preserve dominant key phenomena while quantifying distorted phenomena. These techniques can be leveraged in the design and analysis of fuel performance experiments to help reduce the timeline associated with fuel design and development. This study uses the Dynamical System Scaling (DSS) method to analyze cladding temperature data from the recent SETH-C experiment in the TREAT facility and accompanying BISON simulations to assess dynamic distortions occurring throughout the fast power excursion transient. The DSS analysis revealed that on the cool down from peak cladding temperature that the fuel radial power profile is the most sensitive modeling parameter with a heterogenous radial peaking factor corresponding to the lowest distortion compared to a uniform energy deposition. For the heat up to peak cladding temperature the heterogeneous radial power profile corresponded to the shortest process action. Finally, for the heat up to peak cladding temperature, the gap conductance model sensitivity was quantified using process action and shows that the default Light Water Reactor gap conductance model corresponded to the longest process action.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Critical Parameter Identification of Fuel-Cell Models Using Sensitivity Analysis
Numerical modeling has been a vital tool in proton-exchange-membrane fuel-cell (PEMFC) analysis; however, the predictive capabilities of these models depend on the input physical parameters, several of which are either not experimentally measured or have large scatter in measured values. This article presents an uncertainty propagation-based sensitivity analysis to identify the model parameters that impact the model predictions most. A comprehensive 2-D membrane electrode assembly (MEA) model is used to perform local sensitivity analysis at multiple operating conditions, which encompass the range of environments and operating conditions a cell can encounter. While at lower humidities, cathode kinetics and membrane-ohmic-loss related parameters are crucial, gas transport and porous-media saturation behavior are more important at humidified conditions. Several of these findings are different from previous studies presented in literature. Identifying the crucial parameters helps focus future material and cell optimization studies as well as experimental studies to quantify these parameters with higher accuracy.
25 ENERGY STORAGE↗
Use of an adjoint model for finding triggers for Alpine lee cyclogenesis
The authors propose a new procedure, designated the adjoint-based genesis diagnostic (AGD) procedure, for studying triggering mechanisms and the subsequent genesis of the synoptic phenomena of interest. This procedure makes use of a numerical model sensitivity to initial conditions and the nonlinear evolution of the initial perturbations that are designed using this sensitivity. The model sensitivity is evaluated using the associated adjoint model. This study uses the dry version of the National Center for Atmospheric Research Mesoscale Adjoint Modeling System (MAMS) for the numerical experiments. The authors apply the AGD procedure to two cases of Alpine lee cyclogenesis that were observed during the Alpine Experiment special observations period. The results show that the sensitivity fields that are produced by the adjoint model and the associated initial perturbations are readily related to the probable triggering mechanisms for these cyclones. Additionally, the nonlinear evolution of these initial perturbations points toward the physical processes involved in the lee cyclone formation. The AGD experiments for a weak cyclone case indicate that the MAMS forecast model has an underrepresented topographic forcing due to the sigma vertical coordinate and that this model error can be compensated by adjustments in the initial conditions that are related to the triggering mechanisms, which is not associated with the topographic blocking mechanism.
Vukicevic, Tomislava↗
Natural Ocean Carbon Cycle Sensitivity to Parameterizations of the Recycling in a Climate Model
Sensitivities of the oceanic biological pump within the GISS (Goddard Institute for Space Studies ) climate modeling system are explored here. Results are presented from twin control simulations of the air-sea CO2 gas exchange using two different ocean models coupled to the same atmosphere. The two ocean models (Russell ocean model and Hybrid Coordinate Ocean Model, HYCOM) use different vertical coordinate systems, and therefore different representations of column physics. Both variants of the GISS climate model are coupled to the same ocean biogeochemistry module (the NASA Ocean Biogeochemistry Model, NOBM), which computes prognostic distributions for biotic and abiotic fields that influence the air-sea flux of CO2 and the deep ocean carbon transport and storage. In particular, the model differences due to remineralization rate changes are compared to differences attributed to physical processes modeled differently in the two ocean models such as ventilation, mixing, eddy stirring and vertical advection. GISSEH(GISSER) is found to underestimate mixed layer depth compared to observations by about 55% (10 %) in the Southern Ocean and overestimate it by about 17% (underestimate by 2%) in the northern high latitudes. Everywhere else in the global ocean, the two models underestimate the surface mixing by about 12-34 %, which prevents deep nutrients from reaching the surface and promoting primary production there. Consequently, carbon export is reduced because of reduced production at the surface. Furthermore, carbon export is particularly sensitive to remineralization rate changes in the frontal regions of the subtropical gyres and at the Equator and this sensitivity in the model is much higher than the sensitivity to physical processes such as vertical mixing, vertical advection and mesoscale eddy transport. At depth, GISSER, which has a significant warm bias, remineralizes nutrients and carbon faster thereby producing more nutrients and carbon at depth, which eventually resurfaces with the global thermohaline circulation especially in the Southern Ocean. Because of the reduced primary production and carbon export in GISSEH compared to GISSER, the biological pump efficiency, i.e., the ratio of primary production and carbon export at 75 m, is half in the GISSEH of that in GISSER, The Southern Ocean emerges as a key region where the CO2 flux is as sensitive to biological parameterizations as it is to physical parameterizations. The fidelity of ocean mixing in the Southern Ocean compared to observations is shown to be a good indicator of the magnitude of the biological pump efficiency regardless of physical model choice.
Antarctic Ocean↗
A geostatistics-informed hierarchical sensitivity analysis method for complex groundwater flow and transport modeling
Sensitivity analysis is an important tool for development and improvement of mathematical models, especially for complex systems with a high dimension of spatially correlated parameters. Variance-based global sensitivity analysis has gained popularity because it can quantify the relative contribution of uncertainty from different sources. However, its computational cost increases dramatically with the complexity of the considered model and the dimension of model parameters. As such, in this study, we developed a new sensitivity analysis method that integrates the concept of variance-based method with a hierarchical uncertainty quantification framework. Different uncertain inputs are grouped and organized into a multilayer framework based on their characteristics and dependency relationships to reduce the dimensionality of the sensitivity analysis. A set of new sensitivity indices are defined for the grouped inputs using the variance decomposition method. Using this methodology, we identified the most important uncertainty source for a dynamic groundwater flow and solute transport model at the Department of Energy (DOE) Hanford site. The results indicate that boundary conditions and permeability field contribute the most uncertainty to the simulated head field and tracer plume, respectively. The relative contribution from each source varied spatially and temporally. By using a geostatistical approach to reduce the number of realizations needed for the sensitivity analysis, the computational cost of implementing the developed method was reduced to a practically manageable level. The developed sensitivity analysis method is generally applicable to a wide range of hydrologic and environmental problems that deal with high-dimensional spatially distributed input variables.
58 GEOSCIENCES↗
Sensitivity Analysis of the Human Research Program’s Impact 1.0 Model
Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Leave One Out (LOO) are methods of conducting sensitivity analysis on non-linear simulation models like the IMPACT Model. The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The “partial” part is due to the adjustments made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. LOO removes a medical condition from test suite and calculates the change in the outcome. This is used to identify the influence of the condition input in the model The inputs to the sensitivity procedures include the number of occurrences of each of the one hundred plus IMPACT medical conditions generated over the simulations, and the IMPACT outputs from the MEDPRAT mathematical model. The outputs total task time lost (TTL), number of return to definitive care (RTDC), and number of loss of crew lives (LOCL). The IMPACT team will report the results of using PRCC and LOO on IMPACT 1.0. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty, and input values could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMPACT 1.0.
Sensitivity Anaylsis↗
Sensitivity and model reduction of simulated snow processes: Contrasting observational and parameter uncertainty to improve prediction
Not Available
54 ENVIRONMENTAL SCIENCES↗
New Uses for Sensitivity Analysis: How Different Movement Tasks Effect Limb Model Parameter Sensitivity
Original results for a newly developed eight-order nonlinear limb antagonistic muscle model of elbow flexion and extension are presented. A wider variety of sensitivity analysis techniques are used and a systematic protocol is established that shows how the different methods can be used efficiently to complement one another for maximum insight into model sensitivity. It is explicitly shown how the sensitivity of output behaviors to model parameters is a function of the controller input sequence, i.e., of the movement task. When the task is changed (for instance, from an input sequence that results in the usual fast movement task to a slower movement that may also involve external loading, etc.) the set of parameters with high sensitivity will in general also change. Such task-specific use of sensitivity analysis techniques identifies the set of parameters most important for a given task, and even suggests task-specific model reduction possibilities.
Winters, J. M.↗
Effects of dynamical heat fluxes on model climate sensitivity
A coupled high and low latitude radiative-dynamical model of the annual mean northern hemisphere has been constructed in order to study the interactions of the vertical and meridional heat fluxes and their feedback effect on model climate sensitivity. The model's climate sensitivity to solar constant changes and CO2 increases is investigated, and the effect of feedback in the dynamical fluxes on model climate sensitivity is examined. Nonlinear interactions between heat fluxes and other feedbacks such as radiation-temperature, ice albedo, and humidity are also discussed.
Wang, W.-C.↗
Differential methods for assessing sensitivity in biological models
Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.
59 BASIC BIOLOGICAL SCIENCES↗