Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗

Transient Traceability Analysis of Land Carbon Storage Dynamics: Procedures and Its Application to Two Forest Ecosystems

Abstract Uptake of anthropogenically emitted carbon (C) dioxide by terrestrial ecosystem is critical for determining future climate. However, Earth system models project large uncertainties in future C storage. To help identify sources of uncertainties in model predictions, this study develops a transient traceability framework to trace components of C storage dynamics. Transient C storage ( X ) can be decomposed into two components, C storage capacity ( X c ) and C storage potential ( X p ). X c is the maximum C amount that an ecosystem can potentially store and X p represents the internal capacity of an ecosystem to equilibrate C input and output for a network of pools. X c is codetermined by net primary production (NPP) and residence time (τ N ), with the latter being determined by allocation coefficients, transfer coefficients, environmental scalar, and exit rate. X p is the product of redistribution matrix (τ ch ) and net ecosystem exchange. We applied this framework to two contrasting ecosystems, Duke Forest and Harvard Forest with an ecosystem model. This framework helps identify the mechanisms underlying the responses of carbon cycling in the two forests to climate change. The temporal trajectories of X are similar between the two ecosystems. Using this framework, we found that different mechanisms lead to a similar trajectory between the two ecosystems. This framework has potential to reveal mechanisms behind transient C storage in response to various global change factors. It can also identify sources of uncertainties in predicted transient C storage across models and can therefore be useful for model intercomparison.

58 GEOSCIENCES↗

On the Power of Uncertainties in Microbial System Modeling: No Need To Hide Them Anymore

For decades, microbiologists have considered uncertainties as an undesired side effect of experimental protocols. As a consequence, standard microbial system modeling strives to hide uncertainties for the sake of deterministic understanding. However, recent studies have highlighted greater experimental variability than expected and emphasized uncertainties not as a weakness but as a necessary feature of complex microbial systems. We therefore advocate that biological uncertainties need to be considered foundational facets that must be incorporated in models. Not only will understanding these uncertainties improve our understanding and identification of microbial traits, it will also provide fundamental insights on microbial systems as a whole. Taking into account uncertainties within microbial models calls for new validation techniques. Formal verification already overcomes this shortcoming by proposing modeling frameworks and validation techniques dedicated to probabilistic models. However, further work remains to extract the full potential of such techniques in the context of microbial models. Herein, we demonstrate how statistical model checking can enhance the development of microbial models by building confidence in the estimation of critical parameters and through improved sensitivity analyses.

59 BASIC BIOLOGICAL SCIENCES↗

Translation of Land Surface Model Accuracy and Uncertainty into Coupled Land-Atmosphere Prediction

Land-atmosphere (L-A) Interactions playa critical role in determining the diurnal evolution of both planetary boundary layer (PBL) and land surface heat and moisture budgets, as well as controlling feedbacks with clouds and precipitation that lead to the persistence of dry and wet regimes. Recent efforts to quantify the strength of L-A coupling in prediction models have produced diagnostics that integrate across both the land and PBL components of the system. In this study, we examine the impact of improved specification of land surface states, anomalies, and fluxes on coupled WRF forecasts during the summers of extreme dry (2006) and wet (2007) land surface conditions in the U.S. Southern Great Plains. The improved land initialization and surface flux parameterizations are obtained through the use of a new optimization and uncertainty estimation module in NASA's Land Information System (US-OPT/UE), whereby parameter sets are calibrated in the Noah land surface model and classified according to a land cover and soil type mapping of the observation sites to the full model domain. The impact of calibrated parameters on the a) spinup of the land surface used as initial conditions, and b) heat and moisture states and fluxes of the coupled WRF Simulations are then assessed in terms of ambient weather and land-atmosphere coupling along with measures of uncertainty propagation into the forecasts. In addition, the sensitivity of this approach to the period of calibration (dry, wet, average) is investigated. Finally, tradeoffs of computational tractability and scientific validity, and the potential for combining this approach with satellite remote sensing data are also discussed.

Santanello, Joseph A.↗

A New Modeling Approach for a Priori Uncertainties of Laser Tracker Angle Measurements

Methods for modeling the uncertainty in laser tracker angle measurements vary within the metrology industry, leading to confusion and questionable stochastic modeling for survey network adjustments and error propagation analysis. Interpreting the published laser tracker manufacturer performance specifications to determine an a priori sigma value for weighting azimuth and zenith angle measurements can be confusing and has led to differing implementations. Furthermore, this paper proposes a unique way to model survey network a priori laser tracker angular uncertainties based on laser tracker manufacturers’ published maximum permissible error (MPE) values referenced to current standards for weighting survey network measurements. This paper’s proposed model takes into account the disparate effects that pointing errors, target centering errors, and leveling errors have on azimuth and zenith angular uncertainties for measurements with steep sightings and at near ranges.

42 ENGINEERING↗

Uncertainties in model-independent extractions of amplitudes from complete experiments

A new generation of over-complete experiments is underway, with the goal of performing a high precision extraction of pseudoscalar meson photo-production amplitudes. Such experimentally determined amplitudes can be used both as a test to validate models and as a starting point for an analytic continuation in the complex plane to search for poles. Of crucial importance for both is the level of uncertainty in the extracted multipoles. We have probed these uncertainties by analyses of pseudo-data for KLambda photoproduction, first for the set of 8 observables that have been published for the K{sup +} Lambda channel and then for pseudo-data on a complete set of 16 observables with the uncertainties expected from analyses of ongoing CLAS experiments. In fitting multipoles, we have used a combined Monte Carlo sampling of the amplitude space, with gradient minimization, and have found a shallow X{sup 2} valley pitted with a large number of local minima. This results in bands of solutions that are experimentally indistinguishable. All ongoing experiments will measure observables with limited statistics. We have found a dependence on the particular random choice of values of Gaussian distributed pseudo-data, due to the presence of multiple local minima. This results in actual uncertainties for reconstructed multipoles that are often considerable larger than those returned by gradient minimization routines such as Minuit which find a single local minimum. As intuitively expected, this additional level of uncertainty decreases as larger numbers of observables are included.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

CFD Validation Study of a Hypersonic Cone-Slice-Flap Variable Geometry Configuration

Model validation is the process of determining the degree of accuracy between physical reality and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap variable geometry configuration given uncertainty in both the simulation and experimental data. The research here compares two different turbulence models for the simulations. For a variable geometry, performing uncertainty quantification to capture the model-form uncertainty on every configuration is computationally challenging. This work lays out a procedure that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs and many low-fidelity runs on multiple configurations. Running this comparison provides a quantifiable measurement for the accuracy of each turbulence model for this type of design. The high-fidelity CFD solver used was VULCAN-CFD and the low-fidelity results came from Cart3D. The experimental data came from the 20-Inch Mach 6 Tunnel located at NASA Langley Research Center. The present work showed that the using both the Spalart and Allamaras and Menter Shear-Stress Transport turbulence models overpredicted the drag and lift coefficient, while underpredicting the pitching moment coefficient. The model-form uncertainty estimate resulted in up to a 13.6% change in the total uncertainty for the drag coefficient, up to a 57.4% change in total uncertainty for the lift coefficient, and up to a 100% change in total uncertainty for the pitching moment coefficient.

Laura M. White↗

Identifying high-impact and high-uncertainty parameters in MiniFuel model predictions

The MiniFuel irradiation platform at Oak Ridge National Laboratory's High Flux Isotope Reactor (HFIR) is a flexible, high-throughput separate effects test capability. Finite element thermal models are relied upon to design MiniFuel experiments and to achieve experimental objectives. Recent reports show good agreement in the model prediction of target fuel temperatures, but as the capability of the experiments is extended to higher temperatures, the uncertainty in the model predictions must be quantified. To that end, high-impact, high-uncertainty parameters that contribute the most uncertainty to the model are identified. The uncertainty quantification was accomplished through a series of screening and sensitivity analyses. The first analysis utilizes the method of Morris to perform a computationally efficient preliminary screening that considers uncertainty in a large number of the model inputs. The most important parameters identified in the Morris screening study were then considered in a Sobol sensitivity analysis that more robustly ranks and quantifies the uncertainty associated with each parameter. From these analyses, it was determined that thermal contact conductance between components is the parameter that contributes the highest uncertainty. The estimated uncertainty of the MiniFuel model fuel temperature predictions is ±80 °C in the removable beryllium and ±40 °C in the vertical experiment facilities. In conclusion, the framework established by the series of sensitivity analyses presented herein could easily be adapted to fit the needs of accelerated fuel qualification processes.

Fuel, Irradiation↗

Uncertainty Propagation Analysis of Computational Models in Laser Powder Bed Fusion Additive Manufacturing Using Polynomial Chaos Expansions

Computational models for simulating physical phenomena during laser-based powder bed fusion additive manufacturing (L-PBF AM) processes are critical for enhancing our understanding of these phenomena, enable process optimization, and accelerate qualification and certification of AM materials and parts. It is a well-known fact that such models typically involve multiple sources of uncertainty that originate from different sources such as model parameters uncertainty, or model/code inadequacy, among many others. Uncertainty quantification (UQ) is a broad field that focuses on characterizing such uncertainties in order to maximize the benefit of these models. Although UQ has been a center theme in computational models associated with diverse fields such as computational fluid dynamics and macro-economics, it has not yet been fully exploited with computational models for advanced manufacturing. The current study introduces one among the first efforts to conduct uncertainty propagation (UP) analysis in the context of L-PBF AM. More specifically, we present a generalized polynomial chaos expansions (gPCE) framework to assess the distributions of melt pool dimensions due to uncertainty in input model parameters. We develop the methodology and then employ it to validate model predictions, both through benchmarking them against Monte Carlo (MC) methods and against experimental data acquired from an experimental testbed.

36 MATERIALS SCIENCE↗

Improvements to Nuclear Data and Its Uncertainties by Theoretical Modeling

This project addresses three important gaps in existing evaluated nuclear data libraries that represent a significant hindrance against highly advanced modeling and simulation capabilities for the Advanced Fuel Cycle Initiative (AFCI). This project will: Develop advanced theoretical tools to compute prompt fission neutrons and gamma-ray characteristics well beyond average spectra and multiplicity, and produce new evaluated files of U and Pu isotopes, along with some minor actinides; Perform state-of-the-art fission cross-section modeling and calculations using global and microscopic model input parameters, leading to truly predictive fission cross-sections capabilities. Consistent calculations for a suite of Pu isotopes will be performed; Implement innovative data assimilation tools, which will reflect the nuclear data evaluation process much more accurately, and lead to a new generation of uncertainty quantification files. New covariance matrices will be obtained for Pu isotopes and compared to existing ones. The deployment of a fleet of safe and efficient advanced reactors that minimize radiotoxic waste and are proliferation-resistant is a clear and ambitious goal of AFCI. While in the past the design, construction and operation of a reactor were supported through empirical trials, this new phase in nuclear energy production is expected to rely heavily on advanced modeling and simulation capabilities. To be truly successful, a program for advanced simulations of innovative reactors will have to develop advanced multi-physics capabilities, to be run on massively parallel super- computers, and to incorporate adequate and precise underlying physics. And all these areas have to be developed simultaneously to achieve those ambitious goals. Of particular interest are reliable fission cross-section uncertainty estimates (including important correlations) and evaluations of prompt fission neutrons and gamma-ray spectra and uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessing the nexus between groundwater and solar energy plants in a desert basin with a dual-model approach under uncertainty

Globally, many solar power plants and other types of renewable energy are being located in water-scarce regions. Many projects rely on groundwater resources whose sustainability is uncertain. In the Chuckwalla Basin in California, quantification of recharge and trans-valley underflow is needed to estimate the impacts of solar project withdrawals on the water table. However, such estimates are highly challenging due to data scarcity, heterogeneous soils and long residence times. Conventional assessment employs isolated groundwater models configured with crude and uniform estimates of recharge. Here, we employ a data-constrained surface subsurface processes model, PAWS+CLM, to provide an ensemble of recharges and underflows with perturbed parameters. Then, the Parameter Estimation (PEST) package is used to calibrate MODFLOW aquifer conductivity and filter out implausible recharges. The novel dual-model approach, potentially applicable in other arid regions, can effectively assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was assumed, it resulted in under-estimated drawdown and larger uncertainty bounds. The withdrawals are approaching total inflow, suggesting the system will be nearing, if not exceeding, its sustainable groundwater production capacity, and a boom of such projects will not be sustainable. Especially, the cost/benefit of pumped-storage projects is called into question as the initial-fill phase depletes entire area’s recharge. Our study highlights the stress on groundwater resources of solar development, and that the speed of groundwater recovery does not indicate sustainability. Main point 1: A novel dual model approach, involving an integrated surface/subsurface model and a groundwater parameter-estimation model, was able to better constrain the model. Main point 2: The groundwater system may be nearing, if not exceeding, its sustainable groundwater production capacity and the speed of recovery is not indicative of sustainability. Main point 3: Results from using conventionally-assumed uniform recharge distort calibrated K fields and impacts assessment

14 SOLAR ENERGY↗

Glass Design Using Machine Learning Property Models with Prediction Uncertainties: Nuclear Waste Glass Formulation

The United States Department of Energy is responsible for managing the legacy nuclear waste stored in underground tanks at the Hanford Site. The waste will be separately vitrified as low-activity waste and high-level waste fractions. Waste glass formulation algorithms have been traditionally developed using partial quadratic mixture property-composition models. Recently, machine learning (ML) techniques have been used to predict glass properties and discover new glass materials for nuclear waste vitrification, and these advancements can be utilized to improve waste glass composition design. In this proof-of-principle study, ML algorithms such as Gaussian process regression (GPR) were used to interpolate glass properties (e.g., viscosity, electrical conductivity, chemical durability). After selecting appropriate sets of GPR hyper-parameters for each property, an optimization program was developed to formulate glass compositions to maximize waste loading while simultaneously satisfying property within constraints. The results of the ML-based waste loadings and glass compositions were compared to those obtained using the traditional methods. Comparing to the previous glass design framework, the ML-based optimization methods offer improved glass designs and a streamlined approach to generation of optimally designed data and near real-time updates.

glass formulation, machine learning, constraints, ↗

Assessing the nexus between groundwater and solar energy plants in a desert basin with a dual-model approach under uncertainty

Globally, many solar power plants and other types of renewable energy are being located in water-scarce regions. Many projects rely on groundwater resources whose sustainability is uncertain. In the Chuckwalla Basin in California, quantification of recharge and trans-valley underflow is needed to estimate the impacts of solar project withdrawals on the water table. However, such estimates are highly challenging due to data scarcity, heterogeneous soils and long residence times. Conventional assessment employs isolated groundwater models configured with crude and uniform estimates of recharge. Here, we employ a data-constrained surface subsurface processes model, PAWS+CLM, to provide an ensemble of recharges and underflows with perturbed parameters. Then, the Parameter Estimation (PEST) package is used to calibrate MODFLOW aquifer conductivity and filter out implausible recharges. The novel dual-model approach, potentially applicable in other arid regions, can effectively assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was assumed, it resulted in under-estimated drawdown and larger uncertainty bounds. The withdrawals are approaching total inflow, suggesting the system will be nearing, if not exceeding, its sustainable groundwater production capacity, and a boom of such projects will not be sustainable. Especially, the cost/benefit of pumped-storage projects is called into question as the initial-fill phase depletes entire area’s recharge. Our study highlights the stress on groundwater resources of solar development, and that the speed of groundwater recovery does not indicate sustainability.

14 SOLAR ENERGY↗

Interval Predictor Models for Data with Measurement Uncertainty

An interval predictor model (IPM) is a computational model that predicts the range of an output variable given input-output data. This paper proposes strategies for constructing IPMs based on semidefinite programming and sum of squares (SOS). The models are optimal in the sense that they yield an interval valued function of minimal spread containing all the observations. Two different scenarios are considered. The first one is applicable to situations where the data is measured precisely whereas the second one is applicable to data subject to known biases and measurement error. In the latter case, the IPMs are designed to fully contain regions in the input-output space where the data is expected to fall. Moreover, we propose a strategy for reducing the computational cost associated with generating IPMs as well as means to simulate them. Numerical examples illustrate the usage and performance of the proposed formulations.

Lacerda, Marcio J.↗

Impact of Damping Uncertainty on SEA Model Response Variance

Statistical Energy Analysis (SEA) is commonly used to predict high-frequency vibroacoustic levels. This statistical approach provides the mean response over an ensemble of random subsystems that share the same gross system properties such as density, size, and damping. Recently, techniques have been developed to predict the ensemble variance as well as the mean response. However these techniques do not account for uncertainties in the system properties. In the present paper uncertainty in the damping loss factor is propagated through SEA to obtain more realistic prediction bounds that account for both ensemble and damping variance. The analysis is performed on a floor-equipped cylindrical test article that resembles an aircraft fuselage. Realistic bounds on the damping loss factor are determined from measurements acquired on the sidewall of the test article. The analysis demonstrates that uncertainties in damping have the potential to significantly impact the mean and variance of the predicted response.

Schiller, Noah↗

Advanced Methods for Determining Prediction Uncertainty in Model-Based Prognostics with Application to Planetary Rovers

Prognostics is centered on predicting the time of and time until adverse events in components, subsystems, and systems. It typically involves both a state estimation phase, in which the current health state of a system is identified, and a prediction phase, in which the state is projected forward in time. Since prognostics is mainly a prediction problem, prognostic approaches cannot avoid uncertainty, which arises due to several sources. Prognostics algorithms must both characterize this uncertainty and incorporate it into the predictions so that informed decisions can be made about the system. In this paper, we describe three methods to solve these problems, including Monte Carlo-, unscented transform-, and first-order reliability-based methods. Using a planetary rover as a case study, we demonstrate and compare the different methods in simulation for battery end-of-discharge prediction.

prognosis↗