Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Uncertainty and sensitivity analysis of fission gas behavior in engineering-scale fuel modeling

The role of uncertainties in fission gas behavior calculations as part of engineering-scale nuclear fuel modeling is investigated using the BISON fuel performance code and a recently implemented physics-based model for the coupled fission gas release and swelling. Through the integration of BISON with the DAKOTA software, a sensitivity analysis of the results to selected model parameters is carried out based on UO2 single-pellet simulations covering different power regimes. The parameters are varied within ranges representative of the relative uncertainties and consistent with the information from the open literature. The study leads to an initial quantitative assessment of the uncertainty in fission gas behavior modeling with the parameter characterization presently available. Also, the relative importance of the single parameters is evaluated. Moreover, a sensitivity analysis is carried out based on simulations of a fuel rod irradiation experiment, pointing out a significant impact of the considered uncertainties on the calculated fission gas release and cladding diametral strain. The results of the study indicate that the commonly accepted deviation between calculated and measured fission gas release by a factor of 2 approximately corresponds to the inherent modeling uncertainty at high fission gas release. Nevertheless, higher deviations may be expected for values around 10% and lower. Implications are discussed in terms of directions of research for the improved modeling of fission gas behavior for engineering purposes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Explainable and trustworthy artificial intelligence for correctable modeling in chemical sciences

Data science has primarily focused on big data, but for many physics, chemistry, and engineering applications, data are often small, correlated and, thus, low dimensional, and sourced from both computations and experiments with various levels of noise. Typical statistics and machine learning methods do not work for these cases. Expert knowledge is essential, but a systematic framework for incorporating it into physics-based models under uncertainty is lacking. Here, we develop a mathematical and computational framework for probabilistic artificial intelligence (AI)–based predictive modeling combining data, expert knowledge, multiscale models, and information theory through uncertainty quantification and probabilistic graphical models (PGMs). We apply PGMs to chemistry specifically and develop predictive guarantees for PGMs generally. Our proposed framework, combining AI and uncertainty quantification, provides explainable results leading to correctable and, eventually, trustworthy models. The proposed framework is demonstrated on a microkinetic model of the oxygen reduction reaction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty Quantification of Calculated Temperatures for the AGR 5/6/7 Experiment

This report documents the quantification of uncertainty of the calculated temperature data for the Advanced Gas Reactor (AGR) 5/6/7 fuel irradiation experiment conducted in the Advanced Test Reactor at Idaho National Laboratory in support of the Advanced Reactor Technologies? research and development program. Recognizing uncertainties inherent in physics and thermal simulations of the AGR 5/6/7 capsules, the results of the numerical simulations are used in combination with statistical analysis methods to improve qualification of measured data. The calculated fuel temperatures for AGR tests are also used for validation of the fission product transport and fuel performance simulation models. These crucial roles of the calculated fuel temperatures in ensuring achievement of the AGR experimental program objectives require accurate determination of the model temperature uncertainties. This report covers temperature uncertainty results for each of the five AGR 5/6/7 capsules. To quantify the uncertainty of calculated temperatures determined using the ABAQUS finite element heat transfer code, this study identifies and analyzes model parameters of potential importance to the calculated temperatures of fuel compacts and thermocouples. The selection of input parameters for uncertainty quantification is based on the ranking of their influences upon temperature predictions. Thus, selected input parameters include those with high sensitivity and those with the largest uncertainty. Propagation of model parameter uncertainty and sensitivity is then used to quantify the overall uncertainty of calculated temperatures. Measurement uncertainty, analysis of modeling assumptions, and expert judgment are used as the basis to quantify the uncertainty range for selected input parameters. The input uncertainties are dynamic, accounting for the effect of unplanned events and changes in thermal properties of capsule components over extended exposure to high temperatures and fast neutron irradiation. The sensitivity analysis performed in this work went beyond the traditional local sensitivity. Using experimental design, analysis of pairwise interactions of model parameters was performed to establish sufficiency of the time dependent first order (linear) expansion terms in constructing the temperature response surface. To achieve completeness, uncertainty propagation made use of pairwise noise correlations of model parameters. Furthermore, using an interpolation scheme over the input parameter domain, the analysis obtains time dependent sensitivity over the test campaign duration. This allows computation of uncertainty for the calculated fuel temperatures and the calculated graphite temperatures at thermocouple locations during the entire irradiation period.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

An extended polynomial chaos expansion for PDF characterization and variation with aleatory and epistemic uncertainties

This paper presents an extended polynomial chaos formalism for epistemic uncertainties and a new framework for evaluating sensitivities and variations of output probability density functions (PDF) to uncertainty in probabilistic models of input variables. An ”extended” polynomial chaos expansion (PCE) approach is developed that accounts for both aleatory and epistemic uncertainties, modeled as random variables, thus allowing a unified treatment of both types of uncertainty. We explore in particular epistemic uncertainty associated with the choice of prior probabilistic models for input parameters. A PCE-based Kernel Density (KDE) construction provides a composite map from the PCE coefficients and germ to the PDF of quantities of interest (QoI). Here, the sensitivities of these PDF with respect to the input parameters are then evaluated. Input parameters of the probabilistic models are considered. By sampling over the epistemic random variable, a family of PDFs is generated and the failure probability is itself estimated as a random variable with its own PCE. Integrating epistemic uncertainties within the PCE framework results in a computationally efficient paradigm for propagation and sensitivity evaluation. Two typical illustrative examples are used to demonstrate the proposed approach.

Aleatory uncertainty↗

Modeling and Validation of the Thermal Response of TDI Encapsulating Foam as a function of Initial Density

TDI foams of nominal density from 10 to 45 pound per cubic foot were decomposed within a heated stainless steel container. The pressure in the container and temperatures measured by thermocouples were recorded with each test proceeding to an allowed maximum pressure before venting. Two replicate tests for each of four densities and two orientations in gravity produced very consistent pressure histories. Some thermal responses demonstrate random sudden temperature increases due to decomposition product movement. The pressurization of the container due to the generation of gaseous products is more rapid for denser foams. When heating in the inverted orientation, where gravity is in the opposite direction of the applied heat flux, the liquefied decomposition products move towards the heated plate and the pressure rises more rapidly than in the upright configuration. This effect is present at all the densities tested but becomes more pronounced as density of the foam is decreased. A thermochemical material model implemented in a transient conduction model solved with the finite element method was compared to the test data. The expected uncertainty of the model was estimated using the mean value method and importance factors for the uncertain parameters were estimated. The model that was assessed does not consider the effect of liquefaction or movement of gases. The result of the comparison is that the model uncertainty estimates do not account for the variation in orientation (no gravitational affects are in the model) and therefore the pressure predictions are not distinguishable due to orientation. Temperature predictions were generally in good agreement with the experimental data. Predictions for response locations on the outside of the can benefit from reliable estimates associated with conduction in the metal. For the lighter foams, temperatures measured on the embedded component fall well with the estimated uncertainty intervals indicating the energy transport rate through the decomposed region appears to be accurately estimated. The denser foam tests were terminated at maximum allowed pressure earlier resulting in only small responses at the component. For all densities the following statements are valid: The temperature response of the embedded component in the container depends on the effective conductivity of the foam which attempts to model energy transport through the decomposed foam and on the stainless steel specific heat. The pressure response depends on the activation energy of the reactions and the density of the foam and the foam specific heat and effective conductivity. The temperature responses of other container locations depend heavily on the boundary conditions and the stainless steel conductivity and specific heat.

36 MATERIALS SCIENCE↗

Realistic Geochemical Parameter Uncertainty for Performance Assessment Modeling - 17066

Performance assessments (PAs) include uncertain geochemical parameters that affect the fate and transport of contaminants in environmental media, such as partitioning coefficients for water/rock (K{sub d}) and water/air (K{sub H}), diffusion coefficients, and aqueous solubilities. A statistical approach to realistic, as opposed to 'conservative,' stochastic distribution development for geochemical parameters is presented here. For contaminants not identified as focus elements during screening, broad generic distributions are developed. If any parameter is flagged in the subsequent model sensitivity analysis (SA), it becomes a focus element for further research during the next round of distribution development. This iterative approach is efficient and technically defensible at each stage. Data are collected in databases and may be appropriately weighted or filtered. In the relatively few cases where data exist from local or analogous rocks, those data may be prioritized. Once established, the databases can be used for future PAs or other environmental models and can be expanded as needed based on model SA results, additional screening, and as additional relevant data become available. The iterative method is demonstrated for K{sub d} and K{sub H} in a PA model for a radioactive waste disposal facility. An SA was performed based on preliminary geochemical parameter distributions that showed certain model endpoints are sensitive to K{sub d} and K{sub H} values for some contaminants. This underscores the importance of including realistic uncertainty in these geochemical parameters. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Importance of treating correlations in the uncertainty quantification of radiation damage metrics - 25461

The radiation effects community embraces the importance of quantifying uncertainty in model predictions and the importance of propagating this uncertainty into the integral metrics used to validate models, but they are not always aware of the importance of addressing the energy- and reaction-dependent correlations in the underlying uncertainty contributors. This paper presents a rigorous high-fidelity Total Monte Carlo approach that addresses the correlation in the underlying uncertainty components and quantifies the role of both energy and reaction-dependent correlations in a sample application that addresses the damage metrics relevant to silicon semiconductors. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Contrasting Parametric Sensitivities in Two Global Vegetation Models Using Parameter Perturbation Ensembles

Uncertainty in land model projections remains high and the roles of parametric and structural uncertainty are difficult to disentangle. To compare parametric sensitivity across model structures we present two parameter perturbation ensembles using the Community Land Model (CLM) operating in satellite phenology mode. The ensembles contrast two vegetation modules: (a) the default CLM vegetation module and (b) the Functionally Assembled Terrestrial Ecosystem Simulator (CLM-FATES). We perturbed over 300 parameters and quantified their effects on biophysical fluxes globally and across biomes. Most parameters have minimal impact on biophysical fluxes, with only a few substantially influencing results. While both models exhibit similar parameter sensitivity for some fluxes, CLM-FATES shows larger spread in gross primary productivity (GPP), driven by strong sensitivity to carboxylation rate. CLM-FATES also shows a weaker GPP response to soil hydrology parameters and exhibits higher water use efficiency (WUE). Cross-model comparisons reveal similar sensitivities for some parameters (e.g., leaf dimension) but divergent responses to others (e.g., stomatal intercept), highlighting underlying structural differences. Differences in WUE and sensitivity to hydrology and stomatal conductance parameters underscore how model structure fundamentally alters parametric sensitivity. The data sets generated from these ensembles can be used to identify influential parameters and guide future calibration efforts.

Foster, A. C. [NSF National Center for Atmospheric↗

Flood hazard model calibration using multiresolution model output

Riverine floods pose a considerable risk to many communities. Improving flood hazard projections has the potential to inform the design and implementation of flood risk management strategies. Current flood hazard projections are uncertain, especially due to uncertain model parameters. Calibration methods use observations to quantify model parameter uncertainty. With limited computational resources, researchers typically calibrate models using either relatively few expensive model runs at high spatial resolutions or many cheaper runs at lower spatial resolutions. This leads to an open question: is it possible to effectively combine information from the high and low resolution model runs? We propose a Bayesian emulation–calibration approach that assimilates model outputs and observations at multiple resolutions. As a case study for a riverine community in Pennsylvania, we demonstrate our approach using the LISFLOOD-FP flood hazard model. Here, the multiresolution approach results in improved parameter inference over the single resolution approach in multiple scenarios. Results vary based on the parameter values and the number of available models runs. Our method is general and can be used to calibrate other high dimensional computer models to improve projections.

multiresolution↗

Can machine learning accelerate process understanding and decision‐relevant predictions of river water quality?

Abstract The global decline of water quality in rivers and streams has resulted in a pressing need to design new watershed management strategies. Water quality can be affected by multiple stressors including population growth, land use change, global warming, and extreme events, with repercussions on human and ecosystem health. A scientific understanding of factors affecting riverine water quality and predictions at local to regional scales, and at sub‐daily to decadal timescales are needed for optimal management of watersheds and river basins. Here, we discuss how machine learning (ML) can enable development of more accurate, computationally tractable, and scalable models for analysis and predictions of river water quality. We review relevant state‐of‐the art applications of ML for water quality models and discuss opportunities to improve the use of ML with emerging computational and mathematical methods for model selection, hyperparameter optimization, incorporating process knowledge into ML models, improving explainablity, uncertainty quantification, and model‐data integration. We then present considerations for using ML to address water quality problems given their scale and complexity, available data and computational resources, and stakeholder needs. When combined with decades of process understanding, interdisciplinary advances in knowledge‐guided ML, information theory, data integration, and analytics can help address fundamental science questions and enable decision‐relevant predictions of riverine water quality.

54 ENVIRONMENTAL SCIENCES↗

Detection of multi-reference character imbalances enables a transfer learning approach for virtual high throughput screening with coupled cluster accuracy at DFT cost

Appropriately identifying and treating molecules and materials with significant multi-reference (MR) character is crucial for achieving high data fidelity in virtual high-throughput screening (VHTS). Despite development of numerous MR diagnostics, the extent to which a single value of such a diagnostic indicates the MR effect on a chemical property prediction is not well established. We evaluate MR diagnostics for over 10 000 transition-metal complexes (TMCs) and compare to those for organic molecules. We observe that only some MR diagnostics are transferable from one chemical space to another. By studying the influence of MR character on chemical properties (i.e., MR effect) that involve multiple potential energy surfaces (i.e., adiabatic spin splitting, ΔE H–L , and ionization potential, IP), we show that differences in MR character are more important than the cumulative degree of MR character in predicting the magnitude of an MR effect. Motivated by this observation, we build transfer learning models to predict CCSD(T)-level adiabatic ΔE H–L and IP from lower levels of theory. By combining these models with uncertainty quantification and multi-level modeling, we introduce a multi-pronged strategy that accelerates data acquisition by at least a factor of three while achieving coupled cluster accuracy (i.e., to within 1 kcal mol –1 MAE) for robust VHTS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hydrodynamic Modeling Analysis of Tidal Wetland Restoration in Snohomish River, Washington

To re-establish the intertidal wetlands with full tidal interaction and improve salmonid rearing habitat in the Lower Snohomish River estuary, a diked wetland along Union Slough of the Snohomish River was restored by breaching the existing dike and constructing bridges across the breaches. However, post-restoration monitoring indicated that the restored project site could not drain as efficiently as desired. To improve the drainage conditions at the restoration site during low tides, a modeling study was conducted to evaluate additional restoration scenarios and to provide recommendations for finish-grade ground elevations to achieve the desired drainage. To accurately simulate the drainage of the project site, an unstructured-grid hydrodynamic model with fine-grid resolution down to a few meters was used in this study. The model was first validated with observed water level data collected in the project site and then applied to assess the feasibility of different proposed restoration scenarios. A spatial varying bottom roughness option in the model is also implemented to better represent the high roughness due to the presence of dense vegetation in the project site. The methodology, error statistics of model validation and uncertainty of the modeling analysis are presented and discussed.

Yang, Zhaoqing↗

Light Cone Dynamics and EMC Effects in the Extraction of F{sub 2n} at Large Bjorken x

We discuss theoretical issues related to the extraction of deep inelastic (DIS) structure function of neutron from inclusive DIS scattering off the deuteron at large Bjorken x. Theoretical justification is given to the consideration of only pn component of the deuteron wave function and consistency with both the baryonic number and light-cone momentum conservation sum rules. Next we discuss the EMC type effects and argue that in all cases relevant to the nuclear DIS reactions at large x the main issue is the medium modification of the properties of bound nucleon rather than the non-nucleonic components like pions. We give brief description of the color screening model of EMC and within this model we estimate uncertainties in the extraction of the neutron DIS structure function at large x. We emphasize also that these uncertainties are rather ''model independent'' since any theoretical framework accounting for the medium modification is proportional to the magnitude of the virtuality of bound nucleon which increases with an increase of x.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A five-year milestone: reflections on advances and limitations in GeoAI research

The Annual Meeting of the American Association of Geographers (AAG) in 2023 marked a five-year milestone since the first Geospatial Artificial Intelligence (GeoAI) Symposium was held at AAG in 2018. In the past five years, progress has been made while open questions remain. In this context, we organized an AAG panel and invited five panellists to discuss the advances and limitations in GeoAI research. The panellists commended the successes, such as the development of spatially explicit models, the production of large-scale geographic datasets, and the use of GeoAI to address real-world problems. The panellists also shared their thoughts on limitations in current GeoAI research, which were considered as opportunities to engage theories in geography, enhance model explainability, quantify uncertainty, and improve model generalizability. This article summarizes the presentations from the panellists and also provides after-panel thoughts from the organizers. We hope that this article can make these thoughts more accessible to interested readers and help stimulate new ideas for future breakthroughs.

97 MATHEMATICS AND COMPUTING↗

THE PROPAGATION OF UNCERTAINTIES IN STELLAR POPULATION SYNTHESIS MODELING. III. MODEL CALIBRATION, COMPARISON, AND EVALUATION

Stellar population synthesis (SPS) provides the link between the stellar and dust content of galaxies and their observed spectral energy distributions. In the present work, we perform a comprehensive calibration of our own flexible SPS (FSPS) model against a suite of data. These data include ultraviolet, optical, and near-IR photometry, surface brightness fluctuations, and integrated spectra of star clusters in the Magellanic Clouds (MCs), M87, M31, and the Milky Way (MW), and photometry and spectral indices of both quiescent and post-starburst galaxies at z {approx} 0. Several public SPS models are intercompared, including the models of Bruzual and Charlot (BC03), Maraston (M05), and FSPS. The relative strengths and weaknesses of these models are evaluated, with the following conclusions: (1) the FSPS and BC03 models compare favorably with MC data at all ages, whereas M05 colors are too red and the age dependence is incorrect; (2) all models yield similar optical and near-IR colors for old metal-poor systems, and yet they all provide poor fits to the integrated J - K and V - K colors of both MW and M31 star clusters; (3) FSPS is able to fit all of the ultraviolet data because both the post-asymptotic giant branch (post-AGB) and horizontal branch evolutionary phases are handled flexibly, while the BC03 and M05 models fail in the far-UV, and both far- and near-UV, respectively; (4) all models predict ugr colors too red, D{sub n}4000 strengths too strong, and Hdelta{sub A} strengths too weak compared to massive red sequence galaxies, under the assumption that such galaxies are composed solely of old metal-rich stars; and (5) FSPS and, to a lesser extent, BC03 can reproduce the optical and near-IR colors of post-starburst galaxies, while M05 cannot. Reasons for these discrepancies are explored. The failure at predicting the ugr colors, D{sub n}4000, and Hdelta{sub A} strengths can be explained by some combination of a minority population of metal-poor stars, young stars, blue straggler and/or blue horizontal branch (HB) stars, but not by appealing to inadequacies in either theoretical stellar atmospheres or canonical evolutionary phases (e.g., the main-sequence turnoff). The different model predictions in the near-IR for intermediate age systems are due to different treatments of the thermally pulsating asymptotic giant branch stellar evolutionary phase. We emphasize that due to a lack of calibrating star cluster data in regions of the metallicity-age plane relevant for galaxies, all of these models continue to suffer from serious uncertainties that are difficult to quantify.

79 ASTRONOMY AND ASTROPHYSICS↗

Multifidelity Monte Carlo Estimation of Variance and Sensitivity Indices

Variance-based sensitivity analysis provides a quantitative measure of how uncertainty in a model input contributes to uncertainty in the model output. Such sensitivity analyses arise in a wide variety of applications and are typically computed using Monte Carlo estimation, but the many samples required for Monte Carlo to be sufficiently accurate can make these analyses intractable when the model is expensive. This paper presents a multifidelity approach for estimating sensitivity indices that leverages cheaper low-fidelity models to reduce the cost of sensitivity analysis while retaining accuracy guarantees via recourse to the original, expensive model. This paper develops new multifidelity estimators for variance and for the Sobol' main and total effect sensitivity indices. We discuss strategies for dividing limited computational resources among models and specify a recommended strategy. Results are presented for the Ishigami function and a convection-diffusion-reaction model that demonstrate up to $10\times$ speedups for fixed convergence levels. Finally, for the problems tested, the multifidelity approach allows inputs to be definitively ranked in importance when Monte Carlo alone fails to do so.

97 MATHEMATICS AND COMPUTING↗

Comparison of Uncertainty of Two Precipitation Prediction Models at Los Alamos National Lab Technical Area 54

Meteorological inputs are an important part of subsurface flow and transport modeling. The choice of source for meteorological data used as inputs has significant impacts on the results of subsurface flow and transport studies. One method to obtain the meteorological data required for flow and transport studies is the use of weather generating models. This paper compares the difference in performance of two weather generating models at Technical Area 54 of Los Alamos National Lab. Technical Area 54 is contains several waste pits for low-level radioactive waste and is the site for subsurface flow and transport studies. This makes the comparison of the performance of the two weather generators at this site particularly valuable.

54 ENVIRONMENTAL SCIENCES↗

Scalable Multilevel Uncertainty Quantification Concepts for Extreme-Scale Multiscale Problems

Our work in this project is aimed at making fundamental advances in multilevel and multiscale methods for problems with uncertainties related to flows in porous media. The main thrust of this research is to develop a systematic multiscale, multilevel parallel approaches for problems with uncertainties and use them in the uncertainty quantification. A key emphasis is on problems without an apparent scale separation in space, time, and uncertainty spaces. Multiscale solution methods are currently under active investigation. However, the develop- ment of multiscale methods for problems with uncertainties where the scales and uncertainties are tightly coupled is a research area that is less explored. During this project, we have made some significant contributions to the developments of multiscale methods, the uncertainty quantification for multiscale methods, multiscale model learning, uncertainty quantification in inverse problems, and applications.

97 MATHEMATICS AND COMPUTING↗