Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Systematic study of the validity of the eikonal model including uncertainties

Nuclear reactions at intermediate beam energies are often interpreted using the eikonal model. In the analysis of complex reaction probes, where few-body reaction methods are needed, the eikonal method may be used as an efficient way for describing the fragment-target reaction process. In this work, we perform a systematic study to test the validity of the eikonal approximation for nucleon-nucleus reactions. We also quantify uncertainties due to the nucleon optical potential on reaction observables. We inspect the validity of the eikonal model and its semiclassical correction by comparing it to exact solutions (obtained from solving the optical-model equation with a finite-differences method) for a wide range of reactions. We also study the effect of relativistic corrections, both kinematic and dynamic, by effectively incorporating the relativistic effects at intermediate energies. The uncertainties from a Bayesian global optical potential (KDUQ) are propagated to the observables of interest. Our study includes neutron and proton reactions on 27 Al , 40 Ca , 90 Zr , and 208 Pb , for a wide range of energies 𝐸 lab = 0–400 MeV. We calculate neutron-total cross sections (elastic and reactions) as well as proton-absorption cross sections as a function of beam energy, using the eikonal model, the eikonal model with a semiclassical correction, and the exact solution. Here, we also compute angular distributions for the methods above. Our results show that for the proton-absorption cross section, the eikonal model can be used down to around 60 MeV and the semiclassical correction extends its use to 30 MeV. However, the validity of the eikonal model for the neutron-total cross section only goes down to ≈120 MeV, a range extended to ≈ 50 MeV when using the semiclassical correction. We find the semiclassical correction to the eikonal model to be less effective in describing the angular distributions. The 1⁢𝜎 uncertainty intervals on the observables we studied is less than 5% for most of the energies considered, but increases rapidly for higher energies, namely energies outside the range of KDUQ (𝐸 lab > 200MeV).

Cluster models↗

Role of Uncertainty Quantification in the Explainability of Large Language Models for the Nuclear Industry

The meteoric rise of generative artificial intelligence (AI) large language models (LLMs) has created an opportunity to utilize them to increase efficiencies in a multitude of industries. While LLMs carry great potential to revolutionize the manner in which work is performed, numerous known deficiencies limit their utility, including the black box nature of the models, the stochastic nature of the response (i.e., presenting the same prompt multiple times results in different responses), and the potential for hallucination. Widespread adoption of LLMs in safety-critical industries such as nuclear will require some form of explainability to assure end users that the LLM’s response to a given query is valid. Model uncertainty is inherently linked to the concepts of trust and explainability, and can be used to identify situations in which the model is insufficiently certain about its answer. Although uncertainty is not enough in and of itself to determine the suitability of an answer—a model can be very certain of an inaccurate answer—it still provides valuable supporting information. Practical methodologies for gauging or quantifying the uncertainty in LLM outputs are presented herein, along with examples based on nuclear-specific prompts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

GLAD-M35: a joint P and S global tomographic model with uncertainty quantification

We present our third and final generation joint P and S global adjoint tomography (GLAD) model, GLAD-M35, and quantify its uncertainty based on a low-rank approximation of the inverse Hessian. Starting from our second-generation model, GLAD-M25, we added 680 new earthquakes to the database for a total of 2160 events. New P-wave categories are included to compensate for the imbalance between P- and S-wave measurements, and we enhanced the window selection algorithm to include more major-arc phases, providing better constraints on the structure of the deep mantle and more than doubling the number of measurement windows to 40 million. Two stages of a Broyden–Fletcher–Goldfarb–Shanno (BFGS) quasi-Newton inversion were performed, each comprising five iterations. With this BFGS update history, we determine the model’s standard deviation and resolution length through randomized singular value decomposition.

58 GEOSCIENCES↗

Multifidelity Analysis and Optimization for Supersonic Design

Supersonic aircraft design is a computationally expensive optimization problem and multifidelity approaches over a significant opportunity to reduce design time and computational cost. This report presents tools developed to improve supersonic aircraft design capabilities including: aerodynamic tools for supersonic aircraft configurations; a systematic way to manage model uncertainty; and multifidelity model management concepts that incorporate uncertainty. The aerodynamic analysis tools developed are appropriate for use in a multifidelity optimization framework, and include four analysis routines to estimate the lift and drag of a supersonic airfoil, a multifidelity supersonic drag code that estimates the drag of aircraft configurations with three different methods: an area rule method, a panel method, and an Euler solver. In addition, five multifidelity optimization methods are developed, which include local and global methods as well as gradient-based and gradient-free techniques.

Kroo, Ilan↗

Sources of Uncertainty in Modeled Land Carbon Storage within and across Three MIPs: Diagnosis with Three New Techniques

Terrestrial carbon cycle models have incorporated increasingly more processes as a means to achieve more-realistic representations of ecosystem carbon cycling. Despite this, there are large across-model variations in the simulation and projection of carbon cycling. Several model intercomparison projects (MIPs), for example, the fifth phase of the Coupled Model Intercomparison Project (CMIP5) (historical simulations), Trends in Net Land–Atmosphere Carbon Exchange (TRENDY), and Multiscale Synthesis and Terrestrial Model Intercomparison Project (MsTMIP), have sought to understand intermodel differences. Here in this study, the authors developed a suite of new techniques to conduct post-MIP analysis to gain insights into uncertainty sources across 25 models in the three MIPs. First, terrestrial carbon storage dynamics were characterized by a three-dimensional (3D) model output space with coordinates of carbon residence time, net primary productivity (NPP), and carbon storage potential. The latter represents the potential of an ecosystem to lose or gain carbon. This space can be used to measure how and why model output differs. Models with a nitrogen cycle generally exhibit lower annual NPP in comparison with other models, and mostly negative carbon storage potential. Second, a transient traceability framework was used to decompose any given carbon cycle model into traceable components and identify the sources of model differences. The carbon residence time (or NPP) was traced to baseline carbon residence time (or baseline NPP related to the maximum carbon input), environmental scalars, and climate forcing. Third, by applying a variance decomposition method, the authors show that the intermodel differences in carbon storage can be mainly attributed to the baseline carbon residence time and baseline NPP (>90% in the three MIPs). The three techniques developed in this study offer a novel approach to gain more insight from existing MIPs and can point out directions for future MIPs. Finally, since this study is conducted at the global scale for an overview on intermodel differences, future studies should focus more on regional analysis to identify the sources of uncertainties and improve models at the specified mechanism level.

54 ENVIRONMENTAL SCIENCES↗

Performance Metrics, Error Modeling, and Uncertainty Quantification

A common set of statistical metrics has been used to summarize the performance of models or measurements-­ the most widely used ones being bias, mean square error, and linear correlation coefficient. They assume linear, additive, Gaussian errors, and they are interdependent, incomplete, and incapable of directly quantifying un­certainty. The authors demonstrate that these metrics can be directly derived from the parameters of the simple linear error model. Since a correct error model captures the full error information, it is argued that the specification of a parametric error model should be an alternative to the metrics-based approach. The error-modeling meth­odology is applicable to both linear and nonlinear errors, while the metrics are only meaningful for linear errors. In addition, the error model expresses the error structure more naturally, and directly quantifies uncertainty. This argument is further explained by highlighting the intrinsic connections between the performance metrics, the error model, and the joint distribution between the data and the reference.

Quantification↗

Diagnostic and model dependent uncertainty of simulated Tibetan permafrost area

We perform a land-surface model intercomparison to investigate how the simulation of permafrost area on the Tibetan Plateau (TP) varies among six modern stand-alone land-surface models (CLM4.5, CoLM, ISBA, JULES, LPJ-GUESS, UVic). Here, we also examine the variability in simulated permafrost area and distribution introduced by five different methods of diagnosing permafrost (from modeled monthly ground temperature, mean annual ground and air temperatures, air and surface frost indexes). There is good agreement (99 to 135 × 10 4 km 2 ) between the two diagnostic methods based on air temperature which are also consistent with the observation-based estimate of actual permafrost area (101 ×10 4 km 2 ). However the uncertainty (1 to 128 × 10 4 km 2 ) using the three methods that require simulation of ground temperature is much greater. Moreover simulated permafrost distribution on the TP is generally only fair to poor for these three methods (diagnosis of permafrost from monthly, and mean annual ground temperature, and surface frost index), while permafrost distribution using air-temperature-based methods is generally good. Model evaluation at field sites highlights specific problems in process simulations likely related to soil texture specification, vegetation types and snow cover. Models are particularly poor at simulating permafrost distribution using the definition that soil temperature remains at or below 0°C for 24 consecutive months, which requires reliable simulation of both mean annual ground temperatures and seasonal cycle, and hence is relatively demanding. Although models can produce better permafrost maps using mean annual ground temperature and surface frost index, analysis of simulated soil temperature profiles reveals substantial biases. The current generation of land-surface models need to reduce biases in simulated soil temperature profiles before reliable contemporary permafrost maps and predictions of changes in future permafrost distribution can be made for the Tibetan Plateau.

54 ENVIRONMENTAL SCIENCES↗

Intrinsic Uncertainties in Modeling Complex Systems.

Models are built to understand and predict the behaviors of both natural and artificial systems. Because it is always necessary to abstract away aspects of any non-trivial system being modeled, we know models can potentially leave out important, even critical elements. This reality of the modeling enterprise forces us to consider the prospective impacts of those effects completely left out of a model – either intentionally or unconsidered. Insensitivity to new structure is an indication of diminishing returns. In this work, we represent a hypothetical unknown effect on a validated model as a finite perturbation whose amplitude is constrained within a control region. We find robustly that without further constraints, no meaningful bounds can be placed on the amplitude of a perturbation outside of the control region. Thus, forecasting into unsampled regions is a very risky proposition. We also present inherent difficulties with proper time discretization of models and representing inherently discrete quantities. We point out potentially worrisome uncertainties, arising from mathematical formulation alone, which modelers can inadvertently introduce into models of complex systems.

Cooper, Curtis S.↗

Reconstructing Ly$α$ Fields from Low-resolution Hydrodynamical Simulations with Deep Learning

Hydrodynamical cosmological simulations are a powerful tool for accurately predicting the properties of the intergalactic medium (IGM) and for producing mock skies that can be compared against observational data. However, the need to resolve density fluctuation in the IGM puts a stringent requirement on the resolution of such simulations, which in turn limits the volumes that can be modeled, even on the most powerful supercomputers. In this work, we present a novel modeling method that combines physics-driven simulations with data-driven generative neural networks to produce outputs that are qualitatively and statistically close to the outputs of hydrodynamical simulations employing eight times higher resolution. We show that the Ly$α$ flux field, as well as the underlying hydrodynamic fields, have greatly improved statistical fidelity over a low-resolution simulation. Importantly, the design of our neural network allows for sampling multiple realizations from a given input, enabling us to quantify the model uncertainty. Using test data, we demonstrate that this model uncertainty correlates well with the true error of the Ly$α$ flux prediction. Ultimately, our approach allows for training on small simulation volumes and applying it to much larger ones, opening the door to producing accurate Ly$α$ mock skies in volumes of Hubble size, as will be probed with DESI and future spectroscopic sky surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

MULTI-FIDELITY MODELING AND UNCERTAINTY QUANTIFICATION OF INVERTER BASED RESOURCES IN INTEGRATED T&D SYSTEMS

Uncertainty quantification plays a pivotal role in improving the accuracy and reliability of inverter operation within modern power systems that are increasingly dominated by inverter-based resources (IBRs). IBRs, especially those operating under grid forming (GFM) control, rely heavily on a complex set of control parameters and system measurements to maintain voltage, frequency, and power balance. Traditional deterministic modeling approaches often fail to capture these parameter deviations, potentially resulting in suboptimal control actions, reduced system stability, or even instability under high penetration of IBRs. In this paper, we demonstrate the application of model calibration and uncertainty quantification (UQ) principles to an integrated transmission and distribution (T&D) model involving a GFM converter and provide a framework for prioritizing control improvements, guiding robust design, and informing adaptive strategies that can accommodate real-time variability in system conditions. The proposed approach could be valuable in enhancing the robustness of current and future power systems under increased IBR penetrations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Decision-Dependent Uncertainty-Aware Distribution System Planning Under Wildfire Risk

The interaction between power systems and wildfires can be dangerous and costly. Distribution grids can be liable for the outbreak of wildfires during extreme weather. In wildfire-prone areas, investment planning should consider the impact of operational actions on wildfire-related uncertainties affecting line failure likelihood. Here, in this case, endogenous-based uncertainty modeling should comprise the backbone of the investment planning model viz-a-viz the inability of standard exogenous-based uncertainty modeling. Therefore, we propose a decision-dependent uncertainty (DDU) aware methodology to optimize investment portfolios for distribution systems, considering that high power-flow levels in high-threat areas can ignite wildfires and increase line failure probability. The methodology identifies the best combination of upgrades (new lines, hardening existing lines, and placing switching devices). Methodologically, we propose a two-stage distributionally robust planning optimization problem with DDU that considers the distribution system's multiperiod operation. The first stage determines optimal switching actions and line investments, and the second stage evaluates the worst-case expected operational cost under a DDU framework designed to account for the endogenous impact of power-flow levels and hardening investment decisions in the line failure probabilities. An iterative method is tailored to handle the problem and numerical experiments demonstrate a more prepared grid to deal with wildfire risk.

Power systems investment planning↗

Experimental Robust Control Studies on an Unstable Magnetic Suspension System

This study is an experimental investigation of the robustness of various controllers designed for the Large Angle Magnetic Suspension Test Fixture (LAMSTF). Both analytical and identified nominal models are used for designing controllers along with two different types of uncertainty models. Robustness refers to maintain- ing tracking performance under analytical model errors and dynamically induced eddy currents, while external disturbances are not considered. Results show that incorporating robustness into analytical models gives significantly better results. However, incorporating incorrect uncertainty models may lead to poorer performance than not designing for robustness at all. Designing controllers based on accurate identified models gave the best performance. In fact, incorporating a significant level of robustness into an accurate nominal model resulted in reduced performance. This paper discusses an assortment of experimental results in a consistent manner using robust control theory.

Lim, Kyong B.↗

A MULTISCALE FRAMEWORK FOR THE STOCHASTIC ASSIMILATION AND MODELING OF UNCERTAINTY ASSOCIATED NCF COMPOSITE MATERIALS

Multiscale framework to construct stochastic macroscopic constitutive material models is proposed. A spectral projection approach, specifically polynomial chaos expansion, has been used to construct explicit functional relationships between the homogenized properties and input parameters from finer scales. A homogenization engine embedded in Multiscale Designer, software for composite materials, has been used for the upscaling process. The framework is demonstrated using non-crimp fabric composite materials by constructing probabilistic models of the homogenized properties of a non-crimp fabric laminate in terms of the input parameters together with the homogenized properties from finer scales.

multiscale homogenization, micro- meso- and macro-↗

DIRECT IMAGING OF A COLD JOVIAN EXOPLANET IN ORBIT AROUND THE SUN-LIKE STAR GJ 504

Several exoplanets have recently been imaged at wide separations of >10 AU from their parent stars. These span a limited range of ages (<50 Myr) and atmospheric properties, with temperatures of 800-1800 K and very red colors (J - H > 0.5 mag), implying thick cloud covers. Furthermore, substantial model uncertainties exist at these young ages due to the unknown initial conditions at formation, which can lead to an order of magnitude of uncertainty in the modeled planet mass. Here, we report the direct-imaging discovery of a Jovian exoplanet around the Sun-like star GJ 504, detected as part of the SEEDS survey. The system is older than all other known directly imaged planets; as a result, its estimated mass remains in the planetary regime independent of uncertainties related to choices of initial conditions in the exoplanet modeling. Using the most common exoplanet cooling model, and given the system age of 160{sup +350}{sub -60} Myr, GJ 504b has an estimated mass of 4{sup +4.5}{sub -1.0} Jupiter masses, among the lowest of directly imaged planets. Its projected separation of 43.5 AU exceeds the typical outer boundary of {approx}30 AU predicted for the core accretion mechanism. GJ 504b is also significantly cooler (510{sup +30}{sub -20} K) and has a bluer color (J - H = -0.23 mag) than previously imaged exoplanets, suggesting a largely cloud-free atmosphere accessible to spectroscopic characterization. Thus, it has the potential of providing novel insights into the origins of giant planets as well as their atmospheric properties.

79 ASTRONOMY AND ASTROPHYSICS↗

Direct Imaging of a Cold Jovian Exoplanet in Orbit around the Sun-Like Star GJ 504

Several exoplanets have recently been imaged at wide separations of >10 AU from their parent stars. These span a limited range of ages (<50 Myr) and atmospheric properties, with temperatures of 800-1800 K and very red colors (J −H > 0.5 mag), implying thick cloud covers. Furthermore, substantial model uncertainties exist at these young ages due to the unknown initial conditions at formation, which can lead to an order of magnitude of uncertainty in the modeled planet mass. Here, we report the direct imaging discovery of a Jovian exoplanet around the Sun-like star GJ 504, detected as part of the SEEDS survey. The system is older than all other known directly-imaged planets; as a result, its estimated mass remains in the planetary regime independent of uncertainties related to choices of initial conditions in the exoplanet modeling. Using the most common exoplanet cooling model, and given the system age of 160(+350/−60) Myr, GJ 504 b has an estimated mass of 4(+4.5/−1.0) Jupiter masses, among the lowest of directly imaged planets. Its projected separation of 43.5 AU exceeds the typical outer boundary of approx.. 30 AU predicted for the core accretion mechanism. GJ 504 b is also significantly cooler (510(+30/−20) K)) and has a bluer color (J − H = −0.23 mag) than previously imaged exoplanets, suggesting a largely cloud-free atmosphere accessible to spectroscopic characterization. Thus, it has the potential of providing novel insights into the origins of giant planets, as well as their atmospheric properties.

exoplanets↗

Constraining Bedrock Groundwater Residence Times in a Mountain System with Environmental Tracer Observations and Bayesian Uncertainty Quantification: Modeling and Data Package

Groundwater residence times provide fundamental descriptions of hydrologic dynamics and mixing processes in mountainous watersheds. Yet, few observational datasets that can constrain groundwater residence times over broad timescales are available in high elevation mountain systems. Here we present field observations from May 2021 of dissolved noble gases (He, Ne, Ar, Kr, and Xe), Chloroflourcarbons (CFCs), Sulfurhexaflouride (SF6), and tritium (3H) sampled from the Pumphouse Lower Montane study site (wells PLM1, PLM6, and PLM7) within the East River Watershed, Colorado. The presented noble gas (PLM_noblegas_2021.csv) and environmental tracer (PLM_tracers_2021.csv) observation datasets, along with the associated modeling scripts, aide in quantifying groundwater residence times and recharge conditions in a high elevation mountain system. Furthermore, the modeling scripts quantify groundwater residence time and noble gas recharge condition uncertainties using a novel Markov-chain Monte Carlo approach. All data modeling scripts are written in the Python code.

54 ENVIRONMENTAL SCIENCES↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Quantifying heavy quark transport coefficients with an improved transport model

We report that the heavy-flavor transport coefficients contain important information on the strong interaction at finite temperatures. The extraction of these numbers from experimental data requires dynamical modeling of heavy-flavor transport that is coupled to realistic medium evolution. Furthermore, meaningful extractions necessitate both a faithful implementation of the physical inputs to be tested and the quantification of model uncertainty. For these purposes, we have developed a partonic transport model LIDO. It has an improved treatment of in-medium parton bremsstrahlung, which has been calibrated to theoretical calculations in a simple medium to reduce modeling uncertainty. Regarding the interaction between heavy quark and the medium, few-body perturbative scatterings are applied to large-momentum transfer (q) processes, while a diffusion equation models the dynamics of small-q processes. Such a separation restricts the explicit use of medium quasi-particles to large-q processes only. Another advantage is that deviations from the leading-order probe-medium coupling can be parametrized as an additional contribution to the diffusion constant. The heavy quark transport coefficients are then extracted with uncertainty estimation from a Bayesian analysis including both the RHIC and the LHC data. The results are found to be consistent with earlier extraction of the light-quark transport coefficients at high momentum and be comparable with lattice calculations of the heavy-flavor diffusion constant in the static limit at low momentum.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗