Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Characterizing the Electromagnetic Response of the NOvA Detectors

The NOvA Test Beam Program was commissioned to complement the full-scale NOvA experiment in its goal of measuring neutrino oscillations. The NOvA Experiment consists of a 300-ton Near Detector and a 14-kton Far Detector, both exposed to the same beam, which can be operated in neutrino or antineutrino mode from Fermilab at an off-axis angle of 14.6~mrad. These detectors can discriminate between $\nu_\mu$-CC and $\nu_e$-CC neutrino (or corresponding antineutrino) events, enabling appearance and disappearance measurements of these flavors across the \SI{810}{\kilo\meter} near-to-far detector baseline. From these measurements, the underlying parameters of the three-flavor PMNS oscillations framework are measured. The NOvA Test Beam uses identical technology to the full-scale detectors, but scaled down to 30~tons. It is exposed to a beam of charged particles closely matched to the daughter products of NOvA (anti)neutrino interactions in both energy and species. An instrumented beamline determines both particle momentum and species upstream of the NOvA detector, allowing for a crisp measurement of the NOvA detector response to these known inputs. This dissertation presents an analysis of the electromagnetic response of the NOvA hardware and establishes a framework for incorporating these results to enhance the physics reach of the experiment. Prior to this work, the electromagnetic energy response of the NOvA detector relied primarily on simulation-driven calibration together with a globally applied energy scale uncertainty. The measurements presented here provide direct test beam constraints on the detector response, enabling particle-dependent and potentially energy-dependent uncertainty models derived from controlled electromagnetic inputs.

Myers, Dalton Grant [U. Texas, Austin (main)] (ORC↗

Indoor Sampler Siting

Contaminant releases in or near a building can lead to significant human exposures unless prompt response is taken. U.S. Federal and local agencies are implementing programs to place air-monitoring samplers in buildings to quickly detect biological agents. We describe a probabilistic algorithm for siting samplers in order to detect accidental or intentional releases of biological material. The algorithm maximizes the probability of detecting a release from among a suite of realistic scenarios. The scenarios may differ in any unknown, for example the release size or location, weather, mode of building operation, etc. The algorithm also can optimize sampler placement in the face of modeling uncertainties, for example the airflow leakage characteristics of the building, and the detection capabilities of the samplers. In an illustrative example, we apply the algorithm to a hypothetical 24-room commercial building, finding optimal networks for a variety of assumed sampler types and performance characteristics. We also discuss extensions of this work for detecting ambient pollutants in buildings, and for understanding building-wide airflow, pollutant dispersion, and exposures.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Propagation within Chained Models for Machine Learning Reconstruction of Neutrino-LAr Interactions

Sequential or chained models are increasingly prevalent in machine learning for scientific applications, due to their flexibility and ease of development. Chained models are particularly useful when a task is separable into distinct steps with a hierarchy of meaningful intermediate representations. In reliability-critical tasks, it is important to quantify the confidence of model inferences. However, chained models pose an additional challenge for uncertainty quantification, especially when input uncertainties need to be propagated. In such cases, a fully uncertainty-aware chain of models is required, where each step accepts a probability distribution over the input space, and produces a probability distribution over the output space. In this work, we present a case study for adapting a single model within an existing chain, designed for reconstruction within neutrino-Argon interactions, developed for neutrino oscillation experiments such as MicroBooNE, ICARUS, and the future DUNE experiment. We test the performance of an input uncertainty-enabled model against an uncertainty-blinded model using a method for generating synthetic noise. By comparing these two, we assess the increase in inference quality achieved by exposing models to upstream uncertainty estimates.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

energy modeling↗

Toward shell model interactions with credible uncertainties

Background: The nuclear shell model is a powerful framework for predicting nuclear structure observables, but relies on interaction matrix elements fit to experimental data as its inputs. Extending the shell model's applicability, particularly toward dripline nuclei, requires efficient fitting methods and credible uncertainty quantification. Traditional approaches face computational challenges and may underestimate uncertainties. Purpose: We develop and test a framework combining eigenvector continuation and Markov chain Monte Carlo to efficiently fit shell model interaction matrix elements and quantify their uncertainties. Methods: Eigenvector continuation is used to emulate shell model calculations, reducing computational costs. The emulator enables Markov chain Monte Carlo sampling to optimize interaction matrix elements and rigorously assess parametric uncertainties. Here, the framework is benchmarked using the USDB interaction in the 𝑠⁢𝑑 shell. Results: The emulator reproduces the USDB interaction with negligible error, validating its use in shell model fitting applications. However, we find that to obtain credible predictive intervals, the model defect of the shell model itself, rather than experimental or emulator error, must be taken into account in order to obtain credible uncertainties. Conclusions: The proposed framework provides an efficient and rigorous approach for fitting shell model interactions and quantifying uncertainties. Further, the normality assumption used in the past appears sufficient to describe the distribution of interaction matrix elements. However, it is crucial to account for model correlations to avoid underestimating uncertainties.

Nuclear forces↗

Exploration of Uncertainty in Glacier Modelling

There are procedures and methods for verification of coding algebra and for validations of models and calculations that are in use in the aerospace computational fluid dynamics (CFD) community. These methods would be efficacious if used by the glacier dynamics modelling community. This paper is a presentation of some of those methods, and how they might be applied to uncertainty management supporting code verification and model validation for glacier dynamics. The similarities and differences between their use in CFD analysis and the proposed application of these methods to glacier modelling are discussed. After establishing sources of uncertainty and methods for code verification, the paper looks at a representative sampling of verification and validation efforts that are underway in the glacier modelling community, and establishes a context for these within overall solution quality assessment. Finally, an information architecture and interactive interface is introduced and advocated. This Integrated Cryospheric Exploration (ICE) Environment is proposed for exploring and managing sources of uncertainty in glacier modelling codes and methods, and for supporting scientific numerical exploration and verification. The details and functionality of this Environment are described based on modifications of a system already developed for CFD modelling and analysis.

Thompson, David E.↗

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗

Determination of Uncertainties for the New SSME Model

This report discusses the uncertainty analysis performed in support of a new test analysis and performance prediction model for the Space Shuttle Main Engine. The new model utilizes uncertainty estimates for experimental data and for the analytical model to obtain the most plausible operating condition for the engine system. This report discusses the development of the data sets and uncertainty estimates to be used in the development of the new model. It also presents the application of uncertainty analysis to analytical models and the uncertainty analysis for the conservation of mass and energy balance relations is presented. A new methodology for the assessment of the uncertainty associated with linear regressions is presented.

Coleman, Hugh W.↗

use of cross-section covariance information in uncertainty analysis at modeling HTGR neutron physics - 18551

This work is aimed at improvement of high temperature gas cooled reactors (HTGR) neutron physics design calculations by application of uncertainty analysis with the use of cross-section covariance information. Methodology and codes for preparation of multigroup libraries of covariance information for individual isotopes from the basic 44-group binary library of SCALE-6 code system were developed. A 69-group library of covariance information in a special format for main isotopes and elements typical for HTGR was generated. This library can be used for estimation of uncertainties associated with nuclear data in analysis of HTGR neutron physics with design codes. As an example, calculations of one-group cross-section uncertainties for fission and capture reactions for main isotopes of the MHTGR-350 benchmark, as well as uncertainties of the multiplication factor (k{sub ∞}) for the MHTGR-350 fuel compact cell model and fuel block model were performed. These uncertainties were estimated by the developed technology with the use of WIMS-D code (technology SUW) and modules of SCALE-6 code system, namely, by TSUNAMI, KENO-VI and SAMS. The eight most important reactions on isotopes for MHTGR-350 benchmark were identified, namely: {sup 10}B(capt), {sup 238}U(n,γ), ν{sub 5}, {sup 235}U(n,γ), {sup 238}U(el), {sup nat}C(el), {sup 235}U(fiss)-{sup 235}U(n,γ) and {sup 235}U(fiss). It is shown that the main contribution in the uncertainty of multiplication factor of the fuel block model gives the reaction {sup 10}B(capt) ((n,α)+(n,γ)). (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Surrogate multi-fidelity data and model fusion for scientific discovery and uncertainty quantification in Earth System Models

This whitepaper addresses the Earth and Environmental Systems Sciences Division (EESSD)’s predictability challenges in modeling the integrated water cycle and data-model integration. Specifically, it focuses on reducing and characterizing the uncertainty in the representation of process models for unresolved physics, either due to model resolution or limited by the physical under standing or computational efficiency, and the use of observational data for in-situ process parameter optimization within ESM. The described methods may also be used to determine the nature of responses (e.g. strength and direction), and hence to identify critical processes that drive the overall ESM responses to perturbation in the forcing

54 ENVIRONMENTAL SCIENCES↗

Reducing uncertainties in climate models

Here, we report radiative forcing is a fundamental quantity for understanding both anthropogenic and natural changes in climate. It measures the extent to which human activities [such as the emission of carbon dioxide (CO 2 ), see the image] and natural events (such as volcanic eruptions) perturb the flow of energy into and out of the climate system. This perturbation initiates all other changes of the climate in response to external forcings. Inconsistencies in the calculation of radiative forcing by CO 2 introduce uncertainties in model projections of climate change, a problem that has persisted for more than two decades. The explicit calculation of radiative forcing and a careful vetting of radiative transfer parameterizations provide a straightforward means to substantially reduce these uncertainties and improve the projections.

54 ENVIRONMENTAL SCIENCES↗

Evolution of the Antarctic Ice Sheet from 2000–2300 and beyond: model sensitivity and uncertainty analysis using MPAS-Albany Land Ice

We present a description of the Antarctic Ice Sheet model configuration submitted to the ISMIP6-Antarctica-2300 experiment using the MPAS-Albany Land Ice model, along with three new sets of simulations: (1) a set of extended simulations to 2500 for three forced experiments and to 2775 for the control experiment; (2) a sensitivity analysis of our model configuration to parameters controlling basal sliding and sub-shelf melt, and to model structural choices including the choice of the energy and stress balances; and (3) a 72-member ensemble run on graphics processing units (GPUs) and analysis of variance to determine the primary sources of uncertainty in our ice-sheet model projections. Our extended simulations predict rapid retreat beginning after 2300 for SSP1-2.6 forcing and after 2500 for present-day (control) forcing, primarily in the Amundsen Sea Embayment. We find that varying the sub-shelf melt parameter between the 5th to 95th percentile values for a mean-Antarctic calibration target results in an up to ∼ ± 40 % change in sea-level contribution relative to our baseline simulations that used the median value. Using a linear basal sliding law reduces sea-level contribution by 51 %–73 % relative to our baseline nonlinear sliding law with an exponent of 1/5. When using basal sliding law exponents of 1/3 and 1/10, the overall difference from our baseline simulations at 2300 is on the order of 10 %. The Amundsen Sea Embayment region displays a strongly non-linear dependence of mass loss on the sliding law exponent, with no discernible relationship between the sliding law exponent and the mass loss by 2300, while the sectors feeding the Ross and Filchner-Ronne ice shelves exhibit more mass loss with a more-plastic sliding law. Our model fidelity sensitivity experiments reveal a 9 %–31 % increase in sea-level contribution when using a depth-integrated stress balance approximation relative to our three-dimensional solver, while using a fixed-in-time temperature field increases sea-level contribution by 14 %–88 % relative to two thermomechanically coupled configurations. Our 72-member ensemble and analysis of variance show that the uncertainty in long-term projections is dominated by the choice of Earth system model forcing and the presence or absence of hydrofracture forcing, rather than uncertainty in sliding and sub-shelf melt parameters.

58 GEOSCIENCES↗

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

bifacial↗

Conditional Karhunen–Loève regression model with Basis Adaptation for high-dimensional problems: Uncertainty quantification and inverse modeling

Here, we propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems’ spatially heterogeneous parameter fields, with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen–Loève expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the KLE coefficients. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loève expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements of the parameter field via Gaussian process regression, and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1000-dimensional representation of the model’s log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models.

97 MATHEMATICS AND COMPUTING↗

Propagation of statistical uncertainties of Skyrme mass models to simulations of r -process nucleosynthesis

Uncertainties in nuclear models have a major impact on simulations that aim at understanding the origin of heavy elements in the universe through the rapid neutron capture process ( r process) of nucleosynthesis. Within the framework of the nuclear density functional theory, we use results of Bayesian statistical analysis to propagate uncertainties in the parameters of energy density functionals to the predicted r -process abundance pattern, by way not only of the nuclear masses but also through the influence of the masses on β -decay and neutron capture rates. We point out the importance of the nonequilibrium end stage of the r process in determining the width of the resulting abundance pattern uncertainty bands. We additionally make the first identifications of specific parameters of Skyrme-like energy density functionals which show tentative correlations with particular aspects of the r -process abundance pattern. While previous studies have explored the reduction in the abundance pattern uncertainties due to anticipated new measurements of neutron-rich nuclei, here we point out that an even larger reduction will occur when these new measurements are used to reduce the uncertainty of model predictions of masses, which are then propagated through to the abundance pattern. We make a quantitative prediction for how large this reduction will be.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

WE-AB-204-08: Uncertainties in Kinetic Modeling of Shortened Dynamic 18F-FMISO PET Due to Image Noise

Purpose: To assess uncertainties in voxel-wise kinetic modeling (KM) of dynamic 18F-FMISO PET (dPET) due to image noise for different lengths of dPET acquisitions. Methods: 12 tumor time activity curves (TACs) deduced from 6 head and neck cancer patient dPET datasets (45min dPET + 10min frames at ∼95min and ∼160min respectively) were modeled using an irreversible two-tissue compartment model to estimate kinetic rate constants (KRCs) k3, vB, K1, and K1/k2 (reference standard). For each modeled TAC, 1000 noisy TACs were simulated by adding Gaussian noise with standard deviation equivalent to that observed on a voxel level in GE DSTE PET-CT. KM was conducted for each set of noisy TACs using (i) full dataset (170min), and repeated using (ii) 105min and (iii) 45min shortened subsets, with an input function that was image-derived from the dPET dataset of matching length. Absolute value of percent difference between KRCs from noisy TACs as estimated from either of 3 datasets and reference standard KRCs was used to represent bias. Results: For all KRCs, bias was higher for shortened datasets. For k3, bias was lower when actual k3 was higher: from 7%±5% (170min), 9%±7% (105min), and 14%±11% (45min) (actual k3=0.0098), to 32%±25% (170min), 45%±34% (95min), and 79%±48% (45min) (actual k3=0.0008). Similar relationship was observed for vB, with bias being between ∼7% (actual vB=0.28) and ∼26–34% (actual vB=0.08). For K1 [K1/k2], bias was ∼6–10% [∼2–3%] (dependence on actual value of K1 [K1/k2] was not observed). Conclusion: Uncertainties in voxel-wise KM of shortened 18F-FMISO dPET due to image noisy only are larger for shorter acquisitions and, for k3 [vB], the bias was found to be inversely correlated with the actual values of k3 [vB]. Using 45min subset, k3, vB, K1, and K1/k2 could be estimated to within ∼15–80%, ∼10–35%, ∼10%, and ∼3%, respectively.

60 APPLIED LIFE SCIENCES↗

Uncertainty Quantification and Error Propagation in the Enthalpy and Entropy of Surface Reactions Arising from a Single DFT Functional

Accounting for parametric uncertainty in models is essential for quantifying the models’ predictive ability. Recently, approaches have been introduced to estimate parametric uncertainty in kinetic models while accounting for correlations among energy parameters. However, correlations have been estimated indirectly and correlations in entropies have not been accounted for. For surface-catalyzed microkinetic models of >C2 (more than two carbon-containing) molecules, which consist of thousands of reaction steps and intermediate surface species, first-principles density functional theory (DFT) is costly, and thus, estimation of thermochemistry and reaction barriers requires surrogate methods of DFT, such as group additivity and Brønsted–Evans–Polanyi relationships, respectively. For such parametrization, model uncertainty is unclear. This work develops a framework to overcome these gaps using group additivity and a single DFT functional. We estimate correlations in parameters of kinetic models and quantify uncertainty for thermochemistry, reaction barriers, reaction paths, and ultimately reaction rates, accounting also for the contribution of entropic uncertainty. Furthermore, the approach is illustrated on propane combustion and ethane oxidative dehydrogenation reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗