Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Adaptive Computing for Scale-Up Problems

Adaptive Computing is an application-agnostic outer loop framework to strategically deploy simulations and experiments to guide decision making for scale-up analysis. Resources are allocated over successive batches, which makes the allocation adaptive to some objective such as optimization or model training. The framework enables the characterization and management of uncertainties associated with predictive models of complex systems when scale-up questions lead to significant model extrapolation. A key advancement of this framework is its integration of multi-fidelity surrogate modeling, uncertainty management, and automated orchestration of various computing and experimentation resources into a single integrated software package. This enables efficient multi-fidelity modeling across multiple computing resources by incorporating real-world constraints such as relative queue times and throughput on individual machines into the multi-fidelity sampling decision. We discuss applications of this framework to problems in the renewable energy space, including biofuels production, material synthesis, perovskite crystal growth, and building electrical loads.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Code for multi-shape Gaussian process (GP) fitting with uncertainty quantification (UQ)

This is code associated with the publication “Nonparametric Multi-shape Modeling with Uncertainty Quantification,” authored by Hengrui Luo (Lawrence Berkeley National Laboratory) and Justin Strait (Los Alamos National Laboratory). The code is used to fit multiple-output Gaussian process (GP) models of planar closed curves to collections of ordered point sets, allowing for flexible nonlinear prediction of the underlying curve under dense or sparse point set samplings and with or without noise, as well as tractable uncertainty quantification. To do this, we employ use of a periodic kernel to account for the nonlinear input space of closed curves, and combine with coregionalization models to account for dependence both (i) between curve coordinates, and (ii) between pairs of curves. Functions in the code are capable of fitting these models, as well as performing additional tasks with the fitted curves such as (a) shape registration and alignment, (b) shape averaging, and (c) fitting for curve sub-populations / clusters.

Strait, Justin↗

Dark Energy Survey Year 3 results: Cosmology from cosmic shear and robustness to data calibration

This work, together with its companion paper, Secco, Samuroff et al., presents the Dark Energy Survey Year 3 cosmic shear measurements and cosmological constraints based on an analysis of over 100 million source galaxies. With the data spanning 4143 deg 2 on the sky, divided into four redshift bins, we produce the highest significance measurement of cosmic shear to date, with a signal-to-noise of 40. We conduct a blind analysis in the context of the ΛCDM model and find a 3% constraint of the clustering amplitude, S 8 ≡ σ 8 (Ω m /0.3) 0.5 = 0.759$^{+0.025}_{-0.023}$. A ΛCDM-Optimized analysis, which safely includes smaller scale information, yields a 2% precision measurement of S 8 = 0.772$^{+0.018}_{-0.017}$ that is consistent with the fiducial case. The two low-redshift measurements are statistically consistent with the Planck Cosmic Microwave Background result, however, both recovered S 8 values are lower than the high-redshift prediction by 2.3σ and 2.1σ (ρ-values of 0.02 and 0.05), respectively. The measurements are shown to be internally consistent across redshift bins, angular scales and correlation functions. The analysis is demonstrated to be robust to calibration systematics, with the S 8 posterior consistent when varying the choice of redshift calibration sample, the modeling of redshift uncertainty and methodology. Similarly, we find that the corrections included to account for the blending of galaxies shifts our best-fit S 8 by 0.5σ without incurring a substantial increase in uncertainty. We examine the limiting factors for the precision of the cosmological constraints and find observational systematics to be subdominant to the modeling of astrophysics. Specifically, we identify the uncertainties in modeling baryonic effects and intrinsic alignments as the limiting systematics.

79 ASTRONOMY AND ASTROPHYSICS↗

An Advanced ISOCS In Situ Gamma Spectrometry Services Tool to Reduce Uncertainties in Waste Characterization Projects - 16311

Canberra's In Situ Object Counting System (ISOCS) is an established tool used for gamma spectrometry allowing a physical representation of complex geometries and mathematical calculation of the calibration function. It avoids the need for radioisotope standards which can be costly and prohibitively difficult to produce. Uncertainties in the sample - detector geometry lead to uncertainties in the calibrations. Canberra's ISOCS Uncertainty Estimator (IUE) tool offers an automated means of accommodating known model geometry uncertainties, with calculation of robust defensible calibration uncertainties. However these uncertainties may be large leading to potential over-estimation of under-estimation of activity. This can be equated directly to waste disposal costs if one is using ISOCS for waste sentencing to classify wastes as (for example) Transuranic Waste (TRU) or Low Level Waste (LLW). An Advanced ISOCS in-situ Gamma Spectrometry (AIGS) services tool has been developed to reduce the uncertainties. This system is based on generating and comparing geometry models that yield Figures of Merit (FoM) indicative of improved consistency between modelled data and available diverse measurement data. This paper describes the development and features of AIGS, focusing on recent testing with radioisotope sources in a 200 litre drum filled with a simulated waste matrix. The results demonstrate a significant advantage for Am-241 where uncertainties can otherwise amount to a factor of 2 or more. We show how our specialist teams can develop procedures for deployment of standard ISOCS hardware, adapting measurement geometries and procedures through careful planning, to provide data that can be used to greatly reduce the uncertainties in the measured activities. Lastly, we comment on the range of potential applications for this new technique and the wider benefits for the decommissioning industry. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Diffusion‐Based Uncertainty Quantification Method to Advance E3SM Land Model Calibration

Abstract Calibrating land surface models and accurately quantifying their uncertainty are crucial for improving the reliability of simulations of complex environmental processes. This, in turn, advances our predictive understanding of ecosystems and supports climate‐resilient decision‐making. Traditional calibration methods, however, face challenges of high computational costs and difficulties in accurately quantifying parameter uncertainties. To address these issues, we develop a diffusion‐based uncertainty quantification (DBUQ) method. Unlike conventional generative diffusion methods, which are computationally expensive and memory‐intensive, DBUQ innovates by formulating a parameterized generative model and approximates this model through supervised learning, which enables quick generation of parameter posterior samples to quantify its uncertainty. DBUQ is effective, efficient, and general‐purpose, making it suitable for site‐specific ecosystem model calibration and broadly applicable for parameter uncertainty quantification across various earth system models. In this study, we applied DBUQ to calibrate the Energy Exascale Earth System Model land model at the Missouri Ozark AmeriFlux forest site. Results indicated that DBUQ produced accurate parameter posterior distributions similar to those from Markov Chain Monte Carlo sampling but with 30 times less computing time. This significant improvement in efficiency suggests that DBUQ can enable rapid, site‐level model calibration at a global scale, enhancing our predictive understanding of climate impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

SU-D-16A-06: Modeling Biological Effects of Residual Uncertainties For Stereotactic Radiosurgery

Purpose: Residual uncertainties on the order of 1-2 mm are frequently observed when delivering stereotactic radiosurgery via on-line imaging guidance with a relocatable frame. In this study, a predictive model was developed to evalute potentiral late radiation effects associated with such uncertainties. Methods: A mathematical model was first developed to correlate the peripherial isodose volume with the internal and/or setup margins for a radiosurgical target. Such a model was then integrated with a previoulsy published logistic regression normal tissue complication model for determining the symptomatic radiation necrosis rate at various target sizes and prescription dose levels. The model was tested on a cohort of 15 brain tumor and tumor resection cavity patient cases and model predicted results were compared with the clinical results reported in the literature. Results: A normalized target diameter (D{sub 0}) in term of D{sub 0} = 6V/S, where V is the volume of a radiosurgical target and S is the surface of the target, was found to correlate excellently with the peripheral isodose volume for a radiosurgical delivery (logarithmic regression R{sup 2} > 0.99). The peripheral isodose volumes were found increase rapidly with increasing uncertainties levels. In general, a 1-mm residual uncertainties as calculated to result in approximately 0.5%, 1%, and 3% increases in the symptomatic radiation necrosis rate for D{sub 0} = 1 cm, 2 cm, and 3 cm based on the prescription guideline of RTOG 9005, i.e., 21 Gy to a lesion of 1 cm in diameter, 18 Gy to a lesion 2 cm in diameter, and 15 Gy to a lesion 3 cm in diameter respectively. Conclusion: The results of study suggest more stringent criteria on residual uncertainties are needed when treating a large target such as D{sub 0}≤ 3 cm with stereotactic radiosurgery. Dr. Ma and Dr. Sahgal are currently serving on the board of international society of stereotactic radiosurgery (ISRS)

60 APPLIED LIFE SCIENCES↗

DISTRIBUTION AND RANGE OF RADIONUCLIDE SORPTIOIN COEFFICIENTS IN A SAVANNAH RIVER SITE SUBSURFACE: STOCHASTIC MODELING CONSIDERATIONS - 10259

The uncertainty associated with the sorption coefficient, or K{sub d} value, is one of the key uncertainties in estimating risk associated with burying low-level nuclear waste in the subsurface. The objective of this study was to measure >648 K{sub d} values and provide a measure of the range and distribution (normal or log-normal) of radionuclide K{sub d} values appropriate for the E-Area disposal site, within the Savannah River Site, near Aiken South Carolina. The 95% confidence level for the mean K{sub d} was twice the mean in the Aquifer Zone (18-30.5 m depth), equal to the mean for the Upper Vadose Zone (3.3-10 m depth), and half the mean for the Lower Vadose Zone (3.3-18 m depth). The distribution of K{sub d} values was log normal in the Upper Vadose Zone and Aquifer Zone, and normal in the Lower Vadose Zone. To our knowledge, this is the first report of natural radionuclide K{sub d} variability in the literature. Using ranges and distribution coefficients that are specific to the hydrostratigraphic unit improved model accuracy and reduced model uncertainty. Unfortunately, extension of these conclusions to other sites is likely not appropriate given that each site has its own sources of hydrogeological variability. However, this study provides one of the first examples of the development stochastic ranges and distributions of K{sub d} values for a hydrological unit for stochastic modeling.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Multifidelity methods for uncertainty quantification of a nonlocal model for phase changes in materials

This study is devoted to the construction of a multifidelity Monte Carlo (MFMC) method for the uncertainty quantification of a nonlocal, non-mass-conserving Cahn-Hilliard model for phase transitions with an obstacle potential. Here, we are interested in estimating the expected value of an output of interest (OoI) that depends on the solution of the nonlocal Cahn-Hilliard model. As opposed to its local counterpart, the nonlocal model captures sharp interfaces without the need for significant mesh refinement. However, the computational cost of the nonlocal Cahn-Hilliard model is higher than that of its local counterpart with similar mesh refinement, inhibiting its use for outer-loop applications such as uncertainty quantification. The MFMC method augments the desired high-fidelity, high-cost OoI with a set of lower-fidelity, lower-cost OoIs to alleviate the computational burden associated with nonlocality. Most of the computational budget is allocated to sampling the cheap surrogate models to achieve speedup, whereas the high-fidelity model is sparsely sampled to maintain accuracy. For the non-mass-conserving nonlocal Cahn-Hilliard model, the use of the MFMC method results in, for a given computational budget, about an order of magnitude reduction in the mean-squared error of the expected value of the OoI relative to that of the Monte Carlo method.

97 MATHEMATICS AND COMPUTING↗

Combining simulations and data with deep learning and uncertainty quantification for advanced energy modeling

A novel and modern framework for energy modeling is developed in this paper with a focus on nuclear energy modeling and simulation. The framework combines multiphysics simulations and real data, with validation by uncertainty quantification tasks and facilitation by machine and deep learning methods. The hybrid framework is built on the basis of a wide range of physical models, real data, mathematical and statistical methods, and artificial intelligence techniques. The framework is demonstrated in different applications, including quantifying uncertainties in computer simulations, multiphysics coupling, analysis of variance using machine learning surrogate models, deep learning of time series phenomena, and propagating parametric uncertainties of nuclear data. The applications demonstrated are oriented to nuclear engineering simulations, even though majority of the methods are applicable to other energy sources (eg, renewable). Efficient utilization of this framework is expected to yield a much better understanding of the physical phenomena analyzed as well as an improvement in the performance of the energy design/model under construction.

42 ENGINEERING↗

An Uncertainty Analysis of the Hydrogen Source Term for a Station Blackout Accident in Sequoyah Using MELCOR 1.8.5

A methodology for using the MELCOR code with the Latin Hypercube Sampling method was developed to estimate uncertainty in various predicted quantities such as hydrogen generation or release of fission products under severe accident conditions. In this case, the emphasis was on estimating the range of hydrogen sources in station blackout conditions in the Sequoyah Ice Condenser plant, taking into account uncertainties in the modeled physics known to affect hydrogen generation. The method uses user-specified likelihood distributions for uncertain model parameters, which may include uncertainties of a stochastic nature, to produce a collection of code calculations, or realizations, characterizing the range of possible outcomes. Forty MELCOR code realizations of Sequoyah were conducted that included 10 uncertain parameters, producing a range of in-vessel hydrogen quantities. The range of total hydrogen produced was approximately 583kg ± 131kg. Sensitivity analyses revealed expected trends with respected to the parameters of greatest importance, however, considerable scatter in results when plotted against any of the uncertain parameters was observed, with no parameter manifesting dominant effects on hydrogen generation. It is concluded that, with respect to the physics parameters investigated, in order to further reduce predicted hydrogen uncertainty, it would be necessary to reduce all physics parameter uncertainties similarly, bearing in mind that some parameters are inherently uncertain within a range. It is suspected that some residual uncertainty associated with modeling complex, coupled and synergistic phenomena, is an inherent aspect of complex systems and cannot be reduced to point value estimates. The probabilistic analyses such as the one demonstrated in this work are important to properly characterize response of complex systems such as severe accident progression in nuclear power plants.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A method to estimate the effect of deformable image registration uncertainties on daily dose mapping

Purpose: To develop a statistical sampling procedure for spatially-correlated uncertainties in deformable image registration and then use it to demonstrate their effect on daily dose mapping. Methods: Sequential daily CT studies are acquired to map anatomical variations prior to fractionated external beam radiotherapy. The CTs are deformably registered to the planning CT to obtain displacement vector fields (DVFs). The DVFs are used to accumulate the dose delivered each day onto the planning CT. Each DVF has spatially-correlated uncertainties associated with it. Principal components analysis (PCA) is applied to measured DVF error maps to produce decorrelated principal component modes of the errors. The modes are sampled independently and reconstructed to produce synthetic registration error maps. The synthetic error maps are convolved with dose mapped via deformable registration to model the resulting uncertainty in the dose mapping. The results are compared to the dose mapping uncertainty that would result from uncorrelated DVF errors that vary randomly from voxel to voxel. Results: The error sampling method is shown to produce synthetic DVF error maps that are statistically indistinguishable from the observed error maps. Spatially-correlated DVF uncertainties modeled by our procedure produce patterns of dose mapping error that are different from that due to randomly distributed uncertainties. Conclusions: Deformable image registration uncertainties have complex spatial distributions. The authors have developed and tested a method to decorrelate the spatial uncertainties and make statistical samples of highly correlated error maps. The sample error maps can be used to investigate the effect of DVF uncertainties on daily dose mapping via deformable image registration. An initial demonstration of this methodology shows that dose mapping uncertainties can be sensitive to spatial patterns in the DVF uncertainties.

61 RADIATION PROTECTION AND DOSIMETRY↗

GEANT4 parameter tuning using Professor

The GEANT4 toolkit is used extensively in high energy physics to simulate the passage of particles through matter and to predict effects such as detector efficiencies and smearing. GEANT4 uses many underlying models to predict particle interaction kinematics, and uncertainty in these models leads to uncertainty in high energy physics measurements. The GEANT4 collaboration recently made free parameters in some models accessible through partnership with GEANT4 developers. We present a study of the impact of varying parameters in three GEANT4 hadronic physics models on agreement with thin target datasets and describe fits to these datasets using the Professor model tuning framework [1]. We find that varying parameters produces substantially better agreement with some datasets, but that more degrees of freedom are required for full agreement. This work is a first step towards a common framework for propagating uncertainties in GEANT4 models to high energy physics measurements, and we outline future work required to complete that goal.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Uncertainty and Sensitivity Analyses of Duct Propagation Models

This paper presents results of uncertainty and sensitivity analyses conducted to assess the relative merits of three duct propagation codes. Results from this study are intended to support identification of a "working envelope" within which to use the various approaches underlying these propagation codes. This investigation considers a segmented liner configuration that models the NASA Langley Grazing Incidence Tube, for which a large set of measured data was available. For the uncertainty analysis, the selected input parameters (source sound pressure level, average Mach number, liner impedance, exit impedance, static pressure and static temperature) are randomly varied over a range of values. Uncertainty limits (95% confidence levels) are computed for the predicted values from each code, and are compared with the corresponding 95% confidence intervals in the measured data. Generally, the mean values of the predicted attenuation are observed to track the mean values of the measured attenuation quite well and predicted confidence intervals tend to be larger in the presence of mean flow. A two-level, six factor sensitivity study is also conducted in which the six inputs are varied one at a time to assess their effect on the predicted attenuation. As expected, the results demonstrate the liner resistance and reactance to be the most important input parameters. They also indicate the exit impedance is a significant contributor to uncertainty in the predicted attenuation.

Nark, Douglas M.↗

Validation of Exploding Wire Tests Using Alegra-NG

Exploding wire tests are used to characterize materials undergoing high voltage loading and to validate computational models in a simple configuration. In this report, the materials emphasized are gold, aluminum, copper and nickel wires. Model validation is presented using the nominal model (no uncertainty) in the form of heat maps (per material) that show model bias across scalar quantities and initial voltage. Mesh convergence and uncertainty quantification is also presented.

36 MATERIALS SCIENCE↗

Application of Artificial Neural Networks to Reliable Nuclear Data for Nonproliferation Modeling and Simulation

Detection and identification of special nuclear materials (SNMs) are an essential part of the US nonproliferation effort. Modern cutting-edge SNM detection methodologies rely more and more on modeling and simulation techniques. Experiments with radiological samples in realistic configurations, is the ultimate tool that establishes the minimum detection limits of SNMs in a host of different geometries. Modern modeling and simulation approaches have the potential to significantly reduce the number of experiments with radioactive sources needed to determine these detection limits and reduce the financial barrier to SNM detection. Unreliable nuclear data is one of the principal causes of uncertainty in modeling and simulating nuclear systems. In particular, nuclear cross sections introduce a significant uncertainty in the nuclear data. The goal of this research is to develop a methodology that will autonomously extract the correct nuclear resonance characteristics of experimental data in a reliable way, a task previously left to expert judgement. Accurate nuclear data will in turn allow contemporary modeling and simulation to become far more reliable, de-escalating the extent of experimental testing. Modeling and simulation techniques reduce the use and distribution of radiological sources, while at the same time increase the reliability of the currently used methods for the detection and identification of SNMs.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A Novel Modeling Framework for Computationally Efficient and Accurate Real-Time Ensemble Flood Forecasting With Uncertainty Quantification

A novel modeling framework that simultaneously improves accuracy, predictability, and computational efficiency is presented. It embraces the benefits of three modeling techniques integrated together for the first time: surrogate modeling, parameter inference, and data assimilation. The use of polynomial chaos expansion (PCE) surrogates significantly decreases computational time. Parameter inference allows for model faster convergence, reduced uncertainty, and superior accuracy of simulated results. Ensemble Kalman filters assimilate errors that occur during forecasting. To examine the applicability and effectiveness of the integrated framework, we developed 18 approaches according to how surrogate models are constructed, what type of parameter distributions are used as model inputs, and whether model parameters are updated during the data assimilation procedure. We conclude that (1) PCE must be built over various forcing and flow conditions, and in contrast to previous studies, it does not need to be rebuilt at each time step; (2) model parameter specification that relies on constrained, posterior information of parameters (so-called Selected specification) can significantly improve forecasting performance and reduce uncertainty bounds compared to Random specification using prior information of parameters; and (3) no substantial differences in results exist between single and dual ensemble Kalman filters, but the latter better simulates flood peaks. The use of PCE effectively compensates for the computational load added by the parameter inference and data assimilation (up to ~80 times faster). Therefore, the presented approach contributes to a shift in modeling paradigm arguing that complex, high-fidelity hydrologic and hydraulic models should be increasingly adopted for real-time and ensemble flood forecasting.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Uncertainty in JP-7 Kinetics Models Applied to Scramjets

One of the challenges of designing and flying a scramjet-powered vehicle is the difficulty of preflight testing. Ground tests at realistic flight conditions introduce several sources of uncertainty to the flow that must be addressed. For example, the scales of the available facilities limit the size of vehicles that can be tested and so performance metrics for larger flight vehicles must be extrapolated from ground tests at smaller scales. To create the correct flow enthalpy for higher Mach number flows, most tunnels use a heater that introduces vitiates into the flow. At these conditions, the effects of the vitiates on the combustion process is of particular interest to the engine designer, where the ground test results must be extrapolated to flight conditions. In this paper, the uncertainty of the cracked JP-7 chemical kinetics used in the modeling of a hydrocarbon-fueled scramjet was investigated. The factors that were identified as contributing to uncertainty in the combustion process were the level of flow vitiation, the uncertainty of the kinetic model coefficients and the variation of flow properties between ground testing and flight. The method employed was to run simulations of small, unit problems and identify which variables were the principal sources of uncertainty for the mixture temperature. Then using this resulting subset of all the variables, the effects of the uncertainty caused by the chemical kinetics on a representative scramjet flow-path for both vitiated (ground) and nonvitiated (flight) flows were investigated. The simulations showed that only a few of the kinetic rate equations contribute to the uncertainty in the unit problem results, and when applied to the representative scramjet flowpath, the resulting temperature variability was on the order of 100 K. Both the vitiated and clean air results showed very similar levels of uncertainty, and the difference between the mean properties were generally within the range of uncertainty predicted.

Norris, A. T.↗