Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Melting point of iron at high pressure: An assessment of uncertainties and effect of electronic temperature

An accurate calculation of the melting point of iron at various pressures in the Earth's core is important for understanding the core structure, geodynamo, and the Earth's history. Previous studies have assessed the melt line of iron at these extreme conditions using various experimental measurement techniques as well as both ab initio and classic molecular dynamics simulations. However, experimental measurements have uncertainties up to several hundred Kelvin, and inconsistencies remain among simulation results. Here in this work, we propose an iterative framework that couples density functional theory (DFT) calculations and molecular dynamics simulations performed using an ensemble of interatomic potentials to assess the effect of electronic temperature on the melting point. We systematically validate the potentials by comparing lattice constants and phonon dispersion curves at 0 K and enthalpy differences between liquid and HCP, FCC, BCC phases of iron close to the melt line at 300 GPa with DFT. Our results show that HCP iron melts at 6144 K (at 300 GPa), BCC phase is thermodynamically unstable, and FCC is metastable at this temperature. The melting points of FCC and BCC phases at 300 GPa are 5858 and 5647 K, respectively.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Theoretical H + O 3 rate coefficients from ring polymer molecular dynamics on an accurate global potential energy surface: assessing experimental uncertainties

Thermal rate coefficients and kinetic isotope effects have been calculated for an important atmospheric reaction H/D + O 3 → OH/OD + O2 based on an accurate permutation invariant polynomial-neural network potential energy surface, using ring polymer molecular dynamics (RPMD), quasi-classical trajectory (QCT) and variational transition-state theory (VTST) with multidimensional tunneling. The RPMD approach yielded results that are generally in better agreement with experimental rate coefficients than the VTST and QCT ones, especially at low temperatures, attributable to its capacity to capture quantum effects such as tunneling and zero-point energy. Additionally, the theoretical results support one group of existing experiments over the other. In addition, rate coefficients for the D + O 3 → OD + O 2 reaction are also reported using the same methods, which will allow a stringent assessment of future experimental measurements, thus helping to reduce the uncertainty in the recommended rate coefficients of this reaction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Probabilistic Assessment and Uncertainty Analysis of CO2 Storage Capacity of the Morrow B Sandstone—Farnsworth Field Unit

This paper presents probabilistic methods to estimate the quantity of carbon dioxide (CO2) that can be stored in a mature oil reservoir and analyzes the uncertainties associated with the estimation. This work uses data from the Farnsworth Field Unit (FWU), Ochiltree County, Texas, which is currently undergoing a tertiary recovery process. The input parameters are determined from seismic, core, and fluid analyses. The results of the estimation of the CO2 storage capacity of the reservoir are presented with both expectation curve and log probability plot. The expectation curve provides a range of possible outcomes such as the P90, P50, and P10. The deterministic value is calculated as the statistical mean of the storage capacity. The coefficient of variation and the uncertainty index, P10/P90, is used to analyze the overall uncertainty of the estimations. A relative impact plot is developed to analyze the sensitivity of the input parameters towards the total uncertainty and compared with Monte Carlo. In comparison to the Monte Carlo method, the results are practically the same. The probabilistic technique presented in this paper can be applied in different geological settings as well as other engineering applications.

03 NATURAL GAS↗

Numerical simulation of asteroid geometry variance on airburst threat

For an atmospheric airburst the primary source of concern when assessing uncertainty is the size and velocity. Determining these properties provides the basis for threat assessment, as the total energy of the asteroid may then be estimated, and the threat investigated thoroughly. Even with clarity as to how much energy an asteroid may deposit, a great deal of uncertainty still exists for the actual energy deposition process. One such source of uncertainty is the geometry of the incoming asteroid. The geometry of an asteroid will alter the stress distribution during entry, which adds uncertainty to when fracture will occur. Here, in this study, we use Smoothed Particle Hydrodynamics to model the atmospheric airburst of Tunguska-scale asteroids with varying geometric profiles, including a sphere, ellipsoid, binary and superellipsoid. Each asteroid is modeled as a homogenous structure with strength. We assess uncertainty through a series of planar 2D simulation cases for each geometry, comparing the source of stochasticity across geometries. A single 3D airburst simulation for each geometry is also analyzed. Additionally, the 3D cases are compared to the highly uncertain Tunguska event, predicting variance in burst height across geometries, but all bounded by theoretical burst heights proposed for Tunguska.

Airburst↗

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗

The tensor-train stochastic finite volume method for uncertainty quantification

The stochastic finite volume method offers an efficient one-pass approach for assessing uncertainty in hyperbolic conservation laws. Still, it struggles with the curse of dimensionality when dealing with multiple stochastic variables. Here, we introduce the stochastic finite volume method within the tensor-train framework to counteract this limitation. This integration, however, comes with its own set of difficulties, mainly due to the propensity for shock formation in hyperbolic systems. To overcome these issues, we have developed a tensor-train-adapted stochastic finite volume method that employs a global WENO reconstruction, making it suitable for such complex systems. This approach represents the first step in designing tensor-train techniques for hyperbolic systems and conservation laws involving shocks.

97 MATHEMATICS AND COMPUTING↗

Controversy and consensus: common ground and best practices for life cycle assessment of emerging technologies

This manuscript explores six controversial topics regarding LCA of emerging technologies: (1) appropriate use of LCA, (2) uncertainty assessment, (3) comparison with incumbents, (4) adopting standards, (5) system scale-up, and (6) stakeholder engagement. These topics encompass key issues vigorously debated during a series of workshop-style discussions convened by the LCA of Emerging Technologies Research Network (currently hosted by ACLCA). This paper represents the main points of support and opposition for a declarative resolution representing each topic, along with points of consensus, held amongst research network of LCA practitioners and experts. These debates and associated open questions are intended to build awareness amongst practitioners and decision-makers of the common challenges associated with assessing emerging technologies, while fostering evidence-based and context-informed discussions that are both transparent and impactful for the broader community.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Uncertainties in greenhouse gas emission factors: A comprehensive analysis of switchgrass‐based biofuel production

Abstract This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass‐based biofuel production in Michigan. Using three life cycle assessment (LCA) databases—US lifecycle inventory (USLCI) database, GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI. The convergence of results across our previous study, static calculations, and Monte Carlo simulations enhances the credibility of estimated GWI values. Static calculations, validated by Monte Carlo simulations, offer reasonable central tendencies, providing a robust foundation for policy considerations. However, the wider range observed in Monte Carlo simulations underscores the importance of potential variations and uncertainties in real‐world applications. Sensitivity analyses identify biofuel yield, GHG emissions of electricity, and soil organic carbon (SOC) change as pivotal parameters influencing GWI. Decreasing uncertainties in GWI may be achieved by making greater efforts to acquire more precise data on these parameters. Our study emphasizes the significance of considering diverse GHG factors and databases in GWI assessments and stresses the need for accurate electricity fuel mixes, crucial information for refining GWI assessments and informing strategies for sustainable biofuel production.

Kim, Seungdo↗

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗

Modeling uncertainties in greenhouse gas (GHG) emission factors related to switchgrass-based biofuel production

This study investigates uncertainties in greenhouse gas (GHG) emission factors related to switchgrass-based biofuel production in Michigan. Using three life cycle assessment (LCA) databases— US lifecycle inventory database (USLCI), GREET, and Ecoinvent—each with multiple versions, we recalculated the global warming intensity (GWI) and GHG mitigation potential in a static calculation. Employing Monte Carlo simulations along with local and global sensitivity analyses, we assess uncertainties and pinpoint key parameters influencing GWI.

greenhouse ga emmission↗

Calibration of Al7075 with Plate-Puncture Predictions

The following details calibration of a material model for Al7075-T6511. This aluminum alloy is commonly used across a host of engineering applications. Owing to its widespread prevalence, there is great benefit in improving simulation predictions for this alloy. In the present effort, a calibration is performed of its elastic-plastic response accounting for both rate and temperature dependence. The calibration is informed by a series of tests that include specimens of different geometries tested at different rates and temperatures. All specimens are derived from the same barstock, 3.5 inches in diameter. The fitted model itself uses an anisotropic, Hill yield surface coupled with a Johnson-Cook hardening model. Failure predictions are had by means of a modified Wilkins failure criterion. Following calibration of the material model, a validation exercise is performed against platepuncture experiments. These experiments include multiple probe shapes, probe diameters, and plate thicknesses. The puncture experiments are replicated in simulation with mesh studies performed to assess uncertainty. Key quantities of interest, notably the absorbed energy up to failure, are compared between simulation and experiment providing a means to assess the suitability of the calibration in puncture simulations.

36 MATERIALS SCIENCE↗

Impact of LWR assembly structural features on cladding burst behavior under LOCA conditions

This provides an initial scoping study on clad balloon and burst behavior for burnup extension of reactor fuel. The associated issues with burnup extension are fuel fragmentation, relocation, and dispersal in the event of cladding failure. The general finding of this work is that the structural features, spacer grids and mixing vanes, locally suppress cladding deformation but have little impact on the overall clad performance during loss-of-coolant accidents. The work detailed in a previous report by Capps et al. focused on core optimization via neutronics, thermal hydraulics and thermomechanical analysis for burnups beyond 62 GWD/tU and enrichments above 5%. Uncertainty of fuel fragmentation relocation and dispersal in high-burnup rods during accident conditions was also investigated. The dispersal aspect of fuel fragmentation depends on cladding rupture. Thus, assessing uncertainties in the rupture behavior is helpful in estimating the dispersal of high-burnup fuel. This study builds on the previous work by assessing the impact of assembly structural features on cladding balloon and burst behavior in a full-length fuel rod. In this work, the BISON fuel performance code was used to generate 2D radial and height meshes containing structural features commonly used in nuclear fuel assemblies. First, meshes were generated with spacer grids. Results were then compared to the cladding burst temperature and balloon strain results from the previous work. A mesh sensitivity study was performed to ensure that mixing vanes and spacer grid effects were appropriately considered, resulting in a more refined mesh than the previous study. The balloon deformation and burst times of the cladding were compared to the original case. Consideration was also given to the effect of rod initial pressure. In conclusion, 3D quarter rod simulations were also performed and found good agreement with the 2D simulations in clad deformation and reasonable agreement in burst times.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Evaluation of Uncertainties of Pressure Gain Measurements in Rotating Detonation Combustor

Experimentally measuring the pressure gain of a rotating detonation combustor through the method of equivalent available pressure is prone to many experimental uncertainties. A detailed analysis of sources of random and systematic uncertainties in the thrust and pressure gain is performed using data from a hydrogen/air-operated rotating detonation combustor. The combustor had an axial air inlet and a 50% exit constriction. The measured (negative) pressure gain values agree with the results in the literature for similar inlet-to-exit area ratios. The base drag correction on the centerbody was found to be the greatest source of uncertainty for the thrust. While thrust is the predominant source of random uncertainty in the pressure gain calculation, significant systematic errors can be committed due to the assumed exit Mach number. The impact of this assumption becomes more detrimental the closer to positive the measured pressure gain is. By experimentally evaluating the exit Mach number, the random and systematic uncertainty in pressure gain both decreased, indicating that this should be an essential step. A definitive demonstration of gain is challenging, given the assessed uncertainties, and recommendations are provided to increase the precision of the equivalent available pressure methodology.

Engineering↗

Calibration and Uncertainty Estimation Using the Ensemble Kalman Filter with a Large Subsurface Flow and Transport Model - 20321

At routinely monitored groundwater contamination sites, periodically measured environmental conditions such as groundwater levels and contaminant concentrations are used to inform and confirm a conceptual site model (CSM) and guide the development and calibration of a numerical groundwater flow and transport model. The calibration of groundwater flow and transport models after each measurement (sampling) event can illuminate deficiencies in a CSM, identify areas where additional monitoring is warranted, and predict the behavior of the system to guide decision making. However, manual and automated (e.g. PEST) model calibration tools can be time-consuming and computationally expensive to implement after each sampling event. Perhaps as a result, such calibration tools generally utilize all available monitoring data simultaneously rather than sequentially assimilating monitoring data one sampling event at a time as the results from sampling become available. A more real-time data assimilation approach may reduce parameter uncertainty, quantify the value of additional monitoring data, and produce a usable model more quickly and with less effort. To mitigate the potential time-consuming aspects of manual and widely applied automated calibration techniques, a data assimilation algorithm called the ensemble Kalman filter (EnKF) was evaluated as a relatively efficient method of model calibration and uncertainty assessment via the sequential integration of monitoring data into a model. The EnKF was able to successfully and efficiently assimilate monitoring and modeling data to calibrate a complex flow and transport model at a real-world site with significant subsurface heterogeneity, uncertainty, and 12 years of monitoring data (over 4,000 individual measurements of groundwater levels and over 2,500 measurements of contaminant concentrations). Starting with an uncalibrated model data from annual sampling events were sequentially assimilated, and the resultant predication errors and estimated parameter uncertainties were tracked. After all monitoring data were assimilated, both flow and transport residuals at the end of the EnKF process were comparable to those produced via a concurrent PEST calibration effort but required fewer model simulations. Both uncertainty and prediction errors decreased over time. In a real-time application, the adequacy of the model could be assessed after each sampling event. The benefits of such a real-time approach to utilizing monitoring data include reduced costs (in the form of model updates or site characterization efforts), early flagging of possible errors in the CSM, and a reduced risk of overfitting and corresponding increased confidence in model predictions. This tool may be particularly useful compared to other calibration techniques (e.g. manual, PEST) when model runtimes are long, calibration parameters are many, or parameter uncertainty is large. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sensitivity and Uncertainty Quantification of Transition Scenario Simulations

This report documents the first collective attempt at developing and applying capabilities to quantify uncertainties, assess parametric sensitivities, and optimize multiple parameters and metrics in fuel cycle simulations generated by the SA&I Campaign. To do this, external codes that were designed to perform sensitivity analysis and uncertainty quantification (SA&UQ) needed to be coupled to the SA&I Campaign’s nuclear fuel cycle simulators (NFCS). In FY20, two approaches were pursued: 1) coupling Cyclus to an ORNL-internal code called MOT (Metaheuristic Optimization Tool) and 2) coupling DYMOND to the opensource SA&UQ tool kit Dakota. The primary objective of having these NFCS/SA&UQ coupled capabilities is to better inform DOE-NE and other stakeholders on the results generated from the NFCS. For a given set of fuel cycle strategies, policies, and technology assumptions that make up a fuel cycle scenario, these NFCS have traditionally been used by the SA&I Campaign to provide quantitative answers in terms of year-by-year mass flows, infrastructure requirements, costs, etc. With these newly developed coupled capabilities, the SA&I Campaign can now efficiently simulate hundreds or thousands of these scenarios, sample large ranges of parameters and assumptions, and use the unique features of the SA&UQ tools to process the data. This enables providing answers with known and propagated uncertainties, determining the sensitivity of important metrics to different parameters and assumptions, quantifying how much fuel cycle and technology parameters impact each other, and producing optimized fuel cycle strategies for single and multiple variables. To demonstrate these new capabilities, the Cyclus/MOT was used to model several scenarios ranging from simple fleet retirements to transitions to advanced reactors. Specifically, for a transition scenario from LWRs to SFRs and advanced LWRs, uncertainty quantification, sensitivity analysis, and optimization studies were applied to cases involving single and multiple parameter (input) and single and multiple metric (output) variations. In addition, a similar transition scenario was modeled to demonstrate how to optimize the reprocessing capacity parameter to minimize two performance metrics while taking into account uncertainties from two other parameters. Lastly, a depletion module based on SCALE/ORIGEN was added in Cyclus to simulate the third scenario that was designed to quantify the impact of the modeling assumption that all LWR used nuclear fuel have the same burnup. The newly developed DYMOND/Dakota capability was also applied to a transition scenario from the existing fleet to small modular reactors and fast reactors. This particular scenario involves not only explicit isotopic depletion via ORIGEN-2, but also includes multirecycling and utilizing the criticality search feature to determine the fresh fuel composition of recycled fuel, a feature unique to the DYMOND NFCS. A large database of simulations were run with 4 main parameters that were sampled: start date of reprocessing, reprocessing capacity, energy demand growth rate, and advanced reactor share of the fleet. The 4 main metrics were uranium consumption, enrichment requirements, waste generation, and levelized cost of electricity using data from the Cost Basis Report. The demonstrated SA&UQ results include those that inform on how to choose parameters to avoid “failed” scenarios, Sobol’ indices that inform on the importance of various parameters individually and synergistically, and Analysis of Variance (ANOVA) studies that decompose parameter ranges into groups and informs on whether variations are statistically significant.

Feng, B.↗