Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

CFD Validation Study of a Hypersonic Cone-Slice-Flap Configuration

Model validation is the process of determining the degree of accuracy between the real world and the model. The result of model validation can either be used to improve the model through calibration or quantify the model-form uncertainty. This work focuses on providing the model-form uncertainty through an area metric for a hypersonic cone-slice-flap geometry configuration given uncertainty in both the simulation and experimental data. A procedure will be presented that can give an accurate representation of the model-form uncertainty using a small number of high-fidelity runs. The work will also assess the impact between using different high-fidelity solvers and different turbulence models.The goal of performing this comparison is to provide a quantifiable measurement for the accuracy of each solver and turbulence model for this type of design. A low-fidelity analysis will also be performed to get a model-form uncertainty for the lower fidelity analysis. The two high-fidelty CFD solvers used are VULCAN-CFD and FUN3D and the low-fidelity results will come from Cart3D. The experimental data came from the 20-inch Mach 6Tunnel located at NASA Langley Research Center.

Laura M. White↗

On-Line Mu Method for Robust Flutter Prediction in Expanding a Safe Flight Envelope for an Aircraft Model Under Flight Test

A structured singular value (mu) analysis method of computing flutter margins has robust stability of a linear aeroelastic model with uncertainty operators (Delta). Flight data is used to update the uncertainty operators to accurately account for errors in the computed model and the observed range of aircraft dynamics of the aircraft under test caused by time-varying aircraft parameters, nonlinearities, and flight anomalies, such as test nonrepeatability. This mu-based approach computes predict flutter margins that are worst case with respect to the modeling uncertainty for use in determining when the aircraft is approaching a flutter condition and defining an expanded safe flight envelope for the aircraft that is accepted with more confidence than traditional methods that do not update the analysis algorithm with flight data by introducing mu as a flutter margin parameter that presents several advantages over tracking damping trends as a measure of a tendency to instability from available flight data.

Lind, Richard C.↗

Tolerance and UQ4SIM: Nimble Uncertainty Documentation and Analysis Software

Ultimately, scientific numerical models need quantified output uncertainties so that modeling can evolve to better match reality. Documenting model input uncertainties and variabilities is a necessary first step toward that goal. Without known input parameter uncertainties, model sensitivities are all one can determine, and without code verification, output uncertainties are simply not reliable. The basic premise of uncertainty markup is to craft a tolerance and tagging mini-language that offers a natural, unobtrusive presentation and does not depend on parsing each type of input file format. Each file is marked up with tolerances and optionally, associated tags that serve to label the parameters and their uncertainties. The evolution of such a language, often called a Domain Specific Language or DSL, is given in [1], but in final form it parallels tolerances specified on an engineering drawing, e.g., 1 +/- 0.5, 5 +/- 10%, 2 +/- 10 where % signifies percent and o signifies order of magnitude. Tags, necessary for error propagation, can be added by placing a quotation-mark-delimited tag after the tolerance, e.g., 0.7 +/- 20% 'T_effective'. In addition, tolerances might have different underlying distributions, e.g., Uniform, Normal, or Triangular, or the tolerances may merely be intervals due to lack of knowledge (uncertainty). Finally, to address pragmatic considerations such as older models that require specific number-field formats, C-style format specifiers can be appended to the tolerance like so, 1.35 +/- 10U_3.2f. As an example of use, consider figure 1, where a chemical reaction input file is has been marked up to include tolerances and tags per table 1. Not only does the technique provide a natural method of specifying tolerances, but it also servers as in situ documentation of model uncertainties. This tolerance language comes with a utility to strip the tolerances (and tags), to provide a path to the nominal model parameter file. And, as shown in [1], having the ability to quickly mark and identify model parameter uncertainties facilitates error propagation, which in turn yield output uncertainties.

Kleb, Bil↗

Nuclide Inventory Benchmark for BWR Spent Nuclear Fuel: Challenges in Evaluation of Modeling Data Assumptions and Uncertainties

This work discusses challenges and approaches to uncertainty analyses associated with the development of a nuclide inventory benchmark for fuel irradiated in a boiling water reactor. The benchmark under consideration is being developed based on experimental data from the SFCOMPO international database. The focus herein is on how to address missing data in fuel design and operating conditions that are important for adequately simulating the time-dependent changes in fuel during irradiation in the reactor. The effects of modeling assumptions and uncertainties in modeling parameters on the calculated nuclide inventory were analyzed and quantified through computational models developed using capabilities in the SCALE code system. Particular attention was given to the impact of the power history and water coolant density on the calculated nuclide inventory, as well as to the effect of geometry modeling considerations not usually addressed in a nuclide inventory benchmark. These considerations include gap closure, channel bow, and channel corner radius, which do not usually apply to regular reactor operation but are relevant for assessing impacts of potential anomalous operating scenarios.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

River meander modeling and confronting uncertainty.

This study examines the meandering phenomenon as it occurs in media throughout terrestrial, glacial, atmospheric, and aquatic environments. Analysis of the minimum energy principle, along with theories of Coriolis forces (and random walks to explain the meandering phenomenon) found that these theories apply at different temporal and spatial scales. Coriolis forces might induce topological changes resulting in meandering planforms. The minimum energy principle might explain how these forces combine to limit the sinuosity to depth and width ratios that are common throughout various media. The study then compares the first order analytical solutions for flow field by Ikeda, et al. (1981) and Johannesson and Parker (1989b). Ikeda's et al. linear bank erosion model was implemented to predict the rate of bank erosion in which the bank erosion coefficient is treated as a stochastic variable that varies with physical properties of the bank (e.g., cohesiveness, stratigraphy, or vegetation density). The developed model was used to predict the evolution of meandering planforms. Then, the modeling results were analyzed and compared to the observed data. Since the migration of a meandering channel consists of downstream translation, lateral expansion, and downstream or upstream rotations several measures are formulated in order to determine which of the resulting planforms is closest to the experimental measured one. Results from the deterministic model highly depend on the calibrated erosion coefficient. Since field measurements are always limited, the stochastic model yielded more realistic predictions of meandering planform evolutions. Due to the random nature of bank erosion coefficient, the meandering planform evolution is a stochastic process that can only be accurately predicted by a stochastic model.

54 ENVIRONMENTAL SCIENCES↗

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗

Numerical Experimentation with Maximum Likelihood Identification in Static Distributed Systems

Many important issues in the control of large space structures are intimately related to the fundamental problem of parameter identification. One might also ask how well this identification process can be carried out in the presence of noisy data since no sensor system is perfect. With these considerations in mind the algorithms herein are designed to treat both the case of uncertainties in the modeling and uncertainties in the data. The analytical aspects of maximum likelihood identification are considered in some detail in another paper. The questions relevant to the implementation of these schemes are dealt with, particularly as they apply to models of large space structures. The emphasis is on the influence of the infinite dimensional character of the problem on finite dimensional implementations of the algorithms. Those areas of current and future analysis are highlighted which indicate the interplay between error analysis and possible truncations of the state and parameter spaces.

Scheid, R. E., Jr.↗

Reducing Uncertainty in Hydrodynamic Modeling of ATR Experiments Via Flow Testing, Validation, and Optimization

The development, characterization, and qualification testing of nuclear fuel at Idaho National Laboratory’s Advanced Test Reactor (ATR) requires extensive design and analysis activities prior to the insertion of an irradiation experiment in-pile. Significant effort is made in the design and development phase of all in-pile experiments to ensure that the maximum feasible impacts of all necessary experimental requirements are satisfied. The advancement of fuel, cladding, and in-reactor materials technology in recent years has introduced complexities associated with the design and construct of in-pile experiments necessitating deeper understanding of boundary conditions and increasingly comprehensive observations resulting from the experiment. Each unique experiment must be assessed for neutronics response, thermal/hydraulic/hydrodynamic performance, and structural integrity. This is accomplished either analytically, computationally, or experimentally, or some combination thereof, prior to insertion into the ATR. The various effects are interrelated to various degrees, such as the case with the experiment temperature affecting the thermal cross section of the fuel or the increased temperature of the experiment’s materials reducing the mechanical strength of the assemblies. Additionally, the feedback between the experiment’s response to a reactor transient could alter the neutron flux profile of the reactor during the transient. Each experiment must therefore undergo a barrage of analyses to assure the ATR operational safety review committee that the insertion and irradiation of the experiment will not detrimentally affect the safe operational envelope of the reactor. In many cases, the nuclear fuel being tested can be double-encapsulated to ensure safety margins are adequately addressed, whereas failed fuel would be encased in a protective capsule. In other cases, the experiments can be inserted in a self-contained loop that passes through the reactor core, remaining isolated from the primary coolant. In the case of research reactor fuel, however, the fuel plates must be tested in direct contact with the reactor coolant, and being fuel designed for high neutron fluxes, they are inherently power-dense plates. The combination of plate geometry, high-power density, and direct contact with primary coolant creates a scenario where the neutronic/thermomechanic/hydrodynamic characteristics of the fuel plates are tightly coupled, necessitating as complete characterization as possible to support the safety and programmatic assessments, thus enabling a successful experiment. This paper explores the efforts of the U.S. High-Performance Research Reactor program to thermomechanically/hydromechanically characterize the program’s wide variety of experiments, which range from stacks of miniplate capsules to full-sized, geometrically representative curved plates. Special attention is given to instances where the combination of experimental characterization and analytical assessment has reduced uncertainties of the safety margins, allowing experiments to be irradiated that would otherwise not have passed the rigorous qualification process for irradiation in the ATR. In some cases, the combined processes have exposed flow and heat transfer characteristics that would have been missed using historical methods, which allows for more accurate and representative postirradiation assessments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Monitoring CO 2 Storage at Cranfield, Mississippi with Time-Lapse Offset VSP – Using Integration and Modeling to Reduce Uncertainty

A time-lapse Offset Vertical Seismic Profile (OVSP) data set was acquired as part of a subsurface monitoring program for geologic sequestration of CO 2 . The storage site at Cranfield, near Natchez, Mississippi, is part of a detailed area study (DAS) site for geologic carbon sequestration operated by the U.S. Dept. of Energy’s Southeast Regional Carbon Sequestration Partnership (SECARB). The DAS site includes three boreholes, an injection well and two monitoring wells. The project team selected the DAS site to examine CO 2 sequestration multiphase fluid flow and pressure at the interwell scale in a brine reservoir. The time-lapse (TL) OVSP was part of an integrated monitoring program that included well logs, crosswell seismic, electrical resistance tomography and 4D surface seismic. The goals of the OVSP were to detect the CO 2 induced change in seismic response, give information about the spatial distribution of CO 2 near the injection well and to help tie the high-resolution borehole monitoring to the 4D surface data. The VSP data were acquired in well CFU 31-F1, which is the ~3200 m deep CO 2 injection well at the DAS site. A preinjection survey was recorded in late 2009 with injection beginning in December 2009, and a post injection survey was conducted in Nov 2010 following injection of about 250 kT of CO 2 . The sensor array for both surveys was a 50-level, 3-component, Sercel MaxiWave system with 15 m (49 ft) spacing between levels. The source for both surveys was an accelerated weight drop, with different source trucks used for the two surveys. Consistent time-lapse processing was applied to both data sets. Time-lapse processing generated difference corridor stacks to investigate CO 2 induced reflection amplitude changes from each source point. Corridor stacks were used for amplitude analysis to maximize the signal-to-noise ratio (S/N) for each shot point. Spatial variation in reflectivity (used to ‘map’ the plume) was similar in magnitude to the corridor stacks but, due to relatively lower S/N, the results were less consistent and more sensitive to processing and therefore are not presented. We examined the overall time-lapse repeatability of the OVSP data using three methods, the NRMS and Predictability (Pred) measures of Kragh and Christie (2002) and the signal-to-distortion ratio (SDR) method of Cantillo (2011). Because time-lapse noise was comparable to the observed change, multiple methods were used to analyze data reliability. The reflections from the top and base reservoir were identified on the corridor stacks by correlation with a synthetic response generated from the well logs. A consistent change in the corridor stack amplitudes from pre- to post-CO 2 injection was found for both the top and base reservoir reflections on all ten shot locations analyzed. In addition to the well-log synthetic response, a finite-difference elastic wave propagation model was built based on rock/fluid properties obtained from well logs, with CO 2 induced changes guided by time-lapse crosswell seismic tomography (Ajo-Franklin, et al., 2013) acquired at the DAS site. Time-lapse seismic tomography indicated that two reservoir zones were affected by the flood. The modeling established that interpretation of the VSP trough and peak event amplitudes as reflectivity from the top and bottom of reservoir is appropriate even with possible tuning effects. Importantly, this top/base change gives confidence in an interpretation that these changes arise from within the reservoir, not from bounding lithology. The modeled time-lapse change and the observed field data change from 10 shotpoints are in agreement for both magnitude and polarity of amplitude change for top and base of reservoir. Therefore, we conclude the stored CO 2 has been successfully detected and, furthermore, the observed seismic reflection change can be applied to Cranfield’s 4D surface seismic for spatially delineating the CO 2 /brine interface.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification in the presence of limited climate model data with discontinuities.

Uncertainty quantification in climate models is challenged by the prohibitive cost of a large number of model evaluations for sampling. Another feature that often prevents classical uncertainty analysis from being readily applicable is the bifurcative behavior in the climate data with respect to certain parameters. A typical example is the Meridional Overturning Circulation in the Atlantic Ocean. The maximum overturning stream function exhibits a discontinuity across a curve in the space of two uncertain parameters, namely climate sensitivity and CO2 forcing. In order to propagate uncertainties from model parameters to model output we use polynomial chaos (PC) expansions to represent the maximum overturning stream function in terms of the uncertain climate sensitivity and CO2 forcing parameters. Since the spectral methodology assumes a certain degree of smoothness, the presence of discontinuities suggests that separate PC expansions on each side of the discontinuity will lead to more accurate descriptions of the climate model output compared to global PC expansions. We propose a methodology that first finds a probabilistic description of the discontinuity given a number of data points. Assuming the discontinuity curve is a polynomial, the algorithm is based on Bayesian inference of its coefficients. Markov chain Monte Carlo sampling is used to obtain joint distributions for the polynomial coefficients, effectively parameterizing the distribution over all possible discontinuity curves. Next, we apply the Rosenblatt transformation to the irregular parameter domains on each side of the discontinuity. This transformation maps a space of uncertain parameters with specific probability distributions to a space of i.i.d standard random variables where orthogonal projections can be used to obtain PC coefficients. In particular, we use uniform random variables that are compatible with PC expansions based on Legendre polynomials. The Rosenblatt transformation and the corresponding PC expansions for the model output on either side of the discontinuity are applied successively for several realizations of the discontinuity curve. The climate model output and its associated uncertainty at specific design points is then computed by taking a quadrature-based integration average over PC expansions corresponding to possible realizations of the discontinuity curve.

54 ENVIRONMENTAL SCIENCES↗

Taweret: a Python package for Bayesian model mixing

Uncertainty quantification using Bayesian methods is a growing area of research. Bayesian model mixing (BMM) is a recent development which combines the predictions from multiple models such that the fidelity of each model is preserved in the final result. Practical tools and analysis suites that facilitate such methods are therefore needed. Taweret introduces BMM to existing Bayesian uncertainty quantification efforts. Currently, Taweret contains three individual Bayesian model mixing techniques, each pertaining to a different type of problem structure; we encourage the future inclusion of user-developed mixing methods. Taweret’s first use case is in nuclear physics, but the package has been structured such that it should be adaptable to any research engaged in model comparison or model mixing.

Ingles, Kevin↗

The Climate Response to Emissions Reductions Due to COVID-19: Initial Results From CovidMIP

Many nations responded to the COVID-19 pandemic by restricting travel and other activities during 2020, resulting in temporarily reduced emissions of CO 2 , other greenhouse gases and ozone and aerosol precursors. We perform a coordinated Intercomparison, CovidMIP, of Earth System model simulations to assess the impact on climate of these emissions reductions. Eleven models performed multiple initial-condition ensembles to produce over 280 simulations spanning both initial condition and model structural uncertainty. We find model consensus on reduced aerosol amounts (particularly over East Asia) and associated increases in surface shortwave radiation levels. However, any impact on near-surface temperature or rainfall during 2020-2024 is extremely small and is not detectable in this initial analysis. Regional analyses on a finer scale, and closer attention to extremes (especially linked to changes in atmospheric composition and air quality) are required to test the impact of COVID-19-related emission reductions on near-term climate.

54 ENVIRONMENTAL SCIENCES↗