Search NASA⌕ Search

SEARCH · Search NASA

Results for “input uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Risk Importance Ranking of Fire Data Parameters to Enhance Fire PRA Model Realism

Fire is historically and analytically a significant contributor to nuclear power plant risk. The level of fire risk and the methods, tools and data for modeling this risk is highly debated by experts. One area of debate is the input data used in fire modeling and how to deal with this data’s high uncertainty. This report outlines initial work performed for determining the key parameters causing this uncertainty and how it propagates into nuclear power plant models. This research paves the way for the development of methods to reduce fire data uncertainty used in modeling. The Nuclear Regulatory Commission has mandated that nuclear power plants perform fire risk modeling. However, there are several issues with the current risk modeling implementation that affect the results. Approved modeling methods can be overly conservative and often do not match plant experience. Also, the data used in the modeling can have high uncertainties and is influenced by expert judgement. To evaluate input data uncertainty, researchers performed an initial review of several fire experiments done at Sandia National Laboratories. Uncertainties for fire data can come from many sources, such as experiment design constraints, environmental conditions, or other plant-specific aspects. There are many different significant and insignificant parameters driving the uncertainty. Additionally, the uncertainty of the different input data used in the fire modeling could have a significant or insignificant effect on the entire plant risk. A four-step methodology was developed to perform Integrated Probabilistic Risk Assessment Importance Ranking. A demonstration case using these steps was set up and three of the four steps were completed in fiscal year (FY) 2019 and the fourth step done FY 2020. These steps are: 1. The qualitative analysis of potential sources was conducted with the following items identified for the demonstration. • Maximum heat release rate • Time to maximum heat release rate • Duration of max heat release rate • Time to decay • Thermal conductivity of concrete • Specific heat of concrete • Density of concrete • Cable jacket thickness 2. A quantitative characterization of dominant sources of uncertainty was performed. A list of distributions and determined values of the dominant sources is shown in Appendix A. 3. A quantitative screening of the potential sources of uncertainty using Morris Elementary Effects Analysis was completed. An experimental model using the physics-based fire modeling tool Fire Dynamics Simulator was developed and coupled with the Risk Analysis Virtual Environment. The Morris analysis identified at least two parameters that can be eliminated as significant contributors (specific heat of concrete and cable jacket thickness). 4. Global importance measure (Global IM) analysis to generate a comprehensive ranking based on their influence on the plant risk. In this research, a moment-independent Global IM is used since it can address (a) uncertainty in the input parameters of the fire model, (b) uncertainty in the risk outputs, and (c) non-linearity and interactions among input parameters in the fire model, more accurately than the correlation-based and variance-based global methods. The observations from the research showed that, depending on the initial and boundary conditions of the fire scenarios, fire-induced damage could have a very small probability and could be dominated by the tail of the uncertainty distribution; hence, the accuracy of the correlation-based and variance-based methods is questionable. The moment-independent Global IM analysis in this research provides a better understanding of how experimental uncertainty data affects industry’s plant models and where improvements in that data will have the largest benefit for improving fire modeling accuracy in causing core damage. Among the five unscreened parameters obtained from the Morris EE analysis, the Global IM analysis results for the case study indicated that max heat release rate and fire location are the most important parameters. The report also outlines benefits of using a unified computational platform that integrates the underlying simulations (e.g., a fire progression model), quantitative screening (using the Morris EE method), and the Global IM analysis. A unified platform can (i) facilitate the ranking of input parameters considering multiple key fire scenarios simultaneously, rather than considering one scenario at a time, (ii) contribute to more explicit and accurate treatment of dependencies at multiple levels of Fire PRA, (iii) facilitate the sampling-based uncertainty quantification for Fire PRA, and (iv) help generating both “industry-wide” and "plant-specific" ranking of uncertainty sources in Fire PRA. Future research should be done to include additional parameters such as detection/suppression or cable fire spread. Adding a PRA software such as SAPHIRE to the RAVEN platform would help with plant model integration and improve treatment of fire-induced dependency. The I-PRA risk importance ranking methodology offered in this report can provide valuable information for efficiently (a) enhancing the realism of Fire PRA for existing plants and (b) supporting the development of Dynamic Fire PRA for advanced reactors and new plants.

97 MATHEMATICS AND COMPUTING↗

Implementing a Nitrogen-Based Model for Autotrophic Respiration Using Satellite and Field Observations

The rate of carbon accumulation by terrestrial plant communities in a process-level, mechanistic modeling is the difference of the rate of gross photosynthesis by a canopy (A(sub g)) and autotrophic respiration (R) of the stand. Observations for different biomes often show that R to be a large and variable fraction of A(sub g), ca. 35% to 75%, although other studies suggest the ratio of R and A(sub g) to be less variable. Here, R has been calculated according to the two compartment model as being the sum of maintenance and growth components. The maintenance respiration of foliage and living fine roots for different biomes has been determined objectively from observed nitrogen content of these organs. The sapwood maintenance respiration is based on pipe theory, and checked against an independently derived equation considering sapwood biomass and its maintenance coefficient. The growth respiration has been calculated from the difference of A(sub g) and maintenance respiration. The A(sub g) is obtained as the product of biome-specific radiation use efficiency for gross photosynthesis under unstressed conditions and intercepted photosynthetically active radiation, and adjusted for stress. Calculations have been done using satellite and ground observations for 36 consecutive months (1987-1989) over large contiguous areas (ca. 10(exp 5) sq km) of boreal forests, crop land, temperate deciduous forest, temperate grassland, tropical deciduous forest, tropical evergreen forest, tropical savanna, and tundra. The ratio of annual respiration and gross photosynthesis, (R/A(sub g)), is found to be 0.5-0.6 for temperate and cold adopted biome areas, but somewhat higher for tropical biome areas (0.6-0.7). Interannual variation of the fluxes is found to be generally less than 15%. Calculated fluxes are compared with observations and several previous estimates. Results of sensitivity analysis are presented for uncertainties in parameterization and input data. It is found that uncertainty in determining maintenance respiration for tropical biomes is such that R/A(sub g) for these biomes could be similar to that for temperate biomes.

Choudhury, Bhaskar J.↗

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗

Operational Implementation of a Pc Uncertainty Construct for Conjunction Assessment Risk Analysis

Earlier this year the NASA Conjunction Assessment and Risk Analysis (CARA) project presented the theoretical and algorithmic aspects of a method to include the uncertainties in the calculation inputs when computing the probability of collision (Pc) between two space objects, principally uncertainties in the covariances and the hard-body radius. The output of this calculation approach is to produce rather than a single Pc value an entire probability density function that will represent the range of possible Pc values given the uncertainties in the inputs and bring CA risk analysis methodologies more in line with modern risk management theory. The present study provides results from the exercise of this method against an extended dataset of satellite conjunctions in order to determine the effect of its use on the evaluation of conjunction assessment (CA) event risk posture. The effects are found to be considerable: a good number of events are downgraded from or upgraded to a serious risk designation on the basis of consideration of the Pc uncertainty. The findings counsel the integration of the developed methods into NASA CA operations.

assessment↗

An Efficient Deterministic Approach to Model-based Prediction Uncertainty Estimation

Prognostics deals with the prediction of the end of life (EOL) of a system. EOL is a random variable, due to the presence of process noise and uncertainty in the future inputs to the system. Prognostics algorithm must account for this inherent uncertainty. In addition, these algorithms never know exactly the state of the system at the desired time of prediction, or the exact model describing the future evolution of the system, accumulating additional uncertainty into the predicted EOL. Prediction algorithms that do not account for these sources of uncertainty are misrepresenting the EOL and can lead to poor decisions based on their results. In this paper, we explore the impact of uncertainty in the prediction problem. We develop a general model-based prediction algorithm that incorporates these sources of uncertainty, and propose a novel approach to efficiently handle uncertainty in the future input trajectories of a system by using the unscented transformation. Using this approach, we are not only able to reduce the computational load but also estimate the bounds of uncertainty in a deterministic manner, which can be useful to consider during decision-making. Using a lithium-ion battery as a case study, we perform several simulation-based experiments to explore these issues, and validate the overall approach using experimental data from a battery testbed.

Daigle, Matthew J.↗

Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

Abstract Large‐scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub‐surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have successfully been used in several engineering applications, estimates of output quantities of interest (QoI) — such as breakthrough time of particles reaching the edge of the system — suffer from two distinct types of uncertainty. A run of a DFN simulator requires several parameters to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameters will lead to uncertainty in the QoI, called epistemic uncertainty. Furthermore, since these input settings to DFN simulators control the stochastic processes which place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e., different seeds) of the same random process (i.e., identical input parameters) leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. Beyond the specific takeaways on which input variables influence uncertainty in the QoI the most, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.

58 GEOSCIENCES↗

Minimax control of a system with process uncertainty in substate space

The control of a single input-single output plant with parameter uncertainty was approached using a minimax technique. A linear time invariant controller results which requires only partial state feedback and is optimal in the sense that it minimizes a quadratic criterion involving tracking error, control, and parameter uncertainty. Bounded input-bounded output stability is guaranteed provided the transfer function has only left half plane zeros. If uncertainties are bounded, it is always possible to stabilize the system when sufficient control amplitude is available. The number of states required to generate the control is equal to the system order less the number of zeros.

Basuthakur, S.↗

Bayesian inference of nuclear-matter density from proton scattering

Background: Proton elastic scattering at intermediate energy is widely employed as a tool for determining the matter radius of atomic nuclei. Here, the sensitivity of the approach relies on high-resolution measurements at small scattering angles and low-momentum transfer. Under these conditions, the Glauber multiple scattering theory accurately describes the proton-nucleus elastic cross section. Purpose: Investigate the sensitivity of the Glauber multiple scattering theory to uncertainties associated with input parameters such as the nuclear-matter density distribution and nucleon-nucleon data. Method: A joint Bayesian inference was performed using 12 angular distributions of elastic scattering at different energies on 58 Ni, 90 Zr, and 208 Pb targets. A Metropolis-Hastings algorithm was implemented to make an uncertainty quantification analysis for the input parameters used in the Glauber multiple scattering theory. Results: The experimental cross sections were fitted simultaneously using a joint Bayesian inference approach. Posterior probability density distributions of 42 input parameters were obtained from the analysis. A moderate correlation between the nuclear density parameters and the nucleon-nucleon cross sections was found. This correlation impacts the extraction of the nuclear-matter radius. Conclusions: The present analysis provided a consistent method for extracting the nuclear-matter density distribution of 58 Ni, 90 Zr, and 208 Pb from data across different incident energies. Due to the correlation of the nucleon-nucleon cross sections with the other input parameters, a constrained Bayesian inference using free nucleon-nucleon cross section data was performed. The nuclear-matter radii obtained from the analysis are in good agreement with multiple results reported in the literature.

190 ≤ A ≤ 219↗

Sensitivity of model calculations to uncertain inputs, with an application to neutron star envelopes

A method is given for determining the sensitivity of certain types of calculations to the uncertainties in the input physics or model parameters; this method is applicable to problems that involve solutions to coupled, ordinary differential equations. In particular the sensitivity of calculations of the thermal structure of neutron star envelopes to uncertainties in the opacity and equation of state is examined. It is found that the uncertainties in the relationship between the surface and interior temperatures of a neutron star are due almost entirely to the imprecision in the values of the conductive opacity in the region where the ions form a liquid; here the conductive opacity is, for the most part, due to the scattering of electrons from ions.

Epstein, R. I.↗

Sensitivity Analysis of Numerical Modeling Input Parameters on Wind Turbine Loads in Deterministic Transient Load Cases

Aero-hydro-elastic-servo numerical models used to design and analyze wind turbines are based on thousands of variable input parameters that dictate the inflow, aerodynamic, structural, and control characteristics of the system as well as sea state, hydrodynamic, and mooring characteristics for fixed-bottom and floating offshore wind turbines. Each of these parameters has some level of uncertainty, which can significantly impact the predicted loads. Understanding the uncertainty in the inputs is critical to understanding the uncertainty in the outputs. This work demonstrates a screening technique to identify which parameters ultimate loads are most sensitive to so that more focus can be given to quantifying the possible range of those parameters. This technique has been demonstrated previously for different turbine and load case types and is extended here for a floating offshore wind turbine in design load cases with transient events both in the inflow and operations. Each load case features a deterministic gust, including variations in wind speed, direction, and shear. Load cases are considered with an operating turbine as well as with prescribed fault, startup, and shutdown procedures. The study found that key input parameters with a large impact on loads include the length of the gust, the magnitude of direction change and speed in the gust, the initial wind speed, and the shape of the gust profile.

17 WIND ENERGY↗

Analysis and applications of a general boresight algorithm for the DSS-13 beam waveguide antenna

A general antenna beam boresight algorithm is presented. Equations for axial pointing error, peak received signal level, and antenna half-power beamwidth are given. A pointing error variance equation is derived that illustrates the dependence of the measurement estimation performance on the various algorithm inputs, including RF signal level uncertainty. Plots showing pointing error uncertainty as function of algorithm inputs are presented. Insight gained from the performance analysis is discussed in terms of its application to the areas of antenna controller and receiver interfacing, pointing error compensation, and antenna calibrations. Current and planned applications of the boresight algorithm, including its role in the upcoming Ka-band downlink experiment (KABLE), are highlighted.

Alvarez, L. S.↗

Parameter estimation with maximal updated densities

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of “true” parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter directions informed by the model output data. In other words, this method performs “selective regularization” only in the parameter directions not informed by data. Further, the solution is defined by a maximal updated density (MUD) point where the updated density defines the measure-theoretic solution to the PIP. Another significant contribution of this work is the full theory of existence and uniqueness of MUD points for linear maps with Gaussian distributions. Data-constructed Quantity of Interest (QoI) maps are also presented and analyzed for solving the PIP within this measure-theoretic framework as a means of reducing uncertainties in the MUD estimate. We conclude with a demonstration of the general applicability of the method on two problems involving either spatial or temporal data for estimating uncertain model parameters. The first problem utilizes spatial data from a stationary partial differential equation to produce a MUD estimate of an uncertain boundary condition. The second problem utilizes temporal data obtained from the state-of-the-art ADvanced CIRCulation (ADCIRC) model to obtain a MUD estimate of uncertain wind drag coefficients for a simulated extreme weather event near the Shinnecock Inlet located in the Outer Barrier of Long Island, NY, USA.

42 ENGINEERING↗

Uncertainty Analysis for a Jet Flap Airfoil

An analysis of variance (ANOVA) study was performed to quantify the potential uncertainties of lift and pitching moment coefficient calculations from a computational fluid dynamics code, relative to an experiment, for a jet flap airfoil configuration. Uncertainties due to a number of factors including grid density, angle of attack and jet flap blowing coefficient were examined. The ANOVA software produced a numerical model of the input coefficient data, as functions of the selected factors, to a user-specified order (linear, 2-factor interference, quadratic, or cubic). Residuals between the model and actual data were also produced at each of the input conditions, and uncertainty confidence intervals (in the form of Least Significant Differences or LSD) for experimental, computational, and combined experimental / computational data sets were computed. The LSD bars indicate the smallest resolvable differences in the functional values (lift or pitching moment coefficient) attributable solely to changes in independent variable, given just the input data points from selected data sets. The software also provided a collection of diagnostics which evaluate the suitability of the input data set for use within the ANOVA process, and which examine the behavior of the resultant data, possibly suggesting transformations which should be applied to the data to reduce the LSD. The results illustrate some of the key features of, and results from, the uncertainty analysis studies, including the use of both numerical (continuous) and categorical (discrete) factors, the effects of the number and range of the input data points, and the effects of the number of factors considered simultaneously.

Green, Lawrence L.↗

Very small-scale, segregating-fluidized-bed experiments: A dataset for CFD-DEM validation and uncertainty quantification

IWe report fluidization experiments were conducted on a small scale and with a rapid response (short duration) to enable corresponding simulations at low-computational cost. Rise times are reported for four or fewer polyethylene particles (intruders) in an air-fluidized bed of ~5000 group D glass beads. Experimental inputs were completely characterized—particle properties, system dimensions and operating conditions—which is necessary for validating computational fluid mechanics (CFD)-discrete element method (DEM) including a comprehensive uncertainty quantification (UQ) analysis. Input uncertainties are reported as bounds or cumulative distribution functions of measured values. The staggering number of simulations required to complete a UQ analysis (~O[10 4 ] simulations corresponding to ~5 uncertain inputs) motivates this study. These segregating-bed experiments are designed to permit analogous CFD-DEM simulations to complete in less than a day on a single (~2.5 GHz) computational processor unit (CPU). Segregation times are reported for several operating conditions, intruder sizes, and initial configurations, providing a rich dataset for numerical model testing, validation and UQ.

42 ENGINEERING↗

Nuclear Material Accounting and Control (NMAC) for a Commercial Fuel Debundling Facility in the United States

The concept of fuel debundling proposes that all non-fuel components of a fuel assembly be removed prior to beginning the recycling process. It was introduced to reduce the quantity of and cost of disposing high level radioactive waste during recycling in the United States. However, nuclear material accountancy and control programs could also benefit from fuel debundling due to a reduction in self-shielding material for individual fuel rods compared to a fuel assembly. Current NRC regulations and guidance point to an independent fuel debundling facility with a material-possession-only license as the best option for implementing this concept into a used fuel recycling scheme in the United States. This allows the facility to comply only with simple NMAC requirements under Subpart B of 10 CFR Part 74 without the need to submit an NMAC plan to the NRC, exempting it from more tedious and complex NMAC requirements. However, a recycling facility may desire a Pu mass estimate from measurements of each individual fuel rod to improve accountancy into the dissolver. Many technologies and methodologies were considered for performing NMAC in an independent fuel debundling facility in the United States. Few were able to meet anticipated throughput demands of up to 3,300 rods/day and achieve measurement uncertainties suitable for input accountancy for a recycling facility. The best option was a combination of passive gamma-ray spectroscopy and neutron coincidence counting to meet all requirements for the proposed Fuel Debundling Detector (FUDD). Follow-on work will include a full uncertainty analysis to inform what assumptions can be made to meet input accountancy objectives before beginning experimental activities.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Analysis of multipacting threshold sensitivity to the random distributions of the secondary electron yield parameters

The way multipacting develops, depends strongly on the secondary emission property of the surface material. The knowledge of secondary electron yield is crucial for accurate prediction of the multipacting threshold. Variations in secondary electron yield parameters from experimental measurements create uncertainty, stemming from handling and surface preparation, and these uncertainties significantly affect multipacting threshold predictions. Despite their significance, the previous studies on the multipacting phenomenon did not adequately address the effect of an assumed random distribution of the secondary emission parameters on the multipacting threshold. Therefore, this paper aims to provide a comprehensive statistical study on how the different random distributions of the secondary emission parameters and, as a result, the uncertainty in the secondary electron yield affect multipacting thresholds. We focus on three commonly used distributions, namely uniform, normal, and truncated normal distributions, to define the uncertainty of random inputs. We use the chaos polynomial expansion method to determine how much each of the random parameters contributes to the multipacting threshold uncertainty. Additionally, we calculate Sobol sensitivity indices to evaluate the impact of the individual parameters or groups of parameters on the model outputs and study how different random distributions of these parameters affected the Sobol index results.

physics↗

Quantified uncertainties in fission yields from machine learning

As machine learning methods gain traction in the nuclear physics community, especially those methods that aim to propagate uncertainties to unmeasured quantities, it is important to understand how the uncertainty in the training data coming either from theory or experiment propagates to the uncertainty in the predicted values. Gaussian Processes and Bayesian Neural Networks are being more and more widely used, in particular to extrapolate beyond measured data. However, studies are typically not performed on the impact of the experimental errors on these extrapolated values. In this work, we focus on understanding how uncertainties propagate from input to prediction when using machine learning methods. We use a Mixture Density Network (MDN) to incorporate experimental error into the training of the network and construct uncertainties for the associated predicted quantities. Systematically, we study the effect of the size of the experimental error, both on the reproduced training data and extrapolated predictions for fission yields of actinides.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗