Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗

A new halo-independent approach to dark matter direct detection analysis

Uncertainty in the local dark matter velocity distribution is a key difficulty in the analysis of data from direct detection experiments. Here we propose a new approach for dealing with this uncertainty, which does not involve any assumptions about the structure of the dark matter halo. Given a dark matter model, our method yields the velocity distribution which best describes a set of direct detection data as a finite sum of streams with optimised speeds and densities. The method is conceptually simple and numerically very efficient. We give an explicit example in which the method is applied to determining the ratio of proton to neutron couplings of dark matter from a hypothetical set of future data.

79 ASTRONOMY AND ASTROPHYSICS↗

Summary Findings from the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in Greece in 2008 identified many promising sensitivity analysis and uncertainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not clear. The NATO Science and Technology Organization, Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic vehicle development problems. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper summarizes findings and lessons learned from the task group.

Benek, John A.↗

A Modeling Toolkit for Comparing AC and DC Electrical Distribution Efficiency in Buildings

Recently, there has been considerable research interest in the potential for DC distribution systems in buildings instead of the traditional AC distribution systems. Due to the need for performing power conversions between DC and AC electricity, DC distribution may provide electrical efficiency advantages in some systems. To support comparative evaluations of AC-only, DC-only, and hybrid AC/DC distribution systems in buildings, a new modeling toolkit called the Building Electrical Efficiency Analysis Model (BEEAM) was developed and is described in this paper. To account for harmonics in currents or voltages arising from nonlinear devices, the toolkit implements harmonic power flow, along with nonlinear device behavioral descriptions derived from empirical measurements. This paper describes the framework, network equations, device representations, and an implementation of the toolkit in an open source software package, including a component library and graphical interface for creating circuits. Simulations of electrical behavior and device and system efficiencies using the toolkit are compared with experimental measurements of a small office environment in a variety of operating and load configurations. A detailed analysis of uncertainty estimation is also provided. Key findings were that a comparison of predicted versus measured efficiencies and power losses in the validation testbed using the initial toolkit implementation predicted device- and system-level efficiencies with reasonably good accuracy under both balanced and unbalanced AC scenarios. An uncertainty analysis also revealed that the maximum estimated error for system efficiency across all scenarios was 3%, and measured and modeled system efficiency agreed within the experimental uncertainty in approximately half of the scenarios. Based on the correspondence between simulation and measurement, the toolkit is proposed by the authors as a potentially useful tool for comparing efficiency in AC, DC, and hybrid AC/DC distribution systems in buildings.

DC distribution↗

Probabilistic reliability assessment and case studies for predicted energy savings in residential buildings

This study aims to (1) investigate the key influential parameters (KIPs) in estimating the uncertainty of energy savings using a residential building energy simulation model and (2) perform uncertainty quantification for energy savings for several different scenarios. The proposed methodology was successfully applied to the calculation of uncertainties associated with residential energy retrofits using two test houses designed for pre- and post-retrofit cases. Uncertainties were determined using basic parameters that might be supplied to an energy model and then reevaluated based on an audit of the KIPs identified, resulting in substantially reduced uncertainty. Of four different scenarios, the most uncertain scenario estimated the annual energy savings from the retrofit would be between 18% and 51% at a 95% confidence level, and the least uncertain scenario estimated the annual savings would be between 26% and 40% at a 95% confidence level. The actual measured annual savings from the two test houses was 28%, which shows an agreement with the uncertainty analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamics of Fungal and Bacterial Biomass Carbon in Natural Ecosystems: Site-level Applications of the CLM-Microbe Model

Explicitly representing microbial processes has been recognized as a key improvement to Earth system models for the realistic projections of soil carbon (C) and climate dynamics. The CLM-Microbe model builds upon the CLM4.5 and explicitly represents two major soil microbial groups, fungi and bacteria. Based on the compiled time-series data of fungal (FBC) and bacterial (BBC) biomass C from nine biomes, we parameterized and validated the CLM-Microbe model, and further conducted sensitivity analysis and uncertainty analysis for simulating C cycling. The model performance was evaluated with mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R2) for relative change in FBC and BBC. The CLM-Microbe model is able to reasonably capture the seasonal dynamics of FBC and BBC across biomes, particularly for tropical/subtropical forest, temperate broadleaf forest, and grassland, with MAE < 0.49 for FBC and <0.36 for BBC and RMSE <0.52 FBC and <0.39 for BBC, while R2 values are relatively smaller in some biomes (e.g., shrub) due to small sample sizes. We found good consistencies between simulated and observed FBC (R 2 =0.70, P<0.001) and BBC (R 2 =0.26, P<0.05) on average across biomes, but the model is not able to fully capture the large variation in observed FBC and BBC. Sensitivity analysis shows the most critical parameters are turnover rate, carbon-to-nitrogen ratio of fungi and bacteria, and microbial assimilation efficiency. This study confirms that the explicit representation of soil microbial mechanisms enhances model performance in simulating C variables such as heterotrophic respiration and soil organic C density. The further application of the CLM-Microbe model would deepen our understanding of microbial contributions to the global C cycle.

54 ENVIRONMENTAL SCIENCES↗

A Statistical Approach to Safety Margin Evaluation of Irradiation Experiments in the ATR

The current safety basis of the INL Advanced Test Reactor requires that irradiation experiments meet minimum safety margins to critical heat flux and flow instability during anticipated reactor fault conditions. Compliance to these requirements may be demonstrated by calculating safety margins using safety factors that account for uncertainties, or using a statistical approach to quantify the uncertainty in the safety margins. Safety margins obtained from the first approach are conservative since the individual events leading to the cumulative safety factor are assumed to occur simultaneously at their maximum uncertainty. The statistical approach is less conservative in the case where the uncertainties are not too large, and may reduce the conservatism resulting from an overabundance of safety factors. This report describes the procedure for safety margin evaluation using a statistical approach and identifies the important thermal-hydraulic variables to consider in an uncertainty analysis. In particular, safety margins to critical heat flux and flow instability are evaluated for three recent high power fueled experiments (MP-1, FSP-1 and AFIP-6) using RELAP5 coupled to RAVEN to perform statistical analysis and uncertainty quantification. The results demonstrate adequate safety margins to critical heat flux and flow instability during an anticipated loss of commercial power to the reactor.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Capella: Structure and Abundances

The analysis of the Advanced Satellite for Cosmology and Astrophysics (ASCA) spectra of the cool star binary system Capella is reported. The results of EUVE analysis, ASCA analysis, application of EUVE model to ASCA analysis, and Uncertainty Analysis are discussed.

Brickhouse, Nancy S.↗

Analysis of uncertainties in turbine metal temperature predictions

An analysis was conducted to examine the extent to which various factors influence the accuracy of analytically predicting turbine blade metal temperatures and to determine the uncertainties in these predictions for several accuracies of the influence factors. The advanced turbofan engine gas conditions of 1700 K and 40 atmospheres were considered along with those of a highly instrumented high temperature turbine test rig and a low temperature turbine rig that simulated the engine conditions. The analysis showed that the uncertainty in analytically predicting local blade temperature was as much as 98 K, or 7.6 percent of the metal absolute temperature, with current knowledge of the influence factors. The expected reductions in uncertainties in the influence factors with additional knowledge and tests should reduce the uncertainty in predicting blade metal temperature to 28 K, or 2.1 percent of the metal absolute temperature.

Stepka, F. S.↗

Analysis of Uncertainty Impacts on Emissions and Fuel Economy Evaluation for Chassis Dynamometer Testing

This study illustrates a methodology for quantifying the uncertainties encountered in the measurement of tailpipe emissions and in the fuel consumption measurements for light-duty conventional vehicles tested on a four-wheel drive chassis dynamometer. The study leverages high-fidelity experimental data collected over three standard drive cycles, UDDS, HWY and US06, intended to simulate a wide range of operating conditions. Here, a method is developed to estimate the measurement uncertainties in fuel consumption for a test cycle, which occur due to the accumulation of measurement uncertainties propagated through the system. The uncertainty determination model uses statistical analysis and standard propagation techniques to evaluate and combine the uncertainties introduced from various sources (including the vehicle, chassis dynamometer, driver, and instrumentation). The analysis also examines three different experimental methods for determining the fuel consumption: 1) carbon mass balance, 2) volumetric fuel scale and 3) gravimetric fuel scale, and takes into consideration the properties of the instrumentation used. The results show that the most significant influence on the determination of the emissions comes from the concentration measurement, and similarly the biggest impact on the total fuel consumption uncertainty comes from the uncertainty in the determination of the carbon dioxide mass, due to the large presence of this pollutant in the overall emissions. It was found that the fuel consumption uncertainties are in the range of ±1-2% for all three methods analyzed, with the lowest values being obtained for measurements performed using the gravimetric method for all three drive cycles considered.

33 ADVANCED PROPULSION SYSTEMS↗

Sensitivity Analysis and Uncertainty Quantification for the LAMMPS Molecular Dynamics Simulation Code

We examine sensitivity analysis and uncertainty quantification for molecular dynamics simulation. Extreme (large or small) output values for the LAMMPS code often occur at the boundaries of input regions, and uncertainties in those boundary values are overlooked by common SA methods. Similarly, input values for which code outputs are consistent with calibration data can also occur near boundaries. Upon applying approaches in the literature for imprecise probabilities (IPs), much more realistic results are obtained than for the complacent application of standard SA and code calibration.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty Estimate for the Outdoor Calibration of Solar Pyranometers: A Metrologist Perspective

Pyranometers are used outdoors to measure solar irradiance. By design, this type of radiometer can measure the; total hemispheric (global) or diffuse (sky) irradiance when the detector is unshaded or shaded from the sun disk, respectively. These measurements are used in a variety of applications including solar energy conversion, atmospheric studies, agriculture, and materials science. Proper calibration of pyranometers is essential to ensure measurement quality. This paper describes a step-by-step method for calculating and reporting the uncertainty of the calibration, using the guidelines of the ISO 'Guide to the Expression of Uncertainty in Measurement' or GUM, that is applied to the pyranometer; calibration procedures used at the National Renewable Energy Laboratory (NREL). The NREL technique; characterizes a responsivity function of a pyranometer as a function of the zenith angle, as well as reporting a single; calibration responsivity value for a zenith angle of 45 ..deg... The uncertainty analysis shows that a lower uncertainty can be achieved by using the response function of a pyranometer determined as a function of zenith angle, in lieu of just using; the average value at 45..deg... By presenting the contribution of each uncertainty source to the total uncertainty; users will be able to troubleshoot and improve their calibration process. The uncertainty analysis method can also be used to determine the uncertainty of different calibration techniques and applications, such as deriving the uncertainty of field measurements.

14 SOLAR ENERGY↗

Ensemble Solar Forecasting Statistical Quantification and Sensitivity Analysis

Uncertainties associated with solar forecasts present challenges to maintain grid reliability, especially at high solar penetrations. This study aims to quantify the errors associated with the day-ahead solar forecast parameters and the theoretical solar power output for a 51-kW solar power plant in a utility area in the state of Vermont, U.S. Forecasts were generated by three numerical weather prediction (NWP) models, including the Rapid Refresh, the High Resolution Rapid Refresh, and the North American Model, and a machine-learning ensemble model. A photovoltaic (PV) performance model was adopted to calculate theoretical solar power generation using the forecast parameters (e.g., irradiance, cell temperature, and wind speed). Errors of the power outputs were quantified using statistical moments and a suite of metrics, such as the normalized root mean squared error (NRMSE). In addition, the PV model's sensitivity to different forecast parameters was quantified and analyzed. Results showed that the ensemble model yielded forecasts in all parameters with the smallest NRMSE. The NRMSE of solar irradiance forecasts of the ensemble NWP model was reduced by 28.10% compared to the best of the three NWP models. Further, the sensitivity analysis indicated that the errors of the forecasted cell temperature attributed only approximately 0.12% to the NRMSE of the power output as opposed to 7.44% from the forecasted solar irradiance.

14 SOLAR ENERGY↗

Determination of Uncertainties for the New SSME Model

This report discusses the uncertainty analysis performed in support of a new test analysis and performance prediction model for the Space Shuttle Main Engine. The new model utilizes uncertainty estimates for experimental data and for the analytical model to obtain the most plausible operating condition for the engine system. This report discusses the development of the data sets and uncertainty estimates to be used in the development of the new model. It also presents the application of uncertainty analysis to analytical models and the uncertainty analysis for the conservation of mass and energy balance relations is presented. A new methodology for the assessment of the uncertainty associated with linear regressions is presented.

Coleman, Hugh W.↗

Some Aspects of uncertainty in computational fluid dynamics results

Uncertainties are inherent in computational fluid dynamics (CFD). These uncertainties need to be systematically addressed and managed. Sources of these uncertainty analysis are discussed. Some recommendations are made for quantification of CFD uncertainties. A practical method of uncertainty analysis is based on sensitivity analysis. When CFD is used to design fluid dynamic systems, sensitivity-uncertainty analysis is essential.

Mehta, U. B.↗

Extended Forward Sensitivity Analysis for Uncertainty Quantification

This paper presents the extended forward sensitivity analysis as a method to help uncertainty qualification. By including time step and potentially spatial step as special sensitivity parameters, the forward sensitivity method is extended as one method to quantify numerical errors. Note that by integrating local truncation errors over the whole system through the forward sensitivity analysis process, the generated time step and spatial step sensitivity information reflect global numerical errors. The discretization errors can be systematically compared against uncertainties due to other physical parameters. This extension makes the forward sensitivity method a much more powerful tool to help uncertainty qualification. By knowing the relative sensitivity of time and space steps with other interested physical parameters, the simulation is allowed to run at optimized time and space steps without affecting the confidence of the physical parameter sensitivity results. The time and space steps forward sensitivity analysis method can also replace the traditional time step and grid convergence study with much less computational cost. Two well-defined benchmark problems with manufactured solutions are utilized to demonstrate the method.

99 GENERAL AND MISCELLANEOUS↗

Overview of the AVT-191 Project to Assess Sensitivity Analysis and Uncertainty Quantification Methods for Military Vehicle Design

A NATO symposium held in 2008 identified many promising sensitivity analysis and un-certainty quantification technologies, but the maturity and suitability of these methods for realistic applications was not known. The STO Task Group AVT-191 was established to evaluate the maturity and suitability of various sensitivity analysis and uncertainty quantification methods for application to realistic problems of interest to NATO. The program ran from 2011 to 2015, and the work was organized into four discipline-centric teams: external aerodynamics, internal aerodynamics, aeroelasticity, and hydrodynamics. This paper presents an overview of the AVT-191 program content.

Benek, John A.↗