Search NASA⌕ Search

SEARCH · Search NASA

Results for “input uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Assessing the Sensitivity of Pourbaix Diagrams to Computational Protocols: Electrochemical Stability of Ni Oxides as a Case Study

Pourbaix diagrams stand as a useful tool in assessing and visualizing materials’ electrochemical stability and are widely used for electrocatalyst design. However, their reliability hinges on the accuracy of the chemical potentials of involved phases, which may bear uncertainties and can be significantly impacted by decision-making steps in the computational protocol. Here, this study introduces a robust sensitivity analysis framework, exemplified through a detailed examination of the computational Pourbaix diagram of Ni, the oxides of which are used as high-activity and cost-friendly catalysts for many electrochemical reactions. Quantities of interest derived from the Pourbaix diagram include the appearance and stability domain of the catalytically active Ni oxide phases along with the onset electrochemical potentials of phase transitions. These metrics can guide the design of operational conditions for Ni oxide electrocatalysts. We find that the employed DFT exchange-correlation functional has the most significant influence on the computed Pourbaix diagram. Uncertainties on crystal structures, along with their related ab initio energetics, are also found to affect the size of the phase stability domain. Higher-order coupling among input parameters is found to play a crucial role in influencing the appearance and distribution of Ni phases in the diagram. Our findings suggest a need to consider variations and uncertainties associated with the computational procedures on predicted Pourbaix diagrams for materials design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Covariant density functional theory input for r-process simulations in actinides and superheavy nuclei: The ground state and fission properties

A systematic investigation of the ground-state and fission properties of even-even actinides and superheavy nuclei with Z = 90–120 from the two-proton up to two-neutron drip lines with proper assessment of systematic theoretical uncertainties has been performed for the first time in the framework of covariant density functional theory (CDFT). Furthermore, these results provide a necessary theoretical input for the r-process modeling in heavy nuclei and, in particular, for the study of fission cycling. Four state-of-the-art globally tested covariant energy density functionals (CEDFs), namely, DD-PC1, DD-ME2, NL3*, and PC-PK1, representing the major classes of the CDFT models are employed in the present paper. Ground-state deformations, binding energies, two-neutron separation energies, α-decay Q α values and half-lives, and the heights of fission barriers have been calculated for all these nuclei. Theoretical uncertainties in these physical observables and their evolution as a function of proton and neutron numbers have been quantified and their major sources have been identified. Spherical shell closures at Z = 120, N = 184, and N = 258 and the structure of the single-particle (especially, high-j) states in their vicinities as well as nuclear matter properties of employed CEDFs are two major factors contributing to theoretical uncertainties. However, different physical observables are affected in a different way by these two factors. For example, theoretical uncertainties in calculated ground-state deformations are affected mostly by the former factor, while theoretical uncertainties in fission barriers depend on both of these factors.

190 ≤ A ≤ 219↗
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2024

Benchmark Calculation for BEAVRS Cycles 1 and 2 Using the SCALE 6.3/Polaris–PARCS v3.4.2 Code Package

This study performed the benchmark calculation for BEAVRS to validate the SCALE 6.3/Polaris–PARCS v3.4.2 code package with the ENDF/B-VII.1 56-group library, comparing the simulated results with the measured data. The benchmark results will be used in evaluating uncertainties of the SCALE/Polaris–PARCS code package for pressurized water reactor physics analysis for key nuclear parameters such as reactivity, control bank worth, temperature coefficients, and pin and assembly power peaking factors. This report details plant and fuel design specifications and input data for SCALE/Polaris as well as GenPMAXS and PARCS. Additionally, detailed information is provided for all the input and output files produced for the benchmark calculations. The benchmark results are summarized herein so that they can be used in evaluating uncertainties for key nuclear parameters with other benchmark results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Assessing Uncertainties and Variability 34 Years of Surface Radiative Fluxes Using GEWEX SRB Release4-IP

The NASA/GEWEX Surface Radiation Budget (SRB) project produces 3-hrly shortwave and longwave surface and top of atmosphere radiative fluxes for the 1983-near present time period. The new Release 4 Integrated Product (IP) uses the newly recalibrated and processed ISCCP HXS product as its primary input for cloud and radiance data, replacing ISCCP DX with a ninefold increase in pixel count (10 km instead of 30 km). This first version retains a 1°x1° resolution enabling intercomparison against previous versions and other data sets such as CERES, but spans 34 years from July 1983 through June 2017 and was announced by Kummerow et al. 2019 (GEWEX News). This new IP product also uses an atmospheric temperature and moisture dataset known as nnHIRS and other parameters such as near surface and skin temperatures from SeaFlux and LandFlux data sets. In addition to the input data improvements, several important algorithm improvements have been made since Release 3. These include recalculated SW atmospheric transmissivities and reflectivities, updated ocean and snow/ice albedos, and variable total solar irradiance consistent with SORCE measurements. The LW code has been updated to improve the optical property treatment for clouds and aerosols are included in this version. Radiative treatment of ice clouds is also improved in the LW. The variable aerosol optical properties for the SW and LW are specified using a detailed aerosol history from the Max Planck Institute Aerosol Climatology (MAC). Here we present an assessment of the LW radiative fluxes and the uncertainty of those fluxes relative to the various inputs to surface SW/LW flux measurements from BSRN and PMEL buoys measurements. We review the validation of the SW and LW fluxes and then in terms of time series and then assess the products in terms of their long-term variability of the surface SW and LW net fluxes compared to multiple other data products including atmospheric reanalysis products. The comparisons of radiative estimates to observations are performed at various temporal scales and aimed at investigation of agreement at longer time averages but accessing potential change in diurnal magnitude and daily variability. Utilizing this uncertainty information, to access long-term variability of surface radiation components at selected region and global scales, considering satellite sampling/calibration “artifacts” as necessary. At the longer time scales, the net SW and net LW the TOA and surface have implications toward closure of the energy budgets at the surface, we assess these compared to other studies on energy budget closure for the same selected global and regional scales.

Paul W Stackhouse↗
NASA NTRS2006

Convective Weather Forecast Quality Metrics for Air Traffic Management Decision-Making

Since numerical weather prediction models are unable to accurately forecast the severity and the location of the storm cells several hours into the future when compared with observation data, there has been a growing interest in probabilistic description of convective weather. The classical approach for generating uncertainty bounds consists of integrating the state equations and covariance propagation equations forward in time. This step is readily recognized as the process update step of the Kalman Filter algorithm. The second well known method, known as the Monte Carlo method, consists of generating output samples by driving the forecast algorithm with input samples selected from distributions. The statistical properties of the distributions of the output samples are then used for defining the uncertainty bounds of the output variables. This method is computationally expensive for a complex model compared to the covariance propagation method. The main advantage of the Monte Carlo method is that a complex non-linear model can be easily handled. Recently, a few different methods for probabilistic forecasting have appeared in the literature. A method for computing probability of convection in a region using forecast data is described in Ref. 5. Probability at a grid location is computed as the fraction of grid points, within a box of specified dimensions around the grid location, with forecast convection precipitation exceeding a specified threshold. The main limitation of this method is that the results are dependent on the chosen dimensions of the box. The examples presented Ref. 5 show that this process is equivalent to low-pass filtering of the forecast data with a finite support spatial filter. References 6 and 7 describe the technique for computing percentage coverage within a 92 x 92 square-kilometer box and assigning the value to the center 4 x 4 square-kilometer box. This technique is same as that described in Ref. 5. Characterizing the forecast, following the process described in Refs. 5 through 7, in terms of percentage coverage or confidence level is notionally sound compared to characterizing in terms of probabilities because the probability of the forecast being correct can only be determined using actual observations. References 5 through 7 only use the forecast data and not the observations. The method for computing the probability of detection, false alarm ratio and several forecast quality metrics (Skill Scores) using both the forecast and observation data are given in Ref. 2. This paper extends the statistical verification method in Ref. 2 to determine co-occurrence probabilities. The method consists of computing the probability that a severe weather cell (grid location) is detected in the observation data in the neighborhood of the severe weather cell in the forecast data. Probabilities of occurrence at the grid location and in its neighborhood with higher severity, and with lower severity in the observation data compared to that in the forecast data are examined. The method proposed in Refs. 5 through 7 is used for computing the probability that a certain number of cells in the neighborhood of severe weather cells in the forecast data are seen as severe weather cells in the observation data. Finally, the probability of existence of gaps in the observation data in the neighborhood of severe weather cells in forecast data is computed. Gaps are defined as openings between severe weather cells through which an aircraft can safely fly to its intended destination. The rest of the paper is organized as follows. Section II summarizes the statistical verification method described in Ref. 2. The extension of this method for computing the co-occurrence probabilities in discussed in Section HI. Numerical examples using NCWF forecast data and NCWD observation data are presented in Section III to elucidate the characteristics of the co-occurrence probabilities. This section also discusses the procedure for computing throbabilities that the severity of convection in the observation data will be higher or lower in the neighborhood of grid locations compared to that indicated at the grid locations in the forecast data. The probability of coverage of neighborhood grid cells is also described via examples in this section. Section IV discusses the gap detection algorithm and presents a numerical example to illustrate the method. The locations of the detected gaps in the observation data are used along with the locations of convective weather cells in the forecast data to determine the probability of existence of gaps in the neighborhood of these cells. Finally, the paper is concluded in Section V.

Chatterji, Gano B.↗
DOE OSTI2021

ThickBrick: optimal event selection and categorization in high energy physics. Part I. Signal discovery

We provide a prescription called ThickBrick to train optimal machine-learning-based event selectors and categorizers that maximize the statistical significance of a potential signal excess in high energy physics (HEP) experiments, as quantified by any of six different performance measures. For analyses where the signal search is performed in the distribution of some event variables, our prescription ensures that only the information complementary to those event variables is used in event selection and categorization. This eliminates a major misalignment with the physics goals of the analysis (maximizing the significance of an excess) that exists in the training of typical ML-based event selectors and categorizers. In addition, this decorrelation of event selectors from the relevant event variables prevents the background distribution from becoming peaked in the signal region as a result of event selection, thereby ameliorating the challenges imposed on signal searches by systematic uncertainties. Our event selectors (categorizers) use the output of machine-learning-based classifiers as input and apply optimal selection cutoffs (categorization thresholds) that are functions of the event variables being analyzed, as opposed to flat cutoffs (thresholds). These optimal cutoffs and thresholds are learned iteratively, using a novel approach with connections to Lloyd’s k-means clustering algorithm. We provide a public, Python implementation of our prescription, also called ThickBrick, along with usage examples.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

A rigorous physics-based enhanced parameter estimation (EPE) methodology for calibration of building energy simulations

Buildings rarely perform as designed/simulated and there are numerous tangible benefits if this gap is reconciled. A new scientifically rigorous yet pragmatic methodology for calibrating building energy simulations - called Enhanced Parameter Estimation (EPE) - is proposed that allows physically relevant parameter estimation rather than a blind force-fit to energy use data. Starting with a rapidly created simulation model, calibration is performed in two stages: (a) building shell calibration with the HVAC system replaced by an ideal system that meets the loads (b) HVAC system calibration with the building shell and all internal loads replaced by a box with only process loads. In the first stage, EPE identifies a small number of high-level heat flows in the energy balance, calculates them with specifically tailored individual driving functions, introduces physically significant parameters to best accomplish energy balance, and, estimates the parameters and their uncertainty bounds. Calibration is thus done with corrective heat flows without any arbitrary tuning of input parameters. Calibration accuracy is enhanced by machine learning of the residual errors. The EPE methodology is demonstrated by means of: a synthetic building and an actual 75,000 sq. ft. building in Pennsylvania. Future work needed for widespread application is discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Material Models and Credibility for System Level Abnormal Mechanical ModSim Applications

The purpose of this document is to provide evidence for assessing the adequacy of parameterized material models for a collection of materials used in a finite element analyses setting. “Adequacy” is relative to the intended use of the material in particular analyses. The intended application of the material models covered within this document is for system level abnormal mechanical solid mechanics analyses. Generally, material model parameterizations should be valid from temperatures of approximately -50 to 70° C, across a range of strain rates, and (depending on details of the parts involved) large deformations. Each material covered in this document is presented in its own chapter with a common format across materials. Model assumptions, limitations, existing validation results, readiness for use with uncertainty quantification, general usage guidance, and failure considerations are all provided along with specific parameterization inputs suitable for the finite element analysis code Sierra/Solid Mechanics.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Behavioral Robotics Approach to Radiation Mapping Using Adaptive Sampling

Radiation mapping is a desirable task to automate because of the inherent risks involved and its tedious nature. A novel system was designed to address this by combining various existing technologies, utilizing behavior-based robotics and Bayesian optimization. The system uses a quadruped robot equipped with a manipulator and gamma detector to take measurements at locations that are selected based on the uncertainty of a surrogate model used to estimate the true radiation field. The robot uses input from the world with depth cameras to avoid collisions with the robot’s body, and unreachable points for the end effector are addressed by both allowing for a soft collision with the environment to occur, prompting the system to abandon that point, and varying the exploration tendency of the optimization based on consecutive collisions. This approach provides unique traversability and adaptability over other strategies in the literature. Experiments were performed by placing a Cesium-137 source on the ground and varying geometric setups and an optimization parameter demonstrating the adaptability to diverse environments and the increased robustness resulting from the designed behavior. The results additionally demonstrate that dynamically adjusting the optimization algorithm’s exploration tendency based on the arm’s collision history improves the system’s ability to navigate cluttered environments and construct accurate radiation maps without getting stuck in unreachable areas.

Adams, Joel↗
DOE OSTI2020

Lidar measurements of yawed-wind-turbine wakes: characterization and validation of analytical models

Abstract. Wake measurements of a scanning Doppler lidar mounted on the nacelle of a full-scale wind turbine during a wake-steering experiment were used for the characterization of the wake flow, the evaluation of the wake-steering set-up, and the validation of analytical wake models. Inflow-scanning Doppler lidars, a meteorological mast, and the supervisory control and data acquisition (SCADA) system of the wind turbine complemented the set-up. Results from the wake-scanning Doppler lidar showed an increase in the wake deflection with the yaw angle and that the wake deflection was not in all cases beneficial for the power output of a downstream turbine due to a bias of the inflow wind direction perceived by the yawed wind turbine and the wake-steering design implemented. Both observations could be reproduced with an analytical model that was initialized with the inflow measurements. Error propagation from the inflow measurements that were used as model input and the power coefficient of a waked wind turbine contributed significantly to the model uncertainty. Lastly, the span-wise cross section of the wake was strongly affected by wind veer, masking the effects of the yawed wind turbine on the wake cross sections.

17 WIND ENERGY↗
NASA NTRS2004

Evaluation and Analysis of F-16XL Wind Tunnel Data From Static and Dynamic Tests

A series of wind tunnel tests were conducted in the NASA Langley Research Center as part of an ongoing effort to develop and test mathematical models for aircraft rigid-body aerodynamics in nonlinear unsteady flight regimes. Analysis of measurement accuracy, especially for nonlinear dynamic systems that may exhibit complicated behaviors, is an essential component of this ongoing effort. In this report, tools for harmonic analysis of dynamic data and assessing measurement accuracy are presented. A linear aerodynamic model is assumed that is appropriate for conventional forced-oscillation experiments, although more general models can be used with these tools. Application of the tools to experimental data is demonstrated and results indicate the levels of uncertainty in output measurements that can arise from experimental setup, calibration procedures, mechanical limitations, and input errors.

Kim, Sungwan↗
NASA NTRS2003

Evaluation and Analysis of F-16XL Wind Tunnel Data from Dynamic Tests

A series of wind tunnel tests were conducted in the NASA Langley Research Center as part of an ongoing effort to develop and test mathematical models for aircraft rigid-body aerodynamics in nonlinear unsteady flight regimes. Analysis of measurement accuracy, especially for nonlinear dynamic systems that may exhibit complicated behaviors, is an essential component of this ongoing effort. In this paper, tools for harmonic analysis of dynamic data and assessing measurement accuracy are presented. A linear aerodynamic model is assumed that is appropriate for conventional forced-oscillation experiments, although more general models can be used with these tools. Application of the tools to experimental data is demonstrated and results indicate the levels of uncertainty in output measurements that can arise from experimental setup, calibration procedures, mechanical limitations, and input errors.

Kim, Sungwan↗
NASA NTRS2004

Validation of GOES-9 Satellite-Derived Cloud Properties over the Tropical Western Pacific Region

Real-time processing of hourly GOES-9 images in the ARM TWP region began operationally in October 2003 and is continuing. The ARM sites provide an excellent source for validating this new satellitederived cloud and radiation property dataset. Derived cloud amounts, heights, and broadband shortwave fluxes are compared with similar quantities derived from ground-based instrumentation. The results will provide guidance for estimating uncertainties in the GOES-9 products and to develop improvements in the retrieval methodologies and input.

Khaiyer, Mandana M.↗
NASA NTRS2020

Evaluating China's fossil-fuel CO2 emissions from a comprehensive dataset of nine inventories

China's fossil-fuel CO2 (FFCO2) emissions accounted for approximately 28 % of the global total FFCO2 in 2016. An accurate estimate of China's FFCO2 emissions is a prerequisite for global and regional carbon budget analyses and the monitoring of carbon emission reduction efforts. However, significant uncertainties and discrepancies exist in estimations of China's FFCO2 emissions due to a lack of detailed traceable emission factors (EFs) and multiple statistical data sources. Here, we evaluated China's FFCO2 emissions from nine published global and regional emission datasets. These datasets show that the total emissions increased from 3.4 (3.0–3.7) in 2000 to 9.8 (9.2–10.4) Gt CO2 per yr in 2016. The variations in these estimates were largely due to the different EF (0.491–0.746 t C per t of coal) and activity data. The large-scale patterns of gridded emissions showed a reasonable agreement, with high emissions being concentrated in major city clusters, and the standard deviation mostly ranged from 10 % to 40 % at the provincial level. However, patterns beyond the provincial scale varied significantly, with the top 5 % of the grid level accounting for 50 %–90 % of total emissions in these datasets. Our findings highlight the significance of using locally measured EF for Chinese coal. To reduce uncertainty, we recommend using physical CO2 measurements and use these values for dataset validation, key input data sharing (e.g., point sources), and finer-resolution validations at various levels.

Pengfei Han↗
NASA NTRS2017

Assessing Uncertainties in Gridded Emissions: A Case Study for Fossil Fuel Carbon Dioxide (FFCO2) Emission Data

Fossil fuel carbon dioxide (CO2) emissions (FFCO2) are the largest input to the global carbon cycle on a decadal time scale. Because total emissions are assumed to be reasonably well constrained by fuel statistics, FFCO2 often serves as a reference in order to deduce carbon uptake by poorly understood terrestrial and ocean sinks. Conventional atmospheric CO2 flux inversions solve for spatially explicit regional sources and sinks and estimate land and ocean fluxes by subtracting FFCO2. Thus, errors in FFCO2 can propagate into the final inferred flux estimates. Gridded emissions are often based on disaggregation of emissions estimated at national or regional level. Although national and regional total FFCO2 are well known, gridded emission fields are subject to additional uncertainties due to the emission disaggregation. Assessing such uncertainties is often challenging because of the lack of physical measurements for evaluation. We first review difficulties in assessing uncertainties associated with gridded FFCO2 emission data and present several approaches for evaluation of such uncertainties at multiple scales. Given known limitations, inter-emission data differences are often used as a proxy for the uncertainty. The popular approach allows us to characterize differences in emissions, but does not allow us to fully quantify emission disaggregation biases. Our work aims to vicariously evaluate FFCO2 emission data using atmospheric models and measurements. We show a global simulation experiment where uncertainty estimates are propagated as an atmospheric tracer (uncertainty tracer) alongside CO2 in NASA's GEOS model and discuss implications of FFCO2 uncertainties in the context of flux inversions. We also demonstrate the use of high resolution urban CO2 simulations as a tool for objectively evaluating FFCO2 data over intense emission regions. Though this study focuses on FFCO2 emission data, the outcome of this study could also help improve the knowledge of similar gridded emissions data for non-CO2 compounds with similar emission characteristics.

FFCO↗
NASA NTRSDate not supplied

Model Calibration for Cancer Risk Projections According to Uncertain Data

This paper presents forward and inverse formulations for the calibration of computational models according to uncertain data. Uncertainty in the data might be caused by a poor metrology system, measurement noise, missing or uncontrollable input variables, or by the inability to directly measure the inputs and/or outputs of interest. The forward approach performs the calibration in the space of the model’s output thereby requiring repeated model simulations. Conversely, the inverse approach leverages an ensemble of solutions to an inverse problem in order to perform the calibration in the space of the model’s parameters. As such, the computational demands of the inverse approach are considerably lower. These strategies are applied to the calibration of a radiation model that in-forms cancer risk projections for future deep space missions.

uncertainty quantification↗