Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

An overview of wind-energy-production prediction bias, losses, and uncertainties

Abstract. The financing of a wind farm directly relates to the preconstruction energy yield assessments which estimate the annual energy production for the farm. The accuracy and the precision of the preconstruction energy estimates can dictate the profitability of the wind project. Historically, the wind industry tended to overpredict the annual energy production of wind farms. Experts have been dedicated to eliminating such prediction errors in the past decade, and recently the reported average energy prediction bias is declining. Herein, we present a literature review of the energy yield assessment errors across the global wind energy industry. We identify a long-term trend of reduction in the overprediction bias, whereas the uncertainty associated with the prediction error is prominent. We also summarize the recent advancements of the wind resource assessment process that justify the bias reduction, including improvements in modeling and measurement techniques. Additionally, because the energy losses and uncertainties substantially influence the prediction error, we document and examine the estimated and observed loss and uncertainty values from the literature, according to the proposed framework in the International Electrotechnical Commission 61400-15 wind resource assessment standard. From our findings, we highlight opportunities for the industry to move forward, such as the validation and reduction of prediction uncertainty and the prevention of energy losses caused by wake effect and environmental events. Overall, this study provides a summary of how the wind energy industry has been quantifying and reducing prediction errors, energy losses, and production uncertainties. Finally, for this work to be as reproducible as possible, we include all of the data used in the analysis in appendices to the article.

17 WIND ENERGY↗

Using Median Point in Keeling Plot to Reduce the Uncertainty of the Isotopic Composition of Evapotranspiration

Abstract The isotopic composition of evapotranspirationδ ET is a crucial parameter in isotope-based evapotranspiration (ET) partitioning and moisture recycling studies. The Keeling plot method is the most prevalent method to calculateδ ET , though it contains large extrapolated uncertainties from the least squares regression. Traditional Keeling regression uses the mean point of individual measurements. Here, a modified Keeling plot framework was proposed using the median point of individual measurements. We tested theδ ET uncertainty using the mean point [σ ET (mean)] and median point [σ ET (median)]. Multiple resolutions of input and output data from six independent sites were used to test the performance of the two methods. Theσ ET (mean) would be greater thanσ ET (median) when the mean value of inverse vapor concentration () is greater than the median value of inverse vapor concentration []. When applying the filter ofr 2 > 0.8, around 70% ofσ ET (mean) was greater thanσ ET (median). This phenomenon might be due to the normality of the vapor concentrationC υ producing the asymmetric distribution of 1/C υ . The median method could perform significantly better than the mean method when inputting high-resolution measurements (e.g., 1 Hz) and when the water vapor concentrationC υ is relatively low. Compared to the mean method, applying the median method could on average reduce 6.88% of ET partitioning uncertainties and could on average reduce 9.00% of moisture recycling uncertainties. This study provided a new insight of the Keeling plot method and emphasized handling model output uncertainty from multiple perspectives instead of only from input parameters.

Meteorology & Atmospheric Sciences↗

Global Sensitivity Analysis and Estimation of Model Error, Toward Uncertainty Quantification in Scramjet Computations

The development of scramjet engines is an important research area for advancing hypersonic and orbital flights. Progress toward optimal engine designs requires accurate flow simulations together with uncertainty quantification. However, performing uncertainty quantification for scramjet simulations is challenging due to the large number of uncertain parameters involved and the high computational cost of flow simulations. These difficulties are addressed in this paper by developing practical uncertainty quantification algorithms and computational methods, and deploying them in the current study to large-eddy simulations of a jet in crossflow inside a simplified HIFiRE Direct Connect Rig scramjet combustor. First, global sensitivity analysis is conducted to identify influential uncertain input parameters, which can help reduce the system’s stochastic dimension. Second, because models of different fidelity are used in the overall uncertainty quantification assessment, a framework for quantifying and propagating the uncertainty due to model error is presented. In conclusion, these methods are demonstrated on a nonreacting jet-in-crossflow test problem in a simplified scramjet geometry, with parameter space up to 24 dimensions, using static and dynamic treatments of the turbulence subgrid model, and with two-dimensional and three-dimensional geometries.

33 ADVANCED PROPULSION SYSTEMS↗

Non-scalar uncertainty: Uncertainty in dynamic systems

The following point is stated throughout the paper: dynamic systems are usually subject to uncertainty, be it the unavoidable quantic uncertainty when working with sufficiently small scales or when working in large scales uncertainty can be allowed by the researcher in order to simplify the problem, or it can be introduced by nonlinear interactions. Even though non-quantic uncertainty can generally be dealt with by using the ordinary probability formalisms, it can also be studied with the proposed non-scalar formalism. Thus, non-scalar uncertainty is a more general theoretical framework giving insight into the nature of uncertainty and providing a practical tool in those cases in which scalar uncertainty is not enough, such as when studying highly nonlinear dynamic systems. This paper's specific contribution is the general concept of non-scalar uncertainty and a first proposal for a methodology. Applications should be based upon this methodology. The advantage of this approach is to provide simpler mathematical models for prediction of the system states. Present conventional tools for dealing with uncertainty prove insufficient for an effective description of some dynamic systems. The main limitations are overcome abandoning ordinary scalar algebra in the real interval (0, 1) in favor of a tensor field with a much richer structure and generality. This approach gives insight into the interpretation of Quantum Mechanics and will have its most profound consequences in the fields of elementary particle physics and nonlinear dynamic systems. Concepts like 'interfering alternatives' and 'discrete states' have an elegant explanation in this framework in terms of properties of dynamic systems such as strange attractors and chaos. The tensor formalism proves especially useful to describe the mechanics of representing dynamic systems with models that are closer to reality and have relatively much simpler solutions. It was found to be wise to get an approximate solution to an accurate model than to get a precise solution to a model constrained by simplifying assumptions. Precision has a very heavy cost in present physical models, but this formalism allows the trade between uncertainty and simplicity. It was found that modeling reality sometimes requires that state transition probabilities should be manipulated as nonscalar quantities, finding at the end that there is always a transformation to get back to scalar probability.

Martinez, Salvador Gutierrez↗

A NASA GISTEMP Observational Uncertainty Ensemble: Regional and Monthly Uncertainty

The historical global temperature record is an essential data product for quantifying the variability and change of the Earth system. In recent years, better characterization of observational uncertainty in global and hemispheric trends has become available, but the methodologies are not necessarily applicable to analyses at smaller regional areas, or monthly means, where station sparsity and other systematic issues contribute to greater uncertainty. This work details a gridded uncertainty ensemble of historical temperature anomalies from the Goddard Institute for Space Studies (GISS) Surface Temperature product (GISTEMP) product. This ensemble characterizes the complex spatial and temporal correlation structure of uncertainty in gridded historical temperature, enabling proper uncertainty propagation for climate and social science at regional and monthly scales. This work details the methodology for generating the uncertainty ensemble, key statistics of the uncertainty evolution over space and time, and provides best practices for using the uncertainty ensemble in future studies. Summary statistics from the uncertainty ensemble are in good agreement with production GISTEMP. Two applications of the uncertainty ensemble are also presented. First, the warmest year on record is shown to most likely be 2016 with a 53.2% chance and 2020 as the second most likely with a 44.4% chance. Second, it is shown that the arctic is warming 2.5 - 5 times faster than the globe, significantly faster than the regularly quoted twice as fast.

GISTEMP↗

Characteristics of locational uncertainty marginal price for correlated uncertainties of variable renewable generation and demands

With the rapid increase of variable renewable energy sources in power systems, how to manage and price the uncertainty of renewable resources’ power outputs is becoming an urgent issue. Current market designs considering the uncertainties are mainly based on the probabilistic scenario set of demand and renewable energy resources power outputs. This consideration makes market designs vulnerable to three significant challenges when put into practice. First, the accurate probability distribution of renewable generation is hard to obtain in real-time. Second, it is challenging to clear the market timely with many scenarios to guarantee accuracy. Third, generation cost recovery cannot be guaranteed for some scenarios. To overcome these challenges, this paper proposes a locational uncertainty marginal price model to price the uncertainty explicitly based on a scenario-free stochastic market-clearing model. Instead of using the probabilistic scenario set, the uncertainty of renewable energy sources and loads is modeled with distributionally-robust chance constraints. The correlation of uncertainties can be endogenously modeled in both the market-clearing and the locational uncertainty marginal price formation. Furthermore, this paper proves that generation cost recovery, revenue adequacy, and partial market equilibrium can be achieved using the locational uncertainty marginal price model. Numerical results from both the small and large systems simulations validate that the generation cost recovery is maintained no matter the generation participates in uncertainty mitigation or not. The transmission congestion surplus is also allocated appropriately among loads, renewable energy sources, and financial transmission right owners.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Quantifying Analysis of Uncertainty in Medical Reporting: Creation of User and Context-Specific Uncertainty Profiles

While uncertainty is ubiquitous in medical practice, minimal work to date has been performed to analyze the cause and effect relationship between uncertainty and patient outcomes. In medical imaging practice, uncertainty in the radiology report has been well documented to be a source of clinician dissatisfaction. Before one can effectively create intervention strategies aimed at reducing uncertainty, it must first be better understood through context- and user-specific analysis. One strategy for accomplishing this task is to characterize the source of uncertainty and create user-specific uncertainty profiles which take into account a number of provider-specific variables which may contribute to report uncertainty. The resulting data can in turn be used to create real-time report uncertainty metrics aimed at providing uncertainty analytics at the point of care, for the combined purposes of decision support, improved communication, and enhanced clinical/economic outcomes.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Quantifying the unknown impact of segmentation uncertainty on image-based simulations

Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.

42 ENGINEERING↗

CONUS-wide Projected Flood Frequency and Uncertainty Estimates, Version 1.0

This dataset presents a large-ensemble of CONUS-wide projected flood frequency and uncertainty estimates across ~2.7 million NHDPlusV2 river reaches over the CONUS. The framework producing this dataset leverages a multi-model, uncertainty-aware modeling framework that allows evaluating shifts in flood frequences at the stream reach level across the CONUS. CONUS-wide ensemble streamflow projections generated from hydrologic simulations driven by downscaled and bias-corrected Coupled Model Intercomparison Project Phase 6 (CMIP6) outputs are used to derive these flood frequency and uncertainty estimates over the period 1980 - 2099. A spatially consistent regional L-moment algorithm is applied across clusters defined by the US Hydrologic Unit Code Subregions (HUC4s and HUC8s) and NHDPlusV2 stream orders to estimate flood frequencies. The dataset also includes at-site based flood estimates that allow for the comparison between local and regional approach-based estimates, assess projected changes, and characterize their uncertainties. For more reliable estimation of rare flood frequencies such as 500 and 1000-year return periods, super-ensemble based estimates are also included in the dataset. This dataset is derived to support the "Impact-Informed Dam Safety Risk Assessment for Securing Hydropower Assests" project for the US Department of Energy (DOE) Hydropower and Hydrokinetic Office (H2O). For further details, refer to Kao et al. (2022), Ghimire et al. (2023), Ghimire et al. (2025), and Hosking and Wallis (1997).

Ghimire, Ganesh [ORNL] (ORCID:0000000242843941)↗

A new process sensitivity index to identify important system processes under process model and parametric uncertainty

Hydrological models are always composed of multiple components that represent processes key to intended model applications. When a process can be simulated by multiple conceptual-mathematical models (process models), model uncertainty in representing the process arises. While global sensitivity analysis methods have been widely used for identifying important processes in hydrologic modeling, the existing methods consider only parametric uncertainty but ignore the model uncertainty for process representation. To address this problem, this study develops a new method to probe multimodel process sensitivity by integrating the model averaging methods into the framework of variance-based global sensitivity analysis, given that the model averaging methods quantify both parametric and model uncertainty. A new process sensitivity index is derived as a metric of relative process importance, and the index includes variance in model outputs caused by uncertainty in both process models and model parameters. For demonstration, the new index is used to evaluate the processes of recharge and geology in a synthetic study of groundwater reactive transport modeling. The recharge process is simulated by two models that converting precipitation to recharge, and the geology process is also simulated by two models of different parameterizations of hydraulic conductivity; each process model has its own random parameters. The new process sensitivity index is mathematically general, and can be applied to a wide range of problems in hydrology and beyond.

Dai, Heng↗

Optimization under Uncertainty of Site-Specific Turbine Configurations: Preprint

Uncertainty affects many aspects of wind energy plant performance and cost. In this study, we explore opportunities for site-specific turbine configuration optimization that accounts for uncertainty in the wind resource. As a demonstration, a simple empirical model for wind plant cost of energy is used in an optimization under uncertainty to examine how different risk appetites affect the optimal selection of a turbine configuration for sites of different wind resource profiles. If there is unusually high uncertainty in the site wind resource, the optimal turbine configuration diverges from the deterministic case and a generally more conservative design is obtained with increasing risk aversion on the part of the designer.

17 WIND ENERGY↗

Towards Integrating Data Quality Assessments and Radiometer Uncertainty for Determining the Expanded Uncertainty of Three-Component Solar Radiation Measurements

Accurate solar irradiance data are fundamental for determining the design and performance characteristics of photovoltaic systems. The uncertainty of solar irradiance measurements depends on many factors including radiometer design, calibration, installation, maintenance, and operational environment. The key contributors to this uncertainty can be classified as the measurement uncertainty of a particular radiometer and the operational uncertainty determined for the time of measurement. Radiometer measurement uncertainty estimates (U R ) can be based on well-established methods used as part of the radiometer calibration process. Estimates of operational uncertainties (U o ) require consideration of additional site-specific factors that affect data quality. A method is needed for establishing the accuracy of solar irradiance data by integrating an existing data quality process and measurement uncertainty estimates for specific radiometers. An algorithm has been developed to integrate data quality analyses and measurement uncertainty estimates for three-component solar irradiance data: global horizontal (total hemispheric) irradiance, direct normal (beam) irradiance, and diffuse horizontal (sky) irradiance collected at one- to 60-minute intervals. The algorithm has been tested using one-minute irradiance measurements. The goal of the project is to distribute a user-friendly software package based on the new algorithm.

data integrity↗

Uncertainty Quantification in Wind Plant Energy Estimation: Preprint

Data characterizing a wind power plant's production is important for the validation, calibration, and refinement of the wake loss models used to simulate performance for pre-construction energy estimates. In this process, there is the potential for significant variation in the methods used by an analyst for, first, the preparation of the operational production data for comparison to model data and, second, the generation of analogous production data from simulations. In this work, the uncertainty introduced by these method variations is quantified by considering ensembles of analysis methods. Specifically, 1920 methods variations were developed for preparing the operational data as a predictable production benchmark and simulations taking as input sample sets of the observed wind resource ranged in size from covering 4% to 125% of a full year were run using 3 engineering wake loss models in FLORIS simulations. The benchmark and simulation input uncertainties place lower bounds on the precision of the calibration between the simulation model estimates and operational benchmark data. Even within subsets of method variations (representative of what might be seen within a single company), the uncertainty in the predictable expected production is estimated to be between 1% and 3% the median predictable expected production while the uncertainty in the simulated expected production remains at best on the order of 2%. To put this into context: the simulated expected production is very closely related to the annual energy production (AEP) metric commonly used to quantify a plant's predicted performance and a 3% error in the pre-construction AEP estimate can result in a $17M loss due to additional financing costs for a typical 100MW Texas plant.

17 WIND ENERGY↗

Evaluating the Uncertainty of Terrestrial Water Budget Components Over High Mountain Asia

This study explores the uncertainties in terrestrial water budget estimation over High Mountain Asia (HMA) using a suite of uncoupled land surface model (LSM) simulations. The uncertainty in the water balance components of precipitation (P), evapotranspiration (ET), runoff (R), and terrestrial water storage (TWS) is significantly impacted by the uncertainty in the driving meteorology, with precipitation being the most important boundary condition. Ten gridded precipitation datasets along with a mix of model-, satellite-, and gauge-based products, are evaluated first to assess their suitability for LSM simulations over HMA. The datasets are evaluated by quantifying the systematic and random errors of these products as well as the temporal consistency of their trends. Though the broader spatial patterns of precipitation are generally well captured by the datasets, they differ significantly in their means and trends. In general, precipitation datasets that incorporate information from gauges are found to have higher accuracy with low Root Mean Square Errors and high correlation coefficient values. An ensemble of LSM simulations with selected subset of precipitation products is then used to produce the mean annual fluxes and their uncertainty over HMA in P, ET, and R to be 2.11 ± 0.45, 1.26 ± 0.11, and 0.85 ± 0.36 mm per day, respectively. The mean annual estimates of the surface mass (water) balance components from this model ensemble are comparable to global estimates from prior studies. However, the uncertainty/spread of P, ET, and R is significantly larger than the corresponding estimates from global studies. A comparison of ET, snow cover fraction, and changes in TWS estimates against remote sensing-based references confirms the significant role of the input meteorology in influencing the water budget characterization over HMA and points to the need for improving meteorological inputs.

Yoon, Yeosang↗

Validating Nuclear Data Uncertainties Obtained from a Statistical Analysis of Experimental Data with the “Physical Uncertainty Bounds” Method

Concerns within the nuclear data community led to substantial increases of Neutron Data Standards (NDS) uncertainties from its previous to the current version. For example, those associated with the NDS reference cross section 239 Pu(n,f) increased from 0.6–1.6% to 1.3–1.7% from 0.1–20 MeV. These cross sections, among others, were adopted, e.g., by ENDF/B-VII.1 (previous NDS) and ENDF/B-VIII.0 (current NDS). There has been a strong desire to be able to validate these increases based on objective criteria given their impact on our understanding of various application uncertainties. Here, the “Physical Uncertainty Bounds” method (PUBs) by Vaughan et al. is applied to validate evaluated uncertainties obtained by a statistical analysis of experimental data. We investigate with PUBs whether ENDF/B-VII.1 or ENDF/B-VIII.0 239 Pu(n,f) cross-section uncertainties are more realistic given the information content used for the actual evaluation. It is shown that the associated conservative (1.5–1.8%) and minimal realistic (1.1–1.3%) uncertainty bounds obtained by PUBs enclose ENDF/B-VIII.0 uncertainties and indicate that ENDF/B-VII.1 uncertainties are underestimated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Framework for Quantifying Measurement Uncertainties and Uncertainty Propagation in HCCI/LTGC Engine Experiments

In this study, a framework for estimating experimental measurement uncertainties for a Homogenous Charge Compression Ignition (HCCI)/Low-Temperature Gasoline Combustion (LTGC) engine testing facility is presented. Detailed uncertainty quantification is first carried out for the measurement of the in-cylinder pressure, whose variations during the cycle provide most of the information for performance evaluation. Standard uncertainties of other measured quantities, such as the engine geometry and speed, the air and fuel flow rate and the intake/exhaust dry molar fractions are also estimated. Propagating those uncertainties using a Monte Carlo simulation and Bayesian inference methods then allows for estimation of uncertainties of the mass-average temperature and composition at IVC and throughout the cycle; and also of the engine performances such as gross Integrated Mean Effective Pressure, Heat Release and Ringing Intensity. Throughout the analysis, nominal values for uncertainty inputs were taken from a well-characterized engine test facility. However, the analysis did not take into account the calibration practice of experiments run in that facility and the resulting uncertainty values are therefore not indicative of the expected accuracy of those experimental results. A future study will employ the methodology developed here to explore the effects of different calibration methods on the different uncertainty values in order to evaluate best practices for accurate engine measurements.

02 PETROLEUM↗