Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A functional global sensitivity measure and efficient reliability sensitivity analysis with respect to statistical parameters

Sensitivity analysis and reliability assessment are two important aspects of structural and system safety. Epistemic uncertainty with respect to probabilistic model of input parameters due to lack of knowledge is present in many scarce-data applications and complicates the characterization of uncertainty in model response. In this article, we present two importance measures to evaluate the impact of distribution parameters on the probability distribution function (PDF) of the output and the failure probability. The epistemic uncertainty associated with the distribution parameters is modeled as random variables. Additionally, a modified extended polynomial chaos expansion (MEPCE) approach is introduced in which aleatory and epistemic random variables are modeled and propagated simultaneously while allowing the separate assessment for any single epistemic variable. A MEPCE-based kernel density estimation (KDE) construction provides a composite map from each epistemic variable to the response PDF. The functional global sensitivity index of the PDF with respect to the distribution parameters is thus derived, as a function of output, which is both more informative and more efficient than standard scalar sensitivity measures. Reliability sensitivity indices can be readily evaluated by integrating the global sensitivity index function over the failure zone. Three illustrative examples are used to demonstrate the proposed methodology.

42 ENGINEERING↗
DOE OSTI2021

Surrogate multi-fidelity data and model fusion for scientific discovery and uncertainty quantification in Earth System Models

This whitepaper addresses the Earth and Environmental Systems Sciences Division (EESSD)’s predictability challenges in modeling the integrated water cycle and data-model integration. Specifically, it focuses on reducing and characterizing the uncertainty in the representation of process models for unresolved physics, either due to model resolution or limited by the physical under standing or computational efficiency, and the use of observational data for in-situ process parameter optimization within ESM. The described methods may also be used to determine the nature of responses (e.g. strength and direction), and hence to identify critical processes that drive the overall ESM responses to perturbation in the forcing

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1991

An experimental evaluation of uncertainty models for a flexible structure control problem

The authors describe results in applying robust control techniques of an active precision truss structure at the Jet Propulsion Laboratory. The active structure incorporates piezoelectric members which serve as both structural and actuator/sensor elements. Several characterizations of uncertainty are studied and the controllers are compared experimentally.

Smith, Roy S.↗
DOE OSTI2024

When do different scenarios of projected electricity demand start to meaningfully diverge?

Resource adequacy studies look at balancing electricity supply and demand on 10- to 15-year time horizons while asset investment planning typically evaluates returns on 20- to 40-year time horizons. Projections of electricity demand are factored into the decision-making in both cases. Climate, energy policy, and socioeconomic changes are key uncertainties known to influence electricity demands, but their relative importance for demands over the next 10-40 years is unclear. The power sector would benefit from a better understanding of the need to characterize these uncertainties for resource adequacy and investment planning. In this study, we quantify when projected United States (U.S.) electricity demands start to meaningfully diverge in response to a range of climate, energy policy, and socioeconomic drivers. Here we use a wide yet plausible range of 21st century scenarios for the U.S. The projections span two population/economic growth scenarios (Shared Socioeconomic Pathways 3 and 5) and two climate/energy policy scenarios, one including climate mitigation policies and one without (Representative Concentration Pathways 4.5 and 8.5). Each climate/energy policy scenario has two warming levels to reflect a range of climate model uncertainty. We show that the socioeconomic scenario matters almost immediately – within the next 10 years, the climate/policy scenario matters within 25-30 years, and the climate model uncertainty matters only after 50+ years. This work can inform the power sector working to integrate climate change uncertainties into their decision-making.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2017

Role of Forcing Uncertainty and Background Model Error Characterization in Snow Data Assimilation

Accurate specification of the model error covariances in data assimilation systems is a challenging issue. Ensemble land data assimilation methods rely on stochastic perturbations of input forcing and model prognostic fields for developing representations of input model error covariances. This article examines the limitations of using a single forcing dataset for specifying forcing uncertainty inputs for assimilating snow depth retrievals. Using an idealized data assimilation experiment, the article demonstrates that the use of hybrid forcing input strategies (either through the use of an ensemble of forcing products or through the added use of the forcing climatology) provide a better characterization of the background model error, which leads to improved data assimilation results, especially during the snow accumulation and melt-time periods. The use of hybrid forcing ensembles is then employed for assimilating snow depth retrievals from the AMSR2 (Advanced Microwave Scanning Radiometer 2) instrument over two domains in the continental USA with different snow evolution characteristics. Over a region near the Great Lakes, where the snow evolution tends to be ephemeral, the use of hybrid forcing ensembles provides significant improvements relative to the use of a single forcing dataset. Over the Colorado headwaters characterized by large snow accumulation, the impact of using the forcing ensemble is less prominent and is largely limited to the snow transition time periods. The results of the article demonstrate that improving the background model error through the use of a forcing ensemble enables the assimilation system to better incorporate the observational information.

assimilation↗
NASA NTRS2017

A Survey of Xenon Ion Sputter Yield Data and Fits Relevant to Electric Propulsion Spacecraft Integration

A survey of low energy xenon ion impact sputter yields was conducted to provide a more coherent baseline set of sputter yield data and accompanying fits for electric propulsion integration. Data uncertainties are discussed and different available curve fit formulas are assessed for their general suitability. A Bayesian parameter fitting approach is used with a Markov chain Monte Carlo method to provide estimates for the fitting parameters while characterizing the uncertainties for the resulting yield curves.

xenon↗
DOE OSTI2022

Uncertainty evaluation in reference material characterization by double isotope dilution inductively coupled plasma mass spectrometry (ID-ICP-MS)

Double isotope dilution inductively coupled plasma mass spectrometry (ID-ICP-MS) is one of the most important measurement methods in the establishment of measurement standards for inorganic analysis. However, there is still no good consensus on approaches for uncertainty evaluation in double ID-ICP-MS. Particularly, approaches to treating the instrumental isotopic fractionation (IIF) phenomenon and correlation between uncertainty sources are diverse and often unclear in the literature. Here, an approach for uncertainty evaluation in double ID-ICP-MS measurements is described. Using three certified reference materials (CRMs), it is shown that the IIF effects cancel out and should not be included in the uncertainty budget. Further, a consistent way of considering correlated sources of uncertainty to prevent double counting of uncertainties is described in detail along with an example of measuring the mass fraction of magnesium in an oyster powder CRM.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Climate-aware decision-making: lessons for electric grid infrastructure planning and operations

Abstract Climate change poses significant risks to large-scale infrastructure systems and brings considerable uncertainties that challenge historical planning approaches. Here we focus on how climate awareness might be better incorporated into planning and decision-making in the electric power sector. To do so, we consider lessons from decision science literature where researchers have specifically focused on how to make better decisions under uncertainty. We perform a three-part review: of decision science literature on best practices for decision-making under uncertainty, of industry practice documents to understand how new uncertainties may affect the types of decisions electric utilities are making today, and of literature on electricity sector planning under climate change to assess how lessons from decision science might fit into sector-specific analyses. We discuss how characterizations of uncertainty from the decision science literature might guide approaches in the electricity sector to appropriately capture climate-related uncertainties. We also distill three key ideas from the decision science literature that can be incorporated into electricity sector planning to manage these new uncertainties: robustness, adaptive planning, and multi-stakeholder engagement. We offer example recommendations for how these key ideas might be incorporated into one essential type of planning activity, capacity expansion.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1994

Feedback control laws for highly maneuverable aircraft

During the first half of the year, the investigators concentrated their efforts on completing the design of control laws for the longitudinal axis of the HARV. During the second half of the year they concentrated on the synthesis of control laws for the lateral-directional axes. The longitudinal control law design efforts can be briefly summarized as follows. Longitudinal control laws were developed for the HARV using mu synthesis design techniques coupled with dynamic inversion. An inner loop dynamic inversion controller was used to simplify the system dynamics by eliminating the aerodynamic nonlinearities and inertial cross coupling. Models of the errors resulting from uncertainties in the principal longitudinal aerodynamic terms were developed and included in the model of the HARV with the inner loop dynamic inversion controller. This resulted in an inner loop transfer function model which was an integrator with the modeling errors characterized as uncertainties in gain and phase. Outer loop controllers were then designed using mu synthesis to provide robustness to these modeling errors and give desired response to pilot inputs. Both pitch rate and angle of attack command following systems were designed. The following tasks have been accomplished for the lateral-directional controllers: inner and outer loop dynamic inversion controllers have been designed; an error model based on a linearized perturbation model of the inner loop system was derived; controllers for the inner loop system have been designed, using classical techniques, that control roll rate and Dutch roll response; the inner loop dynamic inversion and classical controllers have been implemented on the six degree of freedom simulation; and lateral-directional control allocation scheme has been developed based on minimizing required control effort.

Garrard, William L.↗
NASA NTRS1991

Frequency domain identification for robust large space structure control design

A methodology is demonstrated for frequency domain identification of large space structures which systematically transforms experimental raw data into a form required for synthesizing H(infinity) controllers using modern robust control design software (e.g., Matlab Toolboxes). A unique feature of this approach is that the additive uncertainty is characterized to a specified statistic confidence rather than with hard bounds. In this study, the difference in robust performance is minimal between the two levels of confidence. In general cases, the present methodology provides a tool for performance/confidence level tradeoff studies. For simplicity, the additive uncertainty on a frequency grid is considered and the interpolation error in between grid points is neglected.

Yam, Y.↗
NASA NTRS1994

The application of decision analysis to life support research and technology development

Applied research and technology development is often characterized by uncertainty, risk, and significant delays before tangible returns are obtained. Decision making regarding which technologies to advance and what resources to devote to them is a challenging but essential task. In the application of life support technology to future manned space flight, new technology concepts typically are characterized by nonexistent data and rough approximations of technology performance, uncertain future flight program needs, and a complex, time-intensive process to develop technology to a flight-ready status. Decision analysis is a quantitative, logic-based discipline that imposes formalism and structure to complex problems. It also accounts for the limits of knowledge that may be available at the time a decision is needed. The utility of decision analysis to life support technology R & D was evaluated by applying it to two case studies. The methodology was found to provide insight that is not possible from more traditional analysis approaches.

Ballin, Mark G.↗
NASA NTRS2010

Using MERRA Gridded Innovations for Quantifying Uncertainties in Analysis Fields and Diagnosing Observing System Inhomogeneities

MERRA is a NASA reanalysis for the satellite era using a major new version of the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5). The project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales and places the NASA EOS suite of observations in a climate context. The characterization of uncertainty in reanalysis fields is a commonly requested feature by users of such data. While intercomparison with reference data sets is common practice for ascertaining the realism of the datasets, such studies typically are restricted to long term climatological statistics and seldom provide state dependent measures of the uncertainties involved. In principle, variational data assimilation algorithms have the ability of producing error estimates for the analysis variables (typically surface pressure, winds, temperature, moisture and ozone) consistent with the assumed background and observation error statistics. However, these "perceived error estimates" are expensive to obtain and are limited by the somewhat simplistic errors assumed in the algorithm. The observation minus forecast residuals (innovations) by-product of any assimilation system constitutes a powerful tool for estimating the systematic and random errors in the analysis fields. Unfortunately, such data is usually not readily available with reanalysis products, often requiring the tedious decoding of large datasets and not so-user friendly file formats. With MERRA we have introduced a gridded version of the observations/innovations used in the assimilation process, using the same grid and data formats as the regular datasets. Such dataset empowers the user with the ability of conveniently performing observing system related analysis and error estimates. The scope of this dataset will be briefly described. We will present a systematic analysis of MERRA innovation time series for the conventional observing system, including maximum-likelihood estimates of background and observation errors, as well as global bias estimates. Starting with the joint PDF of innovations and analysis increments at observation locations we propose a technique for diagnosing bias among the observing systems, and document how these contextual biases have evolved during the satellite era covered by MERRA.

da Silva, Arlindo↗
DOE OSTI2026

Multi‐Model Ensembles in Ecosystem Modeling: Challenges and Best Practices for Decision‐Making

Ecosystem models are increasingly central to the decision-making for environmental policy, conservation planning, and climate-related investments. Yet, the growing reliance on Multi-Model Ensembles (MMEs) of ecosystem models by practitioners and policymakers, sometimes under tight timelines and imperfect information, has frequently outpaced the scientific rigor required to ensure ensemble reliability. Here, MMEs refer to approaches that combine targeted predictions from multiple models with the expectation of improving robustness and quantifying predictive uncertainty. Poorly designed MMEs may create a false sense of confidence and lead to suboptimal policy and market decisions. This perspective argues that robust decision-making-relevant MMEs must be grounded on two pillars: (1) rigorous Model Intercomparison Projects (MIPs), which identify inter-model agreement and disagreement, characterize model uncertainties, and evaluate robustness with observationally based benchmarks—MIPs' diagnostic evaluation is so critical that it must be needed to drive MME's decision in model selection and weighting, especially when only a limited number of models available; and (2) co-design by both stakeholders and scientists to ensure that scenarios, metrics and uncertainty requirements provide decision-relevant information. Building upon the past success and lessons from the existing MIPs-MMEs efforts (e.g., climate/Earth system/crop), we derived the theoretical basis for MMEs, addressed their specific challenges in ecosystem modeling, and highlighted proper consideration of model numbers and diversity, risk of model inter-dependence, effective calibration of model parameters, possible overdue of some ecosystem model development, critical roles of open benchmark data across a wide range of conditions, and suggested use of Artificial Intelligence to support MIPs-MMEs. We highlighted the under-recognized opportunity for MIPs and MMEs to drive scientific progress and innovation through identifying better performing models, systematic benchmarking, feedback loops, and targeted model improvement. By following actionable best practice guidelines, MMEs can evolve from ad hoc aggregation of models into a trusted backbone of environmental policy and decision-making.

ecosystem modeling↗
DOE OSTI2026

MAGIC: M arching Cubes Isosurface Uncertainty Visualization for G auss i an Uncertain Data With Spatial C orrelation

Here, in this paper, we study the propagation of data uncertainty through the marching cubes algorithm for isosurface visualization for correlated uncertain data. Consideration of correlation has been shown paramount for avoiding errors in uncertainty quantification and visualization in multiple prior studies. Although the problem of isosurface uncertainty with spatial data correlation has been previously addressed, there are two major limitations to prior treatments. First, there are no analytical formulations for uncertainty quantification of isosurfaces when the data uncertainty is characterized by a Gaussian distribution with spatial correlation. Second, as a consequence of the lack of analytical formulations,existing techniques resort to a Monte Carlo sampling approach, which is expensive and difficult to integrate into visualization tools. To address these limitations, we present a closed-form framework to efficiently derive uncertainty in marching cubes level-sets for Gaussian uncertain data with spatial correlation (MAGIC). To derive closed-form solutions, we leverage the Hinkley's derivation on the ratio of Gaussian distributions. With our analytical framework, we achieve a significant speed-up and enhanced accuracy of uncertainty quantification over classical Monte Carlo methods. We further accelerate our analytical solutions using many-core processors to achieve speed-ups up to 585× and integrability with production visualization tools for broader impact. We demonstrate the effectiveness of our correlation-aware uncertainty framework through experiments on meteorology, urban flow, and astrophysics simulation datasets.

Gaussian↗
NASA NTRS1998

A Monte Carlo Uncertainty Analysis of Ozone Trend Predictions in a Two Dimensional Model

We use Monte Carlo analysis to estimate the uncertainty in predictions of total O3 trends between 1979 and 1995 made by the Goddard Space Flight Center (GSFC) two-dimensional (2D) model of stratospheric photochemistry and dynamics. The uncertainty is caused by gas-phase chemical reaction rates, photolysis coefficients, and heterogeneous reaction parameters which are model inputs. The uncertainty represents a lower bound to the total model uncertainty assuming the input parameter uncertainties are characterized correctly. Each of the Monte Carlo runs was initialized in 1970 and integrated for 26 model years through the end of 1995. This was repeated 419 times using input parameter sets generated by Latin Hypercube Sampling. The standard deviation (a) of the Monte Carlo ensemble of total 03 trend predictions is used to quantify the model uncertainty. The 34% difference between the model trend in globally and annually averaged total O3 using nominal inputs and atmospheric trends calculated from Nimbus 7 and Meteor 3 total ozone mapping spectrometer (TOMS) version 7 data is less than the 46% calculated 1 (sigma), model uncertainty, so there is no significant difference between the modeled and observed trends. In the northern hemisphere midlatitude spring the modeled and observed total 03 trends differ by more than 1(sigma) but less than 2(sigma), which we refer to as marginal significance. We perform a multiple linear regression analysis of the runs which suggests that only a few of the model reactions contribute significantly to the variance in the model predictions. The lack of significance in these comparisons suggests that they are of questionable use as guides for continuing model development. Large model/measurement differences which are many multiples of the input parameter uncertainty are seen in the meridional gradients of the trend and the peak-to-peak variations in the trends over an annual cycle. These discrepancies unambiguously indicate model formulation problems and provide a measure of model performance which can be used in attempts to improve such models.

Considine, D. B.↗
DOE OSTI2020

Global land use for 2015–2100 at 0.05° resolution under diverse socioeconomic and climate scenarios

Abstract Global future land use (LU) is an important input for Earth system models for projecting Earth system dynamics and is critical for many modeling studies on future global change. Here we generated a new global gridded LU dataset using the Global Change Analysis Model (GCAM) and a land use spatial downscaling model, named Demeter, under the five Shared Socioeconomic Pathways (SSPs) and four Representative Concentration Pathways (RCPs) scenarios. Compared to existing similar datasets, the presented dataset has a higher spatial resolution (0.05° × 0.05°) and spreads under a more comprehensive set of SSP-RCP scenarios (in total 15 scenarios), and considers uncertainties from the forcing climates. We compared our dataset with the Land Use Harmonization version 2 (LUH2) dataset and found our results are in general spatially consistent with LUH2. The presented dataset will be useful for global Earth system modeling studies, especially for the analysis of the impacts of land use and land cover change and socioeconomics, as well as the characterizing the uncertainties associated with these impacts.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Global land use for 2015-2100 at 0.05° resolution under diverse socioeconomic and climate scenarios

Global future land use (LU) is an important input for Earth system models for projecting Earth system dynamics and is critical for many modeling studies on future global change. Here we generated a new global gridded LU dataset using the Global Change Analysis Model (GCAM) and a land use spatial downscaling model, named Demeter, under the five Shared Socioeconomic Pathways (SSPs) and four Representative Concentration Pathways (RCPs) scenarios. Compared to existing similar datasets, the presented dataset has a higher spatial resolution (0.05°×0.05°) and spreads under a more comprehensive set of SSP-RCP scenarios (in total 15 scenarios), and considers uncertainties from the forcing climates. We compared our dataset with the Land Use Harmonization version 2 (LUH2) dataset and found our results are in general spatially consistent with LUH2. The presented dataset will be useful for global Earth system modeling studies, especially for the analysis of the impacts of land use and land cover change and socioeconomics, as well as the characterizing the uncertainties associated with these impacts.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

Mid-Fidelity Computational Fluid Dynamics Analysis of the Elytron 4S UAV Concept

The Elytron 4S Unmanned Aerial Vehicle (UAV) Concept was developed to combine the advantages of fixed- and rotary-wing technology. The 4S Concept is a box-wing configuration with rotors mounted on a centrally located tiltwing. The UAV is intended to be capable of both conventional takeoff and landing (CTOL) and vertical takeoff and landing (VTOL), and is envisioned to excel in UAV performance because of the combined efficiency of fixed-wing aircraft and the hover and VTOL capabilities of regular drones or quadcopters. A mid-fidelity Unsteady Reynolds-Averaged Navier-Stokes (URANS) approach using Rotorcraft CFD (RotCFD) is performed to analyze and characterize the performance of the aircraft. The flow field is coupled with a rotor model based on blade-element momentum theory to model the 4S UAV rotors. Turbulence is modeled using a realizable k- turbulence model with special wall function. The code is used to generate aerodynamic forces and moments on the body at cruise conditions, and during VTOL. The results and their uncertainties are characterized, and an angle- of-attack and sideslip sweep are computed, both with and without rotors on. Simulations are compared with the wind tunnel tests in the 7- by 10-Foot U.S. Army Wind Tunnel at NASA Ames Research Center, performed in 2017. Results show promising comparison with experimental data, despite a late change in rotor size and rudder size of the physical model that cause the expected deviations from the simulation. A slight change in the net thrust value, when rotors are modeled, is observed because of the rotor diameter increase on the physical model. A noticeable difference in the directional stability was observed because of the increased rudder surface and added strakes. These changes were implemented to improve on the design as simulated, which is observed in the results. The simulation results paved the way to the first successful flight of the UAV Concept.

Koning, Witold J. K.↗