Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Neglecting Model Parametric Uncertainty Can Drastically Underestimate Flood Risks

Abstract Floods drive dynamic and deeply uncertain risks for people and infrastructures. Uncertainty characterization is a crucial step in improving the predictive understanding of multi‐sector dynamics and the design of risk‐management strategies. Current approaches to estimate flood hazards often sample only a relatively small subset of the known unknowns, for example, the uncertainties surrounding the model parameters. This approach neglects the impacts of key uncertainties on hazards and system dynamics. Here we mainstream a recently developed method for Bayesian inference to calibrate a computationally expensive distributed hydrologic model. We compare three different calibration approaches: (a) stepwise line search, (b) precalibration or screening, and (c) the Fast Model Calibrations (FaMoS) approach. FaMoS deploys a particle‐based approach that takes advantage of the massive parallelization afforded by modern high‐performance computing systems. We quantify how neglecting parametric uncertainty and data discrepancy can drastically underestimate extreme flood events and risks. Precalibration improves prediction skill score over a stepwise line search. The Bayesian calibration improves the uncertainty characterization of model parameters and flood risk projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Probabilistic Programming for Transportable Source Characterization and Uncertainty Quantification of the North Korean Nuclear Tests 2006–2017

Here, we introduce a transportable technique to determine the yield and depth of burial (DOB) from seismic source spectra of underground nuclear explosions. We demonstrate this technique on the six declared North Korean nuclear tests. This approach derives source spectra in absolute units from regional phase (Pg) amplitudes by correcting the observations for geometric spreading, attenuation, and site amplification. We couple the source spectra and explosion source models with a probabilistic programming framework that integrates deep learning techniques and Bayesian modeling. This approach permits the exchange of information across various data categories to quantify both the data and model uncertainty. This technique stands out as an innovative use of broad‐area propagation models, making it transportable across various geologic settings. This method proves to be effective in scenarios with diverse and/or limited observational data, even when the source depth is unknown. We present new independent estimates of absolute yield and DOB that are consistent with the prior assessments, underscoring the potential of this method in enhancing transportable nuclear explosion monitoring capabilities.

58 GEOSCIENCES↗
DOE OSTI2024

Characterizing the Uncertainty of Measurement of Traceable Isotope Ratios with Bayesian Statistical Techniques

Analytical techniques such as multicollector—inductively coupled plasma—mass spectrometry (MC-ICP-MS) are routinely employed at SRNL, other National Laboratories, and in academia to determine the precise isotopic composition of diverse natural and anthropogenic samples (e.g., rocks and nuclear materials). Quantifying and reporting uncertainty in such analyses, while regularly performed, have a rigorous statistical foundation. The Guide to the Expression of Uncertainty in Measurement 4 (GUM) outlines conventional techniques used to assess such uncertainty. As the accessibility and speed of statistical computing increase, there is a need to modernize conventional techniques. For example, Supplement 1 to the 3rd to the GUM suggests the use of approximation methods as an updated approach to the GUM.

McLarty, Ellis C.↗
NASA NTRS1993

Characterizing the uncertainty in holddown post load measurements

In order to understand unexpectedly erratic load measurements in the launch-pad supports for the space shuttle, the sensitivities of the load cells in the supports were analyzed using simple probabilistic techniques. NASA engineers use the loads in the shuttle's supports to calculate critical stresses in the shuttle vehicle just before lift-off. The support loads are measured with 'load cells' which are actually structural components of the mobile launch platform which have been instrumented with strain gauges. Although these load cells adequately measure vertical loads, the horizontal load measurements have been erratic. The load measurements were simulated in this study using Monte Carlo simulation procedures. The simulation studies showed that the support loads are sensitive to small deviations in strain and calibration. In their current configuration, the load cells will not measure loads with sufficient accuracy to reliably calculate stresses in the shuttle vehicle. A simplified model of the holddown post (HDP) load measurement system was used to study the effect on load measurement accuracy for several factors, including load point deviations, gauge heights, and HDP geometry.

Richardson, J. A.↗
NASA NTRS2004

Characterization and Uncertainty Analysis of a Reference Pressure Measurement System for Wind Tunnels

This paper presents the calibration results and uncertainty analysis of a high-precision reference pressure measurement system currently used in wind tunnels at the NASA Langley Research Center (LaRC). Sensors, calibration standards, and measurement instruments are subject to errors due to aging, drift with time, environment effects, transportation, the mathematical model, the calibration experimental design, and other factors. Errors occur at every link in the chain of measurements and data reduction from the sensor to the final computed results. At each link of the chain, bias and precision uncertainties must be separately estimated for facility use, and are combined to produce overall calibration and prediction confidence intervals for the instrument, typically at a 95% confidence level. The uncertainty analysis and calibration experimental designs used herein, based on techniques developed at LaRC, employ replicated experimental designs for efficiency, separate estimation of bias and precision uncertainties, and detection of significant parameter drift with time. Final results, including calibration confidence intervals and prediction intervals given as functions of the applied inputs, not as a fixed percentage of the full-scale value are presented. System uncertainties are propagated beginning with the initial reference pressure standard, to the calibrated instrument as a working standard in the facility. Among the several parameters that can affect the overall results are operating temperature, atmospheric pressure, humidity, and facility vibration. Effects of factors such as initial zeroing and temperature are investigated. The effects of the identified parameters on system performance and accuracy are discussed.

Amer, Tahani↗
NASA NTRS2012

Understanding Climate Policy Data Needs. NASA Carbon Monitoring System Briefing: Characterizing Flux Uncertainty, Washington D.C., 11 January 2012

Climate policy in the United States is currently guided by public-private partnerships and actions at the local and state levels. This mitigation strategy is made up of programs that focus on energy efficiency, renewable energy, agricultural practices and implementation of technologies to reduce greenhouse gases. How will policy makers know if these strategies are working, particularly at the scales at which they are being implemented? The NASA Carbon Monitoring System (CMS) will provide information on carbon dioxide fluxes derived from observations of earth's land, ocean and atmosphere used in state of the art models describing their interactions. This new modeling system could be used to assess the impact of specific policy interventions on CO2 reductions, enabling an iterative, results-oriented policy process. In January of 2012, the CMS team held a meeting with carbon policy and decision makers in Washington DC to describe the developing modeling system to policy makers. The NASA CMS will develop pilot studies to provide information across a range of spatial scales, consider carbon storage in biomass, and improve measures of the atmospheric distribution of carbon dioxide. The pilot involves multiple institutions (four NASA centers as well as several universities) and over 20 scientists in its work. This pilot study will generate CO2 flux maps for two years using observational constraints in NASA's state-of -the-art models. Bottom-up surface flux estimates will be computed using data-constrained land and ocean models; comparison of the different techniques will provide some knowledge of uncertainty in these estimates. Ensembles of atmospheric carbon distributions will be computed using an atmospheric general circulation model (GEOS-5), with perturbations to the surface fluxes and to transport. Top-down flux estimates will be computed from observed atmospheric CO2 distributions (ACOS/GOSAT retrievals) alongside the forward-model fields, in conjunction with an inverse approach based on the CO2 model of GEOS ]Chem. The forward model ensembles will be used to build understanding of relationships among surface flux perturbations, transport uncertainty and atmospheric carbon concentration. This will help construct uncertainty estimates and information on the true spatial resolution of the top-down flux calculations. The relationship between the top-down and bottom-up flux distributions will be documented. Because the goal of NASA CMS is to be policy relevant, the scientists involved in the flux modeling pilot need to understand and be focused on the needs of the climate policy and decision making community. If policy makers are to use CMS products, they must be aware of the modeling effort and begin to design policies that can be evaluated with information. Improving estimates of carbon sequestered in forests, for example, will require information on the spatial variability of forest biomass that is far more explicit than is presently possible using only ground observations. Carbon mitigation policies being implemented by cities around the United States could be designed with the CMS data in mind, enabling sequential evaluation and subsequent improvements in incentives, structures and programs. The success of climate mitigation programs being implemented in the United States today will hang on the depth of the relationship between scientists and their policy and decision making counterparts. Ensuring that there is two-way communication between data providers and users is important for the success both of the policies and the scientific products meant to support them..

Brown, Molly E.↗
NASA NTRS2014

Interval Predictor Models with a Formal Characterization of Uncertainty and Reliability

This paper develops techniques for constructing empirical predictor models based on observations. By contrast to standard models, which yield a single predicted output at each value of the model's inputs, Interval Predictors Models (IPM) yield an interval into which the unobserved output is predicted to fall. The IPMs proposed prescribe the output as an interval valued function of the model's inputs, render a formal description of both the uncertainty in the model's parameters and of the spread in the predicted output. Uncertainty is prescribed as a hyper-rectangular set in the space of model's parameters. The propagation of this set through the empirical model yields a range of outputs of minimal spread containing all (or, depending on the formulation, most) of the observations. Optimization-based strategies for calculating IPMs and eliminating the effects of outliers are proposed. Outliers are identified by evaluating the extent by which they degrade the tightness of the prediction. This evaluation can be carried out while the IPM is calculated. When the data satisfies mild stochastic assumptions, and the optimization program used for calculating the IPM is convex (or, when its solution coincides with the solution to an auxiliary convex program), the model's reliability (that is, the probability that a future observation would be within the predicted range of outputs) can be bounded rigorously by a non-asymptotic formula.

Crespo, Luis G.↗
NASA NTRSDate not supplied

Characterizing Spatiotemporal Uncertainty in Interpolated Meteorological Data

Interpolated meteorological data invariably contain errors. These errors have structure in time and space, particularly autocorrelation, which can cause the effects of errors to compound when model outputs are aggregated temporally or spatially. One way to account for this uncertainty is with a probabilistic model from which samples can be drawn that are coherent with respect to underlying spatial and temporal covariance structure. This work describes a probabilistic method for spatial interpolation of point-wise meteorological time series. Observational data from weather stations are generally sparse in space and dense in time (but sometimes missing). The method works by projecting time series onto orthogonal basis vectors and spatially interpolating each resulting component independently. Under suitable assumptions, and data transformations to better satisfy those assumptions, Gaussian process regression provides a complete description of the joint predictive distribution over a Gaussian random field. Spatiotemporally coherent realizations are generated as the sum of conditional (spatial) simulations of each orthogonal (temporal) component. Data-derived and generic orthogonal bases are considered. In addition to spatial interpolation, imputation of missing observational data is examined. The method is applied using near-surface air temperature over the Western United States and validated by comparing theoretical versus actual coverage of predictive distributions and analyzing the degree to which spatial and temporal covariance structure is reproduced. Computational considerations, relating to conditional simulation of random fields, are also addressed.

Conor T Doherty↗
DOE OSTI2024

MSD CoP Webinar: Applied Science for Decision-Making at the Water-Energy Nexus

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: The energy transition is a game-changer across multiple sectors, requiring researchers and practitioners to re-evaluate the evolving connections between climate, water, and power systems, as well as the associated co-management of resources and decision-making. In anticipation of new technologies, policies, business models, and other solutions, applied science for decision-making at the climate-water-energy nexus is needed to support transitions with the expected climate resilience, maintained and enhanced energy security, thriving economies, and equity considerations. Through panelists' applied research and operational experience, the webinar will provide lesson-learnt in how to increase the readiness of water-energy research and become actionable in the context of energy transitions. A number of themes will be discussed, including the connection between growing computational resources and complexity of models, and the implications on the intended users, the actual actionable products, the availability of data for validation of the models, uncertainty characterization and decision-making under uncertainty, and the communication of the novelty to decision-makers and the public. Presenters : David McCollum (Oak Ridge National Laboratory; Co-Chair), and Gokul Iyer (Pacific Northwest National Laboratory; Co-Chair), Curt Jawdy (Tennessee Valley Authority), Nathalie Voisin (Pacific Northwest National Laboratory), and Andrew D. Jones (Lawrence Berkeley National Laboratory) Moderator: Pat M. Reed (MSD CoP Facilitation Team) This webinar was held on: April 30, 2024 from 1-2 PM ET

Energy↗
DOE OSTI2024

Characterizing and communicating uncertainty: lessons from NASA’s Carbon Monitoring System

Navigating uncertainty is a critical challenge in all fields of science, especially when translating knowledge into real-world policies or management decisions. However, the wide variance in concepts and definitions of uncertainty across scientific fields hinders effective communication. As a microcosm of diverse fields within Earth Science, NASA’s Carbon Monitoring System (CMS) provides a useful crucible in which to identify cross-cutting concepts of uncertainty. The CMS convened the Uncertainty Working Group (UWG), a group of specialists across disciplines, to evaluate and synthesize efforts to characterize uncertainty in CMS projects. This paper represents efforts by the UWG to build a heuristic framework designed to evaluate data products and communicate uncertainty to both scientific and non-scientific end users. We consider four pillars of uncertainty: origins, severity, stochasticity versus incomplete knowledge, and spatial and temporal autocorrelation. Using a common vocabulary and a generalized workflow, the framework introduces a graphical heuristic accompanied by a narrative, exemplified through contrasting case studies. Envisioned as a versatile tool, this framework provides clarity in reporting uncertainty, guiding users and tempering expectations. Beyond CMS, it stands as a simple yet powerful means to communicate uncertainty across diverse scientific communities.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2023

Advances in Aircraft System Identification at NASA Langley Research Center

Advances in aircraft system identification at NASA Langley Research Center are discussed. The relevant time period includes the years since the last summary paper of this kind, which was published in the Journal of Aircraft in 2005. Research advances were achieved in flight test experiment design, frequency-domain modeling, real-time autonomous global modeling, rapid simulation development and updating, dynamic modeling in turbulence, flight data corrections, model uncertainty characterization, and aeroelastic modeling using distributed sensing. Possible future developments in the field are identified.

Aircraft system identification↗
NASA NTRS2014

A Formal Approach to Empirical Dynamic Model Optimization and Validation

A framework was developed for the optimization and validation of empirical dynamic models subject to an arbitrary set of validation criteria. The validation requirements imposed upon the model, which may involve several sets of input-output data and arbitrary specifications in time and frequency domains, are used to determine if model predictions are within admissible error limits. The parameters of the empirical model are estimated by finding the parameter realization for which the smallest of the margins of requirement compliance is as large as possible. The uncertainty in the value of this estimate is characterized by studying the set of model parameters yielding predictions that comply with all the requirements. Strategies are presented for bounding this set, studying its dependence on admissible prediction error set by the analyst, and evaluating the sensitivity of the model predictions to parameter variations. This information is instrumental in characterizing uncertainty models used for evaluating the dynamic model at operating conditions differing from those used for its identification and validation. A practical example based on the short period dynamics of the F-16 is used for illustration.

Crespo, Luis G↗
DOE OSTI2021

TRUST Nonlinear Dynamics Testbed Assessment

The following assessment evaluates the efficacy of the control script for carrying out a linear signal to generate a linear mechanical response of the system: the TRUST nonlinear dynamics (TRUSTND) testbed. The hardware has three main components: the controller (NI PXIe 8861) embedded in the National Instruments chassis (NI PXIe 1092), the signal amplifier (The Modal Shop Linear Power Amplifier 2050E09) to amplify the output of a custom LabVIEW script, and a shaker (The Modal Shop Electrodynamic Exciter 2075E) where wave spring specimens live and are tested within the attached aluminum testbed (center mass). Different kinds of signals (single-tone, swept frequency and white noise) were sent through this hardware in the E-1 lab space at TA-53. First, the linearity of the setup was tested by specifying a sine wave in the control script and checking the quality of the oscillations in a wave spring (McMaster-Carr 9714K19 [1]). When passing a sine wave through the amplifier was succeeded, the frequency response of the wave spring was tested with white noise for comparison to finite-element model predictions. The testbed outputs a repeatable, linear response to the input excitation when used with the wave spring. These measurements reduce the uncertainty associated with the testbed and test procedure to better characterize uncertainty associated with material behavior (SX358 foam samples) in future tests

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗