Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Identification, Uncertainty Characterization and Robust Control Synthesis Applied to Large Flexible Structures Control

This paper demonstrates an approach to frequency domain identification for the explicit purpose of designing robust H(infinity) controllers. The approach transforms raw experimental data into a plant set estimate directly usable by modern robust control design software(e.g., Matlab Robust Control Toolboxes [11][2]). A key issue in control design from raw data is the question of whether the controller will work when applied to the true system. The main feature fo this approach is that the resulting controller in guaranteed to work as designed(when applied to the true system) to a prescribed statistical confidence. While the overall methodology addresses key theoretical issues, it has at the same time been specifically designed to support practical implementations. A simulation example is included to demonstrate the overall approach.

software↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk, and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results, and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods, such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty, are rendered obsolete, since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods. This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper describes how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
NASA NTRS2016

Characterizing Epistemic Uncertainty for Launch Vehicle Designs

NASA Probabilistic Risk Assessment (PRA) has the task of estimating the aleatory (randomness) and epistemic (lack of knowledge) uncertainty of launch vehicle loss of mission and crew risk and communicating the results. Launch vehicles are complex engineered systems designed with sophisticated subsystems that are built to work together to accomplish mission success. Some of these systems or subsystems are in the form of heritage equipment, while some have never been previously launched. For these cases, characterizing the epistemic uncertainty is of foremost importance, and it is anticipated that the epistemic uncertainty of a modified launch vehicle design versus a design of well understood heritage equipment would be greater. For reasons that will be discussed, standard uncertainty propagation methods using Monte Carlo simulation produce counter intuitive results and significantly underestimate epistemic uncertainty for launch vehicle models. Furthermore, standard PRA methods such as Uncertainty-Importance analyses used to identify components that are significant contributors to uncertainty are rendered obsolete since sensitivity to uncertainty changes are not reflected in propagation of uncertainty using Monte Carlo methods.This paper provides a basis of the uncertainty underestimation for complex systems and especially, due to nuances of launch vehicle logic, for launch vehicles. It then suggests several alternative methods for estimating uncertainty and provides examples of estimation results. Lastly, the paper shows how to implement an Uncertainty-Importance analysis using one alternative approach, describes the results, and suggests ways to reduce epistemic uncertainty by focusing on additional data or testing of selected components.

Novack, Steven D.↗
NASA NTRS2014

The NASA Langley Multidisciplinary Uncertainty Quantification Challenge

This paper presents the formulation of an uncertainty quantification challenge problem consisting of five subproblems. These problems focus on key aspects of uncertainty characterization, sensitivity analysis, uncertainty propagation, extreme-case analysis, and robust design.

Crespo, Luis G.↗
NASA NTRSDate not supplied

PACE OCI Short-Wave Infrared Detection Assembly frequency-dependent linearity characterization and uncertainty analysis

The Ocean Color Instrument (OCI), the primary payload of the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE)observatory, will collect data to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared(SWIR) Detection Assembly (SDA) was built and characterized by the Utah State University Space DynamicsLaboratory (SDL) and is a subsystem of OCI. The SDA measures seven bands centered at 940, 1038, 1250, 1378,1615, 2130, and 2260 nm, with standard- and high-gain varieties for the 1250 and 1615 nm bands, resulting in nine total detection configurations in the SWIR. The delivery of high-quality science data is critically dependent upon accurately characterizing the linearity of the SDA. Two metrology techniques were employed to measure the linearity and characterize the frequency-dependent linearity uncertainty of the system. The first technique used superposition linearity measurements to determine the DC linearity, and the second technique involved an oscillating small-signal response at seven frequencies to determine the frequency-dependent linearity. Discrepancies between the DC and frequency-dependent linearities constrain the uncertainty between the two. Examining the difference between these two methods for all SDA channels, we find most channels experience an uncertainty below0.2% with a worst-case measurement uncertainty of 0.31%. Averaging SDA channels with similar detectors, optical filters, and electronics to simulate the flight-like data products yields a worst-case frequency-dependence linearity uncertainty of 0.12%, demonstrating minimal frequency dependence, implying an excellent linearity knowledge.Detailed performance knowledge, including linearity performance, verifies data quality and builds confidence in the success of the PACE mission.

PACE↗
NASA NTRS1993

Characterizing the uncertainty in holddown post load measurements

In order to understand unexpectedly erratic load measurements in the launch-pad supports for the space shuttle, the sensitivities of the load cells in the supports were analyzed using simple probabilistic techniques. NASA engineers use the loads in the shuttle's supports to calculate critical stresses in the shuttle vehicle just before lift-off. The support loads are measured with 'load cells' which are actually structural components of the mobile launch platform which have been instrumented with strain gauges. Although these load cells adequately measure vertical loads, the horizontal load measurements have been erratic. The load measurements were simulated in this study using Monte Carlo simulation procedures. The simulation studies showed that the support loads are sensitive to small deviations in strain and calibration. In their current configuration, the load cells will not measure loads with sufficient accuracy to reliably calculate stresses in the shuttle vehicle. A simplified model of the holddown post (HDP) load measurement system was used to study the effect on load measurement accuracy for several factors, including load point deviations, gauge heights, and HDP geometry.

Richardson, J. A.↗
NASA NTRS2004

Characterization and Uncertainty Analysis of a Reference Pressure Measurement System for Wind Tunnels

This paper presents the calibration results and uncertainty analysis of a high-precision reference pressure measurement system currently used in wind tunnels at the NASA Langley Research Center (LaRC). Sensors, calibration standards, and measurement instruments are subject to errors due to aging, drift with time, environment effects, transportation, the mathematical model, the calibration experimental design, and other factors. Errors occur at every link in the chain of measurements and data reduction from the sensor to the final computed results. At each link of the chain, bias and precision uncertainties must be separately estimated for facility use, and are combined to produce overall calibration and prediction confidence intervals for the instrument, typically at a 95% confidence level. The uncertainty analysis and calibration experimental designs used herein, based on techniques developed at LaRC, employ replicated experimental designs for efficiency, separate estimation of bias and precision uncertainties, and detection of significant parameter drift with time. Final results, including calibration confidence intervals and prediction intervals given as functions of the applied inputs, not as a fixed percentage of the full-scale value are presented. System uncertainties are propagated beginning with the initial reference pressure standard, to the calibrated instrument as a working standard in the facility. Among the several parameters that can affect the overall results are operating temperature, atmospheric pressure, humidity, and facility vibration. Effects of factors such as initial zeroing and temperature are investigated. The effects of the identified parameters on system performance and accuracy are discussed.

Amer, Tahani↗
NASA NTRS2012

Understanding Climate Policy Data Needs. NASA Carbon Monitoring System Briefing: Characterizing Flux Uncertainty, Washington D.C., 11 January 2012

Climate policy in the United States is currently guided by public-private partnerships and actions at the local and state levels. This mitigation strategy is made up of programs that focus on energy efficiency, renewable energy, agricultural practices and implementation of technologies to reduce greenhouse gases. How will policy makers know if these strategies are working, particularly at the scales at which they are being implemented? The NASA Carbon Monitoring System (CMS) will provide information on carbon dioxide fluxes derived from observations of earth's land, ocean and atmosphere used in state of the art models describing their interactions. This new modeling system could be used to assess the impact of specific policy interventions on CO2 reductions, enabling an iterative, results-oriented policy process. In January of 2012, the CMS team held a meeting with carbon policy and decision makers in Washington DC to describe the developing modeling system to policy makers. The NASA CMS will develop pilot studies to provide information across a range of spatial scales, consider carbon storage in biomass, and improve measures of the atmospheric distribution of carbon dioxide. The pilot involves multiple institutions (four NASA centers as well as several universities) and over 20 scientists in its work. This pilot study will generate CO2 flux maps for two years using observational constraints in NASA's state-of -the-art models. Bottom-up surface flux estimates will be computed using data-constrained land and ocean models; comparison of the different techniques will provide some knowledge of uncertainty in these estimates. Ensembles of atmospheric carbon distributions will be computed using an atmospheric general circulation model (GEOS-5), with perturbations to the surface fluxes and to transport. Top-down flux estimates will be computed from observed atmospheric CO2 distributions (ACOS/GOSAT retrievals) alongside the forward-model fields, in conjunction with an inverse approach based on the CO2 model of GEOS ]Chem. The forward model ensembles will be used to build understanding of relationships among surface flux perturbations, transport uncertainty and atmospheric carbon concentration. This will help construct uncertainty estimates and information on the true spatial resolution of the top-down flux calculations. The relationship between the top-down and bottom-up flux distributions will be documented. Because the goal of NASA CMS is to be policy relevant, the scientists involved in the flux modeling pilot need to understand and be focused on the needs of the climate policy and decision making community. If policy makers are to use CMS products, they must be aware of the modeling effort and begin to design policies that can be evaluated with information. Improving estimates of carbon sequestered in forests, for example, will require information on the spatial variability of forest biomass that is far more explicit than is presently possible using only ground observations. Carbon mitigation policies being implemented by cities around the United States could be designed with the CMS data in mind, enabling sequential evaluation and subsequent improvements in incentives, structures and programs. The success of climate mitigation programs being implemented in the United States today will hang on the depth of the relationship between scientists and their policy and decision making counterparts. Ensuring that there is two-way communication between data providers and users is important for the success both of the policies and the scientific products meant to support them..

Brown, Molly E.↗
NASA NTRS2014

Interval Predictor Models with a Formal Characterization of Uncertainty and Reliability

This paper develops techniques for constructing empirical predictor models based on observations. By contrast to standard models, which yield a single predicted output at each value of the model's inputs, Interval Predictors Models (IPM) yield an interval into which the unobserved output is predicted to fall. The IPMs proposed prescribe the output as an interval valued function of the model's inputs, render a formal description of both the uncertainty in the model's parameters and of the spread in the predicted output. Uncertainty is prescribed as a hyper-rectangular set in the space of model's parameters. The propagation of this set through the empirical model yields a range of outputs of minimal spread containing all (or, depending on the formulation, most) of the observations. Optimization-based strategies for calculating IPMs and eliminating the effects of outliers are proposed. Outliers are identified by evaluating the extent by which they degrade the tightness of the prediction. This evaluation can be carried out while the IPM is calculated. When the data satisfies mild stochastic assumptions, and the optimization program used for calculating the IPM is convex (or, when its solution coincides with the solution to an auxiliary convex program), the model's reliability (that is, the probability that a future observation would be within the predicted range of outputs) can be bounded rigorously by a non-asymptotic formula.

Crespo, Luis G.↗
NASA NTRSDate not supplied

Characterizing Spatiotemporal Uncertainty in Interpolated Meteorological Data

Interpolated meteorological data invariably contain errors. These errors have structure in time and space, particularly autocorrelation, which can cause the effects of errors to compound when model outputs are aggregated temporally or spatially. One way to account for this uncertainty is with a probabilistic model from which samples can be drawn that are coherent with respect to underlying spatial and temporal covariance structure. This work describes a probabilistic method for spatial interpolation of point-wise meteorological time series. Observational data from weather stations are generally sparse in space and dense in time (but sometimes missing). The method works by projecting time series onto orthogonal basis vectors and spatially interpolating each resulting component independently. Under suitable assumptions, and data transformations to better satisfy those assumptions, Gaussian process regression provides a complete description of the joint predictive distribution over a Gaussian random field. Spatiotemporally coherent realizations are generated as the sum of conditional (spatial) simulations of each orthogonal (temporal) component. Data-derived and generic orthogonal bases are considered. In addition to spatial interpolation, imputation of missing observational data is examined. The method is applied using near-surface air temperature over the Western United States and validated by comparing theoretical versus actual coverage of predictive distributions and analyzing the degree to which spatial and temporal covariance structure is reproduced. Computational considerations, relating to conditional simulation of random fields, are also addressed.

Conor T Doherty↗
NASA NTRS2023

Advances in Aircraft System Identification at NASA Langley Research Center

Advances in aircraft system identification at NASA Langley Research Center are discussed. The relevant time period includes the years since the last summary paper of this kind, which was published in the Journal of Aircraft in 2005. Research advances were achieved in flight test experiment design, frequency-domain modeling, real-time autonomous global modeling, rapid simulation development and updating, dynamic modeling in turbulence, flight data corrections, model uncertainty characterization, and aeroelastic modeling using distributed sensing. Possible future developments in the field are identified.

Aircraft system identification↗
NASA NTRS2014

A Formal Approach to Empirical Dynamic Model Optimization and Validation

A framework was developed for the optimization and validation of empirical dynamic models subject to an arbitrary set of validation criteria. The validation requirements imposed upon the model, which may involve several sets of input-output data and arbitrary specifications in time and frequency domains, are used to determine if model predictions are within admissible error limits. The parameters of the empirical model are estimated by finding the parameter realization for which the smallest of the margins of requirement compliance is as large as possible. The uncertainty in the value of this estimate is characterized by studying the set of model parameters yielding predictions that comply with all the requirements. Strategies are presented for bounding this set, studying its dependence on admissible prediction error set by the analyst, and evaluating the sensitivity of the model predictions to parameter variations. This information is instrumental in characterizing uncertainty models used for evaluating the dynamic model at operating conditions differing from those used for its identification and validation. A practical example based on the short period dynamics of the F-16 is used for illustration.

Crespo, Luis G↗
NASA NTRS2019

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗
NASA NTRS2016

The Effect of Future Ambient Air Pollution on Human Premature Mortality to 2100 Using Output from the ACCMIP Model Ensemble

Ambient air pollution from ground-level ozone and fine particulate matter (PM(sub 2.5)) is associated with premature mortality. Future concentrations of these air pollutants will be driven by natural and anthropogenic emissions and by climate change. Using anthropogenic and biomass burning emissions projected in the four Representative Concentration Pathway scenarios (RCPs), the ACCMIP ensemble of chemistry climate models simulated future concentrations of ozone and PM(sub 2.5) at selected decades between 2000 and 2100. We use output from the ACCMIP ensemble, together with projections of future population and baseline mortality rates, to quantify the human premature mortality impacts of future ambient air pollution. Future air-pollution-related premature mortality in 2030, 2050 and 2100 is estimated for each scenario and for each model using a health impact function based on changes in concentrations of ozone and PM(sub 2.5) relative to 2000 and projected future population and baseline mortality rates. Additionally, the global mortality burden of ozone and PM(sub 2.5) in 2000 and each future period is estimated relative to 1850 concentrations, using present-day and future population and baseline mortality rates. The change in future ozone concentrations relative to 2000 is associated with excess global premature mortality in some scenarios/periods, particularly in RCP8.5 in 2100 (316 thousand deaths per year), likely driven by the large increase in methane emissions and by the net effect of climate change projected in this scenario, but it leads to considerable avoided premature mortality for the three other RCPs. However, the global mortality burden of ozone markedly increases from 382000 (121000 to 728000) deaths per year in 2000 to between 1.09 and 2.36 million deaths per year in 2100, across RCPs, mostly due to the effect of increases in population and baseline mortality rates. PM(sub 2.5) concentrations decrease relative to 2000 in all scenarios, due to projected reductions in emissions, and are associated with avoided premature mortality, particularly in 2100: between 2.39 and 1.31 million deaths per year for the four RCPs. The global mortality burden of PM(sub 2.5) is estimated to decrease from 1.70 (1.30 to 2.10) million deaths per year in 2000 to between 0.95 and 1.55 million deaths per year in 2100 for the four RCPs due to the combined effect of decreases in PM(sub 2.5) concentrations and changes in population and baseline mortality rates. Trends in future air-pollution-related mortality vary regionally across scenarios, reflecting assumptions for economic growth and air pollution control specific to each RCP and region. Mortality estimates differ among chemistry climate models due to differences in simulated pollutant concentrations, which is the greatest contributor to overall mortality uncertainty for most cases assessed here, supporting the use of model ensembles to characterize uncertainty. Increases in exposed population and baseline mortality rates of respiratory diseases magnify the impact on premature mortality of changes in future air pollutant concentrations and explain why the future global mortality burden of air pollution can exceed the current burden, even where air pollutant concentrations decrease.

Silva, Raquel A.↗
NASA NTRS2011

Space Radiation Cancer Risk Projections and Uncertainties - 2010

Uncertainties in estimating health risks from galactic cosmic rays greatly limit space mission lengths and potential risk mitigation evaluations. NASA limits astronaut exposures to a 3% risk of exposure-induced death and protects against uncertainties using an assessment of 95% confidence intervals in the projection model. Revisions to this model for lifetime cancer risks from space radiation and new estimates of model uncertainties are described here. We review models of space environments and transport code predictions of organ exposures, and characterize uncertainties in these descriptions. We summarize recent analysis of low linear energy transfer radio-epidemiology data, including revision to Japanese A-bomb survivor dosimetry, longer follow-up of exposed cohorts, and reassessments of dose and dose-rate reduction effectiveness factors. We compare these projections and uncertainties with earlier estimates. Current understanding of radiation quality effects and recent data on factors of relative biological effectiveness and particle track structure are reviewed. Recent radiobiology experiment results provide new information on solid cancer and leukemia risks from heavy ions. We also consider deviations from the paradigm of linearity at low doses of heavy ions motivated by non-targeted effects models. New findings and knowledge are used to revise the NASA risk projection model for space radiation cancer risks.

Cucinotta, Francis A.↗
NASA NTRS2009

Uncertainty Management in Remote Sensing of Climate Data. Summary of A Workshop

Great advances have been made in our understanding of the climate system over the past few decades, and remotely sensed data have played a key role in supporting many of these advances. Improvements in satellites and in computational and data-handling techniques have yielded high quality, readily accessible data. However, rapid increases in data volume have also led to large and complex datasets that pose significant challenges in data analysis (NRC, 2007). Uncertainty characterization is needed for every satellite mission and scientists continue to be challenged by the need to reduce the uncertainty in remotely sensed climate records and projections. The approaches currently used to quantify the uncertainty in remotely sensed data, including statistical methods used to calibrate and validate satellite instruments, lack an overall mathematically based framework.

Remote sensing↗