Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Variability and associated uncertainty in image analysis for soiling characterization in solar energy systems

The accumulation of soiling on photovoltaic modules and on the mirrors of concentrating solar power systems causes non-negligible energy losses with economic consequences. These challenges can be mitigated, or even prevented, through appropriate actions if the magnitude of soiling is known. Particle counting analysis is a common procedure to characterize soiling, as it can be easily performed on micrographs of glass coupons or solar devices that have been exposed to the environment. Particle counting does not, however, yield invariant results across institutions. The particle size distribution analysis is affected by the operator of the image analysis software and the methodology utilized. The results of a round-robin study are presented in this work to explore and elucidate the uncertainty related to particle counting and its effect on the characterization of the soiling of glass surfaces used in solar energy conversion systems. An international group of soiling experts analyzed the same 8 micrographs using the same open-source ImageJ software package. The variation in the particle analyses results were investigated to identify specimen characteristics with the lowest coefficient of variation (CV) and the least uncertainty among the various operators. The mean particle diameter showed the lowest CV among the investigated characteristics, whereas the number of particles exhibited the largest CV. Additional parameters, such as the fractional area coverage by particles and parameters related to the distribution's shape yielded intermediate CV values. These results can provide insights on the magnitude inter-lab variability and uncertainty for optical and microscope-based soiling monitoring and characterization.

14 SOLAR ENERGY↗
NASA NTRS2014

Advanced Modeling and Uncertainty Quantification for Flight Dynamics; Interim Results and Challenges

As part of the NASA Vehicle Systems Safety Technologies (VSST), Assuring Safe and Effective Aircraft Control Under Hazardous Conditions (Technical Challenge #3), an effort is underway within Boeing Research and Technology (BR&T) to address Advanced Modeling and Uncertainty Quantification for Flight Dynamics (VSST1-7). The scope of the effort is to develop and evaluate advanced multidisciplinary flight dynamics modeling techniques, including integrated uncertainties, to facilitate higher fidelity response characterization of current and future aircraft configurations approaching and during loss-of-control conditions. This approach is to incorporate multiple flight dynamics modeling methods for aerodynamics, structures, and propulsion, including experimental, computational, and analytical. Also to be included are techniques for data integration and uncertainty characterization and quantification. This research shall introduce new and updated multidisciplinary modeling and simulation technologies designed to improve the ability to characterize airplane response in off-nominal flight conditions. The research shall also introduce new techniques for uncertainty modeling that will provide a unified database model comprised of multiple sources, as well as an uncertainty bounds database for each data source such that a full vehicle uncertainty analysis is possible even when approaching or beyond Loss of Control boundaries. Methodologies developed as part of this research shall be instrumental in predicting and mitigating loss of control precursors and events directly linked to causal and contributing factors, such as stall, failures, damage, or icing. The tasks will include utilizing the BR&T Water Tunnel to collect static and dynamic data to be compared to the GTM extended WT database, characterizing flight dynamics in off-nominal conditions, developing tools for structural load estimation under dynamic conditions, devising methods for integrating various modeling elements into a real-time simulation capability, generating techniques for uncertainty modeling that draw data from multiple modeling sources, and providing a unified database model that includes nominal plus increments for each flight condition. This paper presents status of testing in the BR&T water tunnel and analysis of the resulting data and efforts to characterize these data using alternative modeling methods. Program challenges and issues are also presented.

Hyde, David C.↗
NASA NTRS2003

First Year Wilkinson Microwave Anisotropy Probe(WMAP) Observations: Data Processing Methods and Systematic Errors Limits

We describe the calibration and data processing methods used to generate full-sky maps of the cosmic microwave background (CMB) from the first year of Wilkinson Microwave Anisotropy Probe (WMAP) observations. Detailed limits on residual systematic errors are assigned based largely on analyses of the flight data supplemented, where necessary, with results from ground tests. The data are calibrated in flight using the dipole modulation of the CMB due to the observatory's motion around the Sun. This constitutes a full-beam calibration source. An iterative algorithm simultaneously fits the time-ordered data to obtain calibration parameters and pixelized sky map temperatures. The noise properties are determined by analyzing the time-ordered data with this sky signal estimate subtracted. Based on this, we apply a pre-whitening filter to the time-ordered data to remove a low level of l/f noise. We infer and correct for a small (approx. 1 %) transmission imbalance between the two sky inputs to each differential radiometer, and we subtract a small sidelobe correction from the 23 GHz (K band) map prior to further analysis. No other systematic error corrections are applied to the data. Calibration and baseline artifacts, including the response to environmental perturbations, are negligible. Systematic uncertainties are comparable to statistical uncertainties in the characterization of the beam response. Both are accounted for in the covariance matrix of the window function and are propagated to uncertainties in the final power spectrum. We characterize the combined upper limits to residual systematic uncertainties through the pixel covariance matrix.

Hinshaw, G.↗
NASA NTRS1990

An application of multiattribute decision analysis to the Space Station Freedom program. Case study: Automation and robotics technology evaluation

The results are described of an application of multiattribute analysis to the evaluation of high leverage prototyping technologies in the automation and robotics (A and R) areas that might contribute to the Space Station (SS) Freedom baseline design. An implication is that high leverage prototyping is beneficial to the SS Freedom Program as a means for transferring technology from the advanced development program to the baseline program. The process also highlights the tradeoffs to be made between subsidizing high value, low risk technology development versus high value, high risk technology developments. Twenty one A and R Technology tasks spanning a diverse array of technical concepts were evaluated using multiattribute decision analysis. Because of large uncertainties associated with characterizing the technologies, the methodology was modified to incorporate uncertainty. Eight attributes affected the rankings: initial cost, operation cost, crew productivity, safety, resource requirements, growth potential, and spinoff potential. The four attributes of initial cost, operations cost, crew productivity, and safety affected the rankings the most.

Smith, Jeffrey H.↗
DOE OSTI2022

Event‐Based Training in Label‐Limited Regimes

Abstract The distribution of attributes assigned using data on independent sensors for a specific source, for example, magnitude, can be richly descriptive for final event characterization and associated uncertainty. Attribute distributions can also provide powerful context for event characterization in the absence of comprehensive annotation. This work develops a way to leverage distributional information across a set of sensors in the absence of comprehensive annotation as a domain‐informed regularization term applied during gradient‐based learning. The regularization term is the basis of event‐based training which I show can be a powerful semi‐supervised learning (SSL) approach. I first use a simple feed forward neural network and a toy data set to outline how data set structure interacts with the assumptions inherent to many semi‐supervised learning approaches. I then demonstrate the effectiveness of event‐based training using a deep convolutional neural network for seismic event classification in Utah, which increases SSL accuracy from 92% to 97% on event classification with a limited number of training labels.

Linville, Lisa M.↗
NASA NTRSDate not supplied

A NASA GISTEMP Observational Uncertainty Ensemble: Regional and Monthly Uncertainty

The historical global temperature record is an essential data product for quantifying the variability and change of the Earth system. In recent years, better characterization of observational uncertainty in global and hemispheric trends has become available, but the methodologies are not necessarily applicable to analyses at smaller regional areas, or monthly means, where station sparsity and other systematic issues contribute to greater uncertainty. This work details a gridded uncertainty ensemble of historical temperature anomalies from the Goddard Institute for Space Studies (GISS) Surface Temperature product (GISTEMP) product. This ensemble characterizes the complex spatial and temporal correlation structure of uncertainty in gridded historical temperature, enabling proper uncertainty propagation for climate and social science at regional and monthly scales. This work details the methodology for generating the uncertainty ensemble, key statistics of the uncertainty evolution over space and time, and provides best practices for using the uncertainty ensemble in future studies. Summary statistics from the uncertainty ensemble are in good agreement with production GISTEMP. Two applications of the uncertainty ensemble are also presented. First, the warmest year on record is shown to most likely be 2016 with a 53.2% chance and 2020 as the second most likely with a 44.4% chance. Second, it is shown that the arctic is warming 2.5 - 5 times faster than the globe, significantly faster than the regularly quoted twice as fast.

GISTEMP↗
NASA NTRS2003

Representativeness Uncertainty in Chemical Data Assimilation Highlight Mixing Barriers

When performing chemical data assimilation the observational, representativeness, and theoretical uncertainties have very different characteristics. In this study we have accurately characterized the representativeness uncertainty by studying the probability distribution function (PDF) of the observations. The average deviation has been used as a measure of the width of the PDF and of the variability (representativeness uncertainty) for the grid cell. It turns out that for long-lived tracers such as N2O and CH4 the representativeness uncertainty is markedly different from the observational uncertainty and clearly delineates mixing barriers such as the polar vortex edge, the tropical pipe and the tropopause.

Lary, David John↗
NASA NTRS2024

The Activity Profiles and Peak Flux of Radar Meteor Showers

Meteor showers are transient phenomena; a limited duration is what distinguishes a shower from a sporadic source. They do not, however, have clear start and end times; instead, shower activity gradually (or rapidly) increases over time, reaches a peak, and then decays. In this report, we examine the activity profiles of 38 meteor showers using 20 years of single-station shower fluxes from the Canadian Meteor Orbit Radar (CMOR). We find that a number of showers, such as the Southern delta Aquariids (SDAs), exhibit a broad maximum in activity rather than a sharp peak. We also find that approximately one-third of showers exhibit asymmetric activity profiles in which the rate in which activity rises prior to the peak differs from the rate at which it decays after the peak. We provide a functional form for meteor shower activity profiles that incorporates these features and use these profile fits to estimate each shower’s peak flux. This report also includes an uncertainty analysis for CMOR fluxes. This includes the first (to our knowledge) characterization of systematic uncertainty in radar meteor fluxes.

A V Moorhead↗
DOE OSTI2020

Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a sampling-based approach that has widely used for quantification and propagation of uncertainties. However, the standard MC method is often time-consuming if the simulation-based model is computationally intensive. This article gives an overview of modern MC methods to address the existing challenges of the standard MC in the context of UQ. Specifically, multilevel Monte Carlo (MLMC) extending the concept of control variates achieves a significant reduction of the computational cost by performing most evaluations with low accuracy and corresponding low cost, and relatively few evaluations at high accuracy and corresponding high cost. Multifidelity Monte Carlo (MFMC) accelerates the convergence of standard Monte Carlo by generalizing the control variates with different models having varying fidelities and varying computational costs. Multimodel Monte Carlo method (MMMC), having a different setting of MLMC and MFMC, aims to address the issue of UQ and propagation when data for characterizing probability distributions are limited. Multimodel inference combined with importance sampling is proposed for quantifying and efficiently propagating the uncertainties resulting from small data sets. All of these three modern MC methods achieve a significant improvement of computational efficiency for probabilistic UQ, particularly uncertainty propagation. Finally, an algorithm summary and the corresponding code implementation are provided for each of the modern MC methods. The extension and application of these methods are discussed in detail.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Large Ensemble Exploration of Global Energy Transitions Under National Emissions Pledges

Global climate goals require a transition to a deeply decarbonized energy system. Meeting the objectives of the Paris Agreement through countries' nationally determined contributions and long-term strategies represents a complex problem with consequences across multiple systems shrouded by deep uncertainty. Robust, large-ensemble methods and analyses mapping a wide range of possible future states of the world are needed to help policymakers design effective strategies to meet emissions reduction goals. This study contributes a scenario discovery analysis applied to a large ensemble of 5,760 model realizations generated using the Global Change Analysis Model. Eleven energy-related uncertainties are systematically varied, representing national mitigation pledges, institutional factors, and techno-economic parameters, among others. The resulting ensemble maps how uncertainties impact common energy system metrics used to characterize national and global pathways toward deep decarbonization. Results show globally consistent but regionally variable energy transitions as measured by multiple metrics, including electricity costs and stranded assets. Larger economies and developing regions experience more severe economic outcomes across a broad sampling of uncertainty. The scale of CO 2 removal globally determines how much the energy system can continue to emit, but the relative role of different CO 2 removal options in meeting decarbonization goals varies across regions. Previous studies characterizing uncertainty have typically focused on a few scenarios, and other large-ensemble work has not (to our knowledge) combined this framework with national emissions pledges or institutional factors. Our results underscore the value of large-ensemble scenario discovery for decision support as countries begin to design strategies to meet their goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2019

Anthropogenic Nitrogen Inputs and Impacts on Oceanic N2O Fluxes in the Northern Indian Ocean: the Need for an Integrated Observation and Modelling Approach

Anthropogenically-derived nitrogen input to the northern Indian Ocean has increased significantly in recent decades, based on both observational and model derived estimates This external nutrient source is supplied by atmospheric deposition and riverine fluxes, and has the potential to affect the vulnerable biogeochemical systems of the Arabian Sea and Bay of Bengal, influencing productivity and oceanic production of the greenhouse-gas nitrous-oxide (N2O). We summarize current estimates of this external nitrogen source to the northern Indian Ocean from observations and models, highlight implications for regional marine N2O emissions using model-based analyses, and make recommendations for measurement and model needs to improve current estimates and future predictions of this impact. Current observationally-derived estimates of deposition and riverine nitrogen inputs are limited by sparse measurements and uncertainties on accurate characterization of nitrogen species composition. Ocean model assessments of the impact of external nitrogen sources on regional marine N2O production in the northern Indian Ocean estimate potentially significant changes but also have large associated uncertainties. We recommend an integrated program of basin-wide measurements combined with high-resolution modeling and more detailed characterization of nitrogen-cycle process to address these uncertainties and improve current estimates and predictions.

Parvadha Suntharalingam↗
NASA NTRS2016

Assessment of MODIS RSB Detector Uniformity Using Deep Convective Clouds

For satellite sensor, the striping observed in images is typically associated with the relative multiple detector gain difference derived from the calibration. A method using deep convective cloud (DCC) measurements to assess the difference among detectors after calibration is proposed and demonstrated for select reflective solar bands (RSBs) of the Moderate Resolution Imaging Spectroradiometer (MODIS). Each detector of MODIS RSB is calibrated independently using a solar diffuser (SD). Although the SD is expected to accurately characterize detector response, the uncertainties associated with the SD degradation and characterization result in inadequacies in the estimation of each detector's gain. This work takes advantage of the DCC technique to assess detector uniformity and scan mirror side difference for RSB. The detector differences for Terra MODIS Collection 6 are less than 1% for bands 1, 3-5, and 18 and up to 2% for bands 6, 19, and 26. The largest difference is up to 4% for band 7. Most Aqua bands have detector differences less than 0.5% except bands 19 and 26 with up to 1.5%. Normally, large differences occur for edge detectors. The long-term trending shows seasonal oscillations in detector differences for some bands, which are correlated with the instrument temperature. The detector uniformities were evaluated for both unaggregated and aggregated detectors for MODIS band 1 and bands 3-7, and their consistencies are verified. The assessment results were validated by applying a direct correction to reflectance images. These assessments can lead to improvements to the calibration algorithm and therefore a reduction in striping observed in the calibrated imagery.

Clouds↗
NASA NTRS2017

Methods for Probabilistic Uncertainty Analysis and Bayesian Analysis with Examples of Statistically Analyzing Data to Revise MMOD Risk Estimates and Compare Models

Probabilistic methods are presented for characterizing and quantifying uncertainties in models and model predictions. Techniques are given for constructing specific uncertainty distributions based on available information. Alternative techniques are given for propagating uncertainties in model inputs to obtain the uncertainty in the model result or prediction. Bayesian techniques are also described for utilizing data and information to update and revise model results and predictions. The focus is on applications with numerous specific examples given. The use of data to revise Micrometeoroid and Orbital Debris (MMOD) risk prediction models are among the examples given.

Risk↗
DOE OSTI2023

Geophysical Constraints on Decarbonized Systems—Building Spatio-Temporal Uncertainties into Future Electricity Grid Planning

Future electricity grids will be characterized by the high penetration of renewables to support the decarbonization process. Yet, this transition will further expose grids to a broad spectrum of geophysical forces, such as weather and climate, land and space, minerals and materials. Understanding their role is thus important to support the grid decarbonization process. Here, we synthesize the current body of knowledge on the relationship between geophysical constraints and electricity grid planning. Additionally, we show that there have been promising advances in the data, methods, and modelling tools needed to incorporate the effect of geophysical constraints on demand, resource availability, and grid operations. There are, however, multiple research avenues that deserve further attention. More system-specific and finer-scale analyses are necessary to better understand how spatio-temporal variability---and associated uncertainty---in geophysical forces affect grid planning. Moreover, we need a broader focus on the multi-sectoral implications of grid decarbonization efforts, so as to limit the risk of unintended consequences. Importantly, all these efforts are challenged by the computational requirements of existing power system models, which often limit our ability to characterize uncertainty, scale analyses across larger domains, or study the multi-sector implications of grid expansion decisions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Gaussian Process Modeling For Experimental Procedure Uncertainty

Many laboratory experiments generate data that are characterized by a form of uncertainty that differs from noise: experimental procedure uncertainty. The origin of this type of uncertainty is the difficulty in controlling a subset of experimental conditions in such a way that the experiment is perfectly reproducible within noise. In this report, we describe a Gaussian Process modeling-based method that accounts for experimental procedure uncertainty. The method accounts for variations in conditions from experiment to experiment that are independent between experiments, but correlated within each experiment, and incorporates the resulting uncertainty into predictions at future experimental settings. The method is discussed in the context of a specific chemistry application in which Raman scattering spectra are measured from three-component mixtures.

42 ENGINEERING↗