Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Characterizing the Uncertainty of Measurement of Traceable Isotope Ratios with Bayesian Statistical Techniques

Analytical techniques such as multicollector—inductively coupled plasma—mass spectrometry (MC-ICP-MS) are routinely employed at SRNL, other National Laboratories, and in academia to determine the precise isotopic composition of diverse natural and anthropogenic samples (e.g., rocks and nuclear materials). Quantifying and reporting uncertainty in such analyses, while regularly performed, have a rigorous statistical foundation. The Guide to the Expression of Uncertainty in Measurement 4 (GUM) outlines conventional techniques used to assess such uncertainty. As the accessibility and speed of statistical computing increase, there is a need to modernize conventional techniques. For example, Supplement 1 to the 3rd to the GUM suggests the use of approximation methods as an updated approach to the GUM.

McLarty, Ellis C.↗
NASA NTRS2003

Aerosol Sources, Absorption, and Intercontinental Transport: Synergies among Models, Remote Sensing, and Atmospheric Measurements

Aerosol climate forcing is one of the largest uncertainties in assessing the anthropogenic impact on the global climate system. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, our limited knowledge of aerosol mixing state and optical properties, and the consequences of intercontinental transport of aerosols and their precursors. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt, from anthropogenic, biomass burning, and natural sources. We compare the model calculated aerosol extinction and absorption with those quantities from the ground-based sun photometer measurements from AERONET at several different wavelengths and the field observations from ACE-Asia, and model calculated total aerosol optical depth and fine mode fractions with the MODIS satellite retrieval. We will also estimate the intercontinental transport of pollution and dust aerosols from their source regions to other areas in different seasons.

Chin, Mian↗
NASA NTRS2004

Aerosol Sources, Absorption, and Intercontinental Transport: Synergies Among Models, Remote Sensing, and Atmospheric Measurements

Aerosol climate forcing is one of the largest uncertainties in assessing the anthropogenic impact on the global climate system. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, our limited knowledge of aerosol mixing state and optical properties, and the consequences of intercontinental transport of aerosols and their precursors. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt, from anthropogenic, .biomass burning, and natural sources. We compare the model calculated aerosol extinction and absorption with those quantities from the ground-based sun photometer measurements from AERON" at several different wavelengths and the field observations from ACE-Asia, and model calculated total aerosol optical depth and fine mode fractions with the MODIS satellite retrieval. We will also estimate the intercontinental transport of pollution and dust aerosols from their source regions to other areas in different seasons.

Chin, Mian↗
NASA NTRSDate not supplied

Exploring Radiation, Water and Energy Closure in Key Deep Tropical Regions Over the Last 3 Decades

The closure of global energy and water budgets at various time scales depends heavily upon the on the processes of water and energy exchange in the deep tropics. A key process observed is the change in convection regimes from disorganized convection to organized deep convection. During these periods an imbalance in key tropical regions is observed of water budget terms between observations and atmospheric reanalysis systems, implying that processes are not simulated well. For instance, periods of imbalance in the water budget may be at least partly attributed to precipitation estimates due to the transition between cloud and precipitation systems in which ice cloud affects microwave radar estimates (Lietmann-Niimi et al. 2024, submitted). A recent paper by Hsaio et al (2023, pre-published version) found that the transition process is characterized by wind shear and longwave cloud radiative feedback signatures as well. This is just one example how these processes also affect the radiative fluxes and thus the energy budget at the TOA. In this presentation, we assess the net radiative budget and components in the deep tropics by comparing multiple data products (GEWEX SRB Rel4IP, CERES EBAF/SYN1deg Ed4.2, ISSCP FH, etc.) and describing the temporal variability of energy balance terms across the deep tropics for the period from 1988 to near present in six key oceanic regions. These six key tropical oceanic regions are West Indian Ocean, the south Indian Ocean east, tropical western, central and eastern Pacific Ocean, and Tropical Atlantic Ocean. In these regions we assess the sensitivity of the fluxes as a function of fluctuations in cloud types in response to various larger scale atmospheric processes (e.g. El Niño, Indian Ocean Dipole). We assess this variability of the radiative flux anomalies (including the net TOA, surface and the atmospheric divergence fluxes) against water vapor divergence, cloud properties (include ISCCP “Weather States, Tselioudis et al. 2021) and larger scale wind shear to assess the uncertainties of energy closure in these regions. These are contrasted against the modeled radiative fluxes from ERA-5 and MERRA-2. Ocean buoy measurements of radiative fluxes are utilized to help assess data radiative flux uncertainty over the nearly 40 year period. In general, the variability for overlap periods of these various data products agrees well, but there are significant differences in the net fluxes that vary according to the rendering of surface, atmospheric, aerosol and cloud properties. These differences also affect closure terms and inferences on systematic uncertainties within the observational estimates. We conclude with recommendations for continuing work

Radiation budget↗
DOE OSTI2026

Laboratory and field assessment of mid-infrared absorption (MIRA) instrument performance for methane and ethane dry mole fractions

Concurrent measurements of methane (CH 4 ) and ethane (C 2 H 6 ) can be used to identify and separate methane sources, as ethane is present in thermogenic sources (e.g., oil and natural gas) but not in biogenic sources (e.g., agriculture). In this study, we evaluated the performance of multiple Aeris MIRA Ultra instruments (Versions 1 and 2) through controlled laboratory tests and tower-based deployments under field conditions. The systems were modified with an external pump, flow control, a Nafion dryer, and a custom-built auxiliary box to automate the system and transmit near real-time data. We determined the best calibration approach for our application, given practical limitations, to be a full calibration cycle (with ambient and high calibration cylinders) about once per day and an ambient calibration cylinder sampled hourly. Measurement uncertainty was assessed, including the uncertainty due to instrument noise as a function of calibration frequency, uncertainty in the water vapor correction, and cylinder assignment uncertainty. Instrument noise was the dominant source of uncertainty for C 2 H 6 , while the water vapor correction dominated the CH 4 uncertainty. For Version 2 systems with hourly calibrations and a Nafion dryer with counterflow, the mean total uncertainty, including both systematic errors and noise, of hourly averages was 0.8–3.0 ppb CH 4 and 0.35–0.37 ppb C 2 H 6 . Laboratory intercomparisons showed network compatibility within 1.2 ppb CH 4 and 0.23 ppb C 2 H6, and a collocated deployment with a NOAA Picarro system agreed within 1.8 ppb CH 4 . Instrument noise varied substantially amongst the instruments, with errors reaching up to 11 ppb CH 4 and 2 ppb C 2 H 6 for hourly means, with similar variability indicated in a 50 h cylinder test. With appropriate engineering and calibration, the Aeris MIRA Ultra has the potential to distinguish regional methane emission sources in many field settings.

03 NATURAL GAS↗
NASA NTRS2012

Shock Layer Radiation Modeling and Uncertainty for Mars Entry

A model for simulating nonequilibrium radiation from Mars entry shock layers is presented. A new chemical kinetic rate model is developed that provides good agreement with recent EAST and X2 shock tube radiation measurements. This model includes a CO dissociation rate that is a factor of 13 larger than the rate used widely in previous models. Uncertainties in the proposed rates are assessed along with uncertainties in translational-vibrational relaxation modeling parameters. The stagnation point radiative flux uncertainty due to these flowfield modeling parameter uncertainties is computed to vary from 50 to 200% for a range of free-stream conditions, with densities ranging from 5e-5 to 5e-4 kg/m3 and velocities ranging from of 6.3 to 7.7 km/s. These conditions cover the range of anticipated peak radiative heating conditions for proposed hypersonic inflatable aerodynamic decelerators (HIADs). Modeling parameters for the radiative spectrum are compiled along with a non-Boltzmann rate model for the dominant radiating molecules, CO, CN, and C2. A method for treating non-local absorption in the non-Boltzmann model is developed, which is shown to result in up to a 50% increase in the radiative flux through absorption by the CO 4th Positive band. The sensitivity of the radiative flux to the radiation modeling parameters is presented and the uncertainty for each parameter is assessed. The stagnation point radiative flux uncertainty due to these radiation modeling parameter uncertainties is computed to vary from 18 to 167% for the considered range of free-stream conditions. The total radiative flux uncertainty is computed as the root sum square of the flowfield and radiation parametric uncertainties, which results in total uncertainties ranging from 50 to 260%. The main contributors to these significant uncertainties are the CO dissociation rate and the CO heavy-particle excitation rates. Applying the baseline flowfield and radiation models developed in this work, the radiative heating for the Mars Pathfinder probe is predicted to be nearly 20 W/cm2. In contrast to previous studies, this value is shown to be significant relative to the convective heating.

Johnston, Christopher O.↗
DOE OSTI2025

Coupled Lake‐Atmosphere‐Land Physics Uncertainties in a Great Lakes Regional Climate Model

Abstract This study develops a surrogate‐based method to assess the uncertainty within a convective permitting integrated modeling system of the Great Lakes region, arising from interacting physics parameterizations across the lake, atmosphere, and land surface. Perturbed physics ensembles of the model during the 2018 summer are used to train a neural network surrogate model to predict lake surface temperature (LST) and near‐surface air temperature (T2m). Average physics uncertainties are determined to be 1.5C for LST and T2m over land, and 1.9C for T2m over lake, but these have significant spatiotemporal variations. We find that atmospheric physics parameterizations alone are the dominant sources of uncertainty (45%–53%), while lake and land parameterizations account for 33% and 38% of the uncertainty of LST and T2m over land respectively. Interactions of atmosphere physics parameterizations with those of the land and lake contribute to an additional 13%–17% of the total variance. LST and T2m over the lake are more uncertain in the deeper northern lakes, particularly during the rapid warming phase that occurs in late spring/early summer. The LST uncertainty increases with sensitivity to the lake model's surface wind stress scheme. T2m over land is more uncertain over forested areas in the north, where it is most sensitive to the land surface model, than the more agricultural land in the south, where it is most sensitive to the atmospheric planetary boundary and surface layer scheme. Uncertainty also increases in the southwest during multiday temperature declines with higher sensitivity to the land surface model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Assessing dynamic vegetation model parameter uncertainty across Alaskan arctic tundra plant communities

Abstract As the Arctic region moves into uncharted territory under a warming climate, it is important to refine the terrestrial biosphere models (TBMs) that help us understand and predict change. One fundamental uncertainty in TBMs relates to model parameters, configuration variables internal to the model whose value can be estimated from data. We incorporate a version of the Terrestrial Ecosystem Model (TEM) developed for arctic ecosystems into the Predictive Ecosystem Analyzer (PEcAn) framework. PEcAn treats model parameters as probability distributions, estimates parameters based on a synthesis of available field data, and then quantifies both model sensitivity and uncertainty to a given parameter or suite of parameters. We examined how variation in 21 parameters in the equation for gross primary production influenced model sensitivity and uncertainty in terms of two carbon fluxes (net primary productivity and heterotrophic respiration) and two carbon (C) pools (vegetation C and soil C). We set up different parameterizations of TEM across a range of tundra types (tussock tundra, heath tundra, wet sedge tundra, and shrub tundra) in northern Alaska, along a latitudinal transect extending from the coastal plain near Utqiaġvik to the southern foothills of the Brooks Range, to the Seward Peninsula. TEM was most sensitive to parameters related to the temperature regulation of photosynthesis. Model uncertainty was mostly due to parameters related to leaf area, temperature regulation of photosynthesis, and the stomatal responses to ambient light conditions. Our analysis also showed that sensitivity and uncertainty to a given parameter varied spatially. At some sites, model sensitivity and uncertainty tended to be connected to a wider range of parameters, underlining the importance of assessing tundra community processes across environmental gradients or geographic locations. Generally, across sites, the flux of net primary productivity (NPP) and pool of vegetation C had about equal uncertainty, while heterotrophic respiration had higher uncertainty than the pool of soil C. Our study illustrates the complexity inherent in evaluating parameter uncertainty across highly heterogeneous arctic tundra plant communities. It also provides a framework for iteratively testing how newly collected field data related to key parameters may result in more effective forecasting of Arctic change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

How Wrong Can the Operational AEP Uncertainty Estimate Be When We Ignore the Correlations Between the Uncertainty Components?

Calculations of wind farm annual energy production (AEP) on operational data are essential for a variety of financial transactions during the life of wind plants. The AEP estimate is associated with an uncertainty value, which is calculated by combining contributions connected to on-site measurements, long-term reference measurements, losses, regression, windiness adjustment, and wind resource interannual variability. Although very limited documentation on the topic exists, the conventional approach currently used by the wind energy community to assess the uncertainty connected to the operational AEP estimate assume that the different uncertainty components are uncorrelated and therefore calculates the overall uncertainty with a sum of squares approach. In this analysis, we contrast the traditional technique to estimate the overall AEP uncertainty by ignoring the correlation between its different components with a novel Monte Carlo based approach, which can instead take into account the correlation between different uncertainty categories. We consider monthly operational data from 472 wind farms from the Energy Information Administration (EIA) 923 database to assess the difference between the two approaches. Long-term wind speed data needed for the AEP assessment are taken from three reanalysis products: the Modern-Era Retrospective analysis for Research and Applications v2 (MERRA-2), the European Reanalysis Interim (ERA-interim), and the National Centers for Environmental Prediction v2 (NCEP-2). The results of the Monte Carlo approach show that three pairs of AEP uncertainty components do show a statistically significant correlation: the uncertainty connected with wind resource inter-annual variability is positively correlated with the one related to the windiness correction and negatively correlated with the one due to the regression, and the wind measurement uncertainty is positively correlated with the regression uncertainty. All these correlations, which are found between uncertainty components which are not only part of an operational analysis, but also of a wind resource assessment, are currently ignored in the conventional techniques used as industry standard. We further investigate the causes of these correlations, in terms of common dependencies of different uncertainty components on wind resource variability, number of data points, and quality of the regression between wind speed and energy production data. Next, we quantify the error in the current industry standard technique, in terms of the percentage difference in total uncertainty calculated with the two considered approaches, for all the analyzed wind farms. We find a mean absolute percentage difference of about 6%, with the largest differences being greater than 20%. The data clearly confirm that ignoring the actual correlation between the uncertainty components can lead to large errors in the assessment of the operational AEP uncertainty, and the proposed Monte Carlo approach should be preferred.

Monte Carlo↗
DOE OSTI2021

Data Quality of Salt Property Measurements

Data quality is a key element to assessing technical uncertainties in property values of salt mixtures that are pivotal in molten salt reactor (MSR) design and safety assessments under both normal operating conditions and accident scenarios. Key properties for the salt mixtures being evaluated for use in MSRs have not been measured and the few values for relevant salt compositions available in the literature are inconsistent and not suitable for use in licensing. The applications of established techniques commonly used for property measurements to molten salts are still experimental in nature and vetted consensus standards are not yet available. Work is in progress to develop and standardize methods through DOE and commercially funded projects. The quality of measured property values limits the current ability to reliably design equipment and model normal MSR operation and the effects of operational upsets. Insights from experimental measurements pertinent to reducing technical uncertainty for regulatory development are summarized in this report. Quality controls are recommended for key properties based on the mathematical calculations used to derive property values and methods used to measure experimental values and salt produced for use in the measurements.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

The implications of uncertain renewable resource potentials for global wind and solar electricity projections

Studies exploring long-term energy system transitions rely on resource cost-supply curves derived from estimates of renewable energy (RE) potentials to generate wind and solar power projections. However, estimates of RE potentials are characterized by large uncertainties stemming from methodological assumptions that vary across studies, including factors such as the suitability of land and the performance and configuration of technology. Based on a synthesis of modeling approaches and parameter values used in prior studies, we explore the implications of these uncertain assumptions for onshore wind and solar photovoltaic electricity generation projections globally using the Global Change Analysis Model. We show that variability in parametric assumptions related to land use (e.g. land suitability) are responsible for the most substantial uncertainty in both wind and solar generation projections. Additionally, assumptions about the average turbine installation density and turbine technology are responsible for substantial uncertainty in wind generation projections. Under scenarios that account for climate impacts on wind and solar energy, we find that these parametric uncertainties are far more significant than those emerging from differences in climate models and scenarios in a global assessment, but uncertainty surrounding climate impacts (across models and scenarios) have significant effects regionally, especially for wind. Our analysis suggests the need for studies focusing on long-term energy system transitions to account for this uncertainty.

14 SOLAR ENERGY↗
NASA NTRS2012

Remote Sensing of Tropical Ecosystems: Atmospheric Correction and Cloud Masking Matter

Tropical rainforests are significant contributors to the global cycles of energy, water and carbon. As a result, monitoring of the vegetation status over regions such as Amazonia has been a long standing interest of Earth scientists trying to determine the effect of climate change and anthropogenic disturbance on the tropical ecosystems and its feedback on the Earth's climate. Satellite-based remote sensing is the only practical approach for observing the vegetation dynamics of regions like the Amazon over useful spatial and temporal scales, but recent years have seen much controversy over satellite-derived vegetation states in Amazônia, with studies predicting opposite feedbacks depending on data processing technique and interpretation. Recent results suggest that some of this uncertainty could stem from a lack of quality in atmospheric correction and cloud screening. In this paper, we assess these uncertainties by comparing the current standard surface reflectance products (MYD09, MYD09GA) and derived composites (MYD09A1, MCD43A4 and MYD13A2 - Vegetation Index) from the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard the Aqua satellite to results obtained from the Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm. MAIAC uses a new cloud screening technique, and novel aerosol retrieval and atmospheric correction procedures which are based on time-series and spatial analyses. Our results show considerable improvements of MAIAC processed surface reflectance compared to MYD09/MYD13 with noise levels reduced by a factor of up to 10. Uncertainties in the current MODIS surface reflectance product were mainly due to residual cloud and aerosol contamination which affected the Normalized Difference Vegetation Index (NDVI): During the wet season, with cloud cover ranging between 90 percent and 99 percent, conventionally processed NDVI was significantly depressed due to undetected clouds. A smaller reduction in NDVI due to increased aerosol levels was observed during the dry season, with an inverse dependence of NDVI on aerosol optical thickness (AOT). NDVI observations processed with MAIAC showed highly reproducible and stable inter-annual patterns with little or no dependence on cloud cover, and no significant dependence on AOT (p less than 0.05). In addition to a better detection of cloudy pixels, MAIAC obtained about 20-80 percent more cloud free pixels, depending on season, a considerable amount for land analysis given the very high cloud cover (75-99 percent) observed at any given time in the area. We conclude that a new generation of atmospheric correction algorithms, such as MAIAC, can help to dramatically improve vegetation estimates over tropical rain forest, ultimately leading to reduced uncertainties in satellite-derived vegetation products globally.

tropical ecosystems↗
DOE OSTI2022

Deployment of Multifidelity Uncertainty Quantification for Thermal Battery Assessment Part I: Algorithms and Single Cell Results

This report documents the results of an FY22 ASC V&V level 2 milestone demonstrating new algorithms for multifidelity uncertainty quantification. Part I of the report describes the algorithms, studies their performance on a simple model problem, and then deploys the methods to a thermal battery example from the open literature. Part II (restricted distribution) applies the multifidelity UQ methods to specific thermal batteries of interest to the NNSA/ASC program.

25 ENERGY STORAGE↗
NASA NTRS2007

Technical Evaluation Report for Symposium AVT-147: Computational Uncertainty in Military Vehicle Design

The complexity of modern military systems, as well as the cost and difficulty associated with experimentally verifying system and subsystem design makes the use of high-fidelity based simulation a future alternative for design and development. The predictive ability of such simulations such as computational fluid dynamics (CFD) and computational structural mechanics (CSM) have matured significantly. However, for numerical simulations to be used with confidence in design and development, quantitative measures of uncertainty must be available. The AVT 147 Symposium has been established to compile state-of-the art methods of assessing computational uncertainty, to identify future research and development needs associated with these methods, and to present examples of how these needs are being addressed and how the methods are being applied. Papers were solicited that address uncertainty estimation associated with high fidelity, physics-based simulations. The solicitation included papers that identify sources of error and uncertainty in numerical simulation from either the industry perspective or from the disciplinary or cross-disciplinary research perspective. Examples of the industry perspective were to include how computational uncertainty methods are used to reduce system risk in various stages of design or development.

Radespiel, Rolf↗
NASA NTRS2002

Space Radiation Cancer Risk Projections for Exploration Missions: Uncertainty Reduction and Mitigation

In this paper we discuss expected lifetime excess cancer risks for astronauts returning from exploration class missions. For the first time we make a quantitative assessment of uncertainties in cancer risk projections for space radiation exposures. Late effects from the high charge and energy (HZE) ions present in the galactic cosmic rays including cancer and the poorly understood risks to the central nervous system constitute the major risks. Methods used to project risk in low Earth orbit are seen as highly uncertain for projecting risks on exploration missions because of the limited radiobiology data available for estimating HZE ion risks. Cancer risk projections are described as a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Monte-Carlo sampling from subjective error distributions represents the lack of knowledge in each factor to quantify risk projection overall uncertainty. Cancer risk analysis is applied to several exploration mission scenarios. At solar minimum, the number of days in space where career risk of less than the limiting 3% excess cancer mortality can be assured at a 95% confidence level is found to be only of the order of 100 days.

Cucinotta, Francis↗
DOE OSTI2022

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗