Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Assessment of Laminar, Convective Aeroheating Prediction Uncertainties for Mars-Entry Vehicles

An assessment of computational uncertainties is presented for numerical methods used by NASA to predict laminar, convective aeroheating environments for Mars-entry vehicles. A survey was conducted of existing experimental heat transfer and shock-shape data for high-enthalpy reacting-gas CO2 flows, and five relevant test series were selected for comparison with predictions. Solutions were generated at the experimental test conditions using NASA state-of-the-art computational tools and compared with these data. The comparisons were evaluated to establish predictive uncertainties as a function of total enthalpy and to provide guidance for future experimental testing requirements to help lower these uncertainties.

Hollis, Brian R.↗
NASA NTRS2016

Operational Implementation of a Pc Uncertainty Construct for Conjunction Assessment Risk Analysis

Earlier this year the NASA Conjunction Assessment and Risk Analysis (CARA) project presented the theoretical and algorithmic aspects of a method to include the uncertainties in the calculation inputs when computing the probability of collision (Pc) between two space objects, principally uncertainties in the covariances and the hard-body radius. The output of this calculation approach is to produce rather than a single Pc value an entire probability density function that will represent the range of possible Pc values given the uncertainties in the inputs and bring CA risk analysis methodologies more in line with modern risk management theory. The present study provides results from the exercise of this method against an extended dataset of satellite conjunctions in order to determine the effect of its use on the evaluation of conjunction assessment (CA) event risk posture. The effects are found to be considerable: a good number of events are downgraded from or upgraded to a serious risk designation on the basis of consideration of the Pc uncertainty. The findings counsel the integration of the developed methods into NASA CA operations.

assessment↗
DOE OSTI2026

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Lidar Simulations of Backscatter and Extinction Uncertainty Estimates for ACCP Assessments

As part of the NASA Aerosols and Clouds, Convection, and Precipitation (ACCP) pre-formulation study, several lidar instruments are being assessed for their capabilities in advancing the science objectives enumerated in the most recent Earth Sciences Decadal Survey. These assessments are conducted using the NASA Langley Research Center(LaRC) lidar simulator, which produces profiles of backscatter and extinction uncertainty estimates for a given set of input parameters. Specifically, attention is focused onevaluating the science benefits and improvements of a candidate two-wavelength space-based High Spectral Resolution Lidar (HSRL) compared to an elastic backscatter lidar with similar capabilities to the Cloud-Aerosol Lidar with Orthogonal Polarization(CALIOP), flying aboard the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite. In this talk, simulations of satellite-based HSRL and those of a CALIOP-like system are compared for different atmospheric scenes that capture varying total aerosol loadings, aerosol vertical distributions, and aerosol types.The results of these analyses are presented as functions of averaging resolution(horizontal/vertical), lighting conditions (daytime/nighttime), surface type (land/ocean),and wavelength (532 nm/1064 nm). Also, simulations of multiple aerosol layers and of aerosols beneath transparent cirrus clouds are shown to demonstrate the consequent impacts on underlying backscatter and extinction uncertainties, and to better differentiate the performance of HSRL compared to that of CALIOP for real-world atmospheric scenarios.

Travis D. Toth↗
DOE OSTI2023

Understanding the Uncertainty in the Technical Performance Level Assessment for Wave Energy

In recent years, the design and development of wave energy converters (WECs) has been explored with intense interest, with highly varying design concepts emerging globally across both research enterprises and industry. The design space for WECs is vast - many concepts ranging in functionality, control systems, power development systems, materials, and scale have been ideated and prototyped, but WEC technology has yet to converge. One critical element of the technology trajectory that governs the speed of adoption is the performance of a WEC concept. In analogous but more-established industries (such as aerospace, and environmentally sustainable electronics design), performance assessment is a quantitative method, based on historical data, that is used as an iterative tool to improve the design of these systems early on in the design process. Though more nascent than these approaches, in wave energy R&D, WEC performance has been assessed using the Technology Performance Level (TPL) assessment, which provides designers with a quantitative score, situating a grid-scale WEC concept on a scale from 1-9 (1 being the lowest performance, and 9 being the highest, trending with the oft-used Technology Readiness Level, or TRL). The TPL assessment is designed to be used during design iteration, when a WEC concept is fully ideated, to enable designers to consider potential means of improving the downstream performance of the concept. One concern that may be slowing the adoption of TPL among WEC developers is the inherent uncertainty in the assessment, and how uncertainty in the individual questions asked as part of the assessment may contribute to perceived inaccuracies in the final score. In this work, we explore the uncertainty present in the assessment and quantify this uncertainty using both traditional mathematical operations and a Monte Carlo simulation. Results imply areas of improvement of the TPL assessment, where reducing uncertainty will be most helpful to end users, enabling both TPL practitioners and users to understand with more accuracy those design elements that can be improved to impact device performance most substantively.

techno-economic analysis↗
NASA NTRS2004

Aerosol Absorption in the Atmosphere: Perspectives from Global Model, Ground-Based Measurements, and Field Observations

Aerosol absorption in the atmosphere poses a major uncertainty in assessing the aerosol climate effects. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, and our limited knowledge of aerosol mixing state and optical properties. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt. We compare the model calculated total aerosol optical thickness, extinction, and absorption with those quantities from the ground-based sun photometer measurements from AERONET at several different wavelengths and the field observations from ACE-Asia. We will examine the most sensitive factors in determining the aerosol absorption, and the consequences of assessing the aerosol radiative forcing and atmospheric heating associated with those factors.

Chin, Main↗
NASA NTRS2004

Aerosol Absorption in the Atmosphere: Perspectives from Global Model, Ground-Based Measurements, and Field Observations

Aerosol absorption in the atmosphere poses a major uncertainty in assessing the aerosol climate effects. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, and our limited knowledge of aerosol mixing state and optical properties. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt. We compare the model calculated total aerosol optical thickness, extinction, and absorption with those quantities from the ground-based sun photometer measurements from AERONET, satellite retrievals from the TOMS instrument, and field observations from ACE-Asia. We will examine the most sensitive factors in determining the aerosol absorption. and the consequences of assessing the aerosol radiative forcing and atmospheric heating associated with those factors.

Chin, Mian↗
NASA NTRS2003

Aerosol Absorption in the Atmosphere: Perspectives from Global Model, Ground-Based Measurements, and Field Observations

Aerosol absorption in the atmosphere poses a major uncertainty in assessing the aerosol climate effects. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, and our limited knowledge of aerosol mixing state and optical properties. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt. We compare the model calculated total aerosol optical thickness, extinction, and absorption with those quantities from the ground-based sun photometer measurements from AERONET at several different wavelengths and the field observations from ACE-Asia. We will examine what are the most sensitive factors in determining the aerosol absorption, and the consequences of assessing the aerosol radiative forcing and atmospheric heating associated with those factors.

Chin, Mian↗
NASA NTRS2003

Aerosol Absorption in the Atmosphere: Perspectives from Global Model, Ground-Based Measurements, and Field Observations

Aerosol absorption in the atmosphere poses a major uncertainty in assessing the aerosol climate effects. This uncertainty arises from the poorly quantified aerosol sources, especially black carbon emissions, and our limited knowledge of aerosol mixing state and optical properties. Here we use a global model GOCART to simulate atmospheric aerosols, including sulfate, black carbon, organic carbon, dust, and sea salt. We compare the model calculated total aerosol optical thickness, extinction, and absorption with those quantities from the ground-based sun photometer measurements from AERONET at several different wavelengths and the field observations from ACE-Asia. We will examine what are the most sensitive factors in determining the aerosol absorption, and the consequences of assessing the aerosol radiative forcing and atmospheric heating associated with those factors.

Chin, Mian↗
DOE OSTI2023

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Uncertainty quantification and reliability assessment for intermodal freight transportation

Intermodal freight optimization models support cost-effective, low-emission, and timely goods movement by coordinating trucks, rail, and barges. These models determine optimal flows, routing, and modal switches while respecting infrastructure and operational constraints. However, their real-world utility is often undermined by pervasive uncertainties-such as fluctuating transportation costs and emissions, variable terminal capacities, and uncertain freight demand-that distort key performance outcomes, including total system cost, carbon footprint, and transit time reliability. This study presents a structured framework for quantifying uncertainty in intermodal freight transportation (IFT) optimization. The framework evaluates how input uncertainty affects system performance and reliability, a critical need for ensuring that model-based decisions remain robust under real-world variability, especially amid volatile fuel prices, shifting demand, and growing disruptions. It integrates three complementary methods: (1) Sobol-based global sensitivity analysis to identify influential parameters affecting cost, emissions, and transit time, (2) Monte Carlo-based capacity perturbation analysis to assess robustness under probabilistic facility disruptions, and (3) Monte Carlo filtering with Bayesian inference to detect threshold-based performance vulnerabilities. The results highlight diesel truck unit cost as the dominant driver of variability. To improve system resilience, planners should prioritize uncertainty in fuel-related parameters when designing intermodal strategies.

Intermodal freight transportation↗
DOE OSTI2024

Uncertainty in determining carbon dioxide removal potential of biochar

A quantitative and systematic assessment of uncertainty in life-cycle assessment is critical to informing sustainable development of carbon dioxide removal (CDR) technologies. Biochar is the most commonly sold form of CDR to date and it can be used in applications ranging from concrete to agricultural soil amendments. Previous analyses of biochar rely on modeled or estimated life-cycle data and suggest a cradle-to-gate range of 0.20–1.3 kg CO 2 net removal per kg of biomass feedstock, with the range reported driven by differences in energy consumption, pyrolysis temperature, and feedstock sourcing. Herein, we quantify the distribution of CDR possible for biochar production with a compositional life-cycle inventory model paired with scenario-aware Monte Carlo simulation in a 'best practice' (incorporating lower transportation distances, high pyrolysis temperatures, high energy efficiency, recapture of energy for drying and pyrolysis energy requirements, and co-generation of heat and electricity) and 'poor practice' (higher transportation distances, lower pyrolysis temperatures, low energy efficiency, natural gas for energy requirements, and no energy recovery) scenarios. In the best-practice scenario, cradle-to-gate CDR (which is representative of the upper limit of removal across the entire life cycle) is highly certain, with a median removal of 1.4 kg of CO 2 e/kg biomass and results in net removal across the entire distribution. In contrast, the poor-practice scenario results in median net emissions of 0.090 kg CO 2 e/kg biomass. Whether this scenario emits (66% likelihood) or removes (34% likelihood) carbon dioxide is highly uncertain. The emission intensity of energy inputs to the pyrolysis process and whether the bio-oil co-product is used as a chemical feedstock or combusted are critical factors impacting the net carbon dioxide emissions of biochar production, together responsible for 98% of the difference between the best- and poor-practice scenarios.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Accounting for Epistemic Uncertainty in Mission Supportability Assessment: A Necessary Step in Understanding Risk and Logistics Requirements

Future crewed missions to Mars present a maintenance logistics challenge that is unprecedented in human spaceflight. Mission endurance – defined as the time between resupply opportunities – will be significantly longer than previous missions, and therefore logistics planning horizons are longer and the impact of uncertainty is magnified. Maintenance logistics forecasting typically assumes that component failure rates are deterministically known and uses them to represent aleatory uncertainty, or uncertainty that is inherent to the process being examined. However, failure rates cannot be directly measured; rather, they are estimated based on similarity to other components or statistical analysis of observed failures. As a result, epistemic uncertainty – that is, uncertainty in knowledge of the process – exists in failure rate estimates that must be accounted for. Analyses that neglect epistemic uncertainty tend to significantly underestimate risk. Epistemic uncertainty can be reduced via operational experience; for example, the International Space Station (ISS) failure rate estimates are refined using a Bayesian update process. However, design changes may re-introduce epistemic uncertainty. Thus, there is a tradeoff between changing a design to reduce failure rates and operating a fixed design to reduce uncertainty. This paper examines the impact of epistemic uncertainty on maintenance logistics requirements for future Mars missions, using data from the ISS Environmental Control and Life Support System (ECLS) as a baseline for a case study. Sensitivity analyses are performed to investigate the impact of variations in failure rate estimates and epistemic uncertainty on spares mass. The results of these analyses and their implications for future system design and mission planning are discussed.

Owens, Andrew↗
DOE OSTI2024

A Refined Method to Translate Solar Data Quality Assessment Flags to Estimated Measurement Uncertainty

Integrating solar resource uncertainties due to radiometer measurement performance and operational data quality assessment can provide improved estimates of economic bankability, system design performance, and compliance of solar energy conversion systems. Estimating radiometer measurement uncertainty is an established procedure consistent with recognized best practices and international guidelines. SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report, the fourth of six for the Data Quality and Uncertainty Integration Project, presents a refined algorithm description for software to translate solar resource data quality assessment results into estimated uncertainty values in a Solar Resource Operational Uncertainty Integrator (SROUI) application. This algorithm requires three-component solar irradiance measurements - global horizontal irradiance, direct normal irradiance, and diffuse horizontal irradiance - collected at 1- to 60-minute intervals, as described in the previous deliverables. The development of this report as Deliverable 6.4 was an iterative process that included reviews and feedback from the project team on initial drafts designed to refine how the new software could best support determining solar resource data uncertainty. The results of this effort will contribute to the final software system development by National Renewable Energy Laboratory staff.

14 SOLAR ENERGY↗
DOE OSTI2021

Assessing boundary condition and parametric uncertainty in numerical-weather-prediction-modeled, long-term offshore wind speed through machine learning and analog ensemble

To accurately plan and manage wind power plants, not only does the time-varying wind resource at the site of interest need to be assessed but also the uncertainty connected to this estimate. Numerical weather prediction (NWP) models at the mesoscale represent a valuable way to characterize the wind resource offshore, given the challenges connected with measuring hub-height wind speed. The boundary condition and parametric uncertainty associated with modeled wind speed is often estimated by running a model ensemble. However, creating an NWP ensemble of long-term wind resource data over a large region represents a computational challenge. Here, we propose two approaches to temporally extrapolate wind speed boundary condition and parametric uncertainty using a more convenient setup in which a mesoscale ensemble is run over a short-term period (1 year), and only a single model covers the desired long-term period (20 year). We quantify hub-height wind speed boundary condition and parametric uncertainty from the short-term model ensemble as its normalized across-ensemble standard deviation. Then, we develop and apply a gradient-boosting model and an analog ensemble approach to temporally extrapolate such uncertainty to the full 20-year period, for which only a single model run is available. As a test case, we consider offshore wind resource characterization in the California Outer Continental Shelf. Both of the proposed approaches provide accurate estimates of the long-term wind speed boundary condition and parametric uncertainty across the region (R 2 >0.75), with the gradient-boosting model slightly outperforming the analog ensemble in terms of bias and centered root-mean-square error. At the three offshore wind energy lease areas in the region, we find a long-term median hourly uncertainty between 10 % and 14 % of the mean hub-height wind speed values. Finally, we assess the physical variability in the uncertainty estimates. In general, we find that the wind speed uncertainty increases closer to land. Also, neutral conditions have smaller uncertainty than the stable and unstable cases, and the modeled wind speed in winter has less boundary condition and parametric sensitivity than summer.

17 WIND ENERGY↗
DOE OSTI2026

Biases in preconstruction estimates of wind plant annual energy production

Estimating the energy yield of a wind plant during the preconstruction phase is a historically difficult task, even with industry improvements in these estimations. We build on prior research comparing the realized energy production of wind plants and their estimated annual energy production P50 values (median energy production), using owner-provided energy production and losses. We produced similar results to prior studies but with a slightly increasing bias of overestimating median energy production (a bias between realized and estimated energy production of −7.4 % to −6.6 %, depending on the scenario, as opposed to −6.7 % to −5.5 % from earlier studies). In addition to assessing annual energy production P50 bias, we compared both the 1-year and the long-term annual energy production P90 and uncertainty energy yield assessment estimates to the observed long-term-corrected energy production. We found that neither the energy yield assessment uncertainty nor the P90 is conservative enough compared to the observed distribution of prediction errors, suggesting significant room for improvement in the energy yield assessment process.

17 WIND ENERGY↗
DOE OSTI2025

Uncertainty in inventories for life cycle assessment: State‐of‐the‐art, challenges, and new technologies

Uncertainty is a critical factor that can hinder the quality and potential applications of life cycle assessment (LCA) results. A prominent source of uncertainty stems from the life cycle inventory (LCI) data. Various methodologies exist to estimate the uncertainty associated with LCI data, primarily based on the widely used structured pedigree matrix approach or the computationally intensive Monte Carlo simulation. This perspective review explores how new technologies (e.g., computational algorithms and data collection methods) from data science and related fields can contribute to identifying, quantifying, and reducing uncertainty in LCI modeling. A brief overview of the sources of uncertainty in LCI modeling and how they are addressed in current LCA practice is provided. Additionally, several new technologies are identified, and the potential benefits of their implementation in reducing uncertainties in LCI modeling are discussed. This perspective review concludes by identifying potential areas that require further development for these technologies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗