SEARCH · Search NASA

Results for “Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

All sources NASA NTRS DOE OSTI

NASA NTRS2018

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)↗

NASA NTRS2018

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗

NASA NTRSDate not supplied

Impact of Airborne Radar Uncertainties on Detect-and-Avoid Systems’ Performance

Impact of sensor uncertainty on Detect-and-Avoid (DAA) systems’ performance is investigated. Key metrics analyzed are the loss of DAA well clear ratio, the near-mid-air-collision risk ratio, the alert ratio, and the number of maneuvers per loss of DAA well clear. Sensitivity of these metrics to the magnitude of sensor uncertainty, pilots’ selection of maneuver, and surveillance range is investigated. Benefits of a dynamic buffer around the DAA well clear separation boundary, computed based on track accuracies, are also analyzed. These metrics are computed from open- and closed-loop simulations of a large number of representative encounters between an unmanned aircraft system and a manned aircraft. Results show that sensor uncertainty degrades safety metrics considerably but has only a minor effect on the number of maneuvers per loss of DAA well clear. The number of maneuvers, nonetheless, can be reduced by a 5◦ buffer away from the edge of the range of conflict-resulting heading in pilots’ selection of maneuver.

UAS↗

NASA NTRS2020

Pre-launch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 that will be on-board Landsat 9 has undergone a pre-launch testing campaign to characterize its radiometric, spectral, and spatial performance and demonstrate compliance to its requirements. This work reviews key elements of the instrument-level radiometric testing using an SI traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 on-board blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a non-linear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument’s potential for enhancing our understanding of the Earth’s environment.

Landsat↗

NASA NTRS2021

An Uncertainty Quantification Framework for Autonomous Flight System Tracking and Health Monitoring

This work proposes a perspective towards establishing a framework for uncertainty quantification of autonomous system tracking and health monitoring. The approach leverages the use of a predictive process structure, which maps uncertainty sources and their interaction according to the quantity of interest and the goal of the predictive estimation. It is systematic and uses basic elements that are system agnostic, and therefore needs to be tailored according to the specificity of the application. This work is motivated by the interest in low-altitude unmanned aerial vehicle operations, where awareness of vehicle and airspace state becomes more relevant as the density of autonomous operations grows rapidly. Predicted scenarios in the area of small vehicle operations and urban air mobility have no precedent, and holistic frameworks to perform prognostics and health management (PHM) at the system- and airspace-level are missing formal approaches to account for uncertainty. At the end of the paper, two case studies demonstrate implementation framework of trajectory tracking and health diagnosis for a small unmanned aerial vehicle. This work has been accepted for publication at the International Journal of Prognostics and Health Management Jan 2021. Minor edits have been incorporated to this original submission to incorporate complete overview and software integration.

Uncertainty Quantification↗

NASA NTRS2019

Uncertainties in the Geostationary Ocean Color Imager (GOCI) Remote Sensing Reflectance for Assessing Diurnal Variability of Biogeochemical Processes

Short-term (sub-diurnal) biological and biogeochemical processes cannot be fully captured by the current suite of polar-orbiting satellite ocean color sensors, as their temporal resolution is limited to potentially one clear image per day. Geostationary sensors, such as the Geostationary Ocean Color Imager (GOCI) from the Republic of Korea, allow the study of these short-term processes because their orbit permit the collection of multiple images throughout each day for any area within the sensor’s field of regard. Assessing the capability to detect sub-diurnal changes in in-water properties caused by physical and biogeochemical processes characteristic of open ocean and coastal ocean ecosystems, however, requires an understanding of the uncertainties introduced by the instrument and/or geophysical retrieval algorithms. This work presents a study of the uncertainties during the daytime period for an ocean region with characteristically low-productivity with the assumption that only small and undetectable changes occur in the in-water properties due to biogeochemical processes during the daytime period. The complete GOCI mission data were processed using NASA’s SeaDAS/l2gen package. The assumption of homogeneity of the study region was tested using three-day sequences and diurnal statistics. This assumption was found to hold based on the minimal diurnal and day-to-day variability in GOCI data products. Relative differences with respect to the midday value were calculated for each hourly observation of the day in order to investigate what time of the day the variability is greater. Also, the influence of the solar zenith angle in the retrieval of remote sensing reflectances and derived products was examined. Finally, we determined that the uncertainties in water-leaving “remote-sensing” reflectance (Rrs) for the 412, 443, 490, 555, 660 and 680 nm bands on GOCI are 8.05 × 10−4, 5.49 × 10−4, 4.48 × 10−4, 2.51 × 10−4, 8.83 × 10−5, and 1.36 × 10−4 sr−1, respectively, and 1.09 × 10−2 mg m−3 for the chlorophyll-a concentration (Chl-a), 2.09 × 10−3 m−1 for the absorption coefficient of chromophoric dissolved organic matter at 412 nm (ag (412)), and 3.7 mg m−3 for particulate organic carbon (POC). These Rrs values can be considered the threshold values for detectable changes of the in-water properties due to biological, physical or biogeochemical processes from GOCI.

Geostationary Ocean Color Imager (GOCI)↗

NASA NTRS2021

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗

NASA NTRSDate not supplied

Applicability of a Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

As improvements are made to the accuracy and reliability of modeling and simulation techniques, certification by analysis becomes a more attractive alternative compared to traditional aircraft flight testing. Certification by analysis is especially cost-effective when one considers modifications to a previously certified aircraft. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. A framework for estimating the performance and associated uncertainty was introduced in an earlier paper. The factors and limitations of this framework for estimating the performance and associated model form uncertainty are explored to determine the range of applicability of the framework, particularly with respect to model form, process and sensor noise, and quality of available flight test data. This paper focuses on the general limitations and applicability of the framework and not the applicability of the individual methods to a range of modified configurations, which requires a large number of modified configurations and is an area for future work. The effects of these factors on the performance and uncertainty results are demonstrated using NASA’s Generic Transport Model aircraft.

uncertainty quantification↗

NASA NTRS2022

Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

Flight testing has been the historical standard for determining aircraft airworthiness. However, increases in the cost of flight testing and the accuracy of inexpensive CFD encourage the adoption of certification by analysis to reduce or replace flight testing. A framework is introduced to predict the performance in the special case of a modification to an existing, previously certified aircraft. This framework uses a combination of existing flight tests or high fidelity data of the original aircraft as well as lower fidelity data from CFD or wind tunnel testing of the original and modified configurations to create 6-DOF flight dynamics models. Two methods are presented which generate an updated flight dynamics model and estimate the model form uncertainty for the modified aircraft configuration using knowledge of the original aircraft. This updated dynamics model and uncertainty estimate are then used to conduct non-deterministic simulations with wind turbulence included. The framework is applied to an example aircraft system to demonstrate the ability to predict the performance and associated model from the uncertainty of modified aircraft configurations.

uncertainty quantification↗

NASA NTRSDate not supplied

Application of Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations Using NASA's X-57 Maxwell

A framework to estimate the performance and associated uncertainty of modified configurations of certified aircraft is applied to the X-57 Maxwell aircraft. In previous theoretical studies, the framework was shown to predict performance and uncertainty bounds accurately. The X-57 Maxwell is an experimental aircraft designed to demonstrate the benefits of distributed electric propulsion through a series of four incremental modifications to a Tecnam P2006T aircraft. The available models and data are first shown to be within the application domain of the framework. We then apply the framework to two X-57 Maxwell modifications. We compare the estimated performance and associated uncertainties against the airworthiness criteria. The results indicate that the framework is a promising tool for the certification by analysis workflow. We expect the framework to reduce and supplement the flight testing required to show compliance to airworthiness certification criteria for a modified configuration.

Uncertainty Quantification↗

NASA NTRSDate not supplied

Application of Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations Using NASA's X-57 Maxwell

Uncertainty Quantification↗

NASA NTRSDate not supplied

Measurement Accuracy and Uncertainty Analysis of the X-59 Air Data Probe Calibration Test Entry One

The X-59 is being developed to demonstrate quiet sonic boom technology. Data was obtained via two test entries in the NASA Glenn Research Center’s 8- by 6-Foot Supersonic Wind Tunnel to calibrate the X-59’s nose air data probe. The first entry tested two theoretically identical probes with the intention of one of the probes becoming the primary X-59 nose air data probe flight hardware and the other becoming a backup. A measurement accuracy and uncertainty analysis was performed on data obtained from the first test entry. The analysis showed that the uncertainties in the probe pressures were nearly identical for the two probes, with an average difference of 2.51 x 10-5 for the non-dimensional total pressure and 2.88 x 10-5 for the non-dimensional static pressures. The analysis also showed that the uncertainty in the probe yaw and pitch angles were 0.00034° and 0.01416°, respectively. This gives confidence in the X-59’s flight air data system.

Air Data Probe↗

NASA NTRS2023

Measurement Accuracy and Uncertainty Analysis of the X-59 Air Data Probe Calibration Test Entry One

The X-59 is being developed to demonstrate quiet sonic boom technology. Data was obtained via two test entries in the NASA Glenn Research Center’s 8- by 6-Foot Supersonic Wind Tunnel to calibrate the X-59’s nose air data probe. The first entry tested two theoretically identical probes with the intention of one of the probes becoming the primary X-59 nose air data probe flight hardware and the other becoming a backup. A measurement accuracy and uncertainty analysis was performed on data obtained from the first test entry. The analysis showed that the uncertainties in the probe pressures were nearly identical for the two probes, with an average difference of 2.51 x 10 -5 for the non-dimensional total pressure and 2.88 x 10 -5 for the non-dimensional static pressures. The analysis also showed that the uncertainty in the probe yaw and pitch angles were 0.00034° and 0.01416°, respectively. This gives confidence in the X-59’s flight air data system.

Air Data Probe↗

NASA NTRSDate not supplied

Results of the NASA Prediction Uncertainty Reduction Tech Challenge

In January 2021 the Advanced Air Vehicles Program approved a new Tech Challenge (TC) to be run out of the Commercial Supersonic Technology (CST) Project. The objective of the TC was to bring uncertainties in the empirical noise modeling for civilian supersonic aircraft into the same range as that of conventional aircraft. The TC goal statement was to “Produce data and demonstrate tools that reduce the uncertainty in predicting Landing & Takeoff Noise levels of supersonic-relevant designs by 5 EPNdB and are ready for use in studies to inform FAA rule-making.” To make the required improvements in noise prediction methods for supersonic aircraft, NASA decided to validate and use high-fidelity numerical simulations to acquire the needed noise data on supersonic propulsion configurations. High-fidelity component designs were developed, such as a two-stage propulsor behind a supersonic inlet designed by General Electric Aviation and variable area exhaust systems using input from recent contracts with GE and Rolls Royce. A noise database was generated as a function of geometric and flow parameters, providing corrections to the empirical noise models and added new input variables to describe the complexities created by the supersonic-specific design features. Statistically, the new models were able to predict the acoustic impact of supersonic-specific features, the reduction in uncertainty being reduced from the baseline 7.8 EPNdB at the beginning of the TC to 2.0 EPNdB at the end.

noise prediction↗

DOE OSTI2025

Role of Uncertainty Quantification in the Explainability of Large Language Models for the Nuclear Industry

The meteoric rise of generative artificial intelligence (AI) large language models (LLMs) has created an opportunity to utilize them to increase efficiencies in a multitude of industries. While LLMs carry great potential to revolutionize the manner in which work is performed, numerous known deficiencies limit their utility, including the black box nature of the models, the stochastic nature of the response (i.e., presenting the same prompt multiple times results in different responses), and the potential for hallucination. Widespread adoption of LLMs in safety-critical industries such as nuclear will require some form of explainability to assure end users that the LLM’s response to a given query is valid. Model uncertainty is inherently linked to the concepts of trust and explainability, and can be used to identify situations in which the model is insufficiently certain about its answer. Although uncertainty is not enough in and of itself to determine the suitability of an answer—a model can be very certain of an inaccurate answer—it still provides valuable supporting information. Practical methodologies for gauging or quantifying the uncertainty in LLM outputs are presented herein, along with examples based on nuclear-specific prompts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Quantifying uncertainty in uranium concentration measurements via K-edge densitometry

This study quantifies the uncertainty in uranium concentration predictions of fluoride and chloride-based salts within a steel pipe using K-edge densitometry. Modeling and simulation was conducted with the Monte Carlo N-Particle Transport (MCNP) code. The quality of of this technique’s prediction in a pipe requires proper characterization of the pipe’s thickness, which is dependent on the source size and axial offset from the pipe centerline. The thickness was determined as either the center-line thickness seen by the X-ray source or an average value determined through random sampling. Generally, the predicted concentrations were slightly better at lower offset with the random sampling thickness and using the center-line thickness for the highest offsets. For a line-beam source and varying axial offsets, the relative error of concentration was within 1% of the true value but uncertainty increased by 2 orders of magnitude. Similarly, for no axial offset, the relative error was significantly less than 1% while no trend for uncertainty was found. However, at the largest possible offset for a given source size, the concentrations become erroneous and greater than the allowable 1% relative error. Furthermore, high offsets tended to increase the variance of the transmission spectra by 3 orders of magnitude.

Characterization and Analytical Technique↗

DOE OSTI2024

Multistage Stochastic optimization for mid-term integrated generation and maintenance scheduling of cascaded hydroelectric system with renewable energy uncertainty

The uncertainties resulting from the escalating penetration of renewable energy resources pose severe challenges to the efficient operation of modern power systems. Hydroelectricity is characterized by its flexibility, controllability, and reliability, and thus becomes one of the most ideal energy resources to hedge against such uncertainties. This paper studies the mid-term integrated generation and maintenance scheduling of a cascaded hydroelectric system (CHS) consisting of multiple cascaded reservoirs and hydroelectric units. To precisely describe the mid-term water regulation policies, the hydraulic coupling relationship and water-energy nexus of CHS are incorporated into the proposed optimization model. The uncertainties of natural water inflow and the power outputs of wind/solar energy generation are taken into consideration and captured via a stochastic process modeled by a scenario tree. A multistage stochastic optimization (MSO) approach is developed to coordinate the complementary operations of multiple energy resources, by optimizing the mid-term water resource management, generation scheduling, and maintenance scheduling of CHS. The proposed MSO model is formulated as a large-scale mixed-integer linear program that presents significant computational intractability. To address this issue, a tailored Benders decomposition algorithm is developed. Two real-world case studies are conducted to demonstrate the capability and characteristics of the proposed model and algorithm. The computational results show that the proposed MSO model can exploit the flexibility of hydroelectricity to efficiently respond to variable wind and solar power, and reserve water resources for the generation in peak months to reduce the consumption of fossil fuel. Furthermore, the proposed solution approach also exhibits promising computational efficiency when handling large-scale models.

13 HYDRO ENERGY↗

DOE OSTI2026

Control co-design under uncertainty for offshore wind farms: Optimizing grid integration, energy storage, and market participation

Offshore wind farms (OWFs) are set to significantly contribute to global decarbonization efforts. Developers often use a sequential approach to optimize design variables and market participation for grid-integrated offshore wind farms. However, this method can lead to sub-optimal system performance, and uncertainties associated with renewable resources are often overlooked in decision-making. Here, this paper proposes a control co-design approach, optimizing design and control decisions for integrating OWFs into the power grid while considering energy market and primary frequency market participation. Additionally, we introduce optimal sizing solutions for energy storage systems deployed onshore to enhance revenue for OWF developers over time. This framework addresses uncertainties related to wind resources and energy prices. We analyze five U.S. west-coast offshore wind farm locations and potential interconnection points, as identified by the Bureau of Ocean Energy Management (BOEM). Results show that optimized control co-design solutions can increase market revenue by 3.2% and provide flexibility in managing wind resource uncertainties.

Control Co-design↗