Search NASASearch

SEARCH · Search NASA

Results for “uncertainty mitigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Applying Sensor Uncertainty Mitigation Schemes to Detect-and-Avoid Systems

Impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. DAIDALUS SUM performance is evaluated using a few safety and operational suitability metrics and compared with more traditional approaches using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the tunable parameters for horizontal and vertical uncertainty in DAIDALUS SUM improves the safety metric at the cost of increasing the number of system alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

detect and avoid

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)

Evaluation of Sensor Uncertainty Mitigation Methods for Detect-and-Avoid Systems

The impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates two such methods. One of them is the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. The second method is the Virtual Intruder State Aggregation (VISA), which averages multiple subsequent intruder states extrapolated to the current (most recent) time into a single ``aggregated`` intruder state. The VISA method can be used either individually as a sensor noise mitigation method in its own right, or in combination with DAIDALUS SUM. The performance of these methods is evaluated using three safety and operational suitability metrics and compared with a baseline configuration using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft, not equipped with a broadcasting transponder or ADS-B out system, are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the DAIDALUS SUM parameters for horizontal and vertical uncertainty improves the safety metric at the cost of increasing the number of actionable alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. VISA was found to be almost as effective as other noise mitigation methods even when it was used alone. Combining VISA with DAIDALUS SUM achieved the best performance among all investigated methods used with DAIDALUS. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

Detect-and-Avoid Systems

Sensor Uncertainty Mitigation and Dynamic Well Clear Volumes in DAIDALUS

This paper presents recent updates to DAIDALUS (Detect & Avoid Alerting Logic for Unmanned Systems), a detect and avoid (DAA) software package for the integration of civil UAS into the airspace. DAIDALUS is the reference implementation of detect and avoid for unmanned aircraft systems chosen by RTCA Special Committee 228 (SC-228), and it is included in its corresponding Minimum Operational Performance Standards (MOPS) document, DO-365. This paper reports on the integration into DAIDALUS of two new capabilities, namely dynamic well clear volumes and sensor uncertainty mitigation.'

Narkawicz, Anthony

Alternative Surveillance Fast Time Simulation with Sensor Uncertainties and Mitigation

This presentation describes a simulation plan for the fast time simulation 3 for the modeling and simulation team in the UAS (Unmanned Aircraft Systems) in the NAS (National Airspace System)project. Objectives: Investigate the effect of limited surveillance volume and realistic radar noise on DAA (Detect and Avoid) performance; Evaluate the ability of the sensor uncertainty mitigation (SUM) feature of the DAIDALUS [Dectect and Avoid...] algorithm to improve DAA alerting and guidance [Includes content on SWaP-C (size, weight, power, and cost) of unmanned aircraft; and Near-mid-air-collision (NMAC).]

UAS

Unmanned Aircraft Systems Minimum Operations Performance Standards End-to-End Verification and Validation (E2-V2) Simulation

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of "eyes in the sky" due to having no human on-board the aircraft. The current NAS relies on pilot's vigilance and judgement to remain Well Clear (CFR 14 91.113) of other aircraft. RTCA SC-228 has defined DAA Well Clear (DAAWC) to provide a quantified Well Clear volume to allow systems to be designed and measured against. Extended research efforts have been conducted to understand and quantify system requirements needed to support a UAS pilot's ability to remain well clear of other aircraft. The efforts have included developing and testing sensor, algorithm, alerting, and display requirements. More recently, sensor uncertainty and uncertainty mitigation strategies have been evaluated. This paper discusses results and lessons learned from an End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA SC-228's proposed Phase I DAA Minimum Operational Performance Standards (MOPS). NASA Langley Research Center (LaRC) was called upon to develop a system that evaluates a specific set of encounters, in a variety of geometries, with end-to-end DAA functionality including the use of sensor and tracker models, a sensor uncertainty mitigation model, DAA algorithmic guidance in both vertical and horizontal maneuvering, and a pilot model which maneuvers the ownship aircraft to remain well clear from intruder aircraft, having received collective input from the previous modules of the system. LaRC developed a functioning batch simulation and added a sensor/tracker model from the Federal Aviation Administration (FAA) William J. Hughes Technical Center, an in-house developed sensor uncertainty mitigation strategy, and implemented a pilot model similar to one from the Massachusetts Institute of Technology's Lincoln Laboratory (MIT/LL). The resulting simulation provides the following key parameters, among others, to evaluate the effectiveness of the MOPS DAA system: severity of loss of well clear (SLoWC), alert scoring, and number of increasing alerts (alert jitter). The technique, results, and lessons learned from a detailed examination of DAA system performance over specific test vectors and encounter cases during the simulation experiment will be presented in this paper.

Ghatas, Rania W.

Characterizing Interaction Uncertainty in Human-Machine Teams

With the increasing use and adoption of artificial intelligence (AI), the reliability of modern data systems will be driven by a tighter teaming between human experts and intelligent machine teammates. As in the case of human-human teams, the success of human-machine teams will also rely on clear communication about mutual goals and actions. In this paper, we combine related literature from cognitive psychology, human-machine teaming, uncertainty in data analysis, and multi-agent systems to propose a new form of uncertainty: interaction uncertainty for characterizing bidirectional communication in human-machine teams. We map the causes and effects of interaction uncertainty and outline potential ways to mitigate uncertainty for mutual trust in a high-consequence real-world scenario.

uncertainty, data analytics, interaction, trust, h

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems

Surrogate-driven Variance-based Sensitivity Analysis of Thermal Storage Tanks in Integrated Energy Systems

Sensitivity analysis and uncertainty quantification are essential steps for enhancing the accuracy of computational models by identifying and mitigating uncertainties. This study focuses on these steps for the Thermal Energy Delivery System at Idaho National Laboratory, specifically targeting the thermocline tank. Using a Modelica/Dymola simulation model, the study perturbed various design parameters and boundary conditions, including shape factor, porosity, outlet temperature, inlet mass flow rate, and system pressure, to predict and quantify uncertainty in the tank’s ax- ial temperature. A dataset of over 1,000 simulations was generated, and surrogate models were developed using the pyMAISE (Michigan Artificial Intelligence Standard Environment) library, which is an Automatic Machine Learning library for nuclear engineering applications. The optimal model, a feedforward neural network with two hidden layers, achieved an R2 score above 0.99 and a mean absolute error below 1 Kelvin. Sensitivity analyses using Sobol indices and Fourier amplitude sensitivity testing methods on this surrogate model revealed that the inlet mass flow rate at initial timestamps and porosity significantly impacts predicted temperatures across all sensors and time steps.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

LOFTID Aeroshell Thermal Response Uncertainty Analysis Utilizing the End-to-End Monte Carlo Approach

A probabilistic thermal margin process has been performed to design the flexible thermal protection system (FTPS) and select entry trajectory constraints given an acceptable risk level for the Low-Earth Orbit Flight Test of and Inflatable Decelerator (LOFTID) project. Uncertainties exist in atmospheric entry aeroheating environments and the predicted thermal response of thermal protection system (TPS) material. Entry vehicle TPS is often over-sized to mitigate uncertainty by combining conservative bounding scenarios together. The probabilistic thermal margin process allows engineers to make informed aeroshell design, flight design, and FTPS performance risk trades while preventing excessive FTPS margin from being applied. This paper describes the uncertainty analysis methodology used to carry out a probabilistic thermal margin process used for LOFTID’s aeroshell and explains how the calculated probability of exceeding flight allowable temperatures is used to design the FTPS and establish nominal flight design constraints. This probabilistic thermal margin process had never been applied to entry, decent, and landing design for a flown entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven Andrew Tobin

Neutrino-nucleus cross section impacts on neutrino oscillation measurements

The challenges in neutrino-nucleus cross section modeling and its impact on neutrino oscillation experiments are widely recognized. However, a comprehensive and theoretically robust estimation of cross section uncertainties has been lacking, and few studies have quantitatively examined their impact on oscillation measurements. In this work, we evaluate the effect of cross section uncertainties on oscillation parameters using setups inspired by NOvA and DUNE. To characterize these uncertainties, we adopt multiple neutrino-nucleus event generators and simulate a realistic experimental procedure that incorporates near-detector data and near-to-far-detector extrapolation. Our results confirm that cross section uncertainties cannot significantly bias oscillation results in current statistics-dominated experiments like NOvA. However, they could lead to substantial bias for future systematics-dominated experiments like DUNE, even when near-detector data are employed to mitigate uncertainties. These findings underscore the need for further studies on the quantitative impacts of cross section modeling, improved strategies to utilize near-detector data and the PRISM concept, and more robust cross section models to optimize the success of future experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis

Planning Amidst Uncertainty: Identifying Core CCS Infrastructure Robust to Storage Uncertainty

Carbon Capture and Storage (CCS) is a critical technology for reducing anthropogenic CO2 emissions, but its large-scale deployment is complicated by uncertainties in geological storage performance. These uncertainties pose significant financial and operational risks, as underperforming storage sites can lead to costly infrastructure modifications, inefficient pipeline routing, and economic shortfalls. To address this challenge, we propose a novel optimization workflow that is based on mixed-integer linear programming and explicitly integrates probabilistic modeling of storage uncertainty into CCS infrastructure design. This workflow generates multiple infrastructure scenarios by sampling storage capacity distributions, optimally solving each scenario using a mixed-integer linear programming model, and aggregating results into a heatmap to identify core infrastructure components that have a low likelihood of underperforming. A risk index parameter is introduced to balance trade-offs between cost, CO2 processing capacity, and risk of underperformance, allowing stakeholders to quantify and mitigate uncertainty in CCS planning. Applying this workflow to a CCS dataset from the US Department of Energy’s Carbon Utilization and Storage Partnership project reveals key insights into infrastructure resilience. Reducing the risk index from 15% to 0% is observed to lead to an 83.7% reduction in CO2 processing capacity and a 77.1% decrease in project profit, quantifying the trade-off between risk tolerance and project performance. Furthermore, our results highlight critical breakpoints, where small adjustments in the risk index produce disproportionate shifts in infrastructure performance, providing actionable guidance for decision-makers. Unlike prior approaches that aimed to cheaply repair underperforming infrastructure, our workflow constructs robust CCS networks from the ground up, ensuring cost-effective infrastructure under storage uncertainty. These findings demonstrate the practical relevance of incorporating uncertainty-aware optimization into CCS planning, equipping decision-makers with a tool to make informed project planning decisions.

Olson, Daniel

ACES Study of DAA-Mitigated UAS Operations SC-228 Requirements Sub Group

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. A recent study conducted using NASA's ACES (Airspace Concept Evaluation System) simulation capability begins to address questions surrounding the development of draft MOPS for DAA systems by assessing DAA performance in a NAS-wide context. ACES analyses were conducted to determine the impact of varying elements of UAS pilot performance and uncertainty mitigations on DAA system performance. Simulations were conducted with recorded cooperative and non-cooperative VFR (Visual Flight Rules) traffic to accurately model UAS encounters with other NAS traffic (ATC (Air Traffic Control) being responsible for separation with other IFR (Instrument Flight Rules) aircraft) and with roughly 25, 000 simulated UAS operations The number of Loss of Well Clear (LoWC) events were recorded across the range of independent variables: pilot response time, horizontal LoWC prediction buffer and horizontal LoWC resolution buffer. The number of LoWC events was compared to the unmitigated case (without the benefit of a DAA system) to determine the resultant risk-ratio for each of 8 simulation conditions. The parameter trades presented by the resultant DAA system performance (risk ratio) will be used by SC 228 to inform decisions about future requirements development and validation efforts.

Detect-and-Avoid

Assessment of MiniFuel Subcapsule Design Recommendations on Previous Experiments

MiniFuel describes the class of separate effects nuclear fuels irradiation experiments that have been conducted in the High Flux Isotope Reactor (HFIR) since 2018. These experiments comprise a stack of six fuel-bearing subcapsules contained in a stainless steel target housing that is in contact with HFIR coolant on its exterior. All MiniFuel targets have a near-standardized architecture, and the primary design variables that change between experiments are the radial gap size between the subcapsule and housing and the target fill gas composition. Finite element heat transfer models are used to determine the optimum gas composition and gap sizes, and recent studies were performed to identify model parameters that contribute the most uncertainty to fuel specimen temperature predictions. That work, which is referenced herein, also recommended a set of design modifications to the subcapsule internal architecture and assembly process. These modifications are intended to reduce fuel temperature uncertainty in future experiments. In this report, the subcapsule design modifications were retroactively applied to a previously conducted MiniFuel experiment to determine how these changes affect the established safety and performance envelope of the experimental capability. These effects were determined in two steps. First, the modifications were applied to the subcapsule design without any other changes to determine their isolated effect on the predicted fuel specimen temperatures. This portion of the analysis showed that fuel temperatures were modestly reduced because the implemented changes improved heat transfer efficacy. Next, traditional MiniFuel design activities (i.e., sizing the gas gaps and determining the fill gas composition) were reperformed, and they confirmed that the original desired fuel temperatures could be achieved while remaining within established safety limits. Therefore, this report demonstrates improved performance resulting from the subcapsule modifications, which mitigate uncertainty while meeting the objectives of past experiments. An additional benefit of the design changes is reduced sensitivity of the fuel temperature to the evolving flux spectrum in HFIR, leading to more stable temperatures and enhanced utility of MiniFuel as a separate effects irradiation platform.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS