Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty mitigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Applying Sensor Uncertainty Mitigation Schemes to Detect-and-Avoid Systems

Impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. DAIDALUS SUM performance is evaluated using a few safety and operational suitability metrics and compared with more traditional approaches using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the tunable parameters for horizontal and vertical uncertainty in DAIDALUS SUM improves the safety metric at the cost of increasing the number of system alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

detect and avoid↗

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)↗

Evaluation of Sensor Uncertainty Mitigation Methods for Detect-and-Avoid Systems

The impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates two such methods. One of them is the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. The second method is the Virtual Intruder State Aggregation (VISA), which averages multiple subsequent intruder states extrapolated to the current (most recent) time into a single ``aggregated`` intruder state. The VISA method can be used either individually as a sensor noise mitigation method in its own right, or in combination with DAIDALUS SUM. The performance of these methods is evaluated using three safety and operational suitability metrics and compared with a baseline configuration using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft, not equipped with a broadcasting transponder or ADS-B out system, are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the DAIDALUS SUM parameters for horizontal and vertical uncertainty improves the safety metric at the cost of increasing the number of actionable alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. VISA was found to be almost as effective as other noise mitigation methods even when it was used alone. Combining VISA with DAIDALUS SUM achieved the best performance among all investigated methods used with DAIDALUS. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

Detect-and-Avoid Systems↗

Sensor Uncertainty Mitigation and Dynamic Well Clear Volumes in DAIDALUS

This paper presents recent updates to DAIDALUS (Detect & Avoid Alerting Logic for Unmanned Systems), a detect and avoid (DAA) software package for the integration of civil UAS into the airspace. DAIDALUS is the reference implementation of detect and avoid for unmanned aircraft systems chosen by RTCA Special Committee 228 (SC-228), and it is included in its corresponding Minimum Operational Performance Standards (MOPS) document, DO-365. This paper reports on the integration into DAIDALUS of two new capabilities, namely dynamic well clear volumes and sensor uncertainty mitigation.'

Narkawicz, Anthony↗

Alternative Surveillance Fast Time Simulation with Sensor Uncertainties and Mitigation

This presentation describes a simulation plan for the fast time simulation 3 for the modeling and simulation team in the UAS (Unmanned Aircraft Systems) in the NAS (National Airspace System)project. Objectives: Investigate the effect of limited surveillance volume and realistic radar noise on DAA (Detect and Avoid) performance; Evaluate the ability of the sensor uncertainty mitigation (SUM) feature of the DAIDALUS [Dectect and Avoid...] algorithm to improve DAA alerting and guidance [Includes content on SWaP-C (size, weight, power, and cost) of unmanned aircraft; and Near-mid-air-collision (NMAC).]

UAS↗

Unmanned Aircraft Systems Minimum Operations Performance Standards End-to-End Verification and Validation (E2-V2) Simulation

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of "eyes in the sky" due to having no human on-board the aircraft. The current NAS relies on pilot's vigilance and judgement to remain Well Clear (CFR 14 91.113) of other aircraft. RTCA SC-228 has defined DAA Well Clear (DAAWC) to provide a quantified Well Clear volume to allow systems to be designed and measured against. Extended research efforts have been conducted to understand and quantify system requirements needed to support a UAS pilot's ability to remain well clear of other aircraft. The efforts have included developing and testing sensor, algorithm, alerting, and display requirements. More recently, sensor uncertainty and uncertainty mitigation strategies have been evaluated. This paper discusses results and lessons learned from an End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA SC-228's proposed Phase I DAA Minimum Operational Performance Standards (MOPS). NASA Langley Research Center (LaRC) was called upon to develop a system that evaluates a specific set of encounters, in a variety of geometries, with end-to-end DAA functionality including the use of sensor and tracker models, a sensor uncertainty mitigation model, DAA algorithmic guidance in both vertical and horizontal maneuvering, and a pilot model which maneuvers the ownship aircraft to remain well clear from intruder aircraft, having received collective input from the previous modules of the system. LaRC developed a functioning batch simulation and added a sensor/tracker model from the Federal Aviation Administration (FAA) William J. Hughes Technical Center, an in-house developed sensor uncertainty mitigation strategy, and implemented a pilot model similar to one from the Massachusetts Institute of Technology's Lincoln Laboratory (MIT/LL). The resulting simulation provides the following key parameters, among others, to evaluate the effectiveness of the MOPS DAA system: severity of loss of well clear (SLoWC), alert scoring, and number of increasing alerts (alert jitter). The technique, results, and lessons learned from a detailed examination of DAA system performance over specific test vectors and encounter cases during the simulation experiment will be presented in this paper.

Ghatas, Rania W.↗

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems↗

LOFTID Aeroshell Thermal Response Uncertainty Analysis Utilizing the End-to-End Monte Carlo Approach

A probabilistic thermal margin process has been performed to design the flexible thermal protection system (FTPS) and select entry trajectory constraints given an acceptable risk level for the Low-Earth Orbit Flight Test of and Inflatable Decelerator (LOFTID) project. Uncertainties exist in atmospheric entry aeroheating environments and the predicted thermal response of thermal protection system (TPS) material. Entry vehicle TPS is often over-sized to mitigate uncertainty by combining conservative bounding scenarios together. The probabilistic thermal margin process allows engineers to make informed aeroshell design, flight design, and FTPS performance risk trades while preventing excessive FTPS margin from being applied. This paper describes the uncertainty analysis methodology used to carry out a probabilistic thermal margin process used for LOFTID’s aeroshell and explains how the calculated probability of exceeding flight allowable temperatures is used to design the FTPS and establish nominal flight design constraints. This probabilistic thermal margin process had never been applied to entry, decent, and landing design for a flown entry vehicle and it is one of the LOFTID project’s goals to demonstrate its merits.

Steven Andrew Tobin↗

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis↗

Integration of Uncertainty Quantification in a Model-Based Systems Analysis and Engineering Framework

This paper presents a technical approach to improve the confidence in the systems analysis process by integrating Uncertainty Quantification (UQ) techniques within a Model-Based Systems Analysis and Engineering (MBSA&E) framework. The MBSA&E architecture uses system models and multidisciplinary analytical solutions as central artifacts for system design and analysis. The integration of UQ enables engineers to assess and mitigate uncertainties associated with a system model, design parameters, and constraint inputs, leading to more complete design studies and further informed decision-making processes. The proposed approach leverages the strengths of MBSA&E and extends it with a UQ methodology to quantify uncertainties in the input parameters and to trace the uncertainties as they propagate throughout the system model. To demonstrate the effectiveness of an integrated MBSA&E-UQ approach, a case study involving a simplified analysis of a Transonic Truss-Braced Wing (TTBW) concept vehicle is performed. This integration enables a more comprehensive evaluation of system performance and behavior under uncertainty and a more robust approach for system design and analysis. Lastly, the paper addresses the challenges and considerations associated with integrating UQ into an MBSA&E framework.

systems analysis↗

ACES Study of DAA-Mitigated UAS Operations SC-228 Requirements Sub Group

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. A recent study conducted using NASA's ACES (Airspace Concept Evaluation System) simulation capability begins to address questions surrounding the development of draft MOPS for DAA systems by assessing DAA performance in a NAS-wide context. ACES analyses were conducted to determine the impact of varying elements of UAS pilot performance and uncertainty mitigations on DAA system performance. Simulations were conducted with recorded cooperative and non-cooperative VFR (Visual Flight Rules) traffic to accurately model UAS encounters with other NAS traffic (ATC (Air Traffic Control) being responsible for separation with other IFR (Instrument Flight Rules) aircraft) and with roughly 25, 000 simulated UAS operations The number of Loss of Well Clear (LoWC) events were recorded across the range of independent variables: pilot response time, horizontal LoWC prediction buffer and horizontal LoWC resolution buffer. The number of LoWC events was compared to the unmitigated case (without the benefit of a DAA system) to determine the resultant risk-ratio for each of 8 simulation conditions. The parameter trades presented by the resultant DAA system performance (risk ratio) will be used by SC 228 to inform decisions about future requirements development and validation efforts.

Detect-and-Avoid↗

Target Prioritization and Observing Strategies for the NEID Earth Twin Survey

NEID is a high-resolution optical spectrograph on the WIYN 3.5 m telescope at Kitt Peak National Observatory and will soon join the new generation of extreme precision radial velocity instruments in operation around the world. We plan to use the instrument to conduct the NEID Earth Twin Survey (NETS) over the course of the next 5 years, collecting hundreds of observations of some of the nearest and brightest stars in an effort to probe the regime of Earth-mass exoplanets. Even if we take advantage of the extreme instrumental precision conferred by NEID, it will be difficult to disentangle the weak (~10 cm/s) signals induced by such low-mass, long-period exoplanets from stellar noise for all but the quietest host stars. In this work, we present a set of quantitative selection metrics which we use to identify an initial NETS target list consisting of stars conducive to the detection of exoplanets in the regime of interest. We also outline a set of observing strategies with which we aim to mitigate uncertainty contributions from intrinsic stellar variability and other sources of noise.

Arvind F. Gupta↗

Space Radiation Cancer Risk Projections for Exploration Missions: Uncertainty Reduction and Mitigation

In this paper we discuss expected lifetime excess cancer risks for astronauts returning from exploration class missions. For the first time we make a quantitative assessment of uncertainties in cancer risk projections for space radiation exposures. Late effects from the high charge and energy (HZE) ions present in the galactic cosmic rays including cancer and the poorly understood risks to the central nervous system constitute the major risks. Methods used to project risk in low Earth orbit are seen as highly uncertain for projecting risks on exploration missions because of the limited radiobiology data available for estimating HZE ion risks. Cancer risk projections are described as a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Monte-Carlo sampling from subjective error distributions represents the lack of knowledge in each factor to quantify risk projection overall uncertainty. Cancer risk analysis is applied to several exploration mission scenarios. At solar minimum, the number of days in space where career risk of less than the limiting 3% excess cancer mortality can be assured at a 95% confidence level is found to be only of the order of 100 days.

Cucinotta, Francis↗

The Use of Gridded Fossil Fuel CO2 Emissions (FFCO2) Inventory for Climate Mitigation Applications: Errors, Uncertainties, and Current and Future Challenges

Emission Inventory (EI) is a fundamental tool to monitor global compliance of greenhouse gases (GHGs) emissions reduction actions. Inventory guidelines provide a best practice to help EI compilers to make comparable national emission estimates, in spite of the differences in data availability across countries and regions. There are a variety of sources of errors and uncertainties, however, that originate beyond what the inventory guidelines define. For example, spatially-explicit EIs, which are a key product for atmospheric modeling applications, are often developed for research purposes, and there are no specific guidelines to disaggregate emission estimates from country scale. On top of that, EIs are fundamentally prone to systematic biases due to the simple calculation methodology and thus an objective evaluation (e.g. atmospheric top-down estimates) is needed to assure the accuracy of the estimates. ODIAC is a global high-resolution (1x1 km) fossil fuel carbon dioxide (CO2) gridded EI that is now often used in atmospheric CO2 modeling. ODIAC is based on disaggregation of national emission estimates made by CDIAC, which is the well accepted standard in the community. The ODIAC emission data product is updated on an annual basis using best available statistical data. Subnational spatial emission patterns are estimated using power plant profiles and satellite-observations of nighttime lights. In addition to the conventional CDIAC gridded data product, ODIAC carries international bunker emissions (shipping and aviation), which allows flux inversion modelers to accurately impose the global total fossil fuel emissions and their horizontal and vertical distribution. We have extensively evaluated ODIAC emissions using fine-grained EIs as well as a high-resolution atmospheric model simulation across different scales (national, subnational/regional, and urban policy relevant) with a focus on the uncertainties associated with the emission disaggregation. We have examined the use of NASA's Black Marble Suomi-NPP/VIIRS nightlight data.

Oda, Tomohiro↗

Uncertainties in estimates of the risks of late effects from space radiation

Methods used to project risks in low-Earth orbit are of questionable merit for exploration missions because of the limited radiobiology data and knowledge of galactic cosmic ray (GCR) heavy ions, which causes estimates of the risk of late effects to be highly uncertain. Risk projections involve a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Using the linear-additivity model for radiation risks, we use Monte-Carlo sampling from subjective uncertainty distributions in each factor to obtain an estimate of the overall uncertainty in risk projections. The resulting methodology is applied to several human space exploration mission scenarios including a deep space outpost and Mars missions of duration of 360, 660, and 1000 days. The major results are the quantification of the uncertainties in current risk estimates, the identification of factors that dominate risk projection uncertainties, and the development of a method to quantify candidate approaches to reduce uncertainties or mitigate risks. The large uncertainties in GCR risk projections lead to probability distributions of risk that mask any potential risk reduction using the "optimization" of shielding materials or configurations. In contrast, the design of shielding optimization approaches for solar particle events and trapped protons can be made at this time and promising technologies can be shown to have merit using our approach. The methods used also make it possible to express risk management objectives in terms of quantitative metrics, e.g., the number of days in space without exceeding a given risk level within well-defined confidence limits. Published by Elsevier Ltd on behalf of COSPAR.

Non-NASA Center↗

Uncertainties in Estimates of the Risks of Late Effects from Space Radiation

The health risks faced by astronauts from space radiation include cancer, cataracts, hereditary effects, and non-cancer morbidity and mortality risks related to the diseases of the old age. Methods used to project risks in low-Earth orbit are of questionable merit for exploration missions because of the limited radiobiology data and knowledge of galactic cosmic ray (GCR) heavy ions, which causes estimates of the risk of late effects to be highly uncertain. Risk projections involve a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Within the linear-additivity model, we use Monte-Carlo sampling from subjective uncertainty distributions in each factor to obtain a Maximum Likelihood estimate of the overall uncertainty in risk projections. The resulting methodology is applied to several human space exploration mission scenarios including ISS, lunar station, deep space outpost, and Mar's missions of duration of 360, 660, and 1000 days. The major results are the quantification of the uncertainties in current risk estimates, the identification of factors that dominate risk projection uncertainties, and the development of a method to quantify candidate approaches to reduce uncertainties or mitigate risks. The large uncertainties in GCR risk projections lead to probability distributions of risk that mask any potential risk reduction using the "optimization" of shielding materials or configurations. In contrast, the design of shielding optimization approaches for solar particle events and trapped protons can be made at this time, and promising technologies can be shown to have merit using our approach. The methods used also make it possible to express risk management objectives in terms of quantitative objective's, i.e., the number of days in space without exceeding a given risk level within well defined confidence limits.

Cucinotta, F. A.↗