Search NASA⌕ Search

Engineering topics

Seungman Lee

Publications and source records attributed to Seungman Lee.

15 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Safety Assessment of Conformance Monitoring for Situational Awareness in UTM Operations

This report presents a systematic approach to evaluating the safety benefit of utilizing strategic deconfliction and Conformance Monitoring for Situational Awareness to manage the traffic that is comprised of both conforming aircraft and contingent aircraft. First, we developed a Monte-Carlo-based simulation platform that generates a range of nominal flight paths, a set of flight paths associated with contingent aircraft, encounters between conforming and contingent aircraft, and simulates aircraft's reported positions within conformance bounds. Next, we derived the mathematical equations for quantifying the level of safety, represented by the probability of mid-air collision per flight hour, using the flight data from the simulation platform. Finally, we compared the safety benefit of CMSA services in scenarios generated at different traffic densities and rates of contingent aircraft. This study suggests that strategic deconfliction and CMSA services can collaboratively handle traffic mixed with conforming and contingent aircraft more safely than strategic deconfliction alone.

CMSA↗
NASA NTRS2024

Survey of Methods for Assessing Safety Compliance of sUAS BVLOS Operations

To ensure the safety of small Unmanned Aircraft System (sUAS) Beyond Line of Sight (BVLOS) operations in the National Airspace System (NAS), the FAA offers a guideline on how sUAS operators can demonstrate compliance with FAA rules, including regulations, advisory circulars, policy statements, and acceptable means of compliance (AMOC), using a formal and top-down approach. According to FAA Advisory Circular 23.2010-1, the AMOC refers to “one method, but not the only method, to show compliance with a regulatory requirement.” It is common for regulations to include a performance and safety standard rather than a detailed design or operation requirement, which allows for flexibility in fulfilling the regulatory requirements while still achieving a predetermined level of safety. This technical report explores existing frameworks for sUAS BVLOS safety analysis. It begins by discussing how sUAS BVLOS operations can be strategically deconflicted and then discusses their hazards. The next step is to establish safety assessment methods commonly used by the aviation industry and the FAA, illustrate how these methods can be applied to several safety-critical air traffic systems, and list collision models that the FAA and industry use. This investigation documents the processes for assessing safety risks in sUAS BVLOS operations and will allow sUAS BVLOS operations to be assessed for safety compliance more efficiently.

sUAS BVLOS Operations↗
NASA NTRS2022

Preliminary Analysis of Separation Standards for Urban Air Mobility using Unmitigated Fast-Time Simulation

This research provides a preliminary analysis of various separation standards for Urban Air Mobility (UAM) operations. This study focuses on understanding and analyzing potential conflicts between UAM flights and conflicts between UAM and conventional aircraft. Fast-time simulations are conducted with a projected high-density of UAM traffic scenario and historical conventional non-UAM traffic flying under Instrument Flight Rules (IFR) or Visual Flight Rules (VFR) in Dallas Fort Worth (DFW) airspace. The conflicts are analyzed by examining losses of separation and near mid-air collisions of UAM flights and unmitigated risk of collision. A set of varied separation standards are used to investigate the impact of the new UAM operations on safety. The preliminary conflict analysis results will help inform separation standards development and in airspace and route design activities for future UAM operations.

Urban air mobility↗
NASA NTRS2021

Best Practices Identified Through the Completion of UAS Flight Demonstrations

After several years of research into Detect and Avoid (DAA) and Command and Control (C2) systems for Unmanned Aircraft Systems (UAS), the National Aeronautics and Space Administration’s (NASA) UAS Integration into the National Airspace System project initiated a focused two-year effort along with the Federal Aviation Administration (FAA) and three industry partners to investigate remaining issues in the specification, test, certification and airspace integration to allow UAS operations in non-segregated airspace. The approach taken had the industry partners propose a flight demonstration approximating a commercial operation, while NASA helped, as needed, the partners through design and test phases and NASA observed interactions with the FAA. During this effort NASA collected best practices intended to be of value to similar UAS endeavors. These best practices can be divided into different sets, including practices that describe the relationship between business considerations to UAS design or describe several UAS development challenges. Another set includes best practices focused on navigating the UAS design and type certification processes. A third set includes best practices that relate to the design of the DAA system. Deploying DAA systems in this timeframe posed unique challenges. Commercial off-the-shelf DAA systems do not exist, necessitating custom development and, for two of the partners, the use of low-size, -weight, and -power (SWaP) sensors not completely specified for DAA. A fourth set of best practices relates to lost-link contingency planning. The final set of best practices relates to the design and testing of C2 systems and obtaining spectrum licenses. The UAS demonstrations were piloted remotely, and for all aspects of flight safety, a C2 system was required to communicate DAA and other UAS subsystem data to the remote pilot and to allow the pilot to issue commands to the vehicle. Throughout the course of this effort, the partners integrated prototype DAA and C2 systems into unmanned aircraft, tested those systems, and laid the groundwork for type certification programs that are expected to continue.

NASA↗
NASA NTRSDate not supplied

Impact of Airborne Radar Uncertainties on Detect-and-Avoid Systems’ Performance

Impact of sensor uncertainty on Detect-and-Avoid (DAA) systems’ performance is investigated. Key metrics analyzed are the loss of DAA well clear ratio, the near-mid-air-collision risk ratio, the alert ratio, and the number of maneuvers per loss of DAA well clear. Sensitivity of these metrics to the magnitude of sensor uncertainty, pilots’ selection of maneuver, and surveillance range is investigated. Benefits of a dynamic buffer around the DAA well clear separation boundary, computed based on track accuracies, are also analyzed. These metrics are computed from open- and closed-loop simulations of a large number of representative encounters between an unmanned aircraft system and a manned aircraft. Results show that sensor uncertainty degrades safety metrics considerably but has only a minor effect on the number of maneuvers per loss of DAA well clear. The number of maneuvers, nonetheless, can be reduced by a 5◦ buffer away from the edge of the range of conflict-resulting heading in pilots’ selection of maneuver.

UAS↗
NASA NTRSDate not supplied

Applying Sensor Uncertainty Mitigation Schemes to Detect-and-Avoid Systems

Impact of sensor noise on the performance of Detect-And-Avoid (DAA) systems can be reduced by implementing various mitigation schemes. This paper evaluates the Sensor Uncertainty Mitigation (SUM) method, implemented in the Detect and Avoid Alerting Logic for Unmanned Systems (DAIDALUS) algorithm, a reference implementation in the DAA minimum operational performance standards. DAIDALUS SUM performance is evaluated using a few safety and operational suitability metrics and compared with more traditional approaches using static safety buffers. A large number of encounters representative of low-speed unmanned aircraft against non-cooperative manned aircraft are simulated and evaluated. An air-to-air radar model produces representative sensor noise for the DAA system. Results show that increasing the tunable parameters for horizontal and vertical uncertainty in DAIDALUS SUM improves the safety metric at the cost of increasing the number of system alerts leading to increased workload. A range of SUM parameters is recommended as suitable values for the type of operations considered for this work. General trends and optimal SUM configurations were found to be nearly the same for two large and very different encounter data sets.

detect and avoid↗
NASA NTRSDate not supplied

Analysis of Conflicts among Urban Air Mobility Aircraft and with Traditional Aircraft

This paper provides an initial analysis of conflicts among Urban Air Mobility aircraft and with traditional aircraft based on fast-time simulations of 20 full-day scenarios. Several sets of separation minima with added performance-based separation are applied, and the resulting separation conflicts are classified. Safety metrics relevant to separation standards are evaluated. The results shed light on future performance-based separation standards and safety metrics for separation standards involving Urban Air Mobility aircraft.

urban air mobility↗
NASA NTRSDate not supplied

Analysis of Conflicts among Urban Air Mobility Aircraft and with Traditional Aircraft

This paper provides an initial analysis of conflicts among Urban Air Mobility aircraft and with traditional aircraft based on fast-time simulations of 20 full-day scenarios. Several sets of separation minima with added performance-based separation are applied, and the resulting separation conflicts are classified. Safety metrics relevant to separation standards are evaluated. The results shed light on future performance-based separation standards and safety metrics for separation standards involving Urban Air Mobility aircraft.

urban air mobility↗
NASA NTRSDate not supplied

Preliminary Analysis of Separation Standards for Urban Air Mobility using Unmitigated Fast-Time Simulation

This research provides a preliminary analysis of various separation standards for Urban Air Mobility (UAM) operations. This study focuses on understanding and analyzing potential conflicts between UAM flights and conflicts between UAM and conventional aircraft. Fast-time simulations are conducted with a projected high-density of UAM traffic scenario and historical conventional non-UAM traffic flying under Instrument Flight Rules (IFR) or Visual Flight Rules (VFR) in Dallas Fort Worth (DFW) airspace. The conflicts are analyzed by examining losses of separation and near mid-air collisions of UAM flights and unmitigated risk of collision. A set of varied separation standards are used to investigate the impact of the new UAM operations on safety. The preliminary conflict analysis results will help inform separation standards development and in airspace and route design activities for future UAM operations.

Urban Air Mobility↗
NASA NTRSDate not supplied

Confidence-Based Buffer for Strategic Deconfliction with Probabilistic Operational Intent

This paper presents a methodology to expand the 95% confidence level of the elliptical geometry given by Unmanned Aircraft System (UAS) operators planning to fly Beyond Visual Line of Sight (BVLOS) to any confidence level before being fed to the strategic deconfliction (SD) module, effectively increasing the separation buffer between Operational Intents (OIs). To assess the performance of this approach, it is integrated within an adaptation of the Rolling Horizon with K-Position Search volume-based strategic deconfliction approach, previously developed at NASA Ames, preventing the 4D overlapping of OIs shaped by ellipses instead of traditional blocks. Safety and efficiency metrics are evaluated through the deconfliction of four simulated package delivery route network structures across the San Francisco Metropolitan Area with increasing numbers of crossing waypoints (network complexity). Safety assessment entails the in-house creation of a metric to quantify collision occurrences per flight hour based on the frequency at which the probabilistic operational volume segments are sampled, whereas efficiency is measured using ground delay. Results indicate that the largest buffer growth occurs when increasing the confidence level beyond 99.9% and demonstrate the negative impact of network complexity on both metrics, regardless of the OI geometry. Further, the ellipse-based SD adaptation more accurately estimates temporal separation at crossings, allowing deconflicted vehicles to be closer together. It is concluded that the proposed methodology enables the desired confidence level to serve as an effective controller of buffer size.

strategic deconfliction↗
NASA NTRSDate not supplied

Safety Benefit Analysis of Conformance Monitoring for Situation Awareness in UTM

This work presents an analytical approach to address situations in drone operations when strategic coordination alone cannot ensure safety, requiring support from the Conformance Monitoring for Situation Awareness service and potentially other deconfliction services. This study focuses on evaluating the impact of off-nominal operations on both UA-to-UA collision risk and ground injury risk. It first establishes a relationship between the likelihood of off-nominal flights and the effectiveness of strategic coordination. The analysis then derives operational conditions where strategic coordination alone is insufficient to meet target safety requirements, particularly when the likelihood of off-nominal operations exceeds a certain threshold. The results indicate that higher operational tempo or density requires a lower likelihood of offnominal operations for strategic coordination to remain effective and meet safety targets. These findings provide quantitative operational thresholds for when CMSA services are necessary. This work contributes to the safety case for both strategic coordination and CMSA services, offering analysis on when CMSA should be employed to support strategic coordination in achieving the desired safety levels. It also establishes a framework for incorporating other deconfliction services in future safety case analyses.

Strategic deconfliction↗
NASA NTRSDate not supplied

Confidence-Based Buffer for Strategic Deconfliction with Probabilistic Operational Intent

This paper presents a methodology to expand the 95% confidence level of the elliptical geometry given by Unmanned Aircraft System (UAS) operators planning to fly Beyond Visual Line of Sight (BVLOS) to any confidence level before being fed to the strategic deconfliction (SD) module, effectively increasing the separation buffer between Operational Intents (OIs). To assess the performance of this approach, it is integrated within an adaptation of the Rolling Horizon with K-Position Search volume-based strategic deconfliction approach, previously developed at NASA Ames, preventing the 4D overlapping of OIs shaped by ellipses instead of traditional blocks. Safety and efficiency metrics are evaluated through the deconfliction of four simulated package delivery route network structures across the San Francisco Metropolitan Area with increasing numbers of crossing waypoints (network complexity). Safety assessment entails the in-house creation of a metric to quantify collision occurrences per flight hour based on the frequency at which the probabilistic operational volume segments are sampled, whereas efficiency is measured using ground delay. Results indicate that the largest buffer growth occurs when increasing the confidence level beyond 99.9% and demonstrate the negative impact of network complexity on both metrics, regardless of the OI geometry. Further, the ellipse-based SD adaptation more accurately estimates temporal separation at crossings, allowing deconflicted vehicles to be closer together. It is concluded that the proposed methodology enables the desired confidence level to serve as an effective controller of buffer size.

safety↗
NASA NTRSDate not supplied

Safety Benefit Analysis of Conformance Monitoring for Situation Awareness in UTM

This work presents an analytical approach to address situations in drone operations when strategic coordination alone cannot ensure safety, requiring support from the Conformance Monitoring for Situation Awareness service and potentially other deconfliction services. This study focuses on evaluating the impact of off-nominal operations on both UA-to-UA collision risk and ground injury risk. It first establishes a relationship between the likelihood of off-nominal flights and the effectiveness of strategic coordination. The analysis then derives operational conditions where strategic coordination alone is insufficient to meet target safety requirements, particularly when the likelihood of off-nominal operations exceeds a certain threshold. The results indicate that higher operational tempo or density requires a lower likelihood of offnominal operations for strategic coordination to remain effective and meet safety targets. These findings provide quantitative operational thresholds for when CMSA services are necessary. This work contributes to the safety case for both strategic coordination and CMSA services, offering analysis on when CMSA should be employed to support strategic coordination in achieving the desired safety levels. It also establishes a framework for incorporating other deconfliction services in future safety case analyses.

Strategic deconfliction↗