Establishing the Assurance Efficacy of Automated Risk Mitigation Strategies
Explore the source record for details and available documents.
Increasingly Autonomous Systems↗
Engineering topics
Natasha Neogi
Publications and source records attributed to Natasha Neogi.
Safety and Certification in Increasingly Autonomous Aviation Systems
Explore the source record for details and available documents.
System Safety↗
Formalized Reasoning of Operational Volumes for Wildland Fire Fighting
This work is focused on the formalized reasoning of operational volumes as it relates to the current and future technologies developed by NASA to aid in wildfire fighting operations. One such technology is the unmanned aircraft system pilot kit (UASP-kit) developed by the Scalable Traffic Management for Emergency Response Operations (STEReO) project at NASA, which is used to increase situation awareness for a ground operator in the field. The UASP-kit utilizes operational volumes which represent mission areas and alerting volumes, to alert when another aircraft is within one of these volumes from received ADS-B data. This work is focused on developing a rigorous foundation for the concept of operational volumes for modeling and prototyping operations in such a tool as the UASP-kit. This includes establishing a class of algorithms to detect when an object is in an operational volume, and when an operational volume is intersecting or contained within another. Additionally, this work is focused on providing rigorous proof in an interactive theorem prover that the algorithms work as intended. Scenarios are presented that model current UASP-kit operations and extend past the current capabilities of the technology to modeling more complex scenarios such as mission planning.
Operational Volumes↗
Formalized Reasoning of Operational Volumes for Wildland Fire Fighting
This work is focused on the formalized reasoning of operational volumes as it relates to the current and future technologies developed by NASA to aid in wildland firefighting operations. One such technology is the Unmanned Aircraft System Pilot Kit (UASP-kit) developed by the Scalable Traffic Management for Emergency Response Operations (STEReO) project at NASA, which is used to increase situational awareness for a ground operator in the field. The UASP-kit utilizes operational volumes to represent mission areas and alerting volumes; these volumes, in combinations with ADS-B data, can then be used to alert the ground operator when another aircraft has entered one of these areas. This work presents a rigorous foundation for the concept of operational volumes for modeling and prototyping operations in such a tool as the UASP-kit. This includes establishing a class of algorithms to detect when an object is in an operational volume, and when one operational volume intersects or is contained in another. Additionally, this work provides rigorous proof that the algorithms work as intended. Scenarios are presented that model current UASP-kit operations and extend past the current capabilities of the technology to modeling more complex scenarios such as mission planning.
Operational Volumes↗
Safety Expertise and the Perils of Novelty
Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.
safety expertise↗
Safety Demonstrator Series for Operational In-Time Aviation Safety Management System (IASMS)
Explore the source record for details and available documents.
Safety Management Systems↗
Standards for AI/ML and Emerging Technologies
Standards development activities require a keen and deep understanding of the problem being solved by the standard as well as the technologies being deployed in any reference implementation of the solution. It is important to understand the mechanisms and limits of the fundamental, underlying science of implementation and verification technologies used to realize and assure systems. We need to understand the limits of what current process and metrics can provide with respect to new technologies. US leadership is important in this endeavor, and it is vital that we have a measured approach that yields sound results. We wish to start with simple, well-defined, non-safety critical applications and then progress to functions which have (1) clearly defined requirements, (2) means of checking the answer/output, and (3) means of intervention and mitigation of incorrect answers/outputs.
Standards Development↗
AssistTaxi: A Comprehensive Dataset for Taxiway Analysis and Autonomous Operations
The availability of high-quality datasets play a crucial role in advancing research and development especially, for safety critical and autonomous systems. This poster presents AssistTaxi, which is a comprehensive novel dataset which is a collection of images for runway and taxiway analysis. The dataset comprises of more than 300,000 frames of diverse and carefully collected data, gathered from Melbourne (MLB) and Grant-Valkaria (X59) general aviation airports. The importance of AssistTaxi lies in its potential to advance autonomous operations, enabling researchers and developers to train and evaluate algorithms for efficient and safe taxiing. Researchers can utilize AssistTaxi to benchmark their algorithms, assess performance, and explore novel approaches for runway and taxiway analysis. Additionally, the dataset serves as a valuable resource for validating and enhancing existing algorithms as well as facilitating innovation in autonomous operations for aviation. We also propose an initial approach to label the dataset using a contour based detection and line extraction technique.
Data Collection↗
Developing Standards for AI/ML Systems in Civil Aviation: Challenges and Barriers
The inability to establish appropriate assurance methods for AI/ML components in safety critical systems leaves us unable to effectively manage the risks and benefits of such systems. It drives cost of development for systems with AI/ML components uneconomically high, it delays the adoption of systems with AI/ML components at scale, and it can result in catastrophic consequences in terms of the safety of systems with AI/ML components. In this presentation we will explore what constitutes sufficient scientific-based evidence to substantiate a safety claim related to an AI/ML component performing a safety-critical function.
AI/ML Standards↗
Approach and Guiding Principles for Developing AI/ML Components and their Standards
The objective of the AI Roadmap meeting is to engage with all stakeholders in aviation in an open conversation about our approach and the guiding principles that can help us in moving forward in the technological landscape of AI/ML. The objective of the Technical Exchange Meeting is to identify categories of safety concerns associated with having an AI component in the aircraft we identified in the previous Technical Exchange Meeting on January 24, 2024. This presentation is to spur the discussion regarding the use of AI/ML in civil aviation and stimulate active participation with all stakeholders.
AI/ML↗
Assurance Issues in Developing AI/ML Components (and their Standards) for Civil Aviation
Standards development activities require a keen and deep understanding of the problem being solved by the standard as well as the technologies being deployed in any reference implementation of the solution. It is important to understand the mechanisms and limits of the fundamental, underlying science of implementation and verification technologies used to realize and assure systems. We need to understand the limits of what current process and metrics can provide with respect to new technologies. US leadership is important in this endeavor, and it is vital that we have a measured approach that yields sound results. We wish to start with simple, well-defined, non-safety critical applications and then progress to functions which have (1) clearly defined requirements, (2) means of checking the answer/output, and (3) means of intervention and mitigation of incorrect answers/outputs.
Aviation Safety↗
Scoping, Tailoring, and Abstraction Refinement in Hazard Assessment Processes
Hazard assessment is an engineering activity that produces insight into which states of thing being engineered might be hazardous. In aviation contexts, it is often performed for certification credit at both the aircraft and system levels during the early design phase of the system’s lifecycle. However, novel aircraft paradigms such as urban air mobility (UAM)operations might either violate assumptions on which traditional aviation hazard assessment is based or simply possess attributes that would make other approaches more effective. In this paper, we define the key concepts under pinning hazard assessment and identify the limitations and assumptions inherent in hazard analysis. We analyze popular techniques to show how they embody these key concepts. We identify ways in which hazard assessment may be scoped and tailored to an application. And, using worked examples, we discuss how, where, and why such tailoring might be needed, especially in novel contexts.
aviation safety↗
Scoping, Tailoring, and Abstraction Refinement in the Hazard Assessment Process
Hazard assessment is an engineering activity that produces insight into which states of thing being engineered might be hazardous. In aviation contexts, it is often performed for certification credit at both the aircraft and system levels during the early design phase of the system’s lifecycle. However, novel aircraft paradigms such as urban air mobility (UAM) operations might either violate assumptions on which traditional aviation hazard assessment is based or simply possess attributes that would make other approaches more effective. In this paper, we define the key concepts underpinning hazard assessment and identify the limitations and assumptions inherent in hazard analysis. We analyze popular techniques to show how they embody these key concepts. We identify ways in which hazard assessment may be scoped and tailored to an application. And, using worked examples, we discuss how, where, and why such tailoring might be needed, especially in novel contexts.
Aviation Safety↗
NASA Research to Expand UAS Operations for Disaster Response
Natural disasters can result in the loss of life and cost governments and private industry billions to recover each year. Over the past decade the rate and severity of natural disasters such as wildfires and hurricanes have resulted in increasingly negative impacts to communities, public health, natural ecosystems, and the economy. To help reduce these impacts, NASA’s Aeronautics Research Mission Directorate is working to advance technologies and enable the safe and efficient inclusion of novel aviation applications to better assist in disaster response. To execute on these efforts, NASA’s Advanced Capabilities for Emergency Response Operations (ACERO) and System-Wide Safety (SWS) projects have developed coordinated strategic research plans focused on aviation operations for disaster response. The ACERO project will be a multi-year effort that focuses on enabling the use of uncrewed aircraft systems (UAS) to improve firefighter safety and efficiency and enable the use of UAS to conduct new missions such as logistics and aerial suppression. The ACERO project will demonstrate technologies that support the Second Shift concept, enabling UAS and ground technologies to support aerial suppression in degraded visual conditions (e.g., heavy smoke, nighttime). The SWS project will be a multi-year effort that focuses on addressing the key safety barriers that are preventing the authorization of UAS operations in a variety of increasingly complex disaster response applications: post-hurricane response, medical courier, and urban disaster response. The SWS project will demonstrate an In-Time Aviation Safety Management System (IASMS) designed to effectively monitor, assess, and mitigate safety risks associated with hazards to UAS operations for disaster response. This paper will provide a deeper insight into NASA’s research and development plans and discuss how solutions developed in partnership with industry stakeholders and federal agencies will improve disaster response across the globe.
disaster response↗
In-Time Aviation Safety Management Systems (IASMS) for Advanced Air Mobility
The goal of the presentation is to explore the role of safety intelligence and safety performance management in continuous improvement of safety across the developing AAM ecosystem.
Safety management systems↗
AI/ML Components in Safety-Critical Aviation Systems: Selected Concepts and Underlying Principles
The objective of the AI Roadmap meeting is to engage with all stakeholders in aviation in an open conversation about our approach and the guiding principles that can help us in moving forward in the technological landscape of AI/ML. The objective of the Technical Exchange Meeting is to identify categories of safety concerns associated with having an AI component in the aircraft we identified in the previous Technical Exchange Meetings. The speakers will bring their experience to the discussion to stimulate active participation with all stakeholders.
Design Safety↗
NASA Research to Expand UAS Operations for Disaster Response
Explore the source record for details and available documents.
UAS↗
Separation Assurance in Urban Air Mobility Systems Using Shared Scheduling Protocols
Ensuring safe separation between aircraft is a critical challenge in air traffic management, particularly in urban air mobility (UAM) environments where high traffic density and low altitudes require precise control. In these environments, conflicts often arise at the intersections of flight corridors, posing significant risks. We propose a tactical separation approach leveraging shared scheduling protocols, originally designed for Ethernet networks and operating systems, to coordinate access to these intersections. Using a decentralized Markov decision process framework, the proposed approach enables aircraft to autonomously adjust their speed and timing as they navigate these critical areas, maintaining safe separation without a central controller. We evaluate the effectiveness of this approach in simulated UAM scenarios, demonstrating its ability to reduce separation violations to zero while acknowledging trade-offs in flight times as traffic density increases. Additionally, we explore the impact of non-compliant aircraft, showing that while shared scheduling protocols can no longer guarantee safe separation, they still provide significant improvements over systems without scheduling protocols.
Separation Assurance↗