Scoping, Tailoring, and Abstraction Refinement in Hazard Assessment Processes

Mallory Graydon; Natasha Neogi; Frank McCormick

NASA NTRS · 20240004263

Scoping, Tailoring, and Abstraction Refinement in Hazard Assessment Processes

Mallory Graydon·Natasha Neogi·Frank McCormick

Abstract

Hazard assessment is an engineering activity that produces insight into which states of thing being engineered might be hazardous. In aviation contexts, it is often performed for certification credit at both the aircraft and system levels during the early design phase of the system’s lifecycle. However, novel aircraft paradigms such as urban air mobility (UAM)operations might either violate assumptions on which traditional aviation hazard assessment is based or simply possess attributes that would make other approaches more effective. In this paper, we define the key concepts under pinning hazard assessment and identify the limitations and assumptions inherent in hazard analysis. We analyze popular techniques to show how they embody these key concepts. We identify ways in which hazard assessment may be scoped and tailored to an application. And, using worked examples, we discuss how, where, and why such tailoring might be needed, especially in novel contexts.

Explore related subjects

aviation safety eVTOL hazard analysis

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Mallory Graydon, Natasha Neogi, Frank McCormick. Scoping, Tailoring, and Abstraction Refinement in Hazard Assessment Processes. https://ntrs.nasa.gov/citations/20240004263

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2024

Assessment of Some IASMS-relevant Data Sources for Aviation Safety

An In-time Aviation Safety Management System (IASMS) [1,2] is a set of services, functions, and capabilities (SFCs) necessary for monitoring known hazards and emergent risks, assessing safety data for anomalies, precursors, and trends, mitigating hazards that reach safety thresholds, and assuring efficacy of controls in mitigating hazards. An IASMS will continually monitor the NAS to collect data on the status of aircraft, air traffic management systems, weather, and airports. Within the NASA Aeronautics Research Mission Directorate (ARMD) System-Wide Safety (SWS) project’s technical challenge called In-time Aviation Safety Management Systems (IASMS) for Commercial Aviation Operations, which we often refer to as Technical Challenge 6 (TC-6), we have performed an assessment of several aviation data sources we have found that are relevant to assessing the safety of the National Airspace System (NAS) in the context of an IASMS. This assessment includes understanding the nature of the data themselves and using some data analytics tools on these data to show how they can be used to identify potential safety issues. We also describe how the data and analytics are part of a system that can allow for other data and analytics to be performed and for the results to be visualized for use by appropriate operators to identify potential safety issues and develop mitigations. This report is a step toward the ultimate goal of TC-6, which is to develop a prototype IASMS system that demonstrates the potential of an IASMS and inspire operators to build analogous systems to make the best possible use of the significant investments that they make in collecting, storing, and managingdata related to their operations.

aviation safety↗

NASA NTRS2021

CAST SE211 Training for Attention Management Final Report

Explore the source record for details and available documents.

aviation safety↗

NASA NTRS2019

Ask-The-Expert: Minimizing Human Review for Big Data Analytics Through Active Learning

In this CIF project, we worked toward semi-automating knowledge discovery from anomaly detection algorithms through the use of active learning. Active learning is an area of research within machine learning that uses an "expert in the loop" to learn from large data sets that have very few annotations or labels available, and where providing such labels is expensive. In our case, the task can be defined as the identification of safety events from flight operational data. Since traditional anomaly detection algorithms cannot differentiate between operationally relevant and irrelevant statistical anomalies, Subject Matter Experts (SMEs) have a lengthy and expensive burden of investigating every example identified by the detection algorithm, classifying and labeling them as relevant or irrelevant. Active learningidentifies the unlabeled example for which a label would most improve the classifier, asks the domain expert for a label, and repeats this process until there are no more resources (time, budget) available for labeling or a minimum required performance is reached. A positive label indicates an operationally significant safety event whereas a negative label indicates otherwise. Based on these few labels we propose to build an active learning system that utilizes the SME's time in the most effective manner by iteratively asking for labels for as few informative instances as possible. Our work was proposed to be a stepping stone toward implementation and deployment of the system with user interface to be pursued by the Aviation Operations and Safety Program (AOSP) given its interest in safety monitoring and discovery of safety incidents.

aviation safety↗