SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation reviews voluntary safety reports received by NASA's Aviation Safety Reporting System pertaining to aircraft taxi, tow, or pushback incidents during maintenance operations.
Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential system that disseminates reports received from personnel involved in aviation operations after de-identifying them. These reports are used by the community to improve overall aviation system safety. Aim: We propose and execute an experiment to assess the use of seed term topic modeling over the database narratives to identify Unmanned Aircraft System (UAS) reports. The use of seed term topic modeling enables users to identify groups of conceptually similar narratives associated to a topic of their interest. Method: We use a collection of narratives, expert-selected words, and report metadata that separates UAS from non-UAS reports to assess if seed topic modeling can be used to improve ASRS searches. Results: For simpler queries, seed topic search observes a higher recall and lower precision than the existing DBOL (DataBase OnLine) search in operation. However, the best results are obtained when seed topic search is used as a search suggestion system to be executed on the DBOL. Conclusion: Utilizing a combination of both the existing method and the proposed method, users can expand their search vocabulary about subjects of interest while improving the quality of results.
Context: The NASA Aviation Safety Reporting System (ASRS) is a voluntary confidential system that disseminates reports received from personnel involved in aviation operations after de-identifying them. These reports are used by the community to improve overall aviation system safety. Aim: We propose and execute an experiment to assess the use of seed term topic modeling over the database narratives to identify Unmanned Aircraft System (UAS) reports. The use of seed term topic modeling enables users to identify groups of conceptually similar narratives associated to a topic of their interest. Method: We use a collection of narratives, expert-selected words, and report metadata that separates UAS from non-UAS reports to assess if seed topic modeling can be used to improve ASRS searches. Results: For simpler queries, seed topic search observes a higher recall and lower precision than the existing DBOL (DataBase OnLine) search in operation. However, the best results are obtained when seed topic search is used as a search suggestion system to be executed on the DBOL. Conclusion: Utilizing a combination of both the existing method and the proposed method, users can expand their search vocabulary about subjects of interest while improving the quality of results.
The Aviation Safety Reporting System (ASRS) was established in 1976 under an agreement between the Federal Aviation Administration (FAA) and the National Aeronautics and Space Administration (NASA). This cooperative safety program invites pilots, air traffic controllers, flight attendants, maintenance personnel, and others to voluntarily report to NASA any aviation incident or safety hazard. The FAA provides most of the program funding. NASA administers the program, sets its policies in consultation with the FAA and aviation community, and receives the reports submitted to the program. The FAA offers those who use the ASRS program two important reporting guarantees: confidentiality and limited immunity. Reports sent to ASRS are held in strict confidence. More than 350,000 reports have been submitted since the program's beginning without a single reporter's identity being revealed. ASRS removes all personal names and other potentially identifying information before entering reports into its database. This system is a very successful, proof-of-concept for gathering safety data in order to provide timely information about safety issues. The ASRS information is crucial to aviation safety efforts both nationally and internationally. It can be utilized as the first step in safety by providing the direction and content to informed policies, procedures, and research, especially human factors. The ASRS process and procedures will be presented as one model of safety reporting feedback systems.
This presentation provides an overview of NASA's Aviation Safety Reporting System (ASRS) for Unmanned Aviation Systems / drones
While many existing taxonomies and frameworks provide a common vocabulary for describing how human operators fail in the context of sociotechnical systems, at present, there is no common vocabulary to describe how humans succeed. Such a framework would facilitate systematically collecting and analyzing data on how human performance can produce safety, not just how it can reduce safety. One potentially rich source of currently available information for exploring desired performance is the reports submitted to NASA’s Aviation Safety Reporting System (ASRS). These de-identified, confidential, and voluntary narrative reports are submitted by pilots, controllers, ground operators, and others within aviation operations. While these reports are primarily submitted to describe safety risks, incidents, and problems, they also often describe how those risks were mitigated, and provide a window into aspects of everyday work in aviation. These reports can be searched in a variety of ways. This paper describes methods for systematically examining ASRS narratives to understand how operators talk about their own resilient behaviors during adverse safety conditions and events. Guided by Erik Hollnagel’s Resilience Assessment Grid framework (i.e., anticipate, monitor, respond, learn), various approaches and tools for such inquiries are described. The approach, process, challenges, and suggestions to building an operator-based description of resilient performance are discussed, and tools to facilitate data analysis to maximize learning from these reports are described.
Context: The NASA Aviation and Safety Reporting System (ASRS) provides various publications to the aviation community (including individual anonymous reports, Callback, Database Search Requests, Directline, and Alerting Messages). Key to these publications are the timely processing of new reports, which is currently done mostly manually by ASRS staff, and which the volume increases yearly. Aim: We investigate whether existing topic modelling techniques are suitable to ease some of the manual effort, and to enhance it with additional visual cues regarding the process of grouping, sense making and labeling incoming (and previous) reports. Method: We evaluate the applicability of WarpLDA topic modelling results combined with three visualization tools, the first two of which have been extended by us in this work for ASRS: Termite, TopicFlow, and LDAVis. Based on the identified limitations in these tools, we propose a methodology for improving them, and evaluate their outputs using ASRS as our test dataset. Results: The user interfaces of Termite, Topicflow and LDAVis were found insufficient for sense-making of the narratives. Moreover, concerns regarding the stability of results due to the inherent randomness of topic modelling, and the lack of a measurable approach for evaluation against the existing ASRS manual workflow were also noted. Conclusion: While many tools to topic modeling and visualization have been proposed, more work is necessary before they can be applied in practical situations to improve existing manual workflows. The methodology presented and applied in this work contribute towards this effort.
No abstract available
While many existing taxonomies and frameworks provide a common vocabulary for describing how human operators fail in the context of sociotechnical systems, at present, there is no common vocabulary to describe how humans succeed. Such a framework would facilitate systematically collecting and analyzing data on how human performance can produce safety, not just how it can reduce safety. One potentially rich source of currently available information for exploring desired performance is the reports submitted to NASA’s Aviation Safety Reporting System (ASRS). These de-identified, confidential, and voluntary narrative reports are submitted by pilots, controllers, ground operators, and others within aviation operations. While these reports are primarily submitted to describe safety risks, incidents, and problems, they also often describe how those risks were mitigated, and provide a window into aspects of everyday work in aviation. This paper describes an analysis of ASRS narratives to understand how operators talk about their own resilient behaviors during adverse safety conditions and events. Guided by Erik Hollnagel’s Resilience Assessment Grid framework (i.e., anticipate, monitor, respond, learn), we illustrate our approach and methodology with examples from reports. We also highlight some of the challenges and how further research is needed in developing a taxonomy of operators’ descriptions of resilient performance.
Confidential reports of maintenance incidents are a valuable source of information on maintenance errors and the contexts within which they occur. NASA's Aviation Safety Reporting System (ASRS) has been receiving an increasing number of maintenance incident reports since a specialized maintenance reporting form was introduced in 1996. In a series of studies, the database of ASRS maintenance incidents was examined using correspondence analysis, a statistical technique that converts complex data tables into a visual form. The analyses revealed patterns within the ASRS data set that would have otherwise been difficult to detect. The results have implications for a range of purposes including human factors training, the design of procedures, and the identification of improvements in aircraft design.
The rationale for aviation incident reporting systems is presented and contrasted to some of the shortcomings of accident investigation procedures. The history of the United State's Aviation Safety Reporting System (ASRS) is outlined and the program's character explained. The planning elements that resulted in the ASRS program's voluntary, confidential, and non-punitive design are discussed. Immunity, from enforcement action and misuse of the volunteered data, is explained and evaluated. Report generation techniques and the ASRS data analysis process are described; in addition, examples of the ASRS program's output and accomplishments are detailed. Finally, the value of incident reporting for the acquisition of safety information, particularly human error data, is explored.
An overview is presented of the growth and role of automation in civil aircraft operations for both cockpit management and ground control. NASA has initiated a research program centered on furthering automation and developing a consistent and rational philosophy of human centered aircraft and air traffic control automation. Introduction of the NASA Aviation Safety Reporting System (ASRS) has proved successful in bringing together pilots and ground controllers to report incidents of operational anomalies that can then be analyzed, leading to corrective action to prevent similar reoccurrences. Attention is given to the growing trend of extensive automation in the cockpit that appears to be leading to a diminution of management control of the aircraft by the decreasing number of flight crew members. A majority of reports indicate that there is a serious mismatch between new aircraft capabilities and ATC procedures, which were designed for older aircraft. ASRS has also kept research oriented toward real problems and community needs.
We applied a standard classification algorithm to a subset of NASA/FAA Aviation Safety Reporting System (ASRS) database. The subset concerned incidents of aircraft altitude deviations. We are exploring the database to address questions such as: Are there 'natural' classes into which the data will fall? How would these classes correspond to recognizable events or situations? Beyond addressing these we want the data to determine directions for further study. We conducted experiments on different data subsections and analyzed diagnostics such as 'message length reduction'; these characterize the classification in terms of its significance and information content. The classification effort was successful in revealing relationships in the data that were in consonance with other studies of the data and expert opinion.
An exploratory study was conducted to identify commercial aviation incidents that are relevant to a "controlled flight into terrain" (CFIT) accident using a NASA-developed text processing method. The QUORUM method was used to rate 67820 incident narratives, virtually all of the narratives in the Aviation Safety Reporting System (ASRS) database, according to their relevance to two official reports on the crash of American Airlines Flight 965 near Cali, Colombia in December 1995. For comparison with QUORUM's ratings, three experienced ASRS analysts read the reports of the crash and independently rated the relevance of the 100 narratives that were most highly rated by QUORUM, as well as 100 narratives randomly selected from the database. Eighty-four of 100 QUORUM-selected narratives were rated as relevant to the Cali accident by one or more of the analysts. The relevant incidents involved a variety of factors, including, over-reliance on automation, confusion and changes during descent/approach, terrain avoidance, and operations in foreign airspace. In addition, the QUORUM collection of incidents was found to be significantly more relevant than the random collection.
The EMS flight environment is unique in today's aviation. The pilots must respond quickly to emergency events and often fly to landing zones where they have never been before . The time from initially receiving a call to being airborne can be as little as two to three minutes. Often the EMS pilot is the only aviation professional on site, they have no operations people or other pilots to aid them in making decisons. Further, since they are often flying to accident scenes, not airports, there is often complete weather and condition information. Therefore, the initial decision that the pilot must make, accepting or declining a flight, can become very difficult. The accident rate of EMS helicopters has been relatively high over the past years. NASA-Ames research center has taken several steps in an attempt to aid EMS pilots in their decision making and situational awareness. A preflight risk assessment system (SAFE) was developed to aid pilots in their decision making, and was tested at an EMS service. The resutls of the study were promising and a second version incorporating the lessons learned is under development. A second line of research was the development of a low cost electronic chart display (ECD). This is a digital map display to help pilots maintain geographical orientation. Another thrust was undertaken in conjunction with the Aviation Safety Reporting System (ASRS). This involved publicizing the ASRS to EMS pilots and personnel, and calling each of the reporters back to gather additional information. This paper will discuss these efforts and how they may positively impact the safety of EMS operations.
We present a study of weather-related incident reports submitted to NASA’s Aviation Safety Reporting System (ASRS) by air carrier pilots in the US. Using specific examples, we examine the relevant aspects of human performance and resilience management exhibited during these incidents. We describe the common narrative about human error and how ASRS data can be used to change it.
A model has been developed which represents prominent reporter concerns expressed in the narratives of 300 mode-related incident reports from NASA's Aviation Safety Reporting System (ASRS). The model objectively quantifies the structure of concerns which persist across situations and reporters. These concerns are described and illustrated using verbatim sentences from the original narratives. Report accession numbers are included with each sentence so that concerns can be traced back to the original reports. The results also include an inventory of mode names mentioned in the narratives, and a comparison of individual and joint concerns. The method is based on a proximity-weighted co-occurrence metric and object-oriented complexity reduction.
To support Search Requests and Quick Responses at the Aviation Safety Reporting System (ASRS), four new QUORUM methods have been developed: keyword search, phrase search, phrase generation, and phrase discovery. These methods build upon the core QUORUM methods of text analysis, modeling, and relevance-ranking. QUORUM keyword search retrieves ASRS incident narratives that contain one or more user-specified keywords in typical or selected contexts, and ranks the narratives on their relevance to the keywords in context. QUORUM phrase search retrieves narratives that contain one or more user-specified phrases, and ranks the narratives on their relevance to the phrases. QUORUM phrase generation produces a list of phrases from the ASRS database that contain a user-specified word or phrase. QUORUM phrase discovery finds phrases that are related to topics of interest. Phrase generation and phrase discovery are particularly useful for finding query phrases for input to QUORUM phrase search. The presentation of the new QUORUM methods includes: a brief review of the underlying core QUORUM methods; an overview of the new methods; numerous, concrete examples of ASRS database searches using the new methods; discussion of related methods; and, in the appendices, detailed descriptions of the new methods.