Search NASA⌕ Search

SEARCH · Search NASA

Results for “System Safety Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

NASA Aviation Safety Program Systems Analysis/Program Assessment Metrics Review

The goal of this project is to evaluate the metrics and processes used by NASA's Aviation Safety Program in assessing technologies that contribute to NASA's aviation safety goals. There were three objectives for reaching this goal. First, NASA's main objectives for aviation safety were documented and their consistency was checked against the main objectives of the Aviation Safety Program. Next, the metrics used for technology investment by the Program Assessment function of AvSP were evaluated. Finally, other metrics that could be used by the Program Assessment Team (PAT) were identified and evaluated. This investigation revealed that the objectives are in fact consistent across organizational levels at NASA and with the FAA. Some of the major issues discussed in this study which should be further investigated, are the removal of the Cost and Return-on-Investment metrics, the lack of the metrics to measure the balance of investment and technology, the interdependencies between some of the metric risk driver categories, and the conflict between 'fatal accident rate' and 'accident rate' in the language of the Aviation Safety goal as stated in different sources.

Louis, Garrick E.↗
NASA NTRS1993

Development of a methodology for assessing the safety of embedded software systems

A Dynamic Flowgraph Methodology (DFM) based on an integrated approach to modeling and analyzing the behavior of software-driven embedded systems for assessing and verifying reliability and safety is discussed. DFM is based on an extension of the Logic Flowgraph Methodology to incorporate state transition models. System models which express the logic of the system in terms of causal relationships between physical variables and temporal characteristics of software modules are analyzed to determine how a certain state can be reached. This is done by developing timed fault trees which take the form of logical combinations of static trees relating the system parameters at different point in time. The resulting information concerning the hardware and software states can be used to eliminate unsafe execution paths and identify testing criteria for safety critical software functions.

Garrett, C. J.↗
NASA NTRS2011

L-Band Digital Aeronautical Communications System Engineering - Initial Safety and Security Risk Assessment and Mitigation

This document is being provided as part of ITT's NASA Glenn Research Center Aerospace Communication Systems Technical Support (ACSTS) contract NNC05CA85C, Task 7: "New ATM Requirements--Future Communications, C-Band and L-Band Communications Standard Development." ITT has completed a safety hazard analysis providing a preliminary safety assessment for the proposed L-band (960 to 1164 MHz) terrestrial en route communications system. The assessment was performed following the guidelines outlined in the Federal Aviation Administration Safety Risk Management Guidance for System Acquisitions document. The safety analysis did not identify any hazards with an unacceptable risk, though a number of hazards with a medium risk were documented. This effort represents a preliminary safety hazard analysis and notes the triggers for risk reassessment. A detailed safety hazards analysis is recommended as a follow-on activity to assess particular components of the L-band communication system after the technology is chosen and system rollout timing is determined. The security risk analysis resulted in identifying main security threats to the proposed system as well as noting additional threats recommended for a future security analysis conducted at a later stage in the system development process. The document discusses various security controls, including those suggested in the COCR Version 2.0.

Zelkin, Natalie↗
NASA NTRSDate not supplied

Development of a Safety Hazards Risk Assessment Tool for Uncrewed Aircraft System Traffic Management during Preflight Planning

Tremendous growth in the uncrewed and remotely piloted vehicle market is expected in low-altitude, uncontrolled airspace, resulting in potential decreases in safety without systems that support monitoring, assessing, and mitigating risk. At NASA, the System-Wide Safety (SWS) project has been developing a suite of data-driven tools to predict hazards so that the potential risks that these hazards pose can be mitigated. Services to predict various hazards have been developed, including battery capacity, proximity to static obstacles, population risks, global positioning system signal strength, radio frequency spectrum interference risk, and vertiport congestion. These services can monitor hazards along a flight path and if any risks posed by these hazards exceed a threshold, the uncrewed aircraft system (UAS) fleet manager can be alerted to mitigate the risk by modifying the flight path, changing the scheduled departure or arrival times, and/or diverting the vehicle to an alternate vertiport. These services were originally developed to monitor and assess risks during flight, but they have been adapted to assess hazard risks prior to departure so that a fleet manager can evaluate the potential risks for a fleet of UAS along their planned flight paths. These services have been integrated into a prototype tool called the Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD), developed at NASA Ames Research Center. The tool consists of a dashboard which provides a comprehensive overview for a number of risks and a map display that shows the details of the hazards along each flight’s path. Based on the findings from three previous studies, the SDSP-CD has been updated with new design elements and functions. In this paper, we describe lessons learned from the previous studies, changes made to the interface, and the feedback received during a follow-up usability study. Overall, participants reported that there is a substantial benefit of having a fleet manager use a consolidated dashboard to assess hazards for the vehicles in their fleet and to provide situational awareness to potential risks so that they can be mitigated prior to flight. Once the SDSP-CD matures, it will need to be integrated into flight and mission planning tools. Some initial thoughts on how this integration should be accomplished are shared in this paper. Finally, the functional differences between preflight vs. in-flight risk assessment and the differences in fleet manager vs. UAS pilot roles that may require different information and user interactions are discussed.

preflight↗
NASA NTRS2011

C-Band Airport Surface Communications System Engineering-Initial High-Level Safety Risk Assessment and Mitigation

This document is being provided as part of ITT's NASA Glenn Research Center Aerospace Communication Systems Technical Support (ACSTS) contract: "New ATM Requirements--Future Communications, C-Band and L-Band Communications Standard Development." ITT has completed a safety hazard analysis providing a preliminary safety assessment for the proposed C-band (5091- to 5150-MHz) airport surface communication system. The assessment was performed following the guidelines outlined in the Federal Aviation Administration Safety Risk Management Guidance for System Acquisitions document. The safety analysis did not identify any hazards with an unacceptable risk, though a number of hazards with a medium risk were documented. This effort represents an initial high-level safety hazard analysis and notes the triggers for risk reassessment. A detailed safety hazards analysis is recommended as a follow-on activity to assess particular components of the C-band communication system after the profile is finalized and system rollout timing is determined. A security risk assessment has been performed by NASA as a parallel activity. While safety analysis is concerned with a prevention of accidental errors and failures, the security threat analysis focuses on deliberate attacks. Both processes identify the events that affect operation of the system; and from a safety perspective the security threats may present safety risks.

Zelkin, Natalie↗
DOE OSTI2020

Overcharge-to-thermal-runaway behavior and safety assessment of commercial lithium-ion cells with different cathode materials: A comparison study

In this paper, overcharge behaviors and thermal runaway (TR) features of large format lithium-ion (Li-ion) cells with different cathode materials (LiFePO 4 (LFP), Li[Ni 1/3 Co 1/3 Mn 1/3 ]O 2 (NCM111), Li[Ni 0.6 Co 0.2 Mn 0.2 ]O 2 (NCM622) and Li[Ni 0.8 Co 0.1 Mn 0.1 ]O 2 (NCM811)) were investigated. The results showed that, under the same overcharge condition, the TR of LFP Li-ion cell occurred earlier compared with the NCM Li-ion cells, indicating its poor overcharge tolerance and high TR risk. However, when TR occurred, LFP Li-ion cell exhibited lower maximum temperature and mild TR response. All NCM Li-ion cells caught fire or exploded during TR, while the LFP Li-ion cell only released a large amount of smoke without fire. According to the overcharge behaviors and TR features, a safety assessment score system was proposed to evaluate the safety of the cells. In short, NCM Li-ion cells have better performance in energy density and overcharge tolerance (or low TR risk), while LFP Li-ion cell showed less severe response to overcharging (or less TR hazards). For NCM Li-ion cells, as the ratio of nickel in cathode material increases, the thermal stability of the cathode materials becomes poorer, and the TR hazards increase. Such a comparison study on large format Li-ion cells with different cathode materials can provide deeper insights into the overcharge behaviors and TR features, and provide guidance for engineers to reasonably choose battery materials in automotive applications.

25 ENERGY STORAGE↗
NASA NTRS2001

A Safety Risk Assessment Methodology for Decision Support Systems with an Application to the Expedite Departure Path Tool

In support of the NASA Advanced Air Transportation Technologies Project, the Volpe National Transportation Systems Center has developed a methodology to perform safety risk assessments for air traffic control/air traffic management decision Support systems and concepts. Changes in controller, pilot, and/or airline dispatcher tasks that are affected by the decision support system are related to associated hazards. These hazards are then assessed either qualitatively or quantitatively in terms of likelihood of occurring and the impact if they do occur. Those items that show a potential safety hazard level increase can then have research plans developed to address those safety risks areas. An application of this methodology will he demonstrated using the AATT decision support tool Expedite Departure Path.

Snyder, Phillip T.↗
DOE OSTI2021

INTEGRATED RISK ASSESSMENT OF DIGITAL I&C SAFETY SYSTEMS FOR NUCLEAR POWER PLANTS

Upgrading the existing analog instrumentation and control (I&C) systems to state-of-the-art digital I&C (DI&C) systems provides the foremost means to improve performance and reduce costs for existing light-water reactors (LWRs). However, qualification of digital technologies remains a challenge?especially the issue of software common cause failure (CCF), which has been difficult to address. Existing analyses of CCFs in I&C systems mainly focus on hardware failures. With the application and upgrading of new DI&C systems, software CCFs due to design flaws might become a potential threat to plant safety, considering that most redundancy designs use similar digital platforms or software in their operating and application systems. With complex multi-layer redundancy designs to meet the single failure criterion, these I&C safety systems are of particular concern in U.S. Nuclear Regulatory Commission (NRC) licensing procedures. In 2019, the Risk-Informed Systems Analysis (RISA) Pathway of the U.S. Department of Energy?s (DOE?s) Light Water Reactor Sustainability (LWRS) Program initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, secure DI&C technologies for digital upgrades/designs. An integrated risk assessment for the DI&C (RADIC) process was proposed for this strategy to identify potential key digital-induced failures, implement reliability analyses of related digital safety I&C systems, and evaluate the unanalyzed sequences introduced by these failures (particularly software CCFs) at the plant level. This paper summarizes these RISA efforts in the risk analysis of safety-related DI& systems at Idaho National Laboratory.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1980

Health and safety: Preliminary comparative assessment of the Satellite Power System (SPS) and other energy alternatives

Data readily available from the literature were used to make an initial comparison of the health and safety risks of a fission power system with fuel reprocessing; a combined-cycle coal power system with a low-Btu gasifier and open-cycle gas turbine; a central-station, terrestrial, solar photovoltaic power system; the satellite power system; and a first-generation fusion system. The assessment approach consists of the identification of health and safety issues in each phase of the energy cycle from raw material extraction through electrical generation, waste disposal, and system deactivation; quantitative or qualitative evaluation of impact severity; and the rating of each issue with regard to known or potential impact level and level of uncertainty.

Habegger, L. J.↗
NASA NTRS2010

SCI Hazard Report Methodology

This slide presentation reviews the methodology in creating a Source Control Item (SCI) Hazard Report (HR). The SCI HR provides a system safety risk assessment for the following Ares I Upper Stage Production Contract (USPC) components (1) Pyro Separation Systems (2) Main Propulsion System (3) Reaction and Roll Control Systems (4) Thrust Vector Control System and (5) Ullage Settling Motor System components.

Mitchell, Michael S.↗
DOE OSTI2023

Passive Safety System Reliability Analysis: Lessons Learned and Open Items

Passive safety systems have multiple benefits, largely stemming from their high functional reliability due to their simplicity and lack of dependencies. However, accurately assessing the reliability of passive systems can be challenging due in large part to the possibility of functional failures. Argonne National Laboratory (Argonne) has been involved in several recent efforts concerning the reliability assessment of passive safety systems for advanced, non-light water reactors (non-LWRs). These efforts have focused on the development and application of mechanistic methods for the evaluation of passive system reliability, which rely on system modelling and uncertainty analyses to derive reliability values for use in probabilistic safety assessments (PSAs). Further information on these efforts is provided in ref [1]. The current paper reviews key lessons learned through these projects, along with outstanding open items regarding the reliability assessment of passive systems.

Grabaskas, David↗
DOE OSTI2023

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Refinement and Exploration

This report documents activities performed by Idaho National Laboratory (INL) during Fiscal Year (FY) 2023 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) risk assessment project. In FY 2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a technical basis to support effective, and secure DI&C technologies for digital upgrades/designs. A risk assessment-informed framework was proposed for this strategy, which aims to (1) provide a best-estimate, risk informed capability to quantitatively estimate the safety margin obtained from plant modernization, especially for safety-related DI&C systems, (2) support and supplement existing risk informed DI&C design guides by providing quantitative risk information and evidence, (3) offer a capability of design architecture evaluation of various DI&C systems, (4) assure the long-term safety and reliability of safety-related DI&C systems, and (5) reduce uncertainty in costs and support integration of DI&C systems in the plant. To achieve these technical goals, the LWRS-developed framework provides a means to address relevant technical issues by: (1) defining a risk informed analysis process for DI&C upgrade that integrates hazard analysis, reliability analysis, and consequence analysis, (2) applying risk informed tools to address common cause failures (CCFs) and quantify corresponding failure probabilities for DI&C technologies, particularly software CCFs, (3) evaluating the impact of digital failures at the component level, system level, and plant level, and (4) providing insights and suggestions on designs to manage the risks, thus to support the development and deployment of advanced DI&C technologies in nuclear power plants (NPPs). Adding diversity within a system or components is the primary means to eliminate and mitigate CCFs, but diversity also increases system complexity and may not address all sources of systematic failures. Optimization of diversity and redundancy applications for the safety-critical DI&C systems remains a challenge. To deal with the technical issues in addressing potential software CCFs in safety-related DI&C systems of NPPs and supporting relevant design optimization, the proposed framework provides: (a) A best-estimate, risk informed capability to address new technical digital issues quantitatively, focusing on software CCFs in safety-related DI&C systems of NPPs; (b) A common and a modularized platform for DI&C designers, software developers, cybersecurity analysts, and plant engineers to predict and prevent risk in the early design stage of DI&C systems; (c) Technical bases and risk informed insights to assist users address the risk informed alternatives for evaluation of CCFs in safety-related DI&C systems of NPPs; and (d) A risk informed tool that offers a capability of design architecture evaluation of various DI&C systems to support system design decisions in diversity and redundancy applications. The research and development efforts of this project in FY 2023 are focused on refining current methods on software CCF modeling and estimation and exploring additional innovative approaches to risk assessment of DI&C systems to enable a more comprehensive and complete assessment of various safety-related DI&C design architectures. The primary audience of this report are DI&C designers, engineers, and probabilistic risk assessment (PRA) practitioners. This includes stakeholders, such as the nuclear utilities and regulators who consider the deployment and upgrade of DI&C systems, DI&C software developers and reviewers, and cybersecurity specialists. It should be noted that all the analyses are performed for the demonstration of the methodology, not for the evaluation of an actual digital control system. Results are obtained based on limited design information and testing data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2005

Developing a Methodology for Eliciting Subjective Probability Estimates During Expert Evaluations of Safety Interventions: Application for Bayesian Belief Networks

The NASA Aviation Safety Program (AvSP) has defined several products that will potentially modify airline and/or ATC operations, enhance aircraft systems, and improve the identification of potential hazardous situations within the National Airspace System (NAS). Consequently, there is a need to develop methods for evaluating the potential safety benefit of each of these intervention products so that resources can be effectively invested to produce the judgments to develop Bayesian Belief Networks (BBN's) that model the potential impact that specific interventions may have. Specifically, the present report summarizes methodologies for improving the elicitation of probability estimates during expert evaluations of AvSP products for use in BBN's. The work involved joint efforts between Professor James Luxhoj from Rutgers University and researchers at the University of Illinois. The Rutgers' project to develop BBN's received funding by NASA entitled "Probabilistic Decision Support for Evaluating Technology Insertion and Assessing Aviation Safety System Risk." The proposed project was funded separately but supported the existing Rutgers' program.

Wiegmann, Douglas A.a↗
NASA NTRS2015

Abort Trigger False Positive and False Negative Analysis Methodology for Threshold-Based Abort Detection

This paper describes a quantitative methodology for bounding the false positive (FP) and false negative (FN) probabilities associated with a human-rated launch vehicle abort trigger (AT) that includes sensor data qualification (SDQ). In this context, an AT is a hardware and software mechanism designed to detect the existence of a specific abort condition. Also, SDQ is an algorithmic approach used to identify sensor data suspected of being corrupt so that suspect data does not adversely affect an AT's detection capability. The FP and FN methodologies presented here were developed to support estimation of the probabilities of loss of crew and loss of mission for the Space Launch System (SLS) which is being developed by the National Aeronautics and Space Administration (NASA). The paper provides a brief overview of system health management as being an extension of control theory; and describes how ATs and the calculation of FP and FN probabilities relate to this theory. The discussion leads to a detailed presentation of the FP and FN methodology and an example showing how the FP and FN calculations are performed. This detailed presentation includes a methodology for calculating the change in FP and FN probabilities that result from including SDQ in the AT architecture. To avoid proprietary and sensitive data issues, the example incorporates a mixture of open literature and fictitious reliability data. Results presented in the paper demonstrate the effectiveness of the approach in providing quantitative estimates that bound the probability of a FP or FN abort determination.

risk assessment↗
NASA NTRSDate not supplied

Safety Assessment of a Machine Learning-Based Aircraft Emergency Braking System: A Case Study

Machine Learning (ML) is revolutionizing many technological fields, but its use in aviation remains restricted due to stringent certification requirements. Efforts by the aviation community to establish standards for certifying ML-based systems are progressing, yet challenges persist, particularly with safety assessment methods for ML-based systems. This research addresses these challenges through a case study of an autonomous emergency braking system utilizing a computer vision deep neural network (DNN). We demonstrate a safety assessment process tailored to ML-specific concerns, such as low integrity and performance variability in quantitative safety analysis. This study can serve as an illustrative example to facilitate the discussion and convergence on certification aspects for ML-based systems within the aviation community.

Safety certification↗
DOE OSTI2021

Data requirements for improving the Quantitative Risk Assessment of liquid hydrogen storage systems

Quantitative Risk Assessment (QRA) supports the development of risk-informed safety codes and standards which are employed to enable the safe deployment of hydrogen technologies essential to decarbonize the transportation sector. System reliability data is a necessary input for rigorous QRA. Here, the lack of reliability data for bulk liquid hydrogen (LH 2 ) storage systems located on site at fueling stations limits the use of QRAs. In turn, this hinders the ability to develop the necessary safety codes and standards that enable worldwide deployment of these stations. Through a QRA-based analysis of a LH 2 storage system, this work focuses on identifying relevant scenario and probability data currently available and ascertaining future data collection requirements regarding risks specific to liquid hydrogen releases. The work developed consists of the analysis of a general bulk LH 2 storage system design located at a hydrogen fueling station. Failure Mode and Effect Analysis (FMEA) and traditional QRA modeling tools such as Event Sequence Diagrams (ESD) and Fault Tree Analysis (FTA) are employed to identify, rank, and model risk scenarios related to the release of LH 2 . Based on this analysis, scenario and reliability data needs to add LH 2 -related components to QRA are identified with the purpose of improving the future safety and risk assessment of these systems.

08 HYDROGEN↗
NASA NTRSDate not supplied

In-Time Safety Assessment & Risk Prediction for Unmanned Aerial Systems

One of the critical challenges in emerging autonomous systems is timely mitigation of hazards encountered during operation which may not be known or accounted for at the time of design. Efficient execution of unmanned systems therefore demands a paradigm shift from scheduled periodic maintenance to predictive risk analysis that includes condition-based-monitoring, real-time reliability assessment and hazard mitigation. Particularly, the state-of-health parameters needs to be computed at the component level, unit level as well as the integrated system level. While in the former two levels, the physics of health propagation may be based on underlying electro-mechanical properties, system level prognostics often relies on data-driven models. Further, uncertainty from model, measurements and input sources should be accurately quantified to generate meaningful prediction results that can be fed into reliable decision making processes. Finally, the expected risk and time to failure has to be computed based on the current state-of-health of the overall system. This talk presents a conceptual design of such an in-time safety assurance approach for unmanned aerial vehicles (UAV) operating at low altitudes near and over populated areas. Typical in-flight hazard incidents include unplanned detour, proximity to obstacles, mid-flight component faults, limited battery life and poor quality of GPS measurements. Safety assessment therefore comprises trajectory generation and re-plan, battery RUL computation, distributed fault diagnostics and uncertainty management of predicted trajectory based on GPS measurement noise. The entire monitoring framework will be demonstrated on simulated as well as real UAV flight experiments conducted at the NASA Langley Research Center. This tutorial will therefore guide the audience through a step-by-step tracking of an autonomous system with focus on in-time risk prediction in the presence of unforeseen hazards and uncertain environment.

diagnostics↗