Results for “Risk Based Analysis” — Page 6

NASA NTRSDate not supplied

Comparison of Artemis 2 and Artemis 5 Model Outcomes Using the Impact Probabilistic Risk Assessment Tool

BACKGROUND The Artemis campaign is a Moon exploration program with a series of six planned missions, five of which will be crewed. These five crewed missions will contain a single mission segment (space flight), or multiple mission segments involving space flight (Orion), lunar landing (LTV) and/or space habitat (Gateway). Each crewed segment faces the risk of unique medical conditions, necessitating medical sets/kits tailored to those specificities. To support and enable a data-driven and evidence-based decision-making process through out a mission’s life cycle, a software tool called IMPACT was developed. Using probabilistic risk assessment (PRA) methodologies, IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces) is a novel tool built for analyzing the possibility of encountering complex medical risks during space flight, and for identifying the medical resources and capabilities needed to treat those potential at-risk medical conditions. This presentation will seek to compare IMPACT’s computational results upon potential complex space medical conditions (e.g., sprain/strain back or sleep disturbance) using IMPACT’s risk metrics and the associated optimized medical sets/kits between two Artemis missions: single segment Artemis 2 and multi-segmented Artemis 5. OVERVIEW By identifying potential medical conditions in space using input criteria such as crew quantity and composition, certain crew physical characteristics, mission duration and mission activities, IMPACT can produce analyses on the type of medical resources and capabilities needed to produce an optimized medical set/kit to address those medical conditions. IMPACT achieves this by performing hundreds of thousands of Monte Carlo simulations of missions to build aggregate pictures of medical risk. IMPACT’s risk metrics include loss of crew life (LOCL) – a measure of crew mortality due to medical conditions in space, return to definitive care (RTDC) – the need to perform crew evacuation, and task time lost (TTL) – a measure of the inability to perform activities due to crew disability. These risk metrics are applied to every medical condition identified by IMPACT’s computation analyses for every segment of the mission. Medical sets/kits are optimized to address these medical conditions but must fit within the stated Artemis Design Reference Mission (DRM) request for mass and volume physical size constraints. ANTICIPATED ANALYSIS AND CONCLUSION Using two Artemis missions, Artemis 2 and Artemis 5, IMPACT will provide the analyses for comparison of medical set/kit contents based upon mass and/or volume requirements and identify the at-risk medical conditions within both missions. This paper serves as an initial exploration of probabilistic risk assessment (PRA) medical risk calculations between two crewed Artemis missions and is not intended to be deemed the official medical response for the Artemis campaign.

probabilistic risk assessment↗

NASA NTRS2010

Development of NASA's Accident Precursor Analysis Process Through Application on the Space Shuttle Orbiter

Accident Precursor Analysis (APA) serves as the bridge between existing risk modeling activities, which are often based on historical or generic failure statistics, and system anomalies, which provide crucial information about the failure mechanisms that are actually operative in the system. APA docs more than simply track experience: it systematically evaluates experience, looking for under-appreciated risks that may warrant changes to design or operational practice. This paper presents the pilot application of the NASA APA process to Space Shuttle Orbiter systems. In this effort, the working sessions conducted at Johnson Space Center (JSC) piloted the APA process developed by Information Systems Laboratories (ISL) over the last two years under the auspices of NASA's Office of Safety & Mission Assurance, with the assistance of the Safety & Mission Assurance (S&MA) Shuttle & Exploration Analysis Branch. This process is built around facilitated working sessions involving diverse system experts. One important aspect of this particular APA process is its focus on understanding the physical mechanism responsible for an operational anomaly, followed by evaluation of the risk significance of the observed anomaly as well as consideration of generalizations of the underlying mechanism to other contexts. Model completeness will probably always be an issue, but this process tries to leverage operating experience to the extent possible in order to address completeness issues before a catastrophe occurs.

Maggio, Gaspare↗

NASA NTRS1967

On non-central chi-squared and non-central F distributions.

Differential difference equations for decision procedure risk function based on noncentral chi squared and F distributions in multivariate statistical analysis

Alam, K.↗

NASA NTRS2014

Cost Analysis in a Multi-Mission Operations Environment

Spacecraft control centers have evolved from dedicated, single-mission or single mission-type support to multi-mission, service-oriented support for operating a variety of mission types. At the same time, available money for projects is shrinking and competition for new missions is increasing. These factors drive the need for an accurate and flexible model to support estimating service costs for new or extended missions; the cost model in turn drives the need for an accurate and efficient approach to service cost analysis. The National Aeronautics and Space Administration (NASA) Huntsville Operations Support Center (HOSC) at Marshall Space Flight Center (MSFC) provides operations services to a variety of customers around the world. HOSC customers range from launch vehicle test flights; to International Space Station (ISS) payloads; to small, short duration missions; and has included long duration flagship missions. The HOSC recently completed a detailed analysis of service costs as part of the development of a complete service cost model. The cost analysis process required the team to address a number of issues. One of the primary issues involves the difficulty of reverse engineering individual mission costs in a highly efficient multi-mission environment, along with a related issue of the value of detailed metrics or data to the cost model versus the cost of obtaining accurate data. Another concern is the difficulty of balancing costs between missions of different types and size and extrapolating costs to different mission types. The cost analysis also had to address issues relating to providing shared, cloud-like services in a government environment, and then assigning an uncertainty or risk factor to cost estimates that are based on current technology, but will be executed using future technology. Finally the cost analysis needed to consider how to validate the resulting cost models taking into account the non-homogeneous nature of the available cost data and the decreasing flight rate. This paper presents the issues encountered during the HOSC cost analysis process, and the associated lessons learned. These lessons can be used when planning for a new multi-mission operations center or in the transformation from a dedicated control center to multi-center operations, as an aid in defining processes that support future cost analysis and estimation. The lessons can also be used by mature service-oriented, multi-mission control centers to streamline or refine their cost analysis process.

Felton, Larry↗

NASA NTRS2014

Cost Analysis In A Multi-Mission Operations Environment

Spacecraft control centers have evolved from dedicated, single-mission or single missiontype support to multi-mission, service-oriented support for operating a variety of mission types. At the same time, available money for projects is shrinking and competition for new missions is increasing. These factors drive the need for an accurate and flexible model to support estimating service costs for new or extended missions; the cost model in turn drives the need for an accurate and efficient approach to service cost analysis. The National Aeronautics and Space Administration (NASA) Huntsville Operations Support Center (HOSC) at Marshall Space Flight Center (MSFC) provides operations services to a variety of customers around the world. HOSC customers range from launch vehicle test flights; to International Space Station (ISS) payloads; to small, short duration missions; and has included long duration flagship missions. The HOSC recently completed a detailed analysis of service costs as part of the development of a complete service cost model. The cost analysis process required the team to address a number of issues. One of the primary issues involves the difficulty of reverse engineering individual mission costs in a highly efficient multimission environment, along with a related issue of the value of detailed metrics or data to the cost model versus the cost of obtaining accurate data. Another concern is the difficulty of balancing costs between missions of different types and size and extrapolating costs to different mission types. The cost analysis also had to address issues relating to providing shared, cloud-like services in a government environment, and then assigning an uncertainty or risk factor to cost estimates that are based on current technology, but will be executed using future technology. Finally the cost analysis needed to consider how to validate the resulting cost models taking into account the non-homogeneous nature of the available cost data and the decreasing flight rate. This paper presents the issues encountered during the HOSC cost analysis process, and the associated lessons learned. These lessons can be used when planning for a new multi-mission operations center or in the transformation from a dedicated control center to multi-center operations, as an aid in defining processes that support future cost analysis and estimation. The lessons can also be used by mature serviceoriented, multi-mission control centers to streamline or refine their cost analysis process.

Newhouse, M.↗

NASA NTRSDate not supplied

Machine Learning Enabled Quantitative Risk Assessment of Aerial Wildfire Response

Aerial wildfire operations are high risk and account for a large number of firefighter deaths. Increasing intensity of wildfires is driving a surge in aerial operations, while simultaneously there is growing interest in improving system safety and performance. In this work, wildfire aviation mishaps documented using the SAFECOM system are analyzed using a previously developed framework for hazard extraction and analysis of trends (HEAT). Hazards and specific failure modes are extracted from the narrative data in SAFECOM forms using natural language processing techniques. Metrics for each hazard are calculated, including frequency, rate, and severity. We examine whether these metrics change over time, and whether they are related to metadata, such as region and aircraft type. The results of the hazard analysis are presented in a risk matrix, identifying the highest and lowest risk hazards based on rate of occurrence and average severity. Results identify jumper operations hazards as high-risk, in addition to bucket drop failures, cargo let down failures, and severe weather as medium risk.

machine learning↗

NASA NTRSDate not supplied

Machine Learning Enabled Quantitative Risk Assessment of Aerial Wildfire Response

Aerial wildfire operations are high risk and account for a large number of firefighter deaths. Increasing intensity of wildfires is driving a surge in aerial operations, while simultaneously there is growing interest in improving system safety and performance. In this work, wildfire aviation mishaps documented using the SAFECOM system are analyzed using a previously developed framework for hazard extraction and analysis of trends (HEAT). Hazards and specific failure modes are extracted from the narrative data in SAFECOM forms using natural language processing techniques. Metrics for each hazard are calculated, including frequency, rate, and severity. We examine whether these metrics change over time, and whether they are related to metadata, such as region and aircraft type. The results of the hazard analysis are presented in a risk matrix, identifying the highest and lowest risk hazards based on rate of occurrence and average severity. Results identify jumper operations hazards as high-risk, in addition to bucket drop failures, cargo let down failures, and severe weather as medium risk.

machine learning↗

NASA NTRS1995

The Role of Analysis and Testing in the Service Life Assessment of Ion Engines

Experience from tests and flights and engineering analysis represent the two sources of information on which to base conclusions on the reliability or failure risk of aerospace flight systems. It is rarely feasible to establish high reliability at high confidence by testing aerospace flight systems or components. The limitations of testing in evaluating failure risk are discussed and an alternate statistical approach which relies on both test experience and analysis to quantitatively assess reliability is outlined. The implementation of this methodology in the service life assessment of ion thrusters is discussed and examples of failure modes being addressed in the NASA Solar Electric Propulsion Technology Application Readiness (NSTAR) program are given.

Ion↗

NASA NTRS2023

IMPACTing Medical System Design with a Risk Analysis Tool [“IMPACT” sur la Conception du Système Médical avec un Outil d'Analyse des Risques]

Background: Following the success of Artemis I, NASA is preparing for human extended duration missions. Ongoing efforts are focused on mitigating mission-related risks, including those affecting crew health and performance. Communication latency, logistics of resupply and time frame of medical evacuation are barriers to provision of healthcare for these missions, especially with respect to constraints in mass, volume, and crew training. An in-depth assessment of medical risks, capabilities and resources for a specific mission design is necessary to determine an optimal balance that maximizes likelihood of mission success. Overview: IMPACT (Informed Mission Planning via Analysis of Complex Tradespaces) is a dynamic tool designed to estimate medical risk and outcomes for a specific mission design. In its current iteration, a list of medical conditions selected based on likelihood of occurrence and/or consequence was linked to a set of clinical capabilities and resources necessary for diagnosis and management. A probabilistic risk analysis tool was then used to identify and estimate the likelihood and consequence of risks through the following outcome metrics: loss of crew life (inflight mortality due to medical conditions), need for medical evacuation (return to definitive care), and crew disability (task time affected based on how medical conditions influence the ability to perform specific exploration mission crew tasks). Finally, the model’s optimization algorithm provides recommendations for medical capabilities that maximize risk mitigation relative to mass and volume constraints. In the Spring of 2023, IMPACT was utilized to estimate outcome metrics for a design reference mission that would be representative of an extended duration Artemis mission. Notional data generated were then used to determine a recommended set of medical capabilities and resources relative to user-defined mass and volume constraints. A multidisciplinary team has also been updating IMPACT to strengthen the model’s fidelity. Figure 1 shows how updates to outcome metric inputs for the conditions resulted in different capability and resource allocation recommendations. Discussion: This presentation will discuss the IMPACT tool and share the latest data generated for a representative extended duration Artemis mission. Efforts to improve the fidelity of data generated by the model’s algorithm will also be discussed.

K A Shair↗

NASA NTRSDate not supplied

IMPACTing Medical System Design with a Risk Analysis Tool

Background: Following the success of Artemis I, NASA is preparing for human extended duration missions. Ongoing efforts are focused on mitigating mission-related risks, including those affecting crew health and performance. Communication latency, logistics of resupply and time frame of medical evacuation are barriers to provision of healthcare for these missions, especially with respect to constraints in mass, volume, and crew training. An in-depth assessment of medical risks, capabilities and resources for a specific mission design is necessary to determine an optimal balance that maximizes likelihood of mission success. Overview: IMPACT (Informed Mission Planning via Analysis of Complex Tradespaces) is a dynamic tool designed to estimate medical risk and outcomes for a specific mission design. In its current iteration, a list of medical conditions selected based on likelihood of occurrence and/or consequence was linked to a set of clinical capabilities and resources necessary for diagnosis and management. A probabilistic risk analysis tool was then used to identify and estimate the likelihood and consequence of risks through the following outcome metrics: loss of crew life (inflight mortality due to medical conditions), need for medical evacuation (return to definitive care), and crew disability (task time affected based on how medical conditions influence the ability to perform specific exploration mission crew tasks). Finally, the model’s optimization algorithm provides recommendations for medical capabilities that maximize risk mitigation relative to mass and volume constraints. In the Spring of 2023, IMPACT was utilized to estimate outcome metrics for a design reference mission that would be representative of an extended duration Artemis mission. Notional data generated were then used to determine a recommended set of medical capabilities and resources relative to user-defined mass and volume constraints. A multidisciplinary team has also been updating IMPACT to strengthen the model’s fidelity. Figure 1 shows how updates to outcome metric inputs for the conditions resulted in different capability and resource allocation recommendations. Discussion: This presentation will discuss the IMPACT tool and share the latest data generated for a representative extended duration Artemis mission. Efforts to improve the fidelity of data generated by the model’s algorithm will also be discussed.

K A Shair↗

NASA NTRS2016

Trajectory Design to Mitigate Risk on the Transiting Exoplanet Survey Satellite (TESS) Mission

The Transiting Exoplanet Survey Satellite (TESS) will employ a highly eccentric Earth orbit, in 2:1 lunar resonance, reached with a lunar flyby preceded by 3.5 phasing loops. The TESS mission has limited propellant and several orbit constraints. Based on analysis and simulation, we have designed the phasing loops to reduce delta-V and to mitigate risk due to maneuver execution errors. We have automated the trajectory design process and use distributed processing to generate and to optimize nominal trajectories, check constraint satisfaction, and finally model the effects of maneuver errors to identify trajectories that best meet the mission requirements.

design↗

NASA NTRSDate not supplied

3D Representation of UAV-obstacle Collision Risk Under Off-nominal Conditions

Safe operations of autonomous unmanned aerial vehicles (UAVs) in low-altitude airspace with beyond visual line-of-sight (BVLOS) flights demand robust risk monitoring of airspace as well as of people and property on ground. One of the safety critical factors for UAV flights is the risk of collision with static and dynamic obstacles in proximity to its flight path. This paper presents a detailed formulation of risk of obstacle collision incorporating the effects of off-nominal conditions introduced by component failures, degraded controllability and environmental disturbances such as wind gusts. The risk is represented in terms of a matrix with rows corresponding to the likelihood of occurrence of collision and columns representing severity of collision to the vehicle and surrounding structures. Risk likelihood is generated using a Bayesian Belief Network (BBN) that compiles knowledge from related Failure Modes and Effects Analysis (FMEAs) and Subject Matter Experts (SMEs) to determine the probability of collision based on on-board sensor measurements indicative of vehicle health and controllability. Risk severity is computed utilizing a point-mass 3D kinematic model of the vehicle in presence of wind. The proposed risk factor is demonstrated on real flight data from experimental flights of an octocopter at NASA Langley Research Center in presence of simulated obstacles and wind conditions. Effect of varying wind conditions, level of controllability and obstacle measurement noise on the risk factor is demonstrated. The proposed approach enables risk-informed decision making for timely mitigation of current and future unsafe events in autonomous systems.

risk analysis↗

NASA NTRS2016

Pitfalls and Precautions When Using Predicted Failure Data for Quantitative Analysis of Safety Risk for Human Rated Launch Vehicles

Launch vehicle reliability analysis is largely dependent upon using predicted failure rates from data sources such as MIL-HDBK-217F. Reliability prediction methodologies based on component data do not take into account risks attributable to manufacturing, assembly, and process controls. These sources often dominate component level reliability or risk of failure probability. While consequences of failure is often understood in assessing risk, using predicted values in a risk model to estimate the probability of occurrence will likely underestimate the risk. Managers and decision makers often use the probability of occurrence in determining whether to accept the risk or require a design modification. Due to the absence of system level test and operational data inherent in aerospace applications, the actual risk threshold for acceptance may not be appropriately characterized for decision making purposes. This paper will establish a method and approach to identify the pitfalls and precautions of accepting risk based solely upon predicted failure data. This approach will provide a set of guidelines that may be useful to arrive at a more realistic quantification of risk prior to acceptance by a program.

Hatfield, Glen S.↗

NASA NTRS2010

An Accident Precursor Analysis Process Tailored for NASA Space Systems

Accident Precursor Analysis (APA) serves as the bridge between existing risk modeling activities, which are often based on historical or generic failure statistics, and system anomalies, which provide crucial information about the failure mechanisms that are actually operative in the system and which may differ in frequency or type from those in the various models. These discrepancies between the models (perceived risk) and the system (actual risk) provide the leading indication of an underappreciated risk. This paper presents an APA process developed specifically for NASA Earth-to-Orbit space systems. The purpose of the process is to identify and characterize potential sources of system risk as evidenced by anomalous events which, although not necessarily presenting an immediate safety impact, may indicate that an unknown or insufficiently understood risk-significant condition exists in the system. Such anomalous events are considered accident precursors because they signal the potential for severe consequences that may occur in the future, due to causes that are discernible from their occurrence today. Their early identification allows them to be integrated into the overall system risk model used to intbrm decisions relating to safety.

Groen, Frank↗

NASA NTRS2013

Evidence Report: Risk of Inadequate Human-Computer Interaction

Human-computer interaction (HCI) encompasses all the methods by which humans and computer-based systems communicate, share information, and accomplish tasks. When HCI is poorly designed, crews have difficulty entering, navigating, accessing, and understanding information. HCI has rarely been studied in an operational spaceflight context, and detailed performance data that would support evaluation of HCI have not been collected; thus, we draw much of our evidence from post-spaceflight crew comments, and from other safety-critical domains like ground-based power plants, and aviation. Additionally, there is a concern that any potential or real issues to date may have been masked by the fact that crews have near constant access to ground controllers, who monitor for errors, correct mistakes, and provide additional information needed to complete tasks. We do not know what types of HCI issues might arise without this "safety net". Exploration missions will test this concern, as crews may be operating autonomously due to communication delays and blackouts. Crew survival will be heavily dependent on available electronic information for just-in-time training, procedure execution, and vehicle or system maintenance; hence, the criticality of the Risk of Inadequate HCI. Future work must focus on identifying the most important contributing risk factors, evaluating their contribution to the overall risk, and developing appropriate mitigations. The Risk of Inadequate HCI includes eight core contributing factors based on the Human Factors Analysis and Classification System (HFACS): (1) Requirements, policies, and design processes, (2) Information resources and support, (3) Allocation of attention, (4) Cognitive overload, (5) Environmentally induced perceptual changes, (6) Misperception and misinterpretation of displayed information, (7) Spatial disorientation, and (8) Displays and controls.

Kritina Holden↗

NASA NTRSDate not supplied

Predicting the Likelihood of Human-Elephant Conflict and Assessing Patterns in Elephant Movements Over Varying Habitat Conditions in the Kavango-Zambezi Area

In the Kavango-Zambezi area of southern Africa, three million people live within areas frequently traveled by free-ranging elephants. As the region continues to develop rapidly, urban and agricultural settlements further encroach upon the land that these elephants use. As elephants come into more frequent contact with urban and agricultural areas, human populations face financial loss through crop damage and the potential for injury from direct conflict with elephants. Elephant populations are also at risk of injuries from conflict as well as illness related to the consumption of waste. In order to implement human-elephant conflict mitigation strategies, local conservation groups need to be informed on best practices for coexistence. This project aided The Ecoexist Project and Connected Conservation in understanding the ecological factors that drive elephant movement into human settlements and provided Earth observation data to support conflict management in the future. The team used Landsat 5 Thematic Mapper (TM), Landsat 8 Operational Land Imager (OLI) data to create land use land cover maps and calculate vegetation indices, and used TerraClimate data to analyze drought conditions. These classified maps allowed us to display a time series of human settlement from 1990 to the present and were made explorable alongside other environmental variables in an updated Google Earth Engine (GEE) tool. This project also provided heat maps that show the risk of human-elephant conflict based on historical data of HEC locations. This analysis will provide support for conservation experts in determining best practices for future mitigation and prevention of human-elephant conflict.

Ariel Calle↗

NASA NTRS2000

An Integrated Low-Speed Performance and Noise Prediction Methodology for Subsonic Aircraft

An integrated methodology has been assembled to compute the engine performance, takeoff and landing trajectories, and community noise levels for a subsonic commercial aircraft. Where feasible, physics-based noise analysis methods have been used to make the results more applicable to newer, revolutionary designs and to allow for a more direct evaluation of new technologies. The methodology is intended to be used with approximation methods and risk analysis techniques to allow for the analysis of a greater number of variable combinations while retaining the advantages of physics-based analysis. Details of the methodology are described and limited results are presented for a representative subsonic commercial aircraft.

Olson, E. D.↗

NASA NTRS2016

Pitfalls and Precautions When Using Predicted Failure Data for Quantitative Analysis of Safety Risk for Human Rated Launch Vehicles

Launch vehicle reliability analysis is largely dependent upon using predicted failure rates from data sources such as MIL-HDBK-217F. Reliability prediction methodologies based on component data do not take into account system integration risks such as those attributable to manufacturing and assembly. These sources often dominate component level risk. While consequence of failure is often understood, using predicted values in a risk model to estimate the probability of occurrence may underestimate the actual risk. Managers and decision makers use the probability of occurrence to influence the determination whether to accept the risk or require a design modification. The actual risk threshold for acceptance may not be fully understood due to the absence of system level test data or operational data. This paper will establish a method and approach to identify the pitfalls and precautions of accepting risk based solely upon predicted failure data. This approach will provide a set of guidelines that may be useful to arrive at a more realistic quantification of risk prior to acceptance by a program.

Hatfield, Glen S.↗