Search NASASearch

SEARCH · Search NASA

Results for “risk matrix”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Development of Risk Assessment Matrix for NASA Engineering and Safety Center

This paper describes a study, which had as its principal goal the development of a sufficiently detailed 5 x 5 Risk Matrix Scorecard. The purpose of this scorecard is to outline the criteria by which technical issues can be qualitatively and initially prioritized. The tool using this score card has been proposed to be one of the information resources the NASA Engineering and Safety Center (NESC) takes into consideration when making decisions with respect to incoming information on safety concerns across the entire NASA agency. The contents of this paper discuss in detail each element of the risk matrix scorecard, definitions for those elements and the rationale behind the development of those definitions. This scorecard development was performed in parallel with the tailoring of the existing Futron Corporation Integrated Risk Management Application (IRMA) software tool. IRMA was tailored to fit NESC needs for evaluating incoming safety concerns and was renamed NESC Assessment Risk Management Application (NAFMA) which is still in developmental phase.

Malone, Roy W., Jr.

Peru Health and Air Quality II: Leveraging Earth Observations and Health Data to Map Outbreak Risk and Inform Public Health Interventions for Zoonotic Disease Prevention

Peru's Madre de Dios region is a hotspot for dengue fever and leishmaniasis due to its tropical Amazonian climate. Though treatable, these zoonotic diseases are debilitating for under-resourced communities whose already close proximity to mosquito and sandfly vectors continues to increase via rapid urbanization and deforestation. Peru’s Ministries of Health (MINSA) and Environment (MINAM) are working to better understand the environmental factors amplifying the risk of dengue fever and leishmaniasis transmission. The first term of this project classified the land use and land cover of Madre de Dios’ 11 districts for 2010, 2015, and 2020 and identified a correlation between both diseases and urbanization. Our team expanded this analysis by creating urban-forest edge maps and incorporating climatic and topographic variables with data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), the Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals for GPM (IMERG), and the Shuttle Radar Topography Mission (SRTM). We determined these variables’ impacts on disease incidence by assessing existing literature and running regression models. Dengue fever correlated with urban-forest edge, urban area, slope, temperature, and precipitation. Leishmaniasis primarily correlated with forest-edge area and elevation, but lacking additional statistical significance prevented further work, a decision supported by the literature. Thus, the risk matrix and risk map which we scripted in R to visualize the risk of disease posed to districts alongside health post locations addresses only dengue fever. The results and products will inform MINSA and MINAM in public health interventions, resource distribution, and policy initiatives.

Jennifer Rogers

Risk Management for Human Support Technology Development

NASA requires continuous risk management for all programs and projects. The risk management process identifies risks, analyzes their impact, prioritizes them, develops and carries out plans to mitigate or accept them, tracks risks and mitigation plans, and communicates and documents risk information. Project risk management is driven by the project goal and is performed by the entire team. Risk management begins early in the formulation phase with initial risk identification and development of a risk management plan and continues throughout the project life cycle. This paper describes the risk management approach that is suggested for use in NASA's Human Support Technology Development. The first step in risk management is to identify the detailed technical and programmatic risks specific to a project. Each individual risk should be described in detail. The identified risks are summarized in a complete risk list. Risk analysis provides estimates of the likelihood and the qualitative impact of a risk. The likelihood and impact of the risk are used to define its priority location in the risk matrix. The approaches for responding to risk are either to mitigate it by eliminating or reducing the effect or likelihood of a risk, to accept it with a documented rationale and contingency plan, or to research or monitor the risk, The Human Support Technology Development program includes many projects with independently achievable goals. Each project must do independent risk management, considering all its risks together and trading them against performance, budget, and schedule. Since the program can succeed even if some projects fail, the program risk has a complex dependence on the individual project risks.

jones, Harry

Machine Learning Enabled Quantitative Risk Assessment of Aerial Wildfire Response

Aerial wildfire operations are high risk and account for a large number of firefighter deaths. Increasing intensity of wildfires is driving a surge in aerial operations, while simultaneously there is growing interest in improving system safety and performance. In this work, wildfire aviation mishaps documented using the SAFECOM system are analyzed using a previously developed framework for hazard extraction and analysis of trends (HEAT). Hazards and specific failure modes are extracted from the narrative data in SAFECOM forms using natural language processing techniques. Metrics for each hazard are calculated, including frequency, rate, and severity. We examine whether these metrics change over time, and whether they are related to metadata, such as region and aircraft type. The results of the hazard analysis are presented in a risk matrix, identifying the highest and lowest risk hazards based on rate of occurrence and average severity. Results identify jumper operations hazards as high-risk, in addition to bucket drop failures, cargo let down failures, and severe weather as medium risk.

machine learning

Machine Learning Enabled Quantitative Risk Assessment of Aerial Wildfire Response

Aerial wildfire operations are high risk and account for a large number of firefighter deaths. Increasing intensity of wildfires is driving a surge in aerial operations, while simultaneously there is growing interest in improving system safety and performance. In this work, wildfire aviation mishaps documented using the SAFECOM system are analyzed using a previously developed framework for hazard extraction and analysis of trends (HEAT). Hazards and specific failure modes are extracted from the narrative data in SAFECOM forms using natural language processing techniques. Metrics for each hazard are calculated, including frequency, rate, and severity. We examine whether these metrics change over time, and whether they are related to metadata, such as region and aircraft type. The results of the hazard analysis are presented in a risk matrix, identifying the highest and lowest risk hazards based on rate of occurrence and average severity. Results identify jumper operations hazards as high-risk, in addition to bucket drop failures, cargo let down failures, and severe weather as medium risk.

machine learning

Quantifying Cybersecurity Risk for NASA Missions

An end-to-end cyber risk assessment process is presented that is based on the combination of guidelines from the National Institute of Standards & Technology (NIST), the standard 5x5 risk matrix, and quantitative methods for generating loss exceedance curves. The NIST guidelines provide a framework for cyber risk assessment, and the standard 5x5 matrix is widely used across the industry for the representation of risk across multiple disciplines. Loss exceedance curves are a means of quantitatively assessing the loss that occurs due to a given risk profile. Combining these different techniques enables us to follow the guidelines, adhere to standard 5x5 risk management practices and develop quantitative metrics simultaneously. Our quantification process is based on the consideration of the NASA and JPL Cost Risk assessment modeling techniques as we define the cost associated with the cybersecurity risk profile of a mission as a function of the mission cost.

Miller, Robert L.

Understanding Pre-Quantitative Risk in Projects

Standard approaches to risk management in projects depend on the ability of teams to identify risks and quantify the probabilities and consequences of these risks (e.g., the 5 x 5 risk matrix). However, long before quantification does - or even can - occur, and long after, teams make decisions based on their pre-quantitative understanding of risk. These decisions can have long-lasting impacts on the project. While significant research has looked at the process of how to quantify risk, our understanding of how teams conceive of and manage pre-quantitative risk is lacking. This paper introduces the concept of pre-quantitative risk and discusses the implications of addressing pre-quantitative risk in projects.

risk levels.

Machine Learning Framework for Hazard Extraction and Analysis of Trends (HEAT) in Wildfire Response

This research proposes a natural language processing enabled risk analysis framework, named Hazard Extraction andAnalysis of Trends (HEAT), and applies the framework to the ICS-209-PLUS data set of wildfire incident responseforms. The HEAT framework produces safety- and risk- relevant analyses, consisting of: (1) a set of hazards extractedfrom text data, (2) a primary analysis using hazard-relevant metrics, such as rate and severity, to form an FMEA-styletable and risk matrix, (3) a time series analysis of metric trends, and (4) a secondary analysis examining potentialpredictors for hazards. Results from HEAT provide quantitative risk-relevant information for high-level hazards doc-umented in existing-state operations. Because of the generalizability of the steps and limited data requirements, HEATcan be applied to any dataset containing narrative text, thus providing a framework for data-driven machine learning-enabled quantitative risk analysis across a variety of domains. To demonstrate HEAT in a case study, we apply theframework to the ICS-209-PLUS dataset of wildland fire incident response forms. Hazards identified in wildfire re-sponse arise from environmental conditions, the mission, and the wildland urban interface. The resulting risk matrixidentifies evacuations as high-risk hazards, while all other identified hazards are medium or serious risk.

natural language processing

Method for Tracking and Communicating Aggregate Risk Through the Use of Model-Based Systems Engineering (MBSE) Tools

Large, complex projects can identify a significant number and variety of risks, throughout the project life cycle. These risks are analyzed, mitigated, closed or accepted as independent uncertainties. Once closed or accepted, it is easy for projects to lose awareness of their impact. In reality, each of these risks contributes some amount to the overall risk posture of the project. The ability to track and effectively communicate this aggregate risk has represented a challenge to project management. There have been previous attempts to create a schema to communicate the aggregate effect of risks, without notable success. Most of these attempts have centered on some additive metric derived from the scoring of likelihood and consequence values. This, in and of itself, is a logical approach, but all too often the scores were then aggregated to a level where all context was lost. One weakness has been a lack of attempt to create linkages or logical groups of the risks upon which useful aggregation could then occur. The overall move to model-based (systems) engineering (MBSE) has opened up a vast frontier of opportunities to better integrate all project data. MBSE provides an underlying layer that links data items to each other. Objectives link to requirements, which then link to functions, functions to physical architecture items, and so on, as far down as projects want to model. While it started with a focus on modeling requirements based on things like use cases, efforts are now underway to integrate safety and mission assurance (S&MA) information and analyses, such as risks. This effort, called Model Based Mission Assurance (MBMA), is yielding models that are more useful and are a more accurate representations of the systems. MBSE models, with this ability to link related items, provide a new means of tracking and communicating aggregate risks. In the proposed method, risks are added into the models as distinct items, having attributes that communicate a scoring derived from the likelihood and consequence values as charted on the standard NASA 5x5 risk matrix. Like earlier efforts, each box in the 5x5 has an associated scoring, which may include both a current score and potential post-mitigation/control score. The risk items are then linked to elements of the model, such as system objectives/goals, requirements, functions, or physical architecture items, with "Risk to" relationships. These risks will then be communicated by use of reports generated from the model, detailing all risks and/or hazards linked to model elements. These reports can include aggregate impacts, including a current scoring and potential future state scoring based on the planned mitigations and/or controls. These reports will show all risks, open, accepted, and closed, linked to project objectives or requirements. When run as part of an upcoming risk acceptance discussion, these reports will serve to remind the team of all previous risks that relate to the effected portion of the system. When included as part of periodic program or project reviews, risk reviews, and safety reviews, this method can improve the overall understanding of the system's true risk posture. This proposed method takes full advantage of the advances that modern modeling techniques provide, with a minimal investment of additional time. Utilizing the model environment also enables a near constant access to current state of aggregate risks.

model based mission assurance

Silent Aircraft Initiative Concept Risk Assessment

A risk assessment of the Silent Aircraft Initiative's SAX-40 concept design for extremely low noise has been performed. A NASA team developed a list of 27 risk items, and evaluated the level of risk for each item in terms of the likelihood that the risk would occur and the consequences of the occurrence. The following risk items were identified as high risk, meaning that the combination of likelihood and consequence put them into the top one-fourth of the risk matrix: structures and weight prediction; boundary-layer ingestion (BLI) and inlet design; variable-area exhaust and thrust vectoring; displaced-threshold and continuous descent approach (CDA) operational concepts; cost; human factors; and overall noise performance. Several advanced-technology baseline concepts were created to serve as a basis for comparison to the SAX-40 concept. These comparisons indicate that the SAX-40 would have significantly greater research, development, test, and engineering (RDT&E) and production costs than a conventional aircraft with similar technology levels. Therefore, the cost of obtaining the extremely low noise capability that has been estimated for the SAX-40 is significant. The SAX-40 concept design proved successful in focusing attention toward low noise technologies and in raising public awareness of the issue.

Nickol, Craig L.

Natural Language Processing Techniques for Intelligent Knowledge Management of Safety Reports

Safety, failure, and incident reports are common artifacts across various domains, including aviation and wildfire response. These reports are often mandatory to submit, resulting in the culmination of large repositories of text-based documents. Simultaneously, these reports and corresponding repositories are often only manually analyzed and queried by users via out-of-date search engines. As a consequence, we have been developing the Manager for Intelligent Knowledge Access (MIKA) toolkit, which uses natural language processing to improve information access and reuse. In this presentation, we discuss natural language processing techniques for knowledge discovery and apply these methods to a repository of aerial wildfire mishap reports. Two methods are used for knowledge discovery: topic modeling and named-entity recognition. We use topic modeling to identify hazards and perform a trend analysis to produce a data-driven risk matrix. A custom named-entity recognition model, build from fine tuning a pre-trained language model, is used to identify failure modes, failure causes, failure effects, control processes, and recommendations to aid in failure modes and effects analysis (FMEA). Throughout the presentation, we discuss and apply natural language processing techniques to better leverage the vast amount of information contained in report repositories.

Machine learning

Multiple Changes to Reusable Solid Rocket Motors, Identifying Hidden Risks

The Space Shuttle Reusable Solid Rocket Motor (RSRM) baseline is subject to various changes. Changes are necessary due to safety and quality improvements, environmental considerations, vendor changes, obsolescence issues, etc. The RSRM program has a goal to test changes on full-scale static test motors prior to flight due to the unique RSRM operating environment. Each static test motor incorporates several significant changes and numerous minor changes. Flight motors often implement multiple changes simultaneously. While each change is individually verified and assessed, the potential for changes to interact constitutes additional hidden risk. Mitigating this risk depends upon identification of potential interactions. Therefore, the ATK Thiokol Propulsion System Safety organization initiated the use of a risk interaction matrix to identify potential interactions that compound risk. Identifying risk interactions supports flight and test motor decisions. Uncovering hidden risks of a full-scale static test motor gives a broader perspective of the changes being tested. This broader perspective compels the program to focus on solutions for implementing RSRM changes with minimal/mitigated risk. This paper discusses use of a change risk interaction matrix to identify test challenges and uncover hidden risks to the RSRM program.

Greenhalgh, Phillip O.

Reducing Software Security Risk Through an Integrated Approach

This paper discusses new joint work by the California Institute of Technology's Jet Propulsion Laboratory and the University of California at Davis sponsored by the National Aeronautics and Space Administration to develop a security assessment instrument for the software development and maintenance life cycle.

risk matrix

Further Developments in Modeling Creep Effects Within Structural SiC/SiC Components

Anticipating the implementation of advanced SiC/SiC composites into turbine section components of future aero-propulsion engines, the primary objective of this on-going study is to develop physics-based analytical and finite-element modeling tools to predict the effects of constituent creep on SiC/SiC component service life. A second objective is to understand how to possibly manipulate constituent materials and processes in order to minimize these effects. Focusing on SiC/SiC components experiencing through-thickness stress gradients (e.g., airfoil leading edge), prior NASA creep modeling studies showed that detrimental residual stress effects can develop globally within the component walls which can increase the risk of matrix cracking. These studies assumed that the SiC/SiC composites behaved as isotropic viscoelastic continuum materials with creep behavior that was linear and symmetric with stress and that the creep parameters could be obtained from creep data as experimentally measured in-plane in the fiber direction of advanced thin-walled 2D SiC/SiC panels. The present study expands on those prior efforts by including constituent behavior with non-linear stress dependencies in order to predict such key creep-related SiC/SiC properties as time-dependent matrix stress, constituent creep and content effects on composite creep rates and rupture times, and stresses on fiber and matrix during and after creep.

Lang, Jerry

Risk of Adverse Cognitive or Behavioral Conditions and Psychiatric Disorders

The NASA commitment to human space flight includes continuing to fly astronauts on the ISS until it is decommissioned as well as possibly returning astronauts to the moon or having astronauts venture to an asteroid or Mars. As missions leave low Earth orbit and explore deeper space, BHP supports and conducts research to enable a risk posture that considers the risk of adverse cognitive or behavioral conditions and psychiatric disorders “acceptable given mitigations,” for pre-, in, and post-flight.The Human System Risk Board (HSRB) determines the risk of various mission scenarios using a likelihood (per person per year) by consequences matrix examining those risks across two categories—long term health and operational (within mission). Colors from a stoplight signal are used by HSRB and quickly provide a means of assessing overall perceived risk for a particular mission scenario. Risk associated with the current six month missions on the ISS are classified as “accepted with monitoring” while planetary missions, such as a mission to Mars, are recognized to be a “red” risk that requires mitigation to ensure mission success.Currently, the HSRB deems that the risk of adverse cognitive or behavioral conditions and psychiatric outcomes requires mitigation for planetary missions owing to long duration isolation and radiation exposure (see Table 1). While limited research evidence exists from spaceflight, it is well known anecdotally that the shift from the two week shuttle missions to the six month ISS missions renders the psychological stressors of space as more salient over longer duration missions. Shuttle astronauts were expected just to tolerate any stressors that arose during their mission and were successful at doing so (Whitmire et al, 2013). While it is possible to deal with stressors such as social isolation and to live with incompatible crewmembers for two weeks on shuttle, “ignoring it” is much less likely to be a successful coping mechanism on station. For the longer missions of the ISS, astronauts require a larger, more robust set of coping skills and more psychological support. Evidence of this are the number of BHP’s Operational Psychology (Op Psy) staff who have been awarded silver Snoopys by long duration astronauts†, in the statements of praise for the Op Psy and Family Support Office teams, and in the written and oral statements from flown astronauts regarding difficulty of longer missions and how much Op Psy helped.

Slack, Kelley J.

Technology Readiness Assessment for Stirling Power Convertor

Stirling-based power conversion system could represent a critical enabling technology for future NASA missions, offering significantly enhanced power efficiency over traditional thermoelectric systems. To ensure the successful infusion of this technology into deep space and planetary surface missions, a rigorous evaluation of its maturity and associated risks is essential. The objective of this Technology Readiness Assessment (TRA) is to determine the current technology readiness level (TRL) of the Stirling power convertor and identify key technical risks and challenges associated with its maturation and potential infusion into a targeted flight system. The evaluation process will rigorously follow the NASA TRA procedure: (1) determining the requirements that underpin the design, function, and performance; (2) finding and listing all new technology elements (NTEs) and critical technology elements (CTEs); (3) identifying the level of integration assumed for the assessment; and (4) assessing the TRL for each NTE and CTE. The overall subassembly TRL will then be determined via a roll-up using the “weakest link” criterion, culminating in a final (5) assessment of risks to further progression of maturity. This paper will present the results of a comprehensive technology readiness assessment (TRA) conducted on the Stirling-based dynamic power conversion subassembly, excluding the radioisotope heat source. The paper will also describe a detailed breakdown of the TRL roll-up and a matrix of identified risks and recommended mitigation paths, along with identified key technical risks and challenges to achieve the required long-duration performance. Key Words: Radioisotope Power Conversion, Technology Readiness Assessment

Radioisotope Power Conversion