Search NASA⌕ Search

SEARCH · Search NASA

Results for “probabilistic performance assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

The Future of Integrated Performance Modeling in the Crew Health and Performance – Probabilistic Risk Assessment Project

The NASA engineering community utilizes event-driven and fault-tree probabilistic techniques to classify risks in the space environment by taking advantage of the inherent knowledge of complex spaceflight system design and testing to quantify failure risk. In harmonizing the risk of human space flight, answering the question of ‘How do we balance health, performance and resource risks with other engineering risks on long duration space missions?’ remains a deeply challenging and largely qualitative practice. The Human Research Program’s Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) was a significant step forward in efforts to robustly quantify the risk to crew health for exploration missions. However, there remains a significant gap in the ability to comprehensively assess and characterize risk across the disparate functionalities and capabilities which comprise the Crew Health and Performance (CHP) system. The Crew Health and Performance – Probabilistic Risk Assessment (CHP-PRA) project seeks to characterize CHP risks by expanding beyond the foundation established by its PRA predecessors like IMM and MEDPRAT, that simulate medical risk metrics like loss of crew life and evacuations. One of the new risk measures in the CHP-PRA system is embodied in our Performance Risk Model (PRisM). PRisM provides a novel way of assessing crew performance on mission tasks, using a generalized framework which relates back to NASA-STD-3001. This approach allows PRisM to capture and integrate data from a variety of different domains into a single, unified, reproducible representation of astronaut performance. In this presentation, we discuss the motivation for the CHP-PRA work and give a high level overview of the goals of the project, outline the forward work for PRisM, and discuss collaboration opportunities for the community who might explore if their domain knowledge and data could be represented, integrated, and quantified with these tools, whose outcomes are metrics useful for supporting operational mission planning and decision making.

Lauren McIntyre↗
NASA NTRS1999

Probabilistic Assessment of Fracture Progression in Composite Structures

This report describes methods and corresponding computer codes that are used to evaluate progressive damage and fracture and to perform probabilistic assessment in built-up composite structures. Structural response is assessed probabilistically, during progressive fracture. The effects of design variable uncertainties on structural fracture progression are quantified. The fast probability integrator (FPI) is used to assess the response scatter in the composite structure at damage initiation. The sensitivity of the damage response to design variables is computed. The methods are general purpose and are applicable to stitched and unstitched composites in all types of structures and fracture processes starting from damage initiation to unstable propagation and to global structure collapse. The methods are demonstrated for a polymer matrix composite stiffened panel subjected to pressure. The results indicated that composite constituent properties, fabrication parameters, and respective uncertainties have a significant effect on structural durability and reliability. Design implications with regard to damage progression, damage tolerance, and reliability of composite structures are examined.

Chamis, Christos C.↗
NASA NTRSDate not supplied

Development of A Crew Health and Performance System Probabilistic Risk Assessment Tool: Proof-of-Concept Approach

The crew health and performance (CHP) system represents the span of technological interventions and tested processes and procedures that in combination address the human risk to space flight. The Human Research Program (HRP) mental model of the CHP system breaks the capabilities needed to meet NASA human flight systems standards into specific categories (i.e., countermeasures, behavioral health, medical intervention). These categories are further broken down into specific sub-groups generally associated with the human system risks that these capabilities seek to mitigate. Like the approach used to develop the Integrated Medical Model (IMM) and the Medical Extensible Dynamic Probabilistic Risk Analysis Tool (MEDPRAT), HRP tasked NASA GRC’s Cross-Cutting Computational Modeling Project with developing a CHP probabilistic risk assessment tool, the CHP-PRA. The CHP-PRA model seeks to quantify and relatively assess the human risk state within the crew health and performance domain, using a combination of knowledge about human system risks and technology and practices likely to be applied during space flight missions. This modeling system will incorporate customer and stakeholder feedback and be flexible enough to address multiple different questions about important low-level mission-specific parameters. This presentation will introduce the initial concept and development timeline for this tool and demonstrate proof-of-concept through an application addressing a specific human risk question posed within the Artemis program.

Risk analysis↗
NASA NTRSDate not supplied

Strategy for Risk Quantification of Spaceflight Crew Health and Performance Using Dynamic Probabilistic Risk Assessment

At NASA, the Crew Health and Performance (CHP) system represents the span of countermeasures, capabilities, interventions, and tested processes and procedures that in combination work to mitigate the human component of spaceflight mission risk. Across the varying NASA mental models of the CHP system, the different functionalities needed to meet human flight systems standards can be broken down into specific categories (i.e. medical capability, environmental health, behavioral health). These categories can be further broken down into specific subgroups generally associated with the CHP functionalities meant to mitigate or buy down individual human system risks. Taking a similar development approach we seek to leverage dynamic probabilistic risk assessment as a means to quantify and relatively assess the human risk state within the crew health and performance domain. By utilizing existing tools as integrators, we propose a rapid development strategy for incorporating research and operational data that represent the influence of the CHP system functionalities, in order to provide order of magnitudes estimates of the influence on most human system risks outcomes. The model system utilizes a modest cumulative risk approach and that limits the scope to primary paths of influence between the CHP functionalities and human system risks, thus enabling quick prototypes of the integrative effects of CHP functional combinations to solicit valuable feedback from stakeholders and customers on the data, relationship, and structure of the integration.

Drayton Munster↗
NASA NTRS2023

Risk Assessment for Asteroid Impact Threat Scenarios

Asteroid impacts can cause a wide range of damage through multiple potential hazards, from localized blast waves or thermal radiation, to tsunami inundation, to global climatic effects. The level of risk posed by these hazards depends not only upon their extent and severity, but also upon the likelihood of the various damage ranges. Some consequences may be more moderate but very likely, while others may be unlikely but catastrophic. Evaluating the risk from these hazards involves substantial uncertainties across all aspects of the problem, including the properties of the asteroid itself, the specifics of its entry, and the complex high-energy damage physics involved. NASA’s Asteroid Threat Assessment Project performs Probabilistic Asteroid Impact Risk (PAIR) assessments that use fast-running entry and hazard models to evaluate millions of impact cases representing the distributions of these many uncertain parameters. This paper presents current probabilistic asteroid impact risk assessment modeling tools and approaches used for evaluating specific asteroid impact threat cases. We give an overview of the current PAIR model used to support impact threat scenarios and discuss some of the key applications of these assessment in supporting response decisions and planetary defense preparedness. We then present the results and key findings from the recent 2023 PDC hypothetical impact exercise as an example of the primary types of risk results and metrics being developed to inform and support those mitigation and response decisions.

SMD↗
NASA NTRSDate not supplied

Proof-of-Concept for a Long-Term Health Metric to Quantify End of Mission Health Status in Astronauts

NASA has long used Probabilistic Risk Assessment (PRA) when high-stakes decisions need to be made about complex systems. For spaceflight medical risk, the Human Research Program’s Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) is a significant step towards robustly quantifying the risk to crew health during exploration missions. However, there remains a significant gap in the ability to comprehensively characterize and assess risk across the disparate functionalities and capabilities which comprise the entire Crew Health and Performance (CHP) system. To fill this gap, the Crew Health and Performance – Probabilistic Risk Assessment (CHP-PRA) project aims to perform risk characterization for the CHP system by assessing performance risk in addition to medical risk. This effort also includes quantifying Long-Term Health (LTH) risk in addition to in-mission risk outcomes within the CHP-PRA results. LTH risk encompasses the timeframe from immediately post-flight, through the rest of an astronaut’s career, through retirement, and until death. A proof-of-concept LTH risk metric is based on medical condition end-state, as defined by the Evidence Library, capturing the spaceflight specific medical impacts persisting into post-flight[1]. Condition outcomes in the Evidence Library progress through three Clinical Phases (CP): the diagnostic phase (CP1), the treatment/convalescent phase (CP2), and the end-state phase (CP3) which represents the detrimental effects of the condition after the crew member has recovered to the maximal extent. Each CP has an associated Task Impairment (TI), defined as the degree of crew incapacity due to experiencing the condition, and is quantified with a 0-1 range. Conditions with an associated CP3 (e.g. Sepsis, Traumatic Hypovolemic Shock, Sudden Cardiac Arrest, etc.) typically have serious consequences that can cause an astronaut to be fully or partially debilitated throughout the remainder of the mission. Consequently, the Cumulative CP3 TI End-of-Mission Health Status Metric is developed by CHP-PRA to quantify the cumulative effects of all conditions which progressed to the CP3 state throughout the entirety of the mission. Hence, this End-of-Mission Health Status Metric attempts to serve as an indicator of an astronaut’s health state at the time of landing. The severity of the lingering effects of in-mission medical events are dependent on mission activities and the level of available in-mission medical care. This allows the associated cumulative TI metric to be used in comparison with the crew’s end of mission health status for different levels of in-mission resources. This presentation provides the strategy for using CP3 as an LTH metric component, as well as a proof-of-concept demonstration of LTH risk characterization using this component.

long term health↗
NASA NTRSDate not supplied

LLMs and GenAI Tools to Depict Contributions of Human Systems to Spaceflight Tasks Execution

Recent advancements in Artificial Intelligence and Machine Learning (AI/ML) technologies, particularly Large Language Models (LLMs) capable of sophisticated syntax analysis, offer substantial potential in automating complex processes, thereby saving time and human resources. This study explores the development of an LLM-driven model designed to analyze and categorize a diverse set of Mars mission tasks into 18 predefined Human System Task Categories (HSTCs) based on their textual descriptions. As part of developing the Crew Health and Performance – Probabilistic Risk Assessment (CHP-PRA projects Performance Risk Model (PRisM) proof-of-concept, we established a framework to project performance scores from small-scale tests onto a preliminary list of Mars tasks. The foundation of our model was a comprehensive spreadsheet populated by NASA experts and clinicians, which detailed each Mars task alongside binary indicators of HSTC involvement. This dataset enabled the initial application of supervised ML, training and testing on existing HSTC labels. The HSTCs were originally defined from a medical system perspective, focusing on task impairments due to deteriorated human health. To expand our model's scope to include categories impacting performance, we face the challenge of generating binary labels (0 or 1) for new categories without pre-existing data. We address this by employing Generative AI (GenAI) software to determine whether a given task involved a new category by asking, "Does task A involve using category B?" We validate our approach by comparing the GenAI's binary classifications with the expert-provided labels for existing HSTCs. Notably, we utilize Ollama [4], a locally hosted GenAI tool that does not require cloud access, thus safeguarding NASA's proprietary data from unauthorized exposure. This study demonstrates the feasibility of leveraging cutting-edge AI tools to advance research, paving the way for automation and rapid decision-making in space exploration.

Mona Matar↗
NASA NTRS2020

Bayesian Framework For Bioburden Density Calculations To Perform Planetary Protection Probabilistic Risk Assessment

The planetary protection discipline aims to minimize the microbial contamination on spacecraft to prevent the inadvertent contamination of other planetary bodies, known as forward planetary protection (PP). Planetary protection probabilistic risk assessment (PRA) relies on two core methodologies-the contamination probability event tree analysis and statistical parameter estimation. Planetary protection engineers combine several techniques to estimate the bioburden present on spacecraft components. A direct assay to enumerate CFU (colony forming units) is the preferred methodology, but given a similar processing environment the bioburden present on certain components is inferred using: (1) a NASA defined bioburden estimate based upon the biological cleanliness of the manufacturing/assembly environment or (2) sampled data from a similar spacecraft component. The paper presents an empirical Bayesian framework to systematically treat bioburden estimation and its uncertainties on different levels starting with measurement procedures to combining different components to subsystems and whole spacecraft. It is shown that the Bayesian approach can effectively handle estimations and their uncertainties at different levels and produce a reliable estimate for bioburden to be used to evaluate the probability of contamination.

Seuylemezian, Arman↗
NASA NTRSDate not supplied

Probabilistic Approach to Assessing Capture System Performance Margin in Mars Sample Return's Capture, Containment, and Return System

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional,” in the sense that guiding margin principles are non-existent, systems engineering processes are required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations which applies global sensitivity analyses to identify input parameters that should drive the design. This approach is used to design a critical payload required for the Mars Sample Return campaign aiming at bringing back rock and atmospheric samples from Mars.

Performance Margins↗
NASA NTRSDate not supplied

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗
NASA NTRSDate not supplied

Strategies for Quantifying Human Space Flight Performance in the Crew Health and Performance System

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center is planning a customized approach to quantify human spaceflight performance changes with respect to changes to the CHP system functions and capabilities. Using the Directed Acyclic Graphs (DAG) initiated by NASA’s Human Systems Risk Board (HSRB) [1], the team is surveying potential candidate models and novel strategies that generate metrics suitable for supporting decision making related to how the CHP system may influence human system performance risk. One such investigation includes classic Human Reliability Analysis (HRA) models. Traditionally, HRA methods estimate the occurrence of human errors and their impact on the success of an activity when designing and operating a system. While humans perceive, interpret, decide on, and carry out a course of action, the factors affecting performance and error likelihood are commonly referred to as performance shaping factors (PSFs). Originally developed to alleviate safety concerns related to nuclear power plant operations, HRA methods such as THERP [2] and CREAM [3] dismantle an activity into tasks, requiring elemental steps to be executed, and assess their failure due to predefined PSFs. In this study, we compare generic HRA methods and those that incorporate some human spaceflight aspects, such as sleep conditions (SCREAM [4]), with respect to how they may be adopted to capture performance with an intention to mitigate detrimental outcomes elucidated by the HSRB DAGs. We suggest strategies to quantify astronaut performance specific to spaceflight activities and illustrate how such concepts may help in optimizing the CHP system capabilities with respect to Artemis missions.

dag↗
NASA NTRS1996

Probabilistic Assessment of National Wind Tunnel

A preliminary probabilistic structural assessment of the critical section of National Wind Tunnel (NWT) is performed using NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) computer code. Thereby, the capabilities of NESSUS code have been demonstrated to address reliability issues of the NWT. Uncertainties in the geometry, material properties, loads and stiffener location on the NWT are considered to perform the reliability assessment. Probabilistic stress, frequency, buckling, fatigue and proof load analyses are performed. These analyses cover the major global and some local design requirements. Based on the assumed uncertainties, the results reveal the assurance of minimum 0.999 reliability for the NWT. Preliminary life prediction analysis results show that the life of the NWT is governed by the fatigue of welds. Also, reliability based proof test assessment is performed.

Shah, A. R.↗
NASA NTRSDate not supplied

Performance Risk Model (PRisM) Proof-of-Concept: An Operational Decision Support Tool to Predict Crew Performance in Space from Available Performance Tests

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center has developed a range of tools to evaluate astronaut health during spaceflight and to optimize the medical set required for missions. Among these, the Performance Risk Model (PRisM) represents a novel advancement, extending CHP-PRA’s focus beyond medical systems into the domain of human performance. Such tool could be pivotal in optimizing astronaut capabilities during space travel, thereby enhancing overall mission success. PRisM leverages data from well-established performance assessments conducted during previous crewed space missions and Earth analogs to strategically predict outcomes for planned tasks, even when direct performance testing has not been conducted for those specific tasks. To evaluate performance, PRisM references the various metrics outlined in NASA-STD-3001 and employs a methodology to integrate different performance scales. This framework analyzes the contribution of various human system task categories (HSTCs) to task execution and compares these contributions to the HSTCs’ involvement in other known tests. The model further employs a Monte Carlo simulation to sample performance scores from their distribution in operationally relevant tests such as those in Mulavara et al. (2018) and, by leveraging similarities in HSTC involvement, transfers this knowledge to actual mission tasks, such as those outlined in the "Human Exploration of Mars: Preliminary List of Crew Tasks”. The current PRisM proof-of-concept includes analyses of the impact of exercise and specific medications on astronauts’ performance, with provisions to incorporate additional countermeasures as data becomes available. Furthermore, the tool is customizable to include any system necessary to fully encompass the domain of human systems and can be adapted to evaluate performance for any spaceflight activities as requested by operational stakeholders. PRisM has the potential to assist the Human Research Program in exploring the capabilities trade space for optimized crew performance.

performance modeling↗
NASA NTRSDate not supplied

Sensorimotor Application of Proposed Methods to Combine the Effects of Multiple Countermeasures for PRisM

Risk associated with human systems is challenging to quantify but is critical for the mission planning and decision making required to enable future Lunar and Martian missions. To address this gap, the Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) project is developing an integrated computational model for CHP mission risk. Much like how MEDPRAT is designed to allow medical resource trades informed by medical risk, CHP-PRA will enable analogous trades in human system risks across multiple CHP functions and capabilities. Human performance is one component of the risk intended to be captured by CHP-PRA through the Performance Risk Model (PRisM). The sensorimotor risk area provides a good frame of reference for investigating the structure of a performance model because most tasks that astronauts are expected to perform require input from the sensory system and/or movement/motor control. Additionally, sensorimotor countermeasures are an area of particular concern for NASA’s Human Research Program because of the increased sensorimotor risk associated with surface operations in Lunar and Martian missions. Thus, a tool that can quickly compare risk reductions of potential countermeasures would be beneficial in guiding research and development of effective countermeasures. In this proof of concept, we present a systematic way to combine multiple performance data sets for humans subjected to different countermeasures such that we can predict the countermeasure(s) that optimize astronaut performance on relevant tasks. PRisM assumes that both the tests that are used to measure countermeasure effectiveness (input data) and the tasks we use to represent astronaut performance, can be broken down and represented as a function/vector of the human systems required to perform that test/task. Through mathematical combination, test data are used to predict performance on astronaut tasks that use similar systems. We propose that when combining countermeasures evaluated using the same test, that only one value should be used to represent their combined effectiveness. We start our analysis with the assumption that two countermeasures together will perform better than each countermeasure individually. Our initial implementation of this framework compares various space motion sickness countermeasures and the most up to date analysis will be demonstrated at the IWS.

Caroline R Austin↗
NASA NTRS2017

Probabilistic Asteroid Impact Risk Assessment for the Hypothetical PDC17 Impact Exercise

Performing impact risk assessment for the 2017 Planetary Defense Conference (PDC17) hypothetical impact exercise, to take place at the PDC17 conference, May 15-20, 2017. Impact scenarios and trajectories are developed and provided by NASA's Near Earth Objects Office at JPL (Paul Chodas). These results represent purely hypothetical impact scenarios, and do not reflect any known asteroid threat. Risk assessment was performed using the Probabilistic Asteroid Impact Risk (PAIR) model developed by the Asteroid Threat Assessment Project (ATAP) at NASA Ames Research Center. This presentation includes sample results that may be presented or used in discussions during the various stages of the impact exercisecenter dot Some cases represent alternate scenario options that may not be used during the actual impact exercise at the PDC17 conference. Updates to these initial assessments and/or additional scenario assessments may be performed throughout the impact exercise as different scenario options unfold.

Asteroid Impact Risk↗