Search NASASearch

Engineering topics

Ian Lim

Publications and source records attributed to Ian Lim.

CHP-PRA Proof-of-Concept [Simulation] Sensitivity Assessment

An effort is underway to establish a Crew Health and Performance system (CHP) tradespace tool using a Probabilistic Risk Assessment (PRA) modeling and simulation system. The goal of the CHP-PRA effort is to provide a means of quantifying the integrated influence of CHP functions and capabilities on risk outcome metrics associated with health, performance, and long-term health. These metrics can then be used to establish potential risk-based trades on CHP system designed functionality and capabilities. Previously, our team demonstrated a proof-of-concept PRA approach that estimated the integrated influence of exercise countermeasures on 8 human system risks (Figure 1a) with outcomes associated with health and medical risk metrics. We reported that the change in the integrated relative health risk was small (Figure 1b) and that the small change in overall risk resulted from compounding and competing contribution levels of the individual risks. This interesting observation illustrates the emergent complexity of even straightforward representations of the human health and performance risk space and the ability of PRA models to capture this balance of global risk concerns. A key question that is not addressed in the initial analysis is “even though the global risk is relatively nominal, do any of the local risks become unacceptable?” In essence, we seek to determine what relative change in the human system risks are contributing to the relatively muted sensitivity of the proof-of-concept model combined risk assessments. Evaluations at the component risk level should elucidate if any individual risk reaches a high level that is subsequentially balanced by reductions in other areas. To further understand the relative changes in the component risks in the proof-of-concept model, and to elucidate how future refinements can be targeted, a means of establishing the contributions of the robustness of the proof-of-concept approach will be demonstrated.

astronaut health

Sensorimotor Application of Proposed Methods to Combine the Effects of Multiple Countermeasures for PRisM

Risk associated with human systems is challenging to quantify but is critical for the mission planning and decision making required to enable future Lunar and Martian missions. To address this gap, the Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) project is developing an integrated computational model for CHP mission risk. Much like how MEDPRAT is designed to allow medical resource trades informed by medical risk, CHP-PRA will enable analogous trades in human system risks across multiple CHP functions and capabilities. Human performance is one component of the risk intended to be captured by CHP-PRA through the Performance Risk Model (PRisM). The sensorimotor risk area provides a good frame of reference for investigating the structure of a performance model because most tasks that astronauts are expected to perform require input from the sensory system and/or movement/motor control. Additionally, sensorimotor countermeasures are an area of particular concern for NASA’s Human Research Program because of the increased sensorimotor risk associated with surface operations in Lunar and Martian missions. Thus, a tool that can quickly compare risk reductions of potential countermeasures would be beneficial in guiding research and development of effective countermeasures. In this proof of concept, we present a systematic way to combine multiple performance data sets for humans subjected to different countermeasures such that we can predict the countermeasure(s) that optimize astronaut performance on relevant tasks. PRisM assumes that both the tests that are used to measure countermeasure effectiveness (input data) and the tasks we use to represent astronaut performance, can be broken down and represented as a function/vector of the human systems required to perform that test/task. Through mathematical combination, test data are used to predict performance on astronaut tasks that use similar systems. We propose that when combining countermeasures evaluated using the same test, that only one value should be used to represent their combined effectiveness. We start our analysis with the assumption that two countermeasures together will perform better than each countermeasure individually. Our initial implementation of this framework compares various space motion sickness countermeasures and the most up to date analysis will be demonstrated at the IWS.

Caroline R Austin

Quantifying the Sensitivity of Condition Incidence Parameters in the Evidence Library

One approach to quantifying spaceflight risk at NASA makes use event driven probabilistic techniques. The Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) is such a tool that estimates medical risk metrics via simulation and enables optimization of medical resources subject to mission constraints [1]. Previous analyses have informed medical set composition, exercise countermeasures, and water intake, where each analysis quantifies the risk associated with proposed variations in system design. As future mission profiles extend beyond Low-Earth Orbit (LEO) and lengthen in duration, understanding these risks and contributing factors is critical. MEDPRAT employs Monte Carlo sampling techniques to simulate missions and track the occurrence of medical events. These events follow fault-tree-like progressions through levels of severity and mitigation via medical treatment to many possible outcomes and these are reported throughout the mission. Making this possible, are the medical databases that contain evidence gathered by the Human Research Program (HRP). Quantifying the impact of uncertainty or variability in the input data is an important step in evaluating the credibility of modeling and simulation results. In this work, we investigate the sensitivity of medical risk metrics with respect to the condition incidence parameters within the Evidence Library (EL) [2] as the medical database input for MEDPRAT. The medical conditions, contained in the EL, are equipped with incidence rates that describe the likelihood that the condition will occur. These incidence rates reflect historical spaceflight data or when appropriate, terrestrial data. In this presentation, we will explore how uncertainty in these rates propagate to the medical risk described by MEDPRAT. These results identify the conditions and parameters with the largest contribution to medical risks.

Ian Lim

Performance Risk Model (PRisM) Proof-of-Concept: An Operational Decision Support Tool to Predict Crew Performance in Space from Available Performance Tests

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center has developed a range of tools to evaluate astronaut health during spaceflight and to optimize the medical set required for missions. Among these, the Performance Risk Model (PRisM) represents a novel advancement, extending CHP-PRA’s focus beyond medical systems into the domain of human performance. Such tool could be pivotal in optimizing astronaut capabilities during space travel, thereby enhancing overall mission success. PRisM leverages data from well-established performance assessments conducted during previous crewed space missions and Earth analogs to strategically predict outcomes for planned tasks, even when direct performance testing has not been conducted for those specific tasks. To evaluate performance, PRisM references the various metrics outlined in NASA-STD-3001 and employs a methodology to integrate different performance scales. This framework analyzes the contribution of various human system task categories (HSTCs) to task execution and compares these contributions to the HSTCs’ involvement in other known tests. The model further employs a Monte Carlo simulation to sample performance scores from their distribution in operationally relevant tests such as those in Mulavara et al. (2018) and, by leveraging similarities in HSTC involvement, transfers this knowledge to actual mission tasks, such as those outlined in the "Human Exploration of Mars: Preliminary List of Crew Tasks”. The current PRisM proof-of-concept includes analyses of the impact of exercise and specific medications on astronauts’ performance, with provisions to incorporate additional countermeasures as data becomes available. Furthermore, the tool is customizable to include any system necessary to fully encompass the domain of human systems and can be adapted to evaluate performance for any spaceflight activities as requested by operational stakeholders. PRisM has the potential to assist the Human Research Program in exploring the capabilities trade space for optimized crew performance.

performance modeling

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling