Search NASA⌕ Search

SEARCH · Search NASA

Results for “human performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Human-Robot Interaction in High Vulnerability Domains

Future NASA missions will require successful integration of the human with highly complex systems. Highly complex systems are likely to involve humans, automation, and some level of robotic assistance. The complex environments will require successful integration of the human with automation, with robots, and with human-automation-robot teams to accomplish mission critical goals. Many challenges exist for the human performing in these types of operational environments with these kinds of systems. Systems must be designed to optimally integrate various levels of inputs and outputs based on the roles and responsibilities of the human, the automation, and the robots; from direct manual control, shared human-robotic control, or no active human control (i.e. human supervisory control). It is assumed that the human will remain involved at some level. Technologies that vary based on contextual demands and on operator characteristics (workload, situation awareness) will be needed when the human integrates into these systems. Predictive models that estimate the impact of the technologies on the system performance and the on the human operator are also needed to meet the challenges associated with such future complex human-automation-robot systems in extreme environments.

workload↗

Human Reliability Analysis: An Overview

Human/process error is potentially a large contributor to failures of aerospace systems. For some systems, such as the space shuttle main engine, large amounts of data are available, and accurate failure rates can be determined empirically. For such systems, the human error is implicit in the empirical failure rate and does not need to be quantified separately. However, for other systems, such as the solid rocket boosters, large amounts of data are not available and the failure rates must be determined by more theoretical means. When empirical data is lacking, structural models and engineering judgment must be employed. In this case, the human/process error must be modeled explicitly. An extensive literature review was performed to determine what methods already exist for modeling human error for aerospace systems. No methods that apply directly were found, although there are a number of methods that have been developed specifically for the nuclear power industry that could probably be modified for space applications. The results of the literature review are presented, as well as recommendations for future research.

Navard, Sharon E.↗

Preview control behavior and optimal control norms

Model based on optimal control theory for characterizing human operator in preview control task to provide reference frame for studying performance value and learning in manual control

HUMAN PERFORMANCE↗

Instantiation of HCML Demonstrating Bayesian Predictive Modeling for Attentional Control

The research team developed models of Attentional Control (AC) that are unique to existing modeling approaches in the literature. The goal was to enable the research team to (1) make predictions about AC and human performance in real-world scenarios and (2) to make predictions about individual characteristics based on human data. First, the team developed a proof-of-concept approach for representing an experimental design and human subjects data in a Bayesian model, then demonstrated an ability to draw inferences about conditions of interest relevant to real-world scenarios. Ultimately, this effort was successful, and we were able to make reasonable (meaning supported by behavioral data) inferences about conditions of interest to develop a risk model for AC (where risk is defined as a mismatch between AC and attentional demand). The team additionally defined a path forward for a human-constrained machine learning (HCML) approach to make predictions about an individual's state based on performance data. The effort represents a successful first step in both modeling efforts and serves as a basis for future work activities. Numerous opportunities for future work have been defined.

97 MATHEMATICS AND COMPUTING↗

Acquisition and production of skilled behavior in dynamic decision-making tasks

Summaries of the four projects completed during the performance of this research are included. The four projects described are: Perceptual Augmentation Aiding for Situation Assessment, Perceptual Augmentation Aiding for Dynamic Decision-Making and Control, Action Advisory Aiding for Dynamic Decision-Making and Control, and Display Design to Support Time-Constrained Route Optimization. Papers based on each of these projects are currently in preparation. The theoretical framework upon which the first three projects are based, Ecological Task Analysis, was also developed during the performance of this research, and is described in a previous report. A project concerned with modeling strategies in human control of a dynamic system was also completed during the performance of this research.

Kirlik, Alex↗

Modeling Visual, Vestibular and Oculomotor Interactions in Self-Motion Estimation

A computational model of human self-motion perception has been developed in collaboration with Dr. Leland S. Stone at NASA Ames Research Center. The research included in the grant proposal sought to extend the utility of this model so that it could be used for explaining and predicting human performance in a greater variety of aerospace applications. This extension has been achieved along with physiological validation of the basic operation of the model.

Perrone, John↗

Explainable Synthesizability Prediction of Inorganic Crystal Polymorphs Using Large Language Models

Abstract We evaluate the ability of machine learning to predict whether a hypothetical crystal structure can be synthesized and explain those predictions to scientists. Fine‐tuned large language models (LLMs) trained on a human‐readable text description of the target crystal structure perform comparably to previous bespoke convolutional graph neural network methods, but better prediction quality can be achieved by training a positive‐unlabeled learning model on a text‐embedding representation of the structure. An LLM‐based workflow can then be used to generate human‐readable explanations for the types of factors governing synthesizability, extract the underlying physical rules, and assess the veracity of those rules. These explanations can guide chemists in modifying or optimizing non‐synthesizable hypothetical structures to make them more feasible for materials design.

Kim, Seongmin [Department of Chemical and Biologic↗

Explainable Synthesizability Prediction of Inorganic Crystal Polymorphs Using Large Language Models

Abstract We evaluate the ability of machine learning to predict whether a hypothetical crystal structure can be synthesized and explain those predictions to scientists. Fine‐tuned large language models (LLMs) trained on a human‐readable text description of the target crystal structure perform comparably to previous bespoke convolutional graph neural network methods, but better prediction quality can be achieved by training a positive‐unlabeled learning model on a text‐embedding representation of the structure. An LLM‐based workflow can then be used to generate human‐readable explanations for the types of factors governing synthesizability, extract the underlying physical rules, and assess the veracity of those rules. These explanations can guide chemists in modifying or optimizing non‐synthesizable hypothetical structures to make them more feasible for materials design.

Kim, Seongmin [Department of Chemical and Biologic↗

Stochastic parametric skeletal dosimetry model for humans: General approach and application to active marrow exposure from bone-seeking beta-particle emitters

The objective of this study is to develop a skeleton model for assessing active marrow dose from bone-seeking beta-emitting radionuclides. This article explains the modeling methodology which accounts for individual variability of the macro- and microstructure of bone tissue. Bone sites with active hematopoiesis are assessed by dividing them into small segments described by simple geometric shapes. Spongiosa, which fills the segments, is modeled as an isotropic three-dimensional grid (framework) of rod-like trabeculae that “run through” the bone marrow. Randomized multiple framework deformations are simulated by changing the positions of the grid nodes and the thickness of the rods. Model grid parameters are selected in accordance with the parameters of spongiosa microstructures taken from the published papers. Stochastic modeling of radiation transport in heterogeneous media simulating the distribution of bone tissue and marrow in each of the segments is performed by Monte Carlo methods. Model output for the human femur at different ages is provided as an example. The uncertainty of dosimetric characteristics associated with individual variability of bone structure was evaluated. An advantage of this methodology for the calculation of doses absorbed in the marrow from bone-seeking radionuclides is that it does not require additional studies of autopsy material. The biokinetic model results will be used in the future to calculate individual doses to members of a cohort exposed to 89,90 Sr from liquid radioactive waste discharged to the Techa River by the Mayak Production Association in 1949–1956. Further study of these unique cohorts provides an opportunity to gain more in-depth knowledge about the effects of chronic radiation on the hematopoietic system. In addition, the proposed model can be used to assess the doses to active marrow under any other scenarios of 90 Sr and 89 Sr intake to humans.

59 BASIC BIOLOGICAL SCIENCES↗

CHP-PRA Proof-of-Concept [Simulation] Sensitivity Assessment

An effort is underway to establish a Crew Health and Performance system (CHP) tradespace tool using a Probabilistic Risk Assessment (PRA) modeling and simulation system. The goal of the CHP-PRA effort is to provide a means of quantifying the integrated influence of CHP functions and capabilities on risk outcome metrics associated with health, performance, and long-term health. These metrics can then be used to establish potential risk-based trades on CHP system designed functionality and capabilities. Previously, our team demonstrated a proof-of-concept PRA approach that estimated the integrated influence of exercise countermeasures on 8 human system risks (Figure 1a) with outcomes associated with health and medical risk metrics. We reported that the change in the integrated relative health risk was small (Figure 1b) and that the small change in overall risk resulted from compounding and competing contribution levels of the individual risks. This interesting observation illustrates the emergent complexity of even straightforward representations of the human health and performance risk space and the ability of PRA models to capture this balance of global risk concerns. A key question that is not addressed in the initial analysis is “even though the global risk is relatively nominal, do any of the local risks become unacceptable?” In essence, we seek to determine what relative change in the human system risks are contributing to the relatively muted sensitivity of the proof-of-concept model combined risk assessments. Evaluations at the component risk level should elucidate if any individual risk reaches a high level that is subsequentially balanced by reductions in other areas. To further understand the relative changes in the component risks in the proof-of-concept model, and to elucidate how future refinements can be targeted, a means of establishing the contributions of the robustness of the proof-of-concept approach will be demonstrated.

astronaut health↗

Intelligent Systems Approach for Automated Identification of Individual Control Behavior of a Human Operator

Results have been obtained using conventional techniques to model the generic human operator?s control behavior, however little research has been done to identify an individual based on control behavior. The hypothesis investigated is that different operators exhibit different control behavior when performing a given control task. Two enhancements to existing human operator models, which allow personalization of the modeled control behavior, are presented. One enhancement accounts for the testing control signals, which are introduced by an operator for more accurate control of the system and/or to adjust the control strategy. This uses the Artificial Neural Network which can be fine-tuned to model the testing control. Another enhancement takes the form of an equiripple filter which conditions the control system power spectrum. A novel automated parameter identification technique was developed to facilitate the identification process of the parameters of the selected models. This utilizes a Genetic Algorithm based optimization engine called the Bit-Climbing Algorithm. Enhancements were validated using experimental data obtained from three different sources: the Manual Control Laboratory software experiments, Unmanned Aerial Vehicle simulation, and NASA Langley Research Center Visual Motion Simulator studies. This manuscript also addresses applying human operator models to evaluate the effectiveness of motion feedback when simulating actual pilot control behavior in a flight simulator.

Zaychik, Kirill B.↗

Piloted Well Clear Performance Evaluation of Detect and Avoid Systems with Suggestive Guidance

Regulations to establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions (RTCA, 2013). Those requirements will apply to the new detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the United States (U.S) National Airspace System (NAS) and will be determined according to their contribution to the overall safety case. That safety case requires demonstration that DAA-equipped UAS collectively operating in the NAS meet an airspace safety threshold (AST). Several key gaps must be closed in order to link equipment requirements to an airspace safety case. Foremost among these is calculation of the systems risk ratio, the degree to which a particular system mitigates violation of an aircraft separation standard (FAA, 2013). The risk ratio of a DAA system, in combination with risk ratios of other collision mitigation mechanisms, will determine the overall safety of the airspace measured in terms of the number of collisions per flight hour. It is not known what the effectiveness is of a pilot-in-the-loop DAA system or even what parameters of the DAA system most improve the pilots ability to maintain separation. The relationship between the DAA system design and the overall effectiveness of the DAA system that includes the pilot, expressed as a risk ratio, must be determined before DAA operational and performance requirements can be finalized. Much research has been devoted to integrating UAS into non-segregated airspace (Dalamagkidis, 2009, Ostwald, 2007, Gillian, 2012, Hesselink, 2011, Santiago, 2015, Rorie 2015 and 2016). Several traffic displays intended for use as part of a DAA system have gone through human-in-the-loop simulation and flight-testing. Most of these evaluations were part of development programs to produce a deployable system, so it is unclear how to generalize particular aspects of those designs to general requirements for future traffic displays (Calhoun, 2014). Other displays have undergone testing to collect data that may generalize to new displays, but have not been evaluated in the context of the development of an overall safety case for UAS equipped with DAA systems in the NAS (Bell, 2012). Other research efforts focus on DAA surveillance performance and separation standards. Together with this work, they are expected to facilitate validation of the airspace safety case (Park, 2014 and Johnson, 2015). The contribution of the present work is to quantify the effectiveness of the pilot-automation system to remain well clear as a function of display features and surveillance sensor error. This quantification will help enable selection of a minimum set of DAA design features that meets the AST, a set that may not be unique for all UAS platforms. A second objective is to collect and analyze pilot performance parameters that will improve the modeling of overall DAA system performance in non-human-in-the-loop simulations. Simulating the DAA-equipped UAS in such batch experiments will allow investigation of a much larger number of encounters than is possible in human simulations. This capability is necessary to demonstrate that a particular set of DAA requirements meets the AST under all foreseeable operational conditions.

detect and avoid↗

Mars Planetary Network for Human Exploration Era – Potential Challenges and Solutions

During 2016-2017, a study was conducted under the sponsorship of the NASA’s Space Communications and Navigation (SCaN) Program to investigate the deep space communications capacity taking into account the needs of all the present and envisioned future missions toward 2030s. It was soon recognized that planning for human exploration to Mars would impose certain unprecedent challenges, both fiscal and technical, to the current space communications paradigm. Targeting the assumed missions concepts, i.e., Crewed Mission to Phobos (CMTP) and Mars Short Stay Mission (MSSM), a Mars Planetary Network for the human exploration era has been formulated. The activity modeling and network traffic simulation/modeling we performed gave some insight into the technical challenges in space communications for the envisioned human Mars exploration era. Chief among the potential challenges are: (1) the high demand on the deep space network (DSN) assets for achieving the high-rate links, both return and forward, from Mars farthest/farther distance (up to 2.67 AU); (2) the need for resilient, persistent communication coverage for crewed vehicles, on surface and in orbits; (3) the significant period of outage for the Mars-Earth link due to superior solar conjunction; (4) the need for on-demand, simultaneous access to the proximity link by multiple vehicles and astronauts in the exploration zone; (5) the capability of determining precise, real-time, positions of surface vehicles and astronauts by the deep space habitat and/or other tele-operations entities. Solution space to each of the above challenges has been explored and analyzed in the context of the individual problem domain and, more importantly, in conjunction with that for the other challenges. This has led to an end-to-end definition of a Mars Planetary Network that would feature: (1) the fusion of deep space Ka-band and optical communications for achieving Mars-Earth high-rate links taking advantage of the optical/RF hybrid 8m/34m antennas in DSN; (2) the integrated application of the Multiple Spacecraft Per Antenna (MSPA) technique, for return link data acquisition, and the Multiple Uplink Per Antenna (MUPA) technique, for forward link data trasnmission, to reduce the number of 34m beam-wave guide (BWG) antennas needed for the era; (3) the integration of three, arrayed, 34m beam-wave guide (BWG) antennas, to provide a high G/T aperture, with the MSPA/MUPA techniques, and a dual “trunk link”approach to cut down the needed G/T -- hence, reducing the number of 34m antennas, relative to that in the single trunk approach by 50%; (4) the deployment of two areostationary/areosynchronous Mars relay orbiters; one of them could also function as (or be served by) a notional Deep Space Habitat (DSH); (5) the opportunistic deployment of a science orbiter in a Pioneer-6 type orbit, equidistant Mars/Earth, that could also serve as an intermediary relay during the Mars superior solar conjunction perod; (6) the existence of the multi-function Mars proximity link that provides the demand-assigned, multiple access (DAMA) capability; and (7) the provision of tracking observables, by leveraging on the planned Mars orbiting and surface infrastructure, to enable the in-situ navigation for surface and orbiting vehicles. This paper provides the description of the proposed Mars Planetary Network in the human exploration era, the trade-off analysis for the various alternative architectures, and the optimal solutions to the key challenges in defining this end-to-end network.

Cheung, Kar-Ming↗

Strategies for Quantifying Human Space Flight Performance in the Crew Health and Performance System

The Crew Health and Performance-Probabilistic Risk Assessment (CHP-PRA) team at NASA Glenn Research Center is planning a customized approach to quantify human spaceflight performance changes with respect to changes to the CHP system functions and capabilities. Using the Directed Acyclic Graphs (DAG) initiated by NASA’s Human Systems Risk Board (HSRB) [1], the team is surveying potential candidate models and novel strategies that generate metrics suitable for supporting decision making related to how the CHP system may influence human system performance risk. One such investigation includes classic Human Reliability Analysis (HRA) models. Traditionally, HRA methods estimate the occurrence of human errors and their impact on the success of an activity when designing and operating a system. While humans perceive, interpret, decide on, and carry out a course of action, the factors affecting performance and error likelihood are commonly referred to as performance shaping factors (PSFs). Originally developed to alleviate safety concerns related to nuclear power plant operations, HRA methods such as THERP [2] and CREAM [3] dismantle an activity into tasks, requiring elemental steps to be executed, and assess their failure due to predefined PSFs. In this study, we compare generic HRA methods and those that incorporate some human spaceflight aspects, such as sleep conditions (SCREAM [4]), with respect to how they may be adopted to capture performance with an intention to mitigate detrimental outcomes elucidated by the HSRB DAGs. We suggest strategies to quantify astronaut performance specific to spaceflight activities and illustrate how such concepts may help in optimizing the CHP system capabilities with respect to Artemis missions.

dag↗

E-Area Low-Level Waste Facility Inadvertent Human Intruder Limits and Doses in Support of the PA2022

This report documents the inadvertent human intruder (IHI) analysis for the E-Area Low-Level Waste Facility (ELLWF) at the Savannah River Site (SRS), near Aiken, South Carolina. This analysis supports the revised ELLWF Performance Assessment (PA), complying with the Department of Energy standard for operation of low-level waste disposal facilities (USDOE, 2017). The ELLWF is an operating waste disposal facility and is scheduled to continue accepting waste to 2065. One task of the revised PA is to establish waste inventory limits for the various disposal units at ELLWF. This is done by modeling future contaminant release and transport through applicable pathways to human receptors, comparing predicted doses per disposed curie with applicable performance measures, to obtain inventory limits which will assure that doses to receptors do not exceed performance measures. This report documents results of modeling future doses to one class of receptor, the inadvertent human intruder. It is assumed that after site closure, public knowledge of the site is lost, and IHIs will engage in activities on the ELLWF that will disrupt the closure cap, causing dose to the IHI. Following USDOE (2017), six different stylized exposure scenarios are considered, simulating activities by an IHI which could result in a radiological dose. The six scenarios are: • Acute – Basement Construction: IHI constructs a basement and encounters waste during excavation which is inadvertently mixed with clean soil and diluted. • Acute – Well Drilling: IHI drills a water well through waste and is exposed to drill cuttings mixed with clean soil that are brought to the surface. • Acute – Discovery: IHI begins constructing a basement but stops when encountering the riprap in the final closure cap and is exposed to photon radiation from unexcavated material residing in the undisturbed waste zone. • Chronic – Agriculture: Resident IHI is exposed to waste that was excavated for basement construction and mixed with native soil in the intruder’s vegetable garden. • Chronic – Post-Drilling: Resident IHI is exposed to waste from drill cuttings mixed with native soil and scattered in the garden area. • Chronic – Residential: Resident IHI is exposed to external radiation while in home located above waste with shielding provided by the concrete basement floor and any soil or engineered material remaining between the basement and waste. Dose calculations are performed using the SRNL Dose Toolkit (Aleman, 2023), following the approach of Smith et al (2019). Calculations are performed separately for 27 of the 33 disposal units (DUs) at ELLWF and are radionuclide specific. The results of the IHI analysis include: • Dose Factors: mrem per disposed curie (acute) and mrem/yr per disposed curie (chronic) for each parent radionuclide, for each DU. • Inventory Limits: in curies, for each parent radionuclide, for each DU. • Estimated Dose to IHI: mrem (acute) and mrem/yr (chronic), for each DU, given its projected closure inventory without inventory biases applied. Most DU-specific IHI inventory limits are in the range of 10 3 to 10 7 curies per nuclide. The lowest inventory limits are associated with gamma-emitters such as Sn-126, Ra-226, Th-232, and Cm-248. Radionuclides with short half-lives such as Pu-241, and nuclides which are pure beta emitters or which decay by electron capture, such as Ni-59 and Ni-63, have the highest limits. For the 27 evaluated DUs, predicted IHI doses are shown in Table ES-1. The maximum acute dose is 1.18 mrem, at ST23, much less than the DOE performance measure of 500 mrem (USDOE, 2017). The highest chronic dose is 37.2 mrem/yr at ST02, below the DOE performance measure of 100 mrem/yr. Also shown are estimated inventory sums of fractions (SOFs) at closure in 2065, for groundwater (GW) and IHI pathways. For each DU, the inventory is constrained by the GW pathway. For most DUs, the IHI SOFs are approximately 1000 times lower than the GW SOF values, and the IHI pathway does not drive risk for any disposal unit.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Federated benchmarking of medical artificial intelligence with MedPerf

Medical artificial intelligence (AI) has tremendous potential to advance healthcare by supporting and contributing to the evidence-based practice of medicine, personalizing patient treatment, reducing costs, and improving both healthcare provider and patient experience. Unlocking this potential requires systematic, quantitative evaluation of the performance of medical AI models on large-scale, heterogeneous data capturing diverse patient populations. Here, to meet this need, we introduce MedPerf, an open platform for benchmarking AI models in the medical domain. MedPerf focuses on enabling federated evaluation of AI models, by securely distributing them to different facilities, such as healthcare organizations. This process of bringing the model to the data empowers each facility to assess and verify the performance of AI models in an efficient and human-supervised process, while prioritizing privacy. We describe the current challenges healthcare and AI communities face, the need for an open platform, the design philosophy of MedPerf, its current implementation status and real-world deployment, our roadmap and, importantly, the use of MedPerf with multiple international institutions within cloud-based technology and on-premises scenarios. Finally, we welcome new contributions by researchers and organizations to further strengthen MedPerf as an open benchmarking platform.

60 APPLIED LIFE SCIENCES↗

International Space Station Science Research Accomplishments During the Assembly Years: An Analysis of Results from 2000-2008

This report summarizes research accomplishments on the International Space Station (ISS) through the first 15 Expeditions. When research programs for early Expeditions were established, five administrative organizations were executing research on ISS: bioastronautics research, fundamental space biology, physical science, space product development, and space flight. The Vision for Space Exploration led to changes in NASA's administrative structures, so we have grouped experiments topically by scientific themes human research for exploration, physical and biological sciences, technology development, observing the Earth, and educating and inspiring the next generation even when these do not correspond to the administrative structure at the time at which they were completed. The research organizations at the time at which the experiments flew are preserved in the appendix of this document. These investigations on the ISS have laid the groundwork for research planning for Expeditions to come. Humans performing scientific investigations on ISS serve as a model for the goals of future Exploration missions. The success of a wide variety of investigations is an important hallmark of early research on ISS. Of the investigations summarized here, some are completed with results released, some are completed with preliminary results, and some remain ongoing.

Evans, Cynthia A.↗