SEARCH · Search NASA

Results for “multi-modal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Human Capabilities Assessments for Autonomous Missions: A Multi-Team Research Effort to Reduce Risk in the Human-System Integration Architecture for Future Deep-Space Missions

In future exploration missions beyond low earth-orbit, crew will have to execute complex operations and respond to off-nominal events, without real-time support from Mission Control. It is anticipated that increased reliance on automated systems, including human-centric vehicle and information architecture, will need to be designed to support the crew; increased risk to performance, health, and safety may occur if these are not implemented appropriately. The Human Factors and Behavioral Performance Element (HFBP) in the NASA Human Research Program supports research to characterize and mitigate such human health and performance risks, including the Risk of Adverse Outcome Due to Inadequate Human Systems Integration Architecture (HSIA). The HSIA risk addresses the integration of onboard capability and the crew roles and responsibilities necessary to enable the crew to respond effectively and efficiently in the increasingly autonomous mission operations environment. In 2017, HFBP released the “Human Capabilities Assessments for Autonomous Missions” (HCAAM) research topic to address HSIA related questions. HCAAM is a major NASA research effort that has assembled a multidisciplinary team from seven institutions to work closely with design and engineering efforts on research towards developing and refining human performance standards, guidelines and automation tools. The scientific focus is on quantitative assessment of human capabilities relevant to future deep-space missions during which earth/spacecraft communication is so delayed and intermittent that the crew must be able to function autonomously. The integrated strategy of the HCAAM project characterizes human capabilities and limitations related to potential performance decrements during long duration exploration mission spaceflight as relevant to both routine and complex task performance; defines system characteristics that reduce the likelihood or impact of potential decrements in human performance capabilities; performs integrated assessment of intelligent system responses within the context of an operational environment with relevant NASA tools, systems, and data structures in order to determine positive or negative interactions and validate recommended approaches; and proposes specific updates to existing standards and guidelines for inclusion in NASA handbooks for the design of future spacecraft intelligent systems that provide crew performance assessment/feedback, and to also serve as decision-support aids for the onboard crew (i.e., NASA-STD-3001, and NASA/SP-Human Integration Design Handbook (HIDH)). The scientific research vectors being addressed by the seven HCAAM teams include: - crew task performance (accuracy, efficiency) (crew + automation) - crew performance (accuracy, efficiency) - crew Situation Awareness - procedure design and multi-modal enhancement - concurrent tasking (mixed manual + some level of autonomy) - task handover - crew self-planning and time-lining - task design - trust in automation, real-time calibration - human multi-sensory feedback and guidance - human trust in on-board software-based intelligent assistants - virtual assistants The presentation will highlight plans and progress made in each of these research areas as well as the methods by which surrogate astronaut crews in the NASA JSC HERA spaceflight analog facility will function as human test subjects for all of the HCAAM research projects.

HCAAM VNSCOR↗

NASA NTRSDate not supplied

Investigation of a Smooth Local Correlation-based Transition Model in a Discrete-Adjoint Aerodynamic Shape Optimization Algorithm

A smooth local correlation-based transition model is fully coupled to a RANS-based Newton-Krylov flow solver and discrete-adjoint gradient-based optimization algorithm. The free-transition optimization framework is evaluated using lift-constrained drag minimizations of airfoils at design conditions ranging from light to single-aisle aircraft and an infinite swept wing at design conditions representative of a transonic strut-braced wing aircraft. The impact of the streamwise grid resolution on the ability of the optimization algorithm to delay boundary-layer transition is investigated, with the results demonstrating that streamwise grid resolution requirements increase as the transition length decreases with increasing Reynolds number. The optimization problem at the light aircraft design conditions is demonstrated to be multi-modal, with the optimization algorithm producing two distinct designs: one with a thin, reflexed trailing edge and steep pressure recovery regions, the other with increased aft loading, with the latter design outperforming the former. A drag minimization of an airfoil at transonic design conditions demonstrates that the optimization algorithm successfully trades a decrease in viscous drag by delaying boundary-layer transition with an increase in wave drag, while the drag minimization of an infinite swept wing demonstrates the capability of the optimizational gorithm to delay both Tollmien-Schlichting and stationary crossflow instabilities.

AATT↗

NASA NTRSDate not supplied

Open Science for Life in Space: Data Sharing and Tools for Knowledge Discovery

The next era in human space exploration is rapidly approaching. The use of health countermeasures and biomonitoring systems for space missions are required to counteract space health hazards and to support life to thrive in deep space (e.g., humans, animals, plants, crops; entire ecosystems within spacecrafts/habitats/spacesuits). The development of these mission components will be highly dependent on our understanding of basic biological and health responses to myriad space hazards (ionizing radiation, altered gravitational fields, altered day-night cycles, confined isolation, hostile-closed environments, distance-duration from Earth, planetary dust-regolith, and extreme temperatures/atmospheres). The fast-growing array of space biological and mission telemetry data, which in the past was simply archived after minimal analysis, holds great potential once applied to these mission challenges if it can be reorganized and formatted for Open Science. Organizing the data for such analysis is a challenge because of its multi-hierarchical, multi-modal, and heterogenous nature (molecular, cellular, tissue, organ, whole organism, behavior, ecosystem, microbiome; tabular, omics, imaging, video, biospecimen, environmental physical-chemical telemetry). This session focuses on current approaches in this domain such as: making space biological data FAIR (findable, accessible, interoperable, reusable), effective data ingestion/dissemination, observational versus experimental data, Open Science collaborations, data analysis techniques, AI/ML/knowledge graph/modeling methods, and data integration/discovery tools.

open science↗

NASA NTRSDate not supplied

SimUAM: A Comprehensive Microsimulation Toolchain to Evaluate the Impact of Urban Air Mobility in Metropolitan Areas

Over the past several years, Urban Air Mobility (UAM) has galvanized enthusiasm from investors and researchers, marrying expertise in aircraft design, transportation, logistics, artificial intelligence, battery chemistry, and broader policymaking. However, two significant questions remain unexplored: (1) What is the value of UAM in a region’s transportation network? and (2) How can UAM be effectively deployed to realize and maximize this value to all stakeholders, including riders and local economies? To adequately understand the value proposition of UAM for metropolitan areas, the authors develop a holistic multi-modal toolchain, SimUAM, to model and simulate UAM and its impacts on travel behavior. This toolchain has several components: (1) Microsimulation Analysis for Network Traffic Assignment (MANTA): A fast, high-fidelity regional-scale traffic microsimulator, (2) VertiSim: Agranular, discrete-event vertiport and pedestrian simulator, (3) Flexible Engine for Fast-time Evaluation of Flight Environments (Fe3): A high-fidelity, trajectory-based aerial microsimulation. SimUAM, rooted in granular, GPU-based microsimulation, models millions of trips and their movements in the street network and in the air, producing interpretable and actionable performance metrics for UAM designs and deployments. Once the ground-air interface is modeled, the authors find that the market for UAM decreases across all network designs relative to models with static assumptions about transfer times. However, significant improvements can be made to balance the demand and optimize the networks for transfer time, likely increasing the number of benefited trips. The modularity, extensibility, and speed of the platform will allow for rapid scenario planning and sensitivity analysis, effectively acting as a detailed performance assessment tool.

urban air mobility↗

NASA NTRSDate not supplied

SimUAM: A Comprehensive Microsimulation Toolchain to Evaluate the Impact of Urban Air Mobility in Metropolitan Areas

Over the past several years, Urban Air Mobility (UAM) has galvanized enthusiasm from investors and researchers, marrying expertise in aircraft design, transportation, logistics, artificial intelligence, battery chemistry, and broader policymaking. However, two significant questions remain unexplored: (1) What is the value of UAM in a region’s transportation network?, and (2) How can UAM be effectively deployed to realize and maximize this value to all stakeholders, including riders and local economies? To adequately understand the value proposition of UAM for metropolitan areas, we develop a holistic multi-modal toolchain, SimUAM, to model and simulate UAM and its impacts on travel behavior. This toolchain has several components: (1) MANTA: A fast, high-fidelity regional-scale traffic microsimulator, (2) VertiSim: A granular, discrete-event vertiport and pedestrian, (3) 3: A high-fidelity, trajectory-based aerial microsimulation. SimUAM, rooted in granular, GPU-based microsimulation, models millions of trips and their exact movements in the street network and in the air, producing interpretable and actionable performance metrics for UAM designs and deployments. The modularity, extensibility, and speed of the platform will allow for rapid scenario planning and sensitivity analysis, effectively acting as a detailed performance assessment tool. As a result, stakeholders in UAM can understand the impacts of critical infrastructure, and subsequently define policies, requirements, and investments needed to support UAM as a viable transportation mode.

Urban air mobility↗

NASA NTRSDate not supplied

Distributed Target Tracking With Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using dynamic information fusion from multi-modal sensors with geodiversity. First, the algorithm execution location is determined using an optimal data migration strategy, next the sensors information is dynamically fused at each estimation instance using validity flag for each sensor reading, finally the target estimation is updated based on the fused innovation vector. The approach is applied to synthetic data generated from the radar and camera models located on the ground for the simulated target flight in Reflection simulation environment.

Distributed sensing↗

NASA NTRS2023

What’s That Supposed to Mean? Capturing Micro-Behaviors in Teams

Future long-duration space exploration (LDSE) crews will require extensive coordination, cooperation, and team functioning as they face a myriad of challenges rooted in both taskwork and teamwork (Bell et al., 2015; Landon et al., 2018). While exposed to extreme conditions, crew members must navigate living and working together in prolonged confinement. Moreover, astronaut teams are becoming increasingly diverse, introducing significant variability in team composition. This increasing diversity, alongside traditional constraints of LDSE, introduces additional challenges into effective team functioning. To date, most methods for capturing team functioning rely on self-report measures. Such measures are prone to several limitations, including but not limited to social desirability bias, halo effect, and leniency effects (Trull & Ebner-Priemer, 2013), which skew data and limit nuanced understandings of phenomena at play. Self-report measures broadly capture team functioning, lending the nature of such methods to identifying underlying “macro”-behaviors (i.e., behaviors that are long-standing and last over time). However, team functioning is far more complex than a series of macro-behaviors, rendering reliance on self-report data deficient for accurate measurement. Recent research demonstrates the potential of alternative methods for capturing team functioning, such as speech and physiological data (Chaffin et al., 2017; Murray & Oertel, 2018). Consequently, these methods are more suitable for capturing micro-behaviors: brief, often unconscious expressions that affect the extent to which an individual feels included by others around them (Paletz et al., 2013). Micro-behaviors can be further classified into microaggressions (i.e., subtle, negative exchanges; Keller & Galgay, 2010) or micro-affirmations (i.e., subtle, positive exchanges; Kyte et al. 2020), both of which influence team functioning. Due to the subtle nature of micro-behaviors, contextual factors have a significant impact when determining if it is aggressive or affirmative. Additionally, several iterations of microbehaviors can have lingering effects on team interactions. For example, the use of “mm-hmm” by a crew member can function as both a micro-affirmation and micro-aggression. Specifically, it can be indication of active listening (i.e., micro-affirmation) or as an expression of annoyance (i.e., aggression) depending on the context in which it occurs. Auditory features (e.g., tone, frequency) can help delineate between the two forms; however, the contextual factors (e.g., previous interactions between team members, crew demographics) add a layer of complexity that render auditory features alone as insufficient to capture micro-behaviors. Consequently, this paper seeks to provide a novel approach in which multi-modal data (i.e., auditory features and contextual features) are used in a random-forest model to better identify distinguishing characteristics between micro-affirmations and micro-aggressions. In turn, detected micro-behaviors are used to predict team performance, thereby demonstrating the value of capturing micro-behaviors as supplemental data to macro-behaviors.

Sydney R. Begerowski↗

NASA NTRSDate not supplied

Target Tracking with Distributed Sensing and Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using adaptive information fusion from multi-modal multi-rate distributed sensors network. First, the tracking algorithm execution location is determined using an optimal data migration strategy, which also computes the associated delays for each sensor data to arrive at the computing location. Next, the fast (zero-delay) sensors information is dynamically fused in the filter correction procedure at the arrival instance of each valid sensor reading. Finally, the target estimation is updated based on the valid slow (delayed) data, which are grouped according to the delay-time steps before application of the Larsen's method. This approach is applied to the synthetic sensor data generated by means of the ground based radar and camera models for the simulated target flight in Reflection simulation environment.

Distributed sensing↗

NASA NTRSDate not supplied

Target Tracking with Distributed Sensing and Optimal Data Migration

Distributed sensing↗

NASA NTRSDate not supplied

Applicability of Micro X-Ray Fluorescence Spectroscopy to Astromaterials Curation and Research

Introduction: The Astromaterials Acquisition and Curation Office at NASA’s Johnson Space Center (JSC) curates NASA’s astromaterial sample collections which includes: Apollo samples, Luna samples, Ant-arctic meteorites, cosmic dust particles, microparticle impacts into space-flown materials, Genesis solar wind atoms, Stardust comet Wild-2 particles, Stardust inter-stellar particles, Hayabusa asteroid Itokawa particles, Hayabusa 2 asteroid Ryugu particles, and future OSIRIS-Rex asteroid Bennu particles (landing in Sep-tember, 2023) [1–3]. To enhance JSC’s advanced cu-ration capabilities, we have recently installed a high-performance micro-X-ray fluorescence (µXRF) spec-trometer to assist in sample characterization through rapid, non-destructive, in-situ elemental analyses that do not require the sample preparation protocols (i.e., polishing and carbon-coating) commonly needed for electron beam analyses. With this new instrument, we are capable of detecting all elements down to carbon in a variable-pressure or He-purged chamber for anal-ysis of a wide range of sample types. Here we describe the instrumental set-up, capabilities, and applicability of µXRF analysis to astromaterials curation and re-search. Instrumentation and Methodology: The X-ray fluorescence and computed tomography lab (X-FaCT) lab at JSC is now equipped with a Bruker M4 Tornado Plus µXRF (Fig. 1). This system is an energy-dispersive x-ray spectrometer equipped with two 60 mm2 silicon drift detectors (SDD) that are able to be used simulta-neously for output count rates ~500,000 cps. New light element windows allow detecting and analyzing the entire elemental range from carbon to americium. Two x-ray tubes (micro-focus Rh with polycapillary lenses and W with collimators of 0.5, 1.0, 2.0, and 4.5 mm) with max excitation parameters of 50 kV, 30 W and 50 kV, 40 W, respectively, allow for more flexibility of the analysis of high energy lines. The motorized X-Y-Z stage has a mapping range of 190 x 160 mm and can support samples up to 7 kg (~15.5 lbs) and a height of 120 mm [4]. Analytical modes include elemental analysis (down to ~20 µm spot size) via point, line, or area of bulk materials (rock surfaces, thin sections, thick sections, etc.) as well as coating analysis (determination of thickness and composition) of samples. This system has a variable vacuum chamber (1 mbar to 1 atm) that is also equipped with a He-purge system which accommodates vacuum sensitive samples while still allowing detection of light elements at atmospheric pressure. Utility and Applicability of µXRF in Astro-materials research and exploration science (ARES): Elemental analysis using µXRF is commonly em-ployed for both terrestrial and planetary geological science disciplines [5]. It is especially useful for analy-sis of astromaterials given the limited sample prepara-tion required, which is not feasible for certain materi-als. Here we show select applications of µXRF anal-yses of astromaterials that can, have, and will be done at JSC’s X-FaCT lab. Point analysis: In-situ spot analyses (~20 µm spot size) on a cut slab of Martian meteorite NWA 10922 allowed for the discovery, qualitative elemental analy-sis and determination of different feldspar minerals [6]. These point analyses served as an effective prelim-inary step for subsequent quantitative analyses. Ana-lytical standards can be employed for more accurate quantification of µXRF spot analyses. Area analysis: This analytical mode measures all detectable elements (from C to Am) at each pixel (>5 µm pixel size) in a user-defined area. The results are shown as elemental maps which can be extracted as 16-bit TIFF’s for further data processing. In Fig. 2. we show elemental distribution maps of the high-Ti basalt 73001,531 that have been processed using ImageJ software. From these maps you can accurately and quickly (this map took ~50 mins.) identify mineral components, such as pyroxene, plagioclase, oxides, and phosphates, compositional zoning, and mineral textures. Detection of high-Z phases: µXRF techniques are es-pecially effective at analyzing trace minerals with high-atomic-number (high-Z) elements because the high-energy characteristic X-rays used (relative to SEM EDS) allow for mapping of K lines in elements up to La (typically SEM maps use L X-ray lines for elements >Zn, and these can often have interferences). Thus, µXRF is especially suited for identifying minerals like zircon, baddeleyite, REE-rich phosphates, Fe-rich met-als, oxides, sulfides, and phosphides [4]. In Fig. 3 we show elemental distribution maps for 73001,530 where we are able to correlate the original video image with, Zr, Si, Y and Hf elemental maps together identi-fying the location of a zircon. In this location you would expect lower Si compared to surrounding mate-rial, as well as higher Zr, Y, and Hf content compared to surrounding material, all of which is confirmed by our XRF ele-mental distribution maps (Figure 2.) Conclusions: The new M4 Tornado Plus µXRF within the Astromaterials Acquisition and Curation office at NASA JSC allows for rapid and non-destructive elemental analysis of astromaterials with limited or no sample preparation. µXRF analyses pro-vide crucial compositional knowledge for the prelimi-nary examination and curation of astromaterials. This instrument enhances the advanced curation capabili-ties in the X-FaCT laboratory at JSC by allowing pro-ductive, cohesive, and non-destructive multi-modal x-ray analyses on astromaterial samples, which is neces-sary for the comprehensive curation and study of our current and future astromaterial collections. Addition-ally, µXRF can provide complimentary information to researchers for studies on astromaterials. References: [1] Allen, C. et al., (2011). Chemie De Erde Geochemistry, 71, 1-20. [2] McCubbin, F. M. et al., (2016) 47th LPSC, abstract #2668 [3] Zeigler, R. A. et al., (2017) 48th LPSC, abstract #2772 [4] Bruker User Manual [5] Young et al., (2016) Appl. Geochemistry, 72, 77-87 [6] Mor-ris, R. V. et al., (2023) 54th LPSC.

E W O'Neal↗

NASA NTRSDate not supplied

Learning From Failure: Boosting Cycling Endurance of Optical Phase Change Materials

Chalcogenide phase change materials (PCMs) are a unique class of compounds whose switchable optical and electronic properties have fueled an explosion of emerging applications in microelectronics and microphotonics. Key to any application is the ability of PCMs to reliably switch between crystalline and amorphous states over a large number of cycles. While this issue has been extensively studied in the case of microelectronic memories, current PCM-based optical devices suffer from much inferior endurance. To understand the failure mechanisms limiting endurance of PCMs specifically in microphotonic devices, we have developed an on-chip resistive micro-heater platform and an automatic multi-modal characterization system to analyze cycling performance of optical PCMs. Reversible switching of large-area PCM devices over 50,000 cycles was demonstrated.

Optical phase change material↗

NASA NTRSDate not supplied

Automated Registration of Multi-Mode Nondestructive Evaluation Data

Registration techniques play a central role in applications of image processing to computer vision, medical imaging, and automatic target tracking. Feature-based techniques such as scale-invariant feature transform (SIFT) and speeded up robust features (SURF) are commonly used to register images derived from a single modality. However, SIFT and SURF struggle to register images from different modalities because the features tend to manifest rather differently and at sometimes very different length-scales. The most successful methods that have been developed to register multi-modal data use information-theoretic approaches. These methods play a key part in nondestructive evaluation scenarios where data that is collected by sensors of different modalities must be registered to be fused. In this paper, automated registration based on normalized mutual information is applied to align data derived from ultrasonic and radiographic inspections of (i) additively manufactured titanium alloy test coupons, and (ii) thin, lithium metal pouch-cell batteries. The quality of the registration is quantified in terms of computational resources and spatial accuracy. In the first case the X-ray computed tomography (XCT) data is captured on a region corresponding to a small subset of the ultrasonic data, while in the case of the lithium batteries the digital radiography (DR) captures a larger region of interest than the ultrasonic data. In both cases the radiographic data resolution is much higher than for ultrasound, but interestingly, in both cases the accuracy of the registration is approximately equal to two-to-three-pixel lengths in the ultrasonic images.

Nondestructive Evaluation↗

NASA NTRSDate not supplied

High Fidelity Adaptively Refined CFD and Reduced Order Models of a High Aspect Ratio Aeroelastic Wing Wind-Tunnel Model

The NASA Advanced Air Transport Technology (AATT) goal of reduced fuel burn for transport aircraft has led to the NASA N+3 High Aspect Ratio Wing (HARW) subproject. This project requires identifying, developing, and demonstrating key technologies and integrated multidisciplinary solutions to enable a safe, high performance, aeroelastic wing. Since this aircraft will have a high aspect ratio wing, aeroelasticity is expected to be a major issue in the design. In this paper high fidelity computational fluid dynamics (CFD) is performed with flow adapted meshes. A system identification of the aerodynamics is developed using both a multi-modal multi-sine time-marching and a multi-mode linear frequency domain method. GLA, MLA and flutter suppression simulations will be performed.

Robert Bartels↗

NASA NTRS2023

What’s That Supposed to Mean? Capturing Micro-Behaviors in Teams

Future long-duration space exploration (LDSE) crews will require extensive coordination, cooperation, and team functioning as they face a myriad of challenges rooted in both taskwork and teamwork (Bell et al., 2015; Landon et al., 2018). While exposed to extreme conditions, crew members must navigate living and working together in prolonged confinement. Moreover, astronaut teams are becoming increasingly diverse, introducing significant variability in team composition. This increasing diversity, alongside traditional constraints of LDSE, introduces additional challenges into effective team functioning. To date, most methods for capturing team functioning rely on self-report measures. Such measures are prone to several limitations, including but not limited to social desirability bias, halo effect, and leniency effects (Trull & Ebner-Priemer, 2013), which skew data and limit nuanced understandings of phenomena at play. Self-report measures broadly capture team functioning, lending the nature of such methods to identifying underlying “macro”-behaviors (i.e., behaviors that are long-standing and last over time). However, team functioning is far more complex than a series of macro-behaviors, rendering reliance on self-report data deficient for accurate measurement. Recent research demonstrates the potential of alternative methods for capturing team functioning, such as speech and physiological data (Chaffin et al., 2017; Murray & Oertel, 2018). Consequently, these methods are more suitable for capturing micro-behaviors: brief, often unconscious expressions that affect the extent to which an individual feels included by others around them (Paletz et al., 2013). Micro-behaviors can be further classified into micro-aggressions (i.e., subtle, negative exchanges; Keller & Galgay, 2010) or micro-affirmations (i.e., subtle, positive exchanges; Kyte et al. 2020), both of which influence team functioning. Due to the subtle nature of micro-behaviors, contextual factors have a significant impact when determining if it is aggressive or affirmative. Additionally, several iterations of micro-behaviors can have lingering effects on team interactions. For example, the use of “mm-hmm” by a crew member can function as both a micro-affirmation and micro-aggression. Specifically, it can be indication of active listening (i.e., micro-affirmation) or as an expression of annoyance (i.e., aggression) depending on the context in which it occurs. Auditory features (e.g., tone, frequency) can help delineate between the two forms; however, the contextual factors (e.g., previous interactions between team members, crew demographics) add a layer of complexity that render auditory features alone as insufficient to capture micro-behaviors. Consequently, this paper seeks to provide a novel approach in which multi-modal data (i.e., auditory features and contextual features) are used in a random-forest model to better identify distinguishing characteristics between micro-affirmations and micro-aggressions. In turn, detected micro-behaviors are used to predict team performance, thereby demonstrating the value of capturing micro-behaviors as supplemental data to macro-behaviors.

Sydney Begerowski↗

NASA NTRSDate not supplied

Kinematic Sensors Evaluation for Spaceflight Exercise Data Collections

INTRODUCTION: On the International Space Station (ISS), exercise feedback from astronauts is very important to diagnose and mitigate any form-related injuries and ensure efficacious exercise prescriptions and systems. Going forward, exploration exercise efforts seek to gain further quantitative data of human and system performance. Currently, methods of collecting in-flight exercise data on the ISS are limited to marker-based motion capture (MoCap) where astronauts must wear reflective markers over their clothes and specialized cameras are used. The main objective of this work was to investigate the following alternative tracking options: markerless video-based MoCap and inertial measurement units (IMUs). These were compared against traditional marker-based MoCap to evaluate kinematic accuracy and inform feasible methods for future exercise data collections on the ISS, especially in support of future Vibration Isolation and Stabilization (VIS) system development. METHODS: Three test subjects performed a variety of flight-like resistance and aerobic exercises using the Miniature Exercise Device (MED-2), Concept-2 rowing ergometer, barbell mockup, bench (e.g., for bench press, hip thruster, and cycling), and a custom structure for dips. These were intended also to represent exercises which could be performed on the multi-modality European Enhanced Exploration Exercise Device (E4D) [1]. The marker-based MoCap data, collected through a 16-camera OptiTrack MoCap system, was regarded as the gold standard to compare the data against. Passive markers were affixed to each subject according to a modified full body Plug-in Gait marker set [2] with 46 total markers. The markerless MoCap data was collected using two GoPro Hero7 cameras and one GoPro Hero11 camera. For the IMU data, a full body set of 17 Xsens DOTs were placed on the subject: 10 upper body and 7 lower body IMUs. Biomechanical modeling and evaluation was conducted through OpenSim [3] (MoCap), OpenSense [4] (IMU), OpenCap [5] (markerless), ENABLE [6] (markerless), and other modeling software. Secondary objectives included comparing the volume of equipment, reducing mass and crew set-up time. RESULTS AND DISCUSSION: While there were issues with initial processing for the IMUs and markerless MoCap, the results aided in the understanding of each sensor, developing end-to-end processes, and identifying future needs. Some observed concerns with the markerless MoCap approaches included being cognizant of a cluttered background, number of people in field of view, camera number and placement. Some challenges with the IMUs included possible sliding, early deactivation possibly due to exercise pose, and large quantity sensor synchronization. Overall, the markerless MoCap option may be the preferred method of data collection and processing as it provides a solution for certain IMU shortcomings and may be least in equipment volume, upmass, and crew setup time. CONCLUSIONS: While this work was mainly focused on ISS data collection, these sensor data along with continued evaluation and development efforts will help to establish best methods for exercise data collection on Gateway, for other Artemis missions, and beyond. Details on the latest end-to-end processing of the data and results will be presented, along with lessons learned and recommended sensor selection and methods.

S. Faragalla↗

NASA NTRS2023

Progressively Enabling Earth Independent Medical Operations (EIMO)

This panel presents the findings from a series of Technical Interchange Meetings (TIMs) hosted by the Exploration Medical Capability Element (ExMC) in NASA’s Human Research Program. The topics for the TIMs were derived from a 2-day conference of senior leaders and subject matters experts that collectively outlined a multi-faceted strategy designed to optimize crew health and performance through an increasingly autonomous medical approach. The first abstract in this panel outlines the scope of issues related to data collection, usage, transmission and computing capacity to facilitate EIMO. The second presentation provides an overview of the challenges in developing curricula and advanced training tools to baseline knowledge, skills and abilities (KSA), verify clinical competency and assure retention during prolonged durations inherent in exploration-class missions. An overview of the complicated medical supply and resource chain necessary to facilitate EIMO is provided in the third presentation of this panel. The final presentation in this EIMO panel surveys the breadth and depth of demands on cognitive load expected to be experienced by crew on an exploration mission and proposes strategies to mitigate the prospect of cognitive overload through methods to shift task load from the crew to multi-modal artificial intelligence based medical support systems. Taken together, these presentations summarize the challenges to be expected and potential solution spaces to be explored and developed to progressively enable increasing autonomous medical operations to support crewed missions beyond low earth orbit. Through EIMO focused pre-mission planning, integrated data architecture design, innovative training development and AI-assisted task load management, the gradual transition of medical care and decision making from terrestrial to space-based assets enabling support of astronaut health and performance and reducing overall mission risk is achievable.

Jay Lemery↗

NASA NTRSDate not supplied

Progressively Enabling Earth Independent Medical Operations (EIMO)

John Lemery↗

NASA NTRSDate not supplied

Datascope to Enable Earth Independent Medical Operations (EIMO)

BACKGROUND: NASA has amassed sixty years of knowledge and experience relevant to maintenance of crew health and performance in low earth orbit. The Apollo Program introduced the importance of ensuring progressively autonomous operational capability. Earth Independent Medical Operations (EIMO) will require a gradual shift in the balance of medical responsibility, management, and authority from terrestrial to space-based assets. Terrestrial assets will continue to be essential for pre-mission screening and planning in addition to maintenance of crew health and performance. However, new capabilities are needed to enable EIMO and the amount of data required to support these systems, and mitigate the impacts of data transmission delays and reduced bandwidth coupled with lack of cloud-like resources and on-board computing capacity that is currently unclear or operationally insufficient. OVERVIEW: The overall goal of EIMO is to develop artificial intelligence (AI)-based solutions to analyze crew health and performance data utilizing a clinical decision support system (CDSS) to provide crew medical officers (CMO) with the equivalent of real-time, on-board medical consults. The EIMO ecosystem is envisioned as a “system of systems” where embedded reference databases and real-time data streams from multiple input vectors continuously and seamlessly assess crew health and performance. EIMO will be designed to make recommendations to the CMO using multi-modal AI-based natural language processing and machine learning methods with interoperability to push/pull data within and between multiple vehicle and habitat architectures. DISCUSSION: Data flows and storage/retrieval capacity are severely constrained during space missions and the challenges will become even greater during exploration missions. Just as each past program from Mercury to the International Space Station (ISS) required rethinking the interaction between ground-based controllers and space-based crew, so too will future missions to the Moon and Mars. While the NASA High-Performance Spaceflight Computing Processor project aims to increase computational capacity by 100 times over current spaceflight computers, the projected deliverable still lags considerably behind what will be needed to enable an AI-driven CDSS. Restrictions in processing speed and data storage capacity, coupled with transmission bottlenecks and delays, necessitate definition and optimization of an integrated data architecture to enable a progressively autonomous medical capability.

Medical operations↗