Search NASASearch

Engineering topics

Kurt Berens

Publications and source records attributed to Kurt Berens.

Autonomous Medical Officer Support (AMOS) Software Technology Demonstrations on the International Space Station (ISS)

Performance of medical procedures in spaceflight beyond low Earth orbit (LEO) requires novel solutions to replace real-time ground support because as distance from Earth increases, communication latencies increase, hampering remote guidance. The Autonomous Medical Officer Support Software (AMOS) Technology Demonstrations on the International Space Station (ISS) trialed a novel software tool that shifts the emphasis from preflight training and real-time remote guidance (current ISS paradigm) to a new standard of multi-dimensional in-flight just-in-time (JIT) instruction. The AMOS platform is a skill management tool for all mission phases and currently features comprehensive training and guidance modules for urinary bladder and renal ultrasound examinations. Variability in Subject anatomy, Operator experience, and Operator receptiveness to instruction during autonomous exams are persistent but manageable limitations. Here we report the first successful demonstrations of autonomous imaging activities in the operational setting of spaceflight, validating this autonomous guidance proof of concept.

Douglas Ebert

Earth Independent Medical Operations (EIMO) DATASCOPE Technical Interchange Meeting 21st August 2023: Background and Summary of Discussion

An aspiration for EIMO datascope is to realize artificial intelligence-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A vision proposed to the meeting participants was that of a “system of systems,” whereby EIMO will utilize AI-supported natural language processing and machine learning techniques to synthesize embedded reference databases and real-time data streams [input vectors] from multiple data sources to continuously and seamlessly assess crew health & performance. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will ideally have a degree of mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats.

Artificial Intelligence

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

Medical Operations

Earth Independent Medical Operations (EIMO) Training Technical Interchange Meeting, 26th October 2023: Background and Summary of Discussion

On 26th October 2023, ExMC convened a panel of Subject Matter Experts (SMEs) from NASA, broadly representing Headquarters, the Human Research Program, Medical Operations, the Human Health and Performance Directorate at JSC, the Health and Medical Technical Authority, the Flight Operations Directorate, and representation from other Centers including: Ames Research Center (ARC), and Glenn Research Center (GRC). Representatives from the Canadian Space Agency also participated in this TIM. In addition, SMEs from industry included representation from the following entities: Axiom Space, Space Exploration Technologies Corporation, Level Ex, Shiny Box Interactive. Additional SMEs from academia included: University of Houston, Touro University, Weill Cornell Medical College and the Translational Research Institute for Space Health at Baylor College of Medicine. This group of stakeholders discussed the training issues related to facilitating EIMO. Sub-topics for this discussion included the following: - Pre-launch medical curriculum development - Ground-based training on medical hardware - Dental health - Behavioral health - Telemedicine - Just-in-time training - Simulation-based training (extended reality)

CMO Training

Progressively Enabling Earth Independent Medical Operations (EIMO)

This panel presents the findings from a series of Technical Interchange Meetings (TIMs) hosted by the Exploration Medical Capability Element (ExMC) in NASA’s Human Research Program. The topics for the TIMs were derived from a 2-day conference of senior leaders and subject matters experts that collectively outlined a multi-faceted strategy designed to optimize crew health and performance through an increasingly autonomous medical approach. The first abstract in this panel outlines the scope of issues related to data collection, usage, transmission and computing capacity to facilitate EIMO. The second presentation provides an overview of the challenges in developing curricula and advanced training tools to baseline knowledge, skills and abilities (KSA), verify clinical competency and assure retention during prolonged durations inherent in exploration-class missions. An overview of the complicated medical supply and resource chain necessary to facilitate EIMO is provided in the third presentation of this panel. The final presentation in this EIMO panel surveys the breadth and depth of demands on cognitive load expected to be experienced by crew on an exploration mission and proposes strategies to mitigate the prospect of cognitive overload through methods to shift task load from the crew to multi-modal artificial intelligence based medical support systems. Taken together, these presentations summarize the challenges to be expected and potential solution spaces to be explored and developed to progressively enable increasing autonomous medical operations to support crewed missions beyond low earth orbit. Through EIMO focused pre-mission planning, integrated data architecture design, innovative training development and AI-assisted task load management, the gradual transition of medical care and decision making from terrestrial to space-based assets enabling support of astronaut health and performance and reducing overall mission risk is achievable.

John Lemery

Supply and Resource Management to Progressively Enable EIMO

BACKGROUND: Current medical operations in Low Earth Orbit (LEO) allow for real-time audio-video communication with a flight surgeon at mission control, resupply, and medical evacuation to earth on the order of hours. As mission profiles change from LEO to the Moon, Mars, and beyond, medical risk as a contribution to overall mission risk is anticipated to rise substantially. Concurrently, due to the distance, the medical systems on board vehicles proposed for these mission types are expected to have reduced mass and volume allocation. Together, astronaut crews will be at a higher risk of major medical events, be required to perform a broader set of tasks, and have substantially reduced resources and support to do so. Earth Independent Medical Operations (EIMO) aims to identify and fill the gaps present in this progressively changing paradigm. OVERVIEW: Medical supplies, resources, and skills are central to spaceflight medical systems. Vehicles used for non-LEO missions are anticipated to be smaller and thus the medical system will also need to have reduced mass, volume, and power. Medical resources are another form of consumable and may need resupply or pre-deployment to meet crew needs. One particular concern is the degradation of medications which become less efficacious and potentially toxic with time, particularly given environmental conditions such as temperature, humidity, oxygen, and radiation which have not yet been fully studied. Supply and resource management in LEO is dependent on resupply, however the supply chain of transporting equipment does not yet have a clear infrastructure for missions beyond LEO. DISCUSSION: EIMO is intended to systemically identify and fill these gaps with forward-looking solutions. In mission monitoring of resources with technology like RFID, improving medical resource longevity, targeted resupply and careful pre-mission planning will be central to facilitate crew health and performance. One approach to optimizing resources is the Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool, which uses probabilistic risk assessment (PRA) to quantitatively predict medical risk and identify resources and skills that mitigate this risk. This evidence based, quantitative analysis prediction tool and several other approaches to meeting the challenge of supply and resource management are discussed.

Arian Anderson

Task Load Management in Earth Independent Medical Operations

BACKGROUND: Medical care in spaceflight carries a high task load and can easily overwhelm a small crew. Present day operations in low Earth orbit (LEO) offload most medical tasks to ground teams in mission control. This team includes dozens of flight surgeons, specialists, and engineers and supports the on-orbit crew in monitoring environmental systems, tracking medications, guiding procedures, providing expert advice, and many other tasks. However, the physical limitations of the speed of light and technical limitations of bandwidth, channel capacity, and signal processing mean that missions beyond LEO cannot rely on this level of telemedical support. The further we travel from Earth the more these tasks will fall on the shoulders of the crew and the greater the risk of task saturation to the wellbeing of the crew and the success of the mission. Exploration class space crews will need progressively more robust systems for managing task load as they progress further out in space. OVERVIEW: Medical task management systems will need to assist with two broad categories of tasks; cognitively intensive tasks and procedure execution tasks. In both cases the goal is for the systems to operate in the background with minimal human-in-the-loop intervention. To accomplish this such systems will need to be designed with careful consideration for human factors and human systems integration to maximize efficiency, minimize alarm fatigue, and avoid inadvertently increasing task loads. Finally, the key domains of space medicine tasking can be used to map present day and near future technologies to the areas where they are best suited to support and identify gaps which can be targeted for research and development. DISCUSSION: Task load is a major challenge for Earth Independent Medical Operations to overcome. It will require careful coordination between experts in a variety of fields paying attention to human factors and human systems integration as well as technical and medical expertise. If done well medical task management systems can handle many of the tasks currently run by humans in mission control and enable human crews to maintain terrestrial standards of care in the extraterrestrial environment.

Dana Levin

Crew Medical Training to Progressively Enable EIMO

Background. Onboard medical capabilities have greatly expanded over the history of the US space program. Newly identified space-related medical conditions, technological advances, and longer mission durations have led to an increasing need for on-demand medical expertise. Lengthy communications delays, lack of resupply and evacuation opportunities on exploration-class missions place an ever-increasing burden on the crew to provide medical care. Having adequate knowledge, skills, and abilities (KSA) available is an essential component of successful Earth Independent Medical Operations (EIMO). Without appropriate crew training and KSA, cutting-edge medical equipment has little value. Presumably, the crew will include a qualified physician; however, if the physician is incapacitated, a non-physician crew medical officer (CMO) will be needed. While more crew time is needed for medical training, there will be concomitant increases in preflight training demands for vehicle system management, operations, science, and contingencies. In truly independent operations, onboard resources such as just-in-time training, mixed reality, decision support tools, and AI-enabled chatbot “consultants” will be needed to augment KSA. Overview. Because of crew time constraints, topical priorities must be determined for preflight training. Curricula should be developed that emphasize management of conditions with relatively high incidence and morbidity/mortality. Defining the required KSA levels to treat each condition is essential, but all crewmembers should have basic lifesaving skills. Procedural and diagnostic training on live patients and simulators should be prioritized over classroom lectures. Crews must be trained with onboard equipment, resources, mixed reality, and AI-based decision support tools. Mission simulations should include medical problems with/without ground support and with appropriate communication delays. Certification guidelines for each level of KSA must be established. Skills rapidly decay for non-physician CMO’s; both pre-flight and in-flight refresher training will be needed. During spaceflight just-in-time training, simulations, and onboard CME with crew physician can help retain skills. Discussion. Medical technology, simulation design, mixed reality, and AI are advancing at a dizzying rate. Recognizing the severe constraints on crew time, it is critical that astronaut training is highly efficient and adapted to keep pace with new innovations both pre-flight and during exploration missions. These challenges will be discussed during this panel session.

Jay Lemery

Datascope to Enable Earth Independent Medical Operations (EIMO)

BACKGROUND: NASA has amassed sixty years of knowledge and experience relevant to maintenance of crew health and performance in low earth orbit. The Apollo Program introduced the importance of ensuring progressively autonomous operational capability. Earth Independent Medical Operations (EIMO) will require a gradual shift in the balance of medical responsibility, management, and authority from terrestrial to space-based assets. Terrestrial assets will continue to be essential for pre-mission screening and planning in addition to maintenance of crew health and performance. However, new capabilities are needed to enable EIMO and the amount of data required to support these systems, and mitigate the impacts of data transmission delays and reduced bandwidth coupled with lack of cloud-like resources and on-board computing capacity that is currently unclear or operationally insufficient. OVERVIEW: The overall goal of EIMO is to develop artificial intelligence (AI)-based solutions to analyze crew health and performance data utilizing a clinical decision support system (CDSS) to provide crew medical officers (CMO) with the equivalent of real-time, on-board medical consults. The EIMO ecosystem is envisioned as a “system of systems” where embedded reference databases and real-time data streams from multiple input vectors continuously and seamlessly assess crew health and performance. EIMO will be designed to make recommendations to the CMO using multi-modal AI-based natural language processing and machine learning methods with interoperability to push/pull data within and between multiple vehicle and habitat architectures. DISCUSSION: Data flows and storage/retrieval capacity are severely constrained during space missions and the challenges will become even greater during exploration missions. Just as each past program from Mercury to the International Space Station (ISS) required rethinking the interaction between ground-based controllers and space-based crew, so too will future missions to the Moon and Mars. While the NASA High-Performance Spaceflight Computing Processor project aims to increase computational capacity by 100 times over current spaceflight computers, the projected deliverable still lags considerably behind what will be needed to enable an AI-driven CDSS. Restrictions in processing speed and data storage capacity, coupled with transmission bottlenecks and delays, necessitate definition and optimization of an integrated data architecture to enable a progressively autonomous medical capability.

Medical operations

Artificial Intelligence (AI) Methods for Automating the Impact Tool Evidence Library

INTRODUCTION: The development of the Evidence Library for use with the IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces) probability risk assessment tool involved a multilayered, time intensive process of data collection and analysis by subject matter experts from the Exploration Medical Capability (ExMC) Element Clinical and Science Team to produce clinical findings forms (CliFFs) for 120 medical conditions. Artificial Intelligence Large Language Models (LLMs) can be leveraged to facilitate this process, thus reducing labor and time. TOPIC: CliFFs contain information about medical conditions as they pertain to spaceflight. This includes condition definitions, incidence data, crew task impairment estimates caused by conditions, treatment protocols and references to literature used for gathering condition evidence. Guided by the Evidence Library Methods document and the CliFF development instructions, a team has leveraged Microsoft Azure AI services and open-source documentation to construct an AI-assisted automated pipeline for CliFF development. This process is designed to search, retrieve, and evaluate the applicable data, and ultimately generate a completed CliFF. The LLM evaluates the relevance of each of the source materials to spaceflight, either as direct evidence or as an analog. The model extracts keywords and generates brief summaries to enhance search and retrieval in later stages of CliFF development. For instance, it can calculate epidemiological statistical data, such as incidence rates and the likelihood of best or worst-case scenarios. APPLICATION: Large Language Models (LLMs) can efficiently summarize large amounts of text. Leveraging this technology will automate data retrieval and evidence gathering for medical databases, like the IMPACT tool, by aiding in the labor-intensive process of analyzing large bodies of literature and organizing it into a formatted document like a CliFF. This added efficiency will enable expeditious expansion of the Evidence Library with additional medical conditions and update previous CLiFFs as new technology becomes available.

Ali Al