Search NASA⌕ Search

SEARCH · Search NASA

Results for “HITL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A Cognitive Walkthrough of Multiple Drone Delivery Operations

Advances of early twenty-first century aviation and transportation technologies provide opportunities for enhanced aerial projects, and the overall integration of unmanned aircraft systems (UAS) into the National Airspace System (NAS) has applications across a wide range of operations. Through these, remote operators have learned to manage several UAS at the same time in a variety of operational environments. The present work details a component piece of an ongoing body of research into multi-UAS operations. Beginning in early 2020, NASA has collaborated with Uber Technologies to design and develop concepts of operations, roles and responsibilities, and ground control station (GCS) concepts to enable food delivery operations via multiple, small UAS (sUAS). A cognitive walkthrough was chosen as the method for data collection. This allowed information to be gathered from UAS subject matter experts (SMEs) that could further mature designs for future human-in-the-loop (HITL) simulations; in addition, it allowed information to be collected remotely during the stringent restrictions of the COVID-19 pandemic. Consequently, the described cognitive walkthrough activity utilized remote data collection protocols mediated through the usage of programs designed for presentation and telecommunications. Scenarios were designed, complete with airspace, contingencies, and remedial actions, to be presented to the SMEs. Information was collected using a combination of rating scales and open-ended questions. Results received from the SMEs revealed expected hazards, workloads, and information concerns inherent in the contingency scenarios. SMEs also provided insight into the design of GCS tools and displays as well as the duties and relationships of human operators (i.e., monitors) and automation (i.e., informers and flight managers). Implications of these findings are discussed.

unmanned aircraft systems↗

A Cognitive Walkthrough of Multiple Drone Delivery Operations

Advances of early twenty-first century aviation and transportation technologies provide opportunities for enhanced aerial projects, and the overall integration of unmanned aircraft systems (UAS) into the National Airspace System (NAS) has applications across a wide range of operations. Through these, remote operators have learned to manage several UAS at the same time in a variety of operational environments. The present work details a component piece of an ongoing body of research into multi-UAS operations. Beginning in early 2020, NASA has collaborated with Uber Technologies to design and develop concepts of operations, roles and responsibilities, and ground control station (GCS) concepts to enable food delivery operations via multiple, small UAS (sUAS). A cognitive walkthrough was chosen as the method for data collection. This allowed information to be gathered from UAS subject matter experts (SMEs) that could further mature designs for future human-in-the-loop (HITL) simulations; in addition, it allowed information to be collected remotely during the stringent restrictions of the COVID-19 pandemic. Consequently, the described cognitive walkthrough activity utilized remote data collection protocols mediated through the usage of programs designed for presentation and telecommunications. Scenarios were designed, complete with airspace, contingencies, and remedial actions, to be presented to the SMEs. Information was collected using a combination of rating scales and open-ended questions. Results received from the SMEs revealed expected hazards, workloads, and information concerns inherent in the contingency scenarios. SMEs also provided insight into the design of GCS tools and displays as well as the duties and relationships of human operators (i.e., monitors) and automation (i.e., informers and flight managers). Implications of these findings are discussed.

unmanned aircraft systems↗

Functional Volume Assessment of an Early Version of the Mars Transit Habitat

During the summer of 2020, the NASA Mars Architecture Team (MAT) conducted a functional volume assessment of the Transit Habitat (TH). The TH has evolved substantially since that time and the current TH does not share the same internal configuration, but the insights gained from the assessment remain relevant. In virtually all architectures involving chemical, electric, or nuclear propulsion, the majority of the crew mission is spent aboard the TH. The Earth to Mars transit durations may vary from architecture to architecture, but all are on the order of hundreds of days, regardless of whether an opposition or conjunction class trajectory is selected, and regardless of whether the propulsion system is chemical, electric, or nuclear. Thus, the TH must provide capabilities appropriate to a very long duration. So, despite significant changes in the current Mars architecture over the past few years, this evaluation still provides useful recommendations in the form of habitability guidance that can be applied to current and future TH concepts. This assessment had six primary objectives: provide a sanity check to the BOC-derived TH layout; understand if we can fit the hardware and functional tasks in the volume; provide a high-level assessment of how aggressive the layout is; generate a list of challenges or assumptions necessary to make it work; generate a list of future work to refine understanding; and identify proposed requirements. All of this information is critical to drive habitat sizing studies and key architecture decisions. It was clear that a human-in-the-loop (HITL) evaluation of some kind would be necessary, but several challenges were immediately identified. The most information could be gleaned from a Desert Research and Technology Studies (DRATS) type of mission operations test (MOT), but the TH concept was too low fidelity to construct the type of prototype necessary to conduct a MOT, nor were their financial resources to do so. The next best option – and really the one most appropriate for the BOC’s stage of maturity – is a Virtual Reality (VR) walk-through evaluation. However, NASA was in a shutdown state due to the COVID-19 pandemic and the VR labs were inaccessible. As a result, a tabletop evaluation was created, using .jpg imagery from the ECM CAD model along with Excel-based datasheets. High-level crew living and working functions within the habitat were identified for evaluation. Questionnaires using Likert scales assessed acceptability of habitat functions and sim quality – the degree to which the function was represented in CAD. This enabled the evaluation to be conducted by personnel working remotely. Each function was evaluated individually along with several overarching habitability parameters and vehicle subsystems. The results of this evaluation are discussed, including methodological challenges and rating challenges. Acceptability results are discussed for functions that the participants were able to rate and participant comments for functions that could not be related are also described. Final conclusions are described, including challenges or assumptions needed to make the TH design acceptable, future work needed to refine understanding of the TH, and proposed habitat requirements based on test data.

Transit Habitat↗

Permutations of the Exploration Extra-vehicular Mobility Unit (xEMU) for Mission Specific Objectives

The Advanced Portable Life Support System began first with NASA investment during the Constellation Program focused on new technologies that were central to the new architecture but with a consideration for development of the most flexible and adaptable design to address the varied future needs for Extra-Vehicular Activity (EVA) capability by the agency as part of the exploration of the moon and beyond. Since that time, the Portable Life Support System (PLSS) architecture has been demonstrated at bread-board level, packaged prototype level with Human In-The Loop (HITL) testing, and has now matured into what has become known as the Exploration Extravehicular Mobility Unit (xEMU) PLSS focused on a demonstration on the International Space Station (ISS) and support for initial lunar missions. The xEMU completed Preliminary Design Review (PDR) and the associated Safety Review Panel (SRP) Phase I reviews in 2019-2020 and is progressing through the Design Verification Test (DVT) phase in 2021. As the agency updates planning for lunar both near term, long term, and beyond, there are many possible permutations of the existing architecture that can be accommodated to enable varied mission objectives. This paper will discuss the current baseline DVT design for xEMU as well as potential permutations of the PLSS architecture to accomplish an Apollo style short-duration down and out mission, a long term lunar ultra-lightweight approach, as well as a potential SuitPort accommodating architecture.

Colin Campbell↗

Validation of Rendered Natural and Artificial Lighting Environments in Real Time Lunar South Pole Simulations

NASA’s Artemis campaign is making heavy use of simulation to help return humans to the lunar surface by the end of the decade. There are several aspects of the lunar surface and its environment which must be accurately modeled before these simulations can be relied upon to influence decisions being made under these programs. Digital Lunar Exploration Sites, a paper submitted to the 2022 IEEE Aerospace Conference, outlined the process used to generate the lunar surface in a digital environment. This paper will expand upon this topic and delve into the steps being taken by the NASA Exploration Systems Simulations (NExSyS) team at NASA’s Johnson Space Center (JSC) to properly verify and validate these simulations, with a focus on the visual aspects of the environment. Natural lighting validation relies in part on the wealth of data generated during the Apollo program. Many images taken by Apollo astronauts on the lunar surface have been replicated in the simulated environments to gain confidence in the accuracy of terrain and lighting models. However, because the environment the Artemis astronauts will experience at the Lunar South Pole (LSP) is dissimilar from the near-equatorial Apollo sites, other validation techniques must be applied. At the LSP, the sun crests only about three degrees above the horizon and when combined with the lack of a lunar atmosphere, lighting in this region is often very different than what a human would experience on Earth. Solar illumination, earthshine, human eye response, solar blooming, lunar regolith optical properties, and shadows cast by rocks and crater walls will play a significant role in an astronaut’s ability to safely conduct an Extra-Vehicular Activity (EVA) or perform a traverse with a lunar rover. Approaches for validation of these aspects of the rendered LSP environment are considered in this paper. In addition to natural lighting, approaches for the validation of artificial lighting models at the LSP are discussed. The JSC Lighting Lab has been studying the illumination profile of the Exploration Infomatics Subsystem (xINFO) lighting on the Exploration EVA Mobility Unit (xEMU). How these lights interact with the solar illumination and the shadows being cast on the lunar surface is of particular interest, so the validity of models representing these lights in a human-in-the-loop virtual reality environment becomes very important. This paper also touches on some of the simulation performance considerations when a Human in the Loop (HITL) is present, which drives the need for real time rendering of the environment. Natural and artificial lighting will play a crucial role to decisions being made when planning and executing missions at the Lunar South Pole (LSP) and it is vitally important to understand the LSP environment before we return.

Lunar↗

2022 Innovation Fair - Simulation Facility to Develop Synchronization Standards for VR Visuals and Motion

Integrating Virtual Reality into the Vertical Motion Simulator for research into the future of simulation and flight To create software and hardware for integration of a Virtual Reality (VR) Head Mounted Display (HMD) into the Ames Vertical Motion Simulator for the purpose of developing and utilizing an empirical human-in-the-loop (HITL) testing method to determine spatial and temporal registration thresholds required for aligning VR Visuals with platform base motion.

Innovation Fair↗

Updates and Correlation of EMU System-Level Model (SINDA EMU)

During United States Extravehicular Activity 80 (US EVA 80), water was observed in the helmet of an Extravehicular Mobility Unit (EMU) during cabin repressurization. One of the primary methods of determining the likely cause of this failure was through a comparison of EVA 80 to other historical EVAs using an analytical approach. The Systems Improved Numerical Differential Analysis EMU model (SINDA EMU) is a system-level model of the EMU that was used in this investigation. SINDA EMU was initially developed and correlated to test data in the 1980s. Since its conception, SINDA EMU has been continually adjusted based on new test data and changes to the EMU design. To support the water in the helmet investigation, SINDA EMU needed to be further updated and recorrelated to ensure accurate results. These changes included changing the primary carbon dioxide (CO2) removal technology, implementing logic to allow for re-evaporation of sweat runoff from the liquid cooling and ventilation garment (LCVG), and improving the transient modeling capabilities. To validate the implementation of these adjustments, SINDA EMU was correlated to test data from the 1990s and human-in-the-loop (HITL) testing from 2014. These updates and correlation efforts proved that SINDA EMU is an effective tool for investigating the EVA 80 water in the helmet failure event.

Noah Lial Andersen↗

HAT m:N Activity Overview

Since 2020, researchers from the Human Autonomy Teaming (HAT) Laboratory at NASA Ames Research Center have conducted human-in-the-loop (HITL) simulation research to study a new control paradigm for operations involving multiple remotely piloted aircraft systems (RPAS). Colloquially referred to as "m:N," this paradigm is characterized by multiple operators collaboratively controlling multiple vehicles between them. The m:N name expresses a ratio whereby m is the number of operators and N is the number of vehicles shared between them. In this presentation, HAT Lab researchers provide a high-level overview of the m:N studies that have been performed to-date. These include a study of the m:N concept of operations (CONOPS) and the attending roles and responsibilities ("ConOps/R&R Sim"), a study focused on contingency management involving dynamic, inter-operator transfers of vehicles ("Handoff Sim"), and a study examining the effects of pilot-ATC communication systems on workload ("UAM Comms Sim"). A selection of key results are provided. The presentation concludes with a brief discussion of planned research into m:N operations.

m:N↗

Approaches for Validation of Lighting Environments in Realtime Lunar South Pole Simulations

NASA’s Artemis campaign is making heavy use of simulation to help return humans to the lunar surface by the end of the decade. There are several aspects of the lunar surface and its environment which must be accurately modeled before these simulations can be relied upon to influence decisions being made under these programs. Digital Lunar Exploration Sites, a paper submitted to the 2022 IEEE Aerospace Conference, outlined the process used to generate the lunar surface in a digital environment. This paper will expand upon this topic and delve into the steps being taken by the NASA Exploration Systems Simulations (NExSyS) team at NASA’s Johnson Space Center (JSC) to properly verify and validate these simulations, with a focus on the visual aspects of the environment. Natural lighting validation relies in part on the wealth of data generated during the Apollo program. Many images taken by Apollo astronauts on the lunar surface have been replicated in the simulated environments to gain confidence in the accuracy of terrain and lighting models. However, because the environment the Artemis astronauts will experience at the Lunar South Pole (LSP) is dissimilar from the near-equatorial Apollo sites, other validation techniques must be applied. At the LSP, the sun crests only about 1.5 degrees above the horizon and when combined with the lack of a lunar atmosphere, lighting in this region is often very different than what a human would experience on Earth. Solar illumination, earthshine, human eye response, solar blooming, lunar regolith optical properties, and shadows cast by rocks and crater walls will play a significant role in an astronaut’s ability to safely conduct an Extra-Vehicular Activity (EVA) or perform a traverse with a lunar rover. Approaches for validation of these aspects of the rendered LSP environment are considered in this paper. In addition to natural lighting, approaches for the validation of artificial lighting models at the LSP are discussed. The JSC Lighting Lab has been studying the illumination profile of the Exploration Informatics Subsystem (xINFO) lighting on the Exploration EVA Mobility Unit (xEMU). How these lights interact with the solar illumination and the shadows being cast on the lunar surface is of particular interest, so the validity of models representing these lights in a human-in-the-loop virtual reality environment becomes very important. This paper also touches on some of the simulation performance considerations when a Human in the Loop (HITL) is present, which drives the need for realtime rendering of the environment. Natural and artificial lighting will play a crucial role to decisions being made when planning and executing missions at the Lunar South Pole (LSP) and it is vitally important to understand the LSP environment before we return.

Lunar↗

Exploration Helmet Permanent Anti-Fog Study

For the current Extravehicular Mobility Unit (EMU) spacesuit, an astronaut applies an antifog solution to the interior of the helmet bubble before each EVA. However, the anti-fog solution has been reported to cause eye discomfort during at least seven EMU EVAs when the anti-fog solution contacted the crew member’s eyes. During STS-100, astronaut Chris Hadfield reported the eye irritation temporarily blinded him during his spacewalk. In addition, the wipe on anti-fog solution is a consumable that needs to be accounted for and a supply launched for missions. To solve this, NASA has tested different permanent anti-fog coatings. However, major issues have arisen with Human in the Loop (HITL) testing with the coatings. Cleaning and removing Valsalva devices which use pressure sensitive adhesives have been challenges to avoid damaging the permanent anti-fog coating. Due to these issues, further investigation is being completed evaluating two solvent based anti-fog solutions: Exxene’s HCF-100 and FSI’s Visgard 106-94. Each coating will be evaluated on polycarbonate samples for application consistency, steam cycles (mimicking breath cycles), cleaning durability, haze, and light transmission. This study will determine if either coating is a viable option to pursue as a permanent anti-fog for spacesuit helmet applications.

spacesuit↗

Using Virtual Reality to Envision Deployment of Spacesuit-Compatible Augmented Reality Displays for Lunar Surface Operations

The National Aeronautics and Space Administration (NASA) aims to land crew on the lunar surface to establish a sustainable presence and develop operational concepts for future long-duration missions. New technologies will be necessary to extend planning and execution capabilities for lunar surface activities. NASA’s Joint Augmented Reality Visual Informatics System (Joint AR) is one such technology. Joint AR is a suit-mounted augmented reality (AR) display and computes system which facilitates unprecedented information exchange and data visualization capabilities between mission support operators and suited crew. This paper describes challenges associated with developing AR technology for an envisioned work domain by applying a sociotechnical lens to the iterative testing and development of novel AR technology through virtual reality (VR). A VR testbed was established to simulate a representative lunar surface environment, enabling a series of three human-in-the-loop (HITL) tests evaluating AR navigation interfaces for exploration extravehicular activity (xEVA). Our findings identify several considerations for future Joint AR design and testing efforts, including challenges with data overload, attentional demands, and environment-related perceptual challenges. Trade-offs and potential approaches are discussed to mitigate these challenges and improve future Joint AR testing fidelity.

Jacob Keller↗

Exploration Helmet Permanent Anti-Fog Study

For the current Extravehicular Mobility Unit (EMU) spacesuit, an astronaut applies an antifog solution to the interior of the helmet bubble before each EVA. However, the anti-fog solution has been reported to cause eye discomfort during at least seven EMU EVAs when the anti-fog solution contacted the crew member’s eyes. During STS-100, astronaut Chris Hadfield reported the eye irritation temporarily blinded him during his spacewalk. In addition, the wipe on anti-fog solution is a consumable that needs to be accounted for and a supply launched for missions. To solve this, NASA has tested different permanent anti-fog coatings. However, major issues have arisen with Human in the Loop (HITL) testing with the coatings. Cleaning and removing Valsalva devices which use pressure sensitive adhesives have been challenges to avoid damaging the permanent anti-fog coating. Due to these issues, further investigation is being completed evaluating two solvent based anti-fog solutions: Exxene’s HCF-100 and FSI’s Visgard 106-94. Each coating will be evaluated on polycarbonate samples for application consistency, steam cycles (mimicking breath cycles), cleaning durability, haze, and light transmission. This study will determine if either coating is a viable option to pursue as a permanent anti-fog for spacesuit helmet applications.

spacesuit↗

Using Virtual Reality to Envision Deployment of Spacesuit-Compatible Augmented Reality Displays for Lunar Surface Operations

The National Aeronautics and Space Administration (NASA) aims to land crew on the lunar surface to establish a sustainable presence and develop operational concepts for future long-duration missions. New technologies will be necessary to extend planning and execution capabilities for lunar surface activities. NASA’s Joint Augmented Reality Visual Informatics System (Joint AR) is one such technology. Joint AR is a suit-mounted augmented reality (AR) display and computes system which facilitates unprecedented information exchange and data visualization capabilities between mission support operators and suited crew. This paper describes challenges associated with developing AR technology for an envisioned work domain by applying a sociotechnical lens to the iterative testing and development of novel AR technology through virtual reality (VR). A VR testbed was established to simulate a representative lunar surface environment, enabling a series of three human-in-the-loop (HITL) tests evaluating AR navigation interfaces for exploration extravehicular activity (xEVA). Our findings identify several considerations for future Joint AR design and testing efforts, including challenges with data overload, attentional demands, and environment-related perceptual challenges. Trade-offs and potential approaches are discussed to mitigate these challenges and improve future Joint AR testing fidelity.

Matthew Miller↗

Joint Augmented Reality Visual Informatics System: Concept of Operations

NASA proposed requirements for a digital display for an EVA spacesuit to provide relevant information to the crew member. The Joint Augmented Reality Visual Informatics System (Joint AR) project pursued four years of research and development towards a suit-display system in a near-eye, AR form factor. The project was responsible for developing software (custom graphics engine and core flight software), physical hardware prototyping (controls, projection display optics, suited display platform), virtual prototyping platform (a virtual reality testbed), and human-in-the-loop (HITL) operational testing informed by EVA flight controllers, crew members, and human factors engineers for con-ops definition. This document contains substantial updates to CTSD-ADV-1788 Rev. Basic. This revision was produced by the project to summarize the use-cases and and user experiences developed throughout the project, and refine the Basic revision originally drafted at the beginning of the project life cycle. The primary purpose of this document is to summarize and make available the scenario development efforts that have been pursued and explored within the Joint AR project. This includes descriptions of the scenarios themselves as well as corresponding potential of advanced informatics displays to support those specified scenarios. In doing so, this document provides a variety of approaches to deconstruct and hypothesize how future technological capabilities so that with future EVA work demands can be satisfied within future human planetary spaceflight missions.

Matthew Miller↗

A Distributed Simulation Framework Applied to Artemis Analysis, Studies, Integration, and Test

The National Aeronautics and Space Administration (NASA) established the Artemis Program, a series of missions to return humans to the Moon and explore further than before. To execute the Artemis missions, NASA is collaborating with commercial and international partners to create the necessary infrastructure and logistics plan that will establish a long term presence on the Moon ahead of exploring Mars. NASA and its partners are developing a collection of space and surface systems to support crewed missions to the lunar surface that will provide the mobility, habitation, logistics, and exploration support necessary for Artemis mission successes which includes robust scientific investigations. This paper details the design, capabilities, and uses of the Artemis Distributed Simulation (ADS) being developed by the NASA Exploration Systems Simulations (NExSyS) Team to support Artemis architecture studies. ADS utilizes international interoperability standards to connect a collection of independent vehicle and service simulations; these include but are not limited to elements such as rovers, landers, and habitation elements along with services like communications, environment, visualization, and data logging. ADS’s distributed nature allows for the complex aggregation of constituent Artemis elements; this includes efficient scenario modification with the addition or removal of individual simulations representing Artemis elements or services. This capability provides support for the rapid performance of various Artemis mission trade studies exploring alternate configurations. Currently, ADS uses NASA developed simulations for development and testing; however, through the use of international simulation interoperability standards, ADS provides an integration framework to incorporate dissimilar authoritative vendor simulations as Artemis systems mature and vendor simulations become available. Vendor simulations will be able to join ADS and interact with other Artemis elements and vehicles while limiting the exposure of proprietary data. This paper describes the expansion of an existing distributed simulation infrastructure to accommodate a collaborative and dynamic framework for the Artemis Program. This work includes updated federation designs, integration into existing NASA facilities, advancements in visualizations, and advancements in human driven inputs. This paper will also outline recently completed and ongoing support and collaboration with NASA studies and testing, namely results from energetics and Human-In-The-Loop (HITL) studies. The paper concludes with a plan for future developments and facility integration to enable enhanced studies in preparation for a return of humans to the lunar surface.

Artemis↗

Evaluation of Initial and Midterm Air Traffic Procedures for Urban Air Mobility Operations

This paper describes a follow-on joint human-in-the loop (HITL) simulation effort by NASA and Joby Aviation that builds on the results of these previous studies. It extends that work by comparing the LOA condition for Initial UAM operations to Midterm operations that includes corridor airspace structures and some other changes to the operating environment. This is the first reported air traffic controller-in-the-loop evaluation of the corridor condition in a high-fidelity simulation environment. The following sections describe the routes, scenarios, and operating conditions along with metrics used to evaluate feasibility from the air traffic controllers’ perspectives. The results section presents the traffic levels that were feasible in each condition and concludes with recommendations for extending the scope and applicability of evaluations like this one in the future.

Savvy Verma↗

Orion Hardware In The Loop OIMU Stimulation Latency Effect on Navigation State Estimation

Because Hardware In The Loop (HITL) testing involves the integration of flight software and flight hardware on the ground, non-flight-like effects may arise. One of these non-flight-like effects includes Inertial Measurement Unit (IMU) stimulation latency that affects the time in which the measurement is received by the Extended Kalman Filter (EKF). This paper seeks to present the extent to which this stimulation latency affects the navigational state estimate from the Orion navigation system for all phases of flight for Artemis II.

Christopher A Ertl↗

Orion Hardware In The Loop OIMU Stimulation Latency Effect on Navigation State Estimation

Because Hardware In The Loop (HITL) testing involves the integration of flight software and flight hardware on the ground, non-flight-like effects may arise. One of these non-flight-like effects includes Inertial Measurement Unit (IMU) stimulation latency that affects the time in which the measurement is received by the Extended Kalman Filter (EKF). This paper seeks to present the extent to which this stimulation latency affects the navigational state estimate from the Orion navigation system for all phases of flight for Artemis II.

Christopher A Ertl↗