Search NASA⌕ Search

SEARCH · Search NASA

Results for “VR”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology and Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical work load during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2) were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alex Baughman↗

Assessments of Physiology And Cognition in Hybrid-reality Environments (APACHE) – Physical Workload Approximation

The Human Physiology, Performance, Protection & Operations Laboratory (H-3PO) at NASA Johnson Space Center (JSC) is developing a hybrid reality exploration surface analog, “Assessments of Physiology And Cognition in Hybrid-reality Environments” (APACHE). The goal of APACHE is to create a planetary extravehicular activity (EVA) simulation environment that provides a representative physical and cognitive workload approximation using a combination of virtual reality (VR), physical reality, and hybrid reality (HR) techniques. To develop and characterize the physical workload approximation within the APACHE environment, a two-part approach was implemented. In part 1, baseline physical workload during ambulation within APACHE was evaluated and compared with that in other planetary EVA analog environments and with existing data sets from Apollo planetary EVAs and reduced gravity testing of prototype planetary spacesuits. For this evaluation, 10 subjects were asked to ambulate in three surface analog environments: a passive treadmill in APACHE, natural terrain in an outdoor field environment, and a standard motorized treadmill. Subjects’ heart rate and metabolic rate (VO2/VCO2)were measured and compared among the different test conditions and existing data sets. Gait parameters were also collected to compare with suited mechanics and to understand the role of gait kinematics in physical workload. In part 2, the aim is to evaluate the addition of a custom weighted body suit to the aforementioned surface analog environments and the ability to titrate the suit configuration to provide the best possible physical workload approximation for simulation of lunar and Martian EVAs.

Alexander J Baughman↗

Ruggedizing a Commercial Depth Camera for Novel Lunar Exploration.

The novel contribution of this instrument is to take the first depth images on the moon. A commercial Kinect camera from Microsoft has been ruggedized for a CLPS mission to the Lunar South Pole. The 12-megapixel color camera is combined with a 1-megapixel color time-of-flight (ToF) depth sensor. The solid-state depth sensor/LIDAR provides greater resolution, a wider field of view, pixel binning, and reduced power consumption. The high-resolution data collected from the mission can be used to construct a near-field virtual environment of the lunar surface for scientific applications. The depth camera can provide a 360-degree view of the target area by combining ToF data with RGB imagery and rover turning. The unit was evaluated for space flight compliant materials and parts at NASA Ames. The microphone array, RF shield, front face, and outer body parts were removed to reduce mass. Plastic parts were replaced with vacuum-compatible materials; manufactured cables were added to properly interface with the host rover, built by Lunar Outpost. The environmental testing was performed on the Kinect with Random Vibration/Sine Testing (Fig 1a), per GEVS (NASA’s General Environmental Verification Standard for spaceflight launch survival). Thermal Vacuum testing cycled the instrument between expected hot (+ 85 C) and cold survival temperatures, as well as +50 C and -25 C operational temps (Fig 1b). The instrument functioned nominally at the conclusion of vibration and thermal cycling tests. The Azure Kinect is manifested on the Nova-C lander which flies on the Intuitive Machines mission IM-2, landing at the lunar south pole for a mission duration of 14 days (one lunar daylight cycle). The unit will be integrated to the MAPP (Mobile Autonomous Prospecting Platform) rover at Lunar Outpost. The Azure Kinect with ToF feature will improve the resolution of lunar geology data near the south pole and enable ground-based VR experience of details of the lunar surface (Fig 1c).

V. Jha↗

Rapid Model Import Tool (RMIT) User Guide

The NASA Rapid Model Import Tool (RMIT) is designed to import 3D models built in commercially available Computer Aided Design (CAD) and Digital Content Creation (DCC) development software such as; Catia, Creo, 3DS Max, Maya, etc. Upon import, RMIT processes the models to reduce file size and exports the results in a format compatible with Augmented Reality (AR) and Virtual Reality (VR) development software applications. RMIT intends to make CAD models directly accessible to engineers from local AR/VR compatible laptops and desktops.

Joseluis Chavez↗

Extended Duration: The SIRIUS 21 Crew Perspective

The SIRIUS (Scientific International Research In a Unique terrestrial Station) missions represent a collaborative effort between NASA and Russia’s Institute for Biomedical Problems (IBMP) to conduct a series of long duration isolation and confinement spaceflight analog missions. Three missions of 17-day, 4-month, and 8-month duration (SIRIUS 17, 19, and 21) have been completed at IBMP’s Ground-Based Experimental Complex / Nazemnyy eksperimental'nyy kompleks (NEK) in Moscow, Russia. The international SIRIUS 21 crew comprising representatives from the United States, United Arab Emirates and Russia recently completed the 8-month analog lunar mission. The extended duration mission included simulated lunar transit, orbital, and surface operations with corresponding deep space communication delay, during which the crew participated in nearly 70 studies, eight of which were sponsored by NASA’s Human Research Program. The studies examined the effect of isolation and confinement on the behavioral health of research subjects, and investigated medical countermeasures, team performance, crew dynamics, crew autonomy, food system risks, consequences of confinement and associated physiological stressors. SIRIUS 21 crewmembers also participated in operational tasks such as Rover and CubeSat assembly, simulated lunar sample assessment, VR activities, robotic arm training, environmental systems monitoring, exercise, greenhouse maintenance and 3D printing. Communication with Mission Control was limited to 30-minute periods every two hours. Since access to the internet and email was restricted, simulated ground support provided the Crew’s primary source of daily news and mission information. This panel discussion will include presentations from the US SIRIUS 21 crewmembers – William Brown and Ashley Kowalski – about their experience participating in the mission and science. A facilitated question and answer session will follow with attendees encouraged to ask questions and join in discussion with the SIRIUS 21 crewmembers about their experiences. William Brown came to SIRIUS 21 with experience spread across multiple industries, including the military, defense contracting, healthcare consulting, software engineering, and logistics. He has lived in the Middle East, Central Asia, and Russia. A former Boren Scholar, Brown is fluent in Russian. He holds a Master of International Business degree from the University of South Carolina’s Darla Moore School of Business. Prior to that, he earned a bachelor’s degree in Russian language, literature, and culture from the University of South Carolina. There, he also completed additional undergraduate coursework in computer science. Ashley Kowalski is a Project Leader in The Aerospace Corporation’s International Partnerships Department, where she works with, represents, and provides technical support to the the U.S. Space Force Space Systems Command International Affairs (SSC/IA) office. Through her numerous national and international assignments (Russia, China, and Germany), she has worked on topics related to international space systems, national security space systems, civil systems (including human spaceflight and civil launch projects), space policy, satellite industry analysis, and satellite manufacturing start-ups. She is proficient in Russian and German, and fluent in Polish. Kowalski received her Bachelor of Science and Master of Science degrees in mechanical and aerospace engineering from George Washington University in 2011 and 2012, respectively.

S. E. Whiting↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

Simulation Modeling Virtual Reality Immersive Tech↗

Developing a Motion-Based System for Lunar Vehicle Handling Qualities Testing

— Motion and visual cue influences are critical in any simulator system, as they impact multiple aspects of the human’s neurovestibular and visual systems. Cues of real motion proceeds to the brain before cues of visual change. It is important therefore for simulator motion cues to exist and to match those realistically with those of the real vehicle to provide transferable training of the activity for operations. The United Kingdom’s Royal Air Force Institute of Aviation Medicine (1989)[1] stated that motion platforms are the only simulation devices capable of fully stimulating the body motion sensors. They confirmed that motion platforms can impart accelerations to the whole body and therefore exercise the automatic motion feedback-loop that operators are used to. With both visual and motion cues handling the vehicle becomes more realistic. Strachan (2019)[1] confirms motion cueing from a well set-up motion platform has been found to be important especially in conditions such as night or reduced visibility where motion cues may be more relied upon. As of this writing, the only lunar rover motion simulator is housed at the General Motors (GM) Milford Proving Ground, which only simulates the motions of a traditional car. A NASA Test Team proposed to complete a motion-based simulation system for NASA’s Lunar Terrain Vehicle (LTV) which resides at Johnson Space Center’s Systems Engineering Simulator facility. This activity integrated existing fixed base simulation capabilities with a newly procured six-degree of freedom motion base platform for the design, development, evaluation, and training associated with the LTV project. This would incorporate a South Pole Lunar virtual reality simulation using Lunar Reconnaissance Orbiter 5m/pixel high-resolution imagery and Unreal 5.2 Virtual Shadow Maps, combined with a virtual reality (VR) headset, integrated within a rover cockpit on a Mikrolar Motion Platform for evaluating human performance and vehicle handling qualities for concept roving vehicle designs. The motion-based system received its Human Rating Certification on March 2023. To begin testing the new facility, a preliminary handling qualities study was conducted. The objectives were to determine if there is a correlation amongst three handling quality methods of performance for a lunar vehicle and to understand the effects of a simulated 1/6-g loads and visuals with a motion platform on the operator while in a 1-g physical environment. The capability this system provides directly benefits the NASA’s Extravehicular Activity and Human Surface Mobility Program and NASA’s Flight Operations Directorate in evaluating the driving qualities of vehicle concepts, human performance related to the operating of a lunar surface vehicle, and assessment of suit related driving impacts. It would also provide direct operational benefit by providing a first-in class and unique simulation platform for the lunar astronaut training curriculum. The empirical knowledge of rover and human performance on this scale is paramount as there is currently no other lunar surface simulator with these capabilities. The result of this study ensures a broadly applicable method of testing for shirtsleeve, unpressurized and pressurized suited rover handling qualities.

Test Track↗

Lunar Rover Motion-Based Simulation System

Our team developed a motion-based simulation system for lunar terrain vehicles which resides at Johnson Space Center’s Systems Engineering Simulator (SES) facility. This activity integrates existing fixed base simulation capabilities with a newly procured motion base platform for the design, development, evaluation, and training associated with lunar terrain vehicles. This incorporates a South Pole Lunar virtual reality simulation, combined with a pair of VR headsets, integrated within a rover cockpit on a motion platform for evaluating human performance and vehicle handling qualities for concept roving vehicle designs for surface mobility operations.

Motion-Based↗

Expanding Impact with the James Webb Space Telescope: Combining Art, Science, and Technology for Public Outreach

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

HITL↗

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

Seeing the Future of Spaceflight: Applications of Extended Reality (XR) Technologies

INTRODUCTION Advances in Earth Independent Medical Operations (EIMO) focused capabilities will be crucial for completing successful beyond low-earth-orbit (LEO) missions, where traditional Earth-based medical support and near real-time communication are limited, intermittent, or absent. In such restricted or limited communication environments, emerging extended reality (ER or XR) technologies may play a vital role in ensuring crew health and safety. Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) are common terms used to describe technologies that "generate or modify" while “extended reality” (ER or XR) is often used as an umbrella term for these technologies. This review explores how such cutting-edge “extended reality” information delivery systems are currently applied across various disciplines within NASA. The review focuses on their capabilities, limitations, and prospective future applications as they pertain to Earth-Independent Medical Operations and its components of pre-mission planning, medical decision making, resource management, and task load management. METHODS/DESIGN The review began with a literature search to identify relevant disciplines (e.g., medical education, austere environments) where XR technologies have been studied to highlight areas where evidence is lacking. Previous and current NASA XR projects and applications, as well as commercial partnerships, such as those with Small Business Innovation Research (SBIR), were identified. Discussions with technical experts involved in the design, development, and application of these technologies allowed for classification based on their respective spaceflight applications. RESULTS AND CONCLUSION This review highlights current and emerging XR technologies that have been developed, tested, and implemented both terrestrially and in spaceflight by NASA, its international partners, the U.S. Armed Forces, and various relevant commercial entities. While these novel information delivery systems vary in their respective technology readiness levels (TRL), they have the potential to be implemented on Earth, in LEO, and during deep space exploration. These systems have the potential for impacting and optimizing many aspects of EIMO.

Yevgeniy Zhivotovskiy↗

The KSC Augmented/Virtual reality Lab

To investigate the new XR technologies that are coming onto the market, learn how they work, determine their strengths and weaknesses, and recommend potential applications of these technologies to the work we do at KSC, processing spacecraft, launch delivery systems, and ground support equipment.

XR↗

Trades, Architecture, and Design of the Joint Augmented Reality Visual Informatics (Joint AR) Product

Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate and tight choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. Additionally, EVA operations, aside from the Apollo Lunar surface missions, have predominately focused on maintenance and construction tasks where success criteria are clearly measurable. However, future exploration missions expect to enable crew to carry out scientific objectives in increasingly Earth-independent ways. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. This paper highlights the project’s experience with a product-focused management style and use-case centered systems engineering approach to iteratively design, build, and test. The Joint AR product features were defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, graphics engine software and analog test beds. We outline the defining architectural design decisions, including safety criticality considerations, suit mounting interfaces, computer architectures, and partnership contracting mechanisms. The outcomes of these studies, architecture decisions, and management requirements result in a recommended design which is the Joint AR product. We discuss the evolution, development of these system components, and what work remains. We hope to share a unified understanding of various design decisions and how they impact the future of crew members’ access to data during Lunar and Martian EVAs. This ongoing effort can enable a community-wide discovery process toward realizing necessary AR features and capabilities for future missions.

Augmented Reality↗