Search NASA⌕ Search

SEARCH · Search NASA

Results for “collaborative VR”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

25 records · Page 2

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop testing plays a crucial role in NASA's mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts' situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA's testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop testing for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive training experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

Simulation Modeling Virtual Reality Immersive Tech↗

Immersive Technologies for Human-in-the-Loop Lunar Surface Simulations

NASA, the National Aeronautics and Space Administration, continually seeks innovative solutions to enhance its operations, particularly in the realms of testing, evaluation, and training for future missions. Immersive technologies, such as virtual, augmented, and mixed reality have proven to be powerful tools for immersing users in realistic, interactive, and engaging environments. This paper explores how the Simulation and Graphics Branch at NASA’s Johnson Space Center (JSC) leverages immersive technology, modern commercial rendering engines, and physics-based systems simulations to develop human-in-the-loop systems for humanity’s return to the Moon through the Artemis program. When NASA returns to the Moon, astronauts will travel to the Moon’s South Pole where lighting conditions will cause a more complex operational environment. Human-in-the-loop simulations play a crucial role in NASA’s mission planning, spacecraft and space systems development, and evaluation of operational scenarios. The development of immersive environments such as a lunar rover mockup at a video wall enables engineers and astronauts to simulate and experience mission scenarios, integrated spacecraft systems, and operational procedures in a relevant environment before deployment. By integrating realistic virtual environments, immersive technology allows for the visualization and interaction with virtual spacecraft models, mission landscapes, and complex operational tasks. This approach helps identify potential design flaws, operational challenges, and safety considerations. It also provides valuable insights for risk reduction and helps improve mission efficiency and effectiveness. With advanced motion tracking systems and custom virtual environments, data can be gathered and evaluated to help NASA refine training protocols, develop specialized training procedures, and optimize human-robotic interactions for future space missions. Furthermore, immersive technology offers opportunities for future training initiatives at NASA. The Virtual Reality Laboratory at JSC has pioneered training with Virtual Reality (VR) since the Hubble Space Telescope repair missions in the early 1990’s. Extended Reality (XR) simulations enable astronauts to rehearse complex spacewalks, spacecraft maneuvers, and extravehicular activities in a safe and controlled environment. By replicating the physical and cognitive challenges of space missions, immersive training experiences enhance astronauts’ situational awareness, decision-making abilities, and adaptability to unexpected scenarios. Additionally, immersive technology facilitates collaborative training, allowing geographically dispersed crew and mission control personnel to engage in synchronized simulations, fostering teamwork and effective communication. The adoption of immersive technology in NASA’s testing, evaluation, and future training programs has yielded significant benefits. By incorporating human-in-the-loop simulations for studies involving Extra Vehicular Activities (EVA), surface mobility and landing systems, NASA can identify and mitigate risks, optimize operational procedures, and enhance mission success. Ultimately, immersive simulation experiences can empower astronauts to better navigate the complexities of space missions, ensuring their safety, productivity, and success in the dynamic and challenging environments they will experience at the Lunar South Pole.

HITL↗

Physics-Informed Graph Neural Networks for Collaborative Dynamic Reconfiguration and Voltage Regulation in Unbalanced Distribution Systems

Network reconfiguration has long been employed as a strategic approach to minimize power distribution system losses and effectively regulate voltage levels. Tap-changing voltage regulators are also critical for controlling bus voltages, especially in accommodating the increasing integration of distributed energy resources (DERs) with intermittent outputs. This paper introduces novel methodologies to address the challenges of dynamic reconfiguration and optimal tap setting in unbalanced three-phase distribution systems. We propose an approximated mixed-integer quadratically constrained program (MIQCP) to model dynamic reconfiguration, along with a pioneering formulation for voltage regulator (VR) tap-setting based on Special Ordered Set type 1 (SOS1). To mitigate computational complexity, we propose a physics-informed spatial-temporal graph convolutional network (STGCN) with an integrated link classifier. The proposed approach enables efficient solution generation by fixing specific variables in the MIQCP instance and solving the simplified sub-MIP using an MIP solver. Numerical studies demonstrate the superior prediction accuracy of our STGCN model compared to baseline neural network models, resulting in reduced DER curtailment and voltage deviation with shorter computation time.

dynamic reconfiguration↗

Extended Duration: The SIRIUS 21 Crew Perspective

The SIRIUS (Scientific International Research In a Unique terrestrial Station) missions represent a collaborative effort between NASA and Russia’s Institute for Biomedical Problems (IBMP) to conduct a series of long duration isolation and confinement spaceflight analog missions. Three missions of 17-day, 4-month, and 8-month duration (SIRIUS 17, 19, and 21) have been completed at IBMP’s Ground-Based Experimental Complex / Nazemnyy eksperimental'nyy kompleks (NEK) in Moscow, Russia. The international SIRIUS 21 crew comprising representatives from the United States, United Arab Emirates and Russia recently completed the 8-month analog lunar mission. The extended duration mission included simulated lunar transit, orbital, and surface operations with corresponding deep space communication delay, during which the crew participated in nearly 70 studies, eight of which were sponsored by NASA’s Human Research Program. The studies examined the effect of isolation and confinement on the behavioral health of research subjects, and investigated medical countermeasures, team performance, crew dynamics, crew autonomy, food system risks, consequences of confinement and associated physiological stressors. SIRIUS 21 crewmembers also participated in operational tasks such as Rover and CubeSat assembly, simulated lunar sample assessment, VR activities, robotic arm training, environmental systems monitoring, exercise, greenhouse maintenance and 3D printing. Communication with Mission Control was limited to 30-minute periods every two hours. Since access to the internet and email was restricted, simulated ground support provided the Crew’s primary source of daily news and mission information. This panel discussion will include presentations from the US SIRIUS 21 crewmembers – William Brown and Ashley Kowalski – about their experience participating in the mission and science. A facilitated question and answer session will follow with attendees encouraged to ask questions and join in discussion with the SIRIUS 21 crewmembers about their experiences. William Brown came to SIRIUS 21 with experience spread across multiple industries, including the military, defense contracting, healthcare consulting, software engineering, and logistics. He has lived in the Middle East, Central Asia, and Russia. A former Boren Scholar, Brown is fluent in Russian. He holds a Master of International Business degree from the University of South Carolina’s Darla Moore School of Business. Prior to that, he earned a bachelor’s degree in Russian language, literature, and culture from the University of South Carolina. There, he also completed additional undergraduate coursework in computer science. Ashley Kowalski is a Project Leader in The Aerospace Corporation’s International Partnerships Department, where she works with, represents, and provides technical support to the the U.S. Space Force Space Systems Command International Affairs (SSC/IA) office. Through her numerous national and international assignments (Russia, China, and Germany), she has worked on topics related to international space systems, national security space systems, civil systems (including human spaceflight and civil launch projects), space policy, satellite industry analysis, and satellite manufacturing start-ups. She is proficient in Russian and German, and fluent in Polish. Kowalski received her Bachelor of Science and Master of Science degrees in mechanical and aerospace engineering from George Washington University in 2011 and 2012, respectively.

S. E. Whiting↗

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗

The Gandalf Staff: A Mobile Tool for Lunar Exploration (2nd year of development)

The Gandalf Staff is a mobile tool designed to be a flexible device supporting crewed and uncrewed operations on the lunar surface. The core of the device is a 24v battery with communications and data storage systems. Initial optional components supporting crewed Extra-Vehicular Activity (EVA) include a LiDAR and 360˚ camera. These provide 3D mapping of the traverse for documentation, and to aid future planning. The mapping also creates outreach opportunities for the public to “stand beside” the astronaut in Virtual Reality (VR). The staff provides external lighting for field site illumination in the south polar region low sun angle environment. Navigation instruments for crew position determination with Lunar Search and Rescue (LunaSAR) are also included. The staff itself can be used as a walking aid or as a splint for Incapacitated Crew Rescue (ICR). As a stand-alone device, the staff operates as a long duration untended science platform collecting environmental data and sending it to a lunar base station. The stand-alone mode requires connection to an auxiliary power source (e.g. solar array) and energy storage system (e.g. battery), so it could become an electrical recharging station. To make rapid progress in the 1st year, and also to demonstrate innovative project management techniques, NASA guided a private industry partner, T STAR, in leading Capstone Engineering student teams at Texas A&M University (TAMU) for proof-of-concept development and testing. These teams developed the power system and demonstrated successful integration of LiDAR, WiFi communications, and external lighting subsystems. Another industry team at Jacobs Technology prototyped a tripod to hold the staff upright. For the 2nd year (FY’22), NASA will again collaborate with partners to prototype enhanced power and lighting concepts. Year 2 will also add new capability for LunaSAR and geophysical science instrumentation using a heat probe. The heat probe is based upon Apollo heritage but modified to measure subsurface volatile ice regimes at the Artemis landing site. Components of the Gandalf Staff can be developed, tested, and deployed independently, or on the integrated staff, rovers, or utility trailers. The project supports crew safety, lunar sample curation, mission science, and public outreach goals of NASA. PLAIN TEST SUMMARY: Gandalf Staff is a 24v battery powered mobile tool for the lunar surface supporting crewed geologic field site exploration, or as a stand-alone science platform. As a tool assisting astronauts conducting field geology, the Gandalf Staff provides external lighting to illuminate shadowed regions on the surface. It also documents the process of collecting rocks and dust samples using a LiDAR (laser range instrument) and cameras. The staff provides a beacon for emergency location of astronauts and augments communications when the astronauts are blocked by large boulders. As a standalone science platform, the Gandalf Staff provides a power system for instruments and sensors to measure the lunar environment over long periods of time. The staff gathers data and sends the results to a lunar base station for analysis.

External Lighting↗

International Conference on Remote Sensing Applications for Archaeological Research and World Heritage Conservation

Contents include the following: Monitoring the Ancient Countryside: Remote Sensing and GIS at the Chora of Chersonesos (Crimea, Ukraine). Integration of Remote Sensing and GIS for Management Decision Support in the Pendjari Biosphere Reserve (Republic of Benin). Monitoring of deforestation invasion in natural reserves of northern Madagascar based on space imagery. Cartography of Kahuzi-Biega National Park. Cartography and Land Use Change of World Heritage Areas and the Benefits of Remote Sensing and GIS for Conservation. Assessing and Monitoring Vegetation in Nabq Protected Area, South Sinai, Egypt, using combine approach of Satellite Imagery and Land Surveys. Evaluation of forage resources in semi-arid savannah environments with satellite imagery: contribution to the management of a protected area (Nakuru National Park) in Kenya. SOGHA, the Surveillance of Gorilla Habitat in World Heritage sites using Space Technologies. Application of Remote Sensing to monitor the Mont-Saint-Michel Bay (France). Application of Remote Sensing & GIS for the Conservation of Natural and Cultural Heritage Sites of the Southern Province of Sri Lanka. Social and Environmental monitoring of a UNESCO Biosphere Reserve: Case Study over the Vosges du Nord and Pfalzerwald Parks using Corona and Spot Imagery. Satellite Remote Sensing as tool to Monitor Indian Reservation in the Brazilian Amazonia. Remote Sensing and GIS Technology for Monitoring UNESCO World Heritage Sites - A Pilot Project. Urban Green Spaces: Modern Heritage. Monitoring of the technical condition of the St. Sophia Cathedral and related monastic buildings in Kiev with Space Applications, geo-positioning systems and GIS tools. The Murghab delta palaeochannel Reconstruction on the Basis of Remote Sensing from Space. Acquisition, Registration and Application of IKONOS Space Imagery for the cultural World Heritage site at Mew, Turkmenistan. Remote Sensing and VR applications for the reconstruction of archaeological landscapes. Archaeology through Space: Experience in Indian Subcontinent. The creation of a GIS Archaeological Site Location Catalogue in Yucatan: A Tool to preserve its Cultural Heritage. Mapping the Ancient Anasazi Roads of Southeast Utah. Remote Sensing and GIS Technology for Identification of Conservation and Heritage sites in Urban Planning. Mapping Angkor: For a new appraisal of the Angkor region. Angkor and radar imaging: seeing a vast pre-industrial low-density, dispersed urban complex. Technical and methodological aspects of archaeological CRM integrating high resolution satellite imagery. The contribution of satellite imagery to archaeological survey: an example from western Syria. The use of satellite images, digital elevation models and ground truth for the monitoring of land degradation in the "Cinque Terre" National park. Remote Sensing and GIS Applications for Protection and Conservation of World Heritage Site on the coast - Case Study of Tamil Nadu Coast, India. Multispectral high resolution satellite imagery in combination with "traditional" remote sensing and ground survey methods to the study of archaeological landscapes. The case study of Tuscany. Use of Remotely-Sensed Imagery in Cultural Landscape. Characterisation at Fort Hood, Texas. Heritage Learning and Data Collection: Biodiversity & Heritage Conservation through Collaborative Monitoring & Research. A collaborative project by UNESCO's WHC (World Heritage Center) & The GLOBE Program (Global Learning and Observations to Benefit the Environment). Practical Remote Sensing Activities in an Interdisciplinary Master-Level Space Course.

Source record↗