Search NASA⌕ Search

SEARCH · Search NASA

Results for “immersive virtual reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

Three-Dimensional User Interfaces for Immersive Virtual Reality

The focus of this grant was to experiment with novel user interfaces for immersive Virtual Reality (VR) systems, and thus to advance the state of the art of user interface technology for this domain. Our primary test application was a scientific visualization application for viewing Computational Fluid Dynamics (CFD) datasets. This technology has been transferred to NASA via periodic status reports and papers relating to this grant that have been published in conference proceedings. This final report summarizes the research completed over the past year, and extends last year's final report of the first three years of the grant.

vanDam, Andries↗
DOE OSTI2025

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗
NASA NTRS2016

Hybrid Reality Lab Capabilities - Video 2

Our Hybrid Reality and Advanced Operations Lab is developing incredibly realistic and immersive systems that could be used to provide training, support engineering analysis, and augment data collection for various human performance metrics at NASA. To get a better understanding of what Hybrid Reality is, let's go through the two most commonly known types of immersive realities: Virtual Reality, and Augmented Reality. Virtual Reality creates immersive scenes that are completely made up of digital information. This technology has been used to train astronauts at NASA, used during teleoperation of remote assets (arms, rovers, robots, etc.) and other activities. One challenge with Virtual Reality is that if you are using it for real time-applications (like landing an airplane) then the information used to create the virtual scenes can be old (i.e. visualized long after physical objects moved in the scene) and not accurate enough to land the airplane safely. This is where Augmented Reality comes in. Augmented Reality takes real-time environment information (from a camera, or see through window, and places digitally created information into the scene so that it matches with the video/glass information). Augmented Reality enhances real environment information collected with a live sensor or viewport (e.g. camera, window, etc.) with the information-rich visualization provided by Virtual Reality. Hybrid Reality takes Augmented Reality even further, by creating a higher level of immersion where interactivity can take place. Hybrid Reality takes Virtual Reality objects and a trackable, physical representation of those objects, places them in the same coordinate system, and allows people to interact with both objects' representations (virtual and physical) simultaneously. After a short period of adjustment, the individuals begin to interact with all the objects in the scene as if they were real-life objects. The ability to physically touch and interact with digitally created objects that have the same shape, size, location to their physical object counterpart in virtual reality environment can be a game changer when it comes to training, planning, engineering analysis, science, entertainment, etc. Our Project is developing such capabilities for various types of environments. The video outlined with this abstract is a representation of an ISS Hybrid Reality experience. In the video you can see various Hybrid Reality elements that provide immersion beyond just standard Virtual Reality or Augmented Reality.

Delgado, Francisco J.↗
NASA NTRS1994

Virtual reality and telerobotics applications of an Address Recalculation Pipeline

The technology described in this paper was designed to reduce latency to user interactions in immersive virtual reality environments. It is also ideally suited to telerobotic applications such as interaction with remote robotic manipulators in space or in deep sea operations. in such circumstances the significant latency is observed response to user stimulus which is due to communications delays, and the disturbing jerkiness due to low and unpredictable frame rates on compressed video user feedback or computationally limited virtual worlds, can be masked by our techniques. The user is provided with highly responsive visual feedback independent of communication or computational delays in providing physical video feedback or in rendering virtual world images. Virtual and physical environments can be combined seamlessly using these techniques.

Regan, Matthew↗
NASA NTRS2008

Venus Quadrangle Geological Mapping: Use of Geoscience Data Visualization Systems in Mapping and Training

We are currently investigating new technological developments in computer visualization and analysis in order to assess their importance and utility in planetary geological analysis and mapping [1,2]. Last year we reported on the range of technologies available and on our application of these to various problems in planetary mapping [3]. In this contribution we focus on the application of these techniques and tools to Venus geological mapping at the 1:5M quadrangle scale. In our current Venus mapping projects we have utilized and tested the various platforms to understand their capabilities and assess their usefulness in defining units, establishing stratigraphic relationships, mapping structures, reaching consensus on interpretations and producing map products. We are specifically assessing how computer visualization display qualities (e.g., level of immersion, stereoscopic vs. monoscopic viewing, field of view, large vs. small display size, etc.) influence performance on scientific analysis and geological mapping. We have been exploring four different environments: 1) conventional desktops (DT), 2) semi-immersive Fishtank VR (FT) (i.e., a conventional desktop with head-tracked stereo and 6DOF input), 3) tiled wall displays (TW), and 4) fully immersive virtual reality (IVR) (e.g., "Cave Automatic Virtual Environment," or Cave system). Formal studies demonstrate that fully immersive Cave environments are superior to desktop systems for many tasks [e.g., 4].

Head, James W.↗
NASA NTRS1998

Object Creation and Human Factors Evaluation for Virtual Environments

The main objective of this project is to provide test objects for simulated environments utilized by the recently established Army/NASA Virtual Innovations Lab (ANVIL) at Marshall Space Flight Center, Huntsville, Al. The objective of the ANVIL lab is to provide virtual reality (VR) models and environments and to provide visualization and manipulation methods for the purpose of training and testing. Visualization equipment used in the ANVIL lab includes head-mounted and boom-mounted immersive virtual reality display devices. Objects in the environment are manipulated using data glove, hand controller, or mouse. These simulated objects are solid or surfaced three dimensional models. They may be viewed or manipulated from any location within the environment and may be viewed on-screen or via immersive VR. The objects are created using various CAD modeling packages and are converted into the virtual environment using dVise. This enables the object or environment to be viewed from any angle or distance for training or testing purposes.

Lindsey, Patricia F.↗
DOE OSTI2026

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

Molten-salt reactors (MSRs) represent a promising solution for next-generation nuclear energy, offering advantages in safety, fuel efficiency, and waste minimization. However, their liquid-fueled design presents unique challenges for spent fuel management, making post-shutdown waste characterization essential for developing effective strategies. Despite this need, there is a notable absence of visualization platforms specifically tailored to the unique characteristics and analytical requirements of MSR waste management. Existing tools in the nuclear industry are primarily designed for reactor operations or generic data exploration and lack both integration with MSR-specific multiphysics frameworks and the ability to simultaneously visualize time-dependent thermal fields, chemical composition evolution, and radiation distribution patterns. To address these limitations, this paper presents an immersive virtual reality (VR) visualization platform that processes and displays high-fidelity multiphysics simulation output from the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework in real-time, using Unity. The platform visualizes MSR waste characteristics such as nuclide decay, salt cooling, and corrosion by using Exodus II output data and running on a VR headset. It includes a user-friendly interface with features such as visibility toggling, cross-sectional slicing, and time-series animation for exploring simulation data. These capabilities support experimental design, stakeholder engagement, and public communication by making complex reactor behavior more accessible and understandable. By enhancing spatial reasoning and reducing cognitive load, this immersive environment fosters more effective communication and decision-making in MSR waste management.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1994

Human factors issues and approaches in the spatial layout of a space station control room, including the use of virtual reality as a design analysis tool

Human Factors Engineering support was provided for the 30% design review of the late Space Station Freedom Payload Control Area (PCA). The PCA was to be the payload operations control room, analogous to the Spacelab Payload Operations Control Center (POCC). This effort began with a systematic collection and refinement of the relevant requirements driving the spatial layout of the consoles and PCA. This information was used as input for specialized human factors analytical tools and techniques in the design and design analysis activities. Design concepts and configuration options were developed and reviewed using sketches, 2-D Computer-Aided Design (CAD) drawings, and immersive Virtual Reality (VR) mockups.

Hale, Joseph P., II↗
NASA NTRS2011

Stage Cylindrical Immersive Display

Panoramic images with a wide field of view intend to provide a better understanding of an environment by placing objects of the environment on one seamless image. However, understanding the sizes and relative positions of the objects in a panorama is not intuitive and prone to errors because the field of view is unnatural to human perception. Scientists are often faced with the difficult task of interpreting the sizes and relative positions of objects in an environment when viewing an image of the environment on computer monitors or prints. A panorama can display an object that appears to be to the right of the viewer when it is, in fact, behind the viewer. This misinterpretation can be very costly, especially when the environment is remote and/or only accessible by unmanned vehicles. A 270 cylindrical display has been developed that surrounds the viewer with carefully calibrated panoramic imagery that correctly engages their natural kinesthetic senses and provides a more accurate awareness of the environment. The cylindrical immersive display offers a more natural window to the environment than a standard cubic CAVE (Cave Automatic Virtual Environment), and the geometry allows multiple collocated users to simultaneously view data and share important decision-making tasks. A CAVE is an immersive virtual reality environment that allows one or more users to absorb themselves in a virtual environment. A common CAVE setup is a room-sized cube where the cube sides act as projection planes. By nature, all cubic CAVEs face a problem with edge matching at edges and corners of the display. Modern immersive displays have found ways to minimize seams by creating very tight edges, and rely on the user to ignore the seam. One significant deficiency of flat-walled CAVEs is that the sense of orientation and perspective within the scene is broken across adjacent walls. On any single wall, parallel lines properly converge at their vanishing point as they should, and the sense of perspective within the scene contained on only one wall has integrity. Unfortunately, parallel lines that lie on adjacent walls do not necessarily remain parallel. This results in inaccuracies in the scene that can distract the viewer and subtract from the immersive experience of the CAVE.

Abramyan, Lucy↗
DOE OSTI2026

Virtual Inspection of Advanced Manufacturing via Process-Scale Digital Twins (Abbreviated Report)

Inspection and certification comprise the most significant bottlenecks in advanced manufacturing for NNSA applications, often requiring far more time and resources than the fabrication of the parts themselves. Traditional methods, such as manual review and X-ray computed tomography, are not only slow and costly, but also struggle to provide a clear connection between manufacturing instructions and the final performance of critical components. This gap limits both the agility and assurance needed to support the modernization and safety of the United States nuclear stockpile. In response, our Strategic Initiative established a digital twin framework that integrates realtime process monitoring, automated data analysis, and immersive virtual reality collaboration into a unified inspection pipeline. By leveraging data from sensors, machine instructions, and imaging, we created high-fidelity virtual models of manufactured parts that could be rapidly analyzed and certified. This approach was first demonstrated with Direct Ink Write, and then extended to other manufacturing settings, including conventional (or “subtractive”) manufacturing and to predict the end of life performance of parts per the aging and lifetimes programs. The result is a transformational capability: inspection times have been reduced by a factor of 120,000 without loss of accuracy and while simultaneously improving traceability and confidence in part quality. This framework not only streamlines certification for critical applications, but also positions the national security enterprise to respond more flexibly to emerging challenges, supporting agile manufacturing and digital engineering practices across a broad range of mission-relevant domains.

42 ENGINEERING↗
NASA NTRS2003

Scientific Visualization & Modeling for Earth Systems Science Education

Providing research experiences for undergraduate students in Earth Systems Science (ESS) poses several challenges at smaller academic institutions that might lack dedicated resources for this area of study. This paper describes the development of an innovative model that involves students with majors in diverse scientific disciplines in authentic ESS research. In studying global climate change, experts typically use scientific visualization techniques applied to remote sensing data collected by satellites. In particular, many problems related to environmental phenomena can be quantitatively addressed by investigations based on datasets related to the scientific endeavours such as the Earth Radiation Budget Experiment (ERBE). Working with data products stored at NASA's Distributed Active Archive Centers, visualization software specifically designed for students and an advanced, immersive Virtual Reality (VR) environment, students engage in guided research projects during a structured 6-week summer program. Over the 5-year span, this program has afforded the opportunity for students majoring in biology, chemistry, mathematics, computer science, physics, engineering and science education to work collaboratively in teams on research projects that emphasize the use of scientific visualization in studying the environment. Recently, a hands-on component has been added through science student partnerships with school-teachers in data collection and reporting for the GLOBE Program (GLobal Observations to Benefit the Environment).

Chaudhury, S. Raj↗
NASA NTRSDate not supplied

Effect of Carbon Dioxide Exposure on Physical and Cognitive Performance in a Simulated Spaceflight Contingency Scenario

Introduction: Carbon dioxide (CO2) produced by astronauts inside space suits can accumulate to levels that affect health and performance. The human health and performance risks associated with different levels of CO2 exposure in the flight environment remain an area of debate. The purpose of this study is to characterize the limit of acceptable performance (cognitive and physical) decrements and symptom severity for mission operations when subjected to elevated inspired CO2 levels in the spacesuit during contingency EVA scenarios. Methods: This study will create a simulation of a 1-hour contingency EVA walk back to the habitat, incorporating a passive treadmill and a fully immersive virtual reality (VR) simulation of a lunar EVA. Subjects will be asked to walk on a treadmill while breathing partial pressures of CO2 of 0, 5, 10, 15, 20, 25, 30mmHg for 1 hour at a time. Cognitive performance will be quantified using validated cognitive tests and measures of functional task performance embedded within the VR environment. Test subject symptoms and self-assessment of performance will be evaluated via survey. Results: This study currently has approval from NASA’s Institutional Review Board and has completed the Test Readiness Review process. Next steps for this research study include test subject recruitment, data collection, and analysis. Data collection is planned for calendar year 2022 and 2023. Discussion: This study will provide valuable information regarding how various partial pressures of CO2 exposure impact acute health, as well as cognitive and physical performance during simulated lunar EVA. This information will be vital in the assessment of overall risk associated with current hardware (vehicle and suit) design for upcoming exploration missions. It will also be invaluable for informing future standards and requirements.

carbon dioxide↗
NASA NTRSDate not supplied

Effect of Carbon Dioxide Exposure on Physical and Cognitive Performance in A Simulated Spaceflight Contingency Scenario

INTRODUCTION: Carbon dioxide (CO2) produced by astronauts inside space suits can accumulate to levels that may affect health and performance. The human health and performance risks associated with different levels of CO2 exposure in the flight environment remain an area of debate. The purpose of this study is to characterize the limit of acceptable performance (cognitive and physical) decrements and symptom severity for mission operations when subjected to elevated inspired CO2 levels in simulated contingency lunar extravehicular activity (EVA) scenarios. METHODS: This study will create a simulation of a 1-hour, ~2km contingency EVA walk back to a habitat, incorporating a passive treadmill and a fully immersive virtual reality (VR) simulation of a lunar EVA environment. Subjects will be asked to walk on a treadmill while breathing partial pressures of CO2 of 0, 5, 10, 15, 20, 25, 30mmHg for 1 hour at a time. Cognitive performance will be quantified using validated cognitive tests and measures of functional task performance embedded within the VR environment. Test subject symptoms and self-assessment of performance will be evaluated via survey. RESULTS: This study currently has approval from NASA’s Institutional Review Board and has completed the Test Readiness Review process. Next steps for this research study include test subject recruitment, data collection, and analysis. Data collection is planned for calendar year 2023 and 2024. DISCUSSION: This study will provide valuable information regarding how various partial pressures of CO2 exposure impact acute health, as well as cognitive and physical performance during simulated contingency lunar EVA. This information will enable assessment of health and performance risk associated with spacesuit systems and operations concepts for future exploration missions as well as informing definition of future standards and requirements.

D. M. Nusbaum↗
NASA NTRSDate not supplied

Effect of Carbon Dioxide Exposure on Physical and Cognitive Performance in A Simulated Spaceflight Contingency Scenario

INTRODUCTION: Carbon dioxide (CO2) produced by astronauts inside space suits can accumulate to levels that may affect health and performance. The human health and performance risks associated with different levels of CO2 exposure in the flight environment remain an area of debate. The purpose of this study is to characterize the limit of acceptable performance (cognitive and physical) decrements and symptom severity for mission operations when subjected to elevated inspired CO2 levels in simulated contingency lunar extravehicular activity (EVA) scenarios. METHODS: This study will create a simulation of a 1-hour, ~2km contingency EVA walk back to a habitat, incorporating a passive treadmill and a fully immersive virtual reality (VR) simulation of a lunar EVA environment. Subjects will be asked to walk on a treadmill while breathing partial pressures of CO2 of 0, 5, 10, 15, 20, 25, 30mmHg for 1 hour at a time. Cognitive performance will be quantified using validated cognitive tests and measures of functional task performance embedded within the VR environment. Test subject symptoms and self-assessment of performance will be evaluated via survey. RESULTS: This study currently has approval from NASA’s Institutional Review Board and has completed the Test Readiness Review process. Next steps for this research study include test subject recruitment, data collection, and analysis. Data collection is planned for calendar year 2023 and 2024. DISCUSSION: This study will provide valuable information regarding how various partial pressures of CO2 exposure impact acute health, as well as cognitive and physical performance during simulated contingency lunar EVA. This information will enable assessment of health and performance risk associated with spacesuit systems and operations concepts for future exploration missions as well as informing definition of future standards and requirements.

carbon dioxide↗
NASA NTRS2019

Immersive Simulations and Engineering Environment (iSEE): Improving Fidelity of Virtual Reality Simulations

The Immersive Simulation and Engineering Environment (iSEE) provides Kennedy Space Center (KSC) with accurate Human Systems Integration (HSI) analysis of the stresses on a human body incurred from physical work, along with accessibility and reach factors. Human Factors engineers can observe the simulations conducted by iSEE and work with the gathered data to help make the working environment at KSC safer. The software that runs the HSI analysis, however, provides users with a low fidelity virtual environment. Previously, this led to the addition and implementation of other iSEE programs that were capable of higher-fidelity simulations. The difficulties of streamlining the workflow in the lab with these new programs is currently being addressed.

Sein, Alexandr↗
NASA NTRS1994

Coordinated control of a dual-arm dexterous robot using full immersion telepresence and virtual reality

Telepresence is an approach to teleoperation that provides egocentric, intuitive interactions between an operator and a remote environment. This approach takes advantage of the natural cognitive and sensory motor skills of an on-board crew and effectively transfers them to a slave robot. A dual alarm dexterous robot operating under telepresence control has been developed and initial evaluations of the system performing candidate EVA, IVA and planetary geological tasks were conducted. The results of our evaluation showed that telepresence control is very effective in transferring the operator's skills to the slave robot. However, the results also showed that, due to the kinematic and dynamics inconsistencies between the operator and the robot, a limited amount of intelligent automation is also required to carry out some to the tasks. Therefore, several enhancements have been made to the original system to increase the automated capabilities of the control system without losing the benefits of telepresence.

Li, Larry↗
NASA NTRS2013

An Onboard ISS Virtual Reality Trainer

Prior to the retirement of the Space Shuttle, many exterior repairs on the International Space Station (ISS) were carried out by shuttle astronauts, trained on the ground and flown to the station to perform these repairs. After the retirement of the shuttle, this is no longer an available option. As such, the need for the ISS crew members to review scenarios while on flight, either for tasks they already trained or for contingency operations has become a very critical subject. In many situations, the time between the last session of Neutral Buoyancy Laboratory (NBL) training and an Extravehicular Activity (EVA) task might be 6 to 8 months. In order to help with training for contingency repairs and to maintain EVA proficiency while on flight, the Johnson Space Center Virtual Reality Lab (VRLab) designed an onboard immersive ISS Virtual Reality Trainer (VRT), incorporating a unique optical system and making use of the already successful Dynamic Onboard Ubiquitous Graphical (DOUG) graphics software, to assist crew members with current procedures and contingency EVAs while on flight. The VRT provides an immersive environment similar to the one experienced at the VRLab crew training facility at NASA Johnson Space Center. EVA tasks are critical for a mission since as time passes the crew members may lose proficiency on previously trained tasks. In addition, there is an increased need for unplanned contingency repairs to fix problems arising as the ISS ages. The need to train and re-train crew members for EVAs and contingency scenarios is crucial and extremely demanding. ISS crew members are now asked to perform EVA tasks for which they have not been trained and potentially have never seen before.

Miralles, Evelyn↗
NASA NTRS2013

An Onboard ISS Virtual Reality Trainer

Prior to the retirement of the Space Shuttle, many exterior repairs on the International Space Station (ISS) were carried out by shuttle astronauts, trained on the ground and flown to the Station to perform these specific repairs. With the retirement of the shuttle, this is no longer an available option. As such, the need for ISS crew members to review scenarios while on flight, either for tasks they already trained for on the ground or for contingency operations has become a very critical issue. NASA astronauts prepare for Extra-Vehicular Activities (EVA) or Spacewalks through numerous training media, such as: self-study, part task training, underwater training in the Neutral Buoyancy Laboratory (NBL), hands-on hardware reviews and training at the Virtual Reality Laboratory (VRLab). In many situations, the time between the last session of a training and an EVA task might be 6 to 8 months. EVA tasks are critical for a mission and as time passes the crew members may lose proficiency on previously trained tasks and their options to refresh or learn a new skill while on flight are limited to reading training materials and watching videos. In addition, there is an increased need for unplanned contingency repairs to fix problems arising as the Station ages. In order to help the ISS crew members maintain EVA proficiency or train for contingency repairs during their mission, the Johnson Space Center's VRLab designed an immersive ISS Virtual Reality Trainer (VRT). The VRT incorporates a unique optical system that makes use of the already successful Dynamic On-board Ubiquitous Graphics (DOUG) software to assist crew members with procedure reviews and contingency EVAs while on board the Station. The need to train and re-train crew members for EVAs and contingency scenarios is crucial and extremely demanding. ISS crew members are now asked to perform EVA tasks for which they have not been trained and potentially have never seen before. The Virtual Reality Trainer (VRT) provides an immersive 3D environment similar to the one experienced at the VRLab crew training facility at the NASA Johnson Space Center. VRT bridges the gap by allowing crew members to experience an interactive, 3D environment to reinforce skills already learned and to explore new work sites and repair procedures outside the Station.

Miralles, Evelyn↗