Search NASA⌕ Search

SEARCH · Search NASA

Results for “Virtual reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Virtual Reality for Shoot/No-Shoot Decision Training in Law Enforcement: A Literature Review and Research Agenda

Virtual reality (VR) can materially improve “shoot / no-shoot” (SNS) training by giving officers realistic, repeatable practice making high-stakes decisions under pressure. Traditional tools—live-fire ranges and video simulators—build basics, but they cannot adapt to each officer in real time or fully mirror the complexity of the field. VR closes that gap by creating immersive scenarios that are safer, more flexible, easier to scale across units, and able to capture objective performance data. SNS decisions are not just about marksmanship; they rely on perception, judgment, memory, and the ability to hold fire when a threat is uncertain. Effective training therefore needs realism, decision complexity, and branching outcomes that reflect the true consequences of choices. These elements strengthen recognition of hostile intent while reducing false positives and building the self-control required in ambiguous situations. VR brings specific advantages: dynamic environments, full-body interaction, and the ability to measure performance with precision—enabling targeted feedback and better transfer of learning to the street. At the same time, responsible deployment must address scenario quality (credible environments and behaviors), lawful decision models, and user wellbeing (appropriate stress levels, comfort, and safety). Sandia’s VIPER Lab is positioned to lead this work. The team combines human-performance science, AI/ML, and VR/AR development with a deep equipment bench (e.g., omnidirectional treadmill, eye-tracking, haptics, multiple HMDs). This ecosystem supports building and validating next-generation SNS training that is immersive, measurable, and trustworthy. Bottom line: Investment in VR-enabled SNS training that blends evidence-based design with careful validation and legal safeguards is expected to pay off in safer, more consistent decision-making and improved community trust, delivered through training that is practical to deploy at scale.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Using Virtual Reality for Worksite Analysis

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). This complements the long history of analyses completed using mockups. These techniques are being implemented for; (1) Concept of development of Deep Space Habitats (DSH), (2) Design and analyses for NASA’s Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time.

Andrews, Tanya↗

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗

Three-Dimensional User Interfaces for Immersive Virtual Reality

The focus of this grant was to experiment with novel user interfaces for immersive Virtual Reality (VR) systems, and thus to advance the state of the art of user interface technology for this domain. Our primary test application was a scientific visualization application for viewing Computational Fluid Dynamics (CFD) datasets. This technology has been transferred to NASA via periodic status reports and papers relating to this grant that have been published in conference proceedings. This final report summarizes the research completed over the past year, and extends last year's final report of the first three years of the grant.

vanDam, Andries↗

Glove-Box or Desktop Virtual-Reality System

The salient features of the optical layout of a desktop-scale virtual-reality system that is specialized for simulating a glove-box work space are depicted and described.

Smith, J. D.↗

Visual feedback and guided balance training in an immersive virtual reality environment for lower extremity rehabilitation

Balance training is essential for physical rehabilitation procedures, as it can improve functional mobility and enhance cognitive coordination. However, conventional balance training methods may have limitations in terms of motivation, real-time objective feedback, and personalization, which a virtual reality (VR) setup may provide a better alternative. In this work, we present an immersive VR training environment for lower extremity balance rehabilitation with real-time guidance and feedback. The VR training environment immerses the user in a 3D ice rink model where a virtual coach (agent) leads them through a series of balance poses, and the user controls a trainee avatar with their own movements. Here we developed two coaching styles: positive-reinforcement and autonomous-supportive, and two viewpoints of the trainee avatar: first-person and third-person. The proposed environment was evaluated in a user study with healthy, non-clinical participants (n = 16, 24.4 ± 5.7 years old, 9 females). Our results show that participants showed stronger performance in the positive-reinforcement style compared to the autonomous-supportive style. Additionally, in the third-person viewpoint, the participants exhibited more stability in the positive-reinforcement style compared to the autonomous-supportive style. For viewpoint, participants exhibited stronger performance in the first-person viewpoint compared to third-person in the autonomous-supportive style, while they were comparable in the positive-reinforcement style. We observed no significant effects on the foot height and number of mistakes. Furthermore, we report the analysis of user performance with balance training poses and subjective measures based on questionnaires to assess the user experience, usability, and task load. The proposed VR balance training could offer an interactive, adaptive, and engaging environment and open new potential research directions for lower extremity rehabilitation.

97 MATHEMATICS AND COMPUTING↗

Finite Element Methods for real-time Haptic Feedback of Soft-Tissue Models in Virtual Reality Simulators

We have applied the linear elastic finite element method to compute haptic force feedback and domain deformations of soft tissue models for use in virtual reality simulators. Our results show that, for virtual object models of high-resolution 3D data (>10,000 nodes), haptic real time computations (>500 Hz) are not currently possible using traditional methods. Current research efforts are focused in the following areas: 1) efficient implementation of fully adaptive multi-resolution methods and 2) multi-resolution methods with specialized basis functions to capture the singularity at the haptic interface (point loading). To achieve real time computations, we propose parallel processing of a Jacobi preconditioned conjugate gradient method applied to a reduced system of equations resulting from surface domain decomposition. This can effectively be achieved using reconfigurable computing systems such as field programmable gate arrays (FPGA), thereby providing a flexible solution that allows for new FPGA implementations as improved algorithms become available. The resulting soft tissue simulation system would meet NASA Virtual Glovebox requirements and, at the same time, provide a generalized simulation engine for any immersive environment application, such as biomedical/surgical procedures or interactive scientific applications.

Frank, Andreas O.↗

A preliminary empirical evaluation of virtual reality as an instructional medium for visual-spatial tasks

We explored the training potential of Virtual Reality (VR) technology. Thirty-one adults were trained and tested on spatial skills in a VR. They learned a sequence of button and knob responses on a VR console and performed flawlessly on the same console. Half were trained with a rote strategy; the rest used a meaningful strategy. Response times were equivalent for both groups and decreased significantly over five test trials indicating that learning continued on VR tests. The same subjects practiced navigating through a VR building, which had three floors with four rooms on each floor. The dependent measure was the number of rooms traversed on routes that differed from training routes. Many subjects completed tests in the fewest rooms possible. All subjects learned configurational knowledge according to the criterion of taking paths that were significantly shorter than those predicted by a random walk as determined by a Monte Carlo analysis. The results were discussed as a departure point for empirically testing the training potential of VR technology.

Regian, J. Wesley↗

Virtual reality flight control display with six-degree-of-freedom controller and spherical orientation overlay

A virtual reality flight control system displays to the pilot the image of a scene surrounding a vehicle or pod having six degrees of freedom of acceleration or velocity control by the pilot and traveling through inertial space, the image itself including a superimposed figure providing the pilot an instant reference of orientation consisting of superimposed sets of geometric figures whose relative orientations provide the pilot an instantaneous feel or sense of orientation changes with respect to some fixed coordinate system. They include a first set of geometric figures whose orientations are fixed to the pilot's vehicle and a second set of geometric figures whose orientations are fixed with respect to a fixed or interstellar coordinate system. The first set of figures is a first set of orthogonal great circles about the three orthogonal axes of the flight vehicle or pod and centered at and surrounding the pilot's head, while the second set of figures is a second set of orthogonal great circles about the three orthogonal axes of a fixed or interstellar coordinate system, also centered at and surrounding the pilot's head.

Beckman, Brian C.↗

Arm DevSummit Keynote: Environment for Data Engineering in Virtual Reality: Ethical Considerations

Currently, the US Government is going through a large-scale data Transformation effort, where the GSA playbook is guiding all agencies to make their processes data-driven with the help of emerging technologies. To address concerns about algorithm sharing, AI adoption, and vendor lock-in, the NASA Langley Research Center Digital Transformation Group has developed the Environment for Data Engineering in Virtual Reality (EnDEVR), a data science ecosystem that allows users to command and investigate customizable data analyses from a VR environment. The system has been evaluated in the Oculus Rift S and Quest environments, two popular VR systems powered by the ARM architecture. Current and future development will employ several AI capabilities to guide research and automation within the environment and to facilitate algorithm sharing. In this talk, we will discuss the results of an initial ethical investigation and recommended considerations for the use of AI within the system.

Artificial Intelligence↗

Visualizing biomolecular electrostatics in virtual reality with UnityMol-APBS

The APBS software was developed to solve the equations of continuum electrostatics for large biomolecular assemblages. APBS has enjoyed widespread adoption throughout the biomedical community and is used in numerous applications involving biomolecular structures. However, visualization of complex biomolecular electrostatic properties can be challenging for two-dimensional graphics systems. Therefore, advanced visualization and manipulation capabilities have been incorporated. In particular, APBS tools have been integrated with the UnityMolX virtual reality platform to provide an immersive experience for preparing biomolecular systems for calculations as well as visualizing and comparing calculated results.

electrostatics, molecular visualization, solvation↗

Embedding speech into virtual realities

In this work a speaker-independent speech recognition system is presented, which is suitable for implementation in Virtual Reality applications. The use of an artificial neural network in connection with a special compression of the acoustic input leads to a system, which is robust, fast, easy to use and needs no additional hardware, beside a common VR-equipment.

Bohn, Christian-Arved↗

System and method for error detection and correction in virtual reality and augmented reality environments

Embodiments of the present disclosure are related to training one or more of machine learning algorithms in a virtual reality environment for error detection and correction and/or for employing one or more trained machine learning models in an augmented reality environment to detect and/or correct user errors associated the performance of one or more tasks.

97 MATHEMATICS AND COMPUTING↗

Virtual Reality Training: "Cybersickness" and Effects on Sensorimotor Functions

The overall goal of this study is to examine the extent to which exposure to virtual reality (VR) systems produces motion sickness and disrupts sensorimotor functions. Two of the major problems in using VRs are: 1) potential "cybersickness", a form of motion sickness, and 2) maladaptive sensorimotor coordination following virtual environment (VE) training. It is likely that users will eventually adapt to any unpleasant perceptual experiences in a virtual environment. However the most critical problem for training applications is that sensorimotor coordination strategies learned in the VE may not be similar to the responses required in the real environment. This study will evaluate and compare responses to the two types of VR delivery systems (head-mounted display [HMD] and a dome-projection system [DOME]), two exposure duration periods (30 minutes or 60 minutes), and repeated exposures (3 sessions). Specific responses that we will examine include cybersickness severity and symptom patterns, and several sensorimotor functions (eye-hea.d and eye-head-hand coordination, and postural equilibrium). To date, all hardware and software acquisition, development, integration and testing has been completed. A database has been developed and tested for the input, management and storage of all questionnaire data. All data analysis scripts have been developed and tested. Data was collected from 20 subjects in a pilot study that was conducted to determine the amount of training necessary to achieve a stable performance level. Seven subjects are currently enrolled in the study designed to examine the effects of exposure to VE systems on postural control. Data has been collected from two subjects, and it is expected that the results from ten subjects will be presented.

Harm, Deborah L.↗

Using Virtual Reality and Motion Capture as tools for Human Factors Engineering at NASA Marshall Space Flight Center

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). VR allows for multiple analyses early in the design process and more opportunities to give design feedback. This tool can be used by engineers in most disciplines to compare design alternatives and is particularly valuable to HFE to give early input during these evaluations. These techniques are being implemented for concept development of Deep Space Habitats (DSH), and work is being done to implement VR for design aspects of the Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time. The MSFC VEL will continue forward leaning implementation with VR technologies in these and other projects for better models earlier in the design process.

Andrews, Tanya↗

Using Virtual Reality and Motion Capture as tools for Human Factors Engineering at NASA Marshall Space Flight Center

NASA Marshall Space Flight Center (MSFC) Human Factors Engineering (HFE) Team is implementing virtual reality (VR) and motion capture (MoCap) into HFE analyses of various projects through its Virtual Environments Lab (VEL). These techniques are being implemented for concept of development of Deep Space Habitats (DSH) and design and analyses for NASA’s Space Launch System (SLS). VR utilization in the VEL will push the design to be better formulated before mockups are constructed, saving budget and time.

Andrews, Tanya↗

NASA KSC Intern Final Report - Virtual Reality in STEM Engagement

For this internship, I was a part of the multi-center NextGen STEM (Science, Technology, Engineering, and Mathematics) pilot. Specifically, I worked with the Developing Commercial Crew Program (CCP) Capabilities team that focuses on human spaceflight to the space station with NASA’s commercial partners. Composed of NASA employees and contractors (who are connected to KSC, JSC, and LaRC), they work to ensure that students will experience traditional classroom content and be immersed in emerging technologies in order to explore Commercial Crew missions and launch facilities. This group is in the process of creating educational products and resources to inspire the next generation to pursue STEM and to allow educators to have access to unique and enticing STEM activities. These products include: age-appropriate classroom lessons (including activity sheets and challenges) for kindergarten through twelfth grade; a CCP app and corresponding guide; learning experiences for students as well as educators; and virtual field trips and tours using NASA-created Virtual Reality (VR) videos and a custom VR app. My particular assignment was managing the VR equipment, developing an understanding of how to maximize the use of the equipment, creating documents that explain and convey the operations and procedures concerning the equipment (including lessons learned from equipment use), and training others to utilize the equipment effectively and correctly for conference events and group demonstrations. Over the course of this internship, I helped my team outline and learn essential procedures of operation for the VR equipment, solved technology problems that arose (due to the nature of creating unique products), and encouraged audiences at KSC and various conferences to consider using the CCP VR videos in their classrooms as an opportunity to engage and challenge the next generation to pursue STEM careers.

STEM↗

Virtual reality as a human factors design analysis tool: Macro-ergonomic application validation and assessment of the Space Station Freedom payload control area

A virtual reality (VR) Applications Program has been under development at MSFC since 1989. Its objectives are to develop, assess, validate, and utilize VR in hardware development, operations development and support, missions operations training, and science training. A variety of activities are under way within many of these areas. One ongoing macro-ergonomic application of VR relates to the design of the Space Station Freedom Payload Control Area (PCA), the control room from which onboard payload operations are managed. Several preliminary conceptual PCA layouts have been developed and modeled in VR. Various managers and potential end users have virtually 'entered' these rooms and provided valuable feedback. Before VR can be used with confidence in a particular application, it must be validated, or calibrated, for that class of applications. Two associated validation studies for macro-ergonomic applications are under way to help characterize possible distortions of filtering of relevant perceptions in a virtual world. In both studies, existing control rooms and their 'virtual counterparts will be empirically compared using distance and heading estimations to objects and subjective assessments. Approaches and findings of the PCA activities and details of the studies are presented.

Hale, Joseph P.↗