Search NASA⌕ Search

SEARCH · Search NASA

Results for “head mounted display”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization: Preprint

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗
DOE OSTI2021

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗
DOE OSTI2013

Evaluating the Impact of Head Rotation Amplification on Virtual Reality Training Effectiveness

Virtual reality (VR) systems have been proposed for use in numerous training scenarios, such as room clearing, which require the trainee to maintain spatial awareness. But many VR training systems lack a fully surrounding display, requiring trainees to use a combination of physical and virtual turns to view the environment, thus decreasing spatial awareness. One solution to this problem is to amplify head rotations, such that smaller physical turns are mapped to larger virtual turns, allowing trainees to view the surrounding environment with head movements alone. For example, in a multi-monitor system covering only a 90-degree field of regard, head rotations could be amplified four times to allow the user to see the entire 360-degree surrounding environment. This solution is attractive because it can be used with lower-cost VR systems and does not require virtual turning. However, the effects of amplified head rotations on spatial awareness and training transfer are not well understood. We hypothesized that small amounts of amplification might be tolerable, but that larger amplifications might cause trainees to become disoriented and to have decreased task performance and training transfer. In this paper, we will present our findings from an experiment designed to investigate these hypotheses. The experiment placed users in a virtual warehouse and asked them to move from room to room, counting objects placed around them in space. We varied the amount of amplification applied during these trials, and also varied the type of display used (head-mounted display or CAVE). We measured task performance and spatial awareness. We then assessed training transfer in an assessment environment with a fully surrounding display and no amplification. The results of this study will inform VR training system developers about the potential negative effects of using head rotation amplification and contribute to more effective VR training system design.

3D interaction↗
DOE OSTI2021

Comparing perceptions of a dimmable LED lighting system between a real space and a virtual reality display

Over the last several decades, designers have used digital screens to view images of real and simulated spaces and make critical design decisions. Screen technology has improved during this time, as technologies like OLED have replaced legacy displays (CRT, plasma, and LCD). These new screens provide a higher pixel resolution, luminous output and contrast ratio. Immersive head-mounted displays now allow designers to view immersive images, and recent developments in real-time rendering have encouraged the uptake of virtual reality (VR) head-mounted displays in mainstream practice and design education. This paper presents an experiment on lighting perception using a series of LED lighting conditions in a real space and a virtual representation of those conditions captured using a 360° high-dynamic-range camera and presented on an HTC Vive Pro HMD. Fifty-three participants were asked to rate each lighting condition by viewing it in a real space (n = 30) or via immersive HDR photographs displayed in a VR HMD (n = 23). The results show that ratings of visual comfort, pleasantness, evenness, contrast and glare are similar between the HTC Vive Pro HMD and our real space when evaluating well-lit scenes, but significant differences emerge in dim and highly contrasted scenes for a number of rating scales.

Rockcastle, S.↗
DOE OSTI2022

Heterogeneous Visualization: A Call for Empirically Driven Technology Advancement and Adoption; Preprint

Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.

heterogeneous visualization↗
DOE OSTI2024

Design and evaluation of alphabetic and numeric input methods for virtual reality

In today’s virtual reality (VR), users have various ways to influence their VR experience, including alphanumeric input. While typing characters and numbers is straightforward on desktop computers, it presents challenges and opportunities in head-mounted display VR due to specific interaction methods and a lack of real-world visual stimuli. Addressing these open questions, our work implements and evaluates ten approaches to alphabetic and numeric inputs in VR. Here, we describe the design motivation behind these input methods and evaluate them in a user study with 40 participants divided into groups for alphabetic and numeric keyboards. This comparison investigates each method’s performance and user interactions. Our findings suggest that different input methods significantly impact words per minute and error rates, and that certain keyboard designs may receive better subjective evaluations despite poorer objective performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Augmented and Virtual Reality Navigation for Interventions in the Musculoskeletal System

Purpose of Review: Augmented reality (AR) and virtual reality (VR) are cutting-edge technologies that offer advanced navigational solutions. These systems are just starting to be used in interventional radiology and the literature has been limited to pre-clinical and translational experiments. In this paper, we present a review of AR and VR for musculoskeletal interventions. Recent Findings: Mixed reality systems have evolved from costly research systems to fully commercialized clinical instruments designed to facilitate operators in navigating complex anatomy. Studies within interventional radiology have demonstrated safety, improved accuracy, and decreased exposure to ionizing radiation. Summary: We review the progression of mixed reality systems from their early origins in computer science through their current day surgical applications, with a special focus on landmark studies within radiologic interventions for the musculoskeletal system. We highlight the instrumentation, clinical workflow, benefits and drawbacks, and suggested future directions for the two main AR systems: head-mounted display and image-overlay.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2015

SU-E-J-190: Development of Abdominal Compression & Respiratory Guiding System Using Gas Pressure Sensor

Purpose: Abdominal compression is known to be effective but, often makes external-marker-based monitoring of breathing motion not feasible. In this study, we developed and evaluated a system that enables both abdominal compression and monitoring of residual abdominal motion simultaneously. The system can also provide visual-biofeedback capability. Methods: The system developed consists of a compression belt, an abdominal motion monitoring sensor (gas pressure sensor) and a visual biofeedback device. The compression belt was designed to be able to compress the frontal side of the abdomen. The pressure level of the belt is controlled by air volume and monitored in real time using the gas pressure sensor. The system displays not only the real-time monitoring curve but also a guiding respiration model (e.g., a breath hold or shallow breathing curve) simultaneously on the head mounted display to help patients keep their breathing pattern as consistent as possible. Three healthy volunteers were enrolled in this pilot study and respiratory signals (pressure variations) were obtained both with and without effective abdominal compression to investigate the feasibility of the developed system. Two guidance patterns, breath hold and shallow breathing, were tested. Results: All volunteers showed smaller abdominal motion with compression (about 40% amplitude reduction compared to without compression). However, the system was able to monitor residual abdominal motion for all volunteers. Even under abdominal compression, in addition, it was possible to make the subjects successfully follow the guide patterns using the visual biofeedback system. Conclusion: The developed abdominal compression & respiratory guiding system was feasible for residual abdominal motion management. It is considered that the system can be used for a respiratory motion involved radiation therapy while maintaining the merit of abdominal compression. This work was supported by the Radiation Technology R&D program (No. 2013M2A2A7043498) and the Mid-career Researcher Program (2014R1A2A1A10050270) through the National Research Foundation of Korea funded by the Ministry of Science, ICT&Future Planning.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗
DOE OSTI2012

XBox Input -Version 1.0

Contains class for connecting to the Xbox 360 controller, displaying the user inputs {buttons, triggers, analog sticks), and controlling the rumble motors. Also contains classes for converting the raw Xbox 360 controller inputs into meaningful commands for the following objects: • Robot arms - Provides joint control and several tool control schemes • UGV's - Provides translational and rotational commands for "skid-steer" vehicles • Pan-tilt units - Provides several modes of control including velocity, position, and point-tracking • Head-mounted displays (HMO)- Controls the viewpoint of a HMO • Umbra frames - Controls the position andorientation of an Umbra posrot object • Umbra graphics window - Provides several modes of control for the Umbra OSG window viewpoint including free-fly, cursor-focused, and object following.

Source record↗
DOE OSTI2021

Exploring thermal state in mixed immersive virtual environments

Combining immersive virtual environment (IVE) with a controlled environment is a potential solution for analyzing human thermal experience during building design. Existing studies in this field have not adequately analyzed scenarios involving stabilized comfortable and uncomfortable temperature conditions using both thermal state votes and physiological responses, or the influence of the seasons. By combining IVE with a climate chamber, called mixed IVE (MIVE) in this study, experiments were conducted to test the hypothesis that participants' virtual experience did not significantly alter their thermal experience compared to their in-situ experience. Response variables were the control temperature distribution, the thermal state vote (at temperature steps 18.3 °C, 23.8 °C, and 29.4 °C), and physiological responses (heart rate and skin temperature). The results show that the first two response variables were not significantly different between the MIVE and in-situ settings (except for one case). Due to the heat development of the head mounted display device, the mean forehead skin temperature in the MIVE experiments was significantly higher than that in the in-situ experiments in most cases. Furthermore, such difference in skin temperature did not seem to affect general thermal state votes. In addition, significant skin temperature differences at some locations were also observed between the MIVE and in-situ settings.

42 ENGINEERING↗
DOE OSTI2023

State of the Art of Molecular Visualization in Immersive Virtual Environments

Abstract Visualization plays a crucial role in molecular and structural biology. It has been successfully applied to a variety of tasks, including structural analysis and interactive drug design. While some of the challenges in this area can be overcome with more advanced visualization and interaction techniques, others are challenging primarily due to the limitations of the hardware devices used to interact with the visualized content. Consequently, visualization researchers are increasingly trying to take advantage of new technologies to facilitate the work of domain scientists. Some typical problems associated with classic 2D interfaces, such as regular desktop computers, are a lack of natural spatial understanding and interaction, and a limited field of view. These problems could be solved by immersive virtual environments and corresponding hardware, such as virtual reality head‐mounted displays. Thus, researchers are investigating the potential of immersive virtual environments in the field of molecular visualization. There is already a body of work ranging from educational approaches to protein visualization to applications for collaborative drug design. This review focuses on molecular visualization in immersive virtual environments as a whole, aiming to cover this area comprehensively. We divide the existing papers into different groups based on their application areas, and types of tasks performed. Furthermore, we also include a list of available software tools. We conclude the report with a discussion of potential future research on molecular visualization in immersive environments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Telerobotic Control of Dexterous Dual-Arm Robots for D and D Operations - 18622

Robotic systems hold the potential to significantly reduce exposure of workers to hazardous environments such as in the deactivation and decommissioning (D and D) of nuclear facilities. Our goal is to enable an operator with minimal training to easily control a remote dual-arm robot to perform demolition tasks with hand tools. We propose a system that combines semi-autonomous coordination of the robot's arms with an intuitive operator interface based on virtual reality (VR) technology. A limb coordination system enables independent control of the robot arms, as well as coupled motion required to hold and manipulate rigid bodies such as reciprocating saws, angle grinders and crow bars. Using a VR head mounted display and stereo video from the robot for situational awareness and tracked VR hand controllers to command robot arm movement, an operator will be able to walk up to the control console, pick up the controllers, engage the manipulators, fly the grippers, grasp a tool with one or both robot arms and easily move them in unison to perform tasks. We present preliminary results using simulation and a physical dual-arm platform based on the Johns Hopkins University Applied Physics Laboratory's Modular Prosthetic Limb, an anthropomorphic device that provides hyper-dexterous human-like manipulation capabilities. Anticipated benefits of the robotic system for D and D operations include improved situational awareness, increased mission complexity, and reduced operator training time, workload, and task execution times. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2014

Virtual reality 3D headset based on DMD light modulators

We present the design of an immersion-type 3D headset suitable for virtual reality applications based upon digital micro-mirror devices (DMD). Our approach leverages silicon micro mirrors offering 720p resolution displays in a small form-factor. Supporting chip sets allow rapid integration of these devices into wearable displays with high resolution and low power consumption. Applications include night driving, piloting of UAVs, fusion of multiple sensors for pilots, training, vision diagnostics and consumer gaming. Our design is described in which light from the DMD is imaged to infinity and the user’s own eye lens forms a real image on the user’s retina.

digital micromirror device↗
DOE OSTI2023

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗