Search NASA⌕ Search

SEARCH · Search NASA

Results for “Head Mounted Display”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

11 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization: Preprint

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗
DOE OSTI2021

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗
DOE OSTI2021

Comparing perceptions of a dimmable LED lighting system between a real space and a virtual reality display

Over the last several decades, designers have used digital screens to view images of real and simulated spaces and make critical design decisions. Screen technology has improved during this time, as technologies like OLED have replaced legacy displays (CRT, plasma, and LCD). These new screens provide a higher pixel resolution, luminous output and contrast ratio. Immersive head-mounted displays now allow designers to view immersive images, and recent developments in real-time rendering have encouraged the uptake of virtual reality (VR) head-mounted displays in mainstream practice and design education. This paper presents an experiment on lighting perception using a series of LED lighting conditions in a real space and a virtual representation of those conditions captured using a 360° high-dynamic-range camera and presented on an HTC Vive Pro HMD. Fifty-three participants were asked to rate each lighting condition by viewing it in a real space (n = 30) or via immersive HDR photographs displayed in a VR HMD (n = 23). The results show that ratings of visual comfort, pleasantness, evenness, contrast and glare are similar between the HTC Vive Pro HMD and our real space when evaluating well-lit scenes, but significant differences emerge in dim and highly contrasted scenes for a number of rating scales.

Rockcastle, S.↗
DOE OSTI2022

Heterogeneous Visualization: A Call for Empirically Driven Technology Advancement and Adoption; Preprint

Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.

heterogeneous visualization↗
DOE OSTI2024

Design and evaluation of alphabetic and numeric input methods for virtual reality

In today’s virtual reality (VR), users have various ways to influence their VR experience, including alphanumeric input. While typing characters and numbers is straightforward on desktop computers, it presents challenges and opportunities in head-mounted display VR due to specific interaction methods and a lack of real-world visual stimuli. Addressing these open questions, our work implements and evaluates ten approaches to alphabetic and numeric inputs in VR. Here, we describe the design motivation behind these input methods and evaluate them in a user study with 40 participants divided into groups for alphabetic and numeric keyboards. This comparison investigates each method’s performance and user interactions. Our findings suggest that different input methods significantly impact words per minute and error rates, and that certain keyboard designs may receive better subjective evaluations despite poorer objective performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗
DOE OSTI2021

Exploring thermal state in mixed immersive virtual environments

Combining immersive virtual environment (IVE) with a controlled environment is a potential solution for analyzing human thermal experience during building design. Existing studies in this field have not adequately analyzed scenarios involving stabilized comfortable and uncomfortable temperature conditions using both thermal state votes and physiological responses, or the influence of the seasons. By combining IVE with a climate chamber, called mixed IVE (MIVE) in this study, experiments were conducted to test the hypothesis that participants' virtual experience did not significantly alter their thermal experience compared to their in-situ experience. Response variables were the control temperature distribution, the thermal state vote (at temperature steps 18.3 °C, 23.8 °C, and 29.4 °C), and physiological responses (heart rate and skin temperature). The results show that the first two response variables were not significantly different between the MIVE and in-situ settings (except for one case). Due to the heat development of the head mounted display device, the mean forehead skin temperature in the MIVE experiments was significantly higher than that in the in-situ experiments in most cases. Furthermore, such difference in skin temperature did not seem to affect general thermal state votes. In addition, significant skin temperature differences at some locations were also observed between the MIVE and in-situ settings.

42 ENGINEERING↗
DOE OSTI2023

State of the Art of Molecular Visualization in Immersive Virtual Environments

Abstract Visualization plays a crucial role in molecular and structural biology. It has been successfully applied to a variety of tasks, including structural analysis and interactive drug design. While some of the challenges in this area can be overcome with more advanced visualization and interaction techniques, others are challenging primarily due to the limitations of the hardware devices used to interact with the visualized content. Consequently, visualization researchers are increasingly trying to take advantage of new technologies to facilitate the work of domain scientists. Some typical problems associated with classic 2D interfaces, such as regular desktop computers, are a lack of natural spatial understanding and interaction, and a limited field of view. These problems could be solved by immersive virtual environments and corresponding hardware, such as virtual reality head‐mounted displays. Thus, researchers are investigating the potential of immersive virtual environments in the field of molecular visualization. There is already a body of work ranging from educational approaches to protein visualization to applications for collaborative drug design. This review focuses on molecular visualization in immersive virtual environments as a whole, aiming to cover this area comprehensively. We divide the existing papers into different groups based on their application areas, and types of tasks performed. Furthermore, we also include a list of available software tools. We conclude the report with a discussion of potential future research on molecular visualization in immersive environments.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Three-Dimensional Grid Visualization for Planning Activities: A Dubai Case Study

National Laboratory of the Rockies (NLR), in collaboration with the Dubai Electricity and Water Authority (DEWA) and Infra-X, has undertaken the Energy Visualization Analysis Project. The aim of this project is to enhance analytical and 3D visualization capabilities for distribution network planning and renewable energy integration. As modern grid continues to evolve with large-scale solar PV deployment and emerging distributed energy resources (DERs), the ability to effectively analyze, visualize, and communicate complex grid behaviors has become increasingly critical. The project focuses on developing empirical use cases based on real distribution feeder data and engineering workflows, ensuring the outcomes are directly aligned with operational environment. Through time-series power flow simulations and nodal hosting capacity analysis, the study quantifies the impacts of high PV penetration on voltage and thermal limits within representative 11 kV feeders. These analyses identify specific nodes and conditions where DER integration challenges arise. Furthermore, a Battery Energy Storage System (BESS) optimization algorithm was applied to determine the optimal size and placement of storage systems that can mitigate network constraints and enhance hosting capacity. The comparative results between base-case and BESS-augmented scenarios clearly demonstrate improvements in network stability and load management efficiency. In parallel, the NLR team developed an immersive 3D visualization framework, enabling interactive exploration of grid simulations using commodity head-mounted display (HMD) systems. This framework transforms conventional 2D simulation data into spatially intuitive visual environments - allowing engineers to analyze feeder conditions, PV hosting potential, and BESS effects in real time. This report represents the first foundational phase in establishing a visualization-driven analytical ecosystem. It provides a methodological foundation for data integration, visualization architecture, and simulation-based decision support, paving the way for large-scale adoption of immersive visualization across DEWA's Smart Grid Initiative, R&D activities, and future network resilience studies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗