Search NASA⌕ Search

SEARCH · Search NASA

Results for “Virtual reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Topological steering of light by nematic vortices and analogy to cosmic strings

Liquid crystals are widely known for their technological uses in displays, electro-optics, photonics and nonlinear optics, but these applications typically rely on defining and switching non-topological spatial patterns of the optical axis. Here, we demonstrate how a liquid crystal’s optical axis patterns with singular vortex lines can robustly steer beams of light. External stimuli, including an electric field and light itself, allow us to reconfigure these unusual light–matter interactions. Here, periodic arrays of vortices obtained by photo-patterning enable the vortex-mediated fission of optical solitons, yielding their lightning-like propagation patterns. Predesigned patterns and spatial trajectories of vortex lines in high-birefringence liquid crystals can steer light into closed loops or even knots. Our vortex lattices might find technological uses in beam steering, telecommunications, virtual reality implementations and anticounterfeiting, as well as possibly offering a model system for probing the interaction of light with defects, including the theoretically predicted, imagination-capturing light-steering action of cosmic strings, elusive defects in cosmology.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Applications of visualization technology in the structural sciences

The structural sciences are undergoing a transformation driven by advancements in visualization technologies that aid researchers in understanding and communicating experimental data from complex molecular systems. New applications of integrative structural biological and biophysical approaches add a wide variety of complementary information from a broad range of scientific disciplines. These approaches extend structural biophysical methodologies to enable research by the incorporation of a variety of data streams and utilization of tools like molecular graphics, virtual reality, and machine learning. To redefine how structural data—particularly from cryo-electron microscopy and x-ray crystallography—are fed forward for scientific exploration and communication, the advances in tools for data visualization and interpretation have been critical. By bringing molecular systems into an interactive three-dimensional space, these novel technologies enhance research workflows, facilitate structure-based drug design, and create engaging educational experiences. Taken together, these visualization innovations are essential tools for advancing the field by making concepts more accessible and compelling.

Eng, Edward T. [New York Structural Biology Center↗
DOE OSTI2021

Distributed Fiber Sensors With High Spatial Resolution in Extreme Radiation Environments in Nuclear Reactor Cores

This paper is a comprehensive experimental report on the neutron radiation effects of distributed optical fiber sensors with enhanced Rayleigh scattering profiles in an in-pile environment. Femtosecond laser direct writing was used to inscribe Type-II modifications in standard telecom fibers and radiation-hardened fibers with fluorine-doped cores. Rayleigh backscattering signals were enhanced for continuous 1.5 m. In-pile lead-out sensors tests were carried out at the MIT Research Reactor for two months, which was operated at a nominal power of 5.7 MW with fast neutron (>0.1 MeV) flux of 1.29 × 1014 n/cm2/s and an in-core temperature of up to 560°C. Using the Optical Frequency Domain Reflectometry technique, the backscattering profiles of fiber sensors were interrogated with a 3-cm spatial resolution to monitor the temperature profile of the reactor. Results show that laser inscribed Type-II modifications in the form of nanogratings are highly stable against extreme temperature and ionizing radiation. Both standard telecom fibers and radiation-hardened fibers with laser-enhanced Rayleigh profiles can continuously perform distributed temperature measurements over the entire duration of the in-pile testing. Temperature coefficients of sensors and spectral shift quality were studied as functions of total radiation fluence. To the best of our knowledge, we present for the first time, the temperature profile of an operating nuclear reactor core with 3-cm spatial resolution, enabled by distributed fiber sensors with laser-enhanced Rayleigh scattering profiles. The high spatial resolution measurements can provide valuable data for the design and validation of digital twin and virtual reality of nuclear energy systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

MetaPoL: Immersive VR based Indoor Patterns of Life (PoL) and Anomalies Data Generation for Insider Threat Modeling in Nuclear Security

Insider threats are perhaps the most serious challenges that nuclear and radiological security systems face. Insiders pose such a great threat due to their access, authority, and knowledge, granting them opportunities to bypass dedicated nuclear and radiological security elements. For example, in one of the latest major insider threat incidents to nuclear security, the Doel-4 nuclear powerplant in Belgium suffered a shutdown, the threat of nuclear materials diversion, and long-term loss of tens of millions of dollars. Seven years of investigation concluded that it was an inside job and attempted sabotage. In this regard, there is an immediate need for R&D and technology integration in the domain of modeling indoor Patterns-of-Life (PoL) and anomaly detection. This can be achieved by using datasets of facility users’ mobility and activity, which can support the design of algorithms for insider threat modeling and detection. However, due to classification, privacy, sensitivity, and safety protocols, such datasets from real physical nuclear reactor facilities are not only hard to share, but also not always feasible to deploy and collect. Aiming to find an alternate solution, our proposed demonstration work - MetaPoL, is the first-ever (for the application space) immersive VR (virtual reality) environment of a real-world secure facility and allows users to move-and-stay through the designed indoor physical layout and also encounter NPCs (non-player characters) that emulate other facility users. In the MetaPoL an interactive user performs realistic spatio-temporal movement, dwelling and activities using a Meta Quest Pro VR headset, and that generates high-frequency (in time) high-resolution (in space) indoor spatial-temporal datasets that are valuable for PoL modeling and anomaly detection research specifically for insider threat modeling and detection mission. Such generated realistic, rich in context, and mission specific datasets can boost AI/Machine Learning based research for modeling and detecting insider threats in nuclear security and nonproliferation.

Gunaratne, Chathika↗
DOE OSTI2025

GRUMDN: A Multi-Task Model for Predicting Human Patterns-of-Life from Stay Transition Data

Understanding human patterns-of-life (PoL) is essential towards ensuring safe and secure indoor facility environment as well as outdoor urban environment. Prediction of human movement in between places of interest is vital in understanding human PoL. Movement between spaces maybe represented and detected in one of the two forms: 1) trajectories: locations measured at regular time intervals by mobile sensors, bluetooth or GPS sensors; or 2) stay transitions: semantic PoI (points of interest) and stay duration data measurable by eventbased sensors that collect data when a check-in or check-out event is detected. Stay transition data provides a more compressed data format compared to trajectories data, especially in situations with longer stay durations, while preserving the information necessary for PoL analysis. Now as introduced briefly in the paper, our deployed end application (Digital Twin of a facility with non-player characters, besides the interactive user in virtual reality) needed a well-performing and validated AI/ML model for simulating high quality stay transitions behavior. In this study we thus primarily present our findings with developing and validating that model, which is a multi-task neural network for stay transition prediction. The neural network consists of two heads, for corresponding two tasks of stay category prediction and stay duration prediction. We evaluated gated recurrent units and multi-layer perceptrons of varying network sizes for stay category prediction; while mixture density networks, noisy generator-only networks, and generative adversarial networks of varying network sizes for stay duration prediction. We have then evaluated four multi-task models, constructed by combining these specialized models, on their ability to predict stay transition data. We tested our models on datasets from two different cases: 1) a simulation-generated dataset of indoor movement within the HFIR (high flux isotope reactor) nuclear reactor facility at Oak Ridge National Laboratory (ORNL); and 2) the GeoLife human mobility dataset of outdoor urban movement available in literature. Our results indicate that GRUMDN, which combines gated recurrent units (GRU) for stay category prediction task, and mixture density networks (MDN) for stay duration prediction task, did overall outperform other multitask models and the current state-of-the-art.

Gunaratne, Chathika [ORNL] (ORCID:0000000225088745↗
DOE OSTI2024

Electronic Visualization Laboratory's 50th Anniversary Retrospective: Look to the Future, Build on the Past

September 2023 marks the 50th anniversary of the Electronic Visualization Laboratory (EVL) at University of Illinois Chicago (UIC). EVL's introduction of the CAVE Automatic Virtual Environment in 1992, the first widely replicated, projection-based, walk-in, virtual-reality (VR) system in the world, put EVL at the forefront of collaborative, immersive data exploration and analytics. However, the journey did not begin then. Since its founding in 1973, EVL has been developing tools and techniques for real-time, interactive visualizations—pillars of VR. But EVL's culture is also relevant to its successes, as it has always been an interdisciplinary lab that fosters teamwork, where each person's expertise contributes to the development of the necessary tools, hardware, system software, applications, and human interface models to solve problems. Over the years, as multidisciplinary collaborations evolved and advanced scientific instruments and data resources were distributed globally, the need to access and share data and visualizations while working with colleagues, local and remote, synchronous and asynchronous, also became important fields of study. This paper is a retrospective of EVL's past 50 years that surveys the many networked, immersive, collaborative visualization and VR systems and applications it developed and deployed, as well as lessons learned and future plans.

Johnson, Andrew E.↗
DOE OSTI2023

Model Inputs, Outputs, and Scripts associated with: “Combined effects of stream hydrology and land use on basin-scale hyporheic zone denitrification in the Columbia River Basin”

This data package is associated with the publication “Combined effects of stream hydrology and land use on basin‐scale hyporheic zone denitrification in the Columbia River Basin”, published in Water Resource Research (Son et al.2022) available at https://doi.org/10.1029/2021WR031131. This data package includes the key model inputs/outputs of the river corridor model for the Columbia River Basin (CRB) and the model source codes used in the manuscript. The model is a carbon-nitrogen-coupled river corridor model (RCM), and the model is used to quantify hyporheic zone (HZ) denitrification at the NHDPLUS stream reach scales. The RCM used in this study combines empirical substrate models derived from observations and three microbially driven reactions, including two-step denitrification and aerobic respiration, are considered within the HZ. The key input data of the model are exchange flux, residence time, and stream solute (dissolved organic carbon (DOC), dissolved oxygen (DO), and nitrate concentrations). These inputs are constant over time and represent long-term averaged values. This study uses the RCM to explore the spatial patterns of HZ denitrification across reaches with different sizes and land use in the CRB. Our main objective is to use the RCM as a virtual reality model, and the machine-learning models as surrogates that encapsulate the complexities of the physics-based model while identifying the importance of different variables that are not evident in the model conceptualization. We do not include a direct comparison of the modeled HZ denitrification and measurements; however, the RCM can capture the overall spatial patterns of the HZ denitrification because the model inputs and its reaction networks are based on well-established theory and a physical-based model. The combination of the model-based predictions and a machine-learning approach (e.g., random forest) is used to improve our understanding of what variables of the model are associated with spatial patterns of the modeled denitrification across reaches with different sizes and land uses, and to develop a proxy model using measurable variables to reproduce the simulated patterns.This dataset contains five folders: (1) model_inputs, (2) model_outputs, (3) Rscripts, (4) figures, and (5) model_codes. It also contains a readme, file level metadata (FLMD), and data dictionary (dd). Please see the FLMD for a list of all the files contained in this data package and descriptions for each. The model_inputs folder contains the model inputs used to drive the model simulations. The model_outputs folder contains key model output files from the river corridor model. The Rscripts folder contains the Rscripts for pre- and post- processing model results. The figures folder contains the raw figures associated with the manuscript. The model_codes folder includes key model source codes/input files. All files are .jpg, .jpeg, .out, .e, .od, .dat, .sub, .F90, .0, .R, .sbx, .cpg, .sbn, .shx, .shp, .dbf, .prj, .tfw, .tif, .xml, .pdf, or .csv.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Radiographic Imaging and Tomography

Radiographic imaging and tomography (RadIT) come in many flavors such as X-ray imaging and tomography (IT), proton IT, neutron IT, muon IT, neutrino IT, etc. We identify five RadIT themes: Physics, Sources, Detectors, Methods, and Data Science, which are integral parts of image interpretation and three-dimensional (3D) tomographic reconstruction. Traditionally, RadIT have been driven by medicine, non-destructive testing, material sciences, and security applications. The latest thrusts of growth come from automation, machine vision, additive manufacturing and virtual reality (‘metaverse’). The five RadIT themes parallel their counterparts in optical IT. Synergies among different forms of RadIT and with optical IT motivate further advances towards multi-modal IT and quantum IT.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Visualization for Scientific Discovery, Decision-Making, and Communication

Visualization–the use of visual elements to explore data, form hypotheses, or convey conclusions–is an integral part of the scientific process. Starting from an initial exploration of new data to illustrating outcomes to the general public, visualization is one of the most intuitive and powerful modes of communication. With the explosion of new data sources and types, unprecedented volumes of data, and new technologies, such as virtual reality and AI, visualization has become increasingly essential but also ever more challenging. Department of Energy’s (DOE) Office of Advanced Scientific Computing Research (ASCR) sponsored a Basic Research Needs workshop in January 2022 to understand the major opportunities and grand challenges in visualization tools and technologies for scientific computing, with a special focus on DOE-relevant applications and goals. The workshop identified five priority research directions (PRDs) for visualization to support scientific discovery, decision-making, and communication.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Report for the ASCR Workshop on Visualization for Scientific Discovery, Decision-Making, and Communication

Visualization—the use of visual elements to explore data, form hypotheses, or convey conclusions—is an integral part of the scientific process. Starting from an initial exploration of new data to illustrating outcomes for the general public, visualization is one of the most intuitive and powerful modes of communication. With the explosion of new data sources and types, unprecedented volumes of data, and new technologies, such as virtual reality (VR) and artificial intelligence (AI), visualization has become increasingly essential but also ever more challenging. The Department of Energy’s (DOE) Office of Advanced Scientific Computing Research (ASCR) sponsored a Basic Research Needs workshop in January 2022 to understand the major opportunities and grand challenges in visualization tools and technologies for scientific computing as well as for DOE-relevant applications and goals in general. The workshop identified five priority research directions (PRDs) for visualization to support scientific discovery, decision making, and communication. The first three PRDs describe interconnected research themes addressing the need for new techniques to deal with complex data, uncertainty, and interpretability (PRD 1); the need for scalable and interoperable software stacks (PRD 2); and the challenges and opportunities inherent in new technologies, such as VR, cloud, or exascale computing (PRD 3). The remaining two PRDs describe foundational research themes that recognize the potential of visualizations to provide equitable access to information and to strengthen the scientific discourse (PRD 4); and the need to consider human factors when designing visualizations (PRD 5). Collectively, these PRDs form the pillars for a coherent, long-term research and development strategy in Visualization for Scientific Discovery, Decision-Making, and Communication in the context of the Office of Science’s mission scope.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Final Report in Response to ARPA-E Contract Award Number DE-AR0001157

Autonomous operations and maintenance (O&M) by robots has been identified as a key technology to facilitate both the safe operation, and reduced operational costs associated with future nuclear reactors. Radiation and thermal environments, particularly associated with molten salt reactor designs, excludes the use of human proximity and so there is a need to train robots for tasks that have not yet been fully identified, or for accidents that may occur in the future. This program sought to develop a generic methodology that could be applied to train ‘any’ robot, to perform ‘any’ task, through the use of machine learning (ML) training performed in a virtual reality (VR) environment that simulates the physically perceived task(s). The VR environment allows us to construct ‘any’ future task and the ML approach, which included reinforcement learning (RL), allowed us to generate extensive data sets that can be used to establish control algorithms to thereby control the physical robot in the physical environment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

US-UK fusion energy collaborations in the digital space

The US and UK share the vision for fusion as a vital part of the clean energy future. This vision is reflected in the respective national plans in the form of the Bold Decadal Vision for Commercial Fusion (BDV) in the US and the Spherical Tokamak for Energy Production (STEP) program in the UK. Digital tools such as simulation and control frameworks, design tools, AI/ML, high performance computing (HPC), and virtual reality (VR) will play an important role in developing, diagnosing, operating, and further improving burning-plasma-class fusion power plants. Therefore, a collaborative approach, involving both the public and private sectors, to developing these digital tools can accelerate the path to fusion energy commercialization. In this report we discuss previous and ongoing collaborations and opportunities to expand these collaborations into new areas. We conclude this report with near term actions and a vision of the collaboration to the Joint Coordinating Committee.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

R.U.N. Motion VR Boots: Realistic Unimpeded Natural (RUN) Motion Boots for VR gaming in the comfort of your home

Virtual reality (VR) gaming has experienced increasingly widespread adoption in recent years largely due to the development of affordable, consumer-grade headsets equipped with high quality, miniature displays and compact sensors for motion tracking. These devices are now able to provide users with immersive experiences that far surpass what traditional video games can achieve. However, despite these technological strides, a fundamental limitation remains: VR users are unable to move freely in their physical environment without the risk of colliding with real-world obstacles and hazards. This safety concern significantly restricts the level of immersion and natural movement possible in VR gaming.

42 ENGINEERING↗
DOE OSTI2026

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗
DOE OSTI2022

PyZebrascope: An Open-Source Platform for Brain-Wide Neural Activity Imaging in Zebrafish

Understanding how neurons interact across the brain to control animal behaviors is one of the central goals in neuroscience. Recent developments in fluorescent microscopy and genetically-encoded calcium indicators led to the establishment of whole-brain imaging methods in zebrafish, which record neural activity across a brain-wide volume with single-cell resolution. Pioneering studies of whole-brain imaging used custom light-sheet microscopes, and their operation relied on commercially developed and maintained software not available globally. Hence it has been challenging to disseminate and develop the technology in the research community. Here, we present PyZebrascope, an open-source Python platform designed for neural activity imaging in zebrafish using light-sheet microscopy. PyZebrascope has intuitive user interfaces and supports essential features for whole-brain imaging, such as two orthogonal excitation beams and eye damage prevention. Its camera module can handle image data throughput of up to 800 MB/s from camera acquisition to file writing while maintaining stable CPU and memory usage. Its modular architecture allows the inclusion of advanced algorithms for microscope control and image processing. As a proof of concept, we implemented a novel automatic algorithm for maximizing the image resolution in the brain by precisely aligning the excitation beams to the image focal plane. PyZebrascope enables whole-brain neural activity imaging in fish behaving in a virtual reality environment. Thus, PyZebrascope will help disseminate and develop light-sheet microscopy techniques in the neuroscience community and advance our understanding of whole-brain neural dynamics during animal behaviors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗
DOE OSTI2023

CrystalVR

SAND2022-14694 O CrystalVR is a CAD2VR plugin which enables the import of crystallographic information files (CIF) into a virtual reality (VR) environment for visualization and interaction. Crystallographic data is incredibly complex and difficult to navigate and visualize on a two-dimensional or 2D screen. CrystalVR empowers users to step inside their crystals, allowing them to intuitively grow, shrink, and scale the crystal structure. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Krukar, John↗