Search NASA⌕ Search

SEARCH · Search NASA

Results for “reality mixed reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Mixed Reality Training and Workspace Integration

Mixed reality technology is being used across Idaho National Laboratory (INL) to enhance training and workforce development. Projects involving mixed reality such as lockout/tagout , the Industrial Control System Laboratory , and a Department of Defense microreactor demonstration have benefited from these innovative approaches. Several key concerns exist with integrating this new technology, including ease of use, ease of setup, and maintenance through the lifecycle. These aspects need to be properly addressed to ensure that this technology remains attractive and useful to operations teams as well as engineers and researchers at INL. Primarily, this requires buy-in from information technology management, designing software/hardware-agnostic tools, and reducing friction with technology integration. To be successful, regular operational use of this new and unfamiliar technology will require straightforward user interfaces, simple setup processes, and feature-rich experiences that reduce the time needed to benefit from the technology. INL is improving its toolset to allow for a streamlined deployment and use of mixed reality technologies that are directly available to researchers and engineers.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Implementing Mixed Reality Tools to Support Mission Delivery at Hanford - 20520

Mission Support Alliance's (MSA) Public Works and Information Systems organizations have been working with Microsoft Corporation to develop and implement mixed reality operational solutions using their HoloLens technology. This collaborative effort is intended to drive innovative solutions and significantly improve MSA's efficiency in performing work at the Hanford Site. HoloLens, a mixed reality tool, is a commercial off-the-shelf technology that combines a head-mounted viewing screen with applications to help people and organizations learn, communicate, and collaborate more effectively through the use of mixed reality. https://microsoft.com/en-us/hololens MSA's initial pilot successfully demonstrated its ability to use mixed reality utilizing HoloLens' advanced features in a variety of ways, illustrating the potential efficiency gains previously stated as goals of this pilot. These achievements include the development of proprietary technology that allows synchronization between a HoloLens device and a mobile device or alternate global positioning system (GPS) device. This synchronization enables the HoloLens device to access real time GPS location data anywhere on the Hanford Site. This real time location data, combined with MSA's improved Hanford Geographical Information System (GIS) data, enables the mixed reality pilot application to identify underground utility systems as well as related utility attributes. This ability will aid utility workers in several areas, including excavation activities, the placement of large cranes, identifying interactions and conflicts with future underground utility placements and, eventually, recognizing and de-conflicting tank waste transfer system valve alignments. The HoloLens mixed reality application is also able to provide full or small scale holographic images of a facility's digital twin. This feature will allow MSA's Water and Sewer Utilities team to train and validate procedures associated with the new water treatment facility virtually, before it is constructed. This reduces the amount of time it takes to complete the training and procedure validation, and accelerates the overall construction schedule. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Radsource Mr: Mixed Reality Planning Tool For Radioactive Recovery

The RadSource MR system leverages Meta Quest 3's advanced mixed reality capabilities to create a comprehensive spatial planning platform for end-of-life sealed radioactive source recovery operations. The application utilizes the Quest 3's high-resolution passthrough cameras and spatial mapping algorithms to generate accurate 3D environmental models. Core technical components include: (1) Real-time spatial measurement algorithms calculating distances, angles, slopes, and surface areas with sub-centimeter accuracy; (2) Virtual object placement system allowing users to position digital representations of recovery equipment (trailers, containment vessels, protective barriers) within the real environment; (3) Voice recording and annotation system for hands-free documentation in protective equipment; (4) 3D mesh capture and storage capabilities for post-operation analysis and regulatory documentation. (5) Procedure documentation is available for viewing in Mixed Reality, providing an innovative and convenient way to access the information during pre-visit and inspection activities. (6) Support for screen capture for the view for real world and virtual objects together to use it later for planning. The system integrates computer vision techniques for environmental understanding, spatial mathematics for precise measurements, and human-computer interaction principles optimized for hazardous environment operations. Data persistence allows teams to save and share planning sessions across multiple stakeholders while maintaining operational security requirements.

Khadka, Rajiv [Idaho National Laboratory (INL), Id↗
DOE OSTI2023

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Immersive Analytics in Critical Spatial Domains: From Materials to Energy Systems

Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Developing Digital Twin Visualizations: A Methodology and Case Study on Chemical Separation Processing

As advances in digital engineering continue to push the technological boundaries, digital twin (DT) visualizations for diagnostics and safeguards advancement become much more feasible and practical. DTs generate large and complex data streams that require effective user interfaces to provide monitoring and diagnostic capabilities. Unfortunately, while these frameworks exist, there is not much research on the systematic documentation of human–computer interaction (HCI) for DT visualization. This work presents a dual-mode visualization methodology (two dimensional [2D] graphical user interface dashboard and 3D mixed reality) designed to support diagnostic tasks in DT systems and building on a validated framework and applying established HCI principles. The methodology is demonstrated through a case study of aqueous processing at Idaho National Laboratory, using experimental data from the chemical solvent extraction runs. Our interfaces display real-time alerts and monitoring to inform users of safeguards anomalies. The interfaces use immersive 3D mixed-reality visualization for further system and experiment investigation. This work demonstrates how the systematic application of HCI principles can inform DT visualization design for diagnostic and safeguards applications. While formal user evaluation studies remain as future work, this paper documents the systematic design methodology and demonstrates a proof-of-concept implementation.

3D visualization↗
DOE OSTI2026

Modeling CO 2 flow through faulted/fractured reservoirs using tEDFM in corner-point grids

The interest in underground CO 2 storage has increased significantly over the last decade because of the rising concern about global warming due to the growing levels of greenhouse gases in the atmosphere. Considering that CO 2 accounts for 80% of these greenhouse gases, carbon capture, utilization, and storage (CCUS) is regarded as one of the most direct approaches to achieving the net zero carbon target. Although CO 2 storage in deep saline aquifers and depleted gas reservoirs has been studied extensively, most studies use commercial simulators that model faults/fractures by simply modifying the transmissibility in the direction perpendicular to the fault surfaces. Here, this work shows that this simplistic approach ignores the accelerated flow in the directions parallel to the fault plane, leading to significantly higher leakage along the fault surface. To accurately model the flow of CO 2 in faulted reservoirs, we present the first transient embedded discrete fracture model for corner-point grids (tEDFM-CPG). By comparing the results of the tEDFM-CPG to high-resolution reference solutions, we show that this approach is accurate and efficient at predicting CO 2 flow in faulted/fractured reservoirs. Finally, this work presents the use of mixed reality (MR) to efficiently observe CO 2 gas migration in the interior of these corner-point grid systems.

25 ENERGY STORAGE↗
DOE OSTI2025

Modeling Co2 Flow Through Faulted/Fractured Reservoirs Using Tedfm in Corner-Point Grids

Interest in underground CO2 storage has increased significantly over the last decade, driven by growing concern about global warming and rising levels of greenhouse gases in the atmosphere. Given that CO2 accounts for 80% of these greenhouse gases, carbon capture, utilization, and storage (CCUS) is considered one of the most direct approaches to achieving the net-zero carbon target. Although CO2 storage in deep saline aquifers and depleted gas reservoirs has been studied extensively, most studies use commercial simulators that model faults/fractures by simply modifying the transmissibility in the direction perpendicular to the fault surfaces. This work shows that this simplistic approach ignores the accelerated flow in the directions parallel to the fault plane, leading to significantly higher leakage along the fault surface. To accurately model CO2 flow in faulted reservoirs, we present the first transient embedded discrete-fracture model for corner-point grids (tEDFM-CPG). By comparing the tEDFM-CPG results with high-resolution reference solutions, we show that this approach is accurate and efficient at predicting CO2 flow in faulted/fractured reservoirs. In conclusion, this work presents the use of mixed reality (MR) to efficiently observe CO2 gas migration in the interior of these corner-point grid systems.

02 PETROLEUM↗
DOE OSTI2021

MenuFramework

The Menu Framework is a reusable Extended Reality multi-level menu system for the Unity Development Platform. The menu structure is architected for reusability to suit whatever need the developer may have for a multi-level, reusable menu framework. Menu Framework's architecture, GUI, and functionality are based on the paper "Extended Reality for Enhanced Training and Knowledge Capture" (SAND2020-2361C). This tool uses the Microsoft Mixed Reality ToolKit (MRTK) built in functionality to provide a suite of functionalities including bounding box, follow me, minimize, maximize, settings, and help commands. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1507 O

Klein, BrandonThorin↗
DOE OSTI2020

Performance Evaluation of Augmented Teleoperation of Contact Manipulation Tasks

At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

A Simple Panel System to Overcome Interface Challenges for Retrofits: Preprint

Retrofitting buildings is usually an expensive and labor-intensive process. Weatherization measures can improve comfort and energy affordability to some extent, but deep energy retrofits are needed to optimize performance and comfort, and to achieve significant energy cost savings. Barriers to deep energy retrofits include a limited supply of skilled labor, different building types, planning complexity, split incentives, and a long or non-existent ROI horizon. The "Simple Panel System" (SPS) workflow developed and demonstrated in this effort streamlines deep energy retrofits by applying advanced site capture, machine learning, and mixed reality to panelized construction. The result is a one-stop, product-independent solution for rapidly scalable retrofits with the potential to reduce construction time and project costs by 50%. Soft costs are reduced by more than 66%, total costs by more than 50%, and field construction time by more than 50% - not to mention the reduction in construction waste, improvement in working conditions, and the ability to scale without an influx of skilled labor. This paper presents the SPS and the preliminary results and findings from the pilot project.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

MARVEL Reactor Digital Engineering Developments

The MARVEL reactor project has served to introduce a new generation of engineers to the processes required to transform a reactor design from simply an idea on paper into what will be an approved, constructed, and operational nuclear power system. Much as there have been advances in materials, analysis, and evaluation methodologies over the 50 years since the last reactor was built at INL, so too has the technology for managing the engineering process itself advanced. Digital Engineering tools and methods provide improved coordination between previously siloed engineering disciplines, reduced burdens of non-value-added data transcription processes and bring forward insights and improvements that might otherwise fall later in the design stage, where changes are much more costly. While the tools and techniques to support the full digital engineering vision are not yet complete, the MARVEL design processes provide valuable demonstrations and validations of key aspects and illuminate further areas for implementation by subsequent projects.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2025

Beartooth - Digital Twin Framework Enabling AI

Digital twin was designed as a core part of this testbed. This presentation will discuss the digital twin framework that will enable AI for nuclear aqueous seperations.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Exploring sodium dynamics in the dilute oxygen regime of mixed oxy-sulfide NaPSiSO glasses

All-solid-state‑sodium batteries have great potential to lower the cost of grid-scale energy storage systems. However, they require a low cost, high conductivity solid electrolyte to become a reality. The electrochemical properties of mixed oxy-sulfide glasses NaPSiSO exceed those of either the pure sulfide or the pure oxide glass alone. In this work, we have tested models of sodium ion dynamics in the NaPSiSO series: zNa 2 S+(1-z)[(1-y)[(1-x)SiS 2 + xPS 5/2 ] + yNaPO 3 ] where 0.57 ≤ z ≤ 0.588, 0 ≤ x ≤ 0.35, and 0.15 ≤ y ≤ 0.35 using 23 Na nuclear magnetic resonance to directly probe the local fields and their fluctuations at the nuclear sites. We determined the distribution of activation energies in these materials arising from distributions of local environments and provided quantitative information about the connectivity of the ionic pathways through which the sodium ions move. We found that the sodium ion conduction dynamics were described as an ionic percolation through a Gaussian distribution of energy barriers and that the composition dependence of the ionic conductivity in the dilute oxygen regime is well-described by the Nernst-Einstein relation modified for percolation.

25 ENERGY STORAGE↗
DOE OSTI2022

Semi-Supervised Disaggregation of Load Profiles at Transmission Buses with Significant Behind-the-Meter Solar Generations

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract daily load profiles at transmission buses, which remains a gap in existing technology paradigm. This digest proposes an explicit yet efficient linear estimator, to disaggregate metered load profiles at buses with significant behind-the-meter (BTM) solar generations in a data driven manner. The proposed estimator is based on utility zonal load profiles and proxy solar irradiance profiles, which in reality is the aggregated waveform at each transmission bus and equivalent to the mix of summed load profiles minus actual BTM solar generation. To overcome technical challenges in the lack of “ground truth” and validate the performance of supervised learning algorithms, we propose semi-supervised mechanisms with parameter tuning, and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors.

machine leaning, behind-the-meter, power grid anal↗
DOE OSTI2023

Holistic fleet optimization incorporating system design considerations

The methodology described in this article enables a type of holistic fleet optimization that simultaneously considers the composition and activity of a fleet through time as well as the design of individual systems within the fleet. Often, real-world system design optimization and fleet-level acquisition optimization are treated separately due to the prohibitive scale and complexity of each problem. Importantly, this means that fleet-level schedules are typically limited to the inclusion of predefined system configurations and are blind to a rich spectrum of system design alternatives. Similarly, system design optimization often considers a system in isolation from the fleet and is blind to numerous, complex portfolio-level considerations. In reality, these two problems are highly interconnected. To properly address this system-fleet design interdependence, we present a general method for efficiently incorporating multi-objective system design trade-off information into a mixed-integer linear programming (MILP) fleet-level optimization. This work is motivated by the authors' experience with large-scale DOD acquisition portfolios. However, the methodology is general to any application where the fleet-level problem is a MILP and there exists at least one system having a design trade space in which two or more design objectives are parameters in the fleet-level MILP.

97 MATHEMATICS AND COMPUTING↗