SEARCH · Search NASA

Results for “Augmented reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Machine learning simulation of finite element analysis in augmented reality

Media, method and system for approximating a finite element analysis texture map for an object. To accomplish this, the object is converted to a computer generated model and finite element analysis is performed for a plurality of different simulated inputs to generate a plurality of simulated mappings. Each simulated mapping is converted into a simulated texture map. A machine learning model is trained on the simulated inputs and simulated texture maps to generate a texture map which approximates a finite element analysis. The machine learning model receives a user input and generates the texture map therefrom. The texture map is then wrapped to the object and displayed.

Scherer, Derek Carl↗

DOE OSTI2025

Immersive Analytics in Critical Spatial Domains: From Materials to Energy Systems

Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.

99 - GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

Interacting with the COVID virus model in VR environment

The Disaster Response Complex at Idaho State University (ISU) hosts an annual Disaster Preparedness and Response Conference which will give a bird's eye view of disasters and pandemics in the U.S. We'll demonstrate virtual reality (VR) and augmented reality (AR) capabilities at the conference. This VR demo displays the structure and components of the COVID virus model, and let users to interact with it in an immersive environment. The 3D model used in this demo is open source and downloaded from this site: https://sketchfab.com/GLS.

3D↗

DOE OSTI2022

Intelligent Process Visualization through Nuclear Operation Process Modeling, Reasoning, and Object Detection from Field Videos (Final Report)

This report is a deliverable for the “Final Report” task of DOE NEET Project 19-16790, "Context-Aware Safety Information Display for Nuclear Field Workers." This project's overall goal is to test the hypothesis that integrating computer vision and process reasoning methods will enable proactive visualization of the safe operation and maintenance processes of Nuclear Power Plants (NPP) for field workers. Augmented Reality (AR) glasses adopting such proactive safety information visualization techniques can significantly increase personnel safety and reduce the NPP’s operating costs. The current practice of monitoring NPPs requires workers to switch between digital models, data, and physical workspaces in identifying relevant but potentially occluded objects and in assessing the risks of operation and maintenance processes. On the other hand, frequently changed field conditions require field workers to report to supervisors for real-time guidance. Such guidance is essential to ensure that changing conditions will not invalidate or endanger the work order and other ongoing processes that may jeopardize NPP operations. Additionally, incorrect recognition of equipment objects can result in communication errors and safety problems. AR techniques can assist engineers in viewing the physical workspaces with objects labeled with detailed operation procedures and safety reminders during field operations. The project team developed an “Intelligent Context-Aware Safety Information Display” (ICAD) for supporting Nuclear Power Plant (NPP) field workers in achieving safe and efficient execution of a series of operational tasks in uncertain and changing workspaces of an NPP. Before designing the ICAD-AR prototype, the project team synthesized NPP operational knowledge models through literature review studies, surveys, interviews with domain experts, and knowledge modeling. The project team conducted an extensive study of the operational procedures of various NPPs, and digital technologies that can support the safe and efficient execution of those procedures in different NPP operational contexts. This literature review helped the project team conduct surveys and interviews with nuclear engineers and field workers to identify three categories of information. The NPP knowledge modeling efforts reveal that the three categories of information identified have different levels of importance in a typical procedure of carrying out a series of tasks to achieve a specific NPP operation goal (e.g., shutdown, mode changes). These three categories of information include 1) Workspace dynamics – the changing spatial arrangements of workspaces, tools, protection equipment, and supporting materials, 2) Workflow prognostics – the dynamic dependencies between different parts of an NPP that functionally support and influence each other in terms of safety and efficiency, and 3) Hazards – objects and spaces that contain hazardous materials or physical conditions that can pose risks to workers or mechanical systems. The project team has profiled the importance levels of these categories of information into a knowledge model. This knowledge model specifies what types of information are more critical for a given task in a given workspace so that computers can automatically identify critical objects and sensors in a scene for delivering context-ware safety information to field workers through AR devices. Significant research development of this project results in technical research outcomes and a prototyping system that illustrates the technical feasibility of establishing an ICAD-AR system supporting the proactive safety information display for nuclear field workers. This final report summarizes the project team’s technological achievements in the past three years. Overall, the project team completed the development and integration of five techniques into a prototype ICAD Augmented Reality (ICAD-AR) system and demonstrated the developed system’s real-time execution in a mechanical room. The project team completed the analysis of using this prototype in other types of workspaces based on 3D image data and digital design models collected from two additional workspaces (a water treatment plant and a flow loop training facility). The integrated techniques include 1) Natural Language Processing (NLP) algorithms supporting the generation and updates of nuclear fieldwork process models based on text analysis of work packages and operation manuals; 2) sensor log analysis for predicting control actions in given sensor reading contexts; 3) computer vision algorithms for automatic localization and navigation of workers; 4) object detection algorithms for identifying task-related objects and correlated sensors for safety checking; 5) AR technique as a platform for supporting the integration. The testing results of these five techniques have shown that 1) the sensor log analysis model can predict the next control action with an accuracy of 0.883; 2) the trained natural language processing model can extract more than 80% of the critical information from paper-based procedures (PBPs); 3) the navigation algorithm with the integration of Visual Inertial Odometry (VIO) and Non-Recursive Bayesian Filter methods make operator’s trajectory estimation resilient to drift error; 4) the computer vision algorithm can detect task-specific and safety-critical objects with an average accuracy of 95.3%. The project team used work procedures collected from a flow loop training facility and two datasets collected from two mechanical rooms simulating the workspaces of NPPs to demonstrate the technical capabilities of the developed ICAD-AR prototype. The demonstration validated the technical feasibility of establishing the ICAD-AR system for nuclear field workers and identified the challenges in 1) automatic text analysis of work packages; 2) use of limited samples of sensor logs for predicting the proper timings of control actions; 3) reliably tracking workers and their task progress in mechanical rooms with many similar objects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Performance Evaluation of Augmented Teleoperation of Contact Manipulation Tasks

At Argonne National Laboratory, an enhanced telerobotic concept has been suggested by providing augmented virtual fixtures for precise and dexterous manipulation. The proposed technology incorporated a human-robot interface that can assist personnel on the processes of Deactivation and Decommissioning in sites of high radiation. It has been implemented on a dual-arm robot system, known as Baxter, by integrating the Robotic Operating System (ROS) with 3D sensors and visual-haptic operator interface. However, what remained before its practical utilization is the capability for precisely placing the virtual fixtures. To this end, the objectives involved camera calibration, which required hardware fabrication and setup, as well as modification and implementation of ROS. The goal of this Research and Development is to develop an augmented-reality- based operator interface for human-inclusive, intelligent, and autonomous robotic system for the Deactivation and Decommissioning (D and D) of radioactive sites. The objectives are to develop: Collaborative Robot; Multi-modal Mixed-Reality Human-Robot Interface; Intelligent and Autonomous Behaviors. In order to achieve this, Baxter's Head-Kinect camera and Left-Hand camera need to be calibrated to overlap the real environment with the simulated environment. Camera calibration, which is crucial for precisely placing the virtual fixtures, was successful after running the simulations. The real and simulated environments overlapped, permitting the utilization of augmented teleoperation and the dexterous manipulation of Baxter for D and D applications in nuclear sites. Future steps: Performance evaluation of augmented teleoperation of contact manipulation tasks: Multiple-Camera 3D Reconstruction and Automation. Oculus Interface: Augmented reality and machine learning for enhanced telerobotic operation (Augmented Tele-autonomy): Machine-learning techniques for complex and flexible autonomous robotic behaviors. Interactive remote operation of robotic systems. Mesh cutting with simulation and real robot.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2024

Visualizing an Exascale Data Center Digital Twin: Considerations, Challenges and Opportunities

Digital twins are an excellent tool to model, visualize, and simulate complex systems, to understand and optimize their operation. In this work, we present the technical challenges of real-time visualization of a digital twin of the Frontier supercomputer.We show the initial prototype and current state of the twin and highlight technical design challenges of visualizing such a large High Performance Computing (HPC) system. The goal is to understand the use of augmented reality as a primary way to extract information and collaborate on digital twins of complex systems. This leverages the spatio-temporal aspect of a 3D representation of a digital twin, with the ability to view historical and real-time telemetry, triggering simulations of a system state and viewing the results, which can be augmented via dashboards for details. Finally, we discuss considerations and opportunities for augmented reality of digital twins of large-scale, parallel computers.

Maiterth, Matthias↗

DOE OSTI2021

HydrogenAR: Interactive Data-Driven Presentation of Dispenser Reliability: Preprint

When delivering presentations to a co-located audience, we typically use slides with text and 2D graphics to complement the spoken narrative. Though presentations have largely been explored on 2D media, augmented reality (AR) allows presentation designers to add data and augmentations to existing physical infrastructure on display. This could provide a more engaging experience to the audience and support comprehension. With HydrogenAR, we present a novel application that leverages the benefits of data-driven storytelling with those of AR to explain the unique challenges of hydrogen dis- penser reliability. Utilizing physical props, situated data, and virtual augmentations and animations, HydrogenAR serves as a unique presentation tool, particularly critical for stakeholders, tour groups, and VIPs. HydrogenAR is a product of multiple collaborative de- sign iterations with a local Hydrogen Fuel research team and is evaluated through interviews with team members and a user study with end-users to evaluate the usability and quality of the interactive AR experience. Through this work, we provide design considera- tions for AR data-driven presentations and discuss how AR could be used for innovative content delivery beyond traditional slide-based presentations.

augmented reality↗

DOE OSTI2024

Dual particle imaging: Applications in security and environmental imaging

Radiation imaging detectors have been applied in a variety of fields for detection, localization and characterization of radioactive sources. In this work, we describe a handheld detection system (H2DPI) that can simultaneously image neutrons and gamma rays, and reconstruct the energy spectra of the incident particles. This system was applied to the detection and characterization of a plutonium metal source in experiments performed at the National Criticality Experiments Research Center, where the 4.5 kg plutonium source was placed approximately 60 cm from the H2DPI. Neutron and gamma-ray images were measured that show good agreement with the known location of the source. Furthermore, the H2DPI was also used to measure the neutron spectrum, which shows the expected shape of a Watt fission spectrum, and the gamma-ray energy spectrum, which shows the energies common to plutonium metal. Finally, we describe the application of the H2DPI in augmented reality, whereby real-time neutron and gamma-ray imaging data can be streamed to the Microsoft HoloLens to allow the user to visualize the source locations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

Situated Visualization of Photovoltaic Module Performance for Workforce Development

The rapid growth of the solar energy industry requires advanced educational tools to train the next generation of engineers and technicians. We present a novel system for situated visualization of photovoltaic (PV) module performance, leveraging a combination of PV simulation, sun-sky position, and head-mounted augmented reality (AR). Our system is guided by four principles of development: simplicity, adaptability, collaboration, and maintainability, realized in six components. Users interactively manipulate a physical module's orientation and shading referents with immediate feedback on the module's performance.

augmented reality↗

DOE OSTI2024

Situated Visualization of Photovoltaic Module Performance for Workforce Development: Preprint

augmented reality↗

DOE OSTI2024

Situated Visualization of Photovoltaic Module Performance for Workforce Development

augmented reality↗

DOE OSTI2024

The Evolution of Airport Terminal Wayfinding Technologies

This work was presented during the Transportation Research Board (TRB) and Airport Cooperative Research Program (ACRP) webinar "Enhancing the Airport Experience with Wayfinding" on May 23, 2024. The process of navigating within airports has evolved over the years, with various technologies emerging to complement static signage. Historically, wayfinding began with static signage and airport staff members providing personal guidance, before progressing into digital signs, interactive kiosks, and displays. In recent years, wayfinding has continued along its digital path using mobile applications, indoor positioning technology, and even robot guides. With ever- larger airport facilities and a growing number of travelers, the future of wayfinding will likely be heavily linked to further digital developments such as facial recognition, augmented-reality technology, and autonomous vehicle navigation. This presentation delves into the history of interior wayfinding in airports, its present state, and the anticipated future. Key wayfinding technologies are discussed with an emphasis on emerging smartphone applications. Other considerations such as legal issues, language barriers, and human-technology interactions are included. A wayfinding framework is proposed, with static wayfinding technologies serving as the base upon which dynamic and personalized digital technologies are built. In this framework, electronic wayfinding technologies do not replace - but rather augment - traditional methods. These technologies can be integrated into existing wayfinding systems for a seamless traveler experience.

airport↗

DOE OSTI2024

The Evolution of Wayfinding Within Airports

The process of navigating within airports has evolved over the years, with various technologies emerging to complement static signage. Historically, wayfinding began with static signage and airport staff members providing personal guidance, before progressing into digital signs, interactive kiosks, and displays. In recent years, wayfinding has continued along its digital path using mobile applications, indoor positioning technology, and even robot guides. With ever- larger airport facilities and a growing number of travelers, the future of wayfinding will likely be heavily linked to further digital developments such as facial recognition, augmented-reality technology, and autonomous vehicle navigation. This report delves into the history of interior wayfinding in airports, its present state, and the anticipated future. Key wayfinding technologies are discussed in detail, with an emphasis on emerging smartphone applications. Other considerations such as traveler stress, legal issues, pandemic safety, and language barriers are included. A wayfinding framework is proposed, with static wayfinding technologies serving as the base upon which dynamic and personalized digital technologies are built. In this framework, electronic wayfinding technologies do not replace - but rather augment - traditional methods. These technologies can be integrated into existing wayfinding systems for a seamless traveler experience.

ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

Exploration ToolKit (ExTK)

The Exploration Toolkit (ExTK) is a reusable Extended Reality (XR) system developed for incorporating and exploring 3-Dimensional (3-D) computer aided design (CAD) models in XR, with a primary focus on Augmented Reality (AR). The ExTK consists of a Developer Mode and a User Mode. In Developer Mode, ExTK provides developers with the ability to easily import 3-D CAD models and activate desired exploration functionality and layout. Multiple models can be added to a single instantiation of the ExTK using Unity's Scene capability. Exploration functions include scaling, rotating, explode/contract, animations, hiding parts, submodules, and measurement functions. In User Mode, ExTK provides a menu system that allows users to select models and initiate exploration functions. ExTK is architected for reusability and developers can customize the ExTK layout and functions according to application needs. ExTK is designed to be hardware agnostic, although initial development focused on the Microsoft HoloLens as the primary deployment platform. The ExTK is developed using the Unity Game Engine Development Platform. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-1506 O

Klein, BrandonThorin↗

DOE OSTI2022

Evaluation Challenges for the Application of Extended Reality Devices in Medicine

Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices’ safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration’s public workshop, “Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine” and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Integrating extended reality with inspection systems

An extended reality (“XR”) inspection system for inspecting a target is provided. The XR inspection system includes an inspection system and an XR device. The inspection system includes an inspection main unit and an inspection probe. The inspection main unit collects inspection data from the inspection probe, receives commands input by an inspector using the XR device, performs functions associated with the commands, and sends display data to the XR device. The XR device provides an augmented reality display and sensors. The XR device displays display data received from the inspection main unit, receives commands via the sensors from the inspector, and sends the commands to the inspection main unit.

Keene, Lionel↗

DOE OSTI2025

Ultra‐Flexible Pixelated Perovskite Photodetectors Enabled by Honeycomb Polymer Grids for High‐Resolution Imaging

Abstract A nature‐inspired fabrication method based on a photolithography‐free flexible polymer grid is reported for high‐resolution pixelation of perovskite photodiode arrays with exceptional mechanical ductility and a morphology resembling that of natural compound eyes. The resulting pixelated perovskite photosensitive layer has a ≈1 µm pixel size with 2000 Pixels per inch (PPI) resolution when fully assembled as a photodetector array, delivering a detectivity of >10 13 Jones while providing cross‐talk free imaging. Using a polymer grid effectively releases stress on the perovskite platform, greatly increasing the mechanical agility of the otherwise brittle perovskite film. This novel fabrication methodology and device design offer new possibilities for applications in robotics, biomedical imaging, and virtual and augmented reality.

Zheng, Ding [Department of Chemistry and the Mater↗

DOE OSTI2024

Integration of 5G and Time Sensitive Networks in Fossil Energy Generation Systems: A Case Study

Precise timing and data transmission within stringent time constraints are critical for numerous applications, such as robotics, virtual and augmented reality, industrial automation, energy and medical business, and various other sectors. Time-sensitive networks (TSN) and fifth-generation wireless communications (5G) are crucial for industrial communications, enabling convergent communication for various services using a common network core. Applications that are time-sensitive and require deterministic communications with low latency fall into this category, such as generation plant systems. This paper presents a simulated model of 5G-TSN for a fossil power plant based on the wired network parameters implemented in situ. Metrics analysis, comparison and future work are presented. © 2024 IEEE.

01 COAL, LIGNITE, AND PEAT↗