SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Embodiments of the present disclosure are related to training one or more of machine learning algorithms in a virtual reality environment for error detection and correction and/or for employing one or more trained machine learning models in an augmented reality environment to detect and/or correct user errors associated the performance of one or more tasks.
Explore the source record for details and available documents.
We describe a spatial augmented reality system with a tangible user interface used to control computer simulations of complex systems. In spatial augmented reality, the user’s physical space is augmented with projected imagery, blending real objects with projected information, and a tangible user interface enables users to manipulate physical objects as controllers for interactive visualizations. Our system learns ad hoc objects in the user’s environment as fiducial markers (i.e., objects that are visually recognized and tracked). When combined with simulation and visualization tools, these interfaces allow the user to control simulations or ensembles of simulations via physical objects using apt metaphors. While other research has leveraged the use of depth cameras, our system enables the use of standard cameras in readily available smartphones and webcams and has an implementation that runs completely in JavaScript in the web browser. We discuss the prerequisite object-recognition requirements for such tangible user interfaces and describe computer-vision and machine-learning algorithms meeting those requirements. We conclude by presenting example applications, which are also available online.
Emerging augmented reality tools offer great promise for helping manage nuclear infrastructure throughout its life cycle. These tools have the ability to provide operators with actionable holographic information as they work. Perhaps more excitingly these tools also feature sensors that provide the ability to document work at very high spatial resolution. These sensors include onboard cameras as well as active infrared sensors that can capture 3D geometry information on-the-fly. Coupling the visualization and sensing tools provided by augmented reality headsets with computational intelligence opens up many exciting new possibilities for managing nuclear infrastructure throughout its life cycle. In this presentation we show a number of examples of how augmented reality tools can be incorporated into the management of nuclear infrastructure. We show examples of using augmented reality as a human-machine interface for robotic control, and we show examples of augmented reality being interfaced with external sensors. Finally, we show how these sensing and visualization capabilities of augmented reality can be interfaced with intelligent algorithms to help operators perform their work in nuclear facilities. The goal of the work is to spark discussions on how emerging augmented reality tools can help enable the next generation of efficient, high-performance nuclear infrastructure. (authors)
In this work we explore the possibility of improving nuclear facility operations through the use of emerging augmented reality technology. Specifically we focus on the use of augmented reality headsets. Augmented reality opens up the possibility for easy, on-the-fly access to documentation related to canisters, rooms, and carts. It also can be used to help plan complicated material moves in ways that do not violate nuclear criticality safety regulations. Modern augmented reality technology can also be interacted with using gaze, gesture and voice commands, thus making it particularly attractive for facilitating the documentation of nuclear material operations and work verification. An augmented reality-based nuclear facility criticality safety system would have a number of benefits for operations in nuclear facilities. This work could be used across the DOE complex to ensure technicians in gloveboxes work safely and securely. It could greatly reduce downtime associated with administrative criticality incidents. It would be a step forward in the process of improving the quality of documentation of the work that occurs in nuclear facilities while simultaneously increasing the ease with which this documentation can be collected. The augmented reality effectively endows the glovebox technicians with a sense for administrative nuclear criticality safety and the reactivity changes caused directly by their actions. Augmented reality also has great potential for facilitating inspections of nuclear infrastructure. Examples of Augmented Reality applications that facilitate infrastructure inspection and work verification will also be presented. (authors)
Abstract not provided.
This paper presents a new approach to applications of augmented reality techniques for performing telerobotic operations in uncertain and hazardous environments. Particular application examples include remote or partially-automated operation of robotic manipulators in nuclear waste facilities, decommissioning sites, or as a part of incident remediation. Recently advances in virtual reality (VR) and augmented reality (AR) technology presents opportunity for enhancing the performance of such remote operations. VR can provide immersive artificial environment for the operator to interact with. As an advanced concept, AR adds to it the blending or artificial contents with real world - users are able to interact with virtual contents in the real world. This work addresses key technological innovations necessary for adopting the VR/AR technologies for the remote operation of hardware robotic systems in real world tasks. To this end, this work focuses on implementation of 'virtual fixtures', which allows intuitive and precise guidance of remote operation, as well as key enhancements in 3D sensing/reconstruction technology. In addition, the implementation details of the integration of the multi-modal augmented reality system to the telerobotic control system are presented. (authors)
This work presents a novel, comprehensive framework that leverages emerging augmented reality headset technology to enable smart nuclear industrial infrastructure that a human can easily interact with to improve their performance in terms of safety, security, and productivity. Nuclear industrial operations require some of the most complicated infrastructure that must be managed today. Nuclear infrastructure and their associated industrial operations typically features stringent requirements associated with seismic, personnel management (e.g., access control, equipment access), safety (e.g., radiation, criticality, mechanical, electrical, spark, and chemical hazards), security (cyber/physical), and sometimes international treaties for nuclear non-proliferation. Furthermore, a wide variety of manufacturing and maintenance operations take place within these facilities further complicating their management. Nuclear facilities require very thorough and stringent documentation of the operations occurring within these facilities as well as maintaining a tight chain-of-custody for the materials being stored within the facility. The emergence of augmented reality and a variety of Internet of Things (IoT) devices offers a possible solution to help mitigate these challenges. This work provides a demonstration of a prototype smart nuclear infrastructure system that leverages augmented reality to illustrate the advantages of this system. It will also present example augmented reality tools that can be leveraged to create the next generation of smart nuclear infrastructure. The discussion will layout future directions of research for this class of work.
Method for visualizing and interacting with ionizing radiation data using augmented reality. This code provides coupling radiation transport data with immersive augmented reality experiences for users in real-world environments. Moreover, it provides real-time, simulation-based, radiation exposure feedback to user as a function of behavior in the immersive environment.
Decaying infrastructure maintenance cost allocation depends heavily on accurate and safe inspection in the field. New tools to conduct inspections can assist in prioritizing investments in maintenance and repairs. The industrial revolution termed as “Industry 4.0” is based on the intelligence of machines working with humans in a collaborative workspace. Contrarily, infrastructure management has relied on the human for making day-to-day decisions. New emerging technologies can assist during infrastructure inspections, to quantify structural condition with more objective data. However, today’s owners agree in trusting the inspector’s decision in the field over data collected with sensors. If data collected in the field is accessible during the inspections, the inspector decisions can be improved with sensors. New research opportunities in the human–infrastructure interface would allow researchers to improve the human awareness of their surrounding environment during inspections. This article studies the role of Augmented Reality (AR) technology as a tool to increase human awareness of infrastructure in their inspection work. The domains of interest of this research include both infrastructure inspections (emphasis on the collection of data of structures to inform management decisions) and emergency management (focus on the data collection of the environment to inform human actions). This article describes the use of a head-mounted device to access real-time data and information during their field inspection. The authors leverage the use of low-cost smart sensors and QR code scanners integrated with Augmented Reality applications for augmented human interface with the physical environment. This article presents a novel interface architecture for developing Augmented Reality–enabled inspection to assist the inspector’s workflow in conducting infrastructure inspection works with two new applications and summarizes the results from various experiments. The main contributions of this work to computer-aided community are enabling inspectors to visualize data files from database and real-time data access using an Augmented Reality environment.
Industry 4.0 represents the next evolution of industrial technology. Some of the key characteristics of Industry 4.0 include augmented reality and additive manufacturing. In support of this evolution, researchers at Oak Ridge National Lab created a prototype augmented reality (AR) interface, ASMARI. This prototype acts as a common interface for both industrial additive and subtractive machines. Additionally, in the changing industrial workspace of Industry 4.0, the role of humans will also change. This interface focuses on increasing productivity and situational awareness, while providing new interaction modalities for interacting with hardware. The prototype was also evaluated by multiple users who provided positive feedback on the system. Ultimately, the prototype represents a first step towards significant integration between augmented reality and additive manufacturing.
For nuclear facility decommissioning and waste cleanup, it is necessary to deploy simple and robust robots in remote sites performing precise and dexterous manipulation under teleoperation. To meet the challenge, this paper presents a new remote operation method based on augmented reality for intuitive and efficient teleoperation. The enhanced teleoperation system incorporates three technology components - 3D sensing and reconstruction, augmented reality, and teleoperation. The 3D reconstruction technology utilizes 3D cameras and constructs a 3D geometric model of the environment. Compared to the state-of-the- art technology, the presented 3D reconstruction has greater spatial precision and dynamic object tracking capability, which enhances the precision of manipulation tasks in a dynamic environment. The augmented reality technology entails generation of virtual surfaces of various geometries and dynamic characteristics, as well as consistent perceptual overlay in camera, robot and operator hand control spaces. Teleoperation is demonstrated with a dual-arm robot system operated under Robot Operating System (ROS). (authors)
Systems, devices, and methods are described for performing augmented reality (AR) to assist user performing a task in an environment. An AR device may be configured to capture real-time data. An AR engine may be configured to monitor user behavior from the real-time data responsive to feature extraction from the real-time data, compare the user behavior to pre-defined work procedures, and generate augmented reality objects to be output by the AR device.
A system and method for displaying augmented reality information for a real object. A transparent display displays the information for the real object within a field of view, such that the information and the real object are simultaneously viewable by a user. Data-gathering peripheral devices gather data of the field of view, including a camera gathering visual data for tracking the real object. An articulating arm moveably supports and facilitates repositioning the display and redirecting the data-gathering peripheral devices in a particular direction. A security interlock disables the data-gathering peripherals when the articulating arm is moved beyond a pre-established threshold, thereby preventing the data-gathering peripherals from gathering data of a real environment outside of a limit of the field of view as determined by the pre-established threshold. The security interlock may include an adjustable contact switch which adjustably defines the pre-established threshold in at least one direction.
In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.
Augmented Reality is a promising technology to support safe pedestrian evacuation from buildings during earthquakes. The widespread availability of phone cameras makes this idea feasible. QR codes, for instance, can place virtual three-dimensional objects to guide people along a prescribed route. In this work, a prototypical system based on this premise was created in response to the 2020 sudden surge in seismic activity in Puerto Rico. The results point towards feasibility as well as to a series of areas that require improvement for a real-life implementation.
This paper presents a comprehensive systematic review examining the application of augmented reality (AR) and sensor technologies for visualizing ionizing radiation in virtual training environments. The review methodology involved systematic identification and analysis of the relevant literature based on predetermined criteria including publication type, year of publication, application domain, and technological approach. The literature search encompassed publications from 2011 to 2021 across four major academic databases: Web of Science, Google Scholar, IEEE Xplore, and Scopus. Through rigorous screening following PRISMA 2020 guidelines, 23 research articles met the inclusion criteria for detailed analysis. From 404 initial database records, 360 were excluded during title/abstract screening (primarily for lacking AR components, radiation focus, or training applications) and 4 during full-text assessment (all for lacking sensor integration). The findings reveal that AR-based ionizing radiation visualization has been successfully implemented across diverse domains, including nuclear facility operations, medical procedures, CERN research activities, and educational and monitoring applications. The analysis identified multiple dimensions of impact, encompassing distinct benefits, emerging opportunities, and implementation challenges associated with AR deployment for ionizing radiation training. Each of these dimensions is comprehensively examined and documented within this review. Additionally, this study identifies critical research gaps that currently limit the full potential of AR technology in supporting ionizing radiation training programs. These gaps are systematically analyzed and discussed to establish clear directions for future research endeavors in this emerging field.
Visualizing 3D molecular structures is crucial to understanding and predicting their chemical behavior. However, static 2D hand-drawn skeletal structures remain the preferred method of chemical communication. Here, we combine cutting-edge technologies in augmented reality (AR), machine learning, and computational chemistry to develop MolAR, an open-source mobile application for visualizing molecules in AR directly from their hand-drawn chemical structures. Users can also visualize any molecule or protein directly from its name or protein data bank ID and compute chemical properties in real time via quantum chemistry cloud computing. MolAR provides an easily accessible platform for the scientific community to visualize and interact with 3D molecular structures in an immersive and engaging way.