SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Method for visualizing and interacting with ionizing radiation data using augmented reality. This code provides coupling radiation transport data with immersive augmented reality experiences for users in real-world environments. Moreover, it provides real-time, simulation-based, radiation exposure feedback to user as a function of behavior in the immersive environment.
The objective of Wireless Augmented Reality Prototype (WARP) effort is to develop and integrate advanced technologies for real-time personal display of information relevant to the health and safety of space station/shuttle personnel.
Decaying infrastructure maintenance cost allocation depends heavily on accurate and safe inspection in the field. New tools to conduct inspections can assist in prioritizing investments in maintenance and repairs. The industrial revolution termed as “Industry 4.0” is based on the intelligence of machines working with humans in a collaborative workspace. Contrarily, infrastructure management has relied on the human for making day-to-day decisions. New emerging technologies can assist during infrastructure inspections, to quantify structural condition with more objective data. However, today’s owners agree in trusting the inspector’s decision in the field over data collected with sensors. If data collected in the field is accessible during the inspections, the inspector decisions can be improved with sensors. New research opportunities in the human–infrastructure interface would allow researchers to improve the human awareness of their surrounding environment during inspections. This article studies the role of Augmented Reality (AR) technology as a tool to increase human awareness of infrastructure in their inspection work. The domains of interest of this research include both infrastructure inspections (emphasis on the collection of data of structures to inform management decisions) and emergency management (focus on the data collection of the environment to inform human actions). This article describes the use of a head-mounted device to access real-time data and information during their field inspection. The authors leverage the use of low-cost smart sensors and QR code scanners integrated with Augmented Reality applications for augmented human interface with the physical environment. This article presents a novel interface architecture for developing Augmented Reality–enabled inspection to assist the inspector’s workflow in conducting infrastructure inspection works with two new applications and summarizes the results from various experiments. The main contributions of this work to computer-aided community are enabling inspectors to visualize data files from database and real-time data access using an Augmented Reality environment.
Industry 4.0 represents the next evolution of industrial technology. Some of the key characteristics of Industry 4.0 include augmented reality and additive manufacturing. In support of this evolution, researchers at Oak Ridge National Lab created a prototype augmented reality (AR) interface, ASMARI. This prototype acts as a common interface for both industrial additive and subtractive machines. Additionally, in the changing industrial workspace of Industry 4.0, the role of humans will also change. This interface focuses on increasing productivity and situational awareness, while providing new interaction modalities for interacting with hardware. The prototype was also evaluated by multiple users who provided positive feedback on the system. Ultimately, the prototype represents a first step towards significant integration between augmented reality and additive manufacturing.
In this paper, we identify the broad range of challenges associated with creating an augmented reality for future spaceflight missions. The challenges were framed within a sociotechnical framework to explore how an imagined augmented reality system might one day help crew cope with future exploration mission demands. Key challenges include an augmented reality system cannot simply be designed to help a single suited astronaut and must enable the broader mission team. There exists a host of optical, compute, and control technical challenges that must be simultaneously addressed while the work domain itself is in development. There exist limited methods to help cope with the envisioned world problem; however, we emphasize a few strategies to articulate work design assumptions and host this detail in a transparent fashion. Finally, we note the broader organizational constraints that shape the creation of such novel technology for spaceflight. By addressing these broad range of challenges directly, early in the design and development process, key trade-offs can be considered and fundamental concerns within the community can be addressed to yield desired mission outcomes.
For nuclear facility decommissioning and waste cleanup, it is necessary to deploy simple and robust robots in remote sites performing precise and dexterous manipulation under teleoperation. To meet the challenge, this paper presents a new remote operation method based on augmented reality for intuitive and efficient teleoperation. The enhanced teleoperation system incorporates three technology components - 3D sensing and reconstruction, augmented reality, and teleoperation. The 3D reconstruction technology utilizes 3D cameras and constructs a 3D geometric model of the environment. Compared to the state-of-the- art technology, the presented 3D reconstruction has greater spatial precision and dynamic object tracking capability, which enhances the precision of manipulation tasks in a dynamic environment. The augmented reality technology entails generation of virtual surfaces of various geometries and dynamic characteristics, as well as consistent perceptual overlay in camera, robot and operator hand control spaces. Teleoperation is demonstrated with a dual-arm robot system operated under Robot Operating System (ROS). (authors)
Systems, devices, and methods are described for performing augmented reality (AR) to assist user performing a task in an environment. An AR device may be configured to capture real-time data. An AR engine may be configured to monitor user behavior from the real-time data responsive to feature extraction from the real-time data, compare the user behavior to pre-defined work procedures, and generate augmented reality objects to be output by the AR device.
A system and method for displaying augmented reality information for a real object. A transparent display displays the information for the real object within a field of view, such that the information and the real object are simultaneously viewable by a user. Data-gathering peripheral devices gather data of the field of view, including a camera gathering visual data for tracking the real object. An articulating arm moveably supports and facilitates repositioning the display and redirecting the data-gathering peripheral devices in a particular direction. A security interlock disables the data-gathering peripherals when the articulating arm is moved beyond a pre-established threshold, thereby preventing the data-gathering peripherals from gathering data of a real environment outside of a limit of the field of view as determined by the pre-established threshold. The security interlock may include an adjustable contact switch which adjustably defines the pre-established threshold in at least one direction.
In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.
An optical see-through, augmented reality display was used to study subjects' ability to detect aircraft maneuvering and landing at the Dallas Ft. Worth International airport in an ATC Tower simulation. Subjects monitored the traffic patterns as if from the airport's western control tower. Three binocular fields of view (14 deg, 28 deg and 47 deg) were studied in an independent groups' design to measure the degradation in detection performance associated with the visual field restrictions. In a second experiment the 14 deg and 28 deg fields were presented either with 46% binocular overlap or 100% overlap for separate groups. The near asymptotic results of the first experiment suggest that binocular fields of view much greater than 47% are unlikely to dramatically improve performance; and those of the second experiment suggest that partial binocular overlap is feasible for augmented reality displays such as may be used for ATC tower applications.
Augmented Reality is a promising technology to support safe pedestrian evacuation from buildings during earthquakes. The widespread availability of phone cameras makes this idea feasible. QR codes, for instance, can place virtual three-dimensional objects to guide people along a prescribed route. In this work, a prototypical system based on this premise was created in response to the 2020 sudden surge in seismic activity in Puerto Rico. The results point towards feasibility as well as to a series of areas that require improvement for a real-life implementation.
Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate and tight choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. Additionally, EVA operations, aside from the Apollo Lunar surface missions, have predominately focused on maintenance and construction tasks where success criteria are clearly measurable. However, future exploration missions expect to enable crew to carry out scientific objectives in increasingly Earth-independent ways. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. This paper highlights the project’s experience with a product-focused management style and use-case centered systems engineering approach to iteratively design, build, and test. The Joint AR product features were defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, graphics engine software and analog test beds. We outline the defining architectural design decisions, including safety criticality considerations, suit mounting interfaces, computer architectures, and partnership contracting mechanisms. The outcomes of these studies, architecture decisions, and management requirements result in a recommended design which is the Joint AR product. We discuss the evolution, development of these system components, and what work remains. We hope to share a unified understanding of various design decisions and how they impact the future of crew members’ access to data during Lunar and Martian EVAs. This ongoing effort can enable a community-wide discovery process toward realizing necessary AR features and capabilities for future missions.
Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) project team at NASA Johnson Space Center (JSC) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. The Joint AR product was defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, and graphics engine software. This paper outlines the defining architectural design decisions, including safety criticality considerations, interfaces, and computer architectures. The outcomes of these studies result in a prototype design which is defined here as the Joint AR product. This work aims to enable a community-wide discussion toward realizing necessary suit-compatible AR features and capabilities for future missions.
Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) project team at NASA Johnson Space Center (JSC) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. The Joint AR product was defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, and graphics engine software. This paper outlines the defining architectural design decisions, including safety criticality considerations, interfaces, and computer architectures. The outcomes of these studies result in a prototype design which is defined here as the Joint AR product. This work aims to enable a community-wide discussion toward realizing necessary suit-compatible AR features and capabilities for future missions.
This paper presents a comprehensive systematic review examining the application of augmented reality (AR) and sensor technologies for visualizing ionizing radiation in virtual training environments. The review methodology involved systematic identification and analysis of the relevant literature based on predetermined criteria including publication type, year of publication, application domain, and technological approach. The literature search encompassed publications from 2011 to 2021 across four major academic databases: Web of Science, Google Scholar, IEEE Xplore, and Scopus. Through rigorous screening following PRISMA 2020 guidelines, 23 research articles met the inclusion criteria for detailed analysis. From 404 initial database records, 360 were excluded during title/abstract screening (primarily for lacking AR components, radiation focus, or training applications) and 4 during full-text assessment (all for lacking sensor integration). The findings reveal that AR-based ionizing radiation visualization has been successfully implemented across diverse domains, including nuclear facility operations, medical procedures, CERN research activities, and educational and monitoring applications. The analysis identified multiple dimensions of impact, encompassing distinct benefits, emerging opportunities, and implementation challenges associated with AR deployment for ionizing radiation training. Each of these dimensions is comprehensively examined and documented within this review. Additionally, this study identifies critical research gaps that currently limit the full potential of AR technology in supporting ionizing radiation training programs. These gaps are systematically analyzed and discussed to establish clear directions for future research endeavors in this emerging field.
This paper introduces an innovative training system for the Renishaw AM400 metal printer, leveraging the synergy of the advanced Vision Language Model (VLM) with Augmented Reality (AR) within the Digital Twins (DT) framework. Aimed at overcoming the limitations of conventional training methods in metal additive manufacturing (AM), our system integrates AR to provide an immersive learning environment, enhancing the real-world experience with interactive digital overlays. The core of the system lies in its use of VLM, which, pre-trained on diverse datasets, excels in processing multi-modal data, thereby offering nuanced and contextually relevant guidance for trainees. Key experiments demonstrate the system’s effectiveness, particularly highlighting the usage of VLM as an Artificial Intelligence (AI) agent to integrate external tools like YOLO-v7 for valve state classification and CRAFT for control panel text recognition. This approach significantly improves recognition accuracy, operational understanding, and human–machine interaction, especially for non-expert users, making complex metal AM operations more accessible. The research not only showcases the potential of AR and VLM in industrial training but also sets a new standard for smart manufacturing practices, indicating broader applications in various industrial domains.
The project goal was to design and study engaging and effective augmented reality learning environments using wireless handheld computers equipped with global positioning system (GPS) receivers.
This project will leverage existing capabilities of an augmented reality (AR) sensorimotor assessment tool. Currently, the tool mimics the capabilities of validated 2-dimensional (2D) assessments. While this modality is well-aligned with seated interactions with flight-deck displays, extravehicular activity (EVA) tasks will require full body mobility wherein astronauts reach and bend in a 3-dimensional (3D) space. These types of motions, naturally including head movements, are known to elicit experiences of disorientation. Thus, sensorimotor assessments that include these stimulations and larger movements are important for understanding astronaut readiness prior to initial EVAs. The proposed effort will extend the current 2D eye-hand coordination task in AR to a 3D task designed to evaluate dynamic balance and eye-hand-body coordination. The new module will extend the range of motion and interaction space such that it better aligns with operational task needs for astronaut readiness evaluation.