SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A virtual reality calibration technique of matching a virtual environment of simulated graphics models in 3-D geometry and perspective with actual camera views of the remote site task environment has been developed to enable high-fidelity preview/predictive displays with calibrated graphics overlay on live video.
Augmented Reality is an emerging field in technology, and encompasses Head Mounted Displays, smartphone apps, and even projected images. HMDs include the Meta 2, Magic Leap, Avegant Light Field, and the Microsoft HoloLens, which is evaluated specifically. The Microsoft HoloLens is designed to be used as an AR personal computer, and is being optimized with that goal in mind. Microsoft allied with the Unity3D game engine to create an SDK for interested application developers that can be used in the Unity environment.
As augmented and virtual reality grows in popularity, and more researchers focus on its development, other fields of technology have grown in the hopes of integrating with the up-and-coming hardware currently on the market. Namely, there has been a focus on how to make an intuitive, hands-free human-computer interaction (HCI) utilizing AR and VR that allows users to control their technology with little to no physical interaction with hardware. Computer vision, which is utilized in devices such as the Microsoft Kinect, webcams and other similar hardware has shown potential in assisting with the development of a HCI system that requires next to no human interaction with computing hardware and software. Object and facial recognition are two subsets of computer vision, both of which can be applied to HCI systems in the fields of medicine, security, industrial development and other similar areas.
For this internship, I was a part of the multi-center NextGen STEM (Science, Technology, Engineering, and Mathematics) pilot. Specifically, I worked with the Developing Commercial Crew Program (CCP) Capabilities team that focuses on human spaceflight to the space station with NASA’s commercial partners. Composed of NASA employees and contractors (who are connected to KSC, JSC, and LaRC), they work to ensure that students will experience traditional classroom content and be immersed in emerging technologies in order to explore Commercial Crew missions and launch facilities. This group is in the process of creating educational products and resources to inspire the next generation to pursue STEM and to allow educators to have access to unique and enticing STEM activities. These products include: age-appropriate classroom lessons (including activity sheets and challenges) for kindergarten through twelfth grade; a CCP app and corresponding guide; learning experiences for students as well as educators; and virtual field trips and tours using NASA-created Virtual Reality (VR) videos and a custom VR app. My particular assignment was managing the VR equipment, developing an understanding of how to maximize the use of the equipment, creating documents that explain and convey the operations and procedures concerning the equipment (including lessons learned from equipment use), and training others to utilize the equipment effectively and correctly for conference events and group demonstrations. Over the course of this internship, I helped my team outline and learn essential procedures of operation for the VR equipment, solved technology problems that arose (due to the nature of creating unique products), and encouraged audiences at KSC and various conferences to consider using the CCP VR videos in their classrooms as an opportunity to engage and challenge the next generation to pursue STEM careers.
A virtual reality (VR) calibration technique of matching a virtual environment of simulated 3-D graphic models with actual camera views of the remote site task environment has been developed. This VR calibration enables high-fidelity preview/predictive displays with calibrated graphics overlay on live video. Reliable and accurate calibration is achieved by operator-interactive camera calibration and object localization procedures based on new linear/nonlinear least-squares algorithms that can handle multiple-camera views.
The Mars Pathfinder Project GDS Team has designed software that integrates virtual reality technology with existing JPL Navigational Ancillary Information Facilities (NAIF) and image processing capabilities. The result is an interactive, workstation-based application software that provides a high resolution 3-dimensional stereo display of Mars as if it were viewed through the lander camera. This paper describes the architecture and characteristics of this science mission planning software and discusses possible uses of this software by other planetary missions.
Within NASA's recent thrust for industrial collaboration, JPL has recently established two technology cooperation agreements in the robotics area: one on virtual reality calibration with Deneb Robotics, Inc., and the other on redundant manipulator control with Robotics Research Corporation (RRC). These technology transfer tasks will enable both Deneb and RRC to commercialize an upgraded version of their products that will greatly benefit both space and terrestrial telerobotic applications.
The objective of Wireless Augmented Reality Prototype (WARP) effort is to develop and integrate advanced technologies for real-time personal display of information relevant to the health and safety of space station/shuttle personnel.
Currently, the US Government is going through a large-scale data Transformation effort, where the GSA playbook is guiding all agencies to make their processes data-driven with the help of emerging technologies. To address concerns about algorithm sharing, AI adoption, and vendor lock-in, the NASA Langley Research Center Digital Transformation Group has developed the Environment for Data Engineering in Virtual Reality (EnDEVR), a data science ecosystem that allows users to command and investigate customizable data analyses from a VR environment. The system has been evaluated in the Oculus Rift S and Quest environments, two popular VR systems powered by the ARM architecture. Current and future development will employ several AI capabilities to guide research and automation within the environment and to facilitate algorithm sharing. In this talk, we will discuss the results of an initial ethical investigation and recommended considerations for the use of AI within the system.
This paper introduces an innovative training system for the Renishaw AM400 metal printer, leveraging the synergy of the advanced Vision Language Model (VLM) with Augmented Reality (AR) within the Digital Twins (DT) framework. Aimed at overcoming the limitations of conventional training methods in metal additive manufacturing (AM), our system integrates AR to provide an immersive learning environment, enhancing the real-world experience with interactive digital overlays. The core of the system lies in its use of VLM, which, pre-trained on diverse datasets, excels in processing multi-modal data, thereby offering nuanced and contextually relevant guidance for trainees. Key experiments demonstrate the system’s effectiveness, particularly highlighting the usage of VLM as an Artificial Intelligence (AI) agent to integrate external tools like YOLO-v7 for valve state classification and CRAFT for control panel text recognition. This approach significantly improves recognition accuracy, operational understanding, and human–machine interaction, especially for non-expert users, making complex metal AM operations more accessible. The research not only showcases the potential of AR and VLM in industrial training but also sets a new standard for smart manufacturing practices, indicating broader applications in various industrial domains.
Virtual reality (VR) can provide access to restorative environments and sensory stimulation for individuals in isolated, confined, and extreme environments. We developed a nature-based VR intervention featuring three scenes (Garden, Forest, Beach) and examined the effects of multisensory augmentation with location-based olfactory, wind, and thermal stimuli (VR+OWT). Over a two-week period, fifty-one participants were assigned to a no-intervention control, standard audiovisual VR, or augmented VR (VR+OWT) condition. Data collection included weekly assessments of affect, stress, and cognitive performance; post-VR measures of affect, presence, and perceived restorativeness; and open-ended feedback. Both VR and VR+OWT groups produced immediate and sustained reductions in negative affect with no sustained systematic benefits on cognitive performance. The addition of olfactory, wind, and thermal stimuli enhanced presence for some scenes; however, feedback indicated that sensory mismatches and stimulus intensity occasionally detracted from the experience and may have contributed to lower coherence ratings in the VR+OWT group. In contrast, the perceived restorativeness of the VR environment was driven primarily by scene content (Garden vs Forest vs Beach) rather than the level of sensory stimulation. These findings support the potential of virtual nature to promote well-being and underscore the importance of coherence across sensory modalities for multisensory augmentation.
Virtual reality (VR) systems have been proposed for use in numerous training scenarios, such as room clearing, which require the trainee to maintain spatial awareness. But many VR training systems lack a fully surrounding display, requiring trainees to use a combination of physical and virtual turns to view the environment, thus decreasing spatial awareness. One solution to this problem is to amplify head rotations, such that smaller physical turns are mapped to larger virtual turns, allowing trainees to view the surrounding environment with head movements alone. For example, in a multi-monitor system covering only a 90-degree field of regard, head rotations could be amplified four times to allow the user to see the entire 360-degree surrounding environment. This solution is attractive because it can be used with lower-cost VR systems and does not require virtual turning. However, the effects of amplified head rotations on spatial awareness and training transfer are not well understood. We hypothesized that small amounts of amplification might be tolerable, but that larger amplifications might cause trainees to become disoriented and to have decreased task performance and training transfer. In this paper, we will present our findings from an experiment designed to investigate these hypotheses. The experiment placed users in a virtual warehouse and asked them to move from room to room, counting objects placed around them in space. We varied the amount of amplification applied during these trials, and also varied the type of display used (head-mounted display or CAVE). We measured task performance and spatial awareness. We then assessed training transfer in an assessment environment with a fully surrounding display and no amplification. The results of this study will inform VR training system developers about the potential negative effects of using head rotation amplification and contribute to more effective VR training system design.
This presentation showcases digital transformation efforts carried by the Idaho National Laboratory (INL) Digital Innovation Center of Excellence (DICE). Digital Engineering technologies are described, including Model-Based Systems Engineering, Digital Thread, Digital Twins, Artificial Intelligence, and Extended Reality. Selected projects across the laboratory that have used or are currently using a digital engineering design approach are presented.
Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.
Augmented reality (AR)-based information delivery has been attracting an increasing attention in the past few years to improve com- munication in human-robot teaming. In the long-term use of AR systems for collaborative human-robot perception, one of the biggest challenges is to perform place and scene matching under long-term environmental changes, such as dramatic variations in lighting, weather and vegetation across di erent times of the day, months, and seasons. To address this challenge, we introduce a novel representation learning approach that learns a scalable long-term representation model that can be used for place and scene matching in various long-term conditions. Our approach is formulated as a regularized optimization problem, which selects the most representative scene templates in di erent scenarios to construct a scalable representation of the same place that can exhibit signi cant long-term environment changes. Our approach adaptively learns to select a small subset of the templates to construct the representation model, based on a user-de ned representativeness threshold, which makes the learned model highly scalable to the long-term variations in real-world applications. To solve the formulated optimization problem, a new algo- rithmic solver is designed, which is theoretically guaranteed to converge to the global optima. Experiments are conducted using two large-scale benchmark datasets, which have demonstrated the superior performance of our approach for long-term place and scene matching.
A high-speed, multi-slice coronary computed tomography (CT) imaging has emerged as a promising or clinically available multifunctional technique for the assessment of myocardial ischemia, viability, ischemia-induced cardiac dysfunction, and coronary atherosclerotic alterations in patients with suspected or known coronary artery disease. Despite several technical issues remain to be resolved, cardiac CT imaging will have a reality as a multifunctional modality for guiding physicians in better decision-making for favorable clinical outcomes in patients with suspected coronary artery disease, provided that this imaging technology can contribute to characterization and localization of high-risk coronary atherosclerosis in combination with the quantitative evaluation of functional myocardial ischemia.
Highlights: • More cell phone radiation is absorbed by children's inner brain tissues than adults’. • Children's radiofrequency radiation exposure should be reduced. • Further research to evaluate the risks to the eye from use of VR is urgently needed. • It is biologically relevant and feasible to reduce the standards’ averaging volume. • Current methods to determine wireless device compliance should be revised. Children's brains are more susceptible to hazardous exposures, and are thought to absorb higher doses of radiation from cell phones in some regions of the brain. Globally the numbers and applications of wireless devices are increasing rapidly, but since 1997 safety testing has relied on a large, homogenous, adult male head phantom to simulate exposures; the “Standard Anthropomorphic Mannequin” (SAM) is used to estimate only whether tissue temperature will be increased by more than 1 Celsius degree in the periphery. The present work employs anatomically based modeling currently used to set standards for surgical and medical devices, that incorporates heterogeneous characteristics of age and anatomy. Modeling of a cell phone held to the ear, or of virtual reality devices in front of the eyes, reveals that young eyes and brains absorb substantially higher local radiation doses than adults’. Age-specific simulations indicate the need to apply refined methods for regulatory compliance testing; and for public education regarding manufacturers' advice to keep phones off the body, and prudent use to limit exposures, particularly to protect the young.
Pb–Zr–Ti–O (PZT) perovskites span a large solid-solution range and have found widespread use due to their piezoelectric and ferroelectric properties that also span a large range. Crystal structure analysis via Rietveld refinement facilitates materials analysis via the extraction of the structural parameters. These parameters, often obtained as a function of an additional dimension (e.g., pressure), can help to diagnose materials response within a use environment. Often referred to as “ in-situ ” studies, these experiments provide an abundance of data. Viewing structural changes due to applied pressure conditions can give much-needed insight into materials performance. However, challenges exist for viewing/presenting results when the details are inherently three-dimensional (3D) in nature. For PZT perovskites, the use of polyhedra (e.g., Zr/Ti–O 6 octahedra) to view bonding/connectivity is beneficial; however, the visualization of the octahedra behavior with pressure dependence is less easily demonstrated due to the complexity of the added pressure dimension. We present a more intuitive visualization by projecting structural data into virtual reality (VR). We employ previously published structural data for Pb 0.99 (Zr 0.95 Ti 0.05 ) 0.98 Nb 0.02 O 3 as an exemplar for VR visualization of the PZT R3c crystal structure between ambient and 0.62 GPa pressure. This is accomplished via our in-house CAD2VR™ software platform and the new CrystalVR plugin. The use of the VR environment enables a more intuitive viewing experience, while enabling on-the-fly evaluation of crystal data, to form a detailed and comprehensive understanding of in-situ datasets. Discussion of methodology and tools for viewing are given, along with how recording results in video form can enable the viewing experience.