Results for “Virtual Reality” — Page 12

NASA NTRS1991

Simulation of extra-vehicular activity (EVA) self-rescue

Self-rescue during EVA is examined in terms of the use of a hand-held thruster that is similar to the hand-held maneuvering units HHMU developed for earlier programs. The problem of assessing velocity-increment requirements is addressed by means of examples of simulation technologies for studying EVA. The technologies evaluated include virtual reality systems such as the Virtual Interactive Environment Workstation (VIEW) and the Space Operations Simulator, and standard approaches like the air-bearing floor and the space shuttle. The VIEW is employed for a study of five trained NASA subjects that conduct a simulated return to a spacecraft with an HMMU under variable conditions. The study demonstrates the efficacy of VIEW for obtaining fuel-consumption values, and separation velocity is identified as the most significant determinant of the fuel and time requirements for a self-rescue operation.

Brody, Adam R.↗

NASA NTRS1994

Tele Hyper Virtuality

In the future, remote images sent over communication lines will be reproduced in virtual reality (VR). This form of virtual telecommunications, which will allow observers to engage in an activity as though it were real, is the focus of considerable attention. Taken a step further, real and unreal objects will be placed in a single space to create an extremely realistic environment. Here, imaginary and other life forms as well as people and animals in remote locations will gather via telecommunication lines that create a common environment where life forms can work and interact together. Words, gestures, diagrams and other forms of communication will be used freely in performing work. Actual construction of a system based on this new concept will not only provide people with experiences that would have been impossible in the past, but will also inspire new applications in which people will function in environments where it would have been difficult if not impossible for them to function until now. This paper describes Tele Hyper Virtuality concept, its definition, applications, the key technologies to accomplish it and future prospects.

Terashima, Nobuyoshi↗

NASA NTRS2008

Venus Quadrangle Geological Mapping: Use of Geoscience Data Visualization Systems in Mapping and Training

We are currently investigating new technological developments in computer visualization and analysis in order to assess their importance and utility in planetary geological analysis and mapping [1,2]. Last year we reported on the range of technologies available and on our application of these to various problems in planetary mapping [3]. In this contribution we focus on the application of these techniques and tools to Venus geological mapping at the 1:5M quadrangle scale. In our current Venus mapping projects we have utilized and tested the various platforms to understand their capabilities and assess their usefulness in defining units, establishing stratigraphic relationships, mapping structures, reaching consensus on interpretations and producing map products. We are specifically assessing how computer visualization display qualities (e.g., level of immersion, stereoscopic vs. monoscopic viewing, field of view, large vs. small display size, etc.) influence performance on scientific analysis and geological mapping. We have been exploring four different environments: 1) conventional desktops (DT), 2) semi-immersive Fishtank VR (FT) (i.e., a conventional desktop with head-tracked stereo and 6DOF input), 3) tiled wall displays (TW), and 4) fully immersive virtual reality (IVR) (e.g., "Cave Automatic Virtual Environment," or Cave system). Formal studies demonstrate that fully immersive Cave environments are superior to desktop systems for many tasks [e.g., 4].

Head, James W.↗

NASA NTRS2017

Incorporating Speech Recognition into a Natural User Interface

The Augmented/ Virtual Reality (AVR) Lab has been working to study the applicability of recent virtual and augmented reality hardware and software to KSC operations. This includes the Oculus Rift, HTC Vive, Microsoft HoloLens, and Unity game engine. My project in this lab is to integrate voice recognition and voice commands into an easy to modify system that can be added to an existing portion of a Natural User Interface (NUI). A NUI is an intuitive and simple to use interface incorporating visual, touch, and speech recognition. The inclusion of speech recognition capability will allow users to perform actions or make inquiries using only their voice. The simplicity of needing only to speak to control an on-screen object or enact some digital action means that any user can quickly become accustomed to using this system. Multiple programs were tested for use in a speech command and recognition system. Sphinx4 translates speech to text using a Hidden Markov Model (HMM) based Language Model, an Acoustic Model, and a word Dictionary running on Java. PocketSphinx had similar functionality to Sphinx4 but instead ran on C. However, neither of these programs were ideal as building a Java or C wrapper slowed performance. The most ideal speech recognition system tested was the Unity Engine Grammar Recognizer. A Context Free Grammar (CFG) structure is written in an XML file to specify the structure of phrases and words that will be recognized by Unity Grammar Recognizer. Using Speech Recognition Grammar Specification (SRGS) 1.0 makes modifying the recognized combinations of words and phrases very simple and quick to do. With SRGS 1.0, semantic information can also be added to the XML file, which allows for even more control over how spoken words and phrases are interpreted by Unity. Additionally, using a CFG with SRGS 1.0 produces a Finite State Machine (FSM) functionality limiting the potential for incorrectly heard words or phrases. The purpose of my project was to investigate options for a Speech Recognition System. To that end I attempted to integrate Sphinx4 into a user interface. Sphinx4 had great accuracy and is the only free program able to perform offline speech dictation. However it had a limited dictionary of words that could be recognized, single syllable words were almost impossible for it to hear, and since it ran on Java it could not be integrated into the Unity based NUI. PocketSphinx ran much faster than Sphinx4 which would've made it ideal as a plugin to the Unity NUI, unfortunately creating a C# wrapper for the C code made the program unusable with Unity due to the wrapper slowing code execution and class files becoming unreachable. Unity Grammar Recognizer is the ideal speech recognition interface, it is flexible in recognizing multiple variations of the same command. It is also the most accurate program in recognizing speech due to using an XML grammar to specify speech structure instead of relying solely on a Dictionary and Language model. The Unity Grammar Recognizer will be used with the NUI for these reasons as well as being written in C# which further simplifies the incorporation.

Chapa, Nicholas↗

NASA NTRS2006

Towards Determination of Visual Requirements for Augmented Reality Displays and Virtual Environments for the Airport Tower

The visual requirements for augmented reality or virtual environments displays that might be used in real or virtual towers are reviewed wi th respect to similar displays already used in aircraft. As an example of the type of human performance studies needed to determine the use ful specifications of augmented reality displays, an optical see-thro ugh display was used in an ATC Tower simulation. Three different binocular fields of view (14 deg, 28 deg, and 47 deg) were examined to det ermine their effect on subjects# ability to detect aircraft maneuveri ng and landing. The results suggest that binocular fields of view much greater than 47 deg are unlikely to dramatically improve search perf ormance and that partial binocular overlap is a feasible display tech nique for augmented reality Tower applications.

NATO FURNISHED↗

NASA NTRS2020

Virtual and Augmented Reality Applications in Science and Engineering

The articles in this special section focus on virtual and augmented reality applications in science and engineering. There has been an explosive growth in visually augmenting the spaces around us by creating environments where visual, aural, and kinesthetic immersive experiences afforded by virtual and augmented reality (AR) powerfully engage us in a way no other medium can. Virtual reality (VR) recreates the sensory world around us entirely through computer-generated signals of sight, sound, touch (and in some cases smell and taste). AR overlays the computer-generated sensory signals on the real world allowing the user to experience a rich juxtaposition of the virtual and the real worlds simultaneously. Together, these technologies are transforming the way people from all walks of life—scientists, engineers, educators, industrial workers, health care professionals, artists, and everyday people— see and use the information that matters most to them, in an intuitive embodied way. Just as mobile technology has revolutionized how we communicate with each other and with our digital worlds, ubiquitous VR and AR will fundamentally alter how our society creates, inspires, engages, and learns from the information-rich and enriched cyberspaces around us. While affordable consumer- quality VR and AR hardware is becoming available, significant work is needed to adopt VR and AR for important and difficult scientific and societal applications.

Virtual Reality, Augmented Reality↗

NASA NTRS2020

Lunar South Pole VR Lunar Lighting Simulation

Virtual Reality (VR) simulation of the Lunar South Pole lighting conditions from December 1, 2022 to December 31, 2022

Virtual Reality↗

NASA NTRS2021

EnDEVR: An Environment for Data Engineering in VR

Organizations within the public and private sectors are looking to improve their data science operations for research, development, and operational purposes. As this interest in data science grows, so too does interest in tools and programs that facilitating such operations. This paper presents EnDEVR, the Environment for Data Engineering in Virtual Reality, a user-extensible system that allows for the execution of custom data science functions. We describe the user-centered design process for the EnDEVR system, based on the needs of subject matter experts within the aerospace and aviation industries. Fundamental to this design is a method for users to integrate their existing analysis code (that may leverage third-party vendors) as usable objects in the virtual environment; this allows organizations to operate without the price tag and lifetime obligations associated with commercial data science toolkits, a concept known as “vendor lock-in”. We then present our system design with iterative implementations, and conclude with lessons learned. The presented work may provide insight into future user-centered design processes for VR applications, particularly for digital transformation stakeholders to circumvent vendor lock-in.

Human-centered computing↗

NASA NTRSDate not supplied

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

NASA NTRSDate not supplied

Equitable and Inclusive Public Outreach with the James Webb Space Telescope: Combining Art, Science, and Technology

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

NASA NTRS2024

Expanding Impact with the James Webb Space Telescope: Combining Art, Science, and Technology for Public Outreach

This archived content may contain outdated information or references that may not reflect current policy or programs. NASA’s James Webb Space Telescope revealed its first images on July 12, 2022 and has been used for groundbreaking science since. Scientific exploration transcends international borders, making a mission like Webb feasible with collaborators including the European Space Agency (ESA), and Canadian Space Agency (CSA). Communication about NASA’s discoveries about the universe, so essential for involving the public, likewise needs to be inclusive to all. Art is a tool for cutting across the boundaries of language, culture, and ability, and serves as a bridge between the technical and non-technical communities. Art makes the beauty and nuance of science and engineering accessible in ways that may not be readily perceived to those outside of those communities of practice. Equitable and inclusive outreach endeavors are challenging to implement while considering language translations, culture context, sensory methods, and technology capabilities. Formats including “Unfolding the Universe'' virtual reality platform has allowed for a wider audience to interact with the Webb images including sounds, visual aids, and talks by the scientists and engineers who worked on Webb. This VR platform has been expanded to highlight the ESA contributors to the mission and will be showcased internationally. The Webb first images were also translated into sounds as a method of inclusion for anyone with sight disabilities. We will explore some successful outreach methods and suggestions for inclusivity in future.

Outreach↗

DOE OSTI2026

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

Molten-salt reactors (MSRs) represent a promising solution for next-generation nuclear energy, offering advantages in safety, fuel efficiency, and waste minimization. However, their liquid-fueled design presents unique challenges for spent fuel management, making post-shutdown waste characterization essential for developing effective strategies. Despite this need, there is a notable absence of visualization platforms specifically tailored to the unique characteristics and analytical requirements of MSR waste management. Existing tools in the nuclear industry are primarily designed for reactor operations or generic data exploration and lack both integration with MSR-specific multiphysics frameworks and the ability to simultaneously visualize time-dependent thermal fields, chemical composition evolution, and radiation distribution patterns. To address these limitations, this paper presents an immersive virtual reality (VR) visualization platform that processes and displays high-fidelity multiphysics simulation output from the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework in real-time, using Unity. The platform visualizes MSR waste characteristics such as nuclide decay, salt cooling, and corrosion by using Exodus II output data and running on a VR headset. It includes a user-friendly interface with features such as visibility toggling, cross-sectional slicing, and time-series animation for exploring simulation data. These capabilities support experimental design, stakeholder engagement, and public communication by making complex reactor behavior more accessible and understandable. By enhancing spatial reasoning and reducing cognitive load, this immersive environment fosters more effective communication and decision-making in MSR waste management.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2026

Integrating Immersive Visualization in Molten-Salt Reactor Waste Management for Experimental Design and Planning

The Molten Salt Reactor (MSR) represents a significant innovation in nuclear technology, offering several operational and safety benefits over traditional solid-fuel reactors. However, MSRs face uncertainties in waste management due to their flexible designs and variable waste compositions. To address these challenges, we propose a visualization platform that illustrates solutions and performance predictions for various waste management strategies, enhancing user experience and improving strategy and communication. Immersive visualizations are widely used in the nuclear industry for training, simulation, and safety enhancement. Our project aims to develop a visualization platform incorporating virtual reality (VR) technologies to illustrate MSR characteristics immediately following reactor shutdown. This immersive simulation will allow users to interact, explore, and understand different waste management strategies. The platform will display MSR reactor characterizations, including nuclide decay, salt solidification, and corrosion, which are crucial for assessing and selecting backend management strategies. Using the Meta Quest 3 VR headset with Unity software, our platform will provide real-scale visualizations, enabling users to experience and evaluate designs and plans as if they were physically present. This user-friendly interface will make complex data accessible and understandable for non-domain experts, aiding in decision-making for MSR waste management. Our proposed visualization workflow can be applied to other nuclear reactors, assisting in the design and planning of waste management strategies.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRSDate not supplied

Artemis Lunar Surface VR/ARGOS Trainer

This proposal aims to provide insight by identifying potential risks and unknowns of lander egress and surface operations through a Mixed Reality (MR) planning, training, and analysis capability that integrates Virtual Reality (VR) simulations and the Active Response Gravity Offload System (ARGOS) in support of Artemis missions to the moon. The VR simulation will incorporate lunar digital elevation map data and imagery to provide accurate terrain of the south pole and Shackleton Crater. Date specific ephemerides will used to simulate the extreme lighting environment. Virtual representations of a lunar lander vehicle will be represented with a physical mockup of the porch and ladder assembly. Human-in-the-loop engineering test runs within ARGOS will be used to refine performance of the Mixed Reality interface with the mockup platform and define procedures for training.

Lee K Bingham↗

NASA NTRS2007

Constraint, Intelligence, and Control Hierarchy in Virtual Environments

This paper seeks to deal directly with the question of what makes virtual actors and objects that are experienced in virtual environments seem real. (The term virtual reality, while more common in public usage, is an oxymoron; therefore virtual environment is the preferred term in this paper). Reality is difficult topic, treated for centuries in those sub-fields of philosophy called ontology- "of or relating to being or existence" and epistemology- "the study of the method and grounds of knowledge, especially with reference to its limits and validity" (both from Webster s, 1965). Advances in recent decades in the technologies of computers, sensors and graphics software have permitted human users to feel present or experience immersion in computer-generated virtual environments. This has motivated a keen interest in probing this phenomenon of presence and immersion not only philosophically but also psychologically and physiologically in terms of the parameters of the senses and sensory stimulation that correlate with the experience (Ellis, 1991). The pages of the journal Presence: Teleoperators and Virtual Environments have seen much discussion of what makes virtual environments seem real (see, e.g., Slater, 1999; Slater et al. 1994; Sheridan, 1992, 2000). Stephen Ellis, when organizing the meeting that motivated this paper, suggested to invited authors that "We may adopt as an organizing principle for the meeting that the genesis of apparently intelligent interaction arises from an upwelling of constraints determined by a hierarchy of lower levels of behavioral interaction. "My first reaction was "huh?" and my second was "yeah, that seems to make sense." Accordingly the paper seeks to explain from the author s viewpoint, why Ellis s hypothesis makes sense. What is the connection of "presence" or "immersion" of an observer in a virtual environment, to "constraints" and what types of constraints. What of "intelligent interaction," and is it the intelligence of the observer or the intelligence of the environment (whatever the latter may mean) that is salient? And finally, what might be relevant about "upwelling" of constraints as determined by a hierarchy of levels of interaction?

Sheridan, Thomas B.↗

NASA NTRS1991

Real-time, interactive, visually updated simulator system for telepresence

Time delays and limited sensory feedback of remote telerobotic systems tend to disorient teleoperators and dramatically decrease the operator's performance. To remove the effects of time delays, key components were designed and developed of a prototype forward simulation subsystem, the Global-Local Environment Telerobotic Simulator (GLETS) that buffers the operator from the remote task. GLETS totally immerses an operator in a real-time, interactive, simulated, visually updated artificial environment of the remote telerobotic site. Using GLETS, the operator will, in effect, enter into a telerobotic virtual reality and can easily form a gestalt of the virtual 'local site' that matches the operator's normal interactions with the remote site. In addition to use in space based telerobotics, GLETS, due to its extendable architecture, can also be used in other teleoperational environments such as toxic material handling, construction, and undersea exploration.

Schebor, Frederick S.↗

NASA NTRS1995

Helmet-Mounted Display Research Capabilities of the NASA/Army Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL)

The Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) is a UH-60A Black Hawk helicopter that is being modified by the US Army and NASA for flight systems research. The principal systems that are being installed in the aircraft are a Helmet Mounted Display (HMD) and imaging system, and a programmable full authority Research Flight Control System (RFCS). In addition, comprehensive instrumentation of both the rigid body of the helicopter and the rotor system is provided. The paper will describe the capabilities of these systems and their current state of development. A brief description of initial research applications is included. The wide (40 X 60 degree) field-of-view HMD system has been provided by Kaiser Electronics. It can be configured as a monochromatic system for use in bright daylight conditions, a two color system for darker ambients, or a full color system for use in night viewing conditions. Color imagery is achieved using field sequential video and a mechanical color wheel. In addition to the color symbology, high resolution computer-gene rated imagery from an onboard Silicon Graphics Reality Engine Onyx processor is available for research in virtual reality applications. This synthetic imagery can also be merged with real world video from a variety of imaging systems that can be installed easily on the front of the helicopter. These sensors include infrared or tv cameras, or potentially small millimeter wave radars. The Research Flight Control System is being developed for the aircraft by a team of contractors led by Boeing Helicopters. It consists of a full authority high bandwidth fly-by-wire actuators that drive the main rotor swashplate actuators and the tail rotor actuator in parallel. This arrangement allows the basic mechanical flight control system of the Black Hawk to be retained so that the safety pilot can monitor the operation of the system through the action of his own controls. The evaluation pilot will signal the fly-by-wire actuators through the flight computer from electrical sidearm controllers located in the right hand cockpit. The system will have very substantial input/output capacity and impressive computational power. These systems are installed in the aircraft using predominantly a MIL-STD 1553B data bus architecture. Sensor data from the RFCS, the basic aircraft and rotor system instrumentation including navigation information, and the HMD system are easily exchanged among user systems, or are available at the systems operator station located in the cabin for real time monitoring or data recording.

Jacobsen, R. A.↗

NASA NTRS2021

Lunar Surface VR/ARGOS Trainer

This proposal aims to provide insight by identifying potential risks and unknowns of lander egress and surface operations through a Mixed Reality (MR) planning, training, and analysis capability that integrates Virtual Reality (VR) simulations and the Active Response Gravity Offload System (ARGOS).

Lee K Bingham↗