Search NASASearch

SEARCH · Search NASA

Results for “Reality”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

An Onboard ISS Virtual Reality Trainer

Prior to the retirement of the Space Shuttle, many exterior repairs on the International Space Station (ISS) were carried out by shuttle astronauts, trained on the ground and flown to the Station to perform these specific repairs. With the retirement of the shuttle, this is no longer an available option. As such, the need for ISS crew members to review scenarios while on flight, either for tasks they already trained for on the ground or for contingency operations has become a very critical issue. NASA astronauts prepare for Extra-Vehicular Activities (EVA) or Spacewalks through numerous training media, such as: self-study, part task training, underwater training in the Neutral Buoyancy Laboratory (NBL), hands-on hardware reviews and training at the Virtual Reality Laboratory (VRLab). In many situations, the time between the last session of a training and an EVA task might be 6 to 8 months. EVA tasks are critical for a mission and as time passes the crew members may lose proficiency on previously trained tasks and their options to refresh or learn a new skill while on flight are limited to reading training materials and watching videos. In addition, there is an increased need for unplanned contingency repairs to fix problems arising as the Station ages. In order to help the ISS crew members maintain EVA proficiency or train for contingency repairs during their mission, the Johnson Space Center's VRLab designed an immersive ISS Virtual Reality Trainer (VRT). The VRT incorporates a unique optical system that makes use of the already successful Dynamic On-board Ubiquitous Graphics (DOUG) software to assist crew members with procedure reviews and contingency EVAs while on board the Station. The need to train and re-train crew members for EVAs and contingency scenarios is crucial and extremely demanding. ISS crew members are now asked to perform EVA tasks for which they have not been trained and potentially have never seen before. The Virtual Reality Trainer (VRT) provides an immersive 3D environment similar to the one experienced at the VRLab crew training facility at the NASA Johnson Space Center. VRT bridges the gap by allowing crew members to experience an interactive, 3D environment to reinforce skills already learned and to explore new work sites and repair procedures outside the Station.

Miralles, Evelyn

The NASA Augmented/Virtual Reality Lab: The State of the Art at KSC

The NASA Augmented Virtual Reality (AVR) Lab at Kennedy Space Center is dedicated to the investigation of Augmented Reality (AR) and Virtual Reality (VR) technologies, with the goal of determining potential uses of these technologies as human-computer interaction (HCI) devices in an aerospace engineering context. Begun in 2012, the AVR Lab has concentrated on commercially available AR and VR devices that are gaining in popularity and use in a number of fields such as gaming, training, and telepresence. We are working with such devices as the Microsoft Kinect, the Oculus Rift, the Leap Motion, the HTC Vive, motion capture systems, and the Microsoft Hololens. The focus of our work has been on human interaction with the virtual environment, which in turn acts as a communications bridge to remote physical devices and environments which the operator cannot or should not control or experience directly. Particularly in reference to dealing with spacecraft and the oftentimes hazardous environments they inhabit, it is our hope that AR and VR technologies can be utilized to increase human safety and mission success by physically removing humans from those hazardous environments while virtually putting them right in the middle of those environments.

Little, William

Rotational and Translational Velocity and Acceleration Thresholds for the Onset of Cybersickness in Virtual Reality

This paper determined rotational and translational velocity and acceleration thresholds for the onset of cybersickness. Cybersickness causes discomfort and discourages the widespread use of virtual reality systems for both recreational and professional use. Visual motion or optic flow is known to be one of the main causes of cybersickness due to the sensory conflict it creates with the vestibular system. The aim of this experiment is to detect rotational and translational velocity and acceleration thresholds that cause the onset of cybersickness. Participants were exposed to a moving particle field in virtual reality for a few seconds per run. The field moved in different directions (longitudinal, lateral, roll, and yaw), with different velocity profiles (steady and accelerating), and different densities. Using a staircase procedure, that controlled the speed or acceleration of the field, we detected the threshold at which participant started to feel temporary symptoms of cybersickness. The optic flow was quantified for each motion type and by modifying the number of features, the same amount of optic flow was present in each scene. Having the same optic flow in each scene allows a direct comparison of the thresholds. The results show that the velocity and acceleration thresholds for rotational optic flow were significantly lower than for translational optic flow. The thresholds suggestively decreased with the decreasing particle density of the scene. Finally, it was found that all the rotational and translational thresholds strongly correlate with each other. While the mean values of the thresholds could be used as guidelines to develop virtual reality applications, the high variability between individuals implies that the individual tuning of motion controls would be more effective to reduce cybersickness while minimizing the impact on the experience of immersion.

Terenzi, Lorenzo

Virtual Reality and Oceanography: Overview, Applications, and Perspective

With the ongoing, exponential increase in ocean data from autonomous platforms, satellites, models, and in particular, the growing field of quantitative imaging, there arises a need for scalable and cost-efficient visualization tools to interpret these large volumes of data. With the recent proliferation of consumer grade head-mounted displays, the emerging field of virtual reality (VR) has demonstrated its benefit in numerous disciplines, ranging frommedicine to archeology. However, these benefits have not received asmuch attention in the ocean sciences. Here, we summarize some of the ways that virtual reality has been applied to this field. We highlight a few examples in which we (the authors) demonstrate the utility of VR as a tool for ocean scientists. For oceanic datasets that are well-suited for three-dimensional visualization, virtual reality has the potential to enhance the practice of ocean science.

Noah L Walcutt

Training Astronauts using Hardware-in-the-Loop Simulations and Virtual Reality

The commercial market has recently started giving significant attention to virtual and augmented reality, even though the technology has been around for many years. The Virtual Reality Training Lab (VRL) at the NASA Johnson Space Center has been using virtual reality to train astronauts for decades. This paper will focus on describing three major Hardware-in-the-Loop VR simulation systems, the Simplified Aid for EVA Rescue (SAFER) system known as the "jetpack", the Mass Handling System nicknamed Charlotte, and a simulated robotics environment for collaborative mission evaluation. Two of these systems are critical for astronaut training. Crew must certify on SAFER and go through the Charlotte Mass Handling training prior to flying to the International Space Station (ISS). Typically, they also complete at least one collaborative visualization session to review any planned Extra Vehicular Activities (EVAs), or spacewalks, before an assigned flight. Given the volatility of new technologies, the graphics and simulation environments used are maintained to be hardware agnostic to preserve a high level of fidelity. Utilizing VR for astronaut training has proved to be effective and essential for these specific systems.

Angelica D. Garcia

Realizing a Spacesuit Compatible Augmented Reality System to Meet the Work Needs of Future Human Spaceflight Exploration

In this paper, we identify the broad range of challenges associated with creating an augmented reality for future spaceflight missions. The challenges were framed within a sociotechnical framework to explore how an imagined augmented reality system might one day help crew cope with future exploration mission demands. Key challenges include an augmented reality system cannot simply be designed to help a single suited astronaut and must enable the broader mission team. There exists a host of optical, compute, and control technical challenges that must be simultaneously addressed while the work domain itself is in development. There exist limited methods to help cope with the envisioned world problem; however, we emphasize a few strategies to articulate work design assumptions and host this detail in a transparent fashion. Finally, we note the broader organizational constraints that shape the creation of such novel technology for spaceflight. By addressing these broad range of challenges directly, early in the design and development process, key trade-offs can be considered and fundamental concerns within the community can be addressed to yield desired mission outcomes.

Matthew J. Miller

Lunar Surface Mixed Reality and ARGOS Trainer

This Artemis focused Mixed Reality (MR) and ARGOS project extends the current VR/ARGOS CIF project to enhance and add VR/MR capabilities to support analysis, training and risk reduction for lunar surface EVA operations in the extreme South Pole lunar environment. This third year focused on establishing a functional trainer for crew that supports the ingress/egress of a lander as well as surface tasks such as sample collection and tool deployment and operation. Completed enhancements include improving hand tracking, the addition of supporting mixed reality surface operations, and the implementation of a higher fidelity body tracking capability through a motion capture system.

Lunar

Trades, Architecture, and Design of the Joint Augmented Reality Visual Informatics (Joint AR) Product

Future expeditions will enable exploration and study of the planetary surfaces of the Moon and Mars by performing extravehicular activity (EVA) operations. Present-day International Space Station (ISS) EVA operations require an intricate and tight choreography of crew, space suits, tools, systems, and flight teams to plan, train, and execute with limited advanced informatics. Additionally, EVA operations, aside from the Apollo Lunar surface missions, have predominately focused on maintenance and construction tasks where success criteria are clearly measurable. However, future exploration missions expect to enable crew to carry out scientific objectives in increasingly Earth-independent ways. In this paper, the Joint Augmented Reality Visual Informatics System (Joint AR) characterizes the design space for developing a modular augmented reality (AR) device for a spacesuit form factor that can support crew decision-making for EVA. This paper highlights the project’s experience with a product-focused management style and use-case centered systems engineering approach to iteratively design, build, and test. The Joint AR product features were defined via trade studies and market analysis of previous EVA display efforts, various AR components such as optics, commercial AR systems, light engines, data interfaces, graphics engine software and analog test beds. We outline the defining architectural design decisions, including safety criticality considerations, suit mounting interfaces, computer architectures, and partnership contracting mechanisms. The outcomes of these studies, architecture decisions, and management requirements result in a recommended design which is the Joint AR product. We discuss the evolution, development of these system components, and what work remains. We hope to share a unified understanding of various design decisions and how they impact the future of crew members’ access to data during Lunar and Martian EVAs. This ongoing effort can enable a community-wide discovery process toward realizing necessary AR features and capabilities for future missions.

Augmented Reality

Effects of Motion Fidelity on Pilot Performance Using Mixed-Reality Visuals

This paper investigates the effects of simulator motion fidelity on pilot performance using mixed-reality visuals. In NASA’s Vertical Motion Simulator, eleven pilots flew a lift-plus-cruise electric vertical takeoff and landing vehicle in a vertiport approach and landing task with four different motion conditions: no motion, small hexapod motion, large hexapod motion, and full motion. The simulator motion condition statistically significantly affected: 1) the severity of cybersickness, 2) motion ratings, 3) final approach and take-off boundary crossing groundspeed, 4) longitudinal touchdown point, and 5) battery time remaining after landing. The findings suggest that motion systems are essential in simulators with virtual- or mixed-reality visuals when it is required to have pilot flying performance similar to that in real flight.

mixed reality

Effects of Motion Fidelity on Pilot Performance Using Mixed-Reality Visuals

This paper investigates the effects of simulator motion fidelity on pilot performance using mixed-reality visuals. In NASA’s Vertical Motion Simulator, eleven pilots flew a lift-plus-cruise electric vertical takeoff and landing vehicle in a vertiport approach and landing task under four different motion conditions: no motion, small hexapod motion, large hexapod motion, and full motion. The simulator motion condition statistically significantly affected: 1) the severity of cybersickness, 2) motion ratings, 3) final approach and take-off boundary crossing groundspeeds, 4) longitudinal touchdown point, and 5) battery time remaining after landing. These results suggest that the use of motion systems in simulators with virtual- or mixed-reality visuals is warranted.

simulation

Radsource Mr: Mixed Reality Planning Tool For Radioactive Recovery

The RadSource MR system leverages Meta Quest 3's advanced mixed reality capabilities to create a comprehensive spatial planning platform for end-of-life sealed radioactive source recovery operations. The application utilizes the Quest 3's high-resolution passthrough cameras and spatial mapping algorithms to generate accurate 3D environmental models. Core technical components include: (1) Real-time spatial measurement algorithms calculating distances, angles, slopes, and surface areas with sub-centimeter accuracy; (2) Virtual object placement system allowing users to position digital representations of recovery equipment (trailers, containment vessels, protective barriers) within the real environment; (3) Voice recording and annotation system for hands-free documentation in protective equipment; (4) 3D mesh capture and storage capabilities for post-operation analysis and regulatory documentation. (5) Procedure documentation is available for viewing in Mixed Reality, providing an innovative and convenient way to access the information during pre-visit and inspection activities. (6) Support for screen capture for the view for real world and virtual objects together to use it later for planning. The system integrates computer vision techniques for environmental understanding, spatial mathematics for precise measurements, and human-computer interaction principles optimized for hazardous environment operations. Data persistence allows teams to save and share planning sessions across multiple stakeholders while maintaining operational security requirements.

Khadka, Rajiv [Idaho National Laboratory (INL), Id

Development and application of virtual reality for man/systems integration

While the graphical presentation of computer models signified a quantum leap over presentations limited to text and numbers, it still has the problem of presenting an interface barrier between the human user and the computer model. The user must learn a command language in order to orient themselves in the model. For example, to move left from the current viewpoint of the model, they might be required to type 'LEFT' at a keyboard. This command is fairly intuitive, but if the viewpoint moves far enough that there are no visual cues overlapping with the first view, the user does not know if the viewpoint has moved inches, feet, or miles to the left, or perhaps remained in the same position, but rotated to the left. Until the user becomes quite familiar with the interface language of the computer model presentation, they will be proned to lossing their bearings frequently. Even a highly skilled user will occasionally get lost in the model. A new approach to presenting type type of information is to directly interpret the user's body motions as the input language for determining what view to present. When the user's head turns 45 degrees to the left, the viewpoint should be rotated 45 degrees to the left. Since the head moves through several intermediate angles between the original view and the final one, several intermediate views should be presented, providing the user with a sense of continuity between the original view and the final one. Since the primary way a human physically interacts with their environment should monitor the movements of the user's hands and alter objects in the virtual model in a way consistent with the way an actual object would move when manipulated using the same hand movements. Since this approach to the man-computer interface closely models the same type of interface that humans have with the physical world, this type of interface is often called virtual reality, and the model is referred to as a virtual world. The task of this summer fellowship was to set up a virtual reality system at MSFC and begin applying it to some of the questions which concern scientists and engineers involved in space flight. A brief discussion of this work is presented.

Brown, Marcus

Intelligent virtual reality in the setting of fuzzy sets

The authors have previously introduced the concept of virtual reality worlds governed by artificial intelligence. Creation of an intelligent virtual reality was further proposed as a universal interface for the handicapped. This paper extends consideration of intelligent virtual realty to a context in which fuzzy set principles are explored as a major tool for implementing theory in the domain of applications to the disabled.

Dockery, John

Fully Three-Dimensional Virtual-Reality System

Proposed virtual-reality system presents visual displays to simulate free flight in three-dimensional space. System, virtual space pod, is testbed for control and navigation schemes. Unlike most virtual-reality systems, virtual space pod would not depend for orientation on ground plane, which hinders free flight in three dimensions. Space pod provides comfortable seating, convenient controls, and dynamic virtual-space images for virtual traveler. Controls include buttons plus joysticks with six degrees of freedom.

Beckman, Brian C.

Profile analysis of after-effects experienced during exposure to several virtual reality environments

Motion sickness symptoms are an unwanted by-product of exposure to virtual environments. This problem is not new and was reported in the early flight simulators and experiments on ego motions and vection. The cardinal symptom of motion sickness is, of course, vomiting, but this symptom is ordinarily preceded by a variety of other symptoms. In his classic studies of motion sickness conducted before and during World War II, G. R. Wendt introduced a three point scale to score motion sickness beyond a vomit/no vomit dichotomy. Later, Navy scientists developed a Motion Sickness Questionnaire (MSQ), originally for use in a slowly rotating room. In the last 20 years the MSQ has been used in a series of studies of air, sea, and space sickness. Only recently, however, has it been appreciated that symptom patterns in the MSQ are not uniform but vary with the way sickness is induced. In seasickness, for example, nausea is the most prominent symptom. In Navy simulators, however, the most common symptom is eye strain, especially when cathode ray tubes are employed in the simulation. The latter result was obtained in a survey of over 1,500 pilot exposures. Using this database, Essex scientists conducted a factor analysis of the MSQ. We found that signs and symptoms of motion sickness fell mainly into three clusters: 1) oculomotor disturbance, 2) nausea and related neurovegetative problems, and 3) disorientation, ataxia, and vertigo. We have since rescored the MSQ results obtained in Navy simulators in terms of these three components. We have also compared these and other profiles obtained from three different vitual reality systems to profiles obtained in sea sickness, space sickness, and alcohol intoxication. We will show examples of these various profiles and point out simularities and differences among them which indicate aspects of what might be called 'virtual-reality sickness'.

Kennedy, Robert S.

Virtual Reality

This video presentation discusses how virtual reality enables scientists to 'explore' other worlds without leaving the laboratory. The applicability of virtual reality for scientific visualization is also discussed.

Source record

ISMCR 1994: Topical Workshop on Virtual Reality. Proceedings of the Fourth International Symposium on Measurement and Control in Robotics

This symposium on measurement and control in robotics included sessions on: (1) rendering, including tactile perception and applied virtual reality; (2) applications in simulated medical procedures and telerobotics; (3) tracking sensors in a virtual environment; (4) displays for virtual reality applications; (5) sensory feedback including a virtual environment application with partial gravity simulation; and (6) applications in education, entertainment, technical writing, and animation.

Source record

Applied virtual reality at the Research Triangle Institute

Virtual Reality (VR) is a way for humans to use computers in visualizing, manipulating and interacting with large geometric data bases. This paper describes a VR infrastructure and its application to marketing, modeling, architectural walk through, and training problems. VR integration techniques used in these applications are based on a uniform approach which promotes portability and reusability of developed modules. For each problem, a 3D object data base is created using data captured by hand or electronically. The object's realism is enhanced through either procedural or photo textures. The virtual environment is created and populated with the data base using software tools which also support interactions with and immersivity in the environment. These capabilities are augmented by other sensory channels such as voice recognition, 3D sound, and tracking. Four applications are presented: a virtual furniture showroom, virtual reality models of the North Carolina Global TransPark, a walk through the Dresden Fraunenkirche, and the maintenance training simulator for the National Guard.

Montoya, R. Jorge