SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A viewgraph presentation describing maintenance procedures for head mounted displays is shown. The topics include: 1) Study Goals; 2) Near Eye Displays (HMDs); 3) Design; 4) Phase I-Evaluation Methods; 5) Phase 1 Results; 6) Improved HMD Mounting; 7) Phase 2 -Evaluation Methods; 8) Phase 2 Preliminary Results; and 9) Next Steps.
The problems associated with assessing visual performance during translation and rotation in a virtual world are presented. Two studies are summarized that highlight the difficulties in defining and measuring the optical and visual variables that pilots use during the control of a craft in simulated flight. The analysis suggests that gaze line-of-sight (LOS), based on craft orientation, should be used to describe the visual information available to an observer. Head-mounted displays that utilize a headtracker provide a technology that can be used for determining an observer's LOS and generating a virtual world display. Such head-mounted displays put observers in a graphical world that exists no matter where they look.
The present invention includes a head mounted display (HMD) worn by a user. The HMD includes a display projecting an image through an optical lens. The HMD also includes a one-dimensional retro reflective array receiving the image through the optical lens at a first angle with respect to the display and deflecting the image at a second angle different than the first angle with respect to the display. The one-dimensional retro reflective array reflects the image in order to project the image onto an eye of the user.
This presentation discusses research needs to support evidence-based qualification standards for Flight Simulation Training Devices (FSTDs) with head mounted displays (HMDs). Currently, the FAA and EASA have no qualification standards specifically for FSTDs using HMDs and extended reality (XR) visuals, and existing qualification standards may not be sufficient. Special Conditions can be prescribed for the evaluation and qualification of individual devices, but these Special Conditions need to be assessed and adjusted on a case-by-case basis resulting in an elaborate process. Furthermore, test tolerances used in Special Conditions are often based on conventional visual systems and may not be adequate. This presentation first identifies gaps in the current knowledge of using HMDs in pilot training, and, more specifically, using HMDs in the training of manual aircraft control with motion cues. Next, research is proposed to help close these gaps, inform the development of qualification criteria and tolerances, and guide efforts to update regulations. The Vertical Motion Simulator (VMS) at NASA Ames Research Center, with its large motion capability, is currently undergoing significant upgrades including a state-of-the-art out-the-window visual system. In addition, an HMD capability will be introduced to use in conjunction with the conventional visual system. With its long history of setting standards in the simulation industry, the VMS is the ultimate tool to conduct research that could help accelerate the development of standards for the use of HMDs in FSTDs. The goal of the talk is ultimately to spark a discussion about the research needs and priorities to best serve the development of new qualification standards.
Augmented Reality (AR) is a technique by which computer generated signals synthesize impressions that are made to coexist with the surrounding real world as perceived by the user. Human smell, taste, touch and hearing can all be augmented, but most commonly AR refers to the human vision being overlaid with information otherwise not readily available to the user. A correct calibration is important on an application level, ensuring that e.g. data labels are presented at correct locations, but also on a system level to enable display techniques such as stereoscopy to function properly [SOURCE]. Thus, vital to AR, calibration methodology is an important research area. While great achievements already have been made, there are some properties in current calibration methods for augmenting vision which do not translate from its traditional use in automated cameras calibration to its use with a human operator. This paper uses a Monte Carlo simulation of a standard direct linear transformation camera calibration to investigate how user introduced head orientation noise affects the parameter estimation during a calibration procedure of an optical see-through head mounted display.
Virtual Environments (aka Virtual Reality) is again catching the public imagination and a number of startups (e.g. Oculus) and even not-so-startup companies (e.g. Microsoft) are trying to develop display systems to capitalize on this renewed interest. All acknowledge that this time they will get it right by providing the required dynamic fidelity, visual quality, and interesting content for the concept of VR to take off and change the world in ways it failed to do so in past incarnations. Some of the surprisingly long historical background of the technology that the form of direct simulation that underlies virtual environment and augmented reality displays will be briefly reviewed. An example of a mid 1990's augmented reality display system with good dynamic performance from our lab will be used to illustrate some of the underlying phenomena and technology concerning visual stability of virtual environments and objects during movement. In conclusion some idealized performance characteristics for a reference system will be proposed. Interestingly, many systems more or less on the market now may actually meet many of these proposed technical requirements. This observation leads to the conclusion that the current success of the IT firms trying to commercialize the technology will depend on the hidden costs of using the systems as well as the development of interesting and compelling content.
Design image-optimization for helmet-mounted displays (HMDs) for military systems is presently discussed within the framework of a systems-engineering approach that encompasses (1) a description of natural targets in the field; (2) the characteristics of human visual perception; and (3) device specifications that directly relate to these ecological and human-factors parameters. Attention is given to target size and contrast and the relationship of the modulation transfer function to image resolution.
We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.
We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.
In virtual environment (VE) applications, where virtual objects are presented in a see-through head-mounted display, virtual images must be continuously stabilized in space in response to user's head motion. Time delays in head-motion compensation cause virtual objects to "swim" around instead of being stable in space which results in misalignment errors when overlaying virtual and real objects. Visual update delays are a critical technical obstacle for implementing head-mounted displays in applications such as battlefield simulation/training, telerobotics, and telemedicine. Head motion is currently measurable by a head-mounted 6-degrees-of-freedom inertial measurement unit. However, even given this information, overall VE-system latencies cannot be reduced under about 25 ms. We present a novel approach to eliminating latencies, which is premised on the fact that myoelectric signals from a muscle precede its exertion of force, thereby limb or head acceleration. We thus suggest utilizing neck-muscles' myoelectric signals to anticipate head motion. We trained a neural network to map such signals onto equivalent time-advanced inertial outputs. The resulting network can achieve time advances of up to 70 ms.
While virtual environment systems are typically thought to consist of a head mounted display and a flex-sensing glove, alternative peripheral devices are beginning to be developed in response to application requirements. Three such alternatives are discussed: fingertip sensing gloves, fixed stereoscopic viewers, and counterbalanced head mounted displays. A subset of commercial examples that highlight each alternative is presented as well as a brief discussion of interesting engineering and implementation issues.
Over the last several decades, designers have used digital screens to view images of real and simulated spaces and make critical design decisions. Screen technology has improved during this time, as technologies like OLED have replaced legacy displays (CRT, plasma, and LCD). These new screens provide a higher pixel resolution, luminous output and contrast ratio. Immersive head-mounted displays now allow designers to view immersive images, and recent developments in real-time rendering have encouraged the uptake of virtual reality (VR) head-mounted displays in mainstream practice and design education. This paper presents an experiment on lighting perception using a series of LED lighting conditions in a real space and a virtual representation of those conditions captured using a 360° high-dynamic-range camera and presented on an HTC Vive Pro HMD. Fifty-three participants were asked to rate each lighting condition by viewing it in a real space (n = 30) or via immersive HDR photographs displayed in a VR HMD (n = 23). The results show that ratings of visual comfort, pleasantness, evenness, contrast and glare are similar between the HTC Vive Pro HMD and our real space when evaluating well-lit scenes, but significant differences emerge in dim and highly contrasted scenes for a number of rating scales.
The Integrated Display and Environmental Awareness System (IDEAS) is an interdisciplinary team project focusing on the development of a wearable computer and Head Mounted Display (HMD) based on Commercial-Off-The-Shelf (COTS) components for the specific application and needs of NASA technicians, engineers and astronauts. Wearable computers are on the verge of utilization trials in daily life as well as industrial environments. The first civil and COTS wearable head mounted display systems were introduced just a few years ago and they probed not only technology readiness in terms of performance, endurance, miniaturization, operability and usefulness but also maturity of practice in perspective of a socio-technical context. Although the main technical hurdles such as mass and power were addressed as improvements on the technical side, the usefulness, practicality and social acceptance were often noted on the side of a broad variety of humans' operations. In other words, although the technology made a giant leap, its use and efficiency still looks for the sweet spot. The first IDEAS project started in January 2015 and was concluded in January 2017. The project identified current COTS systems' capability at minimum cost and maximum applicability and brought about important strategic concepts that will serve further IDEAS-like system development.
Tele-existence aims at a natural and efficient remote control of robots by providing the operator with a real time sensation of presence. It is an advaced type of teleoperation system which enables a human operator at the controls to perform remote manipulation tasks dexterously with the feeling that he or she exists in one of the remote anthropomorphic robots in the remote environment, e.g., in a hostile environment such as those of nuclear radiation, high temperature, and deep space. In order to study the use of the tele-existence system in the artificially constructed environment, the visual tele-existence simulator has been designed, a pseudo-real-time binocular solid model robot simulator has been made, and its feasibility has been experimentally evaluated. An anthropomorphic robot mechanism with an arm having seven degrees of freedom has been designed and developed as a slave robot for feasibility experiments of teleoperation using the tele-existence method. An impedance controlled active display mechanism and a head mounted display have also been designed and developed as the display subsystem for the master. The robot's structural dimensions are set very close to those of humans.
A realistic auditory environment can contribute to both the overall subjective sense of presence in a virtual display, and to a quantitative metric predicting human performance. Here, the role of audio in a virtual display and the importance of auditory-visual interaction are examined. Conjectures are proposed regarding the effectiveness of audio compared to visual information for creating a sensation of immersion, the frame of reference within a virtual display, and the compensation of visual fidelity by supplying auditory information. Future areas of research are outlined for improving simulations of virtual visual and acoustic spaces. This paper will describe some of the intersensory phenomena that arise during operator interaction within combined visual and auditory virtual environments. Conjectures regarding audio-visual interaction will be proposed.
Two experiments examined perceived spatial orientation in a small environment as a function of experiencing that environment under three conditions: real-world, desktop-display (DD), and head-mounted display (HMD). Across the three conditions, participants acquired two targets located on a perimeter surrounding them, and attempted to remember the relative locations of the targets. Subsequently, participants were tested on how accurately and consistently they could point in the remembered direction of a previously seen target. Results showed that participants were significantly more consistent in the real-world and HMD conditions than in the DD condition. Further, it is shown that the advantages observed in the HMD and real-world conditions were not simply due to nonspatial response strategies. These results suggest that the additional idiothetic information afforded in the real-world and HMD conditions is useful for orientation purposes in our presented task domain. Our results are relevant to interface design issues concerning tasks that require spatial search, navigation, and visualization.
The Aeroflightdynamics Directorate (AMRDEC) conducted a simulation to assess the performance associated with a Contact Analog, world-referenced heading tape as implemented on the Comanche Helmet Integrated Display Sight System (HIDSS) when compared with a Compressed heading tape similar to that specified by the former Military Standard (MIL-STD) 1295. Six experienced pilots flew three modified Aeronautical Design Standards (ADS)-33 maneuvers (Hover Turn, Bob-up, Transient Turn) and a precision traffic pattern in the NASA Vertical Motion Simulator (VMS). Analysis of the pilot objective performance data and subjective handling qualities ratings (HQRs) showed the following: Compressed symbology in the Velocity Stabilization (VelStab) flight mode generally produced the most precise performances over Contact Analog symbology with respect to the heading, altitude, position, and time criteria specified for the maneuvers tested. VelStab outperformed the Automatic Flight Control System (AFCS) on all maneuvers achieving desired performance on most maneuvers for both symbol sets. Performance in the AFCS mode was generally desirable to adequate for heading and altitude and did not meet adequate standards for hover position and time for the Hover Turn and Bob-up maneuvers. VelStab and AFCS performance were nearly the same for the Transient Turn. Pilot comments concerning the Contact Analog heading-tape implementation were generally unfavorable in spite of the achieved levels of performance. HQRs showed Compressed symbology in the VelStab flight mode produced the lowest mean HQR, encompassing mixed ratings of satisfactory handling and needing improvement. All other symbology/flight-mode combinations yielded higher HQRs, which characterized opinions that deficiencies in aircraft handling due to HMD symbology would need improvement. Contact Analog heading tape and other symbology require improvement, especially when operating in the AFCS mode. NASA-TLX rated Compressed symbology in the VelStab flight mode as the least demanding on resources, closely followed by ratings for Contact Analog in the VelStab mode. In a similar pattern, TLX ratings for maneuvers completed in the AFCS mode yielded a higher level of resource demand with even slighter differences between Contact Analog and Compressed symbology sets. Further research should be conducted where objective data and subjective HQR ratings indicate a need for improvement. The areas requiring attention are those where the symbology implementation, the flight control system, or a combination of both caused workload to reach an objectionable level where adequate performance was either difficult to achieve or unachievable. These areas are clearly identified in this report. Symbology that received negative HQR comments by a majority of pilots should also be examined. The summary of pilot comments can be found in appendix A. Additional simulation trials should be considered to address the identified issues.
Our ability to generate data from simulations and experimental platforms is generally outpacing our ability to analyze those data efficiently and effectively. There are a growing number and variety of possible visualization display modalities, from commodity head-mounted displays to large-scale immersive environments, from desktop and touch displays to high-resolution display walls. Many of these visualization technologies and visual environments are rapidly evolving and could revolutionize analysis for certain classes of complex scientific and engineering data. However, the choice of what technology or combination of technologies to use has historically been largely ad hoc and lacks a carefully validated understanding of how to best utilize different visualization technologies to advance the science. To maximize the impact of our data and analyses, it is imperative that we use the most effective visualization environments for the analysis task at hand.