Enhancing Training Through Extended Reality and Data Fusion
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Enhancing Training Through Extended Reality (XR) and Data Fusion will go over XR headsets and software built here at Sandia.
In the future, it will be possible to build high-quality models of building interiors based on data from a dense fleet of sensors reporting on air volumes much smaller than a room or zone. To enable such models, we are creating technologies that allow a fleet of sensors to be commissioned quickly at low cost. Our sensor commissioning process builds a 3D model of each building interior that includes sensor positions and sensor networking information such as sensor MAC addresses. It employs multiple technologies, including augmented reality, LiDAR, QR codes, and computer vision. Sensors can be commissioned at more than 10x the speed and at less than one tenth the cost of traditional approaches.
Augmented Reality is a promising technology to support safe pedestrian evacuation from buildings during earthquakes. The widespread availability of phone cameras makes this idea feasible. QR codes, for instance, can place virtual three-dimensional objects to guide people along a prescribed route. In this work, a prototypical system based on this premise was created in response to the 2020 sudden surge in seismic activity in Puerto Rico. The results point towards feasibility as well as to a series of areas that require improvement for a real-life implementation.
Although the common genetic origin of the Kreutz family of sun-grazing comets has generally been accepted, there remains uncertainty with regard to genetic identity among other groups of comets whose orbital elements are nearly alike. Porter (1952) has listed a number of such groups, and Opik (1971) has made a statistical study of the orbits of 472 comets with aphelion distances beyond Saturn. Opik lists 97 groups that show similarities among their three angular elements, calculates an overall probability of some 10 to the -39th power that these similarities could have occurred by chance, and thus concludes that 60% or more of such comets fall into genetic groups containing from two to seven members. This paper explores the statistical reality of Opik's groups utilizing the Monte Carlo method of statistics as well as ordinary probability theory. The conclusion is reached that except for a few pairs, the similarity among orbital elements within the groups is no greater than random expectation.
It is becoming evident that there is an emerging role for manned space platforms in the 1980's and 1990's. Space platforms will place heavy emphasis on habitability support systems. Initial space platforms which may become reality in the 1985-1990 time period will build on prior space flight experience from Skylab, Spacelab, early space habitats or modules leading to the advent of multimodule space platforms which will herald continued occupancy in space. Emphasis is placed on habitability needs for space platforms which may be constructed in the mid 1980's to early 1990's. Crew size from under 10 to near 100 will be the main concentration. Energy supply will rapidly transfer from the Shuttle fuel cells to dependency on larger and larger solar cell arrays.
The Launch Processing System represents Kennedy Space Center's role in providing a major integrated hardware and software system for the test, checkout and launch of a new space vehicle. Past programs considered the active flight vehicle to ground interfaces as part of the flight systems and therefore the related ground system was provided by the Development Center. The major steps taken to transform the Launch Processing System from a concept to reality with the successful launches of the Shuttle Programs Space Transportation System are addressed.
A full proceedings of the symposium will be issued later in the year. This synopsis consists of summations of three sessions by appointed rapporteurs. International figures in space and in politics spoke at the sessions. Themes of international cooperation and fiscal reality pervaded the conference. International speakers from Canada, the European Space Agency, Russia, Japan and China and other countries addressed the topic of the symposium. American representation included Senator Barbara Mikulski, former NASA administrator James Beggs and other speakers.
Virtual Reality (VR) is a rapidly developing Human/Computer Interface (HCI) technology. The evolution of high-speed graphics processors and development of specialized anthropomorphic user interface devices, that more fully involve the human senses, have enabled VR technology. Recently, the maturity of this technology has reached a level where it can be used as a tool in a variety of applications. This paper provides an overview of: VR technology, VR activities at Marshall Space Flight Center (MSFC), applications of VR to Automated Rendezvous and Capture (AR&C), and identifies areas of VR technology that requires further development.
We explored the training potential of Virtual Reality (VR) technology. Thirty-one adults were trained and tested on spatial skills in a VR. They learned a sequence of button and knob responses on a VR console and performed flawlessly on the same console. Half were trained with a rote strategy; the rest used a meaningful strategy. Response times were equivalent for both groups and decreased significantly over five test trials indicating that learning continued on VR tests. The same subjects practiced navigating through a VR building, which had three floors with four rooms on each floor. The dependent measure was the number of rooms traversed on routes that differed from training routes. Many subjects completed tests in the fewest rooms possible. All subjects learned configurational knowledge according to the criterion of taking paths that were significantly shorter than those predicted by a random walk as determined by a Monte Carlo analysis. The results were discussed as a departure point for empirically testing the training potential of VR technology.
Artificial representations of virtual worlds are becoming more common due to advances in the technology of image generation and display systems. Application areas include flight simulation, mission rehearsal, teleoperator systems, and virtual reality systems. System developers should be forewarned that some proportion of users will experience perceptual anomalies and symptoms of motion sickness as a result of travel through virtual space.
Most virtual-reality systems use LCD-based displays that achieve a large field-of-view at the expense of resolution. A typical display will consist of approximately 86,000 pixels uniformly distributed over an 80-degree by 60-degree image. Thus, each pixel subtends about 13 minutes of arc at the retina; about the same as the resolvable features of the 20/200 line of a Snellen Eye Chart. The low resolution of LCD-based systems limits task performance in some applications. We have examined target-detection performance in a low-resolution virtual world. Our synthesized three-dimensional virtual worlds consisted of target objects that could be positioned at a fixed distance from the viewer, but at random azimuth and constrained elevation. A virtual world could be bounded by chromatic walls or by wire-frame, or it could be unbounded. Viewers scanned these worlds and indicated by appropriate gestures when they had detected the target object. By manipulating the viewer's field size and the chromatic and luminance contrast of annuli surrounding the field-of-view, we were able to assess the effect of field size on the detection of virtual objects in low-resolution synthetic worlds.
A force-reflecting teleoperation training simulator with a high-fidelity real-time graphics display has been developed for operator training. A novel feature of this simulator is that it enables the operator to feel contact forces and torques through a force-reflecting controller during the execution of the simulated peg-in-hole task, providing the operator with the feel of visual and kinesthetic force virtual reality. A peg-in-hole task is used in our simulated teleoperation trainer as a generic teleoperation task. A quasi-static analysis of a two-dimensional peg-in-hole task model has been extended to a three-dimensional model analysis to compute contact forces and torques for a virtual realization of kinesthetic force feedback. The simulator allows the user to specify force reflection gains and stiffness (compliance) values of the manipulator hand for both the three translational and the three rotational axes in Cartesian space. Three viewing modes are provided for graphics display: single view, two split views, and stereoscopic view.
NASA-Ames is intensively developing virtual-reality (VR) capabilities that can extend and augment computer-generated and remote spatial environments. VR is envisioned not only as a basis for improving human/machine interactions involved in planetary exploration, but also as a medium for the more widespread sharing of the experience of exploration, thereby broadening the support-base for the lunar and planetary-exploration endeavors. Imagery representative of Mars are being gathered for VR presentation at such terrestrial sites as Antarctica and Death Valley.
Work has begun on the merger of two well known systems, VEOS (HITLab) and CLIPS (NASA). In the recent past, the University of Massachusetts Lowell developed a parallel version of NASA CLIPS, called P-CLIPS. This modification allows users to create smaller expert systems which are able to communicate with each other to jointly solve problems. With the merger of a VEOS message system, PCLIPS-V can now act as a group of entities working within VEOS. To display the 3D virtual world we have been using a graphics package called HOOPS, from Ithaca Software. The artificial reality environment we have set up contains actors and objects as found in our Lincoln Logs Factory of the Future project. The environment allows us to view and control the objects within the virtual world. All communication between the separate CLIPS expert systems is done through VEOS. A graphical renderer generates camera views on X-Windows devices; Head Mounted Devices are not required. This allows more people to make use of this technology. We are experimenting with different types of virtual vehicles to give the user a sense that he or she is actually moving around inside the factory looking ahead through windows and virtual monitors.
The NASA Johnson Space Center (JSC)/LinCom Corporation, the University of Texas Medical Branch at Galveston (UTMB), and the Galveston Independent School District (GISD) have teamed up to develop a virtual visual environment display (VIVED) that provides a unique educational experience using virtual reality (VR) technologies. The VIVED end product will be a self-contained educational experience allowing students a new method of learning as they interact with the subject matter through VR. This type of interface is intuitive and utilizes spatial and psychomotor abilities which are now constrained or reduced by the current two dimensional terminals and keyboards. The perpetual challenge to educators remains the identification and development of methodologies which conform the learners abilities and preferences. The unique aspects of VR provide an opportunity to explore a new educational experience. Endowing medical students with an understanding of the human body poses some difficulty challenges. One of the most difficult is to convey the three dimensional nature of anatomical structures. The ideal environment for addressing this problem would be one that allows students to become small enough to enter the body and travel through it - much like a person walks through a building. By using VR technology, this effect can be achieved; when VR is combined with multimedia technologies, the effect can be spectacular.
A virtual reality (VR) Applications Program has been under development at MSFC since 1989. Its objectives are to develop, assess, validate, and utilize VR in hardware development, operations development and support, missions operations training, and science training. A variety of activities are under way within many of these areas. One ongoing macro-ergonomic application of VR relates to the design of the Space Station Freedom Payload Control Area (PCA), the control room from which onboard payload operations are managed. Several preliminary conceptual PCA layouts have been developed and modeled in VR. Various managers and potential end users have virtually 'entered' these rooms and provided valuable feedback. Before VR can be used with confidence in a particular application, it must be validated, or calibrated, for that class of applications. Two associated validation studies for macro-ergonomic applications are under way to help characterize possible distortions of filtering of relevant perceptions in a virtual world. In both studies, existing control rooms and their 'virtual counterparts will be empirically compared using distance and heading estimations to objects and subjective assessments. Approaches and findings of the PCA activities and details of the studies are presented.
The Graphics Analysis Facility (GRAF) at JSC has developed a rapid algorithm for computing realistic human reaching. The algorithm was applied to GRAF's anthropometrically correct human model and used in a 3D computer graphics system and a virtual reality system. The nature of the algorithm and its uses are discussed.
Two types of synthetic experience are covered: virtual reality (VR) and surgery, and telemedicine. The topics are presented in viewgraph form and include the following: geometric models; physiological sensors; surgical applications; virtual cadaver; VR surgical simulation; telesurgery; VR Surgical Trainer; abdominal surgery pilot study; advanced abdominal simulator; examples of telemedicine; and telemedicine spacebridge.