Search NASA⌕ Search

SEARCH · Search NASA

Results for “Immersive Visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Q-VR: System-Level Design for Future Mobile Collaborative Virtual Reality

High Quality Mobile Virtual Reality (VR) is what the incoming graphics technology era demands: users around the world, regardless of their hardware and network conditions, can all enjoy the immersive virtual experience. However, the state-of-the-art software-based mobile VR designs cannot fully satisfy the realtime performance requirements due to the highly interactive nature of user's actions and complex environmental constraints during VR execution. Inspired by the unique human visual system effects and the strong correlation between VR motion features and realtime hardware-level information, we propose Q-VR, a novel dynamic collaborative rendering solution via software-hardware co-design for enabling future low-latency high-quality mobile VR. At software-level, Q-VR provides flexible high-level tuning interface to reduce network latency while maintaining user perception. At hardware-level, Q-VR accommodates a wide spectrum of hardware and network conditions across users by effectively leveraging the computing capability of the increasingly powerful VR hardware. Extensive evaluation on real-world games demonstrates that Q-VR can achieve an average end-to-end performance speedup of 3.4x (up to 6.7x) over the traditional local rendering design in commercial VR devices, and a 4.1x frame rate improvement over the state-of-the-art static collaborative rendering.

Xie, Chenhao↗
DOE OSTI2022

Interacting with the COVID virus model in VR environment

The Disaster Response Complex at Idaho State University (ISU) hosts an annual Disaster Preparedness and Response Conference which will give a bird's eye view of disasters and pandemics in the U.S. We'll demonstrate virtual reality (VR) and augmented reality (AR) capabilities at the conference. This VR demo displays the structure and components of the COVID virus model, and let users to interact with it in an immersive environment. The 3D model used in this demo is open source and downloaded from this site: https://sketchfab.com/GLS.

3D↗
NASA NTRS1989

Scientific work environments in the next decade

The applications of contemporary computer graphics to scientific visualization is described, with emphasis on the nonintuitive problems. A radically different approach is proposed which centers on the idea of the scientist being in the simulation display space rather than observing it on a screen. Interaction is performed with nonstandard input devices to preserve the feeling of being immersed in the three-dimensional display space. Construction of such a system could begin now with currently available technology.

Gomez, Julian E.↗
DOE OSTI2021

Quantifying Properties for a Mechanistic, Predictive Understanding of Aqueous Impact on Aging of Medium and Low Voltage AC and DC Cabling in Nuclear Power Plants

To address the gap in knowledge in understanding degradation in relevant service conditions, this project aimed to develop a mechanistic, predictive model of medium and low voltage cable failure based on the primary environmental degradation parameters of aqueous immersion time, temperature, and the oxidation extent. To do so, we took a two-fold approach toward evaluating degradation as related to the aqueous condition. First, we evaluated the chemical, mechanical, and electrical properties of polymers that comprise the cabling insulation under varied aqueous conditions at different temperatures. Secondly, we evaluated the performance of insulation materials under similar accelerated aging conditions in addition to the dielectric breakdown of the cabling under submersion conditions. Thermal oxidation and immersion of LDPE thin films were done using a Parr vessel and the extent of oxidation was monitored using the carbonyl index from ATR-FTIR spectrum, a ratio quantifying the carbonyl functionality produced on the LDPE film surface. Increasing the temperature, oxidation time, and oxygen pressure increased the water-vapor permeability and the carbonyl content. Thermogravimetric analysis of the films confirmed that there is indeed an initial weight loss of the smaller molecular weight molecules and volatiles. At higher temperatures, there is a secondary mass loss. Up to 70°C, the mass loss curves were similar until 80°C, when the aged films decreased at a much greater rate with respect to increasing temperature. This was seen in the 10, 50, 90% weight loss temperatures. The mechanical properties of sheet PP and HDPE as well as injection molded LDPE, HDPE, HDPP dog bones were plotted with respect to the time spent in the Parr vessel during thermal oxidation. For the sheet PP and HDPE, the UTS and the modulus of elasticity decreased while the elongation increased. The injection-molded LDPE, HDPE, and HDPP dog bones experienced a similar trend where the changes in the properties were within experimental uncertainty. This analysis of LDPE in dry and immersive oxygen-rich environments is an important baseline for future experiments looking at other degradation mechanisms. A predictive aging model for low-density polyethylene insulative cable housings was developed. This model revealed a combination of physical and chemical processes which lead to an increase in permeability and a decrease in strength of the insulator. In creating this predictive model, a gap of knowledge in the literature was revealed in two areas: understanding how the crystallinity of a polymer changes with time and visualizing the predicted pores formed through the insulator which leads to failure. Developing and using an adapted ATR-FTIR method, crystallinity was monitored and compared to bulk crystallinity found via DSC. Inhomogeneity in crystallinity changes were observed but the FTIR method but was found to be less reliable. Pore visualization was found utilizing electrical impedance spectroscopy saturated aged polyethylene films with synthesized citrate-capped gold nanoparticles, and chloroauric acid precursor. results indicate a decreasing impedance of the polyethylene films caused by the transport of ions through the film. SEM imaging was then performed for elemental analysis of the films and counter electrodes for the presence of ions. Chloride and gold ions were detected; however, no nanoparticles were found. This gives an estimated pore size of at least 0.3 nm through the aged film. Cyclic submergence of polyethylene and polypropylene in aqueous solutions of copper sulfate and Harrison’s solution were examined. It was discovered that aging in these mixed conditions and at 90°C did cause a small, yet significant increase to tensile strength for both unaged polyethylene and polypropylene. The PE and PP in cycled and submerged conditions did not have tensile strengths significantly different from dry-aged after 16 weeks. For both solutions, it was determined that capacitance increases with both water tree depth and cable temperature and is relatively independent of changing water tree AR. As for resistance, there is no apparent change between depth percentages of 10 and 80 for both solutions. This is because the water tree has not yet entered the conductor and thus there is no shorting current flowing through the tree yet. Between 80 and 100% water tree depth, it is observed that for both solutions there is a rapid decrease in resistance because the tree is now impacting the conductor shield and allowing shorting current to flow through it. The relationship between resistance and temperature was found to be inversed. As temperature increases, resistance decreases for both water tree solutions with distilled water having the most apparent difference across the range of temperatures simulated. With regards to water tree AR, resistance was found to be relatively independent at depth percentages of 10, 50, and 70, but there was some relationship at 100% depth for both solutions. At this depth, as water tree AR increased, resistance was found to also increase. Through the examination of voltage and electric field distribution plots, it was confirmed for EPR cables that increasing water tree depth leads to increasing distortion. The increase in shorting current at 100% depth for aqueous copper sulfate compared to distilled water was also visualized. Lastly, the relationship between shorting current and temperature for narrow water trees was visualized and validated using the distribution plots. This study has led to a better understanding of the effect of cable temperature, water tree solution, and geometry of the tree region on cable degradation. Furthermore, this study has documented simulation results of water tree degradation in EPR MV cables, which had been previously lacking in information. Future work in this area will add frequency into the mix and examine what effect it has on the rate of cable degradation as a result of water treeing. To compliment the work being carried by UMD on different polymer chemistries, harvested medium voltage (MV) cables were selected for accelerated aging study at ORNL. These medium voltage cables are representative of the vintages and materials that are currently in use at existing nuclear power plants (NPPs). These cables were immersed in water at 90°C and energized for a period of two years at elevated voltage. Partial discharge was measured during this period of time to track potential degradation. Unfortunately, due to the absence of failure, the extent of integration between the UMD techniques and the harvested MV insulation was limited. However, based on the findings and from the UMD research in the previous sections on polyethylene and polypropylene, follow-on characterization for harvested MV cable insulation should focus on sample preparation to take advantage of the UMD techniques to better understand mechanistic degradation in MV cable insulations. This would include: 1.) Utilization of solutions and impedance measurement insulation to track permeability in harvested and accelerated aging insulation samples, 2.) Adaptation of gold nanoparticle synthesis for electrical impedance spectroscopy with supporting SEM characterization to study pore formation in harvested and accelerated aged insulation samples, & 3.) ATR-FTIR crystallinity with multiple temperature dependent harvested MV cable insulation under different air and submerged accelerated aging. In addition, low voltage dielectric spectroscopy and high voltage dissipation factor, tan δ, could be implemented as a condition monitoring tool for harvested MV cable insulation in submerged environments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2000

Immersive Environment Technologies for Mars Exploration

JPL's charter includes the unmanned exploration of the Solar System. One of the tools for exploring other planets is the rover as exemplified by Sojourner on the Mars Pathfinder mission. The light speed turnaround time between Earth and the outer planets precludes the use of teleoperated rovers so autonomous operations are built in to the current and upcoming generation devices. As the level of autonomy increases, the mode of operations shifts from low-level specification of activities to a higher-level specification of goals. To support this higher-level activity, it is necessary to provide the operator with an effective understanding of the in-situ environment and also the tools needed to specify the higher-level goals. Immersive environments provide the needed sense of presence to achieve this goal. Use of immersive environments at JPL has two main thrusts that will be discussed in this talk. One is the generation of 3D models of the in-situ environment, in particular the merging of models from different sensors, different modes (orbital, descent, and lander), and even different missions. The other is the use of various tools to visualize the environment within which the rover will be operating to maximize the understanding by the operator. A suite of tools is under development which provide an integrated view into the environment while providing a variety of modes of visualization. This allows the operator to smoothly switch from one mode to another depending on the information and presentation desired.

Wright, John R.↗
NASA NTRS1991

High resolution ultrasonic spectroscopy system for nondestructive evaluation

With increased demand for high resolution ultrasonic evaluation, computer based systems or work stations become essential. The ultrasonic spectroscopy method of nondestructive evaluation (NDE) was used to develop a high resolution ultrasonic inspection system supported by modern signal processing, pattern recognition, and neural network technologies. The basic system which was completed consists of a 386/20 MHz PC (IBM AT compatible), a pulser/receiver, a digital oscilloscope with serial and parallel communications to the computer, an immersion tank with motor control of X-Y axis movement, and the supporting software package, IUNDE, for interactive ultrasonic evaluation. Although the hardware components are commercially available, the software development is entirely original. By integrating signal processing, pattern recognition, maximum entropy spectral analysis, and artificial neural network functions into the system, many NDE tasks can be performed. The high resolution graphics capability provides visualization of complex NDE problems. The phase 3 efforts involve intensive marketing of the software package and collaborative work with industrial sectors.

Chen, C. H.↗
NASA NTRS1999

Waves in Radial Gravity Using Magnetic Fluid

Terrestrial laboratory experiments studying various fluid dynamical processes are constrained, by being in an Earth laboratory, to have a gravitational body force which is uniform and unidirectional. Therefore fluid free-surfaces are horizontal and flat. Such free surfaces must have a vertical solid boundary to keep the fluid from spreading horizontally along a gravitational potential surface. In atmospheric, oceanic, or stellar fluid flows that have a horizontal scale of about one-tenth the body radius or larger, sphericity is important in the dynamics. Further, fluids in spherical geometry can cover an entire domain without any sidewall effects, i.e. have truly periodic boundary conditions. We describe spherical body-force laboratory experiments using ferrofluid. Ferrofluids are dilute suspensions of magnetic dipoles, for example magnetite particles of order 10 nm diameter, suspended in a carrier fluid. Ferrofluids are subject to an additional body force in the presence of an applied magnetic field gradient. We use this body force to conduct laboratory experiments in spherical geometry. The present study is a laboratory technique improvement. The apparatus is cylindrically axisymmetric. A cylindrical ceramic magnet is embedded in a smooth, solid, spherical PVC ball. The geopotential field and its gradient, the body force, were made nearly spherical by careful choice of magnet height-to-diameter ratio and magnet size relative to the PVC ball size. Terrestrial gravity is eliminated from the dynamics by immersing the "planet" and its ferrofluid "ocean" in an immiscible silicone oil/freon mixture of the same density. Thus the earth gravity is removed from the dynamics of the ferrofluid/oil interface and the only dynamically active force there is the radial magnetic gravity. The entire apparatus can rotate, and waves are forced on the ferrofluid surface by exterior magnets. The biggest improvement in technique is in the wave visualization. Fluorescing dye is added to the oil/freon mixture and an argon ion laser generates a horizontal light that can be scanned vertically. Viewed from above, the experiment is a black circle with wave deformations surrounded by a light background. A contour of the image intensity at any light sheet position gives the surface of the ferrofluid "ocean" at that "latitude". Radial displacements of the waves as a function of longitude are obtained by subtracting the contour line positions from a no-motion contour at that laser sheet latitude. The experiments are run by traversing the forcing magnet with the laser sheet height fixed and images are frame grabbed to obtain a time-series at one latitude. The experiment is then re-run with another laser-sheet height to generate a full picture of the three-dimensional wave structure in the upper hemisphere of the ball as a function of time. We concentrate here on results of laboratory studies of waves that are important in Earth's atmosphere and especially the ocean. To get oceanic scaling in the laboratory, the experiment must rotate rapidly (4-second rotation period) so that the wave speed is slow compared to the planetary rotation speed as in the ocean. In the Pacific Ocean, eastward propagating Kelvin waves eventually run into the South American coast. Theory predicts that some of the wave energy should scatter into coastal-trapped Kelvin waves that propagate north and south along the coast. Some of this coastal wave energy might then scatter into mid-latitude Rossby waves that propagate back westward. Satellite observations of the Pacific Ocean sea-surface temperature and height seem to show signatures of westward propagating mid-latitude Rossby waves, 5 to 10 years after the 1982-83 El Nino. The observational data is difficult to interpret unambiguously owing to the large range of motions that fill the ocean at shorter timescales. This series of reflections giving eastward, north- ward, and then westward traveling waves is observed cleanly in the laboratory experiments, confirming the theoretical expectations.

Ohlsen, D. R.↗
NASA NTRS2002

Specimen block counter-staining for localization of GUS expression in transgenic arabidopsis and tobacco

A simple counter-staining procedure has been developed for comparative beta-glucuronidase (GUS) expression and anatomical localization in transgenic herbaceous arabidopsis and tobacco. This protocol provides good anatomical visualization for monitoring chimeric gene expression at both the organ and tissue levels. It can be used with different histochemical stains and can be extended to the study of woody species. The specimens are paraffin-embedded, the block is trimmed to reveal internal structure, safranin-O staining solution is briefly applied to the surface of the block, then washed off and, after drying, a drop of immersion oil is placed on the stained surface for subsequent photographic work. This gives tissue counter-staining with good structural preservation without loss of GUS staining product; moreover, sample observation is rapid and efficient compared to existing procedures.

NASA Discipline Plant Biology↗
NASA NTRS2012

Physiological Based Simulator Fidelity Design Guidance

The evolution of the role of flight simulation has reinforced assumptions in aviation that the degree of realism in a simulation system directly correlates to the training benefit, i.e., more fidelity is always better. The construct of fidelity has several dimensions, including physical fidelity, functional fidelity, and cognitive fidelity. Interaction of different fidelity dimensions has an impact on trainee immersion, presence, and transfer of training. This paper discusses research results of a recent study that investigated if physiological-based methods could be used to determine the required level of simulator fidelity. Pilots performed a relatively complex flight task consisting of mission task elements of various levels of difficulty in a fixed base flight simulator and a real fighter jet trainer aircraft. Flight runs were performed using one forward visual channel of 40 deg. field of view for the lowest level of fidelity, 120 deg. field of view for the middle level of fidelity, and unrestricted field of view and full dynamic acceleration in the real airplane. Neuro-cognitive and physiological measures were collected under these conditions using the Cognitive Avionics Tool Set (CATS) and nonlinear closed form models for workload prediction were generated based on these data for the various mission task elements. One finding of the work described herein is that simple heart rate is a relatively good predictor of cognitive workload, even for short tasks with dynamic changes in cognitive loading. Additionally, we found that models that used a wide range of physiological and neuro-cognitive measures can further boost the accuracy of the workload prediction.

Schnell, Thomas↗
NASA NTRS1994

Virtual reality and telerobotics applications of an Address Recalculation Pipeline

The technology described in this paper was designed to reduce latency to user interactions in immersive virtual reality environments. It is also ideally suited to telerobotic applications such as interaction with remote robotic manipulators in space or in deep sea operations. in such circumstances the significant latency is observed response to user stimulus which is due to communications delays, and the disturbing jerkiness due to low and unpredictable frame rates on compressed video user feedback or computationally limited virtual worlds, can be masked by our techniques. The user is provided with highly responsive visual feedback independent of communication or computational delays in providing physical video feedback or in rendering virtual world images. Virtual and physical environments can be combined seamlessly using these techniques.

Regan, Matthew↗
NASA NTRS2023

Turbulence Model Validation Through Joint Experimental /Computational Studies of Separated Flow Over A Three-Dimensional Tapered Bump: Part I - Experimental Investigation

The results of a three-year experimental campaign aimed at comprehensively documenting the separated flow over a three-dimensional bump are presented with the purpose of generating a benchmark experimental database useful in validating computational fluid dynamics (CFD) flow simulations. The bump model geometry was designed to provide well-defined and repeatable smooth-body flow separation conditions that were suitable for both experiments and simulations. The bump had a Gaussian streamwise profile with a constant height equal to 8.5% of its width over the central 60% of the test section width. The remaining 40% were outboard spanwise portions that gradually taper to zero using an error function profile to minimize side-wall boundary layer effects. The model was immersed in a turbulent boundary layer that was developed on a suspended flat plate in the Notre Dame Mach 0.6 Wind Tunnel. In order to document the effect of the incoming boundary layer thickness on the flow separation, the bump model could be located at two streamwise positions. The mean velocity and turbulence intensity of the wind tunnel freestream flow field and approaching turbulent boundary layer were fully documented. The measurements of the flow separation region included surface visualization, wall shear stress using oil-film interferometry, mean and dynamic surface pressure, and planar and stereoscopic particle image velocimetry. The experiments were conducted over a range of Mach numbers from 0.05 to 0.2 corresponding to a range of Reynolds numbers based on the test section spanwise dimension (0.914m) of 1.0 × 10 6 ≤ Re L = U ∞ L/ν ≤ 4.0 × 10 6 . The bulk of the results are presented for the higher Mach number conditions of 0.1 and 0.2 with Re L = 2.0 × 10 6 and 4.0 × 10 6 , respectively. Extensive uncertainty analysis of the data was performed. The data is archived in the NASA Langley Turbulence Modeling Resource website at https://turbmodels.larc.nasa.gov/Other_exp_Data/speedbump_sep_exp.html. In addition to the experiments, a computational effort was made in parallel by the CFD group at Boeing Research & Technology highlighting the usefulness of the data set, which is outlined in the accompanying CFD report.

Flow separation↗
NASA NTRS2018

Interactive Planetary Visualization and Analysis with NASA's Solar System Treks Portals

NASA's Solar System Trek online portals provide web-based suites of interactive visualization and analysis tools enabling mission planners, planetary scientists, students, and the general public to explore planetary surfaces as seen through the eyes of many different instruments aboard a wide range of spacecraft. The portals present a vast collection of mapped data products from past and current missions for a growing number of planetary bodies. As web-based toolsets, the portals do not require users to purchase or install any software beyond current web browsers. The interactive and immersive capabilities of these portals are being used for site selection and analysis by NASA and a number of its international partners, supporting upcoming missions. They are also being used by formal and informal educators, students from elementary through university levels of study, and members of the public who are engaged in the excitement of solar system exploration. This presentation will provide an overview of the Solar System Treks and highlight many of the exciting new additions to the project implemented this past year.

Treks↗
NASA NTRS2001

Challenges Facing Design and Analysis Tools

The design and analysis of future aerospace systems will strongly rely on advanced engineering analysis tools used in combination with risk mitigation procedures. The implications of such a trend place increased demands on these tools to assess off-nominal conditions, residual strength, damage propagation, and extreme loading conditions in order to understand and quantify these effects as they affect mission success. Advances in computer hardware such as CPU processing speed, memory, secondary storage, and visualization provide significant resources for the engineer to exploit in engineering design. The challenges facing design and analysis tools fall into three primary areas. The first area involves mechanics needs such as constitutive modeling, contact and penetration simulation, crack growth prediction, damage initiation and progression prediction, transient dynamics and deployment simulations, and solution algorithms. The second area involves computational needs such as fast, robust solvers, adaptivity for model and solution strategies, control processes for concurrent, distributed computing for uncertainty assessments, and immersive technology. Traditional finite element codes still require fast direct solvers which when coupled to current CPU power enables new insight as a result of high-fidelity modeling. The third area involves decision making by the analyst. This area involves the integration and interrogation of vast amounts of information - some global in character while local details are critical and often drive the design. The proposed presentation will describe and illustrate these areas using composite structures, energy-absorbing structures, and inflatable space structures. While certain engineering approximations within the finite element model may be adequate for global response prediction, they generally are inadequate in a design setting or when local response prediction is critical. Pitfalls to be avoided and trends for emerging analysis tools will be described.

Knight, Norman F., Jr.↗
DOE OSTI2022

Fluid structure interaction of a subaqueous pendulum: Analyzing the effect of wake correction via large eddy simulations

The dynamic behavior of a subaqueous cylindrical pendulum and corresponding flow dynamics are investigated. The objectives were twofold: (i) to examine whether the two-dimensional model equations sufficiently capture the three-dimensional dynamics and (ii) to investigate the emerging three-dimensional vortical flow structures. Large eddy simulations with two-way coupling fluid structure interaction were carried out using the immersed boundary method to simulate the motion of the pendulum and its interactions with the initially stagnant water. The resulting pendulum motion is compared against measured data obtained in a series of experimental tests to validate the simulation results and the model equations with and without wake corrections. An analysis of the flow vorticity revealed the development of a vortex ring during the first swing and the formation of tip vortices. The evolution of the vortex rings emerging from the motion of the subaqueous cylindrical pendulum was visualized using Q-criteria showing a reasonable agreement with vortical structures observed in the experiment using particle imaging velocimetry. The hydrodynamic moments acting on the simulated pendulum and the moments calculated from the model equations are analyzed. Using the insights from these numerical simulations, a modification of the wake correction is proposed to enhance the accuracy of the rate of decay and period. The transient effect of coherent flow on pendulum dynamics, especially the added mass effect, is discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2011

Timescale Correlation between Marine Atmospheric Exposure and Accelerated Corrosion Testing

Evaluation of metal-based structures has long relied on atmospheric exposure test sites to determine corrosion resistance in marine environments. Traditional accelerated corrosion testing relies on mimicking the exposure conditions, often incorporating salt spray and ultraviolet (UV) radiation, and exposing the metal to continuous or cyclic conditions of the corrosive environment. Their success for correlation to atmospheric exposure is often a concern when determining the timescale to which the accelerated tests can be related. Accelerated laboratory testing, which often focuses on the electrochemical reactions that occur during corrosion conditions, has yet to be universally accepted as a useful tool in predicting the long term service life of a metal despite its ability to rapidly induce corrosion. Although visual and mass loss methods of evaluating corrosion are the standard and their use is imperative, a method that correlates timescales from atmospheric exposure to accelerated testing would be very valuable. This work uses surface chemistry to interpret the chemical changes occurring on low carbon steel during atmospheric and accelerated corrosion conditions with the objective of finding a correlation between its accelerated and long-term corrosion performance. The current results of correlating data from marine atmospheric exposure conditions at the Kennedy Space Center beachside corrosion test site, alternating seawater spray, and immersion in typical electrochemical laboratory conditions, will be presented. Key words: atmospheric exposure, accelerated corrosion testing, alternating seawater spray, marine, correlation, seawater, carbon steel, long-term corrosion performance prediction, X-ray photoelectron spectroscopy.

Montgomery, Eliza L.↗
NASA NTRS1994

Applied virtual reality at the Research Triangle Institute

Virtual Reality (VR) is a way for humans to use computers in visualizing, manipulating and interacting with large geometric data bases. This paper describes a VR infrastructure and its application to marketing, modeling, architectural walk through, and training problems. VR integration techniques used in these applications are based on a uniform approach which promotes portability and reusability of developed modules. For each problem, a 3D object data base is created using data captured by hand or electronically. The object's realism is enhanced through either procedural or photo textures. The virtual environment is created and populated with the data base using software tools which also support interactions with and immersivity in the environment. These capabilities are augmented by other sensory channels such as voice recognition, 3D sound, and tracking. Four applications are presented: a virtual furniture showroom, virtual reality models of the North Carolina Global TransPark, a walk through the Dresden Fraunenkirche, and the maintenance training simulator for the National Guard.

Montoya, R. Jorge↗
NASA NTRS2016

The Virtual Tablet: Virtual Reality as a Control System

In the field of human-computer interaction, Augmented Reality (AR) and Virtual Reality (VR) have been rapidly growing areas of interest and concerted development effort thanks to both private and public research. At NASA, a number of groups have explored the possibilities afforded by AR and VR technology, among which is the IT Advanced Concepts Lab (ITACL). Within ITACL, the AVR (Augmented/Virtual Reality) Lab focuses on VR technology specifically for its use in command and control. Previous work in the AVR lab includes the Natural User Interface (NUI) project and the Virtual Control Panel (VCP) project, which created virtual three-dimensional interfaces that users could interact with while wearing a VR headset thanks to body- and hand-tracking technology. The Virtual Tablet (VT) project attempts to improve on these previous efforts by incorporating a physical surrogate which is mirrored in the virtual environment, mitigating issues with difficulty of visually determining the interface location and lack of tactile feedback discovered in the development of previous efforts. The physical surrogate takes the form of a handheld sheet of acrylic glass with several infrared-range reflective markers and a sensor package attached. Using the sensor package to track orientation and a motion-capture system to track the marker positions, a model of the surrogate is placed in the virtual environment at a position which corresponds with the real-world location relative to the user's VR Head Mounted Display (HMD). A set of control mechanisms is then projected onto the surface of the surrogate such that to the user, immersed in VR, the control interface appears to be attached to the object they are holding. The VT project was taken from an early stage where the sensor package, motion-capture system, and physical surrogate had been constructed or tested individually but not yet combined or incorporated into the virtual environment. My contribution was to combine the pieces of hardware, write software to incorporate each piece of position or orientation data into a coherent description of the object's location in space, place the virtual analogue accordingly, and project the control interface onto it, resulting in a functioning object which has both a physical and a virtual presence. Additionally, the virtual environment was enhanced with two live video feeds from cameras mounted on the robotic device being used as an example target of the virtual interface. The working VT allows users to naturally interact with a control interface with little to no training and without the issues found in previous efforts.

virtual control interface↗
NASA NTRS2023

Using Virtual Reality to Envision Deployment of Spacesuit-Compatible Augmented Reality Displays for Lunar Surface Operations

The National Aeronautics and Space Administration (NASA) will soon land crew on the lunar surface to establish a sustainable presence and develop operational concepts for future long-duration missions. New technologies will be necessary to extend planning and execution capabilities for lunar surface activities. The Joint Augmented Reality Visual Informatics System (Joint AR) at NASA Johnson Space Center (JSC) is one such technology. Joint AR is a suit-mounted augmented reality (AR) display and compute system which facilitates unprecedented information exchange and data visualization capabilities between mission support operators and suited crew. This paper describes challenges associated with developing an AR technology for an envisioned work domain by applying a sociotechnical lens to the iterative testing and development of novel AR technology through virtual reality (VR). A foundational VR testbed was established, providing a high-fidelity approximation of the lunar surface and enabling testing of envisioned AR system features in parallel with real world product development. Using this environment, a series of human-in-the-loop experiments were conducted using VR to deploy a notional AR system supporting use cases envisioned for lunar exploration extravehicular activity (xEVA). Our findings indicate VR is a powerful and immersive tool for testing capabilities which extend beyond the limitations of current AR technology. Our VR testbed enables early testing of proposed system features, advancing identification of high-value features and driving present-day development of Joint AR. Future work directions are discussed, including lessons learned and a roadmap for an iterative research and development approach applying VR (among other testbeds) to accelerate Joint AR system maturation.

Augmented reality↗