Advances in Sampling and Situational Awareness Using Augmented and Virtual Reality Devices.
Abstract not provided.
Knowlton, Robert G.↗
SEARCH · Search NASA
Results for “virtual reality device”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Evaluation Challenges for the Application of Extended Reality Devices in Medicine
Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices’ safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration’s public workshop, “Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine” and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.
60 APPLIED LIFE SCIENCES↗
Benefits from R. and D. for D. and D. projects - 15089
CEA (French Alternative Energies and Atomic Energy Commission) is both the operator of important nuclear facilities all over the nuclear cycle, in charge of major new built or D and D projects and a R and D group with dynamic policy of technology transfer: second in France for patents deposit, active partnership agreements with industries, and support for Start-ups. The position of CEA in D and D is unique because of the number and the wide diversity of facilities under decommissioning, with some high level of contamination. Innovative solutions are being developed in 6 main axes to protect the operators, to minimize the overall costs and the volumes of waste: - Investigations in the facilities - Radiological measurement of waste - Robotics, laser cutting devices, virtual reality to simulate and choose the best way to operate, - Decontamination of soils and structures - Waste treatment and conditioning - Methods and Information Technology (IT)Tools for project and waste management The last developments are shown and examples of industrial applications given: encapsulation of Magnesium or vitrification of high level waste for UP1 retreatment plant, treatment of sodium for Phenix fast breeder, treatment of organic liquids, etc. CEA is willing to share actions in partnership with other operators or with industrials so they can use the results for other contracting authorities. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing
Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.
360° panorama↗
Virtual reality 3D headset based on DMD light modulators
We present the design of an immersion-type 3D headset suitable for virtual reality applications based upon digital micro-mirror devices (DMD). Our approach leverages silicon micro mirrors offering 720p resolution displays in a small form-factor. Supporting chip sets allow rapid integration of these devices into wearable displays with high resolution and low power consumption. Applications include night driving, piloting of UAVs, fusion of multiple sensors for pilots, training, vision diagnostics and consumer gaming. Our design is described in which light from the DMD is imaged to infinity and the user’s own eye lens forms a real image on the user’s retina.
digital micromirror device↗
Absorption of wireless radiation in the child versus adult brain and eye from cell phone conversation or virtual reality
Highlights: • More cell phone radiation is absorbed by children's inner brain tissues than adults’. • Children's radiofrequency radiation exposure should be reduced. • Further research to evaluate the risks to the eye from use of VR is urgently needed. • It is biologically relevant and feasible to reduce the standards’ averaging volume. • Current methods to determine wireless device compliance should be revised. Children's brains are more susceptible to hazardous exposures, and are thought to absorb higher doses of radiation from cell phones in some regions of the brain. Globally the numbers and applications of wireless devices are increasing rapidly, but since 1997 safety testing has relied on a large, homogenous, adult male head phantom to simulate exposures; the “Standard Anthropomorphic Mannequin” (SAM) is used to estimate only whether tissue temperature will be increased by more than 1 Celsius degree in the periphery. The present work employs anatomically based modeling currently used to set standards for surgical and medical devices, that incorporates heterogeneous characteristics of age and anatomy. Modeling of a cell phone held to the ear, or of virtual reality devices in front of the eyes, reveals that young eyes and brains absorb substantially higher local radiation doses than adults’. Age-specific simulations indicate the need to apply refined methods for regulatory compliance testing; and for public education regarding manufacturers' advice to keep phones off the body, and prudent use to limit exposures, particularly to protect the young.
54 ENVIRONMENTAL SCIENCES↗
Octave bandwidth photonic fishnet-achromatic-metalens
Planar structured interfaces, also known as metasurfaces, are continuously attracting interest owing to their ability to manipulate fundamental attributes of light, including angular momentum, phase, or polarization. However, chromatic aberration, limiting broadband operation, has remained a challenge for metasurfaces-based optical components and imagers. The limitation stems from the intrinsic dispersion of existing materials and design principles. Here we report and experimentally demonstrate polarization-independent fishnet-achromatic-metalenses with measured average efficiencies over 70% in the continuous band from the visible (640 nm) to the infrared (1200 nm). Results of the scalable platform are enabling for applications requiring broad bandwidth and high efficiency including energy harvesting, virtual reality and information processing devices, or medical imaging.
36 MATERIALS SCIENCE↗
Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform
4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.
Pratt, Martin J.↗
Multiscale porous elastomer substrates for multifunctional on-skin electronics with passive-cooling capabilities
In addition to mechanical compliance, achieving the full potential of on-skin electronics needs the introduction of other features. For example, substantial progress has been achieved in creating biodegradable, self-healing, or breathable, on-skin electronics. However, the research of making on-skin electronics with passive-cooling capabilities, which can reduce energy consumption and improve user comfort, is still rare. Herein, we report the development of multifunctional on-skin electronics, which can passively cool human bodies without needing any energy consumption. This property is inherited from multiscale porous polystyrene-block-poly(ethylene-ran-butylene)-block-polystyrene (SEBS) supporting substrates. The multiscale pores of SEBS substrates, with characteristic sizes ranging from around 0.2 to 7 µm, can effectively backscatter sunlight to minimize heat absorption but are too small to reflect human-body midinfrared radiation to retain heat dissipation, thereby delivering around 6 °C cooling effects under a solar intensity of 840 W∙m -2 . Other desired properties, rooted in multiscale porous SEBS substrates, include high breathability and outstanding waterproofing. The proof-of-concept bioelectronic devices include electrophysiological sensors, temperature sensors, hydration sensors, pressure sensors, and electrical stimulators, which are made via spray printing of silver nanowires on multiscale porous SEBS substrates. The devices show comparable electrical performances with conventional, rigid, nonporous ones. Also, their applications in cuffless blood pressure measurement, interactive virtual reality, and human–machine interface are demonstrated. Notably, the enabled on-skin devices are dissolvable in several organic solvents and can be recycled to reduce electronic waste and manufacturing cost. Such on-skin electronics can serve as the basis for future multifunctional smart textiles with passive-cooling functionalities.
42 ENGINEERING↗
Augmented Reality Rendering of Computed Tomography 3-D Density Data
Overall Objectives: Purchase equipment and Software required to develop the technology; Import CT Data for viewing on an AR device; Develop the tools necessary to manipulate the data in AR. With Augmented and Virtual Reality technology becoming more common and affordable everyday, new visualization techniques need to be developed that can leverage this technology to visualize data in new and useful ways. Computed Tomography (CT) scans, are the result of a powerful X-ray machine taking multiple images of the same object. These images represent slices of the original object and have extremely high resolution. Because of the high resolution, CT scanning is often used in the medical field but is becoming increasingly predominate in diverse industrial fields as well. This is an example of a CT scan that shows an object with multiple items inside. These items are represented by different colors in gray scale to indicate different densities. This is also from the data set used for the duration of the project. The data sets usually contain hundreds of slides that looks like just like this. Visualizing these large data sets can be difficult. The general approach for this seedling was to identify the devices and software that are currently in use for data visualization and evaluate them for use in the project. After that a plan was made to convert the data into a format viewable in AR. Tools were then developed to manipulate that data. The project was a success, but there is plenty of room to advance the technology and create better visualizations.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Ultra‐Flexible Pixelated Perovskite Photodetectors Enabled by Honeycomb Polymer Grids for High‐Resolution Imaging
Abstract A nature‐inspired fabrication method based on a photolithography‐free flexible polymer grid is reported for high‐resolution pixelation of perovskite photodiode arrays with exceptional mechanical ductility and a morphology resembling that of natural compound eyes. The resulting pixelated perovskite photosensitive layer has a ≈1 µm pixel size with 2000 Pixels per inch (PPI) resolution when fully assembled as a photodetector array, delivering a detectivity of >10 13 Jones while providing cross‐talk free imaging. Using a polymer grid effectively releases stress on the perovskite platform, greatly increasing the mechanical agility of the otherwise brittle perovskite film. This novel fabrication methodology and device design offer new possibilities for applications in robotics, biomedical imaging, and virtual and augmented reality.
Zheng, Ding [Department of Chemistry and the Mater↗
Novus: An Unmanned Aerial System and Virtual Reality Flight Deck for Data Collection and Visualization
Many emerging technologies offer tremendous new capabilities that will, without question, redefine how we interact with, utilize, understand, and optimize the energy systems around us. Drones offer a new ability to remotely capture data in ways that have previously been impractical. However, their flight control systems remain rudimentary and limit the ability of researchers to fully take advantage of these platforms as remote sensing devices. In this project, we constructed a hexarotor drone and outfitted it with advanced (yet inexpensive) sensors as well as a telemetry data management and control package. We then created a virtual reality flight deck that allows a drone operator to define waypoints "on-the-fly" or take manual control over flight operations. The flight deck provides a live on-board video stream display, a 3-dimensional topographic map with the drone’s position in space overlaid onto it, as well as a data visualization framework that keeps critical information immediately available to the operator. These advances provide a new platform for scientific data collection such as thermography of building envelopes or solar arrays. As the drone is in flight and data are being collected, these data are relayed to the virtual reality environment where they can be inspected for integrity and the flight plan altered if necessary to collect higher quality data. Future work will focus on implementing 3-dimensional mapping using both visible and thermal imagery collected from the drone, and streaming those into the virtual reality flight deck in real time.
Source record↗
Vertical full-colour micro-LEDs via 2D materials-based layer transfer
Micro-LEDs (µLEDs) have been explored for augmented and virtual reality display applications that require extremely high pixels per inch and luminance. However, conventional manufacturing processes based on the lateral assembly of red, green and blue (RGB) µLEDs have limitations in enhancing pixel density. Recent demonstrations of vertical µLED displays have attempted to address this issue by stacking freestanding RGB LED membranes and fabricating top-down, but minimization of the lateral dimensions of stacked µLEDs has been difficult. Here we report full-colour, vertically stacked µLEDs that achieve, to our knowledge, the highest array density (5,100 pixels per inch) and the smallest size (4 µm) reported to date. This is enabled by a two-dimensional materials-based layer transfer technique that allows the growth of RGB LEDs of near-submicron thickness on two-dimensional material-coated substrates via remote or van der Waals epitaxy, mechanical release and stacking of LEDs, followed by top-down fabrication. The smallest-ever stack height of around 9 µm is the key enabler for record high µLED array density. We also demonstrate vertical integration of blue µLEDs with silicon membrane transistors for active matrix operation. Furthermore, these results establish routes to creating full-colour µLED displays for augmented and virtual reality, while also offering a generalizable platform for broader classes of three-dimensional integrated devices.
42 ENGINEERING↗
Data Visualization: Augmented Reality
In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.
42 ENGINEERING↗
A VR-based volumetric medical image segmentation and visualization system with natural human interaction
Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.
42 ENGINEERING↗
The Design and Performance of Low Cost Haptic Interfaces to Control Precision Nuclear Robotic System - 18351
Nuclear decommissioning environments are challenging and hazardous, typically involving high temperatures, pressures and extreme radiation. Robotic devices are commonly used to complete tasks within challenging environments, which would otherwise pose a risk to human health, however remotely operating robots without full three-dimensional vision is challenging, and operators of robotic systems require extensive training to enable precise navigation through three-dimensional environments using multiple two-dimensional views for feedback. This project explores the possibility of using a human arm as a master device for controlling a variety of low-cost slave robots, with the aim of reducing training times whilst providing a cheaper, more intuitive control system. Virtual Reality (VR) and haptics are used as an aid for navigation of the remote environment, whilst also providing a digital twin for the operator to enable real-time feedback from the slave robot. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Colloidal InAs Quantum Dot-Based Infrared Optoelectronics Enabled by Universal Dual-Ligand Passivation
Solution-processed low-bandgap semiconductors are crucial to next-generation infrared (IR) detection for various applications, such as autonomous driving, virtual reality, recognitions, and quantum communications. In particular, III–V group colloidal quantum dots (CQDs) are interesting as nontoxic bandgap-tunable materials and suitable for IR absorbers; however, the device performance is still lower than that of Pb-based devices. Herein, a universal surface-passivation method of InAs CQDs enabled by intermediate phase transfer (IPT), a preliminary process that exchanges native ligands with aromatic ligands on the CQD surface is presented. IPT yields highly stable CQD ink. In particular, desirable surface ligands with various reactivities can be obtained by dispersing them in green solvents. Furthermore, CQD near-infrared (NIR) photodetectors are demonstrated using solution processes. Careful surface ligand control via IPT is revealed that enables the modulation of surface-mediated photomultiplication, resulting in a notable gain control up to ≈10 with a fast rise/fall response time (≈12/36 ns). Considering the figure of merit (FOM), EQE versus response time (or –3 dB bandwidth), the optimal CQD photodiode yields one of the highest FOMs among all previously reported solution-processed nontoxic semiconductors comprising organics, perovskites, and CQDs in the NIR wavelength range.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Enhancements to VTK enabling Scientific Visualization in Immersive Environments
Modern scientific, engineering and medical computational sim- ulations, as well as experimental and observational data sens- ing/measuring devices, produce enormous amounts of data. While statistical analysis provides insight into this data, scientific vi- sualization is tactically important for scientific discovery, prod- uct design and data analysis. These benefits are impeded, how- ever, when scientific visualization algorithms are implemented from scratch—a time-consuming and redundant process in im- mersive application development. This process can greatly ben- efit from leveraging the state-of-the-art open-source Visualization Toolkit (VTK) and its community. Over the past two (almost three) decades, integrating VTK with a virtual reality (VR) environment has only been attempted to varying degrees of success. In this pa- per, we demonstrate two new approaches to simplify this amalga- mation of an immersive interface with visualization rendering from VTK. In addition, we cover several enhancements to VTK that pro- vide near real-time updates and efficient interaction. Finally, we demonstrate the combination of VTK with both Vrui and OpenVR immersive environments in example applications.
97 MATHEMATICS AND COMPUTING↗