Search NASA⌕ Search

SEARCH · Search NASA

Results for “virtual environments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Direct Manipulation in Virtual Reality

Virtual Reality interfaces offer several advantages for scientific visualization such as the ability to perceive three-dimensional data structures in a natural way. The focus of this chapter is direct manipulation, the ability for a user in virtual reality to control objects in the virtual environment in a direct and natural way, much as objects are manipulated in the real world. Direct manipulation provides many advantages for the exploration of complex, multi-dimensional data sets, by allowing the investigator the ability to intuitively explore the data environment. Because direct manipulation is essentially a control interface, it is better suited for the exploration and analysis of a data set than for the publishing or communication of features found in that data set. Thus direct manipulation is most relevant to the analysis of complex data that fills a volume of three-dimensional space, such as a fluid flow data set. Direct manipulation allows the intuitive exploration of that data, which facilitates the discovery of data features that would be difficult to find using more conventional visualization methods. Using a direct manipulation interface in virtual reality, an investigator can, for example, move a data probe about in space, watching the results and getting a sense of how the data varies within its spatial volume.

Bryson, Steve↗

Towards Autonomous Operations of the Robonaut 2 Humanoid Robotic Testbed

The Robonaut project has been conducting research in robotics technology on board the International Space Station (ISS) since 2012. Recently, the original upper body humanoid robot was upgraded by the addition of two climbing manipulators ("legs"), more capable processors, and new sensors, as shown in Figure 1. While Robonaut 2 (R2) has been working through checkout exercises on orbit following the upgrade, technology development on the ground has continued to advance. Through the Active Reduced Gravity Offload System (ARGOS), the Robonaut team has been able to develop technologies that will enable full operation of the robotic testbed on orbit using similar robots located at the Johnson Space Center. Once these technologies have been vetted in this way, they will be implemented and tested on the R2 unit on board the ISS. The goal of this work is to create a fully-featured robotics research platform on board the ISS to increase the technology readiness level of technologies that will aid in future exploration missions. Technology development has thus far followed two main paths, autonomous climbing and efficient tool manipulation. Central to both technologies has been the incorporation of a human robotic interaction paradigm that involves the visualization of sensory and pre-planned command data with models of the robot and its environment. Figure 2 shows screenshots of these interactive tools, built in rviz, that are used to develop and implement these technologies on R2. Robonaut 2 is designed to move along the handrails and seat track around the US lab inside the ISS. This is difficult for many reasons, namely the environment is cluttered and constrained, the robot has many degrees of freedom (DOF) it can utilize for climbing, and remote commanding for precision tasks such as grasping handrails is time-consuming and difficult. Because of this, it is important to develop the technologies needed to allow the robot to reach operator-specified positions as autonomously as possible. The most important progress in this area has been the work towards efficient path planning for high DOF, highly constrained systems. Other advances include machine vision algorithms for localizing and automatically docking with handrails, the ability of the operator to place obstacles in the robot's virtual environment, autonomous obstacle avoidance techniques, and constraint management.

Badger, Julia↗

Visualization Methods for Viability Studies of Inspection Modules for the Space Shuttle

An effective simulation of an object, process, or task must be similar to that object, process, or task. A simulation could consist of a physical device, a set of mathematical equations, a computer program, a person, or some combination of these. There are many reasons for the use of simulators. Although some of the reasons are unique to a specific situation, there are many general reasons and purposes for using simulators. Some are listed but not limited to (1) Safety, (2) Scarce resources, (3) Teaching/education, (4) Additional capabilities, (5) Flexibility and (6) Cost. Robot simulators are in use for all of these reasons. Virtual environments such as simulators will eliminate physical contact with humans and hence will increase the safety of work environment. Corporations with limited funding and resources may utilize simulators to accomplish their goals while saving manpower and money. A computer simulation is safer than working with a real robot. Robots are typically a scarce resource. Schools typically don t have a large number of robots, if any. Factories don t want the robots not performing useful work unless absolutely necessary. Robot simulators are useful in teaching robotics. A simulator gives a student hands-on experience, if only with a simulator. The simulator is more flexible. A user can quickly change the robot configuration, workcell, or even replace the robot with a different one altogether. In order to be useful, a robot simulator must create a model that accurately performs like the real robot. A powerful simulator is usually thought of as a combination of a CAD package with simulation capabilities. Computer Aided Design (CAD) techniques are used extensively by engineers in virtually all areas of engineering. Parts are designed interactively aided by the graphical display of both wireframe and more realistic shaded renderings. Once a part s dimensions have been specified to the CAD package, designers can view the part from any direction to examine how it will look and perform in relation to other parts. If changes are deemed necessary, the designer can easily make the changes and view the results graphically. However, a complex process of moving parts intended for operation in a complex environment can only be fully understood through the process of animated graphical simulation. A CAD package with simulation capabilities allows the designer to develop geometrical models of the process being designed, as well as the environment in which the process will be used, and then test the process in graphical animation much as the actual physical system would be run . By being able to operate the system of moving and stationary parts, the designer is able to see in simulation how the system will perform under a wide variety of conditions. If, for example, undesired collisions occur between parts of the system, design changes can be easily made without the expense or potential danger of testing the physical system.

Mobasher, Amir A.↗

ISEE System Technical Report

The Immersive Simulations and Engineering Environment (ISEE) Laboratory at Kennedy Space Center is a tool used to assist with operation simulation, for Human Factors operation activities, assisting future missions. The simulations created are important because they ensure that simulated operations are performed for customers, to assist with requirements. Simultaneously, each simulation will allow stakeholders to determine any and all risk associated with the Human Factors involved in a specific assignment. My internship consists of multiple project elements. The first of which, was to assist the Integrations branch chief in developing a growth rate algorithm proof. The integral part of this project, involved learning to powerup and perform the operational procedures of the ISEE lab, capturing and creating characters used in the CAD model virtual environment. In doing so, this led to use the software to model and 3D print screw cap structures for mock-up. The structures will be used to manipulate weight change out used in mock-up design and construction. These structures will also be used in future mock-up models constructed in the lab.

Darryl A J Minor↗

Using Transom Jack in the Human Engineering Analysis of the Materials Science Research Rack-1 and Quench Module Insert

This paper describes the human engineering analysis performed on the Materials Science Research Rack-1 and Quench Module Insert (MSRR-1/QMI) using Transom Jack (Jack) software. The Jack software was used to model a virtual environment consisting of the MSRR-1/QMI hardware configuration and human figures representing the 95th percentile male and 5th percentile female. The purpose of the simulation was to assess the human interfaces in the design for their ability to meet the requirements of the Pressurized Payloads Interface Requirements Document - International Space Program, Revision C (SSP 57000). Jack was used in the evaluation because of its ability to correctly model anthropometric body measurements and the physical behavior of astronauts working in microgravity, which is referred to as the neutral body posture. The Jack model allows evaluation of crewmember interaction with hardware through task simulation including but not limited to collision avoidance behaviors, hand/eye coordination, reach path planning, and automatic grasping to part contours. Specifically, this virtual simulation depicts the human figures performing the QMI installation and check-out, sample cartridge insertion and removal, and gas bottle drawer removal. These tasks were evaluated in terms of adequate clearance in reach envelopes, adequate accessibility in work envelopes, appropriate line of sight in visual envelopes, and accommodation of full size range for male and female stature maneuverability. The results of the human engineering analysis virtual simulation indicate that most of the associated requirements of SSP 57000 were met. However, some hardware design considerations and crew procedures modifications are recommended to improve accessibility, provide an adequate work envelope, reduce awkward body posture, and eliminate permanent protrusions.

Dunn, Mariea C.↗

Building Capacity for Policy-makers in a Virtual Setting: Providing Tools to Analyze Wildfire Smoke Plumes and Their Impacts

The NASA DEVELOP Program conducted 10-week long feasibility projects in a remote work setting, including partnering with The Nature Conservancy’s Washington Chapter and the Puget Sound Clean Air Agency to investigate wildfire smoke from 2000 - 2020 in the Pacific Northwest using satellite-derived data. The team engaged with platforms for collaboration both internally with NASA affiliates and externally with community organizations. Working from multiple states, the team members used a variety of software including Google Meet, Microsoft Teams, and Google Earth Engine to foster communication and work with data in a shared virtual environment. Throughout the project, the team learned that executing the project in a distanced work setting made it easier to reach out to scientists across the country for expertise and guidance. To study changes in air quality resulting from wildfire smoke, the team utilized data from NASA’s Fire Information from Resource Management System (FIRMS) and the ESA’s Sentinel-5 TROPOspheric Monitoring Instrument (TROPOMI). The team created a Google Earth Engine web-based tool, “Plume Hazards and Observations of Emissions by Navigating an Interactive eXplorer” (PHOENIX), to visualize changes in pollutants and aerosol optical depth after fire events. The potential relationship between plume height and fire radiative power was evaluated by using NASA’s Moderate Resolution Imaging Spectroradiometer (MODIS) aboard Aqua and Terra satellites and NASA’s Multi-angle Imaging SpectroRadiometer (MISR) aboard Terra with the MISR INteractive eXplorer (MINX). The PHOENIX smoke assessment tool and science communication infographics will be shared electronically with the partner organizations. Furthermore, the team introduced the partners to MINX and will provide a tailored tutorial that included a recorded video and a written component with a live virtual workshop. These resources build capacity for further research and education on wildfire smoke and air quality within communities.

NASA DEVELOP↗

Applications of telemedicine in the United States space program

Since the beginning of human space flight, NASA has been placing humans in extreme and remote environments. There are many challenges in maintaining humans in outer space, including the provision of life-support systems, radiation shielding, and countermeasures for minimizing the effect of microgravity. Because astronauts are selected for their health, among other factors, disease and illness are minimized. However, it is still of great importance to have appropriate medical care systems in place to address illness and injury should they occur. With the exception of the Apollo program, exploration of space has been limited to missions that are within several hundred miles of the surface of the Earth. At the drawn of the 21st century and the new millennium, human exploration will be focused on operation of the International Space Station (ISS) and preparation for human missions to Mars. These missions will present inherent risks to human health, and, therefore, appropriate plans must be established to address these challenges and risks. Crews of long-duration missions must become more independent from ground controllers. New systems, protocols, and procedures are currently being perfected. Application of emerging technologies in information systems and telecommunications will be critical to inflight medical care. Application of these technologies through telemedicine will provide crew members access to information, noninvasive procedures for assessing health status, and guidance through the integration of sensors, holography, decision-support systems, and virtual environments. These technologies will also serve as a basis to enhance training and medical education. The design of medical care for space flight should lead to a redesign of the practice of medicine on Earth.

Review, Tutorial↗

Simulation System for Training in Laparoscopic Surgery

A computer-based simulation system creates a visual and haptic virtual environment for training a medical practitioner in laparoscopic surgery. Heretofore, it has been common practice to perform training in partial laparoscopic surgical procedures by use of a laparoscopic training box that encloses a pair of laparoscopic tools, objects to be manipulated by the tools, and an endoscopic video camera. However, the surgical procedures simulated by use of a training box are usually poor imitations of the actual ones. The present computer-based system improves training by presenting a more realistic simulated environment to the trainee. The system includes a computer monitor that displays a real-time image of the affected interior region of the patient, showing laparoscopic instruments interacting with organs and tissues, as would be viewed by use of an endoscopic video camera and displayed to a surgeon during a laparoscopic operation. The system also includes laparoscopic tools that the trainee manipulates while observing the image on the computer monitor (see figure). The instrumentation on the tools consists of (1) position and orientation sensors that provide input data for the simulation and (2) actuators that provide force feedback to simulate the contact forces between the tools and tissues. The simulation software includes components that model the geometries of surgical tools, components that model the geometries and physical behaviors of soft tissues, and components that detect collisions between them. Using the measured positions and orientations of the tools, the software detects whether they are in contact with tissues. In the event of contact, the deformations of the tissues and contact forces are computed by use of the geometric and physical models. The image on the computer screen shows tissues deformed accordingly, while the actuators apply the corresponding forces to the distal ends of the tools. For the purpose of demonstration, the system has been set up to simulate the insertion of a flexible catheter in a bile duct. [As thus configured, the system can also be used to simulate other endoscopic procedures (e.g., bronchoscopy and colonoscopy) that include the insertion of flexible tubes into flexible ducts.] A hybrid approach has been followed in developing the software for real-time simulation of the visual and haptic interactions (1) between forceps and the catheter, (2) between the forceps and the duct, and (3) between the catheter and the duct. The deformations of the duct are simulated by finite-element and modalanalysis procedures, using only the most significant vibration modes of the duct for computing deformations and interaction forces. The catheter is modeled as a set of virtual particles uniformly distributed along the center line of the catheter and connected to each other via linear and torsional springs and damping elements. The interactions between the forceps and the duct as well as the catheter are simulated by use of a ray-based haptic-interaction- simulating technique in which the forceps are modeled as connected line segments.

Basdogan, Cagatay↗

Sensory conflict in motion sickness: An observer theory approach

Motion sickness is the general term describing a group of common nausea syndromes originally attributed to motion-induced cerebral ischemia, stimulation of abdominal organ afferent, or overstimulation of the vestibular organs of the inner ear. Sea-, car-, and airsicknesses are the most commonly experienced examples. However, the discovery of other variants such as Cinerama-, flight simulator-, spectacle-, and space sickness in which the physical motion of the head and body is normal or absent has led to a succession of sensory conflict theories which offer a more comprehensive etiologic perspective. Implicit in the conflict theory is the hypothesis that neutral and/or humoral signals originate in regions of the brain subversing spatial orientation, and that these signals somehow traverse to other centers mediating sickness symptoms. Unfortunately, the present understanding of the neurophysiological basis of motion sickness is far from complete. No sensory conflict neuron or process has yet been physiologically identified. To what extent can the existing theory be reconciled with current knowledge of the physiology and pharmacology of nausea and vomiting. The stimuli which causes sickness, synthesizes a contemporary Observer Theory view of the Sensory Conflict hypothesis are reviewed, and a revised model for the dynamic coupling between the putative conflict signals and nausea magnitude estimates is presented. The use of quantitative models for sensory conflict offers a possible new approach to improving the design of visual and motion systems for flight simulators and other virtual environment display systems.

Oman, Charles M.↗

Virtual acoustics displays

The real time acoustic display capabilities are described which were developed for the Virtual Environment Workstation (VIEW) Project at NASA-Ames. The acoustic display is capable of generating localized acoustic cues in real time over headphones. An auditory symbology, a related collection of representational auditory 'objects' or 'icons', can be designed using ACE (Auditory Cue Editor), which links both discrete and continuously varying acoustic parameters with information or events in the display. During a given display scenario, the symbology can be dynamically coordinated in real time with 3-D visual objects, speech, and gestural displays. The types of displays feasible with the system range from simple warnings and alarms to the acoustic representation of multidimensional data or events.

Wenzel, Elizabeth M.↗

Head-coupled remote stereoscopic camera system for telepresence applications

The Virtual Environment Workstation Project (VIEW) at NASA's Ames Research Center has developed a remotely controlled stereoscopic camera system that can be used for telepresence research and as a tool to develop and evaluate configurations for head-coupled visual systems associated with space station telerobots and remore manipulation robotic arms. The prototype camera system consists of two lightweight CCD video cameras mounted on a computer controlled platform that provides real-time pan, tilt, and roll control of the camera system in coordination with head position transmitted from the user. This paper provides an overall system description focused on the design and implementation of the camera and platform hardware configuration and the development of control software. Results of preliminary performance evaluations are reported with emphasis on engineering and mechanical design issues and discussion of related psychophysiological effects and objectives.

Bolas, M. T.↗

Experiments in teleoperator and autonomous control of space robotic vehicles

A research program and strategy are described which include fundamental teleoperation issues and autonomous-control issues of sensing and navigation for satellite robots. The program consists of developing interfaces for visual operation and studying the consequences of interface designs as well as developing navigation and control technologies based on visual interaction. A space-robot-vehicle simulator is under development for use in virtual-environment teleoperation experiments and neutral-buoyancy investigations. These technologies can be utilized in a study of visual interfaces to address tradeoffs between head-tracking and manual remote cameras, panel-mounted and helmet-mounted displays, and stereoscopic and monoscopic display systems. The present program can provide significant data for the development of control experiments for autonomously controlled satellite robots.

Alexander, Harold L.↗

Experiments in teleoperator and autonomous control of space robotic vehicles

A program of research embracing teleoperator and automatic navigational control of freely flying satellite robots is presented. Current research goals include: (1) developing visual operator interfaces for improved vehicle teleoperation; (2) determining the effects of different visual interface system designs on operator performance; and (3) achieving autonomous vision-based vehicle navigation and control. This research program combines virtual-environment teleoperation studies and neutral-buoyancy experiments using a space-robot simulator vehicle currently under development. Visual-interface design options under investigation include monoscopic versus stereoscopic displays and cameras, helmet-mounted versus panel-mounted display monitors, head-tracking versus fixed or manually steerable remote cameras, and the provision of vehicle-fixed visual cues, or markers, in the remote scene for improved sensing of vehicle position, orientation, and motion.

Alexander, Harold L.↗

Advanced training systems for the next decade and beyond

Autonomous training systems grouped under the term intelligent computer-aided training (ICAT) are described with references to their intelligent technologies. An ICAT system was developed for the deployment of the payload-assist module satellites from the Space Shuttle, fault detection in vacuum-vent lines on Spacelab, main-propulsion pneumatics, and for instrument pointing systems. The basic ICAT architecture is delineated with descriptions of elements such as the user interface, domain expert, traning-session manager, trainee model, and training-scenario generator. The ICAT systems employ advanced technologies including knowledge acquisition, virtual environments, and fuzzy logic. The general architecture of the ICAT systems is shown to be fully developed and applicable to the construction of seven different tasks, and the ICAT systems are concluded to enhance the training of aerospace personnel.

Loftin, R. B.↗

USRA/RIACS

The Research Institute for Advanced Computer Science (RIACS) was established by the Universities Space Research Association (USRA) at the NASA Ames Research Center (ARC) on June 6, 1983. RIACS is privately operated by USRA, a consortium of universities with research programs in the aerospace sciences, under a cooperative agreement with NASA. The primary mission of RIACS is to provide research and expertise in computer science and scientific computing to support the scientific missions of NASA ARC. The research carried out at RIACS must change its emphasis from year to year in response to NASA ARC's changing needs and technological opportunities. A flexible scientific staff is provided through a university faculty visitor program, a post doctoral program, and a student visitor program. Not only does this provide appropriate expertise but it also introduces scientists outside of NASA to NASA problems. A small group of core RIACS staff provides continuity and interacts with an ARC technical monitor and scientific advisory group to determine the RIACS mission. RIACS activities are reviewed and monitored by a USRA advisory council and ARC technical monitor. Research at RIACS is currently being done in the following areas: (1) parallel computing; (2) advanced methods for scientific computing; (3) learning systems; (4) high performance networks and technology; and (5) graphics, visualization, and virtual environments. In the past year, parallel compiler techniques and adaptive numerical methods for flows in complicated geometries were identified as important problems to investigate for ARC's involvement in the Computational Grand Challenges of the next decade. We concluded a summer student visitors program during this six months. We had six visiting graduate students that worked on projects over the summer and presented seminars on their work at the conclusion of their visits. RIACS technical reports are usually preprints of manuscripts that have been submitted to research journals or conference proceedings. A list of these reports for the period July 1, 1992 through December 31, 1992 is provided.

Oliger, Joseph↗

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.

Lee, Sukhan↗

Changes in the dark focus of accommodation associated with simulator sickness

The relationship between the dark focus of accommodation and simulator sickness, a form of motion sickness, was examined in three experiments. In Experiment 1, dark focus was measured in 18 college students in a laboratory setting before and after they viewed a projected motion scene depicting low altitude helicopter flight. In Experiments 2 and 3, dark focus was measured in pilots (N = 16 and 23, respectively) before and after they 'flew' in moving-base helicopter flight simulators with optical infinity CRT visual systems. The results showed that individuals who experienced simulator sickness had either an inward (myopic) change in dark focus (Experiments 1 and 3) or attenuated outward shifts in dark focus (Experiment 2) relative to participants who did not get sick. These results are consonant with the hypothesis that parasympathetic activity, which may be associated with simulator sickness, should result in changes in dark focus that are in a myopic direction. Night vision goggles, virtual environments, extended periods in microgravity, and heads-up displays all produce related visual symptomatology. Changes in dark focus may occur in these conditions, as well, and should be measured.

Fowlkes, Jennifer E.↗

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decision-making between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. A case study is performed to demonstrate the feasibility of implementing the fundamental theory and system architecture of interactive and cooperative sensing and control, proposed for the new generation of teleoperation.

Lee, Sukhan↗