Search NASASearch

SEARCH · Search NASA

Results for “Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A Hybrid Synthetic Vision System for the Tele-operation of Unmanned Vehicles

A system called SmartCam3D (SC3D) has been developed to provide enhanced situational awareness for operators of a remotely piloted vehicle. SC3D is a Hybrid Synthetic Vision System (HSVS) that combines live sensor data with information from a Synthetic Vision System (SVS). By combining the dual information sources, the operators are afforded the advantages of each approach. The live sensor system provides real-time information for the region of interest. The SVS provides information rich visuals that will function under all weather and visibility conditions. Additionally, the combination of technologies allows the system to circumvent some of the limitations from each approach. Video sensor systems are not very useful when visibility conditions are hampered by rain, snow, sand, fog, and smoke, while a SVS can suffer from data freshness problems. Typically, an aircraft or satellite flying overhead collects the data used to create the SVS visuals. The SVS data could have been collected weeks, months, or even years ago. To that extent, the information from an SVS visual could be outdated and possibly inaccurate. SC3D was used in the remote cockpit during flight tests of the X-38 132 and 131R vehicles at the NASA Dryden Flight Research Center. SC3D was also used during the operation of military Unmanned Aerial Vehicles. This presentation will provide an overview of the system, the evolution of the system, the results of flight tests, and future plans. Furthermore, the safety benefits of the SC3D over traditional and pure synthetic vision systems will be discussed.

Delgado, Frank

NASA Utilization of the International Space Station and the Vision for Space Exploration

In response to the U.S. President s Vision for Space Exploration (January 14, 2004), NASA has revised its utilization plans for ISS to focus on (1) research on astronaut health and the development of countermeasures that will protect our crews from the space environment during long duration voyages, (2) ISS as a test bed for research and technology developments that will insure vehicle systems and operational practices are ready for future exploration missions, (3) developing and validating operational practices and procedures for long-duration space missions. In addition, NASA will continue a small amount of fundamental research in life and microgravity sciences. There have been significant research accomplishments that are important for achieving the Exploration Vision. Some of these have been formal research payloads, while others have come from research based on the operation of International Space Station (ISS). We will review a selection of these experiments and results, as well as outline some of ongoing and upcoming research. The ISS represents the only microgravity opportunity to perform on-orbit long-duration studies of human health and performance and technologies relevant for future long-duration missions planned during the next 25 years. Even as NASA focuses on developing the Orion spacecraft and return to the moon (2015-2020), research on and operation of the ISS is fundamental to the success of NASA s Exploration Vision.

Robinson, Julie A.

Multi-Dimensionality of Synthetic Vision Cockpit Displays: Prevention of Controlled-Flight-Into-Terrain

NASA's Synthetic Vision Systems (SVS) project is developing technologies with practical applications that will help to eliminate low visibility conditions as a causal factor to civil aircraft accidents while replicating the operational benefits of clear day flight operations, regardless of the actual outside visibility condition. The paper describes experimental evaluation of a multi-mode 3-D exocentric synthetic vision navigation display concept for commercial aircraft. Experimental results showed the situation awareness benefits of 2-D and 3-D exocentric synthetic vision displays over traditional 2-D co-planar navigation and vertical situation displays. Conclusions and future research directions are discussed.

Prinzel, Lawrence J., III

NASA Utilization of the International Space Station and the Vision for Space Exploration

In response to the U.S. President's Vision for Space Exploration (January 14, 2004), NASA has revised its utilization plans for ISS to focus on (1) research on astronaut health and the development of countermeasures that will protect our crews from the space environment during long duration voyages, (2) ISS as a test bed for research and technology developments that will insure vehicle systems and operational practices are ready for future exploration missions, (3) developing and validating operational practices and procedures for long-duration space missions. In addition, NASA will continue a small amount of fundamental research in life and microgravity sciences. There have been significant research accomplishments that are important for achieving the Exploration Vision. Some of these have been formal research payloads, while others have come from research based on the operation of International Space Station (ISS). We will review a selection of these experiments and results, as well as outline some of ongoing and upcoming research. The ISS represents the only microgravity opportunity to perform on-orbit long-duration studies of human health and performance and technologies relevant for future long-duration missions planned during the next 25 years. Even as NASA focuses on developing the Orion spacecraft and return to the moon (2015-2020), research on and operation of the ISS is fundamental to the success of NASA s Exploration Vision.

Robinson, Julie A.

Stroboscopic Vision as a Treatment for Space Motion Sickness

Results obtained from space flight indicate that most space crews will experience some symptoms of motion sickness causing significant impact on the operational objectives that must be accomplished to assure mission success. Based on the initial work of Melvill Jones we have evaluated stroboscopic vision as a method of preventing motion sickness. Given that the data presented by professor Melvill Jones were primarily post hoc results following a study not designed to investigate motion sickness, it is unclear how motion sickness results were actually determined. Building on these original results, we undertook a three part study that was designed to investigate the effect of stroboscopic vision (either with a strobe light or LCD shutter glasses) on motion sickness using: (1) visual field reversal, (2) Reading while riding in a car (with or without external vision present), and (3) making large pitch head movements during parabolic flight.

Reschke, Millard F.

NASA Utilization of the International Space Station and the Vision for Space Exploration

In response to the U.S. President s Vision for Space Exploration (January 14, 2004), NASA has revised its utilization plans for ISS to focus on (1) research on astronaut health and the development of countermeasures that will protect our crews from the space environment during long duration voyages, (2) ISS as a test bed for research and technology developments that will insure vehicle systems and operational practices are ready for future exploration missions, (3) developing and validating operational practices and procedures for long-duration space missions. In addition, NASA will continue a small amount of fundamental research in life and microgravity sciences. There have been significant research accomplishments that are important for achieving the Exploration Vision. Some of these have been formal research payloads, while others have come from research based on the operation of International Space Station (ISS). We will review a selection of these experiments and results, as well as outline some of ongoing and upcoming research. The ISS represents the only microgravity opportunity to perform on-orbit long-duration studies of human health and performance and technologies relevant for future long-duration missions planned during the next 25 years. Even as NASA focuses on developing the Orion spacecraft and return to the moon (2015-2020), research on and operation of the ISS is fundamental to the success of NASA s Exploration Vision.

Robinson, Julie A.

Synthetic Vision Systems - Operational Considerations Simulation Experiment

Synthetic vision is a computer-generated image of the external scene topography that is generated from aircraft attitude, high-precision navigation information, and data of the terrain, obstacles, cultural features, and other required flight information. A synthetic vision system (SVS) enhances this basic functionality with real-time integrity to ensure the validity of the databases, perform obstacle detection and independent navigation accuracy verification, and provide traffic surveillance. Over the last five years, NASA and its industry partners have developed and deployed SVS technologies for commercial, business, and general aviation aircraft which have been shown to provide significant improvements in terrain awareness and reductions in the potential for Controlled-Flight-Into-Terrain incidents/accidents compared to current generation cockpit technologies. It has been hypothesized that SVS displays can greatly improve the safety and operational flexibility of flight in Instrument Meteorological Conditions (IMC) to a level comparable to clear-day Visual Meteorological Conditions (VMC), regardless of actual weather conditions or time of day. An experiment was conducted to evaluate SVS and SVS-related technologies as well as the influence of where the information is provided to the pilot (e.g., on a Head-Up or Head-Down Display) for consideration in defining landing minima based upon aircraft and airport equipage. The "operational considerations" evaluated under this effort included reduced visibility, decision altitudes, and airport equipage requirements, such as approach lighting systems, for SVS-equipped aircraft. Subjective results from the present study suggest that synthetic vision imagery on both head-up and head-down displays may offer benefits in situation awareness; workload; and approach and landing performance in the visibility levels, approach lighting systems, and decision altitudes tested.

Kramer, Lynda J.

Simulation Evaluation of Synthetic Vision as an Enabling Technology for Equivalent Visual Operations

Enhanced Vision (EV) and synthetic vision (SV) systems may serve as enabling technologies to meet the challenges of the Next Generation Air Transportation System (NextGen) Equivalent Visual Operations (EVO) concept ? that is, the ability to achieve or even improve on the safety of Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and even, perhaps, retain VFR procedures independent of actual weather and visibility conditions. One significant challenge lies in the definition of required equipage on the aircraft and on the airport to enable the EVO concept objective. A piloted simulation experiment was conducted to evaluate the effects of the presence or absence of Synthetic Vision, the location of this information during an instrument approach (i.e., on a Head-Up or Head-Down Primary Flight Display), and the type of airport lighting information on landing minima. The quantitative data from this experiment were analyzed to begin the definition of performance-based criteria for all-weather approach and landing operations. Objective results from the present study showed that better approach performance was attainable with the head-up display (HUD) compared to the head-down display (HDD). A slight performance improvement in HDD performance was shown when SV was added, as the pilots descended below 200 ft to a 100 ft decision altitude, but this performance was not tested for statistical significance (nor was it expected to be statistically significant). The touchdown data showed that regardless of the display concept flown (SV HUD, Baseline HUD, SV HDD, Baseline HDD) a majority of the runs were within the performance-based defined approach and landing criteria in all the visibility levels, approach lighting systems, and decision altitudes tested. For this visual flight maneuver, RVR appeared to be the most significant influence in touchdown performance. The approach lighting system clearly impacted the pilot's ability to descend to 100 ft height above touchdown based on existing Federal Aviation Regulation (FAR) 91.175 using a 200 ft decision height, but did not appear to influence touchdown performance or approach path maintenance

Kramer, Lynda J.

Synthetic Vision Displays for Planetary and Lunar Lander Vehicles

Aviation research has demonstrated that Synthetic Vision (SV) technology can substantially enhance situation awareness, reduce pilot workload, improve aviation safety, and promote flight path control precision. SV, and related flight deck technologies are currently being extended for application in planetary exploration vehicles. SV, in particular, holds significant potential for many planetary missions since the SV presentation provides a computer-generated view for the flight crew of the terrain and other significant environmental characteristics independent of the outside visibility conditions, window locations, or vehicle attributes. SV allows unconstrained control of the computer-generated scene lighting, terrain coloring, and virtual camera angles which may provide invaluable visual cues to pilots/astronauts, not available from other vision technologies. In addition, important vehicle state information may be conformally displayed on the view such as forward and down velocities, altitude, and fuel remaining to enhance trajectory control and vehicle system status. The paper accompanies a conference demonstration that introduced a prototype NASA Synthetic Vision system for lunar lander spacecraft. The paper will describe technical challenges and potential solutions to SV applications for the lunar landing mission, including the requirements for high-resolution lunar terrain maps, accurate positioning and orientation, and lunar cockpit display concepts to support projected mission challenges.

Arthur, Jarvis J., III

Vision System Measures Motions of Robot and External Objects

A prototype of an advanced robotic vision system both (1) measures its own motion with respect to a stationary background and (2) detects other moving objects and estimates their motions, all by use of visual cues. Like some prior robotic and other optoelectronic vision systems, this system is based partly on concepts of optical flow and visual odometry. Whereas prior optoelectronic visual-odometry systems have been limited to frame rates of no more than 1 Hz, a visual-odometry subsystem that is part of this system operates at a frame rate of 60 to 200 Hz, given optical-flow estimates. The overall system operates at an effective frame rate of 12 Hz. Moreover, unlike prior machine-vision systems for detecting motions of external objects, this system need not remain stationary: it can detect such motions while it is moving (even vibrating). The system includes a stereoscopic pair of cameras mounted on a moving robot. The outputs of the cameras are digitized, then processed to extract positions and velocities. The initial image-data-processing functions of this system are the same as those of some prior systems: Stereoscopy is used to compute three-dimensional (3D) positions for all pixels in the camera images. For each pixel of each image, optical flow between successive image frames is used to compute the two-dimensional (2D) apparent relative translational motion of the point transverse to the line of sight of the camera. The challenge in designing this system was to provide for utilization of the 3D information from stereoscopy in conjunction with the 2D information from optical flow to distinguish between motion of the camera pair and motions of external objects, compute the motion of the camera pair in all six degrees of translational and rotational freedom, and robustly estimate the motions of external objects, all in real time. To meet this challenge, the system is designed to perform the following image-data-processing functions: The visual-odometry subsystem (the subsystem that estimates the motion of the camera pair relative to the stationary background) utilizes the 3D information from stereoscopy and the 2D information from optical flow. It computes the relationship between the 3D and 2D motions and uses a least-mean-squares technique to estimate motion parameters. The least-mean-squares technique is suitable for real-time implementation when the number of external-moving-object pixels is smaller than the number of stationary-background pixels.

Talukder, Ashit

Simulation Evaluation of Equivalent Vision Technologies for Aerospace Operations

A fixed-based simulation experiment was conducted in NASA Langley Research Center s Integration Flight Deck simulator to investigate enabling technologies for equivalent visual operations (EVO) in the emerging Next Generation Air Transportation System operating environment. EVO implies the capability to achieve or even improve on the safety of current-day Visual Flight Rules (VFR) operations, maintain the operational tempos of VFR, and perhaps even retain VFR procedures - all independent of the actual weather and visibility conditions. Twenty-four air transport-rated pilots evaluated the use of Synthetic/Enhanced Vision Systems (S/EVS) and eXternal Vision Systems (XVS) technologies as enabling technologies for future all-weather operations. The experimental objectives were to determine the feasibility of XVS/SVS/EVS to provide for all weather (visibility) landing capability without the need (or ability) for a visual approach segment and to determine the interaction of XVS/EVS and peripheral vision cues for terminal area and surface operations. Another key element of the testing investigated the pilot's awareness and reaction to non-normal events (i.e., failure conditions) that were unexpectedly introduced into the experiment. These non-normal runs served as critical determinants in the underlying safety of all-weather operations. Experimental data from this test are cast into performance-based approach and landing standards which might establish a basis for future all-weather landing operations. Glideslope tracking performance appears to have improved with the elimination of the approach visual segment. This improvement can most likely be attributed to the fact that the pilots didn't have to simultaneously perform glideslope corrections and find required visual landing references in order to continue a landing. Lateral tracking performance was excellent regardless of the display concept being evaluated or whether or not there were peripheral cues in the side window. Although workload ratings were significantly less when peripheral cues were present compared to when there were none, these differences appear to be operationally inconsequential. Larger display concepts tested in this experiment showed significant situation awareness (SA) improvements and workload reductions compared to smaller display concepts. With a fixed display size, a color display was more influential in SA and workload ratings than a collimated display.

Kramer, Lynda J.

Robot Vision Library

The JPL Robot Vision Library (JPLV) provides real-time robot vision algorithms for developers who are not vision specialists. The package includes algorithms for stereo ranging, visual odometry and unsurveyed camera calibration, and has unique support for very wideangle lenses

Howard, Andrew B.

The Effects of Synthetic and Enhanced Vision Technologies for Lunar Landings

Eight pilots participated as test subjects in a fixed-based simulation experiment to evaluate advanced vision display technologies such as Enhanced Vision (EV) and Synthetic Vision (SV) for providing terrain imagery on flight displays in a Lunar Lander Vehicle. Subjects were asked to fly 20 approaches to the Apollo 15 lunar landing site with four different display concepts - Baseline (symbology only with no terrain imagery), EV only (terrain imagery from Forward Looking Infra Red, or FLIR, and LIght Detection and Ranging, or LIDAR, sensors), SV only (terrain imagery from onboard database), and Fused EV and SV concepts. As expected, manual landing performance was excellent (within a meter of landing site center) and not affected by the inclusion of EV or SV terrain imagery on the Lunar Lander flight displays. Subjective ratings revealed significant situation awareness improvements with the concepts employing EV and/or SV terrain imagery compared to the Baseline condition that had no terrain imagery. In addition, display concepts employing EV imagery (compared to the SV and Baseline concepts which had none) were significantly better for pilot detection of intentional but unannounced navigation failures since this imagery provided an intuitive and obvious visual methodology to monitor the validity of the navigation solution.

Kramer, Lynda J.

Stereoscopic Machine-Vision System Using Projected Circles

A machine-vision system capable of detecting obstacles large enough to damage or trap a robotic vehicle is undergoing development. The system includes (1) a pattern generator that projects concentric circles of laser light forward onto the terrain, (2) a stereoscopic pair of cameras that are aimed forward to acquire images of the circles, (3) a frame grabber and digitizer for acquiring image data from the cameras, and (4) a single-board computer that processes the data. The system is being developed as a prototype of machine- vision systems to enable robotic vehicles ( rovers ) on remote planets to avoid craters, large rocks, and other terrain features that could capture or damage the vehicles. Potential terrestrial applications of systems like this one could include terrain mapping, collision avoidance, navigation of robotic vehicles, mining, and robotic rescue. This system is based partly on the same principles as those of a prior stereoscopic machine-vision system in which the cameras acquire images of a single stripe of laser light that is swept forward across the terrain. However, this system is designed to afford improvements over some of the undesirable features of the prior system, including the need for a pan-and-tilt mechanism to aim the laser to generate the swept stripe, ambiguities in interpretation of the single-stripe image, the time needed to sweep the stripe across the terrain and process the data from many images acquired during that time, and difficulty of calibration because of the narrowness of the stripe. In this system, the pattern generator does not contain any moving parts and need not be mounted on a pan-and-tilt mechanism: the pattern of concentric circles is projected steadily in the forward direction. The system calibrates itself by use of data acquired during projection of the concentric-circle pattern onto a known target representing flat ground. The calibration- target image data are stored in the computer memory for use as a template in processing terrain images. During operation on terrain, the images acquired by the left and right cameras are analyzed. The analysis includes (1) computation of the horizontal and vertical dimensions and the aspect ratios of rectangles that bound the circle images and (2) comparison of these aspect ratios with those of the template. Coordinates of distortions of the circles are used to identify and locate objects. If the analysis leads to identification of an object of significant size, then stereoscopicvision algorithms are used to estimate the distance to the object. The time taken in performing this analysis on a single pair of images acquired by the left and right cameras in this system is a fraction of the time taken in processing the many pairs of images acquired in a sweep of the laser stripe across the field of view in the prior system. The results of the analysis include data on sizes and shapes of, and distances and directions to, objects. Coordinates of objects are updated as the vehicle moves so that intelligent decisions regarding speed and direction can be made. The results of the analysis are utilized in a computational decision-making process that generates obstacle-avoidance data and feeds those data to the control system of the robotic vehicle.

Mackey, Jeffrey R.

Enhanced Vision for All-Weather Operations Under NextGen

Recent research in Synthetic/Enhanced Vision technology is analyzed with respect to existing Category II/III performance and certification guidance. The goal is to start the development of performance-based vision systems technology requirements to support future all-weather operations and the NextGen goal of Equivalent Visual Operations. This work shows that existing criteria to operate in Category III weather and visibility are not directly applicable since, unlike today, the primary reference for maneuvering the airplane is based on what the pilot sees visually through the "vision system." New criteria are consequently needed. Several possible criteria are discussed, but more importantly, the factors associated with landing system performance using automatic and manual landings are delineated.

Bailey, Randall E.

Enhanced and Synthetic Vision for Terminal Maneuvering Area NextGen Operations

Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment with equivalent efficiency as visual operations. To meet this potential, research is needed for effective technology development and implementation of regulatory and design guidance to support introduction and use of SVS/EFVS advanced cockpit vision technologies in Next Generation Air Transportation System (NextGen) operations. A fixed-base pilot-in-the-loop simulation test was conducted at NASA Langley Research Center that evaluated the use of SVS/EFVS in NextGen low visibility ground (taxi) operations and approach/landing operations. Twelve crews flew approach and landing operations in a simulated NextGen Chicago O Hare environment. Various scenarios tested the potential for EFVS for operations in visibility as low as 1000 ft runway visibility range (RVR) and SVS to enable lower decision heights (DH) than can currently be flown today. Expanding the EFVS visual segment from DH to the runway in visibilities as low as 1000 RVR appears to be viable as touchdown performance was excellent without any workload penalties noted for the EFVS concept tested. A lower DH to 150 ft and/or possibly reduced visibility minima by virtue of SVS equipage appears to be viable when implemented on a Head-Up Display, but the landing data suggests further study for head-down implementations.

Kramer, Lynda J.

Flight Deck-Based Delegated Separation: Evaluation of an On-Board Interval Management System with Synthetic and Enhanced Vision Technology

An emerging Next Generation Air Transportation System concept - Equivalent Visual Operations (EVO) - can be achieved using an electronic means to provide sufficient visibility of the external world and other required flight references on flight deck displays that enable the safety, operational tempos, and visual flight rules (VFR)-like procedures for all weather conditions. Synthetic and enhanced flight vision system technologies are critical enabling technologies to EVO. Current research evaluated concepts for flight deck-based interval management (FIM) operations, integrated with Synthetic Vision and Enhanced Vision flight-deck displays and technologies. One concept involves delegated flight deck-based separation, in which the flight crews were paired with another aircraft and responsible for spacing and maintaining separation from the paired aircraft, termed, "equivalent visual separation." The operation required the flight crews to acquire and maintain an "equivalent visual contact" as well as to conduct manual landings in low-visibility conditions. The paper describes results that evaluated the concept of EVO delegated separation, including an off-nominal scenario in which the lead aircraft was not able to conform to the assigned spacing resulting in a loss of separation.

Prinzel, Lawrence J., III

Contribution of Spaceflight Environmental Factors to Vision Risks

The risk of visual impairment and elevated intracranial pressure as a result of low-earth orbit microgravity exposure has directed our attention and research efforts to the eye. While the alterations observed in astronauts returning from long duration missions include vision and neuroanatomical changes observed by non-invasive methods, other effects and subsequent tissue responses at the molecular and cellular level can only be studied by accessing the tissue itself. As a result of this need, several studies are currently taking place within the Human and Health Countermeasures Element (HHC) that use animal models for eye research. The rodent eye has many similarities to the human eye, and both rats and mice have historically been used as models of human eye disease, aiding in the identification of the disease genes, elucidation of mechanisms of disease, as well as in the assessment of therapeutic treatments. These studies attempt to answer two central questions in the etiology of possible vision alterations in the environment of space exploration missions. The first is: what effects and response mechanisms take place in the different eye structures at the cellular and molecular level? The second question is directed to elucidate the contribution of the various environmental stressors (radiation, nutrition, fluid shift) to these effects. Collaborative approaches with internal and external investigators have allowed performing these studies in a most cost-effective fashion, providing preliminary data and laying the bases for testing further hypotheses in future and specifically designed animal experiments. From a study centered on the radioadaptive response in mice, we have learned that the retina responds to low and high dose gamma radiation by elevating antioxidant-related genes at early time points (4hrs) and that this response returns to control levels after 1 day post-irradiation. We are expanding this research with another collaborative study that investigates the combined effects of radiation exposure and iron overload on sensitivity to radiation injury in rat eyes. All main eye structures will be analyzed in this study: retina, lens and cornea. A study in collaboration with the Space Human Factors and Habitability Element (SHFH) investigates the effects of lunar dust exposure on the rat cornea. It is anticipated that common underlying oxidative stress mechanisms of damage may be observed as a result of these three stressors: radiation, nutritional iron and lunar dust. The contribution of fluid shift is addressed by a study using rats subjected to hindlimb suspension. The hypothesis to be tested in this study is that the mechanical stress imparted by the pressure differential across the optic disc and lamina cribosa will impact oxygenation (therefore causing oxidative stress and hypoxia) and cell survival. This study also includes the assessment of two nutritional antioxidant countermeasures: epigallocatechin gallate (green tea) and resveratrol. Finally, as a result of two successful tissue sharing efforts, we are proceeding with the analysis of eye samples of mice aboard two shuttle missions: STS-133 and STS-135. Results from the STS-133 study are presented in an independent abstract. Briefly, the results show that spaceflight represents a source of environmental stress that directly translates into oxidative and cellular stress in the retina. Similar analysis is also planned for the cornea. These samples add large value to our current vision research as they provide data on the direct effects of low-earth orbit spaceflight on eye structures and physiology.

Zanello, Susana B.