Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Camera Simulation for the Perseverance Rover’s Lander Vision System

On February 18, 2021, the Perseverance Rover safely landed on Mars at Jezero Crater. Part of the successful landing was due to the Lander Vision System (LVS), which takes descent images from the LVS Camera (LCAM) and IMU measurements and estimates the lander position relative to a map of the Jezero landing site. The LVS Simulation LCAM (LVSS LCAM) model is an image rendering program developed to test the LVS in a variety of scenarios to ensure performance amid uncertainty. The LVSS LCAM model includes a pointing misalignment model, an exposure timing model, shadowing, a terrain reflectance model, atmospheric attenuation from dust, and sensor effects. This model was used for performance analysis, verification, and validation of the LVS algorithms in a Mars-like simulation prior to landing. This paper describes the LVSS LCAM rendering algorithm and compares flight images from LVS operation during the Perseverance landing with their rendered counterparts.

Zheng, Jason↗
NASA NTRS1989

A fast 3-D object recognition algorithm for the vision system of a special-purpose dexterous manipulator

A fast 3-D object recognition algorithm that can be used as a quick-look subsystem to the vision system for the Special-Purpose Dexterous Manipulator (SPDM) is described. Global features that can be easily computed from range data are used to characterize the images of a viewer-centered model of an object. This algorithm will speed up the processing by eliminating the low level processing whenever possible. It may identify the object, reject a set of bad data in the early stage, or create a better environment for a more powerful algorithm to carry the work further.

Hung, Stephen H. Y.↗
NASA NTRS2002

Preliminary Effect of Synthetic Vision Systems Displays to Reduce Low-Visibility Loss of Control and Controlled Flight Into Terrain Accidents

An experimental investigation was conducted to study the effectiveness of Synthetic Vision Systems (SVS) flight displays as a means of eliminating Low Visibility Loss of Control (LVLOC) and Controlled Flight Into Terrain (CFIT) accidents by low time general aviation (GA) pilots. A series of basic maneuvers were performed by 18 subject pilots during transition from Visual Meteorological Conditions (VMC) to Instrument Meteorological Conditions (IMC), with continued flight into IMC, employing a fixed-based flight simulator. A total of three display concepts were employed for this evaluation. One display concept, referred to as the Attitude Indicator (AI) replicated instrumentation common in today's General Aviation (GA) aircraft. The second display concept, referred to as the Electronic Attitude Indicator (EAI), featured an enlarged attitude indicator that was more representative of a glass display that also included advanced flight symbology, such as a velocity vector. The third concept, referred to as the SVS display, was identical to the EAI except that computer-generated terrain imagery replaced the conventional blue-sky/brown-ground of the EAI. Pilot performance parameters, pilot control inputs and physiological data were recorded for post-test analysis. Situation awareness (SA) and qualitative pilot comments were obtained through questionnaires and free-form interviews administered immediately after the experimental session. Initial pilot performance data were obtained by instructor pilot observations. Physiological data (skin temperature, heart rate, and muscle flexure) were also recorded. Preliminary results indicate that far less errors were committed when using the EAI and SVS displays than when using conventional instruments. The specific data example examined in this report illustrates the benefit from SVS displays to avoid massive loss of SA conditions. All pilots acknowledged the enhanced situation awareness provided by the SVS display concept. Levels of pilot stress appear to be correlated with skin temperature measurements.

Glaab, Louis J.↗
NASA NTRS1991

A computer vision system for the recognition of trees in aerial photographs

Increasing problems of forest damage in Central Europe set the demand for an appropriate forest damage assessment tool. The Vision Expert System (VES) is presented which is capable of finding trees in color infrared aerial photographs. Concept and architecture of VES are discussed briefly. The system is applied to a multisource test data set. The processing of this multisource data set leads to a multiple interpretation result for one scene. An integration of these results will provide a better scene description by the vision system. This is achieved by an implementation of Steven's correlation algorithm.

Pinz, Axel J.↗
NASA NTRS2018

Cobalt: Terrestrial Flight Test of Landing Navigation Using Lander Vision System with Navigation Doppler Lidar

COBALT (CoOperative Blending of Autonomous Landing Technologies) is a NASA technology development and test program to advance precision landing capabilities for future soft landers. The COBALT payload demonstrated terrain relative navigation utilizing the Lander Vision System and Navigation Doppler Lidar sensors on the Masten Space Systems Xodiac rocket. In spring 2017, the program culminated in two open-loop free flights to 500 m altitude with downrange diverts of 300 m. The COBALT system performed well, navigating within meters of the Xodiac vehicle’s GPS-based solution. This paper outlines details of the navigation filter and its performance during the test campaign.

Carson, John M. III↗
NASA NTRS1989

The 3-D vision system integrated dexterous hand

Most multifingered hands use a tendon mechanism to minimize the size and weight of the hand. Such tendon mechanisms suffer from the problems of striction and friction of the tendons resulting in a reduction of control accuracy. A design for a 3-D vision system integrated dexterous hand with motor control is described which overcomes these problems. The proposed hand is composed of three three-jointed grasping fingers with tactile sensors on their tips, a two-jointed eye finger with a cross-shaped laser beam emitting diode in its distal part. The two non-grasping fingers allow 3-D vision capability and can rotate around the hand to see and measure the sides of grasped objects and the task environment. An algorithm that determines the range and local orientation of the contact surface using a cross-shaped laser beam is introduced along with some potential applications. An efficient method for finger force calculation is presented which uses the measured contact surface normals of an object.

Luo, Ren C.↗
NASA NTRS1992

Development of a machine vision system for automated structural assembly

Research is being conducted at the LaRC to develop a telerobotic assembly system designed to construct large space truss structures. This research program was initiated within the past several years, and a ground-based test-bed was developed to evaluate and expand the state of the art. Test-bed operations currently use predetermined ('taught') points for truss structural assembly. Total dependence on the use of taught points for joint receptacle capture and strut installation is neither robust nor reliable enough for space operations. Therefore, a machine vision sensor guidance system is being developed to locate and guide the robot to a passive target mounted on the truss joint receptacle. The vision system hardware includes a miniature video camera, passive targets mounted on the joint receptacles, target illumination hardware, and an image processing system. Discrimination of the target from background clutter is accomplished through standard digital processing techniques. Once the target is identified, a pose estimation algorithm is invoked to determine the location, in three-dimensional space, of the target relative to the robots end-effector. Preliminary test results of the vision system in the Automated Structural Assembly Laboratory with a range of lighting and background conditions indicate that it is fully capable of successfully identifying joint receptacle targets throughout the required operational range. Controlled optical bench test results indicate that the system can also provide the pose estimation accuracy to define the target position.

Sydow, P. Daniel↗
NASA NTRS2014

External Vision Systems (XVS) Proof-of-Concept Flight Test Evaluation

NASA's Fundamental Aeronautics Program, High Speed Project is performing research, development, test and evaluation of flight deck and related technologies to support future low-boom, supersonic configurations (without forward-facing windows) by use of an eXternal Vision System (XVS). The challenge of XVS is to determine a combination of sensor and display technologies which can provide an equivalent level of safety and performance to that provided by forward-facing windows in today's aircraft. This flight test was conducted with the goal of obtaining performance data on see-and-avoid and see-to-follow traffic using a proof-of-concept XVS design in actual flight conditions. Six data collection flights were flown in four traffic scenarios against two different sized participating traffic aircraft. This test utilized a 3x1 array of High Definition (HD) cameras, with a fixed forward field-of-view, mounted on NASA Langley's UC-12 test aircraft. Test scenarios, with participating NASA aircraft serving as traffic, were presented to two evaluation pilots per flight - one using the proof-of-concept (POC) XVS and the other looking out the forward windows. The camera images were presented on the XVS display in the aft cabin with Head-Up Display (HUD)-like flight symbology overlaying the real-time imagery. The test generated XVS performance data, including comparisons to natural vision, and post-run subjective acceptability data were also collected. This paper discusses the flight test activities, its operational challenges, and summarizes the findings to date.

Shelton, Kevin J.↗
NASA NTRS2017

The Lander Vision System for Mars 2020 Entry Descent and Landing

In January 2016, the Mars 2020 project added Terrain Relative Navigation to the project baseline. This new capability helps the mission avoid large hazards in the landing ellipse, which enables the consideration of landing sites that more geologically diverse than before. This diversity should improve the quality of the samples collected by Mars 2020 for possible future return to earth. The Lander Vision System (LVS) is the sensor that provides the position fix that is used to determine where to land between hazards identified in orbital data prior to landing. This paper describes the LVS flight design for Mars 2020, a high-fidelity simulation used as a design tool and the expected LVS performance for Mars 2020.

Johnson, Andrew↗
NASA NTRS1988

Automatic inspection of analog and digital meters in a robot vision system

A critical limitation of most of the robots utilized in industrial environments arises due to their inability to utilize sensory feedback. This forces robot operation into totally preprogrammed or teleoperation modes. In order to endow the new generation of robots with higher levels of autonomy techniques for sensing of their work environments and for accurate and efficient analysis of the sensory data must be developed. In this paper detailed development of vision system modules for inspecting various types of meters, both analog and digital, encountered in a robotic inspection and manipulation tasks are described. These modules are tested using industrial robots having multisensory input capability.

Trivedi, Mohan M.↗
DOE OSTI2024

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗
NASA NTRS2022

Mars 2020 Lander Vision System Flight Performance 1

The Mars 2020 Entry Descent and Landing (EDL) system delivered the Perseverance rover to the surface of Mars on February 18th, 2021. A large fraction of the Jezero Crater landing site was covered with landing hazards including cliffs, inescapable dune fields and rocks. These hazards were identified or inferred using orbital imagery before launch so that they could be avoided using Terrain Relative Navigation (TRN) which was composed of two parts: the Lander Vision System (LVS) and Safe Target Selection (STS). During EDL, the LVS successfully estimated map relative position by fusing landmarks matched between descent imagery and a map of the landing site with Inertial Measurement Unit (IMU) data. This position estimate was used by STS to identify the safest target for landing that was also reachable given fuel and other constraints. The EDL system then used the powered descent phase to retarget to this location and land safely. The overall error between the targeted location and actual landing location was 5m which was an order of magnitude less than the 60m touchdown error requirement. This paper will describe the final tests of the LVS before launch, the checkout of the LVS during operations and the LVS performance during EDL.

Zheng, Jason↗
NASA NTRS2002

Synthetic Vision Systems in GA Cockpit-Evaluation of Basic Maneuvers Performed by Low Time GA Pilots During Transition from VMC to IMC

An experimental investigation was conducted to study the effectiveness of modern flight displays in general aviation cockpits for mitigating Low Visibility Loss of Control and the Controlled Flight Into Terrain accidents. A total of 18 General Aviation (GA) pilots with private pilot, single engine land rating, with no additional instrument training beyond private pilot license requirements, were recruited to evaluate three different display concepts in a fixed-based flight simulator at the NASA Langley Research Center's General Aviation Work Station. Evaluation pilots were asked to continue flight from Visual Meteorological Conditions (VMC) into Instrument Meteorological Conditions (IMC) while performing a series of 4 basic precision maneuvers. During the experiment, relevant pilot/vehicle performance variables, pilot control inputs and physiological data were recorded. Human factors questionnaires and interviews were administered after each scenario. Qualitative and quantitative data have been analyzed and the results are presented here. Pilot performance deviations from the established target values (errors) were computed and compared with the FAA Practical Test Standards. Results of the quantitative data indicate that evaluation pilots committed substantially fewer errors when using the Synthetic Vision Systems (SVS) displays than when they were using conventional instruments. Results of the qualitative data indicate that evaluation pilots perceived themselves to have a much higher level of situation awareness while using the SVS display concept.

Takallu, M. A.↗
NASA NTRS1985

Influence of control parameters on the joint tracking performance of a coaxial weld vision system

The first phase of a series of evaluations of a vision-based welding control sensor for the Space Shuttle Main Engine Robotic Welding System is described. The robotic welding system is presently under development at the Marshall Space Flight Center. This evaluation determines the standard control response parameters necessary for proper trajectory of the welding torch along the joint.

Gangl, K. J.↗
NASA NTRS1985

Investigation of weld joint detection capabilities of a coaxial weld vision system

This report describes the second phase of a series of evaluations of a vision-based welding control sensor for the Space shuttle Main Engine Robotic Welding System. The robotic welding system is presently under development at the Marshall Space Flight Center. This evaluation determines the factors influencing the minimum joint gap required for consistent detection of the weld joint.

Gangl, K. J.↗
NASA NTRS1992

Determination of high temperature strains using a PC based vision system

With the widespread availability of video digitizers and cheap personal computers, the use of computer vision as an experimental tool is becoming common place. These systems are being used to make a wide variety of measurements that range from simple surface characterization to velocity profiles. The Sub-Pixel Digital Image Correlation technique has been developed to measure full field displacement and gradients of the surface of an object subjected to a driving force. The technique has shown its utility by measuring the deformation and movement of objects that range from simple translation to fluid velocity profiles to crack tip deformation of solid rocket fuel. This technique has recently been improved and used to measure the surface displacement field of an object at high temperature. The development of a PC based Sub-Pixel Digital Image Correlation system has yielded an accurate and easy to use system for measuring surface displacements and gradients. Experiments have been performed to show the system is viable for measuring thermal strain.

Mcneill, Stephen R.↗