Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Technology for robotic surface inspection in space

This paper presents on-going research in robotic inspection of space platforms. Three main areas of investigation are discussed: machine vision inspection techniques, an integrated sensor end-effector, and an orbital environment laboratory simulation. Machine vision inspection utilizes automatic comparison of new and reference images to detect on-orbit induced damage such as micrometeorite impacts. The cameras and lighting used for this inspection are housed in a multisensor end-effector, which also contains a suite of sensors for detection of temperature, gas leaks, proximity, and forces. To fully test all of these sensors, a realistic space platform mock-up has been created, complete with visual, temperature, and gas anomalies. Further, changing orbital lighting conditions are effectively mimicked by a robotic solar simulator. In the paper, each of these technology components will be discussed, and experimental results are provided.

Volpe, Richard↗

Some distinguishing characteristics of contour and texture phenomena in images

The development of generalized contour/texture discrimination techniques is a central element necessary for machine vision recognition and interpretation of arbitrary images. Here, the visual perception of texture, selected studies of texture analysis in machine vision, and diverse small samples of contour and texture are all used to provide insights into the fundamental characteristics of contour and texture. From these, an experimental discrimination scheme is developed and tested on a battery of natural images. The visual perception of texture defined fine texture as a subclass which is interpreted as shading and is distinct from coarse figural similarity textures. Also, perception defined the smallest scale for contour/texture discrimination as eight to nine visual acuity units. Three contour/texture discrimination parameters were found to be moderately successful for this scale discrimination: (1) lightness change in a blurred version of the image, (2) change in lightness change in the original image, and (3) percent change in edge counts relative to local maximum.

Jobson, Daniel J.↗

Change detection and classification of land cover in multispectral satellite imagery using clustering of sparse approximations (CoSA) over learned feature dictionaries

Neuromimetic machine vision and pattern recognition algorithms are of great interest for landscape characterization and change detection in satellite imagery in support of global climate change science and modeling. We present results from an ongoing effort to extend machine vision methods to the environmental sciences, using adaptive sparse signal processing combined with machine learning. A Hebbian learning rule is used to build multispectral, multiresolution dictionaries from regional satellite normalized band difference index data. Land cover labels are automatically generated via our CoSA algorithm: Clustering of Sparse Approximations, using a clustering distance metric that combines spectral and spatial textural characteristics to help separate geologic, vegetative, and hydrologie features. We demonstrate our method on example Worldview-2 satellite images of an Arctic region, and use CoSA labels to detect seasonal surface changes. In conclusion, our results suggest that neuroscience-based models are a promising approach to practical pattern recognition and change detection problems in remote sensing.

97 MATHEMATICS AND COMPUTING↗

Monocular Ranging for Small Unmanned Aerial Systems in the Far-Field

Recent proliferation of small Unmanned Aerial Systems (sUAS) applications requires onboard collision avoidance systems to mitigate the risk of collision with non-cooperative aircraft and manned aircraft, which may not see sUAS in time to perform an avoidance maneuver. An attractive avenue for onboard collision avoidance is the utilization of machine vision cameras due to their low size, weight and power (SWaP) requirements. In this paper, we characterize the range performance of a machine vision system developed in-house and mounted onto an sUAS. The technique was designed to estimate the performance of a sense-and-avoid system to ensure that the sensing components meet the well-clear requirements for the chosen platform and avoidance strategy. Experimental flight-test data was acquired from test-flights flown along multiple collision geometries for two intruders: a general Aviation (GA) aircraft and a fixed-wing sUAS. The ownship and both intruders were instrumented with inertial navigation systems (INS) recording position and attitude information. The range at first detection, 𝑹𝟎, was extracted from in-flight imagery of head-on collision course geometry synchronized with INS data from both aircraft and ground-truth values extracted from the raw imagery. This initial detection distance, 𝑹𝟎, scales with atmospheric attenuation. Therefore, under clear sky conditions, the derived 𝑹𝟎 value represents the upper bound on the detection range achievable by the test configuration of the detector. Results indicate that the maximum initial detection distance for a 4k resolution action camera fitted with a 41º Field of View (FOV) lens is 2.763 ± 0.037 km for a GA aircraft and 0.881 ± 0.061 km for a fixed-wing sUAS, respectively. The in results this study suggest that a vision-based detect and track system may be analyzed using the sensor characterization and contextualized within aircraft well-clear volumes.

Chester V. Dolph↗

Advanced SOFC quality control and the role of manufacturing defects on stack reliability

Atrex Energy rolled out first commercial SOFC generator products in 2013. Following that we embarked on implementation of mass production in order to ramp up productivity and lower the costs in the meantime. To ensure the goal of mass production, an accurate, cost effective and consistent quality control methodology needs to be in place. The aim of this DOE funded project is to devise a machine and methodology for cell quality control using modern non-destructive testing methods and cell rejection criterion based on the empirical determination of the role of manufacturing flaws on stack degradation and reliability. The work scope encompasses two goals aimed at 1) developing automatable techniques for objective flaw detection and 2) developing an understanding of the ramifications of flaws on stack and cell reliability. By accomplishing these two goals it is likely that an advanced stage Quality Control (QC) device can be developed. This project scope encompasses: 1) Invention of a high speed automated instrument for spatial mapping of surface and sub-surface imperfections in production cells (ex situ) using modern imaging techniques. 2) Identification of rejection criteria upon which to screen cells from production by: a. Magnification of the effect of production defects on cell degradation through fabrication and testing of micro-cells which encompass these imperfections. b. The long term testing of full size production cells both as single cells and in small stacks, in order to correlate the (in situ) performance and degradation with the imperfection type (identified ex-situ) and hence be able to classify imperfections as actual defects. We first built a defect library with the cells containing imperfections classified and documented. The cells with various imperfections were tested to evaluate the imperfection potential impact on cell electrochemical performance. Evaluations were conducted on minicell, single cell and stack levels. On minicell level, pinhole, scratch, crack, contamination, and pop-out were investigated. We found: (1) none of the imperfections causes calamity type failure, (2) pinholes do not show measurable effect on minicell performance, (3) imperfection such as electrolyte abrasion, scratch, and pop out cause minicell potential to fluctuate by different degrees; the cells with such imperfections exhibit sensitivity of potential to high fuel utilization and “self healing” behavior. On single cell level we evaluated the effect of long crack and high population pinholes. The cell with a long crack does not show performance compromise at start. There is no potential fluctuation or sensitivity to high fuel utilization or catastrophic failure. The voltage degradation due to thermal cycle is slightly higher than normal cells. The cells with high population pinholes perform surprisingly as well as normal cells over a period of 3,500h. Even when subjected to cyclic load condition, the cells 4 show negligible degradation. Our cells appear to have “self immunization” feature which fends off the adversary effects of certain imperfections. Defects were also evaluated on stack level. Two stacks were made each with ten defect cells. The first stack was tested for 13,2000h under steady load condition while the second was tested for 9,000h under transient load conditions. We found: (1) voltage fluctuation and sensitivity to thermal cycle were not observed in contrast to minicell test, (2) of the various cracks examined, including longitudinal cracks, circumferential crack, crack near closed and open ends, none exhibited distinguishable impact on performance, (3) defect cells exhibited higher degradation rates on average under steady load condition; Individually some defect cells performed similarly or better than reference cells, (4) under steady load condition all the cells degrade monotonically with degradation rate increasing with time, (5) under cyclic (transient) load condition, both defect and reference cells exhibit complex dynamic behaviors, (6) fuel loss (leak) was measured occasionally for stack 1, the cells with crack showed the highest fuel loss increase, nevertheless, no correlation with performance degradation could be established with certainty, and (7) no catastrophic failure ever happened other than incremental degradation. Posttest inspection and microanalysis were carried out; the observations are summarized in what follows: (1) Electrolyte pinholes, some scratches and IC porosity became undetectable after testing. (2) The cathode covering the popout defects is intact without any cracking or delamination. (3) The scratch was covered by cathode in pristine state; Ni oxide or NiO-YSZ filled the space where electrolyte was missing. After >10,000h operation, the cathode that used to cover the scratch was missing but the size of the scratch remains unchanged; there is a fairly dense Ni oxide layer on top of the scratch. (4) All of the cracks remain their original dimensions. Current collector kept longitudinal cracks closed which mitigated the adversary effect of crack on cell performance/durability. (5) The crack at open end showed some deterioration manifested by a small oxidation zone in the vicinity of the crack. Wide spectrum of imaging techniques were surveyed and evaluated to detect tubular SOFC defects. Optical methods, with and without assistance of expression technique, were applied to detect all kinds of defects. Thermograph method in combination of CO2 leak, ultra-sound and electric potential was also extensively evaluated to detect surface and under-surface defects such as short circuit. Based on these works, laser camera has been selected to build the final QC machine vision inspection system. The Gocator laser profile sensor was setup to generate 2D surface intensity images of tubular SOFC surface which were analyzed with Sherlock machine vision software supplied by Teledyne Dalsa. The Gocator output was integrated with the Sherlock software and enabled live images to be imported by a Common Vision Blox driver. The Sherlock software was programmed to detect various surface defects from the surface intensity images generated by the Gocator. These measurements are subsequently used to make pass or fail decisions.

01 COAL, LIGNITE, AND PEAT↗

Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array

The bioinspired camera, comprising a single lens and a curved image sensor—a photodiode array on a curved surface—, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Identification Of Cells With A Compact Microscope Imaging System With Intelligent Controls

A Microscope Imaging System (CMIS) with intelligent controls is disclosed that provides techniques for scanning, identifying, detecting and tracking mic?oscopic changes in selected characteristics or features of various surfaces including, but not limited to, cells, spheres, and manufactured products subject to difficult-to-see imperfections. The practice of the present invention provides applications that include colloidal hard spheres experiments, biological cell detection for patch clamping, cell movement and tracking, as well as defect identification in products, such as semiconductor devices, where surface damage can be significant, but difficult to detect. The CMIS system is a machine vision system, which combines intelligent image processing with remote control capabilities and provides the ability to autofocus on a microscope sample, automatically scan an image, and perform machine vision analysis on multiple samples simultaneously.

McDowell, Mark↗

Operation of a Cartesian Robotic System in a Compact Microscope with Intelligent Controls

A Microscope Imaging System (CMIS) with intelligent controls is disclosed that provides techniques for scanning, identifying, detecting and tracking microscopic changes in selected characteristics or features of various surfaces including, but not limited to, cells, spheres, and manufactured products subject to difficult-to-see imperfections. The practice of the present invention provides applications that include colloidal hard spheres experiments, biological cell detection for patch clamping, cell movement and tracking, as well as defect identification in products, such as semiconductor devices, where surface damage can be significant, but difficult to detect. The CMIS system is a machine vision system, which combines intelligent image processing with remote control capabilities and provides the ability to autofocus on a microscope sample, automatically scan an image, and perform machine vision analysis on multiple samples simultaneously.

McDowell, Mark↗

Tracking of Cells with a Compact Microscope Imaging System with Intelligent Controls

A Microscope Imaging System (CMIS) with intelligent controls is disclosed that provides techniques for scanning, identifying, detecting and tracking microscopic changes in selected characteristics or features of various surfaces including, but not limited to, cells, spheres, and manufactured products subject to difficult-to-see imperfections. The practice of the present invention provides applications that include colloidal hard spheres experiments, biological cell detection for patch clamping, cell movement and tracking, as well as defect identification in products, such as semiconductor devices, where surface damage can be significant, but difficult to detect. The CMIS system is a machine vision system, which combines intelligent image processing with remote control capabilities and provides the ability to autofocus on a microscope sample, automatically scan an image, and perform machine vision analysis on multiple samples simultaneously

McDowell, Mark↗

Tracking of cells with a compact microscope imaging system with intelligent controls

A Microscope Imaging System (CMIS) with intelligent controls is disclosed that provides techniques for scanning, identifying, detecting and tracking microscopic changes in selected characteristics or features of various surfaces including, but not limited to, cells, spheres, and manufactured products subject to difficult-to-see imperfections. The practice of the present invention provides applications that include colloidal hard spheres experiments, biological cell detection for patch clamping, cell movement and tracking, as well as defect identification in products, such as semiconductor devices, where surface damage can be significant, but difficult to detect. The CMIS system is a machine vision system, which combines intelligent image processing with remote control capabilities and provides the ability to auto-focus on a microscope sample, automatically scan an image, and perform machine vision analysis on multiple samples simultaneously.

McDowell, Mark↗

An autonomous robot for shell and tube heat exchanger inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this study, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform algorithm, respectively. Assisted by a guiding cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. In conclusion, during this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks, showing accuracy of nearly 100% for identifying defective and nondefective tubes and 85% for four types of defective tubes and nondefective tubes.

42 ENGINEERING↗

An Autonomous Robot for Shell and Tube Heat Exchanger Inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this work, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform (CHT) algorithm, respectively. Assisted by a guidance cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. During this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks (CNN), showing accuracy of nearly 100% for identifying defective and non-defective tubes and 85% for four types of defective tubes and non-defective tubes.

autonomy, deep learning, eddy current testing, hea↗

The JPL/KSC telerobotic inspection demonstration

An ASEA IRB90 robotic manipulator with attached inspection cameras was moved through a Space Shuttle Payload Assist Module (PAM) Cradle under computer control. The Operator and Operator Control Station, including graphics simulation, gross-motion spatial planning, and machine vision processing, were located at JPL. The Safety and Support personnel, PAM Cradle, IRB90, and image acquisition system, were stationed at the Kennedy Space Center (KSC). Images captured at KSC were used both for processing by a machine vision system at JPL, and for inspection by the JPL Operator. The system found collision-free paths through the PAM Cradle, demonstrated accurate knowledge of the location of both objects of interest and obstacles, and operated with a communication delay of two seconds. Safe operation of the IRB90 near Shuttle flight hardware was obtained both through the use of a gross-motion spatial planner developed at JPL using artificial intelligence techniques, and infrared beams and pressure sensitive strips mounted to the critical surfaces of the flight hardward at KSC. The Demonstration showed that telerobotics is effective for real tasks, safe for personnel and hardware, and highly productive and reliable for Shuttle payload operations and Space Station external operations.

Mittman, David↗

Real-time process monitoring for direct ink write additive manufacturing

Direct ink write (DIW) printing of reactive resins presents a unique challenge due to the time-dependent nature of the rheological and chemical properties of the ink. As a result, careful print optimization or process control is important to obtain consistent, high quality prints. The present invention uses a flow-through characterization cell for in situ chemical monitoring of a resin ink during DIW printing. Additionally, in-line extrusion force monitoring can be combined with off-line post inspection using machine vision. By combining in-line spectroscopy and force monitoring, it is possible to follow reaction kinetics (for example, curing of a reactive resin) and viscosity changes during printing, which can be used for a closed-loop process control. Additionally, the capability of machine vision to automatically identify and quantify print artifacts can be incorporated on the printing line to enable real-time, AI-assisted quality control of the printed products. Together, these techniques can form the building blocks of an optimized process control strategy when complex reactive ink must be used to produce printed hardware.

Cook, Adam W.↗

Autonomous pre-alignment of a docking mechanism

The subject project can be described as the development and testing of a digitally controlled docking mechanism. The mechanism consists of a 6 DOF parallel manipulator for docking interface pre-alignment, and a machine vision sensor for real-time target tracking. The parallel manipulator also can be used for capture/latching, energy attenuation, and structural rigidization of docking, but the scope of this paper is the proof-of-concept demonstration of autonomous pre-alignment of a docking mechanism using machine vision.

Carroll, Monty B.↗

Rifle-like camera for long distance face recognition

An improved long-range facial recognition system is provided. The facial recognition system includes an integrated, rifle-like mounting platform with modular and interchangeable components, including a machine-vision camera, a facial recognition module, and an aiming scope. The mounting platform includes an elongated frame, a hand grip, a shoulder stock, and an underbody support attachment for an optional bipod. The mounting platform provides an intuitive, shoulder-operated support structure for stabilizing the machine-vision camera and reducing vibrations that otherwise inhibit long distance imaging.

Bolme, David S.↗

Local intensity adaptive image coding

The objective of preprocessing for machine vision is to extract intrinsic target properties. The most important properties ordinarily are structure and reflectance. Illumination in space, however, is a significant problem as the extreme range of light intensity, stretching from deep shadow to highly reflective surfaces in direct sunlight, impairs the effectiveness of standard approaches to machine vision. To overcome this critical constraint, an image coding scheme is being investigated which combines local intensity adaptivity, image enhancement, and data compression. It is very effective under the highly variant illumination that can exist within a single frame or field of view, and it is very robust to noise at low illuminations. Some of the theory and salient features of the coding scheme are reviewed. Its performance is characterized in a simulated space application, the research and development activities are described.

Huck, Friedrich O.↗

Automated Counting of Particles To Quantify Cleanliness

A machine vision system, similar to systems used in microbiological laboratories to count cultured microbes, has been proposed for quantifying the cleanliness of nominally precisely cleaned hardware by counting residual contaminant particles. The system would include a microscope equipped with an electronic camera and circuitry to digitize the camera output, a personal computer programmed with machine-vision and interface software, and digital storage media. A filter pad, through which had been aspirated solvent from rinsing the hardware in question, would be placed on the microscope stage. A high-resolution image of the filter pad would be recorded. The computer would analyze the image and present a histogram of sizes of particles on the filter. On the basis of the histogram and a measure of the desired level of cleanliness, the hardware would be accepted or rejected. If the hardware were accepted, the image would be saved, along with other information, as a quality record. If the hardware were rejected, the histogram and ancillary information would be recorded for analysis of trends. The software would perceive particles that are too large or too numerous to meet a specified particle-distribution profile. Anomalous particles or fibrous material would be flagged for inspection.

Rhode, James↗