Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Processing; Pattern Recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Microcomputer-based programmable optical signal processor

A microcomputer-based real-time programmable optical signal processing system utilizing a magneto-optic spatial light modulator (MOSLM) and a liquid crystal light valve (LCLV) is described. This system can perform a myriad of complicated optical operations, such as image correlation, image subtraction, and matrix multiplication. Its important asserts are its programmability and the capability of real-time addressing. These are important for telerobotic vision in space automation applications. Design specifications and suggestions for practical implementation of the system are discussed. Some preliminary experimental demonstrations are conducted to demonstrate applications of the proposed system to image correlation for optical pattern recognition, image subtraction for lC chip inspection, and matrix multiplication for optical computing.

Yu, F. T. S.↗

Forecast of Wildfire Potential Across California USA Using a Transformer

Wildfires are a major issue facing the United States, a matter further exacerbated by an ever-changing climate. In California alone, wildfires are responsible for billions of dollars in damages and take lives each year. Accurately predicting fire danger conditions allows preparation awareness before wildfires start. Transformers are a class of deep learning models designed to identify patterns in sequential datasets. In recent years, transformers have gained popularity through their impressive performance in natural language processing and other applications of signal recognition. This analysis demonstrates the ability of a transformer with a residual connection to forecast fire danger potential over the state of California. Wildland fire potential index (WFPI) maps collected from the US Geological Survey database from January 1st 2020 to December 31st 2023 were used to tune, train and evaluate the transformer. Meteorological inputs (provided by Daymet daily weather and climatological summaries), the normalized difference vegetation index (NDVI) (calculated from the Moderate Resolution Imaging Spectroradiometer (MODIS)), and outputs from the Scott and Burgman fire behavior fuel models (to characterize maps of fuel types), were used as inputs. Our results show that a transformer can effectively emulate the US Forest Service modeled WFPI maps of California USA for four week long forecasts over the month of July, 2023, with correlations ranging from 0.85 – 0.98.

Limber, Russell [ORNL]↗

Visualizing Charge Transport and Nanoscale Electrochemistry by Hyperspectral Kelvin Probe Force Microscopy

Charge-transport and electrochemical processes are heavily influenced by the local microstructure. Kelvin probe force microscopy (KPFM) is a widely used technique to map electrochemical potentials at the nanometer scale; however, it offers little information on local charge dynamics. In this study, we implement a hyperspectral KPFM approach for spatially mapping bias-dependent charge dynamics in timescales ranging from the sub-millisecond to the second regime. As a proof of principle, we investigate the role mobile surface charges play in a three-unit-cell LaAlO 3 /SrTiO 3 oxide heterostructure. We explore machine learning approaches to assist with visualization, pattern recognition, and interpretation of the information-rich data sets. Linear unmixing methods reveal hidden bias-dependent interfacial processes, most likely water splitting, which are essentially unnoticed by functional fitting of the dynamic response alone. Hyperspectral KPFM will be beneficial for investigating nanoscale charge transport and local reactivity in systems involving a possible combination of electronic, ionic, and electrochemical phenomena.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Noncontact temperature pattern measuring device

This invention relates to a noncontact imagine pyrometer system for obtaining the true temperature image of a given substance in a contactless fashion without making assumptions about localized emissivity of the substance or the uniformity of the temperature distribution. Such a contactless temperature imaging system has particular application in the study and production of many materials where the physical contact required to make a conventional temperature measurement drastically effects or contaminates the physical process being observed. Two examples where accurate temperature profiles are of critical interest are: (1) the solid-liquid phase change interface in the production of electronic materials and (2) metastable materials in the undercooling region. The apparent novelty resides in the recognition that an active pyrometer system may be advantageously adapted to perform contactless temperature imaging so that an accurate temperature profile can be obtained.

Elleman, D. D.↗

An Application of a New Electromagnetic Sensor to Real-Time Monitoring of Fatigue Crack Growth in Thin Metal Plates

A major part of fracture mechanics is concerned with studying the initiation and propagation of fatigue cracks. This typically requires constant monitoring of crack growth during fatigue cycles which necessitates automation of the whole process. If the rate of crack growth can be determined the experimenter can vary externally controlled parameters such as load level, load cycle frequency and so on. Hence, knowledge of the precise location of the crack tip at any given time is very valuable. One technique currently available for measuring fatigue crack length is the DC potential drop method. The method, however, may be inaccurate if the direction of crack growth deviates considerably from what was assumed initially or the curvature of the crack becomes significant. Another approach is to digitize an optical image of the test specimen surface and then apply a pattern recognition technique to locate the crack tip, but this method is still under development. The present work is an initial study on applying eddy current-type probes to monitoring fatigue crack growth. The performance of two types of electromagnetic probes, a conventional eddy current probe and a newly developed self-nulling probe, was evaluated for the detection characteristics at and near the tips of fatigue cracks. The scan results show that the latter probe provides a very well defined local maximum in its output in the crack tip region suggesting the definite possibility of precisely locating the tip, while the former provides a somewhat ambiguous distribution of the sensor output in the same region. The paper is organized as follows: We start by reviewing the design and performance characteristics of the self-nulling probe and then describe the scan results which demonstrate the basic properties of the self-nulling probe. Next, we provide a brief description of the software developed for tracing a simulated crack and give a brief discussion of the main results of the test. The final section summarizes the major accomplishments of the present work and the elements of the future R&D needs.

Namkung, M.↗

Artificial Intelligence and Computer Vision for Cost-Effective Benthic Habitat Characterizations

Machine learning applied to computer vision and pattern recognition is a type of artificial intelligence that has advanced rapidly in the last 10 to 15 years, spurred forward by breakthroughs in deep convolutional neural networks. These state-of-the-art methods are poised to become widely used in environmental monitoring applications as a result of the increasing abundance of data available from different imaging platforms (e.g., fixed-point cameras, drone surveys, high-resolution satellite data) that can be analyzed to observe, model, and understand environmental conditions. Computer vision and pattern recognition (CVPR) tools advance our ability to use imagery and camera-based tools in cost-effective ways for environmental monitoring. Although these techniques offer great potential, some challenges remain, such as the need for large sets of labeled images for model training and validation and optimized hardware and software to ensure that the models can be trained effectively and in a reasonable amount of time. Here, we have overcome many of these rate-limiting challenges by using a diverse image library built across multiple projects coupled with staff expertise and onsite computing resources. We are working toward a fully automated SPI processing system and also are moving to develop CVPR analytical tools for other imaging platforms and data sets.

02 PETROLEUM↗

Using Eye Tracking to Elucidate the Mechanisms Underlying Stimulation-Enhanced Visual Target Detection

Transcranial direct current stimulation (tDCS) is a noninvasive form of brain stimulation that involves passing a weak electrical current between electrodes on the scalp to modulate underlying neural tissue. TDCS has been shown to modulate cognition in a variety of domains, including memory, attention, and visual processing. Prior work from our laboratory has shown positive effects of tDCS on learning to detect target objects hidden in complex naturalistic visual scenes and learn rules for categorizing images, though the mechanism for these benefits remains unknown. One possibility is that tDCS optimizes visual search by modulating visual attention or via the reduction in search errors. One method of quantifying visual attention is to use eye tracking to record search patterns to determine if and how visual search is adjusted under verum stimulation conditions. Eye tracking data allows classification of errors into error types, including sampling errors (failing to look in the relevant region), recognition errors (looking at the critical portion of a scene, but failing to recognize it as such as evidenced by visual fixation), and decision-making errors (fixating on the relevant portion of a scene, but making the wrong determination). Our results indicate that the benefit tDCS confers on visual search for targets stems from the reduction in decision-making errors when targets are present (Cohen’s d = 0.86). Also reported is a replication of previous findings showing a tDCS-dependent improvement in learning this task, learning score (Cohen’s d = 0.88); d’ (Cohen’s d = 1.00). This provides support for moving tDCS into the application space by pairing it with analysts who are concerned with the type of search error that is corrected via stimulation.

attention↗

Active Microwave Remote Sensing Observations of Weddell Sea Ice

Since July 1991, the European Space Agency's ERS-1 and ERS-2 satellites have acquired radar data of the Weddell Sea, Antarctica. The Active Microwave Instrument on board ERS has two modes; SAR and Scatterometer. Two receiving stations enable direct downlink and recording of high bit-rate, high resolution SAR image data of this region. When not in an imaging mode, when direct SAR downlink is not possible, or when a receiving station is inoperable, the latter mode allows normalized radar cross-section data to be acquired. These low bit-rate ERS scatterometer data are tape recorded, downlinked and processed off-line. Recent advances in image generation from Scatterometer backscatter measurements enable complementary medium-scale resolution images to be made during periods when SAR images cannot be acquired. Together, these combined C-band microwave image data have for the first time enabled uninterrupted night and day coverage of the Weddell Sea region at both high (25 m) and medium-scale (-20 km) resolutions. C-band ERS-1 radar data are analyzed in conjunction with field data from two simultaneous field experiments in 1992. Satellite radar signature data are compared with shipborne radar data to extract a regional and seasonal signature database for recognition of ice types in the images. Performance of automated sea-ice tracking algorithms is tested on Antarctic data to evaluate their success. Examples demonstrate that both winter and summer ice can be effectively tracked. The kinematics of the main ice zones within the Weddell Sea are illustrated, together with the complementary time-dependencies in their radar signatures. Time-series of satellite images are used to illustrate the development of the Weddell Sea ice cover from its austral summer minimum (February) to its winter maximum (September). The combination of time-dependent microwave signatures and ice dynamics tracking enable various drift regimes to be defined which relate closely to the circulation of the sea ice in response to current and wind forcing and iceberg barriers. These are closely related to continental-shelf or central basin regimes, in which tidal forcing or barotropic circulation patterns appear to influence the sea-ice motion, respectively. These regimes provide valuable information about the regions of most prolific ice growth and influence of ice conditions upon air-sea-ice exchange processes in the Weddell Sea.

Drinkwater, Mark R.↗

The utility of ERTS-1 data for applications in land use classification

A comprehensive study has been undertaken to determine the extent to which conventional image interpretation and computer-aided (spectral pattern recognition) analysis techniques using ERTS-1 data could be used to detect, identify (classify), locate, and measure current land use over large geographic areas. It can be concluded that most of the level 1 and 2 categories in the USGS Circular no. 671 can be detected in the Houston-Gulf Coast area using a combination of both techniques for analysis. These capabilities could be exercised over larger geographic areas, however, certain factors such as different vegetative cover, topography, etc. may have to be considered in other geographic regions. The best results in identification (classification), location, and measurement of level 1 and 2 type categories appear to be obtainable through automatic data processing of multispectral scanner computer compatible tapes.

Dornbach, J. E.↗

Real Time Intelligent Target Detection and Analysis with Machine Vision

We present an algorithm for detecting a specified set of targets for an Automatic Target Recognition (ATR) application. ATR involves processing images for detecting, classifying, and tracking targets embedded in a background scene. We address the problem of discriminating between targets and nontarget objects in a scene by evaluating 40x40 image blocks belonging to an image. Each image block is first projected onto a set of templates specifically designed to separate images of targets embedded in a typical background scene from those background images without targets. These filters are found using directed principal component analysis which maximally separates the two groups. The projected images are then clustered into one of n classes based on a minimum distance to a set of n cluster prototypes. These cluster prototypes have previously been identified using a modified clustering algorithm based on prior sensed data. Each projected image pattern is then fed into the associated cluster's trained neural network for classification. A detailed description of our algorithm will be given in this paper. We outline our methodology for designing the templates, describe our modified clustering algorithm, and provide details on the neural network classifiers. Evaluation of the overall algorithm demonstrates that our detection rates approach 96% with a false positive rate of less than 0.03%.

Howard, Ayanna↗

Automated thematic mapping and change detection of ERTS-A images

The author has identified the following significant results. A diffraction pattern analysis of MSS images led to the development of spatial signatures for farm land, urban areas and mountains. Four spatial features are employed to describe the spatial characteristics of image cells in the digital data. Three spectral features are combined with the spatial features to form a seven dimensional vector describing each cell. Then, the classification of the feature vectors is accomplished by using the maximum likelihood criterion. It was determined that the recognition accuracy with the maximum likelihood criterion depends on the statistics of the feature vectors. It was also determined that for a given geographic area the statistics of the classes remain invariable for a period of a month, but vary substantially between seasons. Three ERTS-1 images from the Phoenix, Arizona area were processed, and recognition rates between 85% and 100% were obtained for the terrain classes of desert, farms, mountains, and urban areas. To eliminate the need for training data, a new clustering algorithm has been developed. Seven ERTS-1 images from four test sites have been processed through the clustering algorithm, and high recognition rates have been achieved for all terrain classes.

Gramenopoulos, N.↗

Self-Supervised Cloud Classification

Abstract Low-level marine clouds play a pivotal role in Earth’s weather and climate through their interactions with radiation, heat and moisture transport, and the hydrological cycle. These interactions depend on a range of dynamical and microphysical processes that result in a broad diversity of cloud types and spatial structures, and a comprehensive understanding of cloud morphology is critical for continued improvement of our atmospheric modeling and prediction capabilities moving forward. Deep learning has recently accelerated our ability to study clouds using satellite remote sensing, and machine learning classifiers have enabled detailed studies of cloud morphology. A major limitation of deep learning approaches to this problem, however, is the large number of hand-labeled samples that are required for training. This work applies a recently developed self-supervised learning scheme to train a deep convolutional neural network (CNN) to map marine cloud imagery to vector embeddings that capture information about mesoscale cloud morphology and can be used for satellite image classification. The model is evaluated against existing cloud classification datasets and several use cases are demonstrated, including training cloud classifiers with very few labeled samples, interrogation of the CNN’s learned internal feature representations, cross-instrument application, and resilience against sensor calibration drift and changing scene brightness. The self-supervised approach learns meaningful internal representations of cloud structures and achieves comparable classification accuracy to supervised deep learning methods without the expense of creating large hand-annotated training datasets. Significance Statement Marine clouds heavily influence Earth’s weather and climate, and improved understanding of marine clouds is required to improve our atmospheric modeling capabilities and physical understanding of the atmosphere. Recently, deep learning has emerged as a powerful research tool that can be used to identify and study specific marine cloud types in the vast number of images collected by Earth-observing satellites. While powerful, these approaches require hand-labeling of training data, which is prohibitively time intensive. This study evaluates a recently developed self-supervised deep learning method that does not require human-labeled training data for processing images of clouds. We show that the trained algorithm performs competitively with algorithms trained on hand-labeled data for image classification tasks. We also discuss potential downstream uses and demonstrate some exciting features of the approach including application to multiple satellite instruments, resilience against changing image brightness, and its learned internal representations of cloud types. The self-supervised technique removes one of the major hurdles for applying deep learning to very large atmospheric datasets.

54 ENVIRONMENTAL SCIENCES↗

Identification of Distorted Gamma-Ray Signature Patterns Using Digital Filtering and Auto-Associative Memory Implemented with a Hopfield Neural Network

The detection and identification of radioactive sources in search applications involve analyzing passive gamma-ray emissions from high-level radioactive materials. This process uses a mobile detector-spectrometer in a complex field test environment. Recently, the use of artificial intelligence for gamma-ray spectrum analysis has shown promising results. However, challenges persist in identifying isotopic signatures from spectral measurements that may be distorted due to source shielding, random variations in natural radioactive background, or insufficient measurement time to obtain clear spectral lines. Here, this paper presents a novel intelligent signature recognition method that combines digital filtering techniques with an artificial Hopfield Neural Network (HNN). The HNN leverages auto-associative memory to store training sample patterns and match them with incoming gamma spectra from distorted sources. It restores the testing sources’ measurements by finding the closest matching signature patterns in the spectral library. Before HNN recognition, the measured spectrum undergoes preprocessing with a digital image filter to reduce fluctuations. Performance of the proposed method is evaluated using a set of gamma-ray spectra measured with a sodium iodide detector. The data collected include measurements from six pure samples: 241 Am, 60 Co, 137 Cs, 192 Ir, 239 Pu, and 235 U, which are used for training and validation (i.e. six cases). Additionally, the data set contains 24 distorted synthesized sources with various fluctuating backgrounds. Test results demonstrate the potential of the proposed method to accurately recognize the correct isotope with high precision, achieving an accuracy rate exceeding 85%. Furthermore, the proposed method exhibits superior performance compared to the conventional multiple regression fitting and simple feedforward neural network methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Neural network post-processing of grayscale optical correlator

In this paper we present the use of a radial basis function neural network (RBFNN) as a post-processor to assist the optical correlator to identify the objects and to reject false alarms. Image plane features near the correlation peaks are extracted and fed to the neural network for analysis. The approach is capable of handling large number of object variations and filter sets. Preliminary experimental results are presented and the performance is analyzed.

grayscale optical correlator↗

Tissue Photolithography

Tissue lithography will enable physicians and researchers to obtain macromolecules with high purity (greater than 90 percent) from desired cells in conventionally processed, clinical tissues by simply annotating the desired cells on a computer screen. After identifying the desired cells, a suitable lithography mask will be generated to protect the contents of the desired cells while allowing destruction of all undesired cells by irradiation with ultraviolet light. The DNA from the protected cells can be used in a number of downstream applications including DNA sequencing. The purity (i.e., macromolecules isolated form specific cell types) of such specimens will greatly enhance the value and information of downstream applications. In this method, the specific cells are isolated on a microscope slide using photolithography, which will be faster, more specific, and less expensive than current methods. It relies on the fact that many biological molecules such as DNA are photosensitive and can be destroyed by ultraviolet irradiation. Therefore, it is possible to protect the contents of desired cells, yet destroy undesired cells. This approach leverages the technologies of the microelectronics industry, which can make features smaller than 1 micrometer with photolithography. A variety of ways has been created to achieve identification of the desired cell, and also to designate the other cells for destruction. This can be accomplished through chrome masks, direct laser writing, and also active masking using dynamic arrays. Image recognition is envisioned as one method for identifying cell nuclei and cell membranes. The pathologist can identify the cells of interest using a microscopic computerized image of the slide, and appropriate custom software. In one of the approaches described in this work, the software converts the selection into a digital mask that can be fed into a direct laser writer, e.g. the Heidelberg DWL66. Such a machine uses a metalized glass plate (with chrome metallization) on which there is a thin layer of photoresist. The laser transfers the digital mask onto the photoresist by direct writing, with typical best resolution of 2 micrometers. The plate is then developed to remove the exposed photoresist, which leaves the exposed areas susceptible to chemical chrome etch. The etch removes the unprotected chrome. The rest of the photoresist is then removed, by either ultraviolet organic solvent or over-development. The remaining chrome pattern is quickly oxidized by atmospheric exposure (typically within 30 seconds). The ready chrome mask is now applied to the tissue slide and aligned manually, or using automatic software and pre-designed alignment marks. The slide plate sandwich is then exposed to UV to destroy the DNA of the unwanted cells. The slide and plate are separated and the slide is processed in a standard way to prepare for polymerase chain reaction (PCR) and potential identification of cancer sequences.

Wade, Lawrence A.↗

Taming the Untamable: Making An Enceladus-Like Plume by Hypervelocity Oblique Impacts at the NASA Ames Vertical Gun Range (AVGR) Facility

Enceladus’ plume was extensively investigated by the Cassini-Huygens mission [1-4], giving information about the icy moon interior, and the existence of a plausibly inhabited global ocean. The plume is a mixture of gas, sub-micrometer to micrometer ice, and non-ice particles, expanding into space from vents in the Tiger Stripes region [5]. Collecting plume’s ice particles for signs of Life is a fundamental objective of future fly-by missions to Enceladus, and other icy moons, e.g., Europa, where icy plumes could exist. However, understanding particle collection on high-speed flybys through a plume environment is a challenging task. To address the above, in collaboration with the Applied Physics Laboratory (APL), we have been testing the collection of impact-generated ice grains from simulated ice plumes at the NASA Ames Vertical GunRange (AVGR) facility [e.g., 6-7].Of particular interest is the alteration of organic material in the particles during the high-speed collection process. Any such alteration could degrade the ability of instruments to detect biomarkers in the samples collected. An experimental and theoretical understanding of the organic alteration as a function of collection speed could be used to unravel these effects. Methods: Plumes of -170°C ice particles traveling at an initial speed of 2 – 3 km/s were created by shooting 3-mm hollow Aluminum (Al) projectiles (up to 6 km/s) at liquid-nitrogen-cooled ice targets of synthetic seawater (SSW). An Al witness foil is positioned to determine particle size, and ice particle impact speed is determined by high-speed video. The ice particles smash and sublimate on impact leaving salt residue, dents, and pits on the Al witness foil. We characterized Ice grains type, abundance, density, shape, and distribution caliper (Ferret)diameter via image pattern recognition analysis (ImageJ Software) of still camera photographs of the Al target. Results: Our hyper-velocity impact experiments generated an Enceladus plume analog with an ice particle mean diameter within the particle size distribution (i.e., 2 micrometers to 50 micrometers) as determined by Cassini’s multiple instruments [8]. Simulated impact speed ranged0.2 km/s to 1-2 km/s. The continued experimental production of high-velocity, micrometer-sized ice grains is underway at the AVGR. The relevance of ice particle generation is multifold, so are its applications. These include testing for fragmentation of molecular organics to interpret Cassini’s data (e.g., Cassini Data Analysis Program) and studies of forwarding contamination (a planetary protection issue).

Rosalba Bonaccorsi↗

Adapting In Situ Accelerators for Sparsity With Granular Matrix Reordering

Neural network (NN) inference is an essential part of modern systems and is found at the heart of numerous applications ranging from image recognition to natural language processing. In situ NN accelerators can efficiently perform NN inference using resistive crossbars, which makes them a promising solution to the data movement challenges faced by conventional architectures. Although such accelerators demonstrate significant potential for dense NNs, they often do not benefit from sparse NNs, which contain relatively few non-zero weights. Processing sparse NNs on in situ accelerators results in wasted energy to charge the entire crossbar where most elements are zeros. To address this limitation, this paper proposes Granular Matrix Reordering (GMR): a preprocessing technique that enables an energy-efficient computation of sparse NNs on in situ accelerators. GMR reorders the rows and columns of sparse weight matrices to maximize the crossbars' utilization and minimize the total number of crossbars needed to be charged. The reordering process does not rely on sparsity patterns and incurs no accuracy loss. Finally, GMR achieves an average of 28% and up to 34% reduction in energy consumption over seven pruned NNs across four different pruning methods and network architectures.

97 MATHEMATICS AND COMPUTING↗

Fuzzy set methods for object recognition in space applications

Progress on the following tasks is reported: (1) fuzzy set-based decision making methodologies; (2) feature calculation; (3) clustering for curve and surface fitting; and (4) acquisition of images. The general structure for networks based on fuzzy set connectives which are being used for information fusion and decision making in space applications is described. The structure and training techniques for such networks consisting of generalized means and gamma-operators are described. The use of other hybrid operators in multicriteria decision making is currently being examined. Numerous classical features on image regions such as gray level statistics, edge and curve primitives, texture measures from cooccurrance matrix, and size and shape parameters were implemented. Several fractal geometric features which may have a considerable impact on characterizing cluttered background, such as clouds, dense star patterns, or some planetary surfaces, were used. A new approach to a fuzzy C-shell algorithm is addressed. NASA personnel are in the process of acquiring suitable simulation data and hopefully videotaped actual shuttle imagery. Photographs have been digitized to use in the algorithms. Also, a model of the shuttle was assembled and a mechanism to orient this model in 3-D to digitize for experiments on pose estimation is being constructed.

Keller, James M.↗