Search NASA⌕ Search

SEARCH · Search NASA

Results for “Pattern Recognition, Visual”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

The barberplaid illusion: plaid motion is biased by elongated apertures

The perceived direction of motion of plaids windowed by elongated spatial Gaussians is biased toward the window's long axis. The bias increases as the relative angle between the plaid motion and the long axis of the window increases, peaks at a relative angle of approximately 45 deg, and then decreases. The bias increases as the window is made narrower (at fixed height) and decreases as the component spatial frequency increases (at fixed aperture size). We examine several models of human motion processing (cross-correlation, motion-energy, intersection-of-constraints, and vector-sum), and show that none of these standard models can predict our data. We conclude that spatial integration of motion signals plays a crucial role in plaid motion perception and that current models must be explicitly expanded to include such spatial interactions.

NASA Center ARC↗

Identifying Head-Trunk and Lower Limb Contributions to Gaze Stabilization During Locomotion

The goal of the present study was to determine how the multiple, interdependent full-body sensorimotor subsystems respond to a change in gaze stabilization task constraints during locomotion. Nine subjects performed two gaze stabilization tasks while walking at 6.4 km/hr on a motorized treadmill: 1) focusing on a central point target; 2) reading numeral characters; both presented at 2m in front at the level of their eyes. While subjects performed the tasks we measured: temporal parameters of gait, full body sagittal plane segmental kinematics of the head, trunk, thigh, shank and foot, accelerations along the vertical axis at the head and the shank, and the vertical forces acting on the support surface. We tested the hypothesis that with the increased demands placed on visual acuity during the number recognition task, subjects would modify full-body segmental kinematics in order to reduce perturbations to the head in order to successfully perform the task. We found that while reading numeral characters as - compared to the central point target: 1) compensatory head pitch movement was on average 22% greater despite the fact that the trunk pitch and trunk vertical translation movement control were not significantly changed; 2) coordination patterns between head and trunk as reflected by the peak cross correlation between the head pitch and trunk pitch motion as well as the peak cross correlation between the head pitch and vertical trunk translation motion were not significantly changed; 3) knee joint total movement was on average 11% greater during the period from the heel strike event to the peak knee flexion event in stance phase of the gait cycle; 4) peak acceleration measured at the head was significantly reduced by an average of 13% in four of the six subjects. This was so even when the peak acceleration at the shank and the transmissibility of the shock wave at heel strike (measured by the peak acceleration ratio of the head/shank) remained unchanged. Taken together these results provide further evidence that the full body contributes to gaze stabilization during locomotion, and that its different functional elements can be modified online to contribute to gaze stabilization for different visual task constraints.

Mulavara, Ajitkumar P.↗

Recognition of simple visual images using a sparse distributed memory: Some implementations and experiments

Previously, a method was described of representing a class of simple visual images so that they could be used with a Sparse Distributed Memory (SDM). Herein, two possible implementations are described of a SDM, for which these images, suitably encoded, will serve both as addresses to the memory and as data to be stored in the memory. A key feature of both implementations is that a pattern that is represented as an unordered set with a variable number of members can be used as an address to the memory. In the 1st model, an image is encoded as a 9072 bit string to be used as a read or write address; the bit string may also be used as data to be stored in the memory. Another representation, in which an image is encoded as a 256 bit string, may be used with either model as data to be stored in the memory, but not as an address. In the 2nd model, an image is not represented as a vector of fixed length to be used as an address. Instead, a rule is given for determining which memory locations are to be activated in response to an encoded image. This activation rule treats the pieces of an image as an unordered set. With this model, the memory can be simulated, based on a method of computing the approximate result of a read operation.

Jaeckel, Louis A.↗

Identifying head-trunk and lower limb contributions to gaze stabilization during locomotion

The goal of the present study was to determine how the multiple, interdependent full-body sensorimotor subsystems respond to a change in gaze stabilization task constraints during locomotion. Nine subjects performed two gaze stabilization tasks while walking at 6.4 km/hr on a motorized treadmill: 1) focusing on a central point target; 2) reading numeral characters; both presented at 2 m in front at the level of their eyes. While subjects performed the tasks we measured: temporal parameters of gait, full body sagittal plane segmental kinematics of the head, trunk, thigh, tibia and foot, accelerations along the vertical axis at the head and the tibia, and the vertical forces acting on the support surface. We tested the hypothesis that with the increased demands placed on visual acuity during the number recognition task, subjects would modify full-body segmental kinematics in order to reduce perturbations to the head in order to successfully perform the task. We found that while reading numeral characters as compared to the central point target: 1) compensatory head pitch movement was on average 22% greater despite the fact that the trunk pitch and trunk vertical translation movement control were not significantly changed; 2) coordination patterns between head and trunk as reflected by the peak cross correlation between the head pitch and trunk pitch motion as well as the peak cross correlation between the head pitch and vertical trunk translation motion were not significantly changed; 3) knee joint total movement was on average 11% greater during the period from the heel strike event to the peak knee flexion event in stance phase of the gait cycle; 4) peak acceleration measured at the head was significantly reduced by an average of 13% in four of the six subjects. This was so even when the peak acceleration at the tibia and the transmission of the shock wave at heel strike (measured by the peak acceleration ratio of the head/tibia and the time lag between the tibial and head peak accelerations) remained unchanged. Taken together these results provide further evidence that the full body contributes to gaze stabilization during locomotion, and that its different functional elements can be modified online to contribute to gaze stabilization for different visual task constraints.

NASA Center JSC↗

Cluster Analysis of Spectroscopic Line Profiles and EUV Emission in RMHD Simulations and Observations of the Solar Atmosphere

Spatially-resolved observations from the IRIS, SDO/AIA, and other space mission and ground-based telescopes, coupled with realistic 3D RMHD simulations, are a powerful tool for analysis of processes in the solar atmosphere. To better understand the dynamical and thermodynamic properties in the simulation data and their connection to observations, it is essential to determine similarities in the behaviors of the synthesized and observed emission. However, the complexity of observational data and physical processes makes comparison of observations and modeling results difficult. In this work, we show the initial results of application of K-Means clustering (unsupervised machine learning) algorithm to two different problems: 1) recognition of the typical spectroscopic line profiles observed by IRIS during solar flares and their typical dynamic behavior; 2) recognition of shocks and heating events in synthetic AIA emission data obtained from StellarBox quiet-Sun simulations. The average silhouette width technique for the KMeans algorithm is utilized in different ways to obtain optimal numbers of clusters. We discuss application of the emission clustering to visualizations of the computational volume, understanding its evolutionary trends and behavior patterns, and inversion (reconstruction) of physical properties of the solar atmosphere from synthesizes emission data.

Sadykov, Viacheslav↗

Image remapping strategies applied as protheses for the visually impaired

Maculopathy and retinitis pigmentosa (rp) are two vision defects which render the afflicted person with impaired ability to read and recognize visual patterns. For some time there has been interest and work on the use of image remapping techniques to provide a visual aid for individuals with these impairments. The basic concept is to remap an image according to some mathematical transformation such that the image is warped around a maculopathic defect (scotoma) or within the rp foveal region of retinal sensitivity. NASA/JSC has been pursuing this research using angle invariant transformations with testing of the resulting remapping using subjects and facilities of the University of Houston, College of Optometry. Testing is facilitated by use of a hardware device, the Programmable Remapper, to provide the remapping of video images. This report presents the results of studies of alternative remapping transformations with the objective of improving subject reading rates and pattern recognition. In particular a form of conformal transformation was developed which provides for a smooth warping of an image around a scotoma. In such a case it is shown that distortion of characters and lines of characters is minimized which should lead to enhanced character recognition. In addition studies were made of alternative transformations which, although not conformal, provide for similar low character distortion remapping. A second, non-conformal transformation was studied for remapping of images to aid rp impairments. In this case a transformation was investigated which allows remapping of a vision field into a circular area representing the foveal retina region. The size and spatial representation of the image are selectable. It is shown that parametric adjustments allow for a wide variation of how a visual field is presented to the sensitive retina. This study also presents some preliminary considerations of how a prosthetic device could be implemented in a practical sense, vis-a-vis, size, weight and portability.

Johnson, Curtis D.↗

Computer-implemented system and method for automated and highly accurate plaque analysis, reporting, and visualization

A computer-implemented system and method of intra-oral analysis for measuring plaque removal is disclosed. The system includes hardware for real-time image acquisition and software to store the acquired images on a patient-by-patient basis. The system implements algorithms to segment teeth of interest from surrounding gum, and uses a real-time image-based morphing procedure to automatically overlay a grid onto each segmented tooth. Pattern recognition methods are used to classify plaque from surrounding gum and enamel, while ignoring glare effects due to the reflection of camera light and ambient light from enamel regions. The system integrates these components into a single software suite with an easy-to-use graphical user interface (GUI) that allows users to do an end-to-end run of a patient record, including tooth segmentation of all teeth, grid morphing of each segmented tooth, and plaque classification of each tooth image.

Kemp, James Herbert↗

SU-F-R-25: Automatic Identification of Suspicious Recurrent/residual Disease Regions After Prostatectomy

Purpose: To automatically identify and outline suspicious regions of recurrent or residual disease in the prostate bed using Dynamic Contrast Enhanced-MRI (DCE-MRI) in patients after prostatectomy. Methods: Twenty-two patients presenting for salvage radiotherapy and with identified Gross Tumor Volume (GTV) in the prostate bed were retrospectively analyzed. The MRI data consisted of Axial T2weighted-MRI (T2w) of the pelvis: resolution 1.25×1.25×2.5 mm; Field of View (FOV): 320×320 mm; slice thickness=2.5mm; 72 slices; and Dynamic Contrast Enhanced MRI (DCE-MRI)–12 series of T1w with identical spatial resolution to T2w and at 30–34s temporal resolution. Unsupervised pattern recognition was used to decompose the 4D DCE data as the product W.H of weights W of k patterns H. A well-perfused pattern Hwp was identified and the weight map Wwp associated to Hwp was used to delineate suspicious volumes. Threshold of Wwp set at mean(Wwp)+S*std(Wwp), S=1,1.5,2 and 2.5 defined four volumes labeled as DCE1.0 to DCE2.5. These volumes were displayed on T2w and, along with GTV, were correlated with the highest pre-treatment PSA values, and with pharmacokinetic analysis constants. Results: GTV was significantly correlated with DCE2.0(ρ= 0.60, p<0.003), and DCE 2.5 (ρ=0.58, p=0.004)). Significant correlation was found between highest pre-treatment PSA and GTV(ρ=0.42, p<0.049), DCE2.0(ρ= 0.52, p<0.012), and DCE 2.5 (ρ=0.67, p<<0.01)). Kruskal-Wallis analysis showed that Ktrans median value was statistically different between non-specific prostate bed tissue NSPBT and both GTV (p<<0.001) and DCE2.5 (p<<0.001), but while median Ve was statistically different between DCE2.5 and NSPBT (p=0.002), it was not statistically different between GTV and NSPBT (p=0.054), suggesting that automatic volumes capture more accurately the area of malignancy. Conclusion: Software developed for identification and visualization of suspicions regions in DCE-MRI from post-prostatectomy patients has been validated by PSA and pharmacokinetic constants analysis showing that it generates clinically relevant volumes.

60 APPLIED LIFE SCIENCES↗

Automated Recognition of 3D Features in GPIR Images

A method of automated recognition of three-dimensional (3D) features in images generated by ground-penetrating imaging radar (GPIR) is undergoing development. GPIR 3D images can be analyzed to detect and identify such subsurface features as pipes and other utility conduits. Until now, much of the analysis of GPIR images has been performed manually by expert operators who must visually identify and track each feature. The present method is intended to satisfy a need for more efficient and accurate analysis by means of algorithms that can automatically identify and track subsurface features, with minimal supervision by human operators. In this method, data from multiple sources (for example, data on different features extracted by different algorithms) are fused together for identifying subsurface objects. The algorithms of this method can be classified in several different ways. In one classification, the algorithms fall into three classes: (1) image-processing algorithms, (2) feature- extraction algorithms, and (3) a multiaxis data-fusion/pattern-recognition algorithm that includes a combination of machine-learning, pattern-recognition, and object-linking algorithms. The image-processing class includes preprocessing algorithms for reducing noise and enhancing target features for pattern recognition. The feature-extraction algorithms operate on preprocessed data to extract such specific features in images as two-dimensional (2D) slices of a pipe. Then the multiaxis data-fusion/ pattern-recognition algorithm identifies, classifies, and reconstructs 3D objects from the extracted features. In this process, multiple 2D features extracted by use of different algorithms and representing views along different directions are used to identify and reconstruct 3D objects. In object linking, which is an essential part of this process, features identified in successive 2D slices and located within a threshold radius of identical features in adjacent slices are linked in a directed-graph data structure. Relative to past approaches, this multiaxis approach offers the advantages of more reliable detections, better discrimination of objects, and provision of redundant information, which can be helpful in filling gaps in feature recognition by one of the component algorithms. The image-processing class also includes postprocessing algorithms that enhance identified features to prepare them for further scrutiny by human analysts (see figure). Enhancement of images as a postprocessing step is a significant departure from traditional practice, in which enhancement of images is a preprocessing step.

Park, Han↗

Software and Algorithms for Biomedical Image Data Processing and Visualization

A new software equipped with novel image processing algorithms and graphical-user-interface (GUI) tools has been designed for automated analysis and processing of large amounts of biomedical image data. The software, called PlaqTrak, has been specifically used for analysis of plaque on teeth of patients. New algorithms have been developed and implemented to segment teeth of interest from surrounding gum, and a real-time image-based morphing procedure is used to automatically overlay a grid onto each segmented tooth. Pattern recognition methods are used to classify plaque from surrounding gum and enamel, while ignoring glare effects due to the reflection of camera light and ambient light from enamel regions. The PlaqTrak system integrates these components into a single software suite with an easy-to-use GUI (see Figure 1) that allows users to do an end-to-end run of a patient s record, including tooth segmentation of all teeth, grid morphing of each segmented tooth, and plaque classification of each tooth image. The automated and accurate processing of the captured images to segment each tooth [see Figure 2(a)] and then detect plaque on a tooth-by-tooth basis is a critical component of the PlaqTrak system to do clinical trials and analysis with minimal human intervention. These features offer distinct advantages over other competing systems that analyze groups of teeth or synthetic teeth. PlaqTrak divides each segmented tooth into eight regions using an advanced graphics morphing procedure [see results on a chipped tooth in Figure 2(b)], and a pattern recognition classifier is then used to locate plaque [red regions in Figure 2(d)] and enamel regions. The morphing allows analysis within regions of teeth, thereby facilitating detailed statistical analysis such as the amount of plaque present on the biting surfaces on teeth. This software system is applicable to a host of biomedical applications, such as cell analysis and life detection, or robotic applications, such as product inspection or assembly of parts in space and industry.

Talukder, Ashit↗

A Convolutional Neural Network Neutrino Event Classifier

Convolutional neural networks (CNNs) have been widely applied in the computer vision community to solve complex problems in image recognition and analysis. We describe an application of the CNN technology to the problem of identifying particle interactions in sampling calorimeters used commonly in high energy physics and high energy neutrino physics in particular. Following a discussion of the core concepts of CNNs and recent innovations in CNN architectures related to the field of deep learning, we outline a specific application to the NOvA neutrino detector. This algorithm, CVN (Convolutional Visual Network) identifies neutrino interactions based on their topology without the need for detailed reconstruction and outperforms algorithms currently in use by the NOvA collaboration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Automated assignment of rotational spectra using artificial neural networks

Here, a typical broadband rotational spectrum may contain several thousand observable transitions, spanning many species. While these spectra often encode troves of chemical information, identifying and assigning the individual spectra can be challenging. Traditional approaches typically involve visually identifying a pattern. A more modern approach is to apply an automated fitting routine. In this approach, combinations of 3 transitions are searched by trial and error, to fit the A , B , and C rotational constants in a Watson-type Hamiltonian. In this work, we develop an alternative approach-to utilize machine learning to train a computer to recognize the patterns inherent in rotational spectra. Broadband high-resolution rotational spectra are perhaps uniquely suited for pattern recognition, assignment, and species identification using machine learning. Repeating patterns of transition frequencies and intensities are now routinely recorded in broadband chirped-pulse Fourier transform microwave experiments in which both the number of resolution elements and the dynamic range surpass 10 4 . At the same time, these high-resolution spectra are extremely sensitive to molecular geometry with each polar species having a unique rotational spectrum. Here we train the feed forward neural network on thousands of rotational spectra that we calculate, using the rules of quantum mechanics, from randomly generated sets of rotational constants and other Hamiltonian parameters. Reasonable physical constraints are applied to these parameter sets, yet they need not belong to existing species. A trained neural network presented with a spectrum identifies its type (e.g., linear molecule, symmetric top, or asymmetric top) and infers the corresponding Hamiltonian parameters (rotational constants, distortion, and hyperfine constants). The classification and prediction times, about 160 μs and 50 μs, respectively, seem independent of the spectral complexity or the number of molecular parameters. We describe how the network works, provide benchmarking results, and discuss future directions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A deep learning approach to programmable RNA switches

Engineered RNA elements are programmable tools capable of detecting small molecules, proteins, and nucleic acids. Predicting the behavior of these synthetic biology components remains a challenge, a situation that could be addressed through enhanced pattern recognition from deep learning. Here, we investigate Deep Neural Networks (DNN) to predict toehold switch function as a canonical riboswitch model in synthetic biology. To facilitate DNN training, we synthesize and characterize in vivo a dataset of 91,534 toehold switches spanning 23 viral genomes and 906 human transcription factors. DNNs trained on nucleotide sequences outperform (R 2 = 0.43–0.70) previous state-of-the-art thermodynamic and kinetic models (R 2 = 0.04–0.15) and allow for human-understandable attention-visualizations (VIS4Map) to identify success and failure modes. This work shows that deep learning approaches can be used for functionality predictions and insight generation in RNA synthetic biology.

59 BASIC BIOLOGICAL SCIENCES↗

Discrimination of rock classes and alteration products in southwestern Saudi Arabia with computer-enhanced LANDSAT data

Digital LANDSAT MSS data for an area in the southwestern Arabian Shield were computer-enhanced to improve discrimination of rock classes, and recognition of gossans associated with massive sulphide deposits. The test area is underlain by metamorphic rocks that are locally intruded by granites; these are partly overlain by sandstones. The test area further includes the Wadi Wassat and Wadi Qatan massive sulphide deposits, which are commonly capped by gossans of ferric oxides, silica, and carbonates. Color patterns and boundaries on contrast-stretched ratio color composite imagery, and on complementary images constructed using principal component and canonical analyses transformations, correspond exceptionally well to 1:100,000 scale field maps. A qualitative visual comparison of information content showed that the ratio enhancement provided the best overall image for identification of rock type and alteration products.

Blodget, H. W.↗

Gene Expression Dynamics Inspector (GEDI): for integrative analysis of expression profiles

Genome-wide expression profiles contain global patterns that evade visual detection in current gene clustering analysis. Here, a Gene Expression Dynamics Inspector (GEDI) is described that uses self-organizing maps to translate high-dimensional expression profiles of time courses or sample classes into animated, coherent and robust mosaics images. GEDI facilitates identification of interesting patterns of molecular activity simultaneously across gene, time and sample space without prior assumption of any structure in the data, and then permits the user to retrieve genes of interest. Important changes in genome-wide activities may be quickly identified based on 'Gestalt' recognition and hence, GEDI may be especially useful for non-specialist end users, such as physicians. AVAILABILITY: GEDI v1.0 is written in Matlab, and binary Matlab.dll files which require Matlab to run can be downloaded for free by academic institutions at http://www.chip.org/~ge/gedihome.html Supplementary information: http://www.chip.org/~ge/gedihome.html.

Database Management Systems↗

Neuroplastic Response After Radiation Therapy for Pediatric Brain Tumors: A Pilot Study

Purpose: Clinically effective measurement of cognitive toxicity from photon radiation therapy (XRT) should be accurate, sensitive, and specific. This pilot study tested translational findings on phasic changes in children's memory systems that are sensitive and insensitive to toxic XRT effects to identify a possible neuroplastic effect. Methods and Materials: Memory processes were prospectively tested before XRT and at 3 later time points up to 2 years in 35 children with mixed primary brain tumors who had not experienced recurrence. Memory processes were verbal-semantic, visual-semantic, and visual-perceptual, including accuracy, speed to recall, encoding, retrieval, and recognition. The mixed-effects model included time (to estimate slope), covariates (age, tumor locus, XRT field, and medications) as fixed effects, and individual random intercepts. A sensitivity analysis examined the influence of XRT dose to the hippocampi on memory. Results: Retrieval from long-term verbal-semantic memory declined 2 months after completing XRT, as seen in adults, and was lowest at 1 year, which was delayed in comparison with adults. Double dissociation from visual-perceptual memory at baseline and 2 months was found, consistent with adults. Recovery was demonstrated 2 years after XRT. Patterns were unchanged when dose to hippocampus was included in the model. Conclusions: Verbal and semantic long-term retrieval is specifically sensitive to XRT-related cognitive dysfunction, without effect on visual-perceptual memory. Children reached nadir in XRT-sensitive memory 1 year after XRT and recovered by 2 years, which is later than that observed in adults. The protracted period of post-XRT injury may represent the maturation of the human hippocampus and white matter into late adolescence.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Beyond PCA: Additional Dimension Reduction Techniques to Consider in the Development of Climate Fingerprints

Abstract Dimension reduction techniques are an essential part of the climate analyst’s toolkit. Due to the enormous scale of climate data, dimension reduction methods are used to identify major patterns of variability within climate dynamics, to create compelling and informative visualizations, and to quantify major named modes such as El Niño–Southern Oscillation. Principal components analysis (PCA), also known as the method of empirical orthogonal functions (EOFs), is the most commonly used form of dimension reduction, characterized by a remarkable confluence of attractive mathematical, statistical, and computational properties. Despite its ubiquity, PCA suffers from several difficulties relevant to climate science: high computational burden with large datasets, decreased statistical accuracy in high dimensions, and difficulties comparing across multiple datasets. In this paper, we introduce several variants of PCA that are likely to be of use in climate sciences and address these problems. Specifically, we introduce non-negative , sparse , and tensor PCA and demonstrate how each approach provides superior pattern recognition in climate data. We also discuss approaches to comparing PCA-family results within and across datasets in a domain-relevant manner. We demonstrate these approaches through an analysis of several runs of the E3SM climate model from 1991 to 1995, focusing on the simulated response to the Mt. Pinatubo eruption; our findings are consistent with a recently identified stratospheric warming fingerprint associated with this type of stratospheric aerosol injection.

Weylandt, Michael↗

Computer-Assisted Diagnosis System for Breast Cancer in Computed Tomography Laser Mammography (CTLM)

Computed tomography laser mammography (Eid et al. Egyp J Radiol Nucl Med, 37(1): p. 633–643, 1) is a non-invasive imaging modality for breast cancer diagnosis, which is time-consuming and challenging for the radiologist to interpret the images. Some issues have increased the missed diagnosis of radiologists in visual manner assessment in CTLM images, such as technical reasons which are related to imaging quality and human error due to the structural complexity in appearance. The purpose of this study is to develop a computer-aided diagnosis framework to enhance the performance of radiologist in the interpretation of CTLM images. The proposed CAD system contains three main stages including segmentation of volume of interest (VOI), feature extraction and classification. A 3D Fuzzy segmentation technique has been implemented to extract the VOI. The shape and texture of angiogenesis in CTLM images are significant characteristics to differentiate malignancy or benign lesions. The 3D compactness features and 3D Grey Level Co-occurrence matrix (GLCM) have been extracted from VOIs. Multilayer perceptron neural network (MLPNN) pattern recognition has developed for classification of the normal and abnormal lesion in CTLM images. The performance of the proposed CAD system has been measured with different metrics including accuracy, sensitivity, and specificity and area under receiver operative characteristics (AROC), which are 95.2, 92.4, 98.1, and 0.98%, respectively.

62 RADIOLOGY AND NUCLEAR MEDICINE↗