Search NASASearch

SEARCH · Search NASA

Results for “Neural Patterning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Understanding and Verifying Neural Networks

Deep Neural Networks (DNNs) have gained immense popularity in recent times and have widespread use in applications such as image classification, sentiment analysis, speech recognition and also in safety-critical applications such as autonomous driving. However, they suffer limitations such as lack of explainability and robustness which raise safety and security concerns in their usage. Further, the complex structure and large input spaces of DNNs act as an impediment to thorough verification and testing. The SafeDNN project at the Robust Software Engineering (RSE) group at NASA aims at exploring techniques to ensure that systems that use deep neural networks are safe, robust and interpretable. In this talk, I will be presenting our technique Prophecy that automatically infers formal properties of deep neural network models. The tool extracts patterns based on neuron activations as preconditions that imply certain desirable output properties of the model. I would be highlighting case studies that use Prophecy in obtaining explanations for network decisions, understanding correct and incorrect behavior, providing formal guarantees wrt safety and robustness, and debugging neural network models. We have applied the tool on image classification networks, neural network controllers providing turn advisories in unmanned aircrafts, regression models used for autonomous center-line tracking in aircrafts and neural network object detectors

Deep Neural Networks

Neural networks for calibration tomography

Artificial neural networks are suitable for performing pattern-to-pattern calibrations. These calibrations are potentially useful for facilities operations in aeronautics, the control of optical alignment, and the like. Computed tomography is compared with neural net calibration tomography for estimating density from its x-ray transform. X-ray transforms are measured, for example, in diffuse-illumination, holographic interferometry of fluids. Computed tomography and neural net calibration tomography are shown to have comparable performance for a 10 degree viewing cone and 29 interferograms within that cone. The system of tomography discussed is proposed as a relevant test of neural networks and other parallel processors intended for using flow visualization data.

Decker, Arthur

Neural network classification of clinical neurophysiological data for acute care monitoring

The purpose of neurophysiological monitoring of the 'acute care' patient is to allow the accurate recognition of changing or deteriorating neurological function as close to the moment of occurrence as possible, thus permitting immediate intervention. Results confirm that: (1) neural networks are able to accurately identify electroencephalogram (EEG) patterns and evoked potential (EP) wave components, and measuring EP waveform latencies and amplitudes; (2) neural networks are able to accurately detect EP and EEG recordings that have been contaminated by noise; (3) the best performance was obtained consistently with the back propagation network for EP and the HONN for EEG's; (4) neural network performed consistently better than other methods evaluated; and (5) neural network EEG and EP analyses are readily performed on multichannel data.

Sgro, Joseph

Inspection of Space Station Cold Plate Using Visual and Automated Holographic Techniques

Real-time holography has been used to confirm the presence of non-uniformity in the construction of an International Space Station cold plate. Ultrasonic C-scans have previously shown suspected areas of cooling fin disbonds. But both neural-net processed and visual holography did not evidence any progressive permanent changes resulting from 3000 pressurization and relaxation cycles of a Dash 8 cold plate. Neural-net and visual inspections were performed of characteristic patterns generated from electronic time-average holograms of the vibrating cold plate. Normal modes of vibration were excited at very low amplitudes for this purpose, The neural nets were trained to flag very small changes in the mode shapes as encoded in the characteristic patterns. Both the whole cold plate and a zoomed region were inspected. The inspections were conducted before, after, and during pressurization and relaxation cycles of the cold plate. A water-filled cold plate was pressurized to 120 psig (827 kPa) and relaxed for each cycle. Each cycle required 5 seconds. Both the artificial neural networks and the inspectors were unable to detect changes in the mode shapes of the relaxed cold plate. The cold plate was also inspected visually using real-time holography and double-exposure holography. Regions of non-uniformity correlating with the C-scans were apparent, but the interference patterns did not change after 3000 pressurization and relaxation cycles. These tests constituted the first practical application of a neural-net inspection technique developed originally with support from the Director's Discretionary Fund at the Glenn Research Center at Lewis Field.

Decker, Arthur J.

Three-Dimensional Stereoscopic Tracking Velocimetry and Experimental/Numerical Comparison of Directional Solidification

Measurement of three-dimensional (3-D) three-component velocity fields is of great importance in both ground and space experiments for understanding materials processing and fluid physics. The experiments in these fields most likely inhibit the application of conventional planar probes for observing 3-D phenomena. Here, we present the investigation results of stereoscopic tracking velocimetry (STV) for measuring 3-D velocity fields, which include diagnostic technology development, experimental velocity measurement, and comparison with analytical and numerical computation. STV is advantageous in system simplicity for building compact hardware and in software efficiency for continual near-real-time monitoring. It has great freedom in illuminating and observing volumetric fields from arbitrary directions. STV is based on stereoscopic observation of particles-Seeded in a flow by CCD sensors. In the approach, part of the individual particle images that provide data points is likely to be lost or cause errors when their images overlap and crisscross each other especially under a high particle density. In order to maximize the valid recovery of data points, neural networks are implemented for these two important processes. For the step of particle overlap decomposition, the back propagation neural network is utilized because of its ability in pattern recognition with pertinent particle image feature parameters. For the step of particle tracking, the Hopfield neural network is employed to find appropriate particle tracks based on global optimization. Our investigation indicates that the neural networks are very efficient and useful for stereoscopically tracking particles. As an initial assessment of the diagnostic technology performance, laminar water jets with and without pulsation are measured. The jet tip velocity profiles are in good agreement with analytical predictions. Finally, for testing in material processing applications, a simple directional solidification apparatus is built for experimenting with a metal analog of succinonitrile. Its 3-D velocity field at the liquid phase is then measured to be compared with those from numerical computation. Our theoretical, numerical, and experimental investigations have proven STV to be a viable candidate for reliably measuring 3-D flow velocities. With current activities are focused on further improving the processing efficiency, overall accuracy, and automation, the eventual efforts of broad experimental applications and concurrent numerical modeling validation will be vital to many areas in fluid flow and materials processing.

Lee, David

Developing Open-Source Training Materials for AI/ML and Space Biological Sciences Using NASA Cloud-Based Data

Artificial Intelligence (AI) and Machine Learning (ML) has gained significant traction in the biological and biomedical research fields, in part due to a culture of open data sharing and reuse. AI/ML methodology is well-suited to recognize and predict biological patterns from high-dimensional next-generation sequencing data (e.g. whole genome sequencing, transcriptomic sequencing), as well as from biological or medical imaging data (e.g. microscopy, computed tomography, ultrasound, magnetic resonance imaging, radiography). These methodologies hold particular promise for space biosciences research and automated space health monitoring systems. However, there are key considerations for properly training, validating, and testing a machine learning model in biological research or clinical application. Inexperienced researchers can produce models that perform poorly outside of the training dataset. Open Science principles such as data sharing and open-source code must go hand-in-hand with publicly available, high-quality training curricula in best practices, with modules centered on real-life scientific use cases and data so future AI/ML practitioners gain experience on real problems. Here we present the development of open-source training materials for AI/ML and space biosciences, as part of the NASA Transform to Open Science Training (TOPST) initiative. We develop 4 independent training programs, focused on the following topics: 1) Fundamentals of Machine Learning and Space Biosciences Domain, 2) Open Science, Artificial Intelligence, and Ethical Best Practices for Data Sharing and Analysis, 3) Using AI/ML Classification to Identify Gene Networks Affected By Space Exposure in Mouse Liver, and 4) Using Neural Networks to Find DNA Damage Patterns in Immune Cells after Radiation. All programs leverage cloud-based NASA biological datasets. The curriculum we present will enable worldwide access to training in AI/ML and scientific analysis.

James Casaletto

Developing Open-Source Training Materials for AI/ML and Space Biological Sciences Using NASA Cloud-Based Data

Artificial Intelligence (AI) and Machine Learning (ML) has gained significant traction in the biological and biomedical research fields in the last two decades, in part thanks to an increasing culture of open data sharing and reuse. Due to its capability for identifying complex relationships and patterns, AI/ML methodology is particularly well suited to recognize and predict biological patterns from high-dimensional next-generation sequencing data (e.g. whole genome sequencing, transcriptomic sequencing), as well as from biological or medical imaging data (e.g. microscopy, computed tomography, ultrasound, magnetic resonance imaging, radiography). These methodologies hold particular promise for space biosciences research and automated space health monitoring systems. However, there are many key considerations for properly training, validating, and testing a machine learning model in biological research or clinical application. Even with the positive culture of Open Science and data sharing, inexperienced researchers working quickly without proper checks can produce models that perform poorly outside of the immediate training dataset. Lessons learned from biological AI/ML research indicate that Open Science principles such as data sharing and open-source code must go hand-in-hand with publicly available, high-quality training curricula in best practices, with modules centered on real-life scientific use cases and data so future AI/ML practitioners gain experience on real problems. Here we present the development of open-source training materials for AI/ML and space biosciences, as part of the NASA Transform to Open Science Training (TOPST) initiative. We develop 4 independent training programs, focused on the following topics: 1) Fundamentals of Machine Learning and Space Biosciences Domain, 2) Open Science, Artificial Intelligence, and Ethical Best Practices for Data Sharing and Analysis, 3) Using AI/ML Classification to Identify Gene Networks Affected By Space Exposure in Mouse Liver, and 4) Using Neural Networks to Find DNA Damage Patterns in Immune Cells after Radiation. All programs leverage cloud-based NASA biological datasets. The curriculum we present will enable worldwide access to training in AI/ML and scientific analysis.

James Andrew Casaletto

Comparisons of neural networks to standard techniques for image classification and correlation

Neural network techniques for multispectral image classification and spatial pattern detection are compared to the standard techniques of maximum-likelihood classification and spatial correlation. The neural network produced a more accurate classification than maximum-likelihood of a Landsat scene of Tucson, Arizona. Some of the errors in the maximum-likelihood classification are illustrated using decision region and class probability density plots. As expected, the main drawback to the neural network method is the long time required for the training stage. The network was trained using several different hidden layer sizes to optimize both the classification accuracy and training speed, and it was found that one node per class was optimal. The performance improved when 3x3 local windows of image data were entered into the net. This modification introduces texture into the classification without explicit calculation of a texture measure. Larger windows were successfully used for the detection of spatial features in Landsat and Magellan synthetic aperture radar imagery.

Paola, Justin D.

Evolutionary conservation of the presumptive neural plate markers AmphiSox1/2/3 and AmphiNeurogenin in the invertebrate chordate amphioxus

Amphioxus, as the closest living invertebrate relative of the vertebrates, can give insights into the evolutionary origin of the vertebrate body plan. Therefore, to investigate the evolution of genetic mechanisms for establishing and patterning the neuroectoderm, we cloned and determined the embryonic expression of two amphioxus transcription factors, AmphiSox1/2/3 and AmphiNeurogenin. These genes are the earliest known markers for presumptive neuroectoderm in amphioxus. By the early neurula stage, AmphiNeurogenin expression becomes restricted to two bilateral columns of segmentally arranged neural plate cells, which probably include precursors of motor neurons. This is the earliest indication of segmentation in the amphioxus nerve cord. Later, expression extends to dorsal cells in the nerve cord, which may include precursors of sensory neurons. By the midneurula, AmphiSox1/2/3 expression becomes limited to the dorsal part of the forming neural tube. These patterns resemble those of their vertebrate and Drosophila homologs. Taken together with the evolutionarily conserved expression of the dorsoventral patterning genes, BMP2/4 and chordin, in nonneural and neural ectoderm, respectively, of chordates and Drosophila, our results are consistent with the evolution of the chordate dorsal nerve cord and the insect ventral nerve cord from a longitudinal nerve cord in a common bilaterian ancestor. However, AmphiSox1/2/3 differs from its vertebrate homologs in not being expressed outside the CNS, suggesting that additional roles for this gene have evolved in connection with gene duplication in the vertebrate lineage. In contrast, expression in the midgut of AmphiNeurogenin together with the gene encoding the insulin-like peptide suggests that amphioxus may have homologs of vertebrate pancreatic islet cells, which express neurogenin3. In addition, AmphiNeurogenin, like its vertebrate and Drosophila homologs, is expressed in apparent precursors of epidermal chemosensory and possibly mechanosensory cells, suggesting a common origin for protostome and deuterostome epidermal sensory cells in the ancestral bilaterian. Copyright 2000 Academic Press.

NASA Discipline Evolutionary Biology

Vector Quantization With Emergent Codebook Structure

Proposed scheme under development for transmission of vector-quantized digital video images, vector quantizer codebook updated to adapt quantizer to changing signal statistics. Intended to be realized with electronic neural network. Codebook, which consists of patterns constituting video images, will undergo training during operation and scheme will develop codebooks ordered during training. System enables coding more compact, more immune to noise, and supports variable rate compression.

Ahalt, Stanley C.

Interferometer Control of Optical Tweezers

This paper discusses progress in using spatial light modulators and interferometry to control the beam profile of an optical tweezers. The approach being developed is to use a spatial light modulator (SLM) to control the phase profile of the tweezers beam and to use a combination of the SLM and interferometry to control the intensity profile. The objective is to perform fine and calculable control of the moments and forces on a tip or tool to be used to manipulate and interrogate nanostructures. The performance of the SLM in generating multiple and independently controllable tweezers beams is also reported. Concurrent supporting research projects are mentioned and include tweezers beam scattering and neural-net processing of the interference patterns for control of the tweezers beams.

Decker, Arthur J.

Intelligent Agent Technology

Open Sesame! is the first commercial software product that learns user's behavior, and offers automation and coaching suggestions to the user. The neural learning module looks for repetitive patterns that have not been automated; when it finds one, it creates an observation and, upon approval, automates the task. The manufacturer, Charles River Analytics, credits Langley Research Center and Johnson Space Center Small Business Innovation Research grants and the time the president and vice president spent at the two centers in the 1970s as being essential to the development of their product line.

Source record

Aircraft Fault Detection and Classification Using Multi-Level Immune Learning Detection

This work is an extension of a recently developed software tool called MILD (Multi-level Immune Learning Detection), which implements a negative selection algorithm for anomaly and fault detection that is inspired by the human immune system. The immunity-based approach can detect a broad spectrum of known and unforeseen faults. We extend MILD by applying a neural network classifier to identify the pattern of fault detectors that are activated during fault detection. Consequently, MILD now performs fault detection and identification of the system under investigation. This paper describes the application of MILD to detect and classify faults of a generic transport aircraft augmented with an intelligent flight controller. The intelligent control architecture is designed to accommodate faults without the need to explicitly identify them. Adding knowledge about the existence and type of a fault will improve the handling qualities of a degraded aircraft and impact tactical and strategic maneuvering decisions. In addition, providing fault information to the pilot is important for maintaining situational awareness so that he can avoid performing an action that might lead to unexpected behavior - e.g., an action that exceeds the remaining control authority of the damaged aircraft. We discuss the detection and classification results of simulated failures of the aircraft's control system and show that MILD is effective at determining the problem with low false alarm and misclassification rates.

Wong, Derek

Sensor arrays for detecting microorganisms

A sensor array for detecting a microorganism comprising first and second sensors electrically connected to an electrical measuring apparatus, wherein the sensors comprise a region of nonconducting organic material and a region of conducting material compositionally that is different than the nonconducting organic material and an electrical path through the regions of nonconducting organic material and the conducting material. A system for identifying microorganisms using the sensor array, a computer and a pattern recognition algorithm, such as a neural net are also disclosed.

Lewis, Nathan S.

Classification of the LCVF AVIRIS test site with a Kohonen artificial neural network

We present a classification of an AVIRIS spectral image of the Lunar Crater Volcanic Field (LCVF). Geologic mapping from such data is made possible by distinctive mineral signatures: absorption features and the shape of the spectral continuum. The subtle spectral shape differences between some of the geological units in this scene along with the high dimensionality of the spectral presents a challenging pattern recognition task. We found an artificial neural network powerful in separating 13 geological units based on the full spectral resolution. The LCVF, in northern Nye County, Nevada, was the primary focus of the NASA-sponsored Geologic Remote Sensing Field Experiment in the summer of 1989. It consists of over 100 square miles of Quaternary basaltic pyroclastic and flow deposits. These deposits lie atop ignimbrites and silicic lava flows of Tertiary age and in turn are overlain by Quaternary alluvial and playa deposits. This AVIRIS image was collected on September 29, 1989 at 11:44 at 11:44 PDT. The 256-by-256 pixel subsection in this study contains oxidized basaltic cinder deposits, the southern half of the Lunar Lake playa, and outcrops of the Rhyollite of Big Sand Spring Valley. Vegetation in LCVF is sparse, but locally abundant within washes and near springs.

Merenyi, Erzsebet

A Suppression-based STDP Rule Resilient to Jitter Noise in Spike Patterns for Neuromorphic Computing

Multi-spike models of synaptic plasticity, such as the triplet and suppression spike-timing-dependent plasticity (STDP) rules, exhibit better alignment with neurophysiological data in the brain compared to the pair-based STDP rule. Previous studies have empirically shown that the pair-based STDP rule can detect spatiotemporal spike patterns hidden in equally dense distractor spike trains in an unsupervised manner. However, it fails to detect spike patterns influenced by jitter noise. Given that spiking neural networks (SNNs) exhibit variability in generated spike trains in response to the same inputs, it becomes imperative to have learning rules capable of detecting spike patterns even in the presence of jitter noise. In this study, we introduce a simplified suppression-based STDP rule that demonstrates significantly enhanced tolerance to jitter in spike patterns compared to the pair-based STDP rule. Unlike the ideal suppression STDP rule, characterized by an exponential learning window and requiring high-resolution synapses, the simplified rule limits the synaptic efficacy update to a single bit at any given instant. Moreover, it employs 4-bit fixed-point synapses, facilitating straightforward implementation in neuromorphic hardware.

Gautam, Ashish [ORNL]

Optoelectronic analogs of self-programming neural nets - Architecture and methodologies for implementing fast stochastic learning by simulated annealing

Self-organization and learning is a distinctive feature of neural nets and processors that sets them apart from conventional approaches to signal processing. It leads to self-programmability which alleviates the problem of programming complexity in artificial neural nets. In this paper architectures for partitioning an optoelectronic analog of a neural net into distinct layers with prescribed interconnectivity pattern to enable stochastic learning by simulated annealing in the context of a Boltzmann machine are presented. Stochastic learning is of interest because of its relevance to the role of noise in biological neural nets. Practical considerations and methodologies for appreciably accelerating stochastic learning in such a multilayered net are described. These include the use of parallel optical computing of the global energy of the net, the use of fast nonvolatile programmable spatial light modulators to realize fast plasticity, optical generation of random number arrays, and an adaptive noisy thresholding scheme that also makes stochastic learning more biologically plausible. The findings reported predict optoelectronic chips that can be used in the realization of optical learning machines.

Farhat, Nabil H.