Search NASASearch

SEARCH · Search NASA

Results for “Neural Circuits”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Auto-programmable impulse neural circuits

Impulse neural networks use pulse trains to communicate neuron activation levels. Impulse neural circuits emulate natural neurons at a more detailed level than that typically employed by contemporary neural network implementation methods. An impulse neural circuit which realizes short term memory dynamics is presented. The operation of that circuit is then characterized in terms of pulse frequency modulated signals. Both fixed and programmable synapse circuits for realizing long term memory are also described. The implementation of a simple and useful unsupervised learning law is then presented. The implementation of a differential Hebbian learning rule for a specific mean-frequency signal interpretation is shown to have a straightforward implementation using digital combinational logic with a variation of a previously developed programmable synapse circuit. This circuit is expected to be exploited for simple and straightforward implementation of future auto-adaptive neural circuits.

Watula, D.

Low Temperature Performance of High-Speed Neural Network Circuits

Artificial neural networks, derived from their biological counterparts, offer a new and enabling computing paradigm specially suitable for such tasks as image and signal processing with feature classification/object recognition, global optimization, and adaptive control. When implemented in fully parallel electronic hardware, it offers orders of magnitude speed advantage. Basic building blocks of the new architecture are the processing elements called neurons implemented as nonlinear operational amplifiers with sigmoidal transfer function, interconnected through weighted connections called synapses implemented using circuitry for weight storage and multiply functions either in an analog, digital, or hybrid scheme.

artificial neural networks image processing signal

Robust neural classifier circuits using asynchronous design

Aerospace neural circuits must be adaptive, offer a practical size-performance ratio, and be environmentally robust. Our approach to building such circuits combines asynchronous design with a new fuzzy/neural classifier model. Asynchronous circuits offer many design advantages for neural hardware and our hybrid fuzzy/neural model, using mainly min and max operators, promises a low circuit complexity. The general approach is described and a description of a use of rule-induction to further reduce circuit complexity is described.

Hurdle, John F.

Room and Low Temperature Performance of High-Speed Neural Network Circuits

We have described a challenging neural-network hardware implementation that would mate a 64x64-pixel infrared sensor directly on to a 3-dimensionally packaged set of neural processing chips with parallel input for high speed image processing. Non linearity effects and range compression are also discussed.

high-speed neural network circuits neural network

Document analysis with neural net circuits

Document analysis is one of the main applications of machine vision today and offers great opportunities for neural net circuits. Despite more and more data processing with computers, the number of paper documents is still increasing rapidly. A fast translation of data from paper into electronic format is needed almost everywhere, and when done manually, this is a time consuming process. Markets range from small scanners for personal use to high-volume document analysis systems, such as address readers for the postal service or check processing systems for banks. A major concern with present systems is the accuracy of the automatic interpretation. Today's algorithms fail miserably when noise is present, when print quality is poor, or when the layout is complex. A common approach to circumvent these problems is to restrict the variations of the documents handled by a system. In our laboratory, we had the best luck with circuits implementing basic functions, such as convolutions, that can be used in many different algorithms. To illustrate the flexibility of this approach, three applications of the NET32K circuit are described in this short viewgraph presentation: locating address blocks, cleaning document images by removing noise, and locating areas of interest in personal checks to improve image compression. Several of the ideas realized in this circuit that were inspired by neural nets, such as analog computation with a low resolution, resulted in a chip that is well suited for real-world document analysis applications and that compares favorably with alternative, 'conventional' circuits.

Graf, Hans Peter

Optoelectronic Integrated Circuits For Neural Networks

Many threshold devices placed on single substrate. Integrated circuits containing optoelectronic threshold elements developed for use as planar arrays of artificial neurons in research on neural-network computers. Mounted with volume holograms recorded in photorefractive crystals serving as dense arrays of variable interconnections between neurons.

Psaltis, D.

High level cognitive information processing in neural networks

Two related research efforts were addressed: (1) high-level connectionist cognitive modeling; and (2) local neural circuit modeling. The goals of the first effort were to develop connectionist models of high-level cognitive processes such as problem solving or natural language understanding, and to understand the computational requirements of such models. The goals of the second effort were to develop biologically-realistic model of local neural circuits, and to understand the computational behavior of such models. In keeping with the nature of NASA's Innovative Research Program, all the work conducted under the grant was highly innovative. For instance, the following ideas, all summarized, are contributions to the study of connectionist/neural networks: (1) the temporal-winner-take-all, relative-position encoding, and pattern-similarity association techniques; (2) the importation of logical combinators into connection; (3) the use of analogy-based reasoning as a bridge across the gap between the traditional symbolic paradigm and the connectionist paradigm; and (4) the application of connectionism to the domain of belief representation/reasoning. The work on local neural circuit modeling also departs significantly from the work of related researchers. In particular, its concentration on low-level neural phenomena that could support high-level cognitive processing is unusual within the area of biological local circuit modeling, and also serves to expand the horizons of the artificial neural net field.

Barnden, John A.

Neurodynamic oscillators

Oscillation of electrical activity has been found in many nervous systems, from invertebrates to vertebrates including man. There exists experimental evidence of very simple circuits with the capability of oscillation. Neurons with intrinsic oscillation have been found and also neural circuits where oscillation is a property of the network. These two types of oscillations coexist in many instances. It is nowadays hypothesized that behind synchronization and oscillation there is a system of coupled oscillators responsible for activities that range from locomotion and feature binding in vision to control of sleep and circadian rhythms. The huge knowledge that has been acquired on oscillators from the times of Lord Rayleigh has made the simulation of neural oscillators a very active endeavor. This has been enhanced with more recent physiological findings about small neural circuits by means of intracellular and extracellular recordings as well as imaging methods. The future of this interdisciplinary field looks very promising; some researchers are going into quantum mechanics with the idea of trying to provide a quantum description of the brain. In this work we describe some simulations using neuron models by means of which we form simple neural networks that have the capability of oscillation. We analyze the oscillatory activity with root locus method, cross-correlation histograms, and phase planes. In the more complicated neural network models there is the possibility of chaotic oscillatory activity and we study that by means of Lyapunov exponents. The companion paper shows an example of that kind.

Espinosa, Ismael

On the nature and evolution of the neural bases of human language

The traditional theory equating the brain bases of language with Broca's and Wernicke's neocortical areas is wrong. Neural circuits linking activity in anatomically segregated populations of neurons in subcortical structures and the neocortex throughout the human brain regulate complex behaviors such as walking, talking, and comprehending the meaning of sentences. When we hear or read a word, neural structures involved in the perception or real-world associations of the word are activated as well as posterior cortical regions adjacent to Wernicke's area. Many areas of the neocortex and subcortical structures support the cortical-striatal-cortical circuits that confer complex syntactic ability, speech production, and a large vocabulary. However, many of these structures also form part of the neural circuits regulating other aspects of behavior. For example, the basal ganglia, which regulate motor control, are also crucial elements in the circuits that confer human linguistic ability and abstract reasoning. The cerebellum, traditionally associated with motor control, is active in motor learning. The basal ganglia are also key elements in reward-based learning. Data from studies of Broca's aphasia, Parkinson's disease, hypoxia, focal brain damage, and a genetically transmitted brain anomaly (the putative "language gene," family KE), and from comparative studies of the brains and behavior of other species, demonstrate that the basal ganglia sequence the discrete elements that constitute a complete motor act, syntactic process, or thought process. Imaging studies of intact human subjects and electrophysiologic and tracer studies of the brains and behavior of other species confirm these findings. As Dobzansky put it, "Nothing in biology makes sense except in the light of evolution" (cited in Mayr, 1982). That applies with as much force to the human brain and the neural bases of language as it does to the human foot or jaw. The converse follows: the mark of evolution on the brains of human beings and other species provides insight into the evolution of the brain bases of human language. The neural substrate that regulated motor control in the common ancestor of apes and humans most likely was modified to enhance cognitive and linguistic ability. Speech communication played a central role in this process. However, the process that ultimately resulted in the human brain may have started when our earliest hominid ancestors began to walk.

Review, Tutorial

Neural learning rules for the vestibulo-ocular reflex

Mechanisms for the induction of motor learning in the vestibulo-ocular reflex (VOR) were evaluated by recording the patterns of neural activity elicited in the cerebellum by a range of stimuli that induce learning. Patterns of climbing-fiber, vestibular, and Purkinje cell simple-spike signals were examined during sinusoidal head movement paired with visual image movement at stimulus frequencies from 0.5 to 10 Hz. A comparison of simple-spike and vestibular signals contained the information required to guide learning only at low stimulus frequencies, and a comparison of climbing-fiber and simple-spike signals contained the information required to guide learning only at high stimulus frequencies. Learning could be guided by comparison of climbing-fiber and vestibular signals at all stimulus frequencies tested, but only if climbing fiber responses were compared with the vestibular signals present 100 msec earlier. Computational analysis demonstrated that this conclusion is valid even if there is a broad range of vestibular signals at the site of plasticity. Simulations also indicated that the comparison of vestibular and climbing-fiber signals across the 100 msec delay must be implemented by a subcellular "eligibility" trace rather than by neural circuits that delay the vestibular inputs to the site of plasticity. The results suggest two alternative accounts of learning in the VOR. Either there are multiple mechanisms of learning that use different combinations of neural signals to drive plasticity, or there is a single mechanism tuned to climbing-fiber activity that follows activity in vestibular pathways by approximately 100 msec.

NASA Discipline Neuroscience

Parallel structures in human and computer memory

If one thinks of our experiences as being recorded continuously on film, then human memory can be compared to a film library that is indexed by the contents of the film strips stored in it. Moreover, approximate retrieval cues suffice to retrieve information stored in this library. One recognizes a familiar person in a fuzzy photograph or a familiar tune played on a strange instrument. A computer memory that would allow a computer to recognize patterns and to recall sequences the way humans do is constructed. Such a memory is remarkably similiar in structure to a conventional computer memory and also to the neural circuits in the cortex of the cerebellum of the human brain. It is concluded that the frame problem of artificial intelligence could be solved by the use of such a memory if one were able to encode information about the world properly.

Kanerva, P.

Patterning of somatosympathetic reflexes

In a previous study, we reported that vestibular nerve stimulation in the cat elicits a specific pattern of sympathetic nerve activation, such that responses are particularly large in the renal nerve. This patterning of vestibulosympathetic reflexes was the same in anesthetized and decerebrate preparations. In the present study, we report that inputs from skin and muscle also elicit a specific patterning of sympathetic outflow, which is distinct from that produced by vestibular stimulation. Renal, superior mesenteric, and lumbar colonic nerves respond most strongly to forelimb and hindlimb nerve stimulation (approximately 60% of maximal nerve activation), whereas external carotid and hypogastric nerves were least sensitive to these inputs (approximately 20% of maximal nerve activation). In contrast to vestibulosympathetic reflexes, the expression of responses to skin and muscle afferent activation differs in decerebrate and anesthetized animals. In baroreceptor-intact animals, somatosympathetic responses were strongly attenuated (to <20% of control in every nerve) by increasing blood pressure levels to >150 mmHg. These findings demonstrate that different types of somatic inputs elicit specific patterns of sympathetic nerve activation, presumably generated through distinct neural circuits.

Non-NASA Center

Efferent projections of the ectostriatum in the pigeon (Columba livia)

The ectostriatum is a major visual component of the avian telencephalon. The core region of the ectostriatum (Ec) receives visual input from the optic tectum through thalamic nuclei. In the present study, the efferent projections of the ectostriatum were investigated by using the anterograde tracers Phaseolus vulgaris leucoagglutinin and biotinylated dextran amine. Projection patterns resulting from these tracers were confirmed by the retrograde tracer cholera toxin subunit B. When anterograde tracers were injected in Ec, primary projections were seen traveling dorsolaterally to the belt region of the ectostriatum (Ep) and the neostriatal area immediately surrounding Ep (Ep2). Neurons in Ep sent projections primarily to the overlying Ep2. The efferents of Ep2 traveled dorsolaterally to terminate in three telencephalic regions, from anterior to posterior: (1) neostriatum frontale, pars lateralis (NFL), (2) area temporo-parieto-occipitalis (TPO), and (3) neostriatum intermedium, pars lateralis (NIL). A part of the archistriatum intermedium and the lateral part of the neostriatum caudale also received somewhat minor projections. In addition, some neurons in Ec were also the source of direct, but minor, projections to the NFL, TPO, NIL, and archistriatum intermedium. The topographical relationship among the primary (Ec), secondary (Ep and Ep2), and tertiary (NFL, TPO, NIL) areas indicate that the neural populations for visual processing are organized along the rostral-caudal axis. Thus, the anterior Ec sent efferents to the anterior Ep, which in turn sent projections to anterior Ep2. Neurons in the anterior Ep2 sent projections to NFL and the anterior TPO. Similarly, the intermediate and posterior Ec sent projections to corresponding parts of Ep, whose efferents projected to intermediate and posterior Ep2, respectively. The intermediate Ep2 gave rise to major projections to TPO, whereas posterior Ep2 neurons sent efferents primarily to NIL. The organization of this neural circuit is compared with those of other sensory circuits in the avian telencephalon, as well as the laminar arrangement of the mammalian isocortex.

Non-NASA Center

Parallels in Communication and Navigation Technology and Natural Phenomenon

The premise is more than art imitates life, or technology imitates nature it is a nascent step to see how we might be unwittingly inspired and influenced. An example that might immediately come to mind is a starling murmuration (a phenomenon called scale-free correlation) and Intels recent Coachella music festival drone performance. Superconductivity is a macroscopic manifestation of a quantum phenomenon - choreographed electrons (i.e. an electron murmuration) that enable astonishing devices. There is indeed an intimate connectedness between biology and electromagnetism. Our brains are complex neural circuits generating magnetic fields with a magnitude around 100 femtoTesla (roughly one billion times weaker than a typical magnet used to tack notes to a refrigerator door). Migratory birds navigate by orienteering with respect to the Earth's magnetic field. Electromagnetic field therapy is used in orthopedics to aid in bone repair. The electric eel generates a large electric field for self-defense. Sharks apparently detect extremely weak electric fields for finding prey. And so on. There are similarities between the way a field of wheat responds to a breeze and the natural restoring forces of a semiconductor crystal. And waves in a slowly moving river can lap backwards against a peninsular shoreline mimicking a diffraction effect. Getting back to the introductory sentence and mysterious links over cosmic distances, in August 2016, China launched the Quantum Experiments at Space Scale (QUESS) satellite. The technology is based on a non-linear crystal that produces pairs of entangled photons whose attributes apparently remain entwined regardless of how far apart they are separated. This paper will, no doubt superficially, attempt to enumerate and examine these types of connections and parallelisms.

Romanofsky, Robert

Analog VLSI neural network integrated circuits

Two analog very large scale integration (VLSI) vector matrix multiplier integrated circuit chips were designed, fabricated, and partially tested. They can perform both vector-matrix and matrix-matrix multiplication operations at high speeds. The 32 by 32 vector-matrix multiplier chip and the 128 by 64 vector-matrix multiplier chip were designed to perform 300 million and 3 billion multiplications per second, respectively. An additional circuit that has been developed is a continuous-time adaptive learning circuit. The performance achieved thus far for this circuit is an adaptivity of 28 dB at 300 KHz and 11 dB at 15 MHz. This circuit has demonstrated greater than two orders of magnitude higher frequency of operation than any previous adaptive learning circuit.

Kub, F. J.

Integrated Circuit For Simulation Of Neural Network

Ballast resistors deposited on top of circuit structure. Cascadable, programmable binary connection matrix fabricated in VLSI form as basic building block for assembly of like units into content-addressable electronic memory matrices operating somewhat like networks of neurons. Connections formed during storage of data, and data recalled from memory by prompting matrix with approximate or partly erroneous signals. Redundancy in pattern of connections causes matrix to respond with correct stored data.

Thakoor, Anilkumar P.