SEARCH · Search NASA

Results for “Neural operators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2025

ExtremeMETA: High-speed Lightweight Image Segmentation Model by Remodeling Multi-channel Metamaterial Imagers

Deep neural networks (DNNs) have heavily relied on traditional computational units, such as CPUs and GPUs. However, this conventional approach brings significant computational burden, latency issues, and high power consumption, limiting their effectiveness. This has sparked the need for lightweight networks such as ExtremeC3Net. Meanwhile, there have been notable advancements in optical computational units, particularly with metamaterials, offering the exciting prospect of energy-efficient neural networks operating at the speed of light. Yet, the digital design of metamaterial neural networks (MNNs) faces precision, noise, and bandwidth challenges, limiting their application to intuitive tasks and low-resolution images. In this study, we proposed a large kernel lightweight segmentation model, ExtremeMETA. Based on ExtremeC3Net, our proposed model, ExtremeMETA maximized the ability of the first convolution layer by exploring a larger convolution kernel and multiple processing paths. With the large kernel convolution model, we extended the optic neural network application boundary to the segmentation task. To further lighten the computation burden of the digital processing part, a set of model compression methods was applied to improve model efficiency in the inference stage. The experimental results on three publicly available datasets demonstrated that the optimized efficient design improved segmentation performance from 92.45 to 95.97 on mIoU while reducing computational FLOPs from 461.07 MMacs to 166.03 MMacs. The large kernel lightweight model ExtremeMETA showcased the hybrid design’s ability on complex tasks.

large convolution kernel↗

NASA NTRS1992

Neutral buoyancy simulation of space telerobotics operations

A number of neutral buoyancy versions of space telerobots have been tested in the Space Research Laboratory to understand the potential roles for telerobotic systems in space operations. Particular attention is given to details of the well-modeled dynamic environment, the existence of sizable data base on EVA operations in neural buoyancy with correlation to flight experience, and routine access to a number of high-fidelity mockups of past and planned operational spacecraft. The compromises necessary for the design and construction of neutral buoyancy telerobotic systems are discussed, and data from a number of past simulations, including correlation of neutral buoyancy structural assembly with EVA flight data, and preliminary tests of telerobotic servicing of Hubble Space Telescope are summarized.

Akin, David L.↗

NASA NTRS1998

Fuzzy Adaptive Control for Intelligent Autonomous Space Exploration Problems

The principal objective of the research reported here is the re-design, analysis and optimization of our newly developed neural network fuzzy adaptive controller model for complex processes capable of learning fuzzy control rules using process data and improving its control through on-line adaption. The learned improvement is according to a performance objective function that provides evaluative feedback; this performance objective is broadly defined to meet long-range goals over time. Although fuzzy control had proven effective for complex, nonlinear, imprecisely-defined processes for which standard models and controls are either inefficient, impractical or cannot be derived, the state of the art prior to our work showed that procedures for deriving fuzzy control, however, were mostly ad hoc heuristics. The learning ability of neural networks was exploited to systematically derive fuzzy control and permit on-line adaption and in the process optimize control. The operation of neural networks integrates very naturally with fuzzy logic. The neural networks which were designed and tested using simulation software and simulated data, followed by realistic industrial data were reconfigured for application on several platforms as well as for the employment of improved algorithms. The statistical procedures of the learning process were investigated and evaluated with standard statistical procedures (such as ANOVA, graphical analysis of residuals, etc.). The computational advantage of dynamic programming-like methods of optimal control was used to permit on-line fuzzy adaptive control. Tests for the consistency, completeness and interaction of the control rules were applied. Comparisons to other methods and controllers were made so as to identify the major advantages of the resulting controller model. Several specific modifications and extensions were made to the original controller. Additional modifications and explorations have been proposed for further study. Some of these are in progress in our laboratory while others await additional support. All of these enhancements will improve the attractiveness of the controller as an effective tool for the on line control of an array of complex process environments.

Esogbue, Augustine O.↗

NASA NTRS1996

Automation of Some Operations of a Wind Tunnel Using Artificial Neural Networks

Artificial neural networks were used successfully to sequence operations in a small, recently modernized, supersonic wind tunnel at NASA-Lewis Research Center. The neural nets generated correct estimates of shadowgraph patterns, pressure sensor readings and mach numbers for conditions occurring shortly after startup and extending to fully developed flow. Artificial neural networks were trained and tested for estimating: sensor readings from shadowgraph patterns, shadowgraph patterns from shadowgraph patterns and sensor readings from sensor readings. The 3.81 by 10 in. (0.0968 by 0.254 m) tunnel was operated with its mach 2.0 nozzle, and shadowgraph was recorded near the nozzle exit. These results support the thesis that artificial neural networks can be combined with current workstation technology to automate wind tunnel operations.

Decker, Arthur J.↗

NASA NTRS1988

Terminal attractors for addressable memory in neural networks

A new type of attractors - terminal attractors - for an addressable memory in neural networks operating in continuous time is introduced. These attractors represent singular solutions of the dynamical system. They intersect (or envelope) the families of regular solutions while each regular solution approaches the terminal attractor in a finite time period. It is shown that terminal attractors can be incorporated into neural networks such that any desired set of these attractors with prescribed basins is provided by an appropriate selection of the weight matrix.

Zak, Michail↗

NASA NTRS1989

Terminal attractors in neural networks

A new type of attractor (terminal attractors) for content-addressable memory, associative memory, and pattern recognition in artificial neural networks operating in continuous time is introduced. The idea of a terminal attractor is based upon a violation of the Lipschitz condition at a fixed point. As a result, the fixed point becomes a singular solution which envelopes the family of regular solutions, while each regular solution approaches such an attractor in finite time. It will be shown that terminal attractors can be incorporated into neural networks such that any desired set of these attractors with prescribed basins is provided by an appropriate selection of the synaptic weights. The applications of terminal attractors for content-addressable and associative memories, pattern recognition, self-organization, and for dynamical training are illustrated.

Zak, Michail↗

NASA NTRS1994

A Feasibility Study for Perioperative Ventricular Tachycardia Prognosis and Detection and Noise Detection Using a Neural Network and Predictive Linear Operators

To locate the accessory pathway(s) in preexicitation syndromes, epicardial and endocardial ventricular mapping is performed during anterograde ventricular activation via accessory pathway(s) from data originally received in signal form. As the number of channels increases, it is pertinent that more automated detection of coherent/incoherent signals is achieved as well as the prediction and prognosis of ventricular tachywardia (VT). Today's computers and computer program algorithms are not good in simple perceptual tasks such as recognizing a pattern or identifying a sound. This discrepancy, among other things, has been a major motivating factor in developing brain-based, massively parallel computing architectures. Neural net paradigms have proven to be effective at pattern recognition tasks. In signal processing, the picking of coherent/incoherent signals represents a pattern recognition task for computer systems. The picking of signals representing the onset ot VT also represents such a computer task. We attacked this problem by defining four signal attributes for each potential first maximal arrival peak and one signal attribute over the entire signal as input to a back propagation neural network. One attribute was the predicted amplitude value after the maximum amplitude over a data window. Then, by using a set of known (user selected) coherent/incoherent signals, and signals representing the onset of VT, we trained the back propagation network to recognize coherent/incoherent signals, and signals indicating the onset of VT. Since our output scheme involves a true or false decision, and since the output unit computes values between 0 and 1, we used a Fuzzy Arithmetic approach to classify data as coherent/incoherent signals. Furthermore, a Mean-Square Error Analysis was used to determine system stability. The neural net based picking coherent/incoherent signal system achieved high accuracy on picking coherent/incoherent signals on different patients. The system also achieved a high accuracy of picking signals which represent the onset of VT, that is, VT immediately followed these signals. A special binary representation of the input and output data allowed the neural network to train very rapidly as compared to another standard decimal or normalized representations of the data.

Moebes, T. A.↗

NASA NTRS1993

Anomaly detection of turbopump vibration in Space Shuttle Main Engine using statistics and neural networks

The statistical and neural networks methods have been applied to investigate the feasibility in detecting anomalies in turbopump vibration of SSME. The anomalies are detected based on the amplitude of peaks of fundamental and harmonic frequencies in the power spectral density. These data are reduced to the proper format from sensor data measured by strain gauges and accelerometers. Both methods are feasible to detect the vibration anomalies. The statistical method requires sufficient data points to establish a reasonable statistical distribution data bank. This method is applicable for on-line operation. The neural networks method also needs to have enough data basis to train the neural networks. The testing procedure can be utilized at any time so long as the characteristics of components remain unchanged.

Lo, C. F.↗

NASA NTRS1996

Studies of Vestibular Neurons in Normal, Hyper- and Hypogravity

During the past year, pre-, in- and postflight studies were conducted in association with the Axon project for Bion 10 (Cosmos 2229). Recordings were made during pre- and postflight studies, from 118 horizontal semicircular canal afferents and 27 vestibular nucleus neurons in 7 rhesus monkeys; 137 pulse rotation protocols alone were executed (548 acceleration and deceleration responses were curve fit). Usable data was obtained from 127 horizontal afferents concerning their spontaneous discharge. Curve fits and analysis was made of sinusoidal and sum of sinusoidal responses from 42 and 35 horizontal afferents, respectively. Also recordings were made from neurons inflight from the two flight animals. The mean spontaneous rate varied from 128 spikes/sec. during preflight to 92 spikes/sec during postflight (day 5) - a change of 28%. In direct contrast to the results of Cosmos 2044, the best fitted neural adaptation operator (k) and the gain of the pulse response were decreased during post flight when compared to preflight. Surprisingly, the best fitted gain and k values for the sum of sines were slightly elevated during post flight tests. The gain and phase of single sine responses were compared for pre- and post flight tests and compared to a larger population of afferents. In contrast to Cosmos 2044 results where on the first day of post flight testing the gains of the best fitted sine response were skewed toward the higher values of the Miles and Braitman distribution, the gain of the best fitted sine responses during the first day of post flight testing (day 2) during Cosmos 2229 were exactly on the mode of the Miles and Braitman distribution. Thus, at least for the periodic stimuli, (pulses and sine waves) we found no change in gain and neural adaptation during post flight testing following Cosmos 2229. This conclusion is different from the one derived following the Cosmos 2044 flight. Cosmos flight 2229 differed from Cosmos flight 2044 in several significant ways: For example, during preflight, (1) The animals preflight training was different (less well trained on the gaze task) and (2) the animals were exposed to more experimental manipulations (surgical and rotational). Inflight, (1) the animals were required to make a pointing gesture (motor response) in association with eye movements to obtain reward, (2) the inflight diet was different (more balanced), (3) the feeder for one of the animals clogged following 9 days of flight resulting in evident dehydration and probably less head motion exposure in that monkey and (4) there was limited video taping of the monkeys in space. During postflight, (1) we were unable to test the flight animals until 26 hours postflight as compared to 14.5 hours during Cosmos 2044, (2) the animals received significantly more exposure to motion stimuli during postflight testing than during Cosmos 2044. These differences in the vestibular environment will require analysis of several parameters other than just neural and eye movement responses. For example, computer programs will have to be written and used to recover and quantify the number of head movements made by each animal during flight. This activity is critical to the production of neural adaptation and increased gain.

Correia, Manning J.↗

DOE OSTI2024

Separable physics-informed DeepONet: Breaking the curse of dimensionality in physics-informed machine learning

The deep operator network (DeepONet) has shown remarkable potential in solving partial differential equations (PDEs) by mapping between infinite-dimensional function spaces using labeled datasets. However, in scenarios lacking labeled data, the physics-informed DeepONet (PI-DeepONet) approach, which utilizes the residual loss of the governing PDE to optimize the network parameters, faces significant computational challenges, particularly due to the curse of dimensionality. This limitation has hindered its application to high-dimensional problems, making even standard 3D spatial with 1D temporal problems computationally prohibitive. Additionally, the computational requirement increases exponentially with the discretization density of the domain. Here, to address these challenges and enhance scalability for high-dimensional PDEs, we introduce the Separable physics-informed DeepONet (Sep-PI-DeepONet). This framework employs a factorization technique, utilizing sub-networks for individual one-dimensional coordinates, thereby reducing the number of forward passes and the size of the Jacobian matrix required for gradient computations. By incorporating forward-mode automatic differentiation (AD), we further optimize computational efficiency, achieving linear scaling of computational cost with discretization density and dimensionality, making our approach highly suitable for high-dimensional PDEs. We demonstrate the effectiveness of Sep-PI-DeepONet through three benchmark PDE models: the viscous Burgers’ equation, Biot’s consolidation theory, and a parameterized heat equation. Our framework maintains accuracy comparable to the conventional PI-DeepONet while reducing training time by two orders of magnitude. Notably, for the heat equation solved as a 4D problem, the conventional PI-DeepONet was computationally infeasible (estimated 289.35 h), while the Sep-PI-DeepONet completed training in just 2.5 h. These results underscore the potential of Sep-PI-DeepONet in efficiently solving complex, high-dimensional PDEs, marking a significant advancement in physics-informed machine learning.

Neural operator↗

NASA NTRS1997

Baroreflex regulation of blood pressure during dynamic exercise

From the work of Potts et al. Papelier et al. and Shi et al. it is readily apparent that the arterial (aortic and carotid) baroreflexes are reset to function at the prevailing ABP of exercise. The blood pressure of exercise is the result of the hemodynamic (cardiac output and TPR) responses, which appear to be regulated by two redundant neural control systems, "Central Command" and the "exercise pressor reflex". Central Command is a feed-forward neural control system that operates in parallel with the neural regulation of the locomotor system and appears to establish the hemodynamic response to exercise. Within the central nervous system it appears that the HLR may be the operational site for Central Command. Specific neural sites within the HLR have been demonstrated in animals to be active during exercise. With the advent of positron emission tomography (PET) and single-photon emission computed tomography (SPECT), the anatomical areas of the human brain related to Central Command are being mapped. It also appears that the Nucleus Tractus Solitarius and the ventrolateral medulla may serve as an integrating site as they receive neural information from the working muscles via the group III/IV muscle afferents as well as from higher brain centers. This anatomical site within the CNS is now the focus of many investigations in which arterial baroreflex function, Central Command and the "exercise pressor reflex" appear to demonstrate inhibitory or facilitatory interaction. The concept of whether Central Command is the prime mover in the resetting of the arterial baroreceptors to function at the exercising ABP or whether the resetting is an integration of the "exercise pressor reflex" information with that of Central Command is now under intense investigation. However, it would be justified to conclude, from the data of Bevegard and Shepherd, Dicarlo and Bishop, Potts et al., and Papelier et al. that the act of exercise results in the resetting of the arterial baroreflex. In addition, if, as we have proposed, the cardiopulmonary baroreceptors primarily monitors and reflexly regulates cardiac filling volume, it would seem from the data of Mack et al. and Potts et al. that the cardiopulmonary baroreceptor is also reset at the beginning of exercise. Therefore, investigations of the neural mechanisms of regulation involving Central Command and cardiopulmonary afferents, similar to those being undertaken for the arterial baroreflex, need to be established.

NASA Discipline Cardiopulmonary↗

DOE OSTI2025

Graph neural networks for power grid operational risk assessment under evolving unit commitment

Not Available

Zhang, Yadong (ORCID:0000000171131567)↗

DOE OSTI2025

UQpy Version 4.2: Uncertainty quantification with Python

We introduce a new module for the UQpy software package which extends its capabilities into the field of Scientific Machine Learning. This module builds on PyTorch to create a flexible and robust platform for uncertainty quantification in machine learning. The scientific machine learning module of UQpy introduces custom layers, neural networks, and neural network trainers that are compatible with torch version 2.2.2 and allow for “plug and play” integration into existing torch code.

Neural networks↗

NASA NTRS1990

Programmable Analog Memory Resistors For Electronic Neural Networks

Electrical resistance of new solid-state device altered repeatedly by suitable control signals, yet remains at steady value when control signal removed. Resistance set at low value ("on" state), high value ("off" state), or at any convenient intermediate value and left there until new value desired. Circuits of this type particularly useful in nonvolatile, associative electronic memories based on models of neural networks. Such programmable analog memory resistors ideally suited as synaptic interconnects in "self-learning" neural nets. Operation of device depends on electrochromic property of WO3, which when pure is insulator. Potential uses include nonvolatile, erasable, electronically programmable read-only memories.

Ramesham, Rajeshuni↗

NASA NTRS1992

More About Architecture For Intelligent Robotic Control

Boolean neural networks proposed to implement part of intermediate level of hierarchical architecture of control system for artificially intelligent control of robot hand. Concept described in "Architecture for Intelligent Control of Robotic Tasks" (NPO-17871). Rule level of architecture implemented in two Boolean neural networks operated and updated in alternation. No explicit programming of network. Internal configuration not unique but, depends on initial state and history of previous adaptations. Accepts new rules sequentially presented by external controller.

Fiorini, Paolo↗

NASA NTRS2009

Swarm autonomic agents with self-destruct capability

Systems, methods and apparatus are provided through which in some embodiments an autonomic entity manages a system by generating one or more stay alive signals based on the functioning status and operating state of the system. In some embodiments, an evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy. The evolvable neural interface receives and generates heartbeat monitor signals and pulse monitor signals that are used to generate a stay alive signal that is used to manage the operations of the synthetic neural system. In another embodiment an asynchronous Alice signal (Autonomic license) requiring valid credentials of an anonymous autonomous agent is initiated. An unsatisfactory Alice exchange may lead to self-destruction of the anonymous autonomous agent for self-protection.

Hinchey, Michael G.↗

NASA NTRS2011

Swarm autonomic agents with self-destruct capability

Hinchey, Michael G.↗

DOE OSTI2025

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗