Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural operator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Space time neural networks for tether operations in space

A space shuttle flight scheduled for 1992 will attempt to prove the feasibility of operating tethered payloads in earth orbit. due to the interaction between the Earth's magnetic field and current pulsing through the tether, the tethered system may exhibit a circular transverse oscillation referred to as the 'skiprope' phenomenon. Effective damping of skiprope motion depends on rapid and accurate detection of skiprope magnitude and phase. Because of non-linear dynamic coupling, the satellite attitude behavior has characteristic oscillations during the skiprope motion. Since the satellite attitude motion has many other perturbations, the relationship between the skiprope parameters and attitude time history is very involved and non-linear. We propose a Space-Time Neural Network implementation for filtering satellite rate gyro data to rapidly detect and predict skiprope magnitude and phase. Training and testing of the skiprope detection system will be performed using a validated Orbital Operations Simulator and Space-Time Neural Network software developed in the Software Technology Branch at NASA's Lyndon B. Johnson Space Center.

Lea, Robert N.↗
NASA NTRS1993

Adjoint-Operator Learning For A Neural Network

Electronic neural networks made to synthesize initially unknown mathematical models of time-dependent phenomena or to learn temporally evolving patterns by use of algorithms based on adjoint operators. Algorithms less complicated, involve less computation and solve learning equations forward in time possibly simultaneously with equations of evolution of neural network, thereby both increasing computational efficiency and making real-time applications possible.

Barhen, Jacob↗
DOE OSTI2026

A variational framework for residual-based adaptivity in neural PDE solvers and operator learning

Residual-based adaptive strategies are widely used in scientific machine learning yet remain largely heuristic. We introduce a variational framework that formalizes these methods through convex transformations of the residual, where different transformations correspond to distinct objective functionals. For instance, exponential weights target uniform error minimization, while linear weights recover quadratic error minimization. This perspective reveals adaptive weighting as a means of selecting sampling distributions that optimize a primal objective, directly linking discretization choices to error metrics. This principled approach yields three key benefits: it enables systematic design of adaptive schemes, reduces discretization error by lowering estimator variance, and enhances learning dynamics by improving gradient signal-to-noise ratio. Extending the framework to operator learning, we demonstrate substantial performance gains across diverse optimizers and architectures. Our results provide a theoretical perspective for residual-based adaptivity and establish a foundation for principled discretization and training.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Enhancing Lattice Kinetic Schemes for Fluid Dynamics with Lattice-Equivariant Neural Networks

A new class of equivariant neural networks is presented, hereby dubbed lattice-equivariant neural networks (LENNs), designed to satisfy local symmetries of a lattice structure. The approach develops within a recently introduced framework aimed at learning neural network-based surrogate models’ lattice Boltzmann collision operators. Whenever neural networks are employed to model physical systems, respecting symmetries and equivariance properties has been shown to be key for accuracy, numerical stability, and performance. Here, hinging on ideas from group representation theory, trainable layers are defined whose algebraic structure is equivariant with respect to the symmetries of the lattice cell. In this work, the presented method naturally allows for efficient implementations, in terms of both memory usage and computational costs, supporting scalable training/testing for lattices in two spatial dimensions and higher (in which the size of symmetry group grows). The approach is validated and tested considering 2D and 3D flowing dynamics, both in laminar and turbulent regimes. It is compared with group-averaged-based symmetric networks and with plain, nonsymmetric, networks, showing how the presented approach unlocks the (a posteriori) accuracy and training stability of the former models and the train/inference speed of the latter networks. (LENNs are about one order of magnitude faster than group-averaged networks in 3D.) The work in this paper opens toward practical use of machine learning-augmented lattice Boltzmann CFD in real-world simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

ExtremeMETA: High-speed Lightweight Image Segmentation Model by Remodeling Multi-channel Metamaterial Imagers

Deep neural networks (DNNs) have heavily relied on traditional computational units, such as CPUs and GPUs. However, this conventional approach brings significant computational burden, latency issues, and high power consumption, limiting their effectiveness. This has sparked the need for lightweight networks such as ExtremeC3Net. Meanwhile, there have been notable advancements in optical computational units, particularly with metamaterials, offering the exciting prospect of energy-efficient neural networks operating at the speed of light. Yet, the digital design of metamaterial neural networks (MNNs) faces precision, noise, and bandwidth challenges, limiting their application to intuitive tasks and low-resolution images. In this study, we proposed a large kernel lightweight segmentation model, ExtremeMETA. Based on ExtremeC3Net, our proposed model, ExtremeMETA maximized the ability of the first convolution layer by exploring a larger convolution kernel and multiple processing paths. With the large kernel convolution model, we extended the optic neural network application boundary to the segmentation task. To further lighten the computation burden of the digital processing part, a set of model compression methods was applied to improve model efficiency in the inference stage. The experimental results on three publicly available datasets demonstrated that the optimized efficient design improved segmentation performance from 92.45 to 95.97 on mIoU while reducing computational FLOPs from 461.07 MMacs to 166.03 MMacs. The large kernel lightweight model ExtremeMETA showcased the hybrid design’s ability on complex tasks.

large convolution kernel↗
NASA NTRS1992

Neutral buoyancy simulation of space telerobotics operations

A number of neutral buoyancy versions of space telerobots have been tested in the Space Research Laboratory to understand the potential roles for telerobotic systems in space operations. Particular attention is given to details of the well-modeled dynamic environment, the existence of sizable data base on EVA operations in neural buoyancy with correlation to flight experience, and routine access to a number of high-fidelity mockups of past and planned operational spacecraft. The compromises necessary for the design and construction of neutral buoyancy telerobotic systems are discussed, and data from a number of past simulations, including correlation of neutral buoyancy structural assembly with EVA flight data, and preliminary tests of telerobotic servicing of Hubble Space Telescope are summarized.

Akin, David L.↗
NASA NTRS1998

Fuzzy Adaptive Control for Intelligent Autonomous Space Exploration Problems

The principal objective of the research reported here is the re-design, analysis and optimization of our newly developed neural network fuzzy adaptive controller model for complex processes capable of learning fuzzy control rules using process data and improving its control through on-line adaption. The learned improvement is according to a performance objective function that provides evaluative feedback; this performance objective is broadly defined to meet long-range goals over time. Although fuzzy control had proven effective for complex, nonlinear, imprecisely-defined processes for which standard models and controls are either inefficient, impractical or cannot be derived, the state of the art prior to our work showed that procedures for deriving fuzzy control, however, were mostly ad hoc heuristics. The learning ability of neural networks was exploited to systematically derive fuzzy control and permit on-line adaption and in the process optimize control. The operation of neural networks integrates very naturally with fuzzy logic. The neural networks which were designed and tested using simulation software and simulated data, followed by realistic industrial data were reconfigured for application on several platforms as well as for the employment of improved algorithms. The statistical procedures of the learning process were investigated and evaluated with standard statistical procedures (such as ANOVA, graphical analysis of residuals, etc.). The computational advantage of dynamic programming-like methods of optimal control was used to permit on-line fuzzy adaptive control. Tests for the consistency, completeness and interaction of the control rules were applied. Comparisons to other methods and controllers were made so as to identify the major advantages of the resulting controller model. Several specific modifications and extensions were made to the original controller. Additional modifications and explorations have been proposed for further study. Some of these are in progress in our laboratory while others await additional support. All of these enhancements will improve the attractiveness of the controller as an effective tool for the on line control of an array of complex process environments.

Esogbue, Augustine O.↗
NASA NTRS1996

Automation of Some Operations of a Wind Tunnel Using Artificial Neural Networks

Artificial neural networks were used successfully to sequence operations in a small, recently modernized, supersonic wind tunnel at NASA-Lewis Research Center. The neural nets generated correct estimates of shadowgraph patterns, pressure sensor readings and mach numbers for conditions occurring shortly after startup and extending to fully developed flow. Artificial neural networks were trained and tested for estimating: sensor readings from shadowgraph patterns, shadowgraph patterns from shadowgraph patterns and sensor readings from sensor readings. The 3.81 by 10 in. (0.0968 by 0.254 m) tunnel was operated with its mach 2.0 nozzle, and shadowgraph was recorded near the nozzle exit. These results support the thesis that artificial neural networks can be combined with current workstation technology to automate wind tunnel operations.

Decker, Arthur J.↗
NASA NTRS1988

Terminal attractors for addressable memory in neural networks

A new type of attractors - terminal attractors - for an addressable memory in neural networks operating in continuous time is introduced. These attractors represent singular solutions of the dynamical system. They intersect (or envelope) the families of regular solutions while each regular solution approaches the terminal attractor in a finite time period. It is shown that terminal attractors can be incorporated into neural networks such that any desired set of these attractors with prescribed basins is provided by an appropriate selection of the weight matrix.

Zak, Michail↗
NASA NTRS1989

Terminal attractors in neural networks

A new type of attractor (terminal attractors) for content-addressable memory, associative memory, and pattern recognition in artificial neural networks operating in continuous time is introduced. The idea of a terminal attractor is based upon a violation of the Lipschitz condition at a fixed point. As a result, the fixed point becomes a singular solution which envelopes the family of regular solutions, while each regular solution approaches such an attractor in finite time. It will be shown that terminal attractors can be incorporated into neural networks such that any desired set of these attractors with prescribed basins is provided by an appropriate selection of the synaptic weights. The applications of terminal attractors for content-addressable and associative memories, pattern recognition, self-organization, and for dynamical training are illustrated.

Zak, Michail↗
NASA NTRS1994

A Feasibility Study for Perioperative Ventricular Tachycardia Prognosis and Detection and Noise Detection Using a Neural Network and Predictive Linear Operators

To locate the accessory pathway(s) in preexicitation syndromes, epicardial and endocardial ventricular mapping is performed during anterograde ventricular activation via accessory pathway(s) from data originally received in signal form. As the number of channels increases, it is pertinent that more automated detection of coherent/incoherent signals is achieved as well as the prediction and prognosis of ventricular tachywardia (VT). Today's computers and computer program algorithms are not good in simple perceptual tasks such as recognizing a pattern or identifying a sound. This discrepancy, among other things, has been a major motivating factor in developing brain-based, massively parallel computing architectures. Neural net paradigms have proven to be effective at pattern recognition tasks. In signal processing, the picking of coherent/incoherent signals represents a pattern recognition task for computer systems. The picking of signals representing the onset ot VT also represents such a computer task. We attacked this problem by defining four signal attributes for each potential first maximal arrival peak and one signal attribute over the entire signal as input to a back propagation neural network. One attribute was the predicted amplitude value after the maximum amplitude over a data window. Then, by using a set of known (user selected) coherent/incoherent signals, and signals representing the onset of VT, we trained the back propagation network to recognize coherent/incoherent signals, and signals indicating the onset of VT. Since our output scheme involves a true or false decision, and since the output unit computes values between 0 and 1, we used a Fuzzy Arithmetic approach to classify data as coherent/incoherent signals. Furthermore, a Mean-Square Error Analysis was used to determine system stability. The neural net based picking coherent/incoherent signal system achieved high accuracy on picking coherent/incoherent signals on different patients. The system also achieved a high accuracy of picking signals which represent the onset of VT, that is, VT immediately followed these signals. A special binary representation of the input and output data allowed the neural network to train very rapidly as compared to another standard decimal or normalized representations of the data.

Moebes, T. A.↗
NASA NTRS1993

Anomaly detection of turbopump vibration in Space Shuttle Main Engine using statistics and neural networks

The statistical and neural networks methods have been applied to investigate the feasibility in detecting anomalies in turbopump vibration of SSME. The anomalies are detected based on the amplitude of peaks of fundamental and harmonic frequencies in the power spectral density. These data are reduced to the proper format from sensor data measured by strain gauges and accelerometers. Both methods are feasible to detect the vibration anomalies. The statistical method requires sufficient data points to establish a reasonable statistical distribution data bank. This method is applicable for on-line operation. The neural networks method also needs to have enough data basis to train the neural networks. The testing procedure can be utilized at any time so long as the characteristics of components remain unchanged.

Lo, C. F.↗
NASA NTRS1996

Studies of Vestibular Neurons in Normal, Hyper- and Hypogravity

During the past year, pre-, in- and postflight studies were conducted in association with the Axon project for Bion 10 (Cosmos 2229). Recordings were made during pre- and postflight studies, from 118 horizontal semicircular canal afferents and 27 vestibular nucleus neurons in 7 rhesus monkeys; 137 pulse rotation protocols alone were executed (548 acceleration and deceleration responses were curve fit). Usable data was obtained from 127 horizontal afferents concerning their spontaneous discharge. Curve fits and analysis was made of sinusoidal and sum of sinusoidal responses from 42 and 35 horizontal afferents, respectively. Also recordings were made from neurons inflight from the two flight animals. The mean spontaneous rate varied from 128 spikes/sec. during preflight to 92 spikes/sec during postflight (day 5) - a change of 28%. In direct contrast to the results of Cosmos 2044, the best fitted neural adaptation operator (k) and the gain of the pulse response were decreased during post flight when compared to preflight. Surprisingly, the best fitted gain and k values for the sum of sines were slightly elevated during post flight tests. The gain and phase of single sine responses were compared for pre- and post flight tests and compared to a larger population of afferents. In contrast to Cosmos 2044 results where on the first day of post flight testing the gains of the best fitted sine response were skewed toward the higher values of the Miles and Braitman distribution, the gain of the best fitted sine responses during the first day of post flight testing (day 2) during Cosmos 2229 were exactly on the mode of the Miles and Braitman distribution. Thus, at least for the periodic stimuli, (pulses and sine waves) we found no change in gain and neural adaptation during post flight testing following Cosmos 2229. This conclusion is different from the one derived following the Cosmos 2044 flight. Cosmos flight 2229 differed from Cosmos flight 2044 in several significant ways: For example, during preflight, (1) The animals preflight training was different (less well trained on the gaze task) and (2) the animals were exposed to more experimental manipulations (surgical and rotational). Inflight, (1) the animals were required to make a pointing gesture (motor response) in association with eye movements to obtain reward, (2) the inflight diet was different (more balanced), (3) the feeder for one of the animals clogged following 9 days of flight resulting in evident dehydration and probably less head motion exposure in that monkey and (4) there was limited video taping of the monkeys in space. During postflight, (1) we were unable to test the flight animals until 26 hours postflight as compared to 14.5 hours during Cosmos 2044, (2) the animals received significantly more exposure to motion stimuli during postflight testing than during Cosmos 2044. These differences in the vestibular environment will require analysis of several parameters other than just neural and eye movement responses. For example, computer programs will have to be written and used to recover and quantify the number of head movements made by each animal during flight. This activity is critical to the production of neural adaptation and increased gain.

Correia, Manning J.↗
DOE OSTI2024

Separable physics-informed DeepONet: Breaking the curse of dimensionality in physics-informed machine learning

The deep operator network (DeepONet) has shown remarkable potential in solving partial differential equations (PDEs) by mapping between infinite-dimensional function spaces using labeled datasets. However, in scenarios lacking labeled data, the physics-informed DeepONet (PI-DeepONet) approach, which utilizes the residual loss of the governing PDE to optimize the network parameters, faces significant computational challenges, particularly due to the curse of dimensionality. This limitation has hindered its application to high-dimensional problems, making even standard 3D spatial with 1D temporal problems computationally prohibitive. Additionally, the computational requirement increases exponentially with the discretization density of the domain. Here, to address these challenges and enhance scalability for high-dimensional PDEs, we introduce the Separable physics-informed DeepONet (Sep-PI-DeepONet). This framework employs a factorization technique, utilizing sub-networks for individual one-dimensional coordinates, thereby reducing the number of forward passes and the size of the Jacobian matrix required for gradient computations. By incorporating forward-mode automatic differentiation (AD), we further optimize computational efficiency, achieving linear scaling of computational cost with discretization density and dimensionality, making our approach highly suitable for high-dimensional PDEs. We demonstrate the effectiveness of Sep-PI-DeepONet through three benchmark PDE models: the viscous Burgers’ equation, Biot’s consolidation theory, and a parameterized heat equation. Our framework maintains accuracy comparable to the conventional PI-DeepONet while reducing training time by two orders of magnitude. Notably, for the heat equation solved as a 4D problem, the conventional PI-DeepONet was computationally infeasible (estimated 289.35 h), while the Sep-PI-DeepONet completed training in just 2.5 h. These results underscore the potential of Sep-PI-DeepONet in efficiently solving complex, high-dimensional PDEs, marking a significant advancement in physics-informed machine learning.

Neural operator↗
NASA NTRS1997

Baroreflex regulation of blood pressure during dynamic exercise

From the work of Potts et al. Papelier et al. and Shi et al. it is readily apparent that the arterial (aortic and carotid) baroreflexes are reset to function at the prevailing ABP of exercise. The blood pressure of exercise is the result of the hemodynamic (cardiac output and TPR) responses, which appear to be regulated by two redundant neural control systems, "Central Command" and the "exercise pressor reflex". Central Command is a feed-forward neural control system that operates in parallel with the neural regulation of the locomotor system and appears to establish the hemodynamic response to exercise. Within the central nervous system it appears that the HLR may be the operational site for Central Command. Specific neural sites within the HLR have been demonstrated in animals to be active during exercise. With the advent of positron emission tomography (PET) and single-photon emission computed tomography (SPECT), the anatomical areas of the human brain related to Central Command are being mapped. It also appears that the Nucleus Tractus Solitarius and the ventrolateral medulla may serve as an integrating site as they receive neural information from the working muscles via the group III/IV muscle afferents as well as from higher brain centers. This anatomical site within the CNS is now the focus of many investigations in which arterial baroreflex function, Central Command and the "exercise pressor reflex" appear to demonstrate inhibitory or facilitatory interaction. The concept of whether Central Command is the prime mover in the resetting of the arterial baroreceptors to function at the exercising ABP or whether the resetting is an integration of the "exercise pressor reflex" information with that of Central Command is now under intense investigation. However, it would be justified to conclude, from the data of Bevegard and Shepherd, Dicarlo and Bishop, Potts et al., and Papelier et al. that the act of exercise results in the resetting of the arterial baroreflex. In addition, if, as we have proposed, the cardiopulmonary baroreceptors primarily monitors and reflexly regulates cardiac filling volume, it would seem from the data of Mack et al. and Potts et al. that the cardiopulmonary baroreceptor is also reset at the beginning of exercise. Therefore, investigations of the neural mechanisms of regulation involving Central Command and cardiopulmonary afferents, similar to those being undertaken for the arterial baroreflex, need to be established.

NASA Discipline Cardiopulmonary↗