SEARCH · Search NASA

Results for “Neural operators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2026

NN-OpInf

SAND2026-18878O The NN-OpInf tool is a PyTorch-based approach to operator inference that uses composable, structure-preserving neural networks to represent nonlinear operators. Operator inference is a machine learning method for inferring low-dimensional systems from data and polynomial models for system dynamics. However, many systems do not conform to polynomial structures, which NN-OpInf addresses by parameterizing operators with neural networks. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗

DOE OSTI2026

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

High-order neural models for error correcting code

The decoding and error-correction of data transmitted over a noisy channel is in principle equivalent to the operation of a neural network performing as a content-addressable memory. For a successful application, however, the neural network has to be capable of storing arbitrary words, and it has to be guaranteed that the stored words represent the only stable attractors of the memory. This paper presents a novel high-order neural network architecture that has these characteristics. The analog nature of the network can be used to perform soft-decision decoding with any block code. The performance in terms of postdecoding bit error rate versus SNR is demonstrated for two exemplary block codes. The comparison with a conventional decoding algorithm for a (15,5) cyclic redundancy code shows, for example, that the bit error rate at 7dB SNR can be decreased by two orders of magnitude.

Jeffries, Clark↗

NASA NTRS1997

Oil Reservoir Properties Estimation Using Neutal Networks

This paper investigates the applicability as well as the accuracy of artificial neural networks for estimating specific parameters that describe reservoir properties based on seismic data. Our approach relies on JPL's adjoint operators general purpose neural network code to determine the best suited architecture. We believe that results presented in this work demonstrate that artificial neural networks produce surprisingly accurate estimates of the reservoir parameters.

oil reservoir neural networks geoscience data oil ↗

DOE OSTI2024

On the Training and Generalization of Deep Operator Networks

Here, we present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two subnetworks, namely the branch and trunk networks. Typically, the two subnetworks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram–Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.

deep operator networks↗

DOE OSTI2026

Transfer learning for analysis of collective and non-collective Thomson scattering spectra

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density (⁠n e ) and electron temperature (⁠T e ⁠). Deep neural networks can provide accurate estimates of ⁠n e and T e when conventional fitting algorithms may fail, such as when TS spectra are dominated by noise, or when fast analysis is required for real-time operation. Although deep neural networks typically require large training sets, transfer learning can improve model performance on a target task with limited data by leveraging pre-trained models from related source tasks, where select hidden layers are further trained using target data. We present five architecturally diverse deep neural networks, pre-trained on synthetic TS data and adapted for experimentally measured TS data, to evaluate the efficacy of transfer learning in estimating n e and T e in both the collective and non-collective scattering regimes. We evaluate errors in n e and T e estimates as a function of training set size for models trained with and without transfer learning, and we observe decreases in model error from transfer learning when the training set contains ≲ 200 experimentally measured spectra.

Artificial neural networks↗

NASA NTRS2014

The Effects of Spaceflight and a Spaceflight Analog on Neurocognitive Perfonnance: Extent, Longevity, and Neural Bases

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission and following 70 days exposure to a spaceflight analog, head down tilt bedrest. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post intervention (spaceflight, bedrest). Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that will be conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. With the bedrest study, we will be able to determine the neural and neurocognitive effects of extended duration unloading, reduced sensory inputs, and increased cephalic fluid distribution. This will enable us to parse out the multiple mechanisms contributing to any spaceflight-induced neural structural and behavioral changes that we observe in the flight study. In this presentation I will discuss preliminary results from six participants who have undergone the bed rest protocol. These individuals show decrements in balance and functional mobility, and alterations in brain structure and function, in association with extended bed rest.

Seidler, R. D.↗

DOE OSTI2025

Particle hit clustering and identification using point set transformers in liquid argon time projection chambers

Liquid argon time projection chambers are often used in neutrino physics and dark-matter searches because of their high spatial resolution. The images generated by these detectors are extremely sparse, as the energy values detected by most of the detector are equal to 0, meaning that despite their high resolution, most of the detector is unused in a particular interaction. Instead of representing all of the empty detections, the interaction is usually stored as a sparse matrix, a list of detection locations paired with their energy values. Traditional machine learning methods that have been applied to particle reconstruction such as convolutional neural networks (CNNs), however, cannot operate over data stored in this way and therefore must have the matrix fully instantiated as a dense matrix. Operating on dense matrices requires a lot of memory and computation time, in contrast to directly operating on the sparse matrix. We propose a machine learning model using a point set neural network that operates over a sparse matrix, greatly improving both processing speed and accuracy over methods that instantiate the dense matrix, as well as over other methods that operate over sparse matrices. Compared to competing state-of-the-art methods, our method improves classification performance by 14%, segmentation performance by more than 22%, while taking 80% less time and using 66% less memory. Compared to state-of-the-art CNN methods, our method improves classification performance by more than 86%, segmentation performance by more than 71%, while reducing runtime by 91% and reducing memory usage by 61%.

calibration and fitting methods↗

NASA NTRS2017

Spaceflight Effects on Neurocognitive Performance: Extent, Longevity and Neural Bases

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post spaceflight. Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that are conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. We have collected data on several crewmembers and preliminary findings will be presented. Eventual comparison to results from our parallel bed rest study will enable us to parse out the multiple mechanisms contributing to any spaceflight-induced neural structural and behavioral changes that we observe.

Seidler, R. D.↗

DOE OSTI2025

Two-level overlapping additive Schwarz preconditioner for training scientific machine learning applications

In this work we introduce a novel two-level overlapping additive Schwarz preconditioner for accelerating the training of scientific machine learning applications. The design of the proposed preconditioner is motivated by the nonlinear two-level overlapping additive Schwarz preconditioner. The neural network parameters are decomposed into groups (subdomains) with overlapping regions. In addition, the network’s feed-forward structure is indirectly imposed through a novel subdomain-wise synchronization strategy and a coarse-level training step. Through a series of numerical experiments, which consider physicsinformed neural networks and operator learning approaches, we demonstrate that the proposed two-level preconditioner significantly speeds up the convergence of the standard (LBFGS) optimizer while also yielding more accurate machine learning models. Moreover, the devised preconditioner is designed to take advantage of model-parallel computations, which can further reduce the training time.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

ELECTRIFICATION OF A HEAVY-DUTY OFF-ROAD MATERIAL HANDLER: ENERGY SAVINGS AND EMISSION REDUCTIONS

Federal regulations are driving the adoption of electrification technologies to reduce carbon dioxide equivalent (CO2e) emissions, a metric that quantifies the global warming potential of various greenhouse gases in terms of carbon dioxide (CO2). Although no specific CO2 regulations exist for heavy-duty off-road machines, future reductions are likely, given stricter emissions standards for on-road vehicles. The heavy-duty off-road sector offers significant fuel-saving potential, as its focus has traditionally been on reliability and performance rather than fuel efficiency. This dissertation examines fuel and CO2e savings opportunities on a heavy-duty off-road material handler, the Pettibone Cary-Lift 204i, from stock configuration to simple modifications to a complete teardown and reconfiguration of the machine with a plug-in series hybrid architecture using electrified hydraulics. The study begins by modeling the baseline machine’s fuel and energy consumption, calibrating with experimental data from custom operating cycles. An energy analysis identifies key areas for fuel savings. Two simple powertrain modifications result in a combined 16.2% fuel savings. Next, a Pugh-style analysis narrows a list of electrified architectures, leading to high-fidelity models that evaluate total lifetime CO2e and costs. Higher electrification levels reduce CO2e emissions but increase costs, and electricity grid emissions significantly impact CO2e for plug-in architectures. A plug-in series hybrid is chosen for the project. In its base control form, 49% fuel and 29% CO2e savings are expected from the plug-in series hybrid compared to the baseline machine. Further savings are pursued through regenerative braking (6.3%) and load-following hydraulic control (17.8%), totaling 24.1% fuel savings, and leading to a total of 61% fuel and 41% CO2e savings compared to the baseline. Battery chemistries and charging strategies are also analyzed for cost and CO2e impacts, finding LFP batteries as superior due to longevity, and overnight level 2 charging usually at a lower cost but resulting in higher emissions than opportunity DC fast-charging (DCFC). DCFC emissions are highly dependent on grid emissions, and DCFC cost is highly dependent on grid demand charges. Finally, artificial intelligence is applied to operating cycle recognition. Neural network accuracy ranges from 81% to 99%, with applications to worksite efficiency and safety improvements.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2001

Neural blockade during exercise augments central command's contribution to carotid baroreflex resetting

This investigation was designed to determine central command's role on carotid baroreflex (CBR) resetting during exercise. Nine volunteer subjects performed static and rhythmic handgrip exercise at 30 and 40% maximal voluntary contraction (MVC), respectively, before and after partial axillary neural blockade. Stimulus-response curves were developed using the neck pressure-neck suction technique and a rapid pulse train protocol (+40 to -80 Torr). Regional anesthesia resulted in a significant reduction in MVC. Heart rate (HR) and ratings of perceived exertion (RPE) were used as indexes of central command and were elevated during exercise at control force intensity after induced muscle weakness. The CBR function curves were reset vertically with a minimal lateral shift during control exercise and exhibited a further parallel resetting during exercise with neural blockade. The operating point was progressively reset to coincide with the centering point of the CBR curve. These data suggest that central command was a primary mechanism in the resetting of the CBR during exercise. However, it appeared that central command modulated the carotid-cardiac reflex proportionately more than the carotid-vasomotor reflex.

NASA Discipline Cardiopulmonary↗

NASA NTRS2014

The Effects of Long Duration Head Down Tilt Bed Rest on Neurocognitive Performance: The Effects of Exercise Interventions

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission and following 70 days exposure to a spaceflight analog, head down tilt bedrest. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post intervention (spaceflight, bedrest). Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that will be conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. Our ongoing bed rest participants are also engaging in exercise studies directed by Dr. Lori Ploutz Snyder. In this presentation, I will briefly highlight the existing literature linking exercise and fitness to brain and behavioral functions. I will also overview the metrics from my study that could be investigated in relation to the exercise and control subgroups.

Seidler, R. D.↗

DOE OSTI2025

Heterogeneous Point Set Transformers for Segmentation of Multiple View Particle Detectors

NOvA is a long-baseline neutrino oscillation experiment that detects neutrino particles from the NuMI beam at Fermilab. Before data from this experiment can be used in analyses, raw hits in the detector must be matched to their source particles, and the type of each particle must be identified. This task has commonly been done using a mix of traditional clustering approaches and convolutional neural networks (CNNs). Due to the construction of the detector, the data is presented as two sparse 2D images: an XZ and a YZ view of the detector, rather than a 3D representation. We propose a point set neural network that operates on the sparse matrices with an operation that mixes information from both views. Our model uses less than 10% of the memory required using previous methods while achieving a 96.8% AUC score, a higher score than obtained when both views are processed independently (85.4%).

Robles, Edgar E. [UC, Irvine (main)]↗

DOE OSTI2025

Synergistic learning with multi-task DeepONet for efficient PDE problem solving

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional machine learning to address issues such as data sparsity and overfitting in neural networks. In this work, we apply MTL to problems in science and engineering governed by partial differential equations (PDEs). However, implementing MTL in this context is complex, as it requires task-specific modifications to accommodate various scenarios representing different physical processes. To this end, we present a multi-task deep operator network (MT-DeepONet) to learn solutions across various functional forms of source terms in a PDE and multiple geometries in a single concurrent training session. We introduce modifications in the branch network of the vanilla DeepONet to account for various functional forms of a parameterized coefficient in a PDE. Additionally, we handle parameterized geometries by introducing a binary mask in the branch network and incorporating it into the loss term to improve convergence and generalization to new geometry tasks. Our approach is demonstrated on three benchmark problems: (1) learning different functional forms of the source term in the Fisher equation; (2) learning multiple geometries in a 2D Darcy Flow problem and showcasing better transfer learning capabilities to new geometries; and (3) learning 3D parameterized geometries for a heat transfer problem and demonstrate the ability to predict on new but similar geometries. Finally, our MT-DeepONet framework offers a novel approach to solving PDE problems in engineering and science under a unified umbrella based on synergistic learning that reduces the overall training cost for neural operators.

42 ENGINEERING↗

DOE OSTI2025

Novel artificial neural network model for instantaneous power losses and operational efficiency mapping of MW-scale vanadium redox flow battery for improved technoeconomic analysis

A novel data-driven, machine-learning-based method for modeling the instantaneous power losses of a distribution-sited 2 MW/8MWh vanadium redox flow battery (VRFB), a grid-scale electrochemical storage technology, is introduced and compared against benchmark empirical modeling approaches, including symmetric and asymmetric models, as well as a recent convex hull modeling approach. The novel loss modeling method introduces several advantages over the benchmark models and over simplistic efficiency estimates, the most significant of which is that the model can accurately reflect the stepwise and non-linear parasitic losses associated with the duty cycles of mechanical auxiliary systems like pump motor drives and blower fans. Residuals of the models are compared; the proposed data driven model features significantly improved accuracy over the benchmark models. The model's coefficient of determination is also improved relative to that of the benchmark models. Furthermore, a novel method for visualization of operational efficiency of the grid-scale storage technology is introduced. To demonstrate the benefits of the novel data-driven method for modeling the VRFB, the benchmark models and the proposed models are embedded into an Open DSS distribution network model to study two applications of the grid-scale electrical storage system: load leveling for grid support and energy arbitrage. This article demonstrates that the accuracy of the instantaneous power loss model significantly impacts the understanding of the state of charge of the VRFB. In turn, the accuracy of the efficiency modeling of the VRFB impacts the understanding of the potential economic value and technical benefits to the distribution network operators. In conclusion, the presented power loss modeling approach is, therefore, highly relevant for utility-stakeholders, battery asset owners, system engineers, system designers, and financial planners interested in evaluating or optimizing the operation of grid-scale VRFBs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1992

Neural joint control for Space Shuttle Remote Manipulator System

Neural networks are being used to control a robot arm in a telerobotic operation. The concept uses neural networks for both joint and inverse kinematics in a robotic control application. An upper level neural network is trained to learn inverse kinematic mappings. The output, a trajectory, is then fed to the Decentralized Adaptive Joint Controllers. This neural network implementation has shown that the controlled arm recovers from unexpected payload changes while following the reference trajectory. The neural network-based decentralized joint controller is faster, more robust and efficient than conventional approaches. Implementations of this architecture are discussed that would relax assumptions about dynamics, obstacles, and heavy loads. This system is being developed to use with the Space Shuttle Remote Manipulator System.

Atkins, Mark A.↗

DOE OSTI2025

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗