SEARCH · Search NASA

Results for “Neural operator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2025

UQpy Version 4.2: Uncertainty quantification with Python

We introduce a new module for the UQpy software package which extends its capabilities into the field of Scientific Machine Learning. This module builds on PyTorch to create a flexible and robust platform for uncertainty quantification in machine learning. The scientific machine learning module of UQpy introduces custom layers, neural networks, and neural network trainers that are compatible with torch version 2.2.2 and allow for “plug and play” integration into existing torch code.

Neural networks↗

NASA NTRS1990

Programmable Analog Memory Resistors For Electronic Neural Networks

Electrical resistance of new solid-state device altered repeatedly by suitable control signals, yet remains at steady value when control signal removed. Resistance set at low value ("on" state), high value ("off" state), or at any convenient intermediate value and left there until new value desired. Circuits of this type particularly useful in nonvolatile, associative electronic memories based on models of neural networks. Such programmable analog memory resistors ideally suited as synaptic interconnects in "self-learning" neural nets. Operation of device depends on electrochromic property of WO3, which when pure is insulator. Potential uses include nonvolatile, erasable, electronically programmable read-only memories.

Ramesham, Rajeshuni↗

NASA NTRS1992

More About Architecture For Intelligent Robotic Control

Boolean neural networks proposed to implement part of intermediate level of hierarchical architecture of control system for artificially intelligent control of robot hand. Concept described in "Architecture for Intelligent Control of Robotic Tasks" (NPO-17871). Rule level of architecture implemented in two Boolean neural networks operated and updated in alternation. No explicit programming of network. Internal configuration not unique but, depends on initial state and history of previous adaptations. Accepts new rules sequentially presented by external controller.

Fiorini, Paolo↗

NASA NTRS2009

Swarm autonomic agents with self-destruct capability

Systems, methods and apparatus are provided through which in some embodiments an autonomic entity manages a system by generating one or more stay alive signals based on the functioning status and operating state of the system. In some embodiments, an evolvable synthetic neural system is operably coupled to one or more evolvable synthetic neural systems in a hierarchy. The evolvable neural interface receives and generates heartbeat monitor signals and pulse monitor signals that are used to generate a stay alive signal that is used to manage the operations of the synthetic neural system. In another embodiment an asynchronous Alice signal (Autonomic license) requiring valid credentials of an anonymous autonomous agent is initiated. An unsatisfactory Alice exchange may lead to self-destruction of the anonymous autonomous agent for self-protection.

Hinchey, Michael G.↗

NASA NTRS2011

Swarm autonomic agents with self-destruct capability

Hinchey, Michael G.↗

DOE OSTI2025

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗

DOE OSTI2026

NN-OpInf

SAND2026-18878O The NN-OpInf tool is a PyTorch-based approach to operator inference that uses composable, structure-preserving neural networks to represent nonlinear operators. Operator inference is a machine learning method for inferring low-dimensional systems from data and polynomial models for system dynamics. However, many systems do not conform to polynomial structures, which NN-OpInf addresses by parameterizing operators with neural networks. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

SciDAC↗

DOE OSTI2026

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1990

High-order neural models for error correcting code

The decoding and error-correction of data transmitted over a noisy channel is in principle equivalent to the operation of a neural network performing as a content-addressable memory. For a successful application, however, the neural network has to be capable of storing arbitrary words, and it has to be guaranteed that the stored words represent the only stable attractors of the memory. This paper presents a novel high-order neural network architecture that has these characteristics. The analog nature of the network can be used to perform soft-decision decoding with any block code. The performance in terms of postdecoding bit error rate versus SNR is demonstrated for two exemplary block codes. The comparison with a conventional decoding algorithm for a (15,5) cyclic redundancy code shows, for example, that the bit error rate at 7dB SNR can be decreased by two orders of magnitude.

Jeffries, Clark↗

NASA NTRS1997

Oil Reservoir Properties Estimation Using Neutal Networks

This paper investigates the applicability as well as the accuracy of artificial neural networks for estimating specific parameters that describe reservoir properties based on seismic data. Our approach relies on JPL's adjoint operators general purpose neural network code to determine the best suited architecture. We believe that results presented in this work demonstrate that artificial neural networks produce surprisingly accurate estimates of the reservoir parameters.

oil reservoir neural networks geoscience data oil ↗

DOE OSTI2024

On the Training and Generalization of Deep Operator Networks

Here, we present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two subnetworks, namely the branch and trunk networks. Typically, the two subnetworks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram–Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.

deep operator networks↗

DOE OSTI2026

Transfer learning for analysis of collective and non-collective Thomson scattering spectra

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density (⁠n e ) and electron temperature (⁠T e ⁠). Deep neural networks can provide accurate estimates of ⁠n e and T e when conventional fitting algorithms may fail, such as when TS spectra are dominated by noise, or when fast analysis is required for real-time operation. Although deep neural networks typically require large training sets, transfer learning can improve model performance on a target task with limited data by leveraging pre-trained models from related source tasks, where select hidden layers are further trained using target data. We present five architecturally diverse deep neural networks, pre-trained on synthetic TS data and adapted for experimentally measured TS data, to evaluate the efficacy of transfer learning in estimating n e and T e in both the collective and non-collective scattering regimes. We evaluate errors in n e and T e estimates as a function of training set size for models trained with and without transfer learning, and we observe decreases in model error from transfer learning when the training set contains ≲ 200 experimentally measured spectra.

Artificial neural networks↗

NASA NTRS2014

The Effects of Spaceflight and a Spaceflight Analog on Neurocognitive Perfonnance: Extent, Longevity, and Neural Bases

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission and following 70 days exposure to a spaceflight analog, head down tilt bedrest. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post intervention (spaceflight, bedrest). Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that will be conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. With the bedrest study, we will be able to determine the neural and neurocognitive effects of extended duration unloading, reduced sensory inputs, and increased cephalic fluid distribution. This will enable us to parse out the multiple mechanisms contributing to any spaceflight-induced neural structural and behavioral changes that we observe in the flight study. In this presentation I will discuss preliminary results from six participants who have undergone the bed rest protocol. These individuals show decrements in balance and functional mobility, and alterations in brain structure and function, in association with extended bed rest.

Seidler, R. D.↗

DOE OSTI2025

Particle hit clustering and identification using point set transformers in liquid argon time projection chambers

Liquid argon time projection chambers are often used in neutrino physics and dark-matter searches because of their high spatial resolution. The images generated by these detectors are extremely sparse, as the energy values detected by most of the detector are equal to 0, meaning that despite their high resolution, most of the detector is unused in a particular interaction. Instead of representing all of the empty detections, the interaction is usually stored as a sparse matrix, a list of detection locations paired with their energy values. Traditional machine learning methods that have been applied to particle reconstruction such as convolutional neural networks (CNNs), however, cannot operate over data stored in this way and therefore must have the matrix fully instantiated as a dense matrix. Operating on dense matrices requires a lot of memory and computation time, in contrast to directly operating on the sparse matrix. We propose a machine learning model using a point set neural network that operates over a sparse matrix, greatly improving both processing speed and accuracy over methods that instantiate the dense matrix, as well as over other methods that operate over sparse matrices. Compared to competing state-of-the-art methods, our method improves classification performance by 14%, segmentation performance by more than 22%, while taking 80% less time and using 66% less memory. Compared to state-of-the-art CNN methods, our method improves classification performance by more than 86%, segmentation performance by more than 71%, while reducing runtime by 91% and reducing memory usage by 61%.

calibration and fitting methods↗

NASA NTRS2017

Spaceflight Effects on Neurocognitive Performance: Extent, Longevity and Neural Bases

We are conducting ongoing experiments in which we are performing structural and functional magnetic resonance brain imaging to identify the relationships between changes in neurocognitive function and neural structural alterations following a six month International Space Station mission. Our central hypothesis is that measures of brain structure, function, and network integrity will change from pre to post spaceflight. Moreover, we predict that these changes will correlate with indices of cognitive, sensory, and motor function in a neuroanatomically selective fashion. Our interdisciplinary approach utilizes cutting edge neuroimaging techniques and a broad ranging battery of sensory, motor, and cognitive assessments that are conducted pre flight, during flight, and post flight to investigate potential neuroplastic and maladaptive brain changes in crewmembers following long-duration spaceflight. Success in this endeavor would 1) result in identification of the underlying neural mechanisms and operational risks of spaceflight-induced changes in behavior, and 2) identify whether a return to normative behavioral function following re-adaptation to Earth's gravitational environment is associated with a restitution of brain structure and function or instead is supported by substitution with compensatory brain processes. We have collected data on several crewmembers and preliminary findings will be presented. Eventual comparison to results from our parallel bed rest study will enable us to parse out the multiple mechanisms contributing to any spaceflight-induced neural structural and behavioral changes that we observe.

Seidler, R. D.↗

DOE OSTI2025

Two-level overlapping additive Schwarz preconditioner for training scientific machine learning applications

In this work we introduce a novel two-level overlapping additive Schwarz preconditioner for accelerating the training of scientific machine learning applications. The design of the proposed preconditioner is motivated by the nonlinear two-level overlapping additive Schwarz preconditioner. The neural network parameters are decomposed into groups (subdomains) with overlapping regions. In addition, the network’s feed-forward structure is indirectly imposed through a novel subdomain-wise synchronization strategy and a coarse-level training step. Through a series of numerical experiments, which consider physicsinformed neural networks and operator learning approaches, we demonstrate that the proposed two-level preconditioner significantly speeds up the convergence of the standard (LBFGS) optimizer while also yielding more accurate machine learning models. Moreover, the devised preconditioner is designed to take advantage of model-parallel computations, which can further reduce the training time.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

ELECTRIFICATION OF A HEAVY-DUTY OFF-ROAD MATERIAL HANDLER: ENERGY SAVINGS AND EMISSION REDUCTIONS

Federal regulations are driving the adoption of electrification technologies to reduce carbon dioxide equivalent (CO2e) emissions, a metric that quantifies the global warming potential of various greenhouse gases in terms of carbon dioxide (CO2). Although no specific CO2 regulations exist for heavy-duty off-road machines, future reductions are likely, given stricter emissions standards for on-road vehicles. The heavy-duty off-road sector offers significant fuel-saving potential, as its focus has traditionally been on reliability and performance rather than fuel efficiency. This dissertation examines fuel and CO2e savings opportunities on a heavy-duty off-road material handler, the Pettibone Cary-Lift 204i, from stock configuration to simple modifications to a complete teardown and reconfiguration of the machine with a plug-in series hybrid architecture using electrified hydraulics. The study begins by modeling the baseline machine’s fuel and energy consumption, calibrating with experimental data from custom operating cycles. An energy analysis identifies key areas for fuel savings. Two simple powertrain modifications result in a combined 16.2% fuel savings. Next, a Pugh-style analysis narrows a list of electrified architectures, leading to high-fidelity models that evaluate total lifetime CO2e and costs. Higher electrification levels reduce CO2e emissions but increase costs, and electricity grid emissions significantly impact CO2e for plug-in architectures. A plug-in series hybrid is chosen for the project. In its base control form, 49% fuel and 29% CO2e savings are expected from the plug-in series hybrid compared to the baseline machine. Further savings are pursued through regenerative braking (6.3%) and load-following hydraulic control (17.8%), totaling 24.1% fuel savings, and leading to a total of 61% fuel and 41% CO2e savings compared to the baseline. Battery chemistries and charging strategies are also analyzed for cost and CO2e impacts, finding LFP batteries as superior due to longevity, and overnight level 2 charging usually at a lower cost but resulting in higher emissions than opportunity DC fast-charging (DCFC). DCFC emissions are highly dependent on grid emissions, and DCFC cost is highly dependent on grid demand charges. Finally, artificial intelligence is applied to operating cycle recognition. Neural network accuracy ranges from 81% to 99%, with applications to worksite efficiency and safety improvements.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2001

Neural blockade during exercise augments central command's contribution to carotid baroreflex resetting

This investigation was designed to determine central command's role on carotid baroreflex (CBR) resetting during exercise. Nine volunteer subjects performed static and rhythmic handgrip exercise at 30 and 40% maximal voluntary contraction (MVC), respectively, before and after partial axillary neural blockade. Stimulus-response curves were developed using the neck pressure-neck suction technique and a rapid pulse train protocol (+40 to -80 Torr). Regional anesthesia resulted in a significant reduction in MVC. Heart rate (HR) and ratings of perceived exertion (RPE) were used as indexes of central command and were elevated during exercise at control force intensity after induced muscle weakness. The CBR function curves were reset vertically with a minimal lateral shift during control exercise and exhibited a further parallel resetting during exercise with neural blockade. The operating point was progressively reset to coincide with the centering point of the CBR curve. These data suggest that central command was a primary mechanism in the resetting of the CBR during exercise. However, it appeared that central command modulated the carotid-cardiac reflex proportionately more than the carotid-vasomotor reflex.

NASA Discipline Cardiopulmonary↗