Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural network simulations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Adaptive Optimization of Aircraft Engine Performance Using Neural Networks

Preliminary results are presented on the development of an adaptive neural network based control algorithm to enhance aircraft engine performance. This work builds upon a previous National Aeronautics and Space Administration (NASA) effort known as Performance Seeking Control (PSC). PSC is an adaptive control algorithm which contains a model of the aircraft's propulsion system which is updated on-line to match the operation of the aircraft's actual propulsion system. Information from the on-line model is used to adapt the control system during flight to allow optimal operation of the aircraft's propulsion system (inlet, engine, and nozzle) to improve aircraft engine performance without compromising reliability or operability. Performance Seeking Control has been shown to yield reductions in fuel flow, increases in thrust, and reductions in engine fan turbine inlet temperature. The neural network based adaptive control, like PSC, will contain a model of the propulsion system which will be used to calculate optimal control commands on-line. Hopes are that it will be able to provide some additional benefits above and beyond those of PSC. The PSC algorithm is computationally intensive, it is valid only at near steady-state flight conditions, and it has no way to adapt or learn on-line. These issues are being addressed in the development of the optimal neural controller. Specialized neural network processing hardware is being developed to run the software, the algorithm will be valid at steady-state and transient conditions, and will take advantage of the on-line learning capability of neural networks. Future plans include testing the neural network software and hardware prototype against an aircraft engine simulation. In this paper, the proposed neural network software and hardware is described and preliminary neural network training results are presented.

Simon, Donald L.↗

Simulation-trained machine learning models for Lorentz transmission electron microscopy

Understanding the collective behavior of complex spin textures, such as lattices of magnetic skyrmions, is of fundamental importance for exploring and controlling the emergent ordering of these spin textures and inducing phase transitions. It is also critical to understand the skyrmion–skyrmion interactions for applications such as magnetic skyrmion-enabled reservoir or neuromorphic computing. Magnetic skyrmion lattices can be studied using in situ Lorentz transmission electron microscopy (LTEM), but quantitative and statistically robust analysis of the skyrmion lattices from LTEM images can be difficult. In this work, we show that a convolutional neural network, trained on simulated data, can be applied to perform segmentation of spin textures and to extract quantitative data, such as spin texture size and location, from experimental LTEM images, which cannot be obtained manually. This includes quantitative information about skyrmion size, position, and shape, which can, in turn, be used to calculate skyrmion–skyrmion interactions and lattice ordering. We apply this approach to segmenting images of Néel skyrmion lattices so that we can accurately identify skyrmion size and deformation in both dense and sparse lattices. The model is trained using a large set of micromagnetic simulations as well as simulated LTEM images. This entirely open-source training pipeline can be applied to a wide variety of magnetic features and materials, enabling large-scale statistical studies of spin textures using LTEM.

McCray, Arthur R. C. (ORCID:0000000160774698)↗

Prediction of carbon nanostructure mechanical properties and the role of defects using machine learning

Graphene-based nanostructures hold immense potential as strong and lightweight materials, however, their mechanical properties such as modulus and strength are difficult to fully exploit due to challenges in atomic-scale engineering. This study presents a database of over 2,000 pristine and defective nanoscale CNT bundles and other graphitic assemblies, inspired by microscopy, with associated stress–strain curves from reactive molecular dynamics (MD) simulations using the reactive INTERFACE force field (IFF-R). These 3D structures, containing up to 80,000 atoms, enable detailed analyses of structure-stiffness-failure relationships. By leveraging the database and physics- and chemistry-informed machine learning (ML), accurate predictions of elastic moduli and tensile strength are demonstrated at speeds 1,000 to 10,000 times faster than efficient MD simulations. Hierarchical Graph Neural Networks with Spatial Information (HS-GNNs) are introduced, which integrate chemistry knowledge. HS-GNNs as well as extreme gradient boosted trees (XGBoost) achieve forecasts of mechanical properties of arbitrary carbon nanostructures with only 3 to 6% mean relative error. The reliability equals experimental accuracy and is up to 20 times higher than other ML methods. Predictions maintain 8 to 18% accuracy for large CNT bundles, CNT junctions, and carbon fiber cross-sections outside the training distribution. The physics- and chemistry-informed HS-GNN works remarkably well for data outside the training range while XGBoost works well with limited training data inside the training range. The carbon nanostructure database is designed for integration with multimodal experimental and simulation data, scalable beyond 100 nm size, and extendable to chemically similar compounds and broader property ranges. The ML approaches have potential for applications in structural materials, nanoelectronics, and carbon-based catalysts.

Winetrout, Jordan J.↗

Effect of Ambient Organic Acids on the Water Structure at ${\rm TiO}_{2}$ Interfaces

A molecular-level understanding of the effects of ambient organic compounds on the wettability of titanium dioxide ( ${\rm TiO}_{2}$ ) surfaces is relevant to many of its energy-related and environmental applications. Herein, we focus on two common atmospheric carboxylic acids, formic and acetic acid, and characterize their adsorption/ desorption at the aqueous interfaces of anatase and rutile ${\rm TiO}_{2}$ using molecular dynamics with an ab initio deep neural network potential. Our simulations show that these acids prefer to be localized in the interfacial water layers close to the ${\rm TiO}_{2}$ surface where they are stabilized by the interaction/exchange of their acid proton with a surface oxygen, rather than chemisorb at the surface Ti sites by displacing the adsorbed water. Notably, these acids make the surface of anatase hydrophobic, whereas the larger fraction of adsorbed water dissociation can offset their effect on rutile. Furthermore, these results provide a picture where carboxylic acids control the wettability of ${\rm TiO}_{2}$ largely through acid-base chemistry at the interface rather than chemisorption on the oxide surface, a finding that can help improve the design of self-cleaning surfaces and photocatalytic devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Self-Diffusivity Measurement of Eutectic F 7 LiNaK with and without Additives Using Quasi-Elastic Neutron Scattering

The atomic scale relaxation dynamics of eutectic F 7 LiNaK (46.5 LiF–11.5 NaF–42 KF mol %, Li-7 enriched) were measured using quasi-elastic neutron scattering (QENS) over a temperature range of 500–750 °C. Here, the effect of adding 0.988 mol % cerium, 0.499 mol % cesium, and 1.21 mol % zirconium individually to the dynamics of F 7 LiNaK was also investigated. The relaxation process in both pure and doped F 7 LiNaK molten salts was fit with a stretched exponential function and the temperature dependence follows an Arrhenius behavior over a wavevector transfer range of 0.4 Å –1 < Q < 0.9 Å –1 . The measured activation energy for self-diffusion is E a = 0.77 ± 0.02 eV/atom for pure molten F 7 LiNaK. The QENS response with additives added to F 7 LiNaK was also fit with a stretched exponential and the associated Arrhenius behavior was characterized with activation energies of E a = 0.88 ± 0.01 eV/atom for zirconium (1.21 mol %), E a = 1.02 ± 0.02 eV/atom for cerium (0.988 mol %), and E a = 0.71 ± 0.03 eV/atom for cesium (0.499 mol %). The measured diffusivities are compared to those simulated with a neural network force field model by Lee et al. [Lee, S.-C. Comparative Studies of the Structural and Transport Properties of Molten Salt FLiNaK Using the Machine-Learned Neural Network and Reparametrized Classical Forcefields. J. Phys. Chem. B 2021, 125(37), 10562–10570].

FLiNaK↗

Data-driven modeling of dislocation mobility from atomistics using physics-informed machine learning

Dislocation mobility, which dictates the response of dislocations to an applied stress, is a fundamental property of crystalline materials that governs the evolution of plastic deformation. Traditional approaches for deriving mobility laws rely on phenomenological models of the underlying physics, whose free parameters are in turn fitted to a small number of intuition-driven atomic scale simulations under varying conditions of temperature and stress. This tedious and time-consuming approach becomes particularly cumbersome for materials with complex dependencies on stress, temperature, and local environment, such as body-centered cubic crystals (BCC) metals and alloys. In this paper, we present a novel, uncertainty quantification-driven active learning paradigm for learning dislocation mobility laws from automated high-throughput large-scale molecular dynamics simulations, using Graph Neural Networks (GNN) with a physics-informed architecture. We demonstrate that this Physics-informed Graph Neural Network (PI-GNN) framework captures the underlying physics more accurately compared to existing phenomenological mobility laws in BCC metals.

36 MATERIALS SCIENCE↗

Normalizing flows for domain adaptation when identifying Λ hyperon events

Here this study focuses on the application of a normalizing flow as a method of domain adaptation when classifying physics data. Normalizing flows offer a way to transform data points between two different distributions. The present study investigates a novel method of transforming latent representations of physics data to a normal distribution and then to a physics distribution again. The final distribution models a simulated distribution. After being transformed, the data can be classified by a neural network trained on labeled simulation data. The present study succeeds in training two normalizing flows that can transform between data (or simulation) and a Gaussian distribution.

47 OTHER INSTRUMENTATION↗

Attribution of the record-high 2023 SST using a deep-learning framework

Abstract The global-mean sea surface temperature (SST) reached a record high in 2023, exceeding the 2016 record by 0.14 °C. This unprecedented change in global-mean SST has major implications for our understanding of internal variability and the forced response in our changing climate. In this work, we use neural networks trained on simulated climate data to separate the contributions of internal variability and the forced response within observations. Performing attribution reveals that internal variability was responsible for +0.07 °C of the 2023 global mean SST, due to anomalously warm conditions in the Pacific, Atlantic, and Indian Ocean basins. Furthermore, these results provide a line of evidence for accelerated forced warming in recent years. Continued monitoring of the climate will be critical for understanding the drivers behind this unprecedented SST record.

Rader, Jamin K. (ORCID:0000000222045977)↗

Measurement of neutron production in atmospheric neutrino interactions at Super-Kamiokande

We present measurements of total neutron production from atmospheric neutrino interactions in water, analyzed as a function of electron-equivalent visible energy over a range of 30 MeV to 10 GeV. These results are based on 4,270 days of data collected by Super-Kamiokande, including 564 days with 0.011 wt% gadolinium added to enhance neutron detection. Neutron signal selection is based on a neural network trained on simulation, with its performance validated using an Am/Be neutron point source. The measurements are compared to predictions from neutrino event generators combined with various hadron-nucleus interaction models, which include an intranuclear cascade model and a nuclear deexcitation model. We observe significant variations in the predictions depending on the choice of hadron-nucleus interaction model. We discuss key factors that contribute to describing our data, such as in-medium effects in the intranuclear cascade and the accuracy of statistical evaporation modeling.

Cherenkov detectors↗

Passive Microwave Spectral Imaging of Amospheric Structure

The primary objective of this research was to improve the scientific foundation necessary to full realization of the meteorological potential of the NOAA Advanced Microwave Sounding Unit (AMSU) recently first launched on the NOAA-15 satellite in May, 1998. These advances were made in four main areas: (1) improvements, based on aircraft observations, in the atmospheric transmittance expressions used for interpreting AMSU and similar data; (2) development of neural network retrieval methods for cloud top altitude estimates of approximately 1-km accuracy under cirrus shields--the altitude is that of the larger ice particles aloft, which is related to precipitation rate; (3) analysis of early AMSU flight data with respect to its precipitation sensitivity and fine-scale thermal structure; and (4) improvements to the 54-GHz and 118-GHz MTS aircraft imaging spectrometer now operating on the NASA ER-2 aircraft. More specifically, the oxygen transmittance expressions near 118 GHz were in better agreement with aircraft data when the temperature dependence exponent of the 118.75-GHz linewidth was increased from the MPM92 value (Liebe et al., 1992) of 0.8 to 0.97+/-0.03. In contrast, the observations 52.5-55.8 GHz were consistent with the MPM92 model. Neural networks trained on comparisons of 118-GHz spectral data and coincident stereoscopic video images of convective cells observed from 20-km altitude yielded agreement in their peak altitudes within as little as 1.36 km rms, much of which is stereoscopic error. Imagery using these methods produced useful characterizations for Cyclone Oliver in 1993 and other storms (Schwartz et al., 1996; Spina et al., 1998). Similar neural network techniques yielded simulated rms errors in relative humidity retrievals of 6-14 percent over ocean and 6-15 percent over land at pressure levels from 1013 to 131 mbar (Cabrera-Mercader and Staelin, 1995).

Staelin, David H.↗

Neural network architecture for crossbar switch control

A Hopfield neural network architecture for the real-time control of a crossbar switch for switching packets at maximum throughput is proposed. The network performance and processing time are derived from a numerical simulation of the transitions of the neural network. A method is proposed to optimize electronic component parameters and synaptic connections, and it is fully illustrated by the computer simulation of a VLSI implementation of 4 x 4 neural net controller. The extension to larger size crossbars is demonstrated through the simulation of an 8 x 8 crossbar switch controller, where the performance of the neural computation is discussed in relation to electronic noise and inhomogeneities of network components.

Troudet, Terry P.↗

Neural-Network-Enhanced COTSIM: Advancing Predictive Capabilities for Fast DIII-D Simulations

Sustaining fusion reactions in tokamaks requires heating plasma to thermonuclear temperatures while maintaining confinement and stability. Neutral beam injection (NBI) provides heating, current drive, torque, and fueling, while electron cyclotron (EC) waves are widely used for heating and current drive; together, these actuators shape the plasma current, temperature, and density profiles. The control-oriented tokamak simulator (COTSIM), a predictive, control-oriented code, has been enhanced with neural-network surrogates for transport and sources. Turbulent transport is predicted by MMMnet—a neural-network version of the updated multimode model (MMM 9.0.10)—with significantly reduced computation time relative to MMM; neoclassical transport follows the Chang–Hinton model. NUBEAMnet, a surrogate of the Monte Carlo NUBEAM module, predicts beam-driven heating, current, and torque. EC heating and current drive use a control-oriented, empirically scaled source model; plasma resistivity follows the Spitzer formulation; bootstrap current uses the Sauter model. Equilibrium is computed using both prescribed and fixed-boundary solvers (FBSs), and the pedestal structure is modeled with an empirical pedestal model. For a representative DIII-D discharge, COTSIM predicts electron and ion temperature and safety-factor profiles in close agreement with TRANSP predictive and interpretive simulations while extending predictions through the pedestal region to the plasma edge (versus 80% of the minor radius in TRANSP). Furthermore, the equivalent COTSIM simulation runs in under 3 min compared to about 2 h for TRANSP, enabling rapid scenario planning, optimization of tokamak operation, and between-pulse control design.

Control-oriented tokamak simulator (COTSIM)↗

Radar signal categorization using a neural network

Neural networks were used to analyze a complex simulated radar environment which contains noisy radar pulses generated by many different emitters. The neural network used is an energy minimizing network (the BSB model) which forms energy minima - attractors in the network dynamical system - based on learned input data. The system first determines how many emitters are present (the deinterleaving problem). Pulses from individual simulated emitters give rise to separate stable attractors in the network. Once individual emitters are characterized, it is possible to make tentative identifications of them based on their observed parameters. As a test of this idea, a neural network was used to form a small data base that potentially could make emitter identifications.

Anderson, James A.↗

Recent Weakening of the Global Radiative Feedback

Earth's climate stability, characterized by the global radiative feedback parameter (𝜆), varies decadally due to changing surface temperature patterns. Recent variations in 𝜆 are poorly understood as coordinated model simulations typically end in 2014. We apply a convolutional neural network trained on climate model simulations to observation-based surface temperature reconstructions to estimate variations in 𝜆 up to 2025. We find that 𝜆 reached a minimum (maximum stability) around the mid 1990s (𝜆 ≃ −3 Wm −2 /K), but has since weakened significantly (𝜆 ≃ −2 Wm −2 /K). We confirm these results with climate model simulations extended to 2022. The recent 𝜆 weakening is not significantly affected by El Niño Southern Oscillation or Pacific Decadal Oscillation. Attribution reveals that warming in the subtropical Northeast Pacific is an important driver of the recently weakened feedback, confirmed by targeted experiments in E3SMv2. Our approach enables near real-time monitoring of Earth's climate stability.

54 ENVIRONMENTAL SCIENCES↗

Spiking Neurons for Analysis of Patterns

Artificial neural networks comprising spiking neurons of a novel type have been conceived as improved pattern-analysis and pattern-recognition computational systems. These neurons are represented by a mathematical model denoted the state-variable model (SVM), which among other things, exploits a computational parallelism inherent in spiking-neuron geometry. Networks of SVM neurons offer advantages of speed and computational efficiency, relative to traditional artificial neural networks. The SVM also overcomes some of the limitations of prior spiking-neuron models. There are numerous potential pattern-recognition, tracking, and data-reduction (data preprocessing) applications for these SVM neural networks on Earth and in exploration of remote planets. Spiking neurons imitate biological neurons more closely than do the neurons of traditional artificial neural networks. A spiking neuron includes a central cell body (soma) surrounded by a tree-like interconnection network (dendrites). Spiking neurons are so named because they generate trains of output pulses (spikes) in response to inputs received from sensors or from other neurons. They gain their speed advantage over traditional neural networks by using the timing of individual spikes for computation, whereas traditional artificial neurons use averages of activity levels over time. Moreover, spiking neurons use the delays inherent in dendritic processing in order to efficiently encode the information content of incoming signals. Because traditional artificial neurons fail to capture this encoding, they have less processing capability, and so it is necessary to use more gates when implementing traditional artificial neurons in electronic circuitry. Such higher-order functions as dynamic tasking are effected by use of pools (collections) of spiking neurons interconnected by spike-transmitting fibers. The SVM includes adaptive thresholds and submodels of transport of ions (in imitation of such transport in biological neurons). These features enable the neurons to adapt their responses to high-rate inputs from sensors, and to adapt their firing thresholds to mitigate noise or effects of potential sensor failure. The mathematical derivation of the SVM starts from a prior model, known in the art as the point soma model, which captures all of the salient properties of neuronal response while keeping the computational cost low. The point-soma latency time is modified to be an exponentially decaying function of the strength of the applied potential. Choosing computational efficiency over biological fidelity, the dendrites surrounding a neuron are represented by simplified compartmental submodels and there are no dendritic spines. Updates to the dendritic potential, calcium-ion concentrations and conductances, and potassium-ion conductances are done by use of equations similar to those of the point soma. Diffusion processes in dendrites are modeled by averaging among nearest-neighbor compartments. Inputs to each of the dendritic compartments come from sensors. Alternatively or in addition, when an affected neuron is part of a pool, inputs can come from other spiking neurons. At present, SVM neural networks are implemented by computational simulation, using algorithms that encode the SVM and its submodels. However, it should be possible to implement these neural networks in hardware: The differential equations for the dendritic and cellular processes in the SVM model of spiking neurons map to equivalent circuits that can be implemented directly in analog very-large-scale integrated (VLSI) circuits.

Huntsberger, Terrance↗

Pilot Workload Rating Predictions Using Image Data and Recurrent Neural Networks

In this work, we augmented existing methods for estimating pilot workload ratings with deep neural networks trained using data from simulated flight tests in the Vertical Motion Simulator (VMS). We used an existing method, Spare Capacity Operations Estimator (SCOPE), along with a recurrent neural network and conducted comparison studies between the two methods individually, and when used together. We found that using both methods together can improve the result over using either approach alone. In our first test case, we achieved an improved linear correlation coefficient of 0.409 over that of SCOPE alone at 0.352 on the training dataset. Through cross validation, we also found that the results may be dependent on the split of training vs. validation data, and that further investigation should be conducted to understand what additional inputs to the neural network model should be made.

Image Data↗

Simulation tests of the optimization method of Hopfield and Tank using neural networks

The method proposed by Hopfield and Tank for using the Hopfield neural network with continuous valued neurons to solve the traveling salesman problem is tested by simulation. Several researchers have apparently been unable to successfully repeat the numerical simulation documented by Hopfield and Tank. However, as suggested to the author by Adams, it appears that the reason for those difficulties is that a key parameter value is reported erroneously (by four orders of magnitude) in the original paper. When a reasonable value is used for that parameter, the network performs generally as claimed. Additionally, a new method of using feedback to control the input bias currents to the amplifiers is proposed and successfully tested. This eliminates the need to set the input currents by trial and error.

Paielli, Russell A.↗

Digital twin framework for PIP-II linac: AI-driven multi-scale modeling from ion source to 800 MeV

The PIP-II superconducting linac at Fermilab is designed to deliver multi-megawatt proton beams for neutrino physics and other high-intensity applications. To expedite commissioning and enhance operational reliability, we have developed an EPICS-based data flow framework that seamlessly integrates digital twins (DT) with physical twins (PT). These digital twins comprise high-fidelity beam dynamics models or data-driven surrogate models connected to their physical counterparts through real-time diagnostics and advanced machine-learning algorithms.Central to this framework is Linac_Gen, an accelerated simulation tool that incorporates convolutional neural networks, random forests, and genetic algorithms to provide up to a tenfold speedup in optimizing the accelerator geometry model. An EPICS translator layer ensures interoperability by efficiently mapping lattice parameters across diverse simulation platforms.Our EPICS-based framework supports multiple operational modes—monitoring, passive learning, closed-loop control, and online learning—covering the entire machine lifecycle. By leveraging HPC resources and multi-objective optimization techniques, the digital twin enables adaptive trajectory correction, real-time fault detection, and predictive modeling of beam stability. This comprehensive approach paves the way for robust, high-intensity operation and data-driven accelerator R&D at Fermilab.

Pathak, Abhishek [Fermilab]↗