Search NASA⌕ Search

SEARCH · Search NASA

Results for “Neural Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Three and Two Phase Rotating Field Inductive Couplers for Wireless Power Transfer with One Phase per Layer Windings

Multiphase inductive wireless charging coils have been proposed recently to improve coupler surface power density, reduce component stress and size, and provide near-constant power delivery to charge mobile electric systems. Several aspects for the fundamental characterization of multiphase coils are explored up to six phases including approximate mutual inductance with size and turn variation, induced voltage, and output power estimation. The relative component stress and size of passive components for resonant operation are compared between the multiphase variants. A combination of an experimentally validated 3D electromagnetic finite element analysis (FEA) and power electronic co-simulations are used to validate the estimated quantities approximated with a mixture of analytical equations and an artificial neural network model for mutual inductance. A novel three-phase transmitter, two-phase receiver coil pair is also proposed for electric vehicle charging to reduce the number of connections and compensation complexity on the vehicle-side with improved power output compared to a two-phase configuration.

Lewis, Donovin D. [University of Kentucky]↗
DOE OSTI2023

Automatic Crack Segmentation and Feature Extraction in Electroluminescence Images of Solar Modules

The effect of cracks in solar cells on the long-term degradation of photovoltaic (PV) modules remains to be determined. To investigate this effect in future studies, it is necessary to quantitatively describe the crack features (e.g., length) and correlate them with module power loss. Electroluminescence (EL) imaging is a common technique for identifying cracks. However, it is currently challenging and time-consuming to identify cracks in a large number of EL images and quantify complex crack features by human inspection. This article introduces a fast semantic segmentation method (~0.18 s/cell) to automatically segment cracks from EL images and algorithms to extract crack features. Here we fine-tuned a UNet neural network model using pretrained VGG16 as the encoder and obtained an average F1 score of 0.875 and an intersection over union score of 0.782 on the testing set. With cracks and busbars segmented, we developed algorithms for extracting crack features, including the crack-isolated area, the brightness inside the isolated area, and the crack length. We also developed an automatic preprocessing tool for cropping individual cell images from EL images of PV modules (~0.72 s/module). Our codes are published as open-source an software, and our annotated dataset composed of various types of cells is published as a benchmark for crack segmentation in EL images.

14 SOLAR ENERGY↗
DOE OSTI2024

Evaluation of GlassNet for physics-informed machine learning of glass stability and glass-forming ability

Glassy materials form the basis of many modern applications, including nuclear waste immobilization, touch-screen displays, and optical fibers, and also hold great potential for future medical and environmental applications. However, their structural complexity and large composition space make design and optimization challenging for certain applications. Of particular importance for glass processing and design is an estimate of a given composition's glass-forming ability (GFA). However, there remain many open questions regarding the underlying physical mechanisms of glass formation, especially in oxide glasses. It is apparent that a proxy for GFA would be highly useful in glass processing and design, but identifying such a surrogate property has proven itself to be difficult. While glass stability (GS) parameters have historically been used as a GFA surrogate, recent research has demonstrated that most of these parameters are not accurate predictors of the GFA of oxide glasses. Here, in this work, we explore the application of an open-source pre-trained neural network model, GlassNet, that can predict the characteristic temperatures necessary to compute GS with reasonable performance and assess the feasibility of using these physics-informed machine learning (PIML)-predicted GS parameters to estimate GFA. In doing so, we track the uncertainties at each step of the computation—from the original ML prediction errors to the compounding of errors during GS estimation, and finally to the final estimation of GFA. While GlassNet exhibits reasonable accuracy on all individual properties, we observe a large compounding of error in the combination of these individual predictions for the PIML prediction of GS, finding that random forest models offer similar accuracy to GlassNet. We also break down the performance of GlassNet on different glass families and find that the error in GS prediction is correlated with the error in crystallization peak temperature prediction. Lastly, we utilize this finding to assess the relationship between top-performing GS parameters and GFA for two ternary glass systems: sodium borosilicate and sodium iron phosphate glasses. We conclude that to obtain true ML predictive capability of GFA, significantly more data needs to be collected.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Numerical Investigation of Fuel Property Effects on Mixed-Mode Combustion in a Spark-Ignition Engine

In this research, lean mixed-mode combustion is numerically investigated using computational fluid dynamics (CFD) in a spark-ignition engine. A new E30 fuel surrogate is developed using a neural network model with matched octane numbers. A skeletal mechanism is also developed by automated mechanism reduction and by incorporating a NO x submechanism. A hybrid approach that couples the G-equation model and the well-stirred reactor model is employed for turbulent combustion modeling. The developed CFD model is shown to well predict pressure and apparent heat release rate (AHRR) traces compared with experiment. Two types of combustion cycles (deflagration-only and mixed-mode cycles) are observed. The mixed-mode cycles feature early flame propagation and subsequent end-gas auto-ignition, leading to two distinctive AHRR peaks. The validated CFD model is then employed to investigate the effects of NO x chemistry. The NO x chemistry is found to promote auto-ignition through the residual gas, while the deflagration phase remains largely unaffected. Sensitivity analysis is finally performed to understand effects of fuel properties, including heat of vaporization (HoV) and laminar flame speed (S L ). An increased HoV tends to suppress auto-ignition through charge cooling, while the impact of HoV on flame propagation is insignificant. In contrast, an increased S L is found to significantly promote both flame propagation and end-gas auto-ignition. The promoting effect of S L on auto-ignition is not a direct chemical effect; it is rather caused by an advancement of the combustion phasing, which increases compression heating of the end-gas.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

On the Training and Generalization of Deep Operator Networks

Here, we present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two subnetworks, namely the branch and trunk networks. Typically, the two subnetworks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram–Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.

deep operator networks↗
DOE OSTI2022

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗
DOE OSTI2023

Towards On-Chip Learning for Low Latency Reasoning with End-to-End Synthesis

The Software Defined Architectures (SODA) Synthesizer is an open-source compiler-based tool able to automatically generate domain-specialized systems targeting Application-Specific Integrated Circuits (ASICs) or Field Programmable Gate Arrays (FPGAs) starting from high-level programming. SODA is composed of a frontend, SODA-OPT, which leverages the multilevel intermediate representation (MLIR) framework to interface with productive programming tools (e.g., machine learning frame-works), identify kernels suitable for acceleration, and perform high-level optimizations, and of a state-of-the-art high-level synthesis backend, Bambu from the PandA framework, to generate custom accelerators. One specific application of the SODA Synthesizer is the generation of accelerators to enable ultra-low latency inference and control on autonomous systems for scientific discovery (e.g., electron microscopes, sensors in particle accelerators, etc.). This paper provides an overview of the flow in the context of the generation of accelerators for edge processing to be integrated in transmission electron microscopy (TEM) devices, focusing on use cases from precision material synthesis. We show the tool in action with an example of design space exploration for inference on reconfigurable devices with a conventional deep neural network model (LeNet). Finally, we discuss the research directions and opportunities enabled by SODA in the area of autonomous control for scientific experimental workflows.

Castellana, Vito G.↗
DOE OSTI2022

ccp137/SUGAR

This package (SUrface-wave Grader with ARtificial intelligence or SUGAR) automatically assigns a quality score to surface-wave seismograms (SAC format) using a trained artificial neural network model (included). Specifically, the python script 01_apply_ann.py calculates probability scores for a list of SAC files. You may consider seismograms with probability scores larger than 0.5 as acceptable data. Note no scores will be given to seismograms that do not pass an initial check (e.g., insufficient number of data points). See https://doi.org/10.1002/essoar.10507941.3 for more details.

Chai, Chengping [Oak Ridge National Lab. (ORNL), O↗
DOE OSTI2020

MalGen

MalGen is helper code that includes a script for loading data in format for PyTorch neural network models. It also includes example models. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3078 O

Johnson, NicholasT↗
DOE OSTI2025

ORNL-Chi-Geometry

Library for benchmarking neural network models on classification tasks for chirality detection in atomistic structures of organic compounds.

Weaver, Rylie [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2025

fast3

Code to train neural network models for binding affinity prediction

Kim, Hyojin [Lawrence Livermore National Laborator↗
DOE OSTI2021

The genotype-phenotype landscape of an allosteric protein

Allostery is a fundamental biophysical mechanism that underlies cellular sensing, signaling, and metabolism. Yet a quantitative understanding of allosteric genotype-phenotype relationships remains elusive. Here, we report the large-scale measurement of the genotype-phenotype landscape for an allosteric protein: the lac repressor from Escherichia coli , LacI. Using a method that combines long-read and short-read DNA sequencing, we quantitatively measure the dose-response curves for nearly 10 5 variants of the LacI genetic sensor. The resulting data provide a quantitative map of the effect of amino acid substitutions on LacI allostery and reveal systematic sequence-structure-function relationships. We find that in many cases, allosteric phenotypes can be quantitatively predicted with additive or neural-network models, but unpredictable changes also occur. For example, we were surprised to discover a new band-stop phenotype that challenges conventional models of allostery and that emerges from combinations of nearly silent amino acid substitutions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Nonlinear behavior of urban flood peaks in the U.S. Mid-Atlantic region

Urbanization, i.e., increasing urban development areas in a watershed, is well known as a major cause of increasing flood magnitudes. This study analyzes the observed flood peaks at 262 watersheds in the U.S. Mid-Atlantic region with varying levels of urban development and free from reservoir impacts. Our analysis reveals an interesting, V-shaped nonlinear behavior: flood peaks first decrease and then increase with increasing percentage of urban development area at the watershed scale (PDAW), with the shift occurring at a PDAW threshold of around 10%. Regression analyses suggest that the V-shaped pattern primarily results from complex interactions among climate conditions (e.g., storm-event rainfall) and landscape properties (e.g., elevation, distance to the coast). A neural network model was then developed to capture such interactions, satisfactorily reproducing the V-shaped pattern with an R-squared value of 0.58, RMSE of 6.72 mm/day, and NSE of 0.55. These findings highlight the need to account for nonlinear dynamics in flood prediction and management in the coastal environment.

flood peaks↗
DOE OSTI2021

Online Monitoring System for Concrete Structures Affected by Alkali-Silica Reaction

This report presents a comprehensive study of developing ultrasonic wave and acoustic emission (AE) techniques for long-term monitoring of alkali-silica reaction (ASR) development in concrete. Small, medium, and full-scale concrete specimens were cast, conditioned, and monitored for various periods, from at least one year to 2.4 years. The reactive concrete specimens contain coarse or fine reactive aggregates to study the effects of different types of reactive aggregates. Confinements were also designed to simulate the 2-dimensional confinement effects of reinforcement in the shield building of nuclear power plants. The concrete specimens were stored in a environmental chamber with high humidity and high temperature to accelerate the ASR development. The ultrasonic monitoring data shows high sensitivity to ASR development and could detect cracking initiation well before visible surface cracks occurred. However, the linear ultrasonic analysis based on wave velocity is strongly affected by temperature variation. Therefore, a nonlinear ultrasonic method was proposed to measure thermally induced nonlinear acoustic responses of concrete (thermal modulation of ultrasonic wave). The measured nonlinear acoustic parameter shows a high correlation with ASR expansion across specimens with different reactive aggregates and confinement conditions. The same conclusion was obtained from nonlinear resonance tests on small concrete prisms. Compared to the linear acoustic methods, the nonlinear tests show high sensitivities to ASR damage from internal microcracking initiation at the early stage to visible cracks at the late stage of ASR. The attributes of the thermal modulation of nonlinear ultrasonic method include high sensitivity, immunity to temperature effects, and strong correlation with ASR expansion, which demonstrate great potentials of the nonlinear ultrasonic method for diagnosis of ASR damage and prediction of concrete deterioration process. Acoustic emission is a passive sensing technique for damage assessment, and access to only one surface is needed even for thick and heavily reinforced elements such as the walls utilized for nuclear shield building. Additionally, relatively few sensors are required to monitor the progression of the damage process. Results indicate that the AE data can be related to the damage rating index, which is a petrography-based means of assessing damage due to ASR in reinforced concrete. Furthermore, AE is capable of detecting ASR damage long before surface cracking is visually noticeable. Boundary conditions play in important role in the progression of ASR damage and differences in boundary conditions are reflected in the AE data. Entropy based data assessment methods provide a means to assess the damage state, and convolutional neural network based data assessment provided a means to assess the damage state in real-time. Results indicate that artificial neural network models may be used as a means to predict volumetric expansion based on AE data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

CO2 Plume Imaging with Accelerated Deep Learning-based Data Assimilation Considering Multiple Realizations: Application to the Illinois Basin-Decatur Carbon Sequestration Project

We propose a fast and efficient deep learning workflow for near real-time data assimilation, forecasting and visualization of CO2 plume evolution in saline aquifer and demonstrate its application at a field site. Unlike the previous work, this study incorporates the impact of spatial heterogeneity using multiple realizations. In the proposed workflow, a neural network model utilizes available monitoring data such as downhole pressure measurements as input and predicts the propagating pressure ‘front’ using the diffusive time of flight (DTOF) map which is considered as representative reservoir image of the flow field. The DTOF is the arrival time of pressure front propagation, which can be computed by the Fast Marching Method rapidly without flow simulations. Reservoir model calibration can be implemented by selecting the training data samples that describe the predicted DTOF map based on observed data. The power and efficacy of our workflow is demonstrated by application to the Illinois Basin-Decatur Project.

CO2 plume imaging↗
DOE OSTI2026

Machine Learning Vacancy Formation Energy in Nickel-Based Superalloys

Thermal vacancies play a critical role in high-temperature Ni-based superalloys and influence various properties such as creep resistance, oxidation, etc. This study systematically investigates the impact of commonly used transition metals (Cr, Co, Fe), refractory metals (Nb, Ta, Mo, W) and other elements (Al, Cu, Ti, Mn) on the thermodynamic stability of 36 binary, 20 ternary, 11 quaternary, 9 quinary, and 3 senary FCC Ni-based alloys covering various elemental combinations. Density functional theory-based studies on Ni-X binary alloys show that higher concentrations of Cr, Nb, Ta, Al, and Ti introduce significant lattice distortions and broaden the distribution of vacancy formation energies (standard deviation up to 0.15 eV). These elements partially donate electrons, reducing their self-consistent chemical potentials relative to single-element reference values and lowering vacancy formation energies, while Co, Fe, Mo, and W show lower charge localization. These trends extend from 3-6 element alloys, where Cr, Nb, and Ta-rich compositions have low-energy states (~0.5 eV) that increase vacancy concentrations. Finally, graph neural network models are developed to screen over 5000 virtual alloys. Eleven leading compositions are identified with mean vacancy formation energy higher than 1.75 eV and vacancy concentration ~2 orders of magnitude lower than pure Ni at 1000 K. These results provide valuable guidelines to achieve controlled defect engineering in structural alloys.

DFT↗
DOE OSTI2021

Using Machine Learning to Track Objects Across Cameras

Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

SQuaD: Smart Quantum Detection for Photon Recognition and Dark Count Elimination

Quantum detectors of single photons are an essential component for quantum information processing across computing, communication and networking. Today's quantum detection system, which consists of single photon detectors, timing electronics, control and data processing software, is primarily used for counting the number of single photon detection events. However, it is largely incapable of extracting other rich physical characteristics of the detected photons, such as their wavelengths, polarization states, photon numbers, or temporal waveforms. This work, for the first time, demonstrates a smart quantum detection system, SQuaD, which integrates a field programmable gate array (FPGA) with a neural network model, and is designed to recognize the features of photons and to eliminate detector dark-count. The SQuaD is a fully integrated quantum system with high timing-resolution data acquisition, onboard multi-scale data analysis, intelligent feature recognition and extraction, and feedback-driven system control. Our \name experimentally demonstrates 1) reliable photon counting on par with the state-of-the art commercial systems; 2) high-throughput data processing for each individual detection events; 3) efficient dark count recognition and elimination; 4) up to 100% accurate feature recognition of photon wavelength and polarization. Additionally, we deploy the SQuaD to an atomic (erbium ion) photon emitter source to realize noise-free control and readout of a spin qubit in the telecom band, enabling critical advances in quantum networks and distributed quantum information processing.

Linne, Karl C. [U. Chicago (main)] (ORCID:00090009↗