Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep potential”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Predicting Catalyst Surface Stability Under Reaction Conditions Using Deep Reinforcement Learning and Machine Learning Potentials

Catalysts are critical for most large-scale energy intensive chemical transformation processes, such as energy storage, liquid fuel production, and the formation of chemical building blocks. The catalyst composition, structure, and morphology impact the performance under reaction conditions and influences properties like activity and selectivity. Many industrial catalysts offer imperfect activity/selectivity, or contain expensive metals. Further, catalysts can deactivate over time as the morphology changes or harsh reactive environments alter the surface structure. Methods to automatically model and predict the kinetics of how catalyst surfaces will restructure would enable engineers to design around these challenges, improve performance, increase longevity. This project investigated a specific type of machine learning model, deep reinforcement learning, machine learning models to act as surrogates for the physical system, and compared the results of these approaches with a specialized high-throughput experimental synthesis and measurement platform.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Towards Efficient Uncertainty estimation in deep learning for robust energy prediction in crystal materials

In material science, recent studies have started to explore the potential of using deep learning to improve property prediction from high-fidelity simulations, e.g, density functional theory (DFT). However, the design spaces are sometimes too large and intractable to sample completely. This results in a critical question that is how to evaluate the confidence and robustness of the prediction. In this paper, we propose an efficient approach to estimate uncertainty in deep learning using a single forward pass and then apply it for robust prediction of the total energy in crystal lattice structures. Our approach is built upon the deep kernel learning (DKL) that originally introduces to leverage the expressiveness of deep neural networks as input with a probabilistic prediction of Gaussian processes (GPs) as output. Existing DKL methods have difficulties in the accuracy of predictive uncertainty, training stability, and scaling to large datasets, which lead to significant barriers in real-world applications. We propose to address these challenges by using an inducing point approximate GP in feature space combined with spectral normalization as a regularization. We finally demonstrate our robust performance on an artificial example and a real-world application from materials chemistry.

Bi, Sirui↗
DOE OSTI2025

Differential Seismic Phase Detection Probability as a Potential Discriminant of Explosions and Earthquakes

Deep learning models trained to estimate the probability of seismic P and S phases are rapidly expanding the scale of local event detections. Here, we evaluate the potential for deep learning model output phase detection probabilities to contribute to event‐type classification, particularly discrimination of single‐fired borehole explosions and earthquakes at local distances (<300 km). Motivated by the empirical success of P/S amplitude ratios, we consider the difference between P and S pick probability output from previously developed phase detection models, P prob −S prob ⁠, as a discriminant. Test data include M L ∼1–4 earthquakes and explosions observed by common seismographs in ten geologically diverse localities. Depending on the picking model and training data, binary classification using P prob −S prob with at least three stations can achieve approximately equivalent classification accuracy as P/S amplitude ratios without requiring any customization. Joint classification with P/S and P prob −S prob improves accuracy for most quality control scenarios. Pick probabilities are an efficient attribute to consider in explosion discrimination because they can be automated byproducts of event detection. They avoid the binary choice of picking or not picking weakly visible S waves common to explosions.

Duan, Chenglong [Rice Univ., Houston, TX (United S↗
DOE OSTI2024

Deep Eutectic Solvents as Candidates for Lithium Isotope Enrichment

Nuclear fusion is a phenomenon that is well known within the nuclear physics community as a viable option for alternative energy as many natural gases and fossil fuels are phased out of commercial use. Deuterium and tritium fusion reactions are currently the leading candidates for nuclear fusion, with a major limiting factor being a means to produce tritium on an industrial scale. Lithium-6 is a well-known isotope that can produce tritium and helium following a fission reaction with a neutron. Unfortunately, the lithium-6 enrichment methods are limited to the COLEX process, which leaves behind an alarming amount of mercury waste as a potential environmental contaminant. Deep eutectic solvents are believed to be a potential alternative to lithium isotope separations due to the ease of generation, in addition to the minimum environmental waste generated when these solvents are employed. Previous studies have suggested that deep eutectic solvents are capable of separating lithium isotopes by utilizing a 2-thenoyltrifluoroacetone and trioctylphosphine oxide system that can biphasically react with a buffered solution containing lithium chloride. This system displays a separation factor of 1.068, which when compared to the 1.054 separation within the COLEX process, makes it a potential candidate for lithium-6/7 separation. Within this study, we investigate this system in comparison to two newly synthesized deep eutectic solvents and find that within these acetylacetone-based systems, little isotopic separation is observed. We investigate these systems both experimentally and computationally, showing the different lithium cation affinities, in addition to proposing how the electron-donating or -withdrawing nature can influence these systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Assessment of alternative radionuclides for use in a radioisotope thermoelectric generator

238 Pu is the current fuel source for MMRTGs. This is due to favorable properties, such as high decay heat and low gamma emissions. 238 Pu supplies are dwindling rapidly, necessitating the review of potential replacement isotopes for deep space missions. This work considers nine potential replacements, Ac-227, Am-241, Cf-252, Cm-244, Cs-137, Po-210, Sr-90, Th-228, and Th-170. We have assessed performance of alternatives to 238 Pu by modeling the specific decay-heat and gamma spectra of several potential radioisotopes in SCALE-ORIGEN, and comparing these with 238 Pu. An analysis of heat output, heat stability, safety, availability and required mass, baselined against 238 Pu demonstrates that of those radioisotopes studied, 241 Am has properties that make it most conducive for 238 Pu replacement.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

Transformers are considered one of the most important deep learning models since 2018, in part because it establishes state-of-the-art (SOTA) records and could potentially replace existing Deep Neural Networks (DNNs). Despite the remarkable triumphs, the prolonged turnaround time of Transformer models is a widely recognized roadblock. The variety of sequence lengths imposes additional computing overhead where inputs need to be zero-padded to the maximum sentence length in the batch to accommodate the parallel computing platforms. This paper targets the field-programmable gate array (FPGA) and proposes a coherent sequence length adaptive algorithm–hardware co-design for Transformer acceleration. Particularly, we develop a hardware-friendly sparse attention operator and a length-aware hardware resource scheduling algorithm. The proposed sparse attention operator brings the complexity of attention-based models down to linear complexity and alleviates the off-chip memory traffic. The proposed length-aware resource hardware scheduling algorithm dynamically allocates the hardware resources to fill up the pipeline slots and eliminates bubbles for NLP tasks. Experiments show that our design has very small accuracy loss and has 80.2 × and 2.6 × speedup compared to CPU and GPU implementation, and 4 × higher energy efficiency than state-of-the-art GPU accelerator optimized via CUBLAS GEMM.

Peng, Hongwu↗
DOE OSTI2022

Cooperative Research and Development Agreement between National Energy Technology Laboratory and University of Kentucky (Abstract)

The National Energy Technology Laboratory (NETL) and University of Kentucky (Participant) will collaborate in the development of “Deep Learning Potential-based Molecular Dynamics Simulation Investigation of Chemical Conversion-Absorption Coupling of CO 2 at Air-Reactive Deep Eutectic Solvent Interface.” This project is supported by DOE-Office of Science Graduate Student Research (SCGSR) program and managed by Oak Ridge Institute for Science and Education (ORISE). Deep eutectic solvents (DESs) are promising alternative sorbents for direct air capture (DAC) CO 2 due to their low vapor pressure, low corrosion, non-toxicity, relatively low cost, and biodegradable nature. Understanding the CO 2 reaction-transport mechanisms at the interface can help develop cost-effective DAC by DESs with high capacity and stability. The collaboration will investigate the absorption and chemical conversion of CO 2 at the air-DES interface to facilitate the development of novel DAC technology using reactive DESs. The anticipated results will make DAC more efficient, allow more sustainable use of our Nation’s fossil energy resources, and advance NETL’s ongoing CO 2 capture efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Water dissociation at the water–rutile TiO 2 (110) interface from ab initio-based deep neural network simulations

The interaction of water with TiO 2 surfaces is of crucial importance in various scientific fields and applications, from photocatalysis for hydrogen production and the photooxidation of organic pollutants to self-cleaning surfaces and bio-medical devices. In particular, the equilibrium fraction of water dissociation at the TiO 2 –water interface has a critical role in the surface chemistry of TiO 2 , but is difficult to determine both experimentally and computationally. Among TiO 2 surfaces, rutile TiO 2 (110) is of special interest as the most abundant surface of TiO 2 ’s stable rutile phase. While surface-science studies have provided detailed information on the interaction of rutile TiO 2 (110) with gas-phase water, much less is known about the TiO 2 (110)–water interface, which is more relevant to many applications. In this work, we characterize the structure of the aqueous TiO 2 (110) interface using nanosecond timescale molecular dynamics simulations with ab initio-based deep neural network potentials that accurately describe water/TiO 2 (110) interactions over a wide range of water coverages. Simulations on TiO 2 (110) slab models of increasing thickness provide insight into the dynamic equilibrium between molecular and dissociated adsorbed water at the interface and allow us to obtain a reliable estimate of the equilibrium fraction of water dissociation. We find a dissociation fraction of 22 ± 6% with an associated average hydroxyl lifetime of 7.6 ± 1.8 ns. These quantities are both much larger than corresponding estimates for the aqueous anatase TiO 2 (101) interface, consistent with the higher water photooxidation activity that is observed for rutile relative to anatase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Explaining Neural Spike Activity for Simulated Bio-plausible Network through Deep Sequence Learning

With significant improvements in large-scale simulations of brain models, there is a growing need to develop tools for rapid analysis and interpreting the simulation results. In this work, we explore the potential of sequential deep learning models to understand and explain the network dynamics among the neurons extracted from a large-scale neural simulation in STACS (Simulation Tool for Asynchronous Cortical Stream). Our method employs a representative neuroscience model that abstracts the cortical dynamics with a reservoir of randomly connected spiking neurons with a low stable spike firing rate throughout the simulation duration. We subsequently analyze the spike dynamics of the simulated spiking neural network through an autoencoder model and an attention-based mechanism.

Kulkarni, Shruti↗
DOE OSTI2023

Techno-Economic Analysis for a Potential Geothermal District Heating System in Tuttle, Oklahoma

Geothermal deep direct use (DDU) has potential across a wide swath of the United States but is underutilized due to challenging project economics associated with developing a deep geothermal resource for a large-scale and variable heat demand. The National Renewable Energy Laboratory (NREL) and University of Oklahoma evaluated the feasibility of a geothermal district heating (GDH) and cooling system in two schools and 250 houses by utilizing existing oil and gas (O&G) wells in Tuttle, Oklahoma. Heating and cooling demand in the two schools and a typical single-family house were modeled using EnergyPlus building energy simulation software. The modeling results indicated that annual heating demand in two schools and 250 houses is approximately 2.61 GWhth, and cooling demand in the two schools is approximately 2.65 GWhth. In this scope, the techno-economic analysis (TEA) was conducted using the GEOPHIRES tool combined with the TOUGH2 reservoir simulator. The reservoir performance, including geothermal heat production capacity, was modeled by the reservoir simulator TOUGH2. Then, levelized cost of heat (LCOH) was calculated using GEOPHIRES version 3.0, which includes new features such as hourly heat load optimization and peak performance evaluation. Geothermal reservoir temperature was estimated as 90.5 degrees C at a total depth of 3.3 km by the regional average temperature gradient of 22.8 degrees C/km and validated by cation geothermometer calculations. Four production scenarios with two different well configurations and two different heat load profiles have been developed for well flow rates ranging between 3.1 kg/s and 9.3 kg/s. The LCOH of the district heating and cooling system was calculated between $95 and $210/MWh ($28/MMBtu to $62/MMBtu) for four different production scenarios. Typical natural gas prices for residential customers in Oklahoma have ranged from 9 to 19 $/MMBtu over the past decade, which indicates a challenge for deployment of such a GDH system.

deep direct-use↗
DOE OSTI2023

Molecular dynamics simulation of Fe-Si alloys using a neural network machine learning potential

Interatomic potential development using machine learning (ML) approaches has attracted a lot of attention in recent years because these potentials can effectively describe the structural and dynamical properties of complex materials at the atomistic level. Here, in this work, we present the development of a neural network (NN) deep ML interatomic potential for Fe-Si alloys, and we demonstrate the effectiveness of the NN-ML potential in predicting the structures and energies of liquid and crystalline phases of Fe-Si alloys in comparison with the results from ab initio molecular dynamics simulations or experimental data. The developed NN-ML potential is also used to perform molecular dynamics simulations to study the structures of Fe-Si alloys with various compositions under rapid solidification conditions. The short-ranged orders in the rapidly solidified Fe-Si alloys are also analyzed by a cluster alignment method.

36 MATERIALS SCIENCE↗
DOE OSTI2020

GEOPHIRES Simulations for Deep Direct Use (DDU) Projects

This folder contains the GEOPHIRES codes and input files for running the base case scenarios for the six deep direct-use (DDU) projects. The six DDU projects took place during 2017-2020 and were funded by the U.S. Department of Energy Geothermal Technologies Office. They investigated the potential of geothermal deep direct-use at six locations across the country. The projects were conducted by Cornell University, West Virginia University (WVU), University of Illinois (U of IL), Sandia National Laboratory (SNL), Portland State University (PSU), and National Renewable Energy Laboratory (NREL). Four projects (Cornell, WVU, U of IL, SNL) investigated geothermal for direct heating of a local campus or community, the project by PSU considered seasonal subsurface storage of solar heating, and the NREL project investigated geothermal heating for turbine inlet cooling using absorption chillers. To allow comparison of techno-economic results across the six DDU projects, GEOPHIRES simulations were set up and conducted for each project. The GEOPHIRES code was modified for each project to simulate the local application and incorporate project-specific assumptions and results such as reservoir production temperature or financing conditions. The base case input file is included which simulates the base case conditions assumed by each project team. The levelized cost of heat (LCOH) is calculated and matches the base case LCOH reported by the project teams.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Patch-Based Convolutional Neural Networks for Multiple Microstructural Features Detection in FIB-SEM Micrographs of Irradiated Nuclear Fuel

Focused ion beam scanning electron microscopy (FIB-SEM) tomography has increasingly been utilized for acquiring three-dimensional (3D) microstructure features at the sub-micron scale in irradiated nuclear materials. This technique involves sequential ion beam slicing followed by electron beam imaging and compositional mapping using energy dispersive spectroscopy (EDS). Despite its growing use, several challenges persist. These include the time-intensive nature of data collection of EDS data, difficulties in distinguishing between various microstructures, and issues with image alignment. These challenges currently limit the broader application of FIB-SEM tomography in the field. To overcome these limitations, we propose using convolutional neural networks (CNNs) to automate microstructure identification in SEM images. Our study introduces a new framework for identifying microstructures in irradiated U-10Zr (wt. %) metallic fuel with limited annotated data. The framework includes the creation of a reliable annotated dataset with paired SEM and ground truth data from EDS maps, the applications of CNNs for microstructure identification, and the validation of model performance. Specifically, we employed the Segment Anything Model (SAM) to align SEM images with corresponding EDS maps and focused ion beam (FIB) tomography SEM data. We evaluate several models, including Patch-based U-Net, Attention U-Net, and Residual U-Net, finding that patch-based U-Net exhibits superior segmentation performance and consistency. This approach reduces reliance on EDS detectors and aids in accelerating nuclear material analysis process, highlighting the potential of advanced deep learning techniques to improve microstructural understanding in nuclear material. This is the first framework to integrate SAM and Patch-based CNN models for semantic segmentation of irradiated nuclear materials, with potential applicability to other tomography datasets.

36 - MATERIALS SCIENCE↗
DOE OSTI2021

Neural network potential for Zr–Rh system by machine learning

Zr–Rh metallic glass has enabled its many applications in vehicle parts, sports equipment and so on due to its outstanding performance in mechanical property, but the knowledge of the microstructure determining the superb mechanical property remains yet insufficient. Here, we develop a deep neural network potential of Zr–Rh system by using machine learning, which breaks the dilemma between the accuracy and efficiency in molecular dynamics simulations, and greatly improves the simulation scale in both space and time. Here, the results show that the structural features obtained from the neural network method are in good agreement with the cases in ab initio molecular dynamics simulations. Furthermore, we build a large model of 5400 atoms to explore the influences of simulated size and cooling rate on the melt-quenching process of Zr 77 Rh 23 . Our study lays a foundation for exploring the complex structures in amorphous Zr 77 Rh 23 , which is of great significance for the design and practical application.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase-Contrast Transmission Electron Microscopy Images

Phase-contrast transmission electron microscopy (TEM) is a powerful tool for imaging the local atomic structure of materials. TEM has been used heavily in studies of defect structures of two-dimensional materials such as monolayer graphene due to its high dose efficiency. However, phase-contrast imaging can produce complex nonlinear contrast, even for weakly scattering samples. It is, therefore, difficult to develop fully automated analysis routines for phase-contrast TEM studies using conventional image processing tools. For automated analysis of large sample regions of graphene, one of the key problems is segmentation between the structure of interest and unwanted structures such as surface contaminant layers. In this study, we compare the performance of a conventional Bragg filtering method with a deep learning routine based on the U-Net architecture. We show that the deep learning method is more general, simpler to apply in practice, and produces more accurate and robust results than the conventional algorithm. We provide easily adaptable source code for all results in this paper and discuss potential applications for deep learning in fully automated TEM image analysis.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Deep Learning for Pion Identification and Energy Calibration with the ATLAS Detector

Separating charged and neutral pions as well as calibrating the pion energy response is a core component of reconstruction in the ATLAS calorimeter. This note presents an investigation of deep learning techniques for these tasks, representing the signal in the ATLAS calorimeter layers as pixelated images. Deep learning approaches outperform the classification applied in the baseline local hadronic calibration and are able to improve the energy resolution for a wide range in particle momenta, especially for low energy pions. This work demonstrates the potential of deep-learning-based low-level hadronic calibrations to significantly improve the quality of particle reconstruction in the ATLAS calorimeter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Techno-Economic Analysis for a Potential Geothermal District Heating System in Tuttle, Oklahoma: Preprint

Geothermal deep direct use (DDU) has potential across a wide swath of the United States but is underutilized due to challenging project economics associated with developing a deep geothermal resource for a large-scale and variable heat demand. The National Renewable Energy Laboratory (NREL) and University of Oklahoma evaluated the feasibility of a geothermal district heating (GDH) and cooling system in two schools and 250 houses by utilizing existing oil and gas (O&G) wells in Tuttle, Oklahoma. Heating and cooling demand in the two schools and a typical single-family house were modeled using EnergyPlus building energy simulation software. The modeling results indicated that annual heating demand in two schools and 250 houses is approximately 2.61 GWhth, and cooling demand in the two schools is approximately 2.65 GWhth. In this scope, the techno-economic analysis (TEA) was conducted using the GEOPHIRES tool combined with the TOUGH2 reservoir simulator. The reservoir performance, including geothermal heat production capacity, was modeled by the reservoir simulator TOUGH2. Then, levelized cost of heat (LCOH) was calculated using GEOPHIRES version 3.0, which includes new features such as hourly heat load optimization and peak performance evaluation. Geothermal reservoir temperature was estimated as 90.5 degrees C at a total depth of 3.3 km by the regional average temperature gradient of 22.8 degrees C/km and validated by cation geothermometer calculations. Four production scenarios with two different well configurations and two different heat load profiles have been developed for well flow rates ranging between 3.1 kg/s and 9.3 kg/s. The LCOH of the district heating and cooling system was calculated between $95 and $210/MWh ($28/MMBtu to $62/MMBtu) for four different production scenarios. Typical natural gas prices for residential customers in Oklahoma have ranged from 9 to 19 $/MMBtu over the past decade, which indicates a challenge for deployment of such a GDH system.

deep direct-use↗