Search NASA⌕ Search

SEARCH · Search NASA

Results for “residual networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Interconnection of the Antenna Pigment 8-HDF and Flavin Facilitates Red-Light Reception in a Bifunctional Animal-like Cryptochrome

Cryptochromes are ubiquitous flavin-binding light sensors closely related to DNA-repairing photolyases. The animal-like cryptochrome CraCRY from the green alga Chlamydomonas reinhardtii challenges the paradigm of cryptochromes as pure blue-light receptors by acting as a (6-4) photolyase, using 8-hydroxy-5-deazaflavin (8-HDF) as a light-harvesting antenna with a 17.4 Å distance to flavin and showing spectral sensitivity up to 680 nm. The expanded action spectrum is attributed to the presence of the flavin neutral radical (FADH•) in the dark, despite a rapid FADH• decay observed in vitro in samples exclusively carrying flavin. Herein, the red-light response of CraCRY carrying flavin and 8-HDF was studied, revealing a 3-fold prolongation of the FADH• lifetime in the presence of 8-HDF. Millisecond time-resolved ultraviolet-visible spectroscopy showed the red-light-induced formation and decay of an absorbance band at 458 nm concomitant with flavin reduction. Time-resolved Fourier transform infrared (FTIR) spectroscopy and density functional theory attributed these changes to the deprotonation of 8-HDF, challenging the paradigm of 8-HDF being permanently deprotonated in photolyases. FTIR spectra showed changes in the hydrogen bonding network of asparagine 395, a residue suggested to indirectly control flavin protonation, indicating the involvement of N395 in the stabilization of FADH•. Fluorescence spectroscopy revealed a decrease in the energy transfer efficiency of 8-HDF upon flavin reduction, possibly linked to 8-HDF deprotonation. Finally, the discovery of the interdependence of flavin and 8-HDF beyond energy transfer processes highlights the essential role of the antenna, introducing a new concept enabling CraCRY and possibly other bifunctional cryptochromes to fulfill their dual function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Detecting lithium plating dynamics in a solid-state battery with operando X-ray computed tomography using machine learning

Operando X-ray micro-computed tomography (µCT) provides an opportunity to observe the evolution of Li structures inside pouch cells. Segmentation is an essential step to quantitatively analyzing µCT datasets but is challenging to achieve on operando Li-metal battery datasets due to the low X-ray attenuation of the Li metal and the sheer size of the datasets. Herein, we report a computational approach, batteryNET, to train an Iterative Residual U-Net-based network to detect Li structures. The resulting semantic segmentation shows singular Li-related component changes, addressing diverse morphologies in the dataset. In addition, visualizations of the dead Li are provided, including calculations about the volume and effective thickness of electrodes, deposited Li, and redeposited Li. We also report discoveries about the spatial relationships between these components. The approach focuses on a method for analyzing battery performance, which brings insight that significantly benefits future Li-metal battery design and a semantic segmentation transferrable to other datasets.

25 ENERGY STORAGE↗
DOE OSTI2022

Cross-scale sensing of field-level crop residue cover: Integrating field photos, airborne hyperspectral imaging, and satellite data

Conservation tillage practices can bring benefits to agricultural sustainability. Accurate spatial and temporal resolved information of field-scale crop residue cover, which reflects tillage intensity, is highly valuable for evaluating the outcomes of government conservation programs and voluntary ecosystem service markets, as well as facilitating agroecosystem modeling to quantify cropland biogeochemical processes. Remote sensing has the potential to cost-effectively detect crop residue cover, however, existing regional-scale studies were limited by insufficient ground truth data, scale mismatch between coarse satellite pixels and ground data, and the lack of key spectral data for detecting crop residues. Therefore, this study developed an innovative cross-sensing framework to integrate proximal sensing, airborne hyperspectral imaging, and satellite Earth Observation through deep learning to quantify field-level crop residue cover fractions at the regional scale. Specifically, we have collected intensive ground orthographic photos and conducted airborne hyperspectral surveys at corn and soybean fields of Champaign and nearby counties in Illinois, the heartland of the U.S. Corn Belt. Through semi-automatic labeling aided by ResNet-50 and superpixel image segmentation, we obtained 6719 records of ground residue fractions. With these ground data, we developed the 1-dimensional convolution neural network (CNN) model using airborne hyperspectral reflectance, which has 0.5m spatial resolution and 3–5 nm spectral resolution from 400 to 2400 nm, to predict residue fractions. By applying the CNN model to airborne pixels, we augmented “ground truth” data of crop residues and further combined them with Harmonized Landsat and Sentinel-2 (HLS) satellite data to quantify regional residue fractions at 30 m resolution. Results show that airborne hyperspectral imagery with CNN can accurately detect residue fractions (R 2 = 0.82, relative RMSE = 11.73%) to effectively generate quasi “ground truth” data to support satellite upscaling to all fields. With independent ground data for testing, we found that the ground-airborne-satellite integrative framework achieved better predictions in estimating crop residue cover (R 2 = 0.67, relative RMSE = 17.53%) than the conventional ground-satellite upscaling (R 2 = 0.22, relative RMSE = 32.09%). Here we also found that the shortwave infrared wavelengths, particularly 2100–2300 nm, are vital for predicting crop residue cover. Sentinel-2 and Landsat-8 data have a comparable capability to track residue fractions due to similar shortwave infrared wavelengths. This study highlights the high accuracy of hyperspectral imaging to detect agroecosystem tillage management practices and the advantages of cross-scale sensing to cost-effectively integrate multi-source data to quantify field-level agroecosystem variables across scales.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Adaptive Data-Driven Deep-Learning Surrogate Model for Frontal Polymerization in Dicyclopentadiene

Frontal polymerization (FP) is a self-sustaining curing process that enables rapid and energy-efficient manufacturing of thermoset polymers and composites. Computational methods conventionally used to simulate the FP process are time-consuming, and repeating simulations are required for sensitivity analysis, uncertainty quantification, or optimization of the manufacturing process. Here, in this work, we develop an adaptive surrogate deep-learning model for FP of dicyclopentadiene (DCPD), which predicts the evolution of temperature and degree of cure orders of magnitude faster than the finite-element method (FEM). The adaptive algorithm provides a strategy to select training samples efficiently and save computational costs by reducing the redundancy of FEM-based training samples. The adaptive algorithm calculates the residual error of the FP governing equations using automatic differentiation of the deep neural network. A probability density function expressed in terms of the residual error is used to select training samples from the Sobol sequence space. The temperature and degree of cure evolution of each training sample are obtained by a 2D FEM simulation. The adaptive method is more efficient and has a better prediction accuracy than the random sampling method. With the well-trained surrogate neural network, the FP characteristics (front speed, shape, and temperature) can be extracted quickly from the predicted temperature and degree-of-cure fields.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Parallel molecular mechanisms for enzyme temperature adaptation

The mechanisms that underly the adaptation of enzyme activities and stabilities to temperature are fundamental to our understanding of molecular evolution and how enzymes work. Here, we investigate the molecular and evolutionary mechanisms of enzyme temperature adaption, combining deep mechanistic studies with comprehensive sequence analyses of thousands of enzymes. We show that temperature adaptation in ketosteroid isomerase (KSI) arises primarily from one residue change with limited, local epistasis, and we establish the underlying physical mechanisms. This residue change occurs in diverse KSI backgrounds, suggesting parallel adaptation to temperature. Furthermore, we identify residues associated with organismal growth temperature across 1005 diverse bacterial enzyme families, suggesting widespread parallel adaptation to temperature. We assess the residue properties, molecular interactions, and interaction networks that appear to underly temperature adaptation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Transient Unfolding and Long-Range Interactions in Viral BCL2 M11 Enable Binding to the BECN1 BH3 Domain

Viral BCL2 proteins (vBCL2s) help to sustain chronic infection of host proteins to inhibit apoptosis and autophagy. However, details of conformational changes in vBCL2s that enable binding to BH3Ds remain unknown. Using all-atom, multiple microsecond-long molecular dynamic simulations (totaling 17 μs) of the murine γ-herpesvirus 68 vBCL2 (M11), and statistical inference techniques, we show that regions of M11 transiently unfold and refold upon binding of the BH3D. Further, we show that this partial unfolding/refolding within M11 is mediated by a network of hydrophobic interactions, which includes residues that are 10 Å away from the BH3D binding cleft. We experimentally validate the role of these hydrophobic interactions by quantifying the impact of mutating these residues on binding to the Beclin1/BECN1 BH3D, demonstrating that these mutations adversely affect both protein stability and binding. To our knowledge, this is the first study detailing the binding-associated conformational changes and presence of long-range interactions within vBCL2s.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Chemical Reactor Network Modeling of Ammonia Rich-Quench-Lean Combustion Using a Partially Stirred Reactor Approach

Ammonia is a promising alternative fuel, but its use is challenging due to low flammability and high nitrogen oxide (NOx) emissions. Two-stage rich-quench-lean (RQL) combustion strategies have shown promise in reducing NOx emissions. This approach involves two stages: a rich stage that oxidizes part of the fuel and decomposes ammonia into hydrogen, and a lean stage that burns out the hydrogen and residual ammonia. Researchers used a chemical reactor network model to study the effects of heat loss and mixing on emissions performance. They found that heat loss and reduced mixing rates can lead to increased NOx emissions and N2O formation. The results will inform the development of optimized two-stage RQL combustors for ammonia, with a focus on minimizing NOx emissions and improving overall efficiency.

ammonia combustion↗
DOE OSTI2023

Neural Network-Based Variational Methods for Solving Quadratic Porous Medium Equations in High Dimensions

Here, in this paper, we propose and study neural network-based methods for solutions of high-dimensional quadratic porous medium equation (QPME). Three variational formulations of this nonlinear PDE are presented: a strong formulation and two weak formulations. For the strong formulation, the solution is directly parameterized with a neural network and optimized by minimizing the PDE residual. It can be proved that the convergence of the optimization problem guarantees the convergence of the approximate solution in the $L^1$ sense. The weak formulations are derived following (Brenier in Examples of hidden convexity in nonlinear PDEs, 2020) which characterizes the very weak solutions of QPME. Specifically speaking, the solutions are represented with intermediate functions who are parameterized with neural networks and are trained to optimize the weak formulations. Extensive numerical tests are further carried out to investigate the pros and cons of each formulation in low and high dimensions. This is an initial exploration made along the line of solving high-dimensional nonlinear PDEs with neural network-based methods, which we hope can provide some useful experience for future investigations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Knowledge-Informed Uncertainty-Aware Machine Learning for Time Series Forecasting of Dynamical Engineered Systems

The high complexity and multiscale nature of many engineered systems—such as those in nuclear power plants—make representing and forecasting their dynamic behavior challenging. Physics-based models can be overly complex and computationally intractable, whereas machine learning (ML) tools are often data-hungry and prone to unphysical solutions. This study proposes a knowledge-informed ML-aided hybrid residual modeling approach that offers accurate and efficient time series forecasting for the operation of dynamical engineered systems. Hybrid residual modeling entails a baseline solution from domain knowledge and known physics expressions about the system dynamics integrated with an ML model to capture undiscovered information from the mismatch (i.e., residuals) between true states from measurements and baseline-predicted outputs. This study further quantifies the ML model uncertainty to provide trustworthy solutions. Real-time operational data from thermal-hydraulic flow loops of the cryogenic moderator system in Oak Ridge National Laboratory’s Spallation Neutron Source facility were used to demonstrate the potential of knowledge-informed uncertainty-aware ML in real-world applications. The state variables of the cryogenic helium loop were modeled with (1) first principles–based system identification (sysID), (2) long short-term memory (LSTM) neural network, and (3) hybrid sysID (baseline) + LSTM (residual). The superior predictive capability of the sysID+LSTM model versus stand-alone sysID and LSTM is confirmed by average performance metrics and individual data points across different prediction horizons. By creating a robust representation of the underlying physical system, the widely applicable hybrid residual modeling approach will enable the future development of digital twins for performance prediction, prognostics, and operation control.

Zhao, Xingang↗
DOE OSTI2026

Improving ideal MHD equilibrium accuracy with physics-informed neural networks

We present a novel approach to compute three-dimensional magnetohydrodynamic equilibria with isotropic pressure profiles and nested surfaces by parametrizing Fourier modes with artificial neural networks (NNs). The full nonlinear global force residual of single equilibria across the volume in real space is then minimized with first order optimizers and compared to equilibria computed by conventional solvers. Already, we observe competitive computational cost to arrive at the same minimum residuals computable with existing codes. With increased computational cost, lower minima of the residual are computable with the NNs than with any other tested solver, establishing a new lower bound for the force residual. We use minimally complex NNs, and we expect significant improvements for solving not only single equilibria with NNs, but also for creating NN models valid over continuous distributions of equilibria.

ideal magnetohydrodynamics↗
DOE OSTI2025

An adaptive and stability-promoting layerwise training approach for sparse deep neural network architecture

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a new layer is added each time and trained independently by freezing parameters in the previous layers. We impose desirable structures on the DNN by employing manifold regularization, sparsity regularization, and physics-informed terms. We introduce a ε – δ – stability-promoting concept as a desirable property for a learning algorithm and show that employing manifold regularization yields a ε – δ stability-promoting algorithm. Further, we also derive the necessary conditions for the trainability of a newly added layer and investigate the training saturation problem. In the second stage of the algorithm (post-processing), a sequence of shallow networks is employed to extract information from the residual produced in the first stage, thereby improving the prediction accuracy. Numerical investigations on prototype regression and classification problems demonstrate that the proposed approach can outperform fully connected DNNs of the same size. Moreover, by equipping the physics-informed neural network (PINN) with the proposed adaptive architecture strategy to solve partial differential equations, we numerically show that adaptive PINNs not only are superior to standard PINNs but also produce interpretable hidden layers with provable stability. As a result, we also apply our architecture design strategy to solve inverse problems governed by elliptic partial differential equations.

42 ENGINEERING↗
DOE OSTI2021

Time–connectivity superposition and the gel/glass duality of weak colloidal gels

Colloidal gels result from the aggregation of Brownian particles suspended in a solvent. Gelation is induced by attractive interactions between individual particles that drive the formation of clusters, which in turn aggregate to form a space-spanning structure. We study this process in aluminosilicate colloidal gels through time-resolved structural and mechanical spectroscopy. Using the time–connectivity superposition principle a series of rapidly acquired linear viscoelastic spectra, measured throughout the gelation process by applying an exponential chirp protocol, are rescaled onto a universal master curve that spans over eight orders of magnitude in reduced frequency. This analysis reveals that the underlying relaxation time spectrum of the colloidal gel is symmetric in time with power-law tails characterized by a single exponent that is set at the gel point. The microstructural mechanical network has a dual character; at short length scales and fast times it appears glassy, whereas at longer times and larger scales it is gel-like. These results can be captured by a simple three-parameter constitutive model and demonstrate that the microstructure of a mature colloidal gel bears the residual skeleton of the original sample-spanning network that is created at the gel point. Our conclusions are confirmed by applying the same technique to another well-known colloidal gel system composed of attractive silica nanoparticles. The results illustrate the power of the time–connectivity superposition principle for this class of soft glassy materials and provide a compact description for the dichotomous viscoelastic nature of weak colloidal gels.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Hydrogen bond arrangements in (H 2 O) 20, 24, 28 clathrate hydrate cages: Optimization and many-body analysis

Here we provide a detailed study of hydrogen bonding arrangements, relative stability, residual entropy, and an analysis of the many-body effects in the (H 2 O) 20 (D-cage), (H 2 O) 24 (T-cage), and (H 2 O) 28 (H-cage) hollow cages making up structures I (sI) and II (sII) of clathrate hydrate lattices. Based on the enumeration of the possible hydrogen bonding networks for a fixed oxygen atom scaffold, the residual entropy (S 0 ) of these three gas phase cages was estimated at 0.754 82, 0.754 44, and 0.754 17 · Nk b , where N is the number of molecules and k b is Boltzmann’s constant. A previously identified descriptor of enhanced stability based on the relative arrangement and connectivity of nearest-neighbor fragments on the polyhedral water cluster [strong-weak-effective-bond model] also applies to the larger hollow cages. The three cages contain a maximum of 7, 9, and 11 such preferable arrangements of trans nearest dimer pairs with one “free” OH bond on the donor molecule (t1d dimers). The Many-Body Expansion (MBE) up to the 4-body suggests that the many-body terms vary nearly linearly with the cluster binding energy. Using a hierarchical approach of screening the relative stability of networks starting from optimizations with the TIP4P, TTM2.1-F, and MB-pol classical potentials, subsequently refining at more accurate levels of electronic structure theory (DFT and MP2), and finally correcting for zero-point energy, we were able to identify a group of four low-lying isomers of the (H 2 O) 24 T-cage, two of which are antisymmetric and the other two form a pair of antipode configurations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Enabling deeper learning on big data for materials informatics applications

Abstract The application of machine learning (ML) techniques in materials science has attracted significant attention in recent years, due to their impressive ability to efficiently extract data-driven linkages from various input materials representations to their output properties. While the application of traditional ML techniques has become quite ubiquitous, there have been limited applications of more advanced deep learning (DL) techniques, primarily because big materials datasets are relatively rare. Given the demonstrated potential and advantages of DL and the increasing availability of big materials datasets, it is attractive to go for deeper neural networks in a bid to boost model performance, but in reality, it leads to performance degradation due to the vanishing gradient problem. In this paper, we address the question of how to enable deeper learning for cases where big materials data is available. Here, we present a general deep learning framework based on Individual Residual learning (IRNet) composed of very deep neural networks that can work with any vector-based materials representation as input to build accurate property prediction models. We find that the proposed IRNet models can not only successfully alleviate the vanishing gradient problem and enable deeper learning, but also lead to significantly (up to 47%) better model accuracy as compared to plain deep neural networks and traditional ML techniques for a given input materials representation in the presence of big data.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Unusual zwitterionic catalytic site of SARS–CoV-2 main protease revealed by neutron crystallography

The main protease (3CL M pro ) from SARS–CoV-2, the etiological agent of COVID-19, is an essential enzyme for viral replication. 3CL M pro possesses an unusual catalytic dyad composed of Cys 145 and His 41 residues. A critical question in the field has been what the protonation states of the ionizable residues in the substrate-binding active-site cavity are; resolving this point would help understand the catalytic details of the enzyme and inform rational drug development against this pernicious virus. Here, we present the room-temperature neutron structure of 3CL M pro , which allowed direct determination of hydrogen atom positions and, hence, protonation states in the protease. We observe that the catalytic site natively adopts a zwitterionic reactive form in which Cys 145 is in the negatively charged thiolate state and His 41 is doubly protonated and positively charged, instead of the neutral unreactive state usually envisaged. The neutron structure also identified the protonation states, and thus electrical charges, of all other amino acid residues and revealed intricate hydrogen-bonding networks in the active-site cavity and at the dimer interface. The fine atomic details present in this structure were made possible by the unique scattering properties of the neutron, which is an ideal probe for locating hydrogen positions and experimentally determining protonation states at near-physiological temperature. Our observations provide critical information for structure-assisted and computational drug design, allowing precise tailoring of inhibitors to the enzyme's electrostatic environment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Simultaneous energy and mass calibration of large-radius jets with the ATLAS detector using a deep neural network

The energy and mass measurements of jets are crucial tasks for the Large Hadron Collider experiments. This paper presents a new calibration method to simultaneously calibrate these quantities for large-radius jets measured with the ATLAS detector using a deep neural network (DNN). To address the specificities of the calibration problem, special loss functions and training procedures are employed, and a complex network architecture, which includes feature annotation and residual connection layers, is used. The DNN-based calibration is compared to the standard numerical approach in an extensive series of tests. The DNN approach is found to perform significantly better in almost all of the tests and over most of the relevant kinematic phase space. In particular, it consistently improves the energy and mass resolutions, with a 30% better energy resolution obtained for transverse momenta $p$ T > $500$ GeV.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

A Multi-Objective Approach for Optimizing Edge-Based Resource Allocation Using TOPSIS

Existing approaches for allocating resources on edge environments are inefficient and lack the support of heterogeneous edge devices, which in turn fail to optimize the dependency on cloud infrastructures or datacenters. To this extent, we propose in this paper OpERA, a multi-layered edge-based resource allocation optimization framework that supports heterogeneous and seamless execution of offloadable tasks across edge, fog, and cloud computing layers and architectures. By capturing offloadable task requirements, OpERA is capable of identifying suitable resources within nearby edge or fog layers, thus optimizing the execution process. Throughout the paper, we present results which show the effectiveness of our proposed optimization strategy in terms of reducing costs, minimizing energy consumption, and promoting other residual gains in terms of processing computations, network bandwidth, and task execution time. We also demonstrate that by optimizing resource allocation in computation offloading, it is then possible to increase the likelihood of successful task offloading, particularly for computationally intensive tasks that are becoming integral as part of many IoT applications such robotic surgery, autonomous driving, smart city monitoring device grids, and deep learning tasks. The evaluation of our OpERA optimization algorithm reveals that the TOPSIS MCDM technique effectively identifies optimal compute resources for processing offloadable tasks, with a 96% success rate. Moreover, the results from our experiments with a diverse range of use cases show that our OpERA optimization strategy can effectively reduce energy consumption by up to 88%, and operational costs by 76%, by identifying relevant compute resources.

97 MATHEMATICS AND COMPUTING↗