Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Layer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.

42 ENGINEERING↗
DOE OSTI2023

Distributed fiber-optic sensor network for sensing the corrosion onset and quantification

Materials, methods of making, and methods of sensing liquid droplets with high spatial resolution as a signature of the on-set of corrosion using a hierarchical sensor network A hierarchical sensor network for sensing liquid droplets with high spatial resolution as a signature of the on-set of corrosion, including an interrogation system; and an intermediate sensor array layer in communication with the interrogation system. The network includes an interrogation system and an intermediate sensor array layer in communication with the interrogation system.

Ohodnicki, Paul R.↗
DOE OSTI2021

Impact of Blockchain Delay on Grid-Tied Solar Inverter Performance

This paper investigates the impact of the delay resulting from a blockchain, a promising security measure, for a hierarchical control system of inverters connected to the grid. The blockchain communication network is designed at the secondary control layer for resilience against cyberattacks. To represent the latency in the communication channel, a model is developed based on the complexity of the blockchain framework. Taking this model into account, this work evaluates the plant’s performance subject to communication delays, introduced by the blockchain, among the hierarchical control agents. In addition, this article considers an optimal model-based control strategy that performs the system’s internal control loop. The work shows that the blockchain’s delay size influences the convergence of the power supplied by the inverter to the reference at the point of common coupling. In the results section, real-time simulations on OPAL-RT are performed to test the resilience of two parallel inverters with increasing blockchain complexity.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2023

Reinforcement Learning for Intentional Islanding in Resilient Power Transmission Systems

Intentional islanding is the process of identifying and deliberately decomposing the transmission network to form self-sustained islands from an endangered network during disruptions to improve resilience and security. Most existing intentional islanding models are offline resilience decision tools and hence do not provide outage responses in a timely manner. In this paper, a reinforcement learning (RL) based model for intentional islanding is developed, which offers real-time switching control, online deployability, and adaptability to varying system conditions. The intentional islanding process is formulated as a Markov decision process, where the optimal transmission switching policy is learned using the RL approach. The control policy is learned over an environment that encompasses a Power System Simulator for Engineering (PSS/E) model of the transmission network, facilitated by an interface to the standard openAI Gym framework. The proposed RL-based methodology aims to form stable and self-sustainable islands by ensuring voltage stability while reducing the power mismatch in the formed islands. A proximal policy optimization algorithm is designed, which is suitable for controlling the on/off status of the switches with multi-layer perceptron as value and actor networks. The effectiveness of the proposed framework in the self-recovery of the grid by island formation is applied on the modified IEEE 39-bus test network and validated by dynamic simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2024

Nonlinear encoding in diffractive information processing using linear optical materials

Nonlinear encoding of optical information can be achieved using various forms of data representation. Here, we analyze the performances of different nonlinear information encoding strategies that can be employed in diffractive optical processors based on linear materials and shed light on their utility and performance gaps compared to the state-of-the-art digital deep neural networks. For a comprehensive evaluation, we used different datasets to compare the statistical inference performance of simpler-to-implement nonlinear encoding strategies that involve, e.g., phase encoding, against data repetition-based nonlinear encoding strategies. We show that data repetition within a diffractive volume (e.g., through an optical cavity or cascaded introduction of the input data) causes the loss of the universal linear transformation capability of a diffractive optical processor. Therefore, data repetition-based diffractive blocks cannot provide optical analogs to fully connected or convolutional layers commonly employed in digital neural networks. However, they can still be effectively trained for specific inference tasks and achieve enhanced accuracy, benefiting from the nonlinear encoding of the input information. Our results also reveal that phase encoding of input information without data repetition provides a simpler nonlinear encoding strategy with comparable statistical inference accuracy to data repetition-based diffractive processors. Our analyses and conclusions would be of broad interest to explore the push-pull relationship between linear material-based diffractive optical systems and nonlinear encoding strategies in visual information processors.

42 ENGINEERING↗
DOE OSTI2021

Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics

Graph neural networks have been shown to achieve excellent performance for several crucial tasks in particle physics, such as charged particle tracking, jet tagging, and clustering. An important domain for the application of these networks is the FGPA-based first layer of real-time data filtering at the CERN Large Hadron Collider, which has strict latency and resource constraints. We discuss how to design distance-weighted graph networks that can be executed with a latency of less than one μs on an FPGA. To do so, we consider a representative task associated to particle reconstruction and identification in a next-generation calorimeter operating at a particle collider. We use a graph network architecture developed for such purposes, and apply additional simplifications to match the computing constraints of Level-1 trigger systems, including weight quantization. Using the hls4ml library, we convert the compressed models into firmware to be implemented on an FPGA. Performance of the synthesized models is presented both in terms of inference accuracy and resource usage.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Improved Subseasonal Forecasting of Extreme Polar Vortices Using Machine Learning

Our research was focused on forecasting the position and shape of the winter stratospheric polar vortex at a subseasonal timescale of 15 days in advance. To achieve this, we employed both statistical and neural network machine learning techniques. The analysis was performed on 42 winter seasons of reanalysis data provided by NASA giving us a total of 6,342 days of data. The state of the polar vortex for determined by using geometric moments to calculate the centroid latitude and the aspect ratio of an ellipse fit onto the vortex. Timeseries for thirty additional precursors were calculated to help improve the predictive capabilities of the algorithm. Feature importance of these precursors was performed using random forest to measure the predictive importance and the ideal number of precursors. Then, using the precursors identified as important, various statistical methods were tested for predictive accuracy with random forest and nearest neighbor performing the best. An echo state network, a type of recurrent neural network that features sparsely connected hidden layer and a reduced number of trainable parameters that allows for rapid training and testing, was also implemented for the forecasting problem. Hyperparameter tuning was performed for each methods using a subset of the training data. The algorithms were trained and tuned on the first 41 years of data, then tested for accuracy on the final year. In general, the centroid latitude of the polar vortex proved easier to predict than the aspect ratio across all algorithms. Random forest outperformed other statistical forecasting algorithms overall but struggled to predict extreme values. Forecasting from echo state network suggested a strong predictive capability past 15 days, but further work is required to fully realize the potential of recurrent neural network approaches.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Multilayered Network Models for Security: Enhancing System Security Engineering with Orchestration

Security engineering approaches can often focus on a particular domain—physical security, cyber security, or personnel security, for example. Yet, security systems engineering consistently faces challenges requiring socio-technical solutions to address evolving and dynamic complexity. While some drivers of this complexity stem from complex risk environments, innovative adversaries, and disruptive technologies, other drivers are endogenous and emerge from the interactions across security engineering approaches. In response, INCOSE's Systems Security Working Group identified the need to better coordinate “disparate security solutions [that] operate independently” as one of eleven key concepts in their IS21 FuSE Security Roadmap. From this perspective, this need for “security orchestration” aligns with the perspective that security is a property that emerges from interactions within complex systems. Current efforts at Sandia National Laboratories are developing a systems security engineering approach that describes high consequence facility (HCF) security as a multidomain set of interacting layers. The result is a multilayered network (MLN)-based approach that captures the interactions between infrastructure, physical components, digital components, and humans in nuclear security systems. This article will summarize the MLN-based approach to HCF security and describe two preliminary results demonstrating potential benefits from incorporating interactions across disparate security solutions. Here, leveraging the logical structure of networks, this MLN model-based approach provides an example of how security orchestration provides enhanced systems security engineering solutions.

42 ENGINEERING↗
DOE OSTI2021

ResNet and CycleGAN for pulse shape discrimination of He-4 detector pulses: Recovering pulses conventional algorithms fail to label unanimously

Pulse shape discrimination (PSD) capable detectors, such as He-4, that respond to neutron and gamma-ray 7 interactions have a threshold deposited energy value below which n/γ discrimination vanishes when using 8 conventional PSD algorithms. Recent attempts in applying supervised learning based artificial neural 9 networks for PSD use the pulses in the separated regions to train the networks so they can be used to classify 10 another set of separated pulses. In doing so, pulses previously indistinguishable are not recovered for 11 classification, which would have increased the number of neutron and gamma-ray pulses that could be used 12 for further analysis. Assuming the reason why conventional PSD algorithms have unseparated regions is 13 because the parameter space of the algorithms fail to capture the intrinsic (but subtle) distinguishing 14 behavior of some of the neutron and gamma-ray pulses, a cycle-consistent generative adversarial network 15 (CycleGAN) was trained to amplify those differences and extract well separated neutron and gamma-ray 16 clusters. Results show that, once the network is trained with pulses from separated and unseparated regions, 17 it was able to transform the pulses in the unseparated region to improve the PSD. Subsequent n/γ 18 classification was performed using deep residual network (ResNet) that takes pulses with 512 data points 19 as an input. Two different ResNets were explored – simple ResNet and modified ResNet which takes 20 segmented pulse inputs in the first layer and the corresponding time axis values in the last hidden layer. 21 The later approach enables the network to extract time correlated pulse features to enhance its ability to 22 capture the pulse behaviors relevant for PSD. Although it achieves slightly lower accuracy, 99.41% versus 23 99.89%, based on simply counting the number of correct n/γ labels assigned, compared to the simple 24 ResNet, the modified ResNets architecture was able to decreases the cross-entropy loss function by half, 25 which implies that the correct n/γ labels assigned are less likely to be accidental. PSD parameter 26 distributions based on n/γ classification by ResNet before and after transforming unseparated pulses using 27 CycleGAN show that by enhancing the separation between neutrons and gamma-rays, the transformation 28 helps improve the performance of classifier networks that are trained using labeled dataset. The 29 enhancement of neutron and gamma-ray separation by the CycleGAN increased the PSD figure of merit 30 (FOM) by up to 70% in some regions. Here, the results show that, if a given detector achieves clear separation 31 between neutron and gamma-ray pulses in any energy region, such neural network approaches can help 32 lower the energy threshold for the separation and increasing the number of neutron and gamma-ray pulses 33 that can be used for further analysis.

4He↗
DOE OSTI2020

Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks

Here we propose two approaches of locally adaptive activation functions namely, layer-wise and neuron-wise locally adaptive activation functions, which improve the performance of deep and physics-informed neural networks. The local adaptation of activation function is achieved by introducing a scalable parameter in each layer (layer-wise) and for every neuron (neuron-wise) separately, and then optimizing it using a variant of stochastic gradient descent algorithm. In order to further increase the training speed, an activation slope-based slope recovery term is added in the loss function, which further accelerates convergence, thereby reducing the training cost. On the theoretical side, we prove that in the proposed method, the gradient descent algorithms are not attracted to sub-optimal critical points or local minima under practical conditions on the initialization and learning rate, and that the gradient dynamics of the proposed method is not achievable by base methods with any (adaptive) learning rates. We further show that the adaptive activation methods accelerate the convergence by implicitly multiplying conditioning matrices to the gradient of the base method without any explicit computation of the conditioning matrix and the matrix–vector product. The different adaptive activation functions are shown to induce different implicit conditioning matrices. Furthermore, the proposed methods with the slope recovery are shown to accelerate the training process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Estimating Internal Stress of an Alteration Layer Formed on Corroded Boroaluminosilicate Glass through Spectroscopic Ellipsometry Analysis

Aqueous corrosion of glass may result in the formation of an alteration layer in the glass surface of which chemical composition and network structure are different from those of the bulk glass. Since corrosion occurs far below the glass-transition temperature, the alteration layer cannot fully relax to the new structure with the lowest possible energy. Molecular dynamics simulations suggested that such a network will contain highly strained chemical bonds, which can be manifested as a stress in the alteration layer. Common techniques to measure stress in thin films or surface layers were found inadequate for thick monolithic glass samples corroded in water. Here, we explored the use of spectroscopic ellipsometry to test the presence of internal stress in the alteration layer formed by aqueous corrosion of glass. Furthermore, a procedure for analyses of spectroscopic ellipsometry data to determine birefringence in the alteration layer was developed. Findings with the established fitting procedure suggested that a stress builds up in the corroded surface layer of a boroaluminosilicate glass if there is a change in relative humidity, pH, or electrolyte concentration of the environment to which the glass surface is exposed. A similar process may occur in other types of glass, and it may affect the surface properties of corroded glass objects.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

On Transfer Learning Of Neural Networks Using Bi-Fidelity Data For Uncertainty Propagation

Due to their high degree of expressiveness, neural networks have recently been used as surrogate models for mapping inputs of an engineering system to outputs of interest. Once trained, neural networks are computationally inexpensive to evaluate and remove the need for repeated evaluations of computationally expensive models in uncertainty quantification applications. However, given the highly parameterized construction of neural networks, especially deep neural networks, accurate training often requires large amounts of simulation data that may not be available in the case of computationally expensive systems. In this paper, to alleviate this issue for uncertainty propagation, we explore the application of transfer learning techniques using training data generated from both high- and low-fidelity models. We explore two strategies for coupling these two datasets during the training procedure, namely, the standard transfer learning and the bi-fidelity-weighted learning. In the former approach, a neural network model mapping the inputs to the outputs of interest is trained based on the low-fidelity data. The high-fidelity data are then used to adapt the parameters of the upper layer(s) of the low-fidelity network, or train a simpler neural network to map the output of the low-fidelity network to that of the high-fidelity model. In the latter approach, the entire low-fidelity network parameters are updated using data generated via a Gaussian process model trained with a small high-fidelity dataset. The parameter updates are performed via a variant of stochastic gradient descent with learning rates given by the Gaussian process model. Using three numerical examples, we illustrate the utility of these bi-fidelity transfer learning methods where we focus on accuracy improvement achieved by transfer learning over standard training approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

3D Carbon Coating Enabled High‐capacity and Stable Micro‐sized Silicon Suboxide‐graphite Blended Anodes for Practical Lithium‐ion Batteries

Abstract Silicon oxide (SiO x ) is a promising anode candidate of lithium‐ion batteries (LIBs) owing to its extremely high specific capacity. However, the low initial Coulombic efficiency (ICE) and rapid capacity degradation of SiO x , triggered by the enormous volume variation upon repeated (de)lithiation, gravely hinder its practical use. Herein, two mass‐produced micro‐sized SiO x @C composites with obviously different morphologies for commercial LIBs are reported. Particularly, the SiO x ‐graphite blended anode (SiO x @3D‐G‐Gr) based on SiO x wrapped by three‐dimensional (3D) carbon layers (SiO x @3D‐G) exhibits a capacity of 519 mAh g −1 , an ICE of 90.0 % and a capacity retention of 83.4 % at 0.2 C over 100 cycles. which is far exceeding its counterpart SiO x @C‐H‐Gr (65.7 %). The obtained impressive properties of SiO x @3D‐G originate from the critical contribution of 3D carbon layers, which serves as the effective stress buffer and protective layer as well as the strong networks for electron/Li + transport. Accordingly, the full‐cell based on SiO x @3D‐G‐Gr anode and commercial LiCoO 2 cathode delivers a capacity of 803 mAh and an excellent capacity retention of 95.6 % (616 mAh, 96.6 % for graphite, respectively) at 1 C over 100 cycles with a stabilized CE of nearly 100 %. The micro‐sized SiO x @3D‐G showing a promising prospect in the commercial‐grade anodes in LIBs.

Electrochemistry↗
DOE OSTI2022

Registration and fusion of large-scale melt pool temperature and morphology monitoring data demonstrated for surface topography prediction in LPBF

In-situ monitoring technologies for laser powder bed fusion (LPBF) additive manufacturing often face one key challenge, extracting the ultrafast melt pool (MP) signatures for understanding the localized part properties. Further, the spatial information of each monitored MP signature is essential for correlating the MP – part property. This spatial information is often unavailable especially from commercial LPBF printers. Many MP monitoring methods have been reported and utilized. However, very few of these have the MP’s spatial information. To overcome this challenge, in this work we report a method for spatially registering the key MP signatures (MP intensity, temperature, and area) to the monitored print parts. The MP signatures are obtained from our coaxial high-speed single-camera based two-wavelength imaging pyrometry (STWIP) system and the MP spatial information is obtained from an off-axis camera system. A machine learning aided image analysis method is employed to retrieve the spatial distribution of MPs within the corresponding part’s coordinates system. Then, the MP signature maps (MPSMs) are reconstructed by mapping the STWIP measured MP signatures to the registered MP coordinates. Further, a long short-term memory (LSTM) neural network is developed for estimating the layer surface topography from the registered MPSMs. The obtained results indicate that the layer surface topography can be more accurately estimated by using MP temperature signature rather than MP intensity and/or area signatures as in common practice. Finally, our developed methods for MP monitoring, registration, and MP-surface topography prediction offer advanced capabilities for the online detection of process anomalies and part defects.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Microstructural Engineering of Cu-Rich Nanoprecipitate formation in NiCoFeCrCu0.12 High-Entropy Alloy via Severe Plastic Deformation for Enhanced Irradiation Tolerance

This study demonstrates a defect-engineering approach for controlling Cu-rich precipitates in FeNiCrCoCu0.2 high-entropy alloys (Cu-HEAs), delivering a novel pathway for next-generation nuclear reactor materials with superior irradiation resistance. This work establishes that severe plastic deformation (SPD) processing via Shear Assisted Processing and Extrusion (ShAPE) and Friction Stir Layer Deposition (FSLD) creates dense dislocation networks and subgrain boundaries that fundamentally alter precipitation behavior under identical thermal treatments. Atom probe tomography (APT) indicates that SPD produces a metastable, atomically homogeneous solid solution that, upon moderate heat treatment (500°C/10 hour), develops remarkedly stronger Cu clustering than the as-cast counterpart. High-temperature exposure (800°C/100 h) produces near-pure Cu precipitates (~90 at% Cu) with significantly enhanced defect-sink efficacy in SPD-processed alloys: precipitate sizes of 50-60 nm and number densities of 2.7-3.8 × 10¹7 m?³, compared to 89 nm and 0.44 × 10¹7 m?³ in as-cast materials. Collectively, the findings establish defect-mediated precipitation control as a scalable, high-impact route to tailor sink density and distribution in HEAs, enabling microstructures optimized for irradiation tolerance and mechanical robustness in nuclear reactor environments.

Meher, Subhashish↗
DOE OSTI2023

Discovery and construction of surface kagome electronic states induced by p-d electronic hybridization in Co3Sn2S2

Abstract Kagome-lattice materials possess attractive properties for quantum computing applications, but their synthesis remains challenging. Herein, based on the compelling identification of the two cleavable surfaces of Co 3 Sn 2 S 2 , we show surface kagome electronic states (SKESs) on a Sn-terminated triangular Co 3 Sn 2 S 2 surface. Such SKESs are imprinted by vertical p-d electronic hybridization between the surface Sn (subsurface S) atoms and the buried Co kagome-lattice network in the Co 3 Sn layer under the surface. Owing to the subsequent lateral hybridization of the Sn and S atoms in a corner-sharing manner, the kagome symmetry and topological electronic properties of the Co 3 Sn layer is proximate to the Sn surface. The SKESs and both hybridizations were verified via qPlus non-contact atomic force microscopy (nc-AFM) and density functional theory calculations. The construction of SKESs with tunable properties can be achieved by the atomic substitution of surface Sn (subsurface S) with other group III-V elements (Se or Te), which was demonstrated theoretically. This work exhibits the powerful capacity of nc-AFM in characterizing localized topological states and reveals the strategy for synthesis of large-area transition-metal-based kagome-lattice materials using conventional surface deposition techniques.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗