Search NASA⌕ Search

SEARCH · Search NASA

Results for “hybrid learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

When does global attention help: a unified empirical study on atomistic graph learning

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable the modeling of complex physics. While most recent GNNs combine more traditional message passing neural networks (MPNNs) layers to model short-range interactions with more advanced graph transformers (GTs) with global attention mechanisms to model long-range interactions, it is still unclear when global attention mechanisms provide real benefits over well-tuned MPNN layers due to inconsistent implementations, features, or hyperparameter tuning. We introduce the first unified, reproducible benchmarking framework–built on HydraGNN–that enables seamless switching among four controlled model classes: MPNN, MPNN with chemistry/topology encoders, GPS-style hybrids of MPNN with global attention, and fully fused localglobal models with encoders. Using seven diverse open-source datasets for benchmarking across regression and classification tasks, we systematically isolate the contributions of message passing, global attention, and encoder-based feature augmentation. Our study shows that encoder-augmented MPNNs form a robust baseline, while fused localglobal models yield the clearest benefits for properties governed by long-range interaction effects. We further quantify the accuracycompute trade-offs of attention, reporting its overhead in memory. Together, these results establish the first controlled evaluation of global attention in atomistic graph learning and provide a reproducible testbed for future model development.

Equivariant graph neural networks↗
DOE OSTI2022

An LSTM Deep Learning Network for ¿Background Radiation Prediction

Determination of appropriate background radiation is important in any measurement application. Environmental radiation monitors and monitors used to assess dose to individuals outside of controlled areas are particularly susceptible to changes in readings due to fluctuations in the environmental conditions. These fluctuations (e.g. radon progeny concentrations) lead to changes in the detector response in the actual radiation environment, and they need to be taken into account when extracting the net operational doses. Work has been ongoing to apply advances in Deep Learning and Artificial Intelligence to account for changes in detector responses based on environmental parameters; in particular, a Long-Short Term Memory (LSTM) Deep Learning architecture has been utilized to incorporate time-series data into a prediction model. In this work, we present the current status of the project to predict radiation measurements based on meteorological conditions and air packet trajectories extracted using the National Oceanic and Atmospheric Administration's (NOAA) Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT4) model.

Degtiarenko, Pavel↗
DOE OSTI2024

Causality Extraction from Nuclear Licensee Event Reports Using a Hybrid Framework

In this paper, we proposed a hybrid framework for causality detection and extraction in LER documents. The main contributions are summarized below. We 1) built an LER corpus with 20,129 text samples for causality analysis, 2) developed an interactive tool was developed for labeling cause-effect pairs, 3) built a deep learning-based approach for causal relation detection, and 4) built a knowledge-based cause-effect extraction approach.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Evolution of Programmatic Asset Lifecycle Planning at MESA

Early on in 2018 Sandia recognized the Microsystems Engineering, Science and Applications (MESA) Programmatic Asset Lifecycle Planning capability to be unpredictable, inconsistent, reactive, and unable to provide strong linkage to the sponsor's needs. The impetus for this report is to share learnings from MESA's journey towards maturing this capability. This report describes re-building the foundational elements of MESA's Programmatic Asset Lifecycle Planning capability using a risk-based, Multi-Criteria Decision Analysis (MCDA) approach. To begin, MESA's decades-old Piano Chart + Ad Hoc Hybrid Methodology is described with a narrative of its strengths and weaknesses. Then its replacement, the MCDA /Analytical Hierarchy Process, is introduced with a discussion of its strengths and weaknesses. To generate a realistic Programmatic Asset Lifecycle Planning budget outlook, MESA used its rolling 20-year Extended Life Program Plan (MELPP) as a baseline. The new MCDA risk-based prioritization methodology implements DOE/NNSA guidelines for prioritization of DOE activities and provides a reliable, structured framework for combining expert judgement and stakeholder preferences according to an established scientific technique. An in-house Hybrid Decision Support System (HDSS) software application was developed to facilitate production of several key deliverables. The application enables analysis of the prioritization decisions with charts to display and provide linkage of MESA's funding requests to the stakeholders' priorities, strategic objectives, nuclear deterrence programs, MESA priorities, and much more.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Physics-Informed Neural Network Solution of Point Kinetics Equations for a Nuclear Reactor Digital Twin

A digital twin (DT) for nuclear reactor monitoring can be implemented using either a differential equations-based physics model or a data-driven machine learning model. The challenge of a physics-model-based DT consists of achieving sufficient model fidelity to represent a complex experimental system, whereas the challenge of a data-driven DT consists of extensive training requirements and a potential lack of predictive ability. We investigate the performance of a hybrid approach, which is based on physics-informed neural networks (PINNs) that encode fundamental physical laws into the loss function of the neural network. We develop a PINN model to solve the point kinetic equations (PKEs), which are time-dependent, stiff, nonlinear, ordinary differential equations that constitute a nuclear reactor reduced-order model under the approximation of ignoring spatial dependence of the neutron flux. The PINN model solution of PKEs is developed to monitor the start-up transient of Purdue University Reactor Number One (PUR-1) using experimental parameters for the reactivity feedback schedule and the neutron source. The results demonstrate strong agreement between the PINN solution and finite difference numerical solution of PKEs. We investigate PINNs performance in both data interpolation and extrapolation. For the test cases considered, the extrapolation errors are comparable to those of interpolation predictions. Extrapolation accuracy decreases with increasing time interval.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2019

Integrating Hybrid-Clustering and Localized Regression for Time Synchronization of a Hierarchical Underwater Acoustic Sensor Array

Time synchronization is a critical requirement for the application of underwater acoustic sensor network (UWSN). Although a number of time synchronization protocols have been proposed for UWSN, none of them can be directly applied to autonomous acoustic receivers due to lack of hardware platform to communicate with each other. In this paper, we propose a machine learning-based time synchronization framework for autonomous receiver arrays, using the Juvenile Salmon Acoustic Telemetry System as a case study. The proposed framework consists of array partition and time synchronization. Using detections of receiver attached beacons as input, this framework synchronizes all receiver clocks to a root receiver clock. The framework has been successfully used in a field study at Trevallyn Dam forebay in Tasmania, Australia.

Fu, Tao↗
DOE OSTI2026

A Comprehensive Comparative Study of Active Learning Schemes for Nanophotonics Design

We present a benchmarking study of active learning (AL) schemes for designing planar multilayer nanophotonic metamaterials, where the design tasks are formulated as binary optimization problems. Different surrogate models, including factorization machine (FM), Gaussian process regression (GPR), and convolutional neural network (CNN), combined with different optimization methods, including exhaustive enumeration, discrete particle swarm optimization (DPSO), quantum annealing (QA), hybrid QA, and simulated annealing are studied. The benchmark cases investigated range from small problems with short binary lengths (N = 25) to large problems with N up to 100, focusing on the design of two classes of photonic structures, including antireflective coatings for the long-wavelength infrared region and transparent radiative coolers. For small problems, CNN coupled with DPSO in AL achieves the best performance. As N increases, FM with QA outperforms GPR and CNN. For FM-based AL, hybrid QA yields the best optimization results, particularly in high-dimensional cases (N = 100). These results demonstrate that the optimization method can significantly affect in AL performance as N increases, and that QA-based optimization can provide practical routes for mitigating the optimization bottleneck in high-dimensional problems.

Jung, Serang [Kyung Hee University, Korea]↗
DOE OSTI2026

Recurrent convolutional neural networks for modeling nonadiabatic dynamics of quantum-classical systems

Recurrent neural networks (RNNs) have recently been extensively applied to model the time evolution in fluid dynamics, weather predictions, and even chaotic systems due to their ability to capture temporal dependencies and sequential patterns in data. Here we present an RNN model based on convolutional neural networks for modeling the nonlinear nonadiabatic dynamics of hybrid quantum-classical systems. The dynamical evolution of the hybrid systems is governed by equations of motion for classical degrees of freedom and von Neumann equation for electrons. The Physics-Aware Recurrent Convolution (PARC) neural network structure incorporates a differentiator-integrator architecture that inductively models the spatiotemporal dynamics of generic physical systems. Here, we apply our RNN approach to learn the space-time evolution of a one-dimensional semiclassical Holstein model after an interaction quench. For shallow quenches (small changes in electron-lattice coupling), the deterministic dynamics can be accurately captured using a single-CNN-based recurrent network. In contrast, deep quenches induce chaotic evolution, making long-term trajectory prediction significantly more challenging. Nonetheless, we demonstrate that the PARC-CNN architecture can effectively learn the statistical climate of the Holstein model under deep-quench conditions.

Holstein model↗
DOE OSTI2020

Enabling Highly Efficient Capsule Networks Processing Through A PIM-Based Architecture Design

In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classication is found to be easily misled by increasingly complex image features due to the usage of pooling operations, hence unable to preserve accurate position and pose information of the objects. To address this challenge, a novel neural network structure called Capsule Network has been proposed, which introduces equivariance through capsules to signicantly enhance the learning ability for image segmentation and object detection. Due to its requirement of performing a high volume of matrix operations, CapsNets have been generally accelerated on modern GPU platforms that provide highly optimized software library for common deep learning tasks. However, based on our performance characterization on modern GPUs, CapsNets exhibit low effciency due to the special program and execution features of their routing procedure, including massive unshareable intermediate variables and intensive syn- chronizations, which are very dicult to optimize at software level. To address these challenges, we propose a hybrid computing architecture design named PIM-CapsNet. It preserves GPU's on-chip computing capability for accelerating CNN types of layers in CapsNet, while pipelining with an off-chip in-memory acceleration solution that effectively tackles routing procedure's ineffciency by leveraging the processing-in-memory capability of today's 3D stacked memory. Using routing procedure's inherent parallellization feature, our design enables hierarchical improvements on CapsNet inference effciency through minimizing data movement and maximizing parallel processing in memory. Evaluation results demonstrate that our proposed design can achieve substantial improvement on both performance and energy savings for CapsNet inference, with almost zero accuracy loss. The results also suggest good performance scalability in optimizing the routing procedure with increasing network size.

Zhang, Xingyao↗
DOE OSTI2026

Investigation of the Effect of Framework Flexibility on Adsorption in SIFSIX-3-Cu using a Machine-Learned Force Field

Metal-organic frameworks (MOFs) are a promising class of adsorbents. The performance of MOF sorbents relies on high selectivity and low regeneration energy. This work focuses on the use of machine learned force fields (MLFFs) to model adsorption in a flexible MOF, SIFSIX-3-Cu. A DeePMD-based MLFF was trained to reproduce DFT (PBE+D3) energies, forces, and stresses, using an iterative sampling scheme combining sampling based on molecular dynamics, Monte Carlo, and geometry optimization to capture both attractive and repulsive regions of the potential energy surface. Flexibility of the MOF was explicitly included in this model. Hybrid Monte Carlo/molecular dynamics (MC/MD) simulations using the MLFF predicted adsorption isotherms in good agreement with experimental data for a range of pressures (40 Pa – 104 Pa) in contrast to rigid models, which overpredict CO2 adsorption at low pressures. The improvement was the result of a description of the variability of fluorine-fluorine diagonal distances at adsorption sites. This detailed description of flexibility afforded by the MLFF resulted in more accurate predictions adsorption isotherms when compared to the experimentally measured values. These results underscore the importance of including framework flexibility when modeling adsorption phenomena in MOFs, particularly for low pressure applications and provide a robust procedure for training MLFF models for MOFs.

Atomistic Simulation↗
DOE OSTI2021

MADE3D: Enabling the next generation of high-torque density wind generators by additive design and 3D printing

Direct-drive wind turbine generators are increasing in popularity, thanks to recent project developments—especially offshore, where reliability and efficiency are major cost drivers. Yet, high capital costs are forcing many original equipment manufacturers to consider lightweight, high-torque density generators for next-generation multi-megawatt turbines that may be difficult to realize by traditional design or manufacturing methods. In this study, we present a new design framework enabled by advanced machine learning and multimaterial additive manufacturing to perform a magnetic topology optimization that maximizes the torque per rotor active mass for a 15-megawatt direct-drive permanent magnet wind generator. A comparison of the proposed approach against conventional topology optimization demonstrated a significant increase in computational efficiency and accuracy in performance predictions. Results using single and multimaterial compositions for rotor core and magnets identify a wider choice of 3D printable designs for a given specification. A hybrid combination of sintered and dysprosium-free polymer-bonded magnets shows good potential for torque performance by saving material costs up to 8.75%. More than 30% improvement in rotor torque densities is identified which can marginally improve the overall generator torque density. With the rapid evolution of multipowder deposition technolgies, this study can greatly inspire a new paradigm for design-driven manufacturing with novel material compositions and lightweight, low-cost, high-strength multimaterial geometries that were previously unexplored for direct-drive generators.

17 WIND ENERGY↗
DOE OSTI2023

Ultrafast radiographic imaging and tracking: An overview of instruments, methods, data, and applications

Ultrafast radiographic imaging and tracking (U-RadIT) use state-of-the-art ionizing particle and light sources to experimentally study sub-nanosecond transients or dynamic processes in physics, chemistry, biology, geology, materials science and other fields. These processes are fundamental to modern technologies and applications, such as nuclear fusion energy, advanced manufacturing, communication, and green transportation, which often involve one mole or more atoms and elementary particles, and thus are challenging to compute by using the first principles of quantum physics or other forward models. One of the central problems in U-RadIT is to optimize information yield through, e.g. high-luminosity X-ray and particle sources, efficient imaging and tracking detectors, novel methods to collect data, and large-bandwidth online and offline data processing, regulated by the underlying physics, statistics, and computing power. We review and highlight recent progress in: (a.) Detectors such as high-speed complementary metal-oxide semiconductor (CMOS) cameras, hybrid pixelated array detectors integrated with Timepix4 and other application-specific integrated circuits (ASICs), and digital photon detectors; (b.) U-RadIT modalities such as dynamic phase contrast imaging, dynamic diffractive imaging, and four-dimensional (4D) particle tracking; (c.) U-RadIT data and algorithms such as neural networks and machine learning, and (d.) Applications in ultrafast dynamic material science using XFELs, synchrotrons and laser-driven sources. Hardware-centric approaches to U-RadIT optimization are constrained by detector material properties, low signal-to-noise ratio, high cost and long development cycles of critical hardware components such as ASICs. Interpretation of experimental data, including comparisons with forward models, is frequently hindered by sparse measurements, model and measurement uncertainties, and noise. Alternatively, U-RadIT make increasing use of data science and machine learning algorithms, including experimental implementations of compressed sensing. Machine learning and artificial intelligence approaches, refined by physics and materials information, may also contribute significantly to data interpretation, uncertainty quantification and U-RadIT optimization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

High-throughput predictions of metal–organic framework electronic properties: theoretical challenges, graph neural networks, and data exploration

Abstract With the goal of accelerating the design and discovery of metal–organic frameworks (MOFs) for electronic, optoelectronic, and energy storage applications, we present a dataset of predicted electronic structure properties for thousands of MOFs carried out using multiple density functional approximations. Compared to more accurate hybrid functionals, we find that the widely used PBE generalized gradient approximation (GGA) functional severely underpredicts MOF band gaps in a largely systematic manner for semi-conductors and insulators without magnetic character. However, an even larger and less predictable disparity in the band gap prediction is present for MOFs with open-shell 3 d transition metal cations. With regards to partial atomic charges, we find that different density functional approximations predict similar charges overall, although hybrid functionals tend to shift electron density away from the metal centers and onto the ligand environments compared to the GGA point of reference. Much more significant differences in partial atomic charges are observed when comparing different charge partitioning schemes. We conclude by using the dataset of computed MOF properties to train machine-learning models that can rapidly predict MOF band gaps for all four density functional approximations considered in this work, paving the way for future high-throughput screening studies. To encourage exploration and reuse of the theoretical calculations presented in this work, the curated data is made publicly available via an interactive and user-friendly web application on the Materials Project.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Learning to Count Grave Sites for Cemetery Observation Models With Satellite Imagery

Understanding how people occupy open spaces is important for research in support of population modeling, policy, national security, emergency response, and sustainability. For the past decade, there has been an increase in research toward capturing and reporting population dynamics and patterns of life at the building level and in some open public spaces such as cemeteries and parks. This is done through observation models developed from local sociocultural information acquired at various spatiotemporal scales to inform night, day, and episodic population occupancy estimates (people/1000 sq ft). Sociocultural information for cemeteries and parks is scarcely available and often collected manually. The process is not only marred by inconsistencies but is laborious and time consuming. In this study, we leverage convolutional neural networks (CNNs) and satellite imagery to derive grave site counts as proxy variables to support scalable and accurate sociocultural data required in a population observation model. Through a hybrid workflow (weak localization plus regression model), we characterize a large scale automation process to counting of grave sites. We evaluate and demonstrate the efficacy of proposed workflow using out-of-data set large satellite imagery and establish its broader impact on cemetery observation models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Retrospective on Recent DOE-Funded Studies Concerning the Extraction of Rare Earth Elements & Lithium from Geothermal Brines (Final Report)

Rare earth elements (REE) and lithium are non-toxic metals that are considered critical materials due to their use in electronics, magnets, batteries, and a wide variety of industrial processes important for the economy and military preparedness. Demand for REE and lithium is increasing and these critical materials are imported, so identifying and exploiting domestic sources of REE and lithium is a national priority. The U.S. Department of Energy (DOE) Geothermal Technologies Office (GTO) has been in the forefront of sponsoring research investigating the potential recovery of REE, lithium, and other critical minerals from geothermal brines. It has been proposed that the future of geothermal energy should include “hybrid systems” that combine electricity generation with other revenue-generating activities, such as recovery of valuable and critical minerals, including REE and lithium. Two recent GTO funding opportunities have focused on the recovery of REE and other valuable minerals from geothermal brines. The research supported by the GTO’s mineral recovery program is focused on three areas: resource characterization, technology for the extraction of REE, and technology for the extraction of lithium (Tables 1 and 2). This report is a retrospective study examining the outcome of GTO’s two recent mineral recovery programs (DE-FOA-0001016 in FY 2014 and DE-FOA-0001376 in FY 2016). In this report, the knowledge, technology, and techniques that were developed by researchers funded by GTO are summarized and discussed. Four projects were funded to assess the concentrations and amounts of REE found in geothermal brines and oil field produced waters. The GTO-funded studies compiled publically available data on REE concentrations from brines and produced water from all over the USA. In addition, new samples were collected and characterized from major geothermal and hydrocarbon basins in the Western USA. The studies examined the relationship between lithology and REE concentrations and developed models examining the influence of geology on REE concentrations in produced brines. It was determined that REE are frequently found at higher concentrations in oil field produced water than geothermal brines, but that some geothermal areas had significant REE resources. Significant reservoirs of REE were identified in the Western USA. In some cases, concentrations of REE were more than 1000 times the concentrations found in seawater. Collectively, these studies represent a comprehensive picture of REE resources associated with geothermal and hydrocarbon systems in the USA. The studies did not examine lithium resources, but in some cases, lithium concentration data was collected. Data from these studies are housed in the Geothermal Data Repository (GDR) and represent a significant information resource and it is recommended that these data be further analyzed in a future study. Eight projects were funded to develop new technology for REE extraction from geothermal fluids. These projects investigated sorption as an approach for removal and recovery of REE from geothermal brines. The projects investigated cutting-edge technology for selective sorption of ions from complex solutions, including the application of metal-organic frameworks and biosorbent proteins. The REE sorption studies tested different combinations of metal-binding ligands and solid supports. The most promising metal-binding ligands for REE included phosphonic acid, thiol, and carboxylic acid functional groups. Ligands were attached or incorporated into a wide variety of solid supports. In most cases, attachment was via covalent bonding to organic resins, polymers, or silica-based supports. Most of the REE projects were conducted at a low technology readiness level (TRL) and showed promise, but direct comparison between technologies was not possible based on the available information. It is recommended that testing and reporting be standardized to the extent possible to facilitate comparisons between technologies. Two projects were directed at novel lithium extraction technology. Both projects investigated the use of inorganic sorbents, including manganese oxides. One study also examined the use of metal- ion imprinted polymers as selective ion-exchange resins for the separation of lithium and manganese from brines. Both approaches showed promise for the selective extraction of lithium from brines, including potentially geothermal brines. Results from these GTO studies indicated that selective REE and lithium extraction is possible, but interference from co-occurring solutes, such as calcium, magnesium, or heavy metals, will interfere with process efficiency and negatively impact process economics. Techno-economic analysis conducted as part of the resource and technology studies suggest extraction of REE from geothermal brines is unlikely to be economically viable, especially since non-geothermal produced waters frequently have higher REE concentrations. It is recommended that benchmarks for techno-economic analysis be established to the extent possible for future studies, to facilitate direct comparison of various technologies. Based on the collective results of this program, it appears that hybrid geothermal power would benefit more from recovery of lithium and other metals, rather than REE. It is recommended that future studies be conducted at a higher- TRL and that sorbents be tested against actual geothermal fluid samples. Prior higher-TRL efforts to extract metals from geothermal brines should be further evaluated for lessons learned.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Computational Framework to design 3D stiffness gradient acoustic metamaterials for impedance matching

Acoustic waves play a crucial role in various applications, including medical imaging, non-destructive testing, and sonar systems. One of the significant challenges in these applications is impedance matching, which is essential for minimizing reflections and maximizing the transfer of acoustic energy between different media. Acoustic metamaterials offer a promising solution to this challenge. In addition to impedance control, gradient stiffness can enhance structural efficiency and enable spatial control of wave propagation, making it a valuable feature in acoustic metamaterial design. In this pa- per, we present our developed computational method to design 3D stiffness gradient acoustic metamaterials for impedance matching. The key steps in our approach include generating initial designs using a periodic covariance function to provide unit cells that are both periodic on the boundaries and randomly formed inside the unit cell. Furthermore, we integrated manufacturing constraints into the design process, ensuring that the structures are interconnected for fabrication. We propose two computational optimization algorithms: GenUnit, based on a non-dominated sorting genetic algorithm (NSGA-II), and MLMatch, which leverages differentiable machine learning. The two approaches are not separate contributions but complementary com- ponents of a unified framework. GenUnit requires no training data and directly interfaces with physics-based simulations, making it highly accurate but slower for large-scale exploration. In contrast, MLMatch is data-hungry during training but, once trained, enables near-instantaneous inference and broad design-space coverage. Together, they form a hybrid strategy: ML- Match rapidly explores the global design space, and GenUnit provides local refinement with high-fidelity accuracy. This balance between training cost, inference time, and precision is the motivation for including both methods in the same study. We applied this dual-algorithm framework to generate two metallic-based metamaterial designs that match the acoustic impedance of water while exhibiting a controlled gradient in stiffness (from stiff to soft). The stiffness gradient is particularly advantageous in applications where one side of the structure must interface with soft or sensitive surfaces, such as human tissue or delicate components. Here, this work paves the way for improved materials in various acoustic applications, particularly in ultrasound devices, by providing better impedance.

Metamaterial↗
DOE OSTI2023

Modular machine learning-based elastoplasticity: Generalization in the context of limited data

The development of highly accurate constitutive models for materials that undergo path-dependent processes continues to be a complex challenge in computational solid mechanics. Challenges arise both in considering the appropriate model assumptions and from the viewpoint of data availability, verification, and validation. Recently, data-driven modeling approaches have been proposed that aim to establish stress-evolution laws that avoid user-chosen functional forms by relying on machine learning representations and algorithms. However, these approaches not only require a significant amount of data but also need data that probes the full stress space with a variety of complex loading paths. Furthermore, they rarely enforce all necessary thermodynamic principles as hard constraints. Hence, they are in particular not suitable for low-data or limited-data regimes, where the first arises from the cost of obtaining the data and the latter from the experimental limitations of obtaining labeled data, which is commonly the case in engineering applications. In this work, we discuss a hybrid framework that can work on a variable amount of data by relying on the modularity of the elastoplasticity formulation where each component of the model can be chosen to be either a classical phenomenological or a data-driven model depending on the amount of available information and the complexity of the response. The method is tested on synthetic uniaxial data coming from simulations as well as cyclic experimental data for structural materials. The discovered material models are found to not only interpolate well but also allow for accurate extrapolation in a thermodynamically consistent manner far outside the domain of the training data. This ability to extrapolate from limited data was the main reason for the early and continued success of phenomenological models and the main shortcoming in machine learning-enabled constitutive modeling approaches. Training aspects and details of the implementation of these models into Finite Element simulations are discussed and analyzed.

42 ENGINEERING↗
DOE OSTI2025

Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detection

The proliferation of sensors brings an immense volume of spatio-temporal (ST) data in many domains, including monitoring, diagnostics, and prognostics applications. Data curation is a time-consuming process for a large volume of data, making it challenging and expensive to deploy data analytics platforms in new environments. Transfer learning (TL) mechanisms promise to mitigate data sparsity and model complexity by utilizing pre-trained models for a new task. Despite the triumph of TL in fields like computer vision and natural language processing, efforts on complex ST models for anomaly detection (AD) applications are limited. In this study, we present the potential of TL within the context of high-dimensional ST AD with a hybrid autoencoder architecture, incorporating convolutional, graph, and recurrent neural networks. Motivated by the need for improved model accuracy and robustness, particularly in scenarios with limited training data on systems with thousands of sensors, this research investigates the transferability of models trained on different sections of the Hadron Calorimeter of the Compact Muon Solenoid experiment at CERN. The key contributions of the study include exploring TL’s potential and limitations within the context of encoder and decoder networks, revealing insights into model initialization and training configurations that enhance performance while substantially reducing trainable parameters and mitigating data contamination effects.

47 OTHER INSTRUMENTATION↗