Search NASA⌕ Search

SEARCH · Search NASA

Results for “successive training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

KBase partners with community developers from several Department of Energy Science Focus Areas to increase functionality of tools and analysis

Several SFAs were selected for training on the KBase Software Development Kit (SDK) to integrate tools and data into the KBase platform. Overall, the collaborative effort was viewed as highly successful. Every SFA project was able to achieve their proposed targets for training and functionality, while also gaining an appreciation for the role KBase plays/could play in their future science plans. Both the SFA and KBase teams felt that continued collaboration would be beneficial, especially if the programs were able to jointly prioritize scope and readiness of future projects. This poster will outline the scope of functionality added by SFA community developers, and highlight points of intersection across these efforts.

59 BASIC BIOLOGICAL SCIENCES↗

Industry-driven Training and Curriculum Development Process

The development of a sustainable, skilled fusion workforce requires coordinated strategy between all sectors of fusion industry. This paper outlines a framework to align training programs with evolving technical and professional demands of fusion, including enhancing existing curricula, the establishment of new programs at educational institutions, and the identification of workforce gaps informed through industry engagement. Effective curriculum development requires input from both educators and employers to ensure that academic content reflects real-world challenges and can prepare students for successful transitions into the field. Collaborative models, such as industry-led training programs, inter-institutional partnerships, and faculty development initiatives, are highlighted as mechanisms for scalable and inclusive workforce development. Continued program success and relevance will be dependent on continuous review processes, including feedback from employers, alumni, and advisory boards. The combination of these programs supports the formation of flexible, industry-informed training pathways. This approach aims to foster a competent workforce capable of advancing fusion energy research and commercialization.

Gehrig, Monica [ORNL] (ORCID:0000000341022612)↗

ASK: Adversarial Soft k-Nearest Neighbor Attack and Defense

K-Nearest Neighbor (kNN)-based deep learning methods have been applied to many applications due to their simplicity and geometric interpretability. However, the robustness of kNN-based deep classification models has not been thoroughly explored and kNN attack strategies are underdeveloped. In this paper, we first propose an Adversarial Soft kNN (ASK) loss for developing more effective kNN-based deep neural network attack strategies and designing better defense methods against them. Our ASK loss provides a differentiable surrogate of the expected kNN classification error. It is also interpretable as it preserves the mutual information between the perturbed input and the in-class-reference data. We use the ASK loss to design a novel attack method called the ASK-Attack (ASK-Atk), which shows superior attack efficiency and accuracy degradation relative to previous kNN attacks on hidden layers. We then derive an ASK-Defense (ASK-Def) method that optimizes the worst-case ASK training loss. Experiments on CIFAR-10 (ImageNet) show that (i) ASK-Atk achieves ≥13% (≥ 13% ) improvement in attack success rate over previous kNN attacks, and (ii) ASK-Def outperforms the conventional adversarial training method by ≥ 6.9% (≥ 3.5% ) in terms of robustness improvement. Relevant codes are available at https://github.com/wangren09/ASK .

97 MATHEMATICS AND COMPUTING↗

On the Prediction of Aerosol-Cloud Interactions Within a Data-Driven Framework

Aerosol-cloud interactions (ACI) pose the largest uncertainty for climate projection. Among many challenges of understanding ACI, the question of whether ACI can be deterministically predicted has not been explicitly answered. Here we attempt to answer this question by predicting cloud droplet number concentration N c from aerosol number concentration N a and ambient conditions using a data-driven framework. We use aerosol properties, vertical velocity fluctuations, and meteorological states from the ACTIVATE field observations (2020–2022) as predictors to estimate N c . We show that the campaign-wide N c can be successfully predicted using machine learning models despite the strongly nonlinear and multi-scale nature of ACI. However, the observation-trained machine learning model fails to predict N c in individual cases while it successfully predicts N c of randomly selected data points that cover a broad spatiotemporal scale. This suggests that, within a data-driven framework, the N c prediction is uncertain at fine spatiotemporal scales.

54 ENVIRONMENTAL SCIENCES↗

Modular machine learning-based elastoplasticity: Generalization in the context of limited data

The development of highly accurate constitutive models for materials that undergo path-dependent processes continues to be a complex challenge in computational solid mechanics. Challenges arise both in considering the appropriate model assumptions and from the viewpoint of data availability, verification, and validation. Recently, data-driven modeling approaches have been proposed that aim to establish stress-evolution laws that avoid user-chosen functional forms by relying on machine learning representations and algorithms. However, these approaches not only require a significant amount of data but also need data that probes the full stress space with a variety of complex loading paths. Furthermore, they rarely enforce all necessary thermodynamic principles as hard constraints. Hence, they are in particular not suitable for low-data or limited-data regimes, where the first arises from the cost of obtaining the data and the latter from the experimental limitations of obtaining labeled data, which is commonly the case in engineering applications. In this work, we discuss a hybrid framework that can work on a variable amount of data by relying on the modularity of the elastoplasticity formulation where each component of the model can be chosen to be either a classical phenomenological or a data-driven model depending on the amount of available information and the complexity of the response. The method is tested on synthetic uniaxial data coming from simulations as well as cyclic experimental data for structural materials. The discovered material models are found to not only interpolate well but also allow for accurate extrapolation in a thermodynamically consistent manner far outside the domain of the training data. This ability to extrapolate from limited data was the main reason for the early and continued success of phenomenological models and the main shortcoming in machine learning-enabled constitutive modeling approaches. Training aspects and details of the implementation of these models into Finite Element simulations are discussed and analyzed.

42 ENGINEERING↗

Woven ceramic matrix composite surrogate model based on physics-informed recurrent neural network

A recurrent neural network (RNN) based surrogate model is developed to emulate the nonlinear constitutive behavior of woven ceramic matrix composites (CMCs) driven by matrix damage at multiple length scales. Physics-informed constraints are introduced into the surrogate model through regularization to ground the prediction in physics and improve its predictive capabilities. Training data is generated using the multiscale generalized method of cells (MSGMC) approach coupled with a matrix damage model. This coupling permits simulating the nonlinear behavior of woven CMCs based on constituent response at the micro-, meso-, and macroscales. The multiscale repeating unit cell is loaded under non-monotonic conditions including multiple load / unload cycles and tension / compression. The fiber volume fraction as well as the intra- and intertow void volume fractions are also varied in the generation of training data. Therefore, the RNN-based surrogate model is tasked with predicting, as a function of variable input strain sequence and fiber and void volume fractions, the resulting stress versus strain response while satisfying physical constraints such as positive semi-definiteness of the tangent stiffness matrix and linear elastic unloading. Further, the trained surrogate model effectively matches the stress versus strain response and successfully predicts the tangent modulus throughout the loading regime. Neural network based surrogate models can offer efficient alternatives to running computationally intensive multiscale material models to simulate the nonlinear response of large structural models. Therefore the presented work provides evidence towards the feasibility of developing, training, and running such models for CMCs with complex architectures, nonlinear multiaxial material response, and under non-monotonic loading conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

When and why PINNs fail to train: A neural tangent kernel perspective

Physics-informed neural networks (PINNs) have lately received great attention thanks to their flexibility in tackling a wide range of forward and inverse problems involving partial differential equations. However, despite their noticeable empirical success, little is known about how such constrained neural networks behave during their training via gradient descent. More importantly, even less is known about why such models sometimes fail to train at all. Here in this work, we aim to investigate these questions through the lens of the Neural Tangent Kernel (NTK); a kernel that captures the behavior of fully-connected neural networks in the infinite width limit during training via gradient descent. Specifically, we derive the NTK of PINNs and prove that, under appropriate conditions, it converges to a deterministic kernel that stays constant during training in the infinite-width limit. This allows us to analyze the training dynamics of PINNs through the lens of their limiting NTK and find a remarkable discrepancy in the convergence rate of the different loss components contributing to the total training error. To address this fundamental pathology, we propose a novel gradient descent algorithm that utilizes the eigenvalues of the NTK to adaptively calibrate the convergence rate of the total training error. Finally, we perform a series of numerical experiments to verify the correctness of our theory and the practical effectiveness of the proposed algorithms.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning

Heterogeneous Differential Privacy (HDP) in Federated Learning (FL) allows clients to select individual privacy budgets () according to institutional policies and data sensitivity. In practice, many HDP-FL systems employ -aware server aggregation to improve model utility by re-weighting client updates according to their declared privacy budgets. However, gradient updates in FL retain structural patterns induced by non-independent and identically-distributed (non-IID) data, and these additional signals exposed by -aware aggregation create new opportunities for inference by an honest-but-curious server. In this work, we first show that a server equipped with gradient denoising and surrogate modeling can mount a Privacy Inference Attack that infers distributional attributes of clients and links updates from the same client across training rounds, measured via surrogate inference accuracy and linkage success, under realistic knowledge constraints. The Shuffle-Model has been widely studied as a defense against such inference risks by anonymizing update sources, but it is fundamentally incompatible with HDP-FL -aware aggregation. To address this challenge, we propose IntraShuffler, a middleware defense framework designed for HDP-FL systems. IntraShuffler introduces a privacy-aware shuffling mechanism that groups clients into privacy-compatible buckets and performs parameter-level shuffling within each bucket to disrupt persistent gradient structure while preserving -aware aggregation. Experiments across four different datasets show that IntraShuffler reduces gradient recoverability by over 60% and decreases surrogate inference accuracy from 0.78 to 0.33 while maintaining comparable model utility across multiple FL aggregation rules.

Riya, Farhin Farhad [ORNL]↗

Measurement of hybrid rocket solid fuel regression rate for a slab burner using deep learning

This study presents an imaging-based deep learning tool to measure the fuel regression rate in a 2D slab burner experiment for hybrid rocket fuels. The slab burner experiment is designed to verify mechanistic models of reacting boundary layer combustion in hybrid rockets by the measurement of fuel regression rates. A DSLR camera with a high intensity flash is used to capture images throughout the burn and the images are then used to find the fuel boundary to calculate the regression rate. A U-net convolutional neural network architecture is explored to segment the fuel from the experimental images. Here, a Monte-Carlo Dropout process is used to quantify the regression rate uncertainty produced from the network. The U-net computed regression rates are compared with values from other techniques from literature and show error less than 10%. An oxidizer flux dependency study is performed and shows the U-net predictions of regression rates are accurate and independent of the oxidizer flux, when the images in the training set are not over-saturated. Training with monochrome images is explored and is not successful at predicting the fuel regression rate from images with high noise. The network is superior at filtering out noise introduced by soot, pitting, and wax deposition on the chamber glass as well as the flame when compared to traditional image processing techniques, such as threshold binary conversion and spatial filtering. U-net consistently provides low error image segmentations to allow accurate computation of the regression rate of the fuel.

42 ENGINEERING↗

DPM: A deep learning PDE augmentation method with application to large-eddy simulation

A framework is introduced that leverages known physics to reduce overfitting in machine learning for scientific applications. The partial differential equation (PDE) that expresses the physics is augmented with a neural network that uses available data to learn a description of the corresponding unknown or unrepresented physics. Training within this combined system corrects for missing, unknown, or erroneously represented physics, including discretization errors associated with the PDE's numerical solution. For optimization of the network within the PDE, an adjoint PDE is solved to provide high-dimensional gradients, and a stochastic adjoint method (SAM) further accelerates training. Additionally, the approach is demonstrated for large-eddy simulation (LES) of turbulence. High-fidelity direct numerical simulations (DNS) of decaying isotropic turbulence provide the training data used to learn sub-filter-scale closures for the filtered Navier–Stokes equations. Out-of-sample comparisons show that the deep learning PDE method outperforms widely-used models, even for filter sizes so large that they become qualitatively incorrect. It also significantly outperforms the same neural network when a priori trained based on simple data mismatch, not accounting for the full PDE. Measures of discretization errors, which are well-known to be consequential in LES, point to the importance of the unified training formulation's design, which without modification corrects for them. For comparable accuracy, simulation runtime is significantly reduced. A relaxation of the typical discrete enforcement of the divergence-free constraint in the solver is also successful, instead allowing the DPM to approximately enforce incompressibility physics. Since the training loss function is not restricted to correspond directly to the closure to be learned, training can incorporate diverse data, including experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Seeking Repeating Anthropogenic Seismic Sources: Implications for Seismic Velocity Monitoring at Fault Zones

Abstract Seismic velocities in rocks are highly sensitive to changes in permanent deformation and fluid content. The temporal variation of seismic velocity during the preparation phase of earthquakes has been well documented in laboratories but rarely observed in nature. It has been recently found that some anthropogenic, high‐frequency (>1 Hz) seismic sources are powerful enough to generate body waves that travel down to a few kilometers and can be used to monitor fault zones at seismogenic depth. Anthropogenic seismic sources typically have fixed spatial distribution and provide new perspectives for velocity monitoring. In this work, we propose a systematic workflow to seek such powerful seismic sources in a rapid and straightforward manner. We tackle the problem from a statistical point of view, considering that persistent, powerful seismic sources yield highly coherent correlation functions (CFs) between pairs of seismic sensors. The algorithm is tested in California and Japan. Multiple sites close to fault zones show high‐frequency CFs stable for an extended period of time. These findings have great potential for monitoring fault zones, including the San Jacinto Fault and the Ridgecrest area in Southern California, Napa in Northern California, and faults in central Japan. However, extra steps, such as beamforming or polarization analysis, are required to determine the dominant seismic sources and study the source characteristics, which are crucial to interpreting the velocity monitoring results. Train tremors identified by the present approach have been successfully used for seismic velocity monitoring of the San Jacinto Fault in previous studies.

58 GEOSCIENCES↗

Raman Spectroscopy Based On-Line, Real-Time Monitoring to Reduce Composition Uncertainties: Enhanced sensitivity through optimization of Raman Parameters

Optical spectroscopy-based on-line monitoring of Hanford processing streams can enable real-time characterization of chemical composition of process streams and batches, ultimately enabling and enhancing process control. It can provide immediate feedback on process conditions and has the potential to reduce the needed number of grab sample collections, thereby reducing times and costs associated with laboratory processing. Here we discuss the utilization of Raman spectroscopy to quantify multiple target analytes that are common within Hanford tanks and waste processing streams. Analytes include: nitrate, nitrite, carbonate, chromate, sulfate, phosphate, hydroxide, oxalate, ammonia, and aluminate. Most notably in this work, Raman applications to low-concentration streams are explored and optimized. Raman instrument specifications are compared; specifically, the impact of utilizing three different Raman excitation wavelengths, 405, 532, and 671 nm, is discussed. Also, Raman data collection parameters such as collection time and spectral averaging are measured and discussed. Finally, optical libraries of chemical targets were collected using optimized collection parameters and chemometric models were built to automate quantification of chemical targets. These models were validated through application to simulants and real Hanford process samples. Chemometric models performed well on both training and validation sets, suggesting these approaches can be successfully applied to on-line and real-time monitoring of low concentration Hanford processing streams. The use of the combine Raman wave lengths with the enhanced chemometric models for the low concentration streams significantly improved the chemical detection levels and significantly reduced uncertainties of those measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Assessing shellfish water exposure to fecal bacteria pollution in Salish Sea: three-dimensional modeling and implications for monitoring

Fecal bacteria (FB) contamination poses significant risks to shellfish safety and management in coastal and estuarine waters. Despite extensive pollution identification and correction efforts, FB contamination in shellfish-growing areas persists in the Salish Sea, highlighting the need to identify overlooked sources and better understand FB transport from riverine and shoreline inputs to shellfish beds. To address this, a high-resolution three-dimensional hydrodynamic model coupled with FB kinetics was developed and applied to a case study site in Salish Sea—Portage Bay—to simulate freshwater plume circulation, flushing dynamics, and bacterial transport. Daily FB loading from the major freshwater inflow—Nooksack River was generated by both linear interpolation and integrating a machine learning approach (XGBoost), trained on historical hydrological and meteorological data. The model successfully reproduced both the magnitude and seasonal variation of FB concentrations in Portage Bay for the year of 2021, demonstrating that simplified FB kinetics with first-order decay due to mortality was effective in this dynamic coastal environment with short flushing time. Model results identified the Nooksack River as the dominant far-field FB source, while scenario simulations showed that near-field coastal stormwater outfalls elevated local FB levels following rainfall, particularly under low-flow conditions. The XGBoost prediction provided comparable or superior accuracy to linear interpolation, particularly during periods of missing observational data, by capturing short-term variability and event-driven loading more effectively. Integrating data-driven riverine FB inputs with mechanistic coastal numerical modeling provides a robust framework for operational forecasting of shellfish bed exposure risk and supports adaptive monitoring and management of shellfish growing areas in the Salish Sea and similar coastal systems.

Salish Sea↗

RockFlow: Fast Generation of Synthetic Source Rock Images Using Generative Flow Models

Image-based evaluation methods are a valuable tool for source rock characterization. The time and resources needed to obtain images has spurred development of machine-learning generative models to create synthetic images of pore structure and rock fabric from limited image data. While generative models have shown success, existing methods for generating 3D volumes from 2D training images are restricted to binary images and grayscale volume generation requires 3D training data. Shale characterization relies on 2D imaging techniques such as scanning electron microscopy (SEM), and grayscale values carry important information about porosity, kerogen content, and mineral composition of the shale. Here, we introduce RockFlow, a method based on generative flow models that creates grayscale volumes from 2D training data. We apply RockFlow to baseline binary micro-CT image volumes and compare performance to a previously proposed model. We also show the extension of our model to 2D grayscale data by generating grayscale image volumes from 2D SEM and dual modality nanoscale shale images. The results show that our method underestimates the porosity and surface area on the binary baseline datasets but is able to generate realistic grayscale image volumes for shales. With improved binary data preprocessing, we believe that our model is capable of generating synthetic porous media volumes for a very broad class of rocks from shale to carbonates to sandstone.

58 GEOSCIENCES↗

Workshop on Addressing Rigor and Reproducibility in Thermal, Heterogeneous Catalysis

Heterogeneous catalysis has long served as the bedrock of the manufacturing of energy carriers, fuels and chemicals, and various technologies for pollution abatement. The significant complexity and variability spanning the entire breadth of catalyst material properties, synthesis methods, characterization techniques, and evaluation procedures, has focused attention on the need to establish community-accepted best practices for ensuring high-quality, benchmarked, and reproducible data. In addition, increased societal urgency to transition to clean energy and reduce greenhouse gas concentrations has incentivized interdisciplinary, convergent, and translational approaches to catalysis research in recent years. Research engineers and scientists with expertise cutting broadly across materials science, chemical synthesis, interfacial science, spectroscopy, and methods of data science and computational simulation, all bring diverse and important perspectives to catalysis research, but often with little awareness of the complexity of catalytic systems, especially in their working environment. As has already occurred in other scientific fields, there has been growing recognition and consensus in the heterogeneous catalysis research community that mechanisms are needed to improve the rigor and reproducibility (R&R) of experimental measurements, to ensure alignment of the broader research community with a common core of best practices specific to the realization of high-quality catalysis research. Similarly, the field is moving rapidly toward computationally informed and data science-driven catalyst design, but the success of implementing such predictive tools hinges on model training and validation rooted in rigorously obtained and reproducible experimental data that are benchmarked to common specifications. As such, this workshop was convened to prepare a report summarizing best practices for reporting data and performing experiments that researchers can use to benchmark, validate, and reproduce data in specific sub-fields of thermal, heterogeneous catalysis. Additionally, we discussed recommendations for future actions that may improve R&R in this field. The workshop organizers and participants include a diverse range of catalysis researchers from various employment sectors (e.g., academia, industry, national laboratory), institutional mission and resources (e.g., PhD-granting research universities, non-PhD-granting teaching universities), career stage (e.g., early, mid and late-career), technical expertise, and demographic background. This diverse group was involved in the discussion of workshop agenda items, writing this report, and discussing possible future action items for the community to consider, which helped ensure that a broad range of perspectives were captured in the description of the problems at hand and the creation of actionable solutions that may be effectively adopted by the diverse practitioners in catalysis research. Importantly, this group of workshop participants also included very early career researchers (e.g., senior PhD students, postdoctoral scholars) who will become the next generation of scientific leaders in various sectors, thus capturing emerging perspectives of newcomers to the field to shape its future while positively impacting the development of its future workforce. We envision that this effort will help advance the field of catalysis science by improving the rigor and reproducibility of experimental data collected by current researchers and future newcomers to the field, which is of broad importance to health and vitality of any scientific discipline. Therefore, best practices identified in this endeavor for thermal heterogeneous catalysis can be translated to such efforts in other areas of catalysis and other scientific fields involving the study of materials, and vice versa. We also envision this to be an ongoing effort, with future workshops that are convened to discuss issues of rigor and reproducibility on technical topics that were unable to be covered in this workshop due to its scope limitations, and as emerging methods and materials become more prevalent in the research community.

36 MATERIALS SCIENCE↗

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Inductive predictions of hydrologic events using a Long Short-Term Memory network and the Soil and Water Assessment Tool

We present machine learning methods to predict hydrologic features such as streamflow and soil moisture from spatially and temporally varying hydrological and meteorological data. Here, we used a temporal reduction technique to reduce computation and memory requirements and trained a Long Short-Term Memory (LSTM) network to predict soil moisture and streamflow over multiple watersheds. We show LSTM networks can be trained in a fraction of the time required by complex process-based and attention-based models such as Soil and Water Assessment Tool (SWAT) and GeoMAN without sacrificing accuracy. We also demonstrate that outside data - sourced from a watershed other than the target - can be used to train LSTM to comparable or even superior prediction accuracy. The success of LSTM in such spatially-inductive settings shows hydrologic features can be predicted with minimal prior knowledge of the watershed in question. Finally, we make all methodologies of this work publicly available as an end-to-end software pipeline that facilitates rapid prototyping of hydrologic learners.

97 MATHEMATICS AND COMPUTING↗

Application of First-Principles-Based Artificial Neural Network Potentials to Multiscale-Shock Dynamics Simulations on Solid Materials

The use of artificial neural network (ANN) potentials trained with first-principles calculations has emerged as a promising approach for molecular dynamics (MD) simulations encompassing large space and time scales while retaining first-principles accuracy. To date, however, the application of ANN-MD has been limited to near-equilibrium processes. Here we combine first-principles-trained ANN-MD with multiscale shock theory (MSST) to successfully describe far-from-equilibrium shock phenomena. Overall, our ANN-MSST-MD approach describes shock-wave propagation in solids with first-principles accuracy but a 5000 times shorter computing time. Accordingly, ANN-MD-MSST was able to resolve fine, long-time elastic deformation at low shock speed, which was impossible with first-principles MD because of the high computational cost. This work thus lays a foundation of ANN-MD simulation to study a wide range of far-from-equilibrium processes.

36 MATERIALS SCIENCE↗