Search NASA⌕ Search

SEARCH · Search NASA

Results for “machine learning framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Lagrangian large eddy simulations via physics-informed machine learning

High-Reynolds number homogeneous isotropic turbulence (HIT) is fully described within the Navier–Stokes (NS) equations, which are notoriously difficult to solve numerically. Engineers, interested primarily in describing turbulence at a reduced range of resolved scales, have designed heuristics, known as large eddy simulation (LES). LES is described in terms of the temporally evolving Eulerian velocity field defined over a spatial grid with the mean-spacing correspondent to the resolved scale. This classic Eulerian LES depends on assumptions about effects of subgrid scales on the resolved scales. Here, we take an alternative approach and design LES heuristics stated in terms of Lagrangian particles moving with the flow. Our Lagrangian LES, thus L-LES, is described by equations generalizing the weakly compressible smoothed particle hydrodynamics formulation with extended parametric and functional freedom, which is then resolved via Machine Learning training on Lagrangian data from direct numerical simulations of the NS equations. The L-LES model includes physics-informed parameterization and functional form, by combining physics-based parameters and physics-inspired Neural Networks to describe the evolution of turbulence within the resolved range of scales. The subgrid-scale contributions are modeled separately with physical constraints to account for the effects from unresolved scales. We build the resulting model under the differentiable programming framework to facilitate efficient training. We experiment with loss functions of different types, including physics-informed ones accounting for statistics of Lagrangian particles. We show that our L-LES model is capable of reproducing Eulerian and unique Lagrangian turbulence structures and statistics over a range of turbulent Mach numbers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

A data-driven operational model for traffic at the Dallas Fort Worth International Airport

Airports are on the front line of significant innovations, allowing the movement of more people and goods faster, cheaper, and with greater convenience. As air travel continues to grow, airports will face challenges in responding to increasing passenger vehicle traffic, which leads to lower operational efficiency, poor air quality, and security concerns. This paper evaluates methods for traffic demand forecasting combined with traffic microsimulation, which will allow airport operations staff to accurately predict traffic and congestion. Using two years of detailed data describing individual vehicle arrivals and departures, aircraft movements, and weather at Dallas-Fort Worth (DFW) International Airport, we evaluate multiple prediction methods including the Auto Regressive Integrated Moving Average (ARIMA) family of models, traditional machine learning models, and DeepAR, a modern recurrent neural network (RNN). We find that these algorithms are able to capture the diurnal trends in the surface traffic, and all do very well when predicting the next 30 minutes of demand. Longer forecast horizons are moderately effective, demonstrating the challenge of this problem and highlighting promising techniques as well as potential areas for improvement. Traffic demand is not the only factor that contributes to terminal congestion, because temporary changes to the road network, such as a lane closure, can make benign traffic demand highly congested. Combining a demand forecast with a traffic microsimulation framework provides a complete picture of traffic and its consequences. The result is an operational intelligence platform for exploring policy changes, as well as infrastructure expansion and disruption scenarios. To demonstrate the value of this approach, we present results from a case study at DFW Airport assessing the impact of a policy change for vehicle routing in high demand scenarios. This framework can assist airports like DFW as they tackle daily operational challenges, as well as explore the integration of emerging technology and expansion of their services into long term plans.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

AI-Based Integrated Modeling and Observational Framework for Improving Seasonal to Decadal Prediction of Terrestrial Ecohydrological Extremes

Focal Areas: (1) Insight gleaned from complex data (both observed and simulated) using artificial intelligence(AI), big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI (2) Data acquisition and assimilation enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, unsupervised learning (including deep learning), and hardware-related efforts involving AI (e.g., edge computing).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Finite-element-based simulations of electrodes for CO 2 cascade reduction reactions

The multielectron reduction of CO 2 to liquid fuels could be a path to scalable energy storage, but reaching this goal requires major advances in catalysis and systems engineering. Cascade catalysis, which couples sequential reactions without isolating intermediates, has emerged as a promising route to enhance selectivity and efficiency in CO 2 reduction (CO 2 R). In this review, we examine how finite-element-based simulations of continuum model [finite element method (FEM)] approaches are being used to analyze and guide CO 2 R cascade systems. We first outline the fundamentals of cascade catalysis and recent advances in catalytic materials (metallic, molecular, and hybrid architectures). We then focus on FEM developments at the electrode and device scales, emphasizing how these models capture transport phenomena, local microenvironments, and geometry-dependent effects. To clarify design principles, we present case studies of cascade electrodes organized in systems without and with integrated semiconductors. We further emphasize the integration of FEM with multiscale frameworks (density functional theory, molecular dynamics, kinetic Monte Carlo) and its role in bridging atomic-level insights with device-level performance. Finally, we identify current limitations and future prospects, including improved boundary conditions, coupling with operando experiments, and machine learning-accelerated model development. Together, these insights provide design principles for next-generation CO 2 R cascade systems for efficient solar fuel production.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Accelerate microstructure evolution simulation using graph neural networks with adaptive spatiotemporal resolution

Abstract Surrogate models driven by sizeable datasets and scientific machine-learning methods have emerged as an attractive microstructure simulation tool with the potential to deliver predictive microstructure evolution dynamics with huge savings in computational costs. Taking 2D and 3D grain growth simulations as an example, we present a completely overhauled computational framework based on graph neural networks with not only excellent agreement to both the ground truth phase-field methods and theoretical predictions, but enhanced accuracy and efficiency compared to previous works based on convolutional neural networks. These improvements can be attributed to the graph representation, both improved predictive power and a more flexible data structure amenable to adaptive mesh refinement. As the simulated microstructures coarsen, our method can adaptively adopt remeshed grids and larger timesteps to achieve further speedup. The data-to-model pipeline with training procedures together with the source codes are provided.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Machine learning insights into microstructural origins of transport and mechanical properties in porous microstructures

Multifunctional porous materials are increasingly needed across various fields, but their complex microstructures create significant challenges due to the intricate microstructure-property relationships. This complexity, combined with limitations of traditional analysis methods, hinders efforts to understand and optimize microstructure–property relationships. Here, to address this, we integrate physics-based mesoscale modeling with interpretable machine learning (ML) to uncover how microstructural features govern effective diffusivity and elastic modulus. At constant porosity, we show diffusivity varies by over 150 × and modulus by ∼50 ×, highlighting the power of microstructure engineering. Statistical analysis reveals bimodal behavior in diffusivity and unimodal in modulus. ML identifies connectivity as the dominant factor, while modulus is also sensitive to domain size and feature interactions. Controlled simulations further highlight domain shape as a critical feature for modulus. This framework enables efficient exploration of microstructure-property correlations, offering new insights to guide the design of advanced porous materials.

Bicontinuous microstructure↗
DOE OSTI2022

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Application of Dimensionality Reduction in Machine Learning Modeling of CO2 Storage

In this study, we developed deep learning models that are capable of predicting spatio-temporal outputs of CO2 saturation, pressure, and brine production in a 3D saline storage reservoir over 30 years of continuous CO2 injection and a 50-year post-injection timeframe. To improve computational efficiency and maintain performance accuracy, the model framework involves ensembling multi-layer autoencoder networks that provide dimensionality reduction of geologic inputs with fully connected long short-term memory (LSTM) neural networks that generate time-series prediction. This study was presented as poster at the 2022 Carbon Management Project Review Meeting held in Pittsburgh, PA (August 15 – 19, 2022).

Bello, Kolawole↗
DOE OSTI2021

Autotuning PolyBench benchmarks with LLVM Clang/Polly loop optimization pragmas using Bayesian optimization

Here, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and evaluate their effectiveness. We select six of the most complex PolyBench benchmarks and apply the newly developed LLVM Clang/Polly loop optimization pragmas to the benchmarks to optimize them. We then use the autotuning framework to optimize the pragma parameters to improve their performance. The experimental results show that our autotuning approach outperforms the other compiling methods to provide the smallest execution time for the benchmarks syr2k, 3mm, heat-3d, lu, and covariance with two large datasets in 200 code evaluations for effectively searching the parameter spaces with up to 170,368 different configurations. We find that the Floyd-Warshall benchmark did not benefit from autotuning. To cope with this issue, we provide some compiler option solutions to improve the performance. Then we present loop autotuning without a user's knowledge using a simple mctree autotuning framework to further improve the performance of the Floyd-Warshall benchmark. We also extend the ytopt autotuning framework to tune a deep learning application.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Group-Invariant Quantum Machine Learning

Quantum machine learning (QML) models are aimed at learning from data encoded in quantum states. Recently, it has been shown that models with little to no inductive biases (i.e., with no assumptions about the problem embedded in the model) are likely to have trainability and generalization issues, especially for large problem sizes. As such, it is fundamental to develop schemes that encode as much information as available about the problem at hand. In this work we present a simple, yet powerful, framework where the underlying invariances in the data are used to build QML models that, by construction, respect those symmetries. These so-called group-invariant models produce outputs that remain invariant under the action of any element of the symmetry group $\mathfrak{G}$ associated with the dataset. We present theoretical results underpinning the design of $\mathfrak{G}$-invariant models, and exemplify their application through several paradigmatic QML classification tasks, including cases when $\mathfrak{G}$ is a continuous Lie group and also when it is a discrete symmetry group. Notably, our framework allows us to recover, in an elegant way, several well-known algorithms for the literature, as well as to discover new ones. Taken together, we expect that our results will help pave the way towards a more geometric and group-theoretic approach to QML model design.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine-learning-assisted deciphering of microstructural effects on ionic transport in composite materials: A case study of Li 7 La 3 Zr 2 O 12 -LiCoO 2

The effective diffusivity of ionic species in multiphase materials is critical for the design and function of composite materials for electrochemical energy storage. In practice, effective diffusivity depends sensitively not only on the intrinsic diffusivities of constituting materials but also on their topological arrangement; nevertheless, these coupled contributions are oversimplified in most analytical models. Here, we combine atomistically informed mesoscale modeling and machine learning (ML) analysis to unravel how such features affect effective diffusivity in two-phase composites. Using the Li 7 La 3 Zr 2 O 12 -LiCoO 2 composite solid-state battery cathode as a model system, we compute effective diffusivity for 600 distinct dense polycrystalline microstructures with different topological configurations of grains, grain boundaries, and heterointerfaces. We verify that in addition to atomic-scale variabilities, microstructural feature diversity can significantly impact effective transport properties. Across the ensemble of test microstructures, this often results in bimodal distributions of effective diffusivity that encompass two qualitatively distinct operating mechanisms, which we identify via flux analysis. An ML approach reveals that the most critical determining factors for effective diffusivity are the connectivity of bulk phases and their heterointerfaces. The role of ionic mobility at the heterointerfaces is also discussed. These insights highlight the combined importance of microstructure and interface engineering in tuning the transport properties of ionic species in composite materials. In conclusion, our framework can also be extended for understanding generic microstructure-property relationships in other complex multiphase materials.

25 ENERGY STORAGE↗
DOE OSTI2024

AdvEP

AdvEP is a code repository which contains PyTorch implementations of various adversarial attacks on a deep neural network trained with Equilibrium Propagation (EP), which is a neuromorphic learning framework. AdvEP allows for the training, testing, and conducting white/black-box attacks of EP models on a wide variety of applications and datasets. AdvEP is based on the open-source code https://github.com/Laborieux-Axel/Equilibrium-Propagation which was developed to train energy models. AdvEP was created by modifying the original code to perform and test against adversarial attacks. AdvEP was developed in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning. AdvEP interfaces heavily with the open-source PyTorch Python package as well as the open-source Adversarial Robustness Toolbox (ART) package.

Mansingh, Siddarth↗
DOE OSTI2019

A real-time machine learning-based disruption predictor in DIII-D

A disruption prediction algorithm, named DPRF (Disruption Prediction using Random Forests), has run in real-time in the DIII-D plasma control system (PCS) over more than 900 discharges. DPRF naturally provides a probability mapping associated to its predictions, i.e. the disruptivity signal, now incorporated in the DIII-D PCS. Here, we report on disruption prediction accomplishments in terms of shot-by-shot performances, by simulating alarms on each discharge as in the PCS framework. Due to the optimised performance metric chosen to evaluate DPRF, we find that almost all disruptive discharges are detected in average with few hundred of milliseconds of warning time, but this comes at a high cost of false alarms produced. Performances are not satisfying ITER requirements, where the success rate has to be higher than 95%, but this is not completely unexpected. DPRF is trained on many years of major disruptions occurring during the flattop phase of the plasma current on DIII-D, but without any differentiation by cause. Furthermore, we find that DPRF is affected by a relatively high fraction of false alarms occurring during the first 500 milliseconds from the flattop onset. This subtle effect, more evident on the discharges where DPRF ran in real-time, can be marginalized by taking specific precautions on the validity range of the predictions, and performances do improve. Even if presently burdened by some limitations, DPRF provides an incredible and novel advantage. Thanks to the feature contribution analysis (e.g., the identification of which signals contributed to triggering an alarm), it is possible to interpret and explain DPRF predictions. It is the first time that such interpretability features is exploited by a disruption predictor: by uncovering the disruption events' causes, a better understanding of disruption dynamics is achieved, and a clear path toward the design of disruption avoidance strategies can be provided.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Improving the reliability of machine learned potentials for modeling inhomogeneous liquids

The atomic-scale response of inhomogeneous fluids at interfaces and surrounding solute particles plays a critical role in governing chemical, electrochemical, and biological processes. Classical molecular dynamics simulations have been applied extensively to simulate the response of fluids to inhomogeneities directly, but are limited by the accuracy of the underlying interatomic potentials. Here, we use neural network potentials (NNPs) trained to ab initio simulations to accurately predict the inhomogeneous responses of two distinct fluids: liquid water and molten NaCl. Although NNPs can be readily trained to model complex bulk systems across a range of state points, we show that to appropriately model a fluid's response at an interface, relevant inhomogeneous configurations must be included in the training data. In order to sufficiently sample appropriate configurations of such inhomogeneous fluids, we develop protocols based on molecular dynamics simulations in the presence of external potentials. We demonstrate that NNPs trained on inhomogeneous fluid configurations can more accurately predict several key properties of fluids—including the density response, surface tension and size-dependent cavitation free energies—for liquid water and molten NaCl, compared to both empirical interatomic potentials and NNPs that are not trained on such inhomogeneous configurations. This work therefore provides a first demonstration and framework to extract the response of inhomogeneous fluids from first principles for classical density-functional treatment of fluids free from empirical potentials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Security Enhancement of Network Constraint Grid-Edge Energy Management System

Network constrained grid edge energy management system (EMS) provides economic solution for active and reactive power dispatch of distributed energy resources (DERs) at the grid edge level. Grid edge EMS ensures secure interconnection of a circuit segment to the distribution system by maintaining grid code requirements (e.g. IEEE 1547–2018). Grid edge EMS is dependent on communication to receive load measurement, which brings a risk of unobservable false data injection attacks (FDIAs). To mitigate the risk, this paper proposes a framework to enhance resilient operation of grid edge EMS by detecting the unobservable FDIAs on loads and replacing them with forecasted values. In this work, a two-step detection algorithm is proposed. In first step, conventional residual based algorithm is deployed. Autoencoder (AE) based data driven mechanism is included in second step to detect the presence of unobservable FDIAs. After ensuring the presence of FDIA, its specific location is detected by checking the maximum residue values till the predefined threshold value is reached. Detected false data injected loads are then replaced with forecasted load values following long-short term memory (LSTM) based forecast to ensure resilient performance of grid edge EMS in the presence of attacks. This proposed security enhancement framework for grid edge EMS is evaluated in IEEE 13 bus system with three integrated DERs. Numerical simulation shows the validation of the proposed framework by reducing voltage violation in real operation of grid edge EMS.

cyber attack detection↗
DOE OSTI2018

The TENNLab Exploratory Neuromorphic Computing Framework

Spiking, neuromorphic computing systems are in a period of active exploration by the computing community. While they feature computational expressiveness beyond both von Neumann computing models and feed-forward neural networks, they are also challenging to design and program. The TENNLab exploratory neuromorphic computing framework is a software infrastructure, soon to be open-source, whose goal is to enable potential users of spiking, neuromorphic computing systems to develop applications and evaluate computing architectures, and for architecture researchers to develop and evaluate their architectures with a variety of applications. In this letter, we present the software architecture of the TENNLab framework.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Cyber threat assessment of machine learning driven autonomous control systems of nuclear power plants

We report advanced cyber-attacks against critical infrastructure and the energy sector are becoming more common. With the invention of autonomous control systems (ACS) within advanced nuclear reactor designs, system designers, reactor operators, and regulators must consider cybersecurity during the design and operational phases. This article provides a cyber threat assessment of machine learning (ML)-based digital twinning (DT) technologies in the context of advanced reactor ACS. A cyber–physical testbed was created to emulate nuclear reactor digital instrumentation and controls (I&C) and act as a basis for the ACS. The ACS was designed as two plant-level DTs predicting reactor malfunctions and determining control actions and two component-level DTs responsible for classifying component states and forecasting component inputs and outputs (I/O). Two duplicate ACS designs– one using a traditional ML framework and one using an automated ML (AutoML) framework– were created and tested against cyber-attacks on training data, real-time process data, and ML model architectures to determine their respective qualitative cyber-risk in terms of likelihood and impact. Both frameworks showed similar cyber-resilience against training, real-time, and ML architecture attacks, proving that neither is inherently more secure. Recommended safeguard and security measures are posed to system designers, reactor operators, and regulators to maintain the cybersecurity of ML-based DT technologies such as ACS, prompting a holistic view of shared responsibility for maintaining cyber-secure ML-based systems.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Deep Factorization Machine Learning for Disaggregation of Transmission Load Profiles with High Penetration of Behind-The-Meter Solar

The ever-growing integration of distributed energy resources (DERs), especially behind-the-meter (BTM) solar generations, poses imperative operational challenges to system operators such as regional transmission organizations (RTOs). It is important for RTOs to effectively and accurately extract actual load profiles at the transmission level for a single node with significant BTM solar injection. This paper first illustrates the necessity of disaggregating the daily actual load profile of a single node. Furthermore, by segmenting nodes with selected timeseries features, nodes with significant BTM solar generation are identified. Lastly, a bi-level framework is proposed, comprising reference node disaggregation and DeepFM nodal disaggregation, aimed at disaggregating the nodal load profiles from which system operators require more information. By adopting a hybrid Deep Factorization Machine (DeepFM) model, the model achieve accurate results by extracting both linear and nonlinear relations between nodes in the same region and the zonal load and nodal load profile. To overcome the lack of ground truth, this paper segments the load profile into daytime, nighttime, and zero-crossing points and utilizes the latter two for evaluation purposes. The proposed disaggregation procedure is validated using real world, minute-level, normalized, and anonymized nodal data in the PJM service territory.

42 ENGINEERING↗