Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Day-Ahead Probabilistic Forecasting of Net-Load and Demand Response Potentials with High Penetration of Behind-the-Meter Solar-plus-Storage

The goal of this project is to develop advanced methods for day-ahead net-load forecasting, by leveraging the state-of-the-art machine learning techniques. The developed models produce both point and probabilistic forecasts for a variety of use cases, and are versatile to work with different types of data sets. The innovation lies in the novel design of the architectures, leveraging the most recent advances in machine learning that have not been explored in power systems, accompanied by techniques in the broader artificial intelligence fields such as fuzzy systems. This project has achieved the following accomplishments: (1) preprocessing of over 10 data sets covering varying geographical regions, time horizons, and system levels, which form a robust foundation for training and evaluating forecasting models across a wide range of realistic grid scenarios; (2) development of an interactive web app that enables exploratory analysis of load and generation data, and supports better understanding of data trends, anomalies, and correlations, facilitating model development and stakeholder engagement; (3) implementation of over 10 benchmark models for point and probabilistic forecasting, which include a mix of conventional machine learning methods and state-of-the-art deep learning approaches, providing a comprehensive baseline for performance comparison and validation of the proposed models; (4) development of a fuzzy system based gradient boosting model, tailored for small (less than 3 years) data sets, which achieves a mean absolute percentage error (MAPE) of 4% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (5) development of a Transformer (a state-of-the-art deep learning architecture) based neural network model, tailored for large (3 years or more) data sets, which achieves a MAPE of 2% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (6) development of a methodology for quantifying DR potential, and extensions of the previous models for multi-target forecasting of net load and DR potential, which achieve a MAPE of 10% for DR potential.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Off-policy deep reinforcement learning with automatic entropy adjustment for adaptive online grid emergency control

Electric overloading conditions and contingencies put modern power systems at risk of voltage collapse and blackouts. Load shedding is crucial to maintain voltage stability for grid emergency control. However, the rule- or model-based schemes rely on accurate dynamic system models and face considerable challenges in adapting to various operating conditions and uncertain event occurrences. Here, to address these issues, this paper proposes a novel deep reinforcement learning (DRL)-based voltage stability control algorithm with automatic entropy adjustment (AEA) for grid emergency control. Various dynamic network components for complex system operations are modeled to construct the DRL environment. An off-policy soft actor-critic architecture is developed to maximize the expected reward and policy entropy simultaneously. The AEA mechanism is proposed to facilitate the policy maximum entropy procedure, and the proposed method can automatically provide effective discrete and continuous actions against various fault scenarios. Our approach accomplishes high sampling efficiency, scalability, and auto-adaptivity of the control policies under high uncertainties. Comparative studies with the existing DRL-based control methods in IEEE benchmarks indicate salient performance improvement of the proposed method for dynamic system emergency control.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

1.2.4.404 - Data-Driven Approach for Hydropower Plant Controller Prototyping Using Remote Hardware in the Loop (DR-HIL)

Real-time prototyping of hydropower plant controls is important for reducing the cost and the risk of field deployment. This project will 1) collect design and operational data from actual hydro plants and 2) use a physics-informed machine learning approach for real-time emulation of hydropower plants, including hydro turbine and hydrodynamics. The data-driven models will be interfaced with digital real-time simulation at NREL’s Flatirons campus for hardware-in-the-loop (HIL) testing of the governor hardware device or controller-HIL (CHIL). The proposed approach will also establish the connectivity based remote CHIL testing capability using real-time data streams from an actual hydro plant. This integrated hydro-plant emulation with CHIL will be used to prototype hydro-governor controls and eventually provide an opportunity to test hydropower integrated with various technologies (e.g. conventional and renewable generation, energy conversion, etc.) as HIL.

controls prototyping↗
DOE OSTI2026

Ensemble Federated Machine Learning‐Based Cybersecurity Situational Awareness in Microgrid Network

Cyber-physical microgrids are vulnerable to stealthy cybersecurity threats that disguise their actions through the exploitation of system knowledge. Such actions can severely impacts microgrids deployed in defense bases, slowing the response time of military forces during national emergencies. Several machine-learning algorithms have been proposed to detect intrusions in the grid networks; however, these traditional machine-learning algorithms lack data privacy and are subject to several adversarial machine-learning threats. This paper proposes a novel federated machine learning (FML)-based three-model framework to detect and identify stealthy data-integrity attacks while ensuring data privacy in microgrid networks. The proposed architecture uses a variational mode decomposition technique to extract derived features from incoming measurement and control datasets. The extraction of these derived features allows FML models to learn minute variations in data patterns that allow them to perform significantly better than the models trained with generic datasets consisting of raw features. Our experimental results show the efficient performance of the proposed methodology against different types of data integrity attacks while considering primary and secondary controllers in microgrids. Further, the applied FML-integrated random forest ensemble algorithm outperforms the existing generic FML algorithms during noisy and noise-free datasets with prediction latencies of only 91–134 µs per sample within the 0.1 s sampling interval and requires communication bandwidth of around ∼8.25 KB/s at the control center and ∼2.7 KB/s per edge client for communication.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Advancing spatiotemporal forecasts of CO 2 plume migration using deep learning networks with transfer learning and interpretation analysis

Accurate and timely forecasts of CO 2 plume distribution throughout the injection and post-injection phases are crucial for detecting plume migration, assessing leakage risks, and supporting operational decisions in geologic carbon storage (GCS). Current convolutional neural network-based approaches primarily focus on spatial information and overlook temporal dependencies in plume distributions, thus limiting their ability to capture dynamic movement effects and provide accurate predictions of plume migration. In this work, we propose two deep learning models, Auto-Encoder (AE)-LSTM and Encoder-Decoder (ED)-ConvLSTM, each uniquely designed to capture both spatial and temporal features. We apply the proposed methods to forecast the dynamic distribution of CO 2 plumes based on 108 reservoir simulations over a 30-year injection and a 30-year post-injection period. The results indicate that the ED-ConvLSTM model outperforms the AE-LSTM model in accurately predicting the spatiotemporal dynamics of CO 2 plume migration, achieving R 2 values above 0.99. To provide a deeper understanding of these model predictions, we employ a gradient-based explanation method on the trained models. This approach provides insights into the influence of input variables on plume migration forecasts and uncovers the underlying prediction mechanisms of the proposed models. Furthermore, we introduce a transfer learning technique, enabling fast and accurate plume migration forecasting in the post-injection phase by leveraging the trained model during the injection phase. This reduces the necessity for extensive data collection or re-training. In conclusion, the methods proposed in our work enhances the performance and interpretability of CO 2 plume migration forecasts, thereby facilitating informed decision-making throughout the entire lifecycle of GCS applications.

58 GEOSCIENCES↗
DOE OSTI2023

LA100 Equity Strategies. Chapter 4: Lessons Learned and Options for Community Engagement in Los Angeles

The LA100 Equity Strategies project synthesizes community guidance with robust research, modeling, and analysis to identify strategy options that can increase equitable outcomes in Los Angeles' clean energy transition. Grounded in the analysis of past and ongoing energy inequities and engagement with underserved communities, the project presents community-guided strategies that aim to operationalize recognition and procedural justice. Building on the community-identified problems and solutions, and the analysis of the 11 strategies described in Chapter 3, this chapter continues to focus on the solution space through the lens of recognition and procedural justice. It centers the role of community engagement in energy utility planning and project development with a specific focus on how the Los Angeles Department of Water and Power (LADWP) can engage and work equitably with Los Angeles communities to cocreate a clean and just energy future for LA. LA100 Equity Strategies is rooted in the crucial role community engagement plays in restructuring the energy systems of cities, states, and nations. Scholarship on wind, solar, and other transitional energy technologies and projects has documented that such engagement is commonly used as a top-down mechanism for adapting social practices to fit new technological innovations. Yet, understanding how the clean energy transition - with related changes in technologies, infrastructures, practices, and costs - will fit equitably into the existing socio-political context is a challenge that requires substantive collaboration with local communities. Any form of community engagement opens up government officials and utilities to opposition from their public. Meaningful engagement methods turn such dissent into a strength, embracing critical feedback - particularly from communities historically excluded from decision-making - as contributing to more grounded design and effective implementation. Leveraging this collaborative model to further rectify past and ongoing inequities in the social, cultural, and institutional scaffolding of LA, this chapter presents options and methods to support LADWP in launching a just and equitable clean energy transition. We approach community engagement as a critical process linking recognition, procedural, and distributional justice, outlining how LADWP could learn from past engagement, coordinate such knowledge organization-wide, and use engagement as a key tool for achieving energy justice and equity.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2017

Consumption Behavior Analytics-Aided Energy Forecasting and Dispatch

For decades, electricity customers have been treated as mere recipients of electricity in vertically integrated power systems. However, as customers have widely adopted distributed energy resources and other forms of customer participation in active dispatch (such as demand response) have taken shape, the value of mining knowledge from customer behavior patterns and using it for power system operation is increasing. Further, the variability of renewable energy resources has been considered a liability to the grid. However, electricity consumption has shown the same level of variability and uncertainty, and this is sometimes overlooked. This article investigates data analytics and forecasting methods to identify correlations between electricity consumption behavior and distributed photovoltaic (PV) output. The forecasting results feed into a predictive energy management system that optimizes energy consumption in the near future to balance customer demand and power system needs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Photometric redshifts for the S-PLUS Survey: Is machine learning up to the task?

The Southern Photometric Local Universe Survey (S-PLUS) is a novel project that aims to map the Southern Hemisphere using a twelve filter system, comprising five broad-band SDSS-like filters and seven narrow-band filters optimized for important stellar features in the local universe. In this paper we use the photometry and morphological information from the first S-PLUS data release (S-PLUS DR1) cross-matched to unWISE data and spectroscopic redshifts from Sloan Digital Sky Survey DR15. We explore three different machine learning methods (Gaussian Processes with GPz and two Deep Learning models made with TensorFlow) and compare them with the currently used template-fitting method in the S-PLUS DR1 to address whether machine learning methods can take advantage of the twelve filter system for photometric redshift prediction. Using tests for accuracy for both single-point estimates such as the calculation of the scatter, bias, and outlier fraction, and probability distribution functions (PDFs) such as the Probability Integral Transform (PIT), the Continuous Ranked Probability Score (CRPS) and the Odds distribution, we conclude that a deep-learning method using a combination of a Bayesian Neural Network and a Mixture Density Network offers the most accurate photometric redshifts for the current test sample. In conclusion, it achieves single-point photometric redshifts with scatter (σ NMAD ) of 0.023, normalized bias of -0.001, and outlier fraction of 0.64% for galaxies with r_auto magnitudes between 16 and 21.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Subtask 1.1 – Advanced Characterization of Unconventional Oil and Gas Reservoirs to Enhance CO2 Storage Resource Estimates

The Energy & Environmental Research Center (EERC) developed methods and approaches for advanced characterization of unconventional oil and gas reservoirs to enhance CO2 storage resource estimates using samples collected from organic-rich shales of the Bakken Formation. The project was funded under U.S. Department of Energy (DOE) Cooperative Agreement No. DE-FE0024233, with nonfederal cost share provided by Hitachi High Technologies America. The project participants included the EERC, Hitachi High Technologies America, the team at the National Energy Technology Laboratory’s (NETL’s) computed tomography (CT) scanning laboratory in Morgantown, West Virginia, and several NETL staff who have worked on CO2 storage resource estimation. Investigations on the use of subsurface geologic formations for CO2 storage have been ongoing for many years. In the last decade, improvements in directional drilling technology and hydraulic fracturing of organic-rich shale and other tight rock formations have opened new opportunities for CO2 storage, with the potential cobenefit of enhancing gas and oil recovery. Gas-bearing, organic-rich shales have been of particular interest as a carbon storage target because their ability to store large volumes of CO2 is implied by their ability to store methane; however, estimating the CO2 storage resource of organic-rich shales and other unconventional reservoirs is challenging because of the lack of detailed geologic and petrophysical data that are needed to develop improved volumetric equations. According to NETL’s method for estimating regional-scale CO2 storage resources, the key factors that control CO2 storage in geologic formations include void space within induced fractures, natural fractures and matrix pores, as well as the occurrence and distribution of organic matter (OM) and clay minerals. A key goal of this effort was to use field emission scanning electron microscopy (FESEM) analysis of fine-grain unconventional reservoir rocks coupled with advanced image analysis and machine learning techniques to quantify the occurrence and distribution of porosity, OM, and clay minerals. By better understanding the potential migration pathways of CO2 within tight rocks and quantifying the occurrence of sorptive components (OM and clays) along potential flow pathways, methods to estimate the CO2 storage resource of such rocks can be refined. The Bakken petroleum system (Bakken) was used as the source of rock samples for this effort because it includes organic-rich shales with contrasting degrees of thermal maturity as well as tight, nonshale clastic rocks with varying clay mineral content. To better understand the key components of interest in tight rock samples, the EERC worked closely with Hitachi to optimize the FESEM settings necessary to resolve the sample mineralogy, porosity and OM content at micro- to nanoscale resolution. The EERC also worked closely with Hitachi to apply and improve its advanced mineral identification and characterization system (AMICS) software so that it is better suited for mineral identification at the high resolution necessary to resolve features of interest in fine-grained rocks such as organic-rich shales. The EERC also applied advanced image analysis software packages, including Ilastik, to classify and quantify the key components of interest within the samples using FESEM imagery. These advanced techniques allowed for quantification and differentiation of the void space within fractures, pores and OM, as well as a technique to determine and quantify the key mineral and OM components surrounding pore spaces. Being able to better quantify the void space and the potential accessibility of CO2 to sorptive minerals or OM within tight rocks allows for improved estimation of the CO2 storage resource potential of organic-rich shales and other unconventional formations. The information derived from the image analysis techniques was used to refine NETL’s method for estimating regional-scale CO2 storage resources in collaboration with staff from NETL. An additional goal of this work was to better understand rates of CO2 permeation, flow pathways, and sorption in organic-rich shales and nonshale reservoir rocks and to evaluate potential changes in CO2 flow over time. The EERC conducted long-duration (several weeks) CO2 flow-through testing at reservoir conditions using Bakken shale and nonshale samples to assess CO2 permeation rates and retention/sorption within core plugs to represent bulk matrix behavior. Conventional isothermal adsorption testing over a range of pressure conditions was also performed on pulverized Bakken samples to better assess potential maximum sorptive capacity of the samples. The results of this testing illustrated the higher sorptive capacity of the Bakken shales when compared to the sorptive capacity of the nonshale reservoir rock, which contains very little OM when compared to the Bakken shales. The results also illustrate the differences in permeation behavior as a function of fracture flow versus matrix flow. In an attempt to visualize CO2 permeation and flow behavior in Bakken shale samples over time, the EERC collaborated with NETL’s CT Lab in Morgantown, West Virginia. A variety of tests were performed at the NETL lab on unfractured and fractured samples of the Bakken shale. The unfractured Bakken shale samples did not result in CO2 migration within the samples over the testing duration; thus imagery of CO2 migration pathways within the matrix of Bakken samples was not obtained. The results of the flow-through testing within fractured samples illustrate changes in CO2 permeation rates over time, with a trend of decreasing CO2 flow over time. The results of this effort suggest that FESEM analysis coupled with advanced image analysis and machine learning techniques are effective in characterizing and quantifying the mineralogy, porosity, fractures, and OM content of 2-D imagery at the high resolution needed to identify features of interest in tight rocks. In addition, the image analysis techniques allow for identification and quantification of different porosity types as well as the key mineral components and/or OM that CO2 would contact in the reservoir as it migrates through pores and fracture networks. This is key information needed to better estimate the CO2 storage resource potential of organic-rich shales and other tight reservoirs. Additional work is needed to determine the sorptive capacity of the individual sample components (OM and clay minerals) at reservoir conditions so that this approach and the refined CO2 storage resource equation can be applied to other shale and unconventional reservoirs. In addition, subsequent work should be performed to better understand the number of images needed to use stereological approaches to estimate the volume of sample components using 2-D imagery, to explore machine learning techniques to differentiate between induced vs. natural fractures, and to estimate the connectivity of pores and fracture networks using 2-D imagery. Being able to derive this information at the microscale would facilitate scaling up of the sample characterization data used for reservoir modeling and simulation to estimate the CO2 storage resource potential of tight formations.

03 NATURAL GAS↗
DOE OSTI2024

Decoding the Pair Distribution Function of Uranium in Molten Fluoride Salts from X-Ray Absorption Spectroscopy Data by Machine Learning

Thermal properties of actinides in molten salts are linked to the strongly disordered local environment of actinide ions. Here, we illustrate both the limitations of the commonly used fitting method for analysis of extended X-ray absorption fine structure (EXAFS) spectra in molten UF 4 and a possible solution using an "objective neural network - EXAFS" (ONNE) method. ONNE provides both extraction of the pair distribution function, as validated by its application to the EXAFS spectra calculated on molecular dynamics trajectory, and the EXAFS data reconstruction. The ONNE analysis of the molten UF4 has revealed reduction of the first nearest neighbor U-F coordination number, expansion of the U-F bond length and smaller contribution to the second shell compared to its crystalline counterpart. This method is therefore an attractive alternative to conventional EXAFS analysis and molecular dynamics simulations for studies of disordered environment of actinides in molten salts.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2023

Probabilistic Physics-Informed Graph Convolutional Network for Active Distribution System Voltage Prediction

Here this letter proposes a novel data-driven probabilistic physics-informed graph convolutional network (GCN) for active distribution system voltage prediction with PVs and EVs. It leverages both measurements and network topology to accurately and efficiently predict node voltages without the need for an accurate distribution system power flow model. The dropout-enabled Bayesian inference is developed to achieve uncertainty quantification of the voltage prediction. Thanks to the network model embedding, it also has robustness against topology changes, a key difference with existing machine learning-based approaches. Comparison results with other state-of-the-art machine learning methods on a realistic 759-node distribution system demonstrate that the proposed method can achieve better accuracy and robustness under different scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Accelerating geostatistical modeling using geostatistics-informed machine Learning

Ordinary Kriging (OK) is a popular geostatistical algorithm for spatial interpolation and estimation. The computational complexity of OK changes quadratically and cubically for memory and speed, respectively, given the number of data. Therefore, it is computationally intensive and also challenging to process a large set of data, especially in three-dimensional (3D) cases. This paper develops a geostatistics-informed machine learning (GIML) model to improve the efficiency of OK by reducing the number of points required to be estimated using OK. Specifically, only a very few of the unknown points are estimated by OK to get the weights and estimations, which are used as the training dataset. Moreover, the governing equations of OK are used to guide our proposed machine learning to better reproduce the spatial distributions. Our results show that the proposed GIML can reduce the computational time of OK by at least one order of magnitude. The effectiveness of the GIML is evaluated and compared using a 2D case. Furthermore, we demonstrate its efficiency and robustness by considering a different number of training samples on various 3D simulation grids.

58 GEOSCIENCES↗
DOE OSTI2022

Power quality disturbances diagnosis: A 2D densely connected convolutional network framework

The fast and accurate diagnosis of power quality disturbances (PQD) aids in avoiding shutdowns and unnecessary procedures, concerning electric energy distribution systems. As such, a number of techniques have been tested and applied in order to reach this objective. Majority of the techniques applied are two-step based. On the first step, power quality disturbances features are extracted. Second step, considering features extracted, disturbance classification is implemented. Recently, relevant literature has presented data-driven signal processing-based approaches, as deep convolutional neural networks (DCNN), which can implement both processing steps while providing automated recognition of patterns and outliers in data. However, not considered by state-of-art, power quality disturbances are evolving in nature, while all possible regularities might not be represented in the dataset. In this work a 2 Dimension Densely Connected Convolutional Network (2D-DenseNet) framework is presented. Further, a case study with synthetic disturbance events are analyzed. Easy-to-implement formulation, built on the 2D-DenseNet, without hard-to-design parameters, highlight potential aspects for real-life implementation.

42 ENGINEERING↗
DOE OSTI2023

Prediction of dislocation - grain boundary interactions in FCC aluminum bicrystals using a modified continuum criterion and machine learning methods

Mechanical properties of metals such as strength and toughness are strongly correlated to complex interactions between various defects in the crystalline structure. While elementary interactions between these defects have been investigated using recent micro- and nano-characterization techniques, understanding of the detailed interaction mechanisms has hardly been obtained. To understand defect-driven plasticity at various time and length scales, it is necessary to formulate a general guideline to predict both the interaction type (transmission or reflection) and the dislocation's subsequent slip system after the interaction. Many criteria based on the geometric alignment of the defects have been developed to predict this phenomenon, but these have yet to be found to be accurate when applied to general data sets of grain boundaries (GBs). With this motivation, we conduct a systematic study using molecular dynamics (MD) models of bicrystals to analyze defect interaction process between a prismatic dislocation loop and eleven different grain boundaries of the following character: three tilt, three twist, and five mixed. Based on the MD observations, two new prediction methods are developed: the first is a new data-driven parametric score function based on the classical geometric criteria, and the second is by applying Gaussian process machine learning methods to find the probability distribution of a hidden function. In conclusion, the proposed data-driven prediction methods could pave a new way to predict the unit interaction of dislocations with various GBs, which could show much higher accuracy compared to pre-existing geometric criteria.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Efficient 3D Molecular Design with an E(3) Invariant Transformer VAE

This work introduces a three-dimensional (3D) invariant graph-to-string transformer variational autoencoders (VAE) (Vagrant) for generating molecules with accurate density functional theory (DFT)-level properties. Vagrant learns to model the joint probability distribution of a 3D molecular structure and its properties by encoding molecular structures into a 3D-aware latent space. Directed navigation through this latent space implicitly optimizes the 3D structure of a molecule, and the latent embedding can be used to condition a generative transformer to predict the candidate structure as a one-dimensional (1D) sequence. Additionally, we introduce two novel sampling methods that exploit the latent characteristics of a VAE to improve performance. Here, we show that our method outperforms comparable 3D autoregressive and diffusion methods for predicting quantum chemical property values of novel molecules in terms of both sample quality and computational efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

4D-STEM Coupled with Unsupervised Machine Learning to Reveal at Large-Scale the Microstructural Evolution in Li- and Mn-Rich Cathodes

Li- and Mn-rich (LMR) layered oxides are known to exhibit a thin surface reconstruction layer, which grows during electrochemical cycling in a manner that depends on exposed crystallographic facets, cycling conditions, and electrolyte chemistry. Direct characterization of this layer has traditionally relied on high-resolution electron microscopy, which is inherently limited to small fields of view. Here, we employ four-dimensional scanning transmission electron microscopy (4D-STEM) combined with unsupervised machine-learning clustering to quantitatively map phase distributions over large areas and track their evolution in LMR cathodes during electrochemical aging. Our results show that the surface reconstruction layer consists predominantly of a rocksalt phase, whose thickness varies across different facets following activation cycling and becomes substantially thicker and more uniform during calendar aging. In contrast, a spinel-like phase is observed within the particle bulk. Large-area phase mapping and correlative high-resolution imaging reveal that this spinel-like phase preferentially nucleates at bulk crystallographic defects, including boundaries between 60°-rotated layered domains and associated mixed-phase regions, rather than exclusively at the particle surface. Our findings establish a mechanistic distinction between surface-driven rocksalt formation and bulk-defect-mediated spinel nucleation while demonstrating the unique capability of 4D-STEM to provide statistically robust, mesoscale insight into complex phase-evolution processes in LMR cathodes.

4D-STEM↗
DOE OSTI2018

Cross-Scale Molecular Analysis of Chemical Heterogeneity in Shale Rocks

The organic and mineralogical heterogeneity in shale at micrometer and nanometer spatial scales contributes to the quality of gas reserves, gas flow mechanisms and gas production. Here, we demonstrate two molecular imaging approaches based on infrared spectroscopy to obtain mineral and kerogen information at these mesoscale spatial resolutions in large-sized shale rock samples. The first method is a modified microscopic attenuated total reflectance measurement that utilizes a large germanium hemisphere combined with a focal plane array detector to rapidly capture chemical images of shale rock surfaces spanning hundreds of micrometers with micrometer spatial resolution. The second method, synchrotron infrared nano-spectroscopy, utilizes a metallic atomic force microscope tip to obtain chemical images of micrometer dimensions but with nanometer spatial resolution. This chemically "deconvoluted" imaging at the nano-pore scale is then used to build a machine learning model to generate a molecular distribution map across scales with a spatial span of 1000 times, which enables high-throughput geochemical characterization in greater details across the nano-pore and micro-grain scales and allows us to identify co-localization of mineral phases with chemically distinct organics and even with gas phase sorbents. Finally, this characterization is fundamental to understand mineral and organic compositions affecting the behavior of shales.

04 OIL SHALES AND TAR SANDS↗
DOE OSTI2023

Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics

Sampling from known probability distributions is a ubiquitous task in computational science, underlying calculations in domains from linguistics to biology and physics. Generative machine-learning (ML) models have emerged as a promising tool in this space, building on the success of this approach in applications such as image, text, and audio generation. Often, however, generative tasks in scientific domains have unique structures and features—such as complex symmetries and the requirement of exactness guarantees—that present both challenges and opportunities for ML. This Perspective outlines the advances in ML-based sampling motivated by lattice quantum field theory, in particular for the theory of quantum chromodynamics. Enabling calculations of the structure and interactions of matter from our most fundamental understanding of particle physics, lattice quantum chromodynamics is one of the main consumers of open-science supercomputing worldwide. Here, the design of ML algorithms for this application faces profound challenges, including the necessity of scaling custom ML architectures to the largest supercomputers, but also promises immense benefits, and is spurring a wave of development in ML-based sampling more broadly. In lattice field theory, if this approach can realize its early promise it will be a transformative step towards first-principles physics calculations in particle, nuclear and condensed matter physics that are intractable with traditional approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗