Results for “Distributed Learning” — Page 55

DOE OSTI2019

A machine learning approach to thermal conductivity modeling: A case study on irradiated uranium-molybdenum nuclear fuels

A deep neural network was developed for the purpose of predicting thermal conductivity with a case study performed on irradiated nuclear fuel. Traditional thermal conductivity modeling approaches rely on existing theoretical frameworks that describe known, relevant phenomena that govern the microstructural evolution processes during neutron irradiation (such as recrystallization, and pore size, distribution and morphology). Current empirical modeling approaches, however, do not represent all irradiation test data well. We develop a machine learning approach to thermal conductivity modeling that does not require a priori knowledge of a specific material microstructure and system of interest. Our approach allows re-searchers to probe dependency of thermal conductivity on a variety of reactor operating and material conditions. The purpose of building such a model is to allow for improved predictive capabilities linking structure-property-processing-performance relationships in the system of interest (here, irradiated nuclear fuel), which could lead to improved experimental test planning and characterization. The uranium-molybdenum system is the fuel system studied in this work, and historic irradiation test data is leveraged for model development. Our model achieved a mean absolute percent error of approximately 10%. Results indicate our model generalizes well to never before seen data, and thus use of deep learning methods for material property predictions from limited, historic irradiation data is a viable approach. This work challenges the current paradigm in materials science, where material property models are based on limited experimental data fitted to low-dimensionality phenomenological models, or by simulations in which fundamental equations are explicitly solved. The work presented here aims to demonstrate the potential and limitations of machine learning in the field of materials science and material property modeling.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2016

TH-AB-BRB-00: Research Opportunities with Digital Linear Accelerators

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

TH-AB-BRB-01: Trajectory Modulated Arc Therapy: Application to Partial Breast Irradiation

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

TH-AB-BRB-02: ET-Reloaded

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

TH-AB-BRB-03: 4n Radiotherapy

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

TH-AB-BRB-04: Quality Assurance for Advanced Digital Linac Implementations

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

TH-AB-BRB-05: Using a Research Real-Time Control Interface to Go Beyond Dynamic MLC Tracking

Current state-of-the art digital C-arm medical linear accelerators are capable of delivering radiation treatments with high level of automation, which affords coordinated motions of gantry, couch, and multileaf collimator (MLC) with dose rate modulations. The new machine capacity has shown the potential to bring substantially improved radiation dosimetry and/or delivery efficiency to many challenging diseases. Combining an integrated beam orientation optimization algorithm with automated machine navigation, markedly improved dose conformity has been achieved using 4ρ therapy. Trajectory modulated radiation therapy (TMAT) can be used to deliver highly conformal dose to partial breast or to carve complex dose distribution for therapy involving extended volumes such as total marrow and total lymph node treatment. Dynamic electron arc radiotherapy (DEAR) not only overcomes the deficiencies of conventional electron therapy in dose conformity and homogeneity but also achieves so without patient-specific shields. The combination of MLC and couch tracking provides improved motion management of thoracic and abdominal tumors. A substantial body of work has been done in these technological advances for clinical translation. The proposed symposium will provide a timely review of these exciting opportunities. Learning Objectives: Recognize the potential of using digitally controlled linacs for clinically significant improvements in delivered dose distributions for various treatment sites. Identify existing approaches to treatment planning, optimization and delivery for treatment techniques utilizing the advanced functions of digital linacs and venues for further development and improvement. Understand methods for testing and validating delivery system performance. Identify tools available on current delivery systems for implementation and control for such treatments. Obtain the update in clinical applications, trials and regulatory approval. K. Sheng, NIH U19AI067769, NIH R43CA183390, NIH R01CA188300, Varian Medical Systems V. Yu, Varian Medical Systems, AAPM Summer Undergraduate Fellowship, NSF graduate fellowship S. Nill, Elekta AB. Cancer Research UK under Programme C33589/A19727, NIHR Biomedical Research Centre at The Royal Marsden and The Institute of Cancer Research.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗

DOE OSTI2016

WE-DE-202-01: Connecting Nanoscale Physics to Initial DNA Damage Through Track Structure Simulations

Radiation therapy for the treatment of cancer has been established as a highly precise and effective way to eradicate a localized region of diseased tissue. To achieve further significant gains in the therapeutic ratio, we need to move towards biologically optimized treatment planning. To achieve this goal, we need to understand how the radiation-type dependent patterns of induced energy depositions within the cell (physics) connect via molecular, cellular and tissue reactions to treatment outcome such as tumor control and undesirable effects on normal tissue. Several computational biology approaches have been developed connecting physics to biology. Monte Carlo simulations are the most accurate method to calculate physical dose distributions at the nanometer scale, however simulations at the DNA scale are slow and repair processes are generally not simulated. Alternative models that rely on the random formation of individual DNA lesions within one or two turns of the DNA have been shown to reproduce the clusters of DNA lesions, including single strand breaks (SSBs), double strand breaks (DSBs) without the need for detailed track structure simulations. Efficient computational simulations of initial DNA damage induction facilitate computational modeling of DNA repair and other molecular and cellular processes. Mechanistic, multiscale models provide a useful conceptual framework to test biological hypotheses and help connect fundamental information about track structure and dosimetry at the sub-cellular level to dose-response effects on larger scales. In this symposium we will learn about the current state of the art of computational approaches estimating radiation damage at the cellular and sub-cellular scale. How can understanding the physics interactions at the DNA level be used to predict biological outcome? We will discuss if and how such calculations are relevant to advance our understanding of radiation damage and its repair, or, if the underlying biological processes are too complex for a mechanistic approach. Can computer simulations be used to guide future biological research? We will debate the feasibility of explaining biology from a physicists’ perspective. Learning Objectives: Understand the potential applications and limitations of computational methods for dose-response modeling at the molecular, cellular and tissue levels Learn about mechanism of action underlying the induction, repair and biological processing of damage to DNA and other constituents Understand how effects and processes at one biological scale impact on biological processes and outcomes on other scales J. Schuemann, NCI/NIH grantsS. McMahon, Funding: European Commission FP7 (grant EC FP7 MC-IOF-623630)

60 APPLIED LIFE SCIENCES↗

DOE OSTI2018

Toward Uncertainty Quantification for Supervised Classification

Our goal is to develop a general theoretical basis for quantifying uncertainty in supervised machine learning models. Current machine learning accuracy-based validation metrics indicate how well a classifier performs on a given data set as a whole. However, these metrics do not tell us a model's efficacy in predicting particular samples. We quantify uncertainty by constructing probability distributions of the predictions made by an ensemble of classifiers. This report details our initial investigations into uncertainty quantification for supervised machine learning. We apply an uncertainty analysis to the problem of malicious website detection. Machine learning models can be trained to find suspicious characteristics in the text of a website's Uniform Resource Locator (URL). However, given the vast numbers of URLs and the ever changing tactics of malicious actors, it will always be possible to find sets of websites which are outliers with respect to a model's hypothesis. Therefore, we seek to understand a model's per-sample reliability when classifying URL data. Acknowledgements This work was funded by the Sandia National Laboratories Laboratory Directed Research and Development (LDRD) program.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Neural simulation-based inference of the neutron star equation of state directly from telescope spectra

Neutron stars provide a unique opportunity to study strongly interacting matter under extreme density conditions. The intricacies of matter inside neutron stars and their equation of state are not directly visible, but determine bulk properties, such as mass and radius, which affect the star's thermal X-ray emissions. However, the telescope spectra of these emissions are also affected by the stellar distance, hydrogen column, and effective surface temperature, which are not always well-constrained. Uncertainties on these nuisance parameters must be accounted for when making a robust estimation of the equation of state. In this study, we develop a novel methodology that, for the first time, can infer the full posterior distribution of both the equation of state and nuisance parameters directly from telescope observations. This method relies on the use of neural likelihood estimation, in which normalizing flows use samples of simulated telescope data to learn the likelihood of the neutron star spectra as a function of these parameters, coupled with Hamiltonian Monte Carlo methods to efficiently sample from the corresponding posterior distribution. Our approach surpasses the accuracy of previous methods, improves the interpretability of the results by providing access to the full posterior distribution, and naturally scales to a growing number of neutron star observations expected in the coming years.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2018

Integrated Multi Scale Data Analytics and Machine Learning for the Grid; Benchmarking Algorithms and Data Quality Analysis

Machine Learning and Data Analytics are terms which are utilized now ubiquitously throughout grid analytics forums, as a potential solution to the growing big data challenges for the distribution grid. As sensors become inexpensive and common, and communication networks grow, the analytics themselves must adapt and enable consumers and providers to visualize and utilize the data provided effectively. Machine learning is one of the techniques proposed in order to manage this data deluge. This report is a subset of the work in this activity, funded through the DOE Grid Modernization Initiative, to summarize the benchmarking and review of data quality impact on the algorithm sets being developed within each use case area.

42 ENGINEERING↗

DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2023

Hierarchical Flexibility Offering Strategy for Integrated Hybrid Resources in Real-time Energy Markets

This paper proposes a hierarchical model for determining the energy flexibility offering strategy of integrated hybrid resources (IHRs) in power distribution systems to participate in real-time energy markets. The proposed model utilizes the scalability, fast response time, and uncertainty observation of deep reinforcement learning (DRL) to overcome the scalability issue of operating numerous flexible resources and deliverability of energy flexibility to the real-time markets in the presence of the network constraints. To that end, the power distribution system is divided into multiple IHRs, where different types of flexible loads, energy storage systems, and solar plants with controllable inverters are operated through local IHR controllers, trained by deep deterministic policy gradient (DDPG) algorithm. Active power request and reactive power capacity of IHRs are then transmitted to a central flexibility controller, where a quadratic optimization model ensures the deliverability of the energy flexibility to the real-time energy market by satisfying the distribution network constraints. The proposed model is implemented on the 123-bus test power distribution system, demonstrating the capability of DRL-based hierarchical model for scalable operation of IHRs in order to offer deliverable energy flexibility to the real-time energy market.

Majidi, Majid↗

DOE OSTI2023

Deep learning of electrochemical CO 2 conversion literature reveals research trends and directions

Large-scale and openly available material science databases are mainly composed of computer simulation results rather than experimental data. Some examples include the Materials Project, Open Quantum Materials Database, and Open Catalyst 2022. Unfortunately, building large-scale experimental databases remains challenging due to the difficulties in consolidating locally distributed datasets. In this work, focusing on the catalysis literature of CO 2 reduction reactions (CO 2 RRs), we present a machine learning (ML)-based protocol for selecting highly relevant papers and extracting important experimental data. First, we report a document embedding method (Doc2Vec) for collecting papers of greatest relevance to the specific target domain, which yielded 3154 CO 2 RR-related papers from six publishers. Next, we developed named entity recognition (NER) models to extract twelve entities related to material names (catalyst, electrolyte, etc.) and catalytic performance (Faradaic efficiency, current density, etc.). Further, among several tested models, the MatBERT-based approach achieved the highest accuracy, with an average F1-score of 90.4% and an F1-score of 95.2% in a boundary relaxation evaluation scheme. The accurate and accelerated NER-based data extraction from a large volume of catalysis literature enables temporal trend analyses of the CO 2 RR catalysts, products, and performances, revealing the potentially effective material space in CO 2 RRs. While this work demonstrates the effectiveness of our ML-based text mining methods for specifically CO 2 RR literature, the methods and approach are applicable to and may be used to accelerate the development of other catalytic chemical reactions.

36 MATERIALS SCIENCE↗

DOE OSTI2019

Neural network modeling of in situ fluid-filled pore size distributions in subsurface shale reservoirs under data constraints

Subsurface nuclear magnetic resonance (NMR) logs acquired in the wellbore environment are sensitive to fluid-filled pore size distribution, fluid mobility, permeability, and porosity in the near-wellbore reservoir volume. NMR response of a formation layer is processed to extract the T2 distribution, which approximates the fluid-filled pore size distribution. NMR logs are acquired in limited number of wells due to financial and operational challenges, which adversely affects reservoir characterization. We developed here two neural-network-based machine learning techniques, long short-term memory (LSTM) network and variational autoencoder with a convolutional layer (VAEc) network, to process the ‘easy-to-acquire’ formation mineral and fluid saturation logs to generate synthetic NMR T2 distributions in the absence of ‘hard-to-acquire’ NMR T2 distribution log. Both the predictive models are trained and tested on limited wireline log measurements randomly selected from a 300-ft depth interval of the Bakken shale formation. Synthesis performances of LSTM and VAEc models in terms of R 2 are 0.78 and 0.75, respectively. Noise is inevitable in logging data due to the complex wellbore and formation conditions. Notably, both the predictive models robustly synthesize the fluid-filled pore size distributions in the presence of 50% noise in input logs and 30% noise in training T2 data. The performance of the proposed methodology improves with access to larger volume of training data from other formation types. The proposed method is critical to the synthesis of in situ fluid-filled pore size distributions in shale formations under data constraints due to financial and operational challenges.

58 GEOSCIENCES↗

DOE OSTI2024

Deep-Learning-Based Multi-Timescale Load Forecasting in Buildings: Opportunities and Challenges from Research to Deployment

Electricity load forecasting for buildings and campuses is becoming increasingly important as the penetration of distributed energy resources (DERs) grows. Efficient operation and dispatch of DERs require reasonably accurate predictions of future energy consumption in order to conduct near-real-time optimized dispatch of on-site generation and storage assets. Electric utilities have traditionally performed load forecasting for load pockets spanning large geographic areas, and therefore, forecasting has not been a common practice by buildings and campus operators. Given the growing trends of research and prototyping in the grid-interactive efficient buildings domain, characteristics beyond simple algorithm forecast accuracy are important in determining the algorithm's true utility for smart buildings. Other characteristics include the overall design of the deployed architecture and the operational efficiency of the forecasting system. In this work, we present a deep-learning-based load forecasting system that predicts the building load at 1-hour intervals for 18 hours in the future. We also discuss challenges associated with the real-time deployment of such systems as well as the research opportunities presented by a fully functional forecasting system that has been developed within the National Renewable Energy Laboratory's Intelligent Campus program.

building load forecasting↗