Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Hierarchical Flexibility Offering Strategy for Integrated Hybrid Resources in Real-time Energy Markets

This paper proposes a hierarchical model for determining the energy flexibility offering strategy of integrated hybrid resources (IHRs) in power distribution systems to participate in real-time energy markets. The proposed model utilizes the scalability, fast response time, and uncertainty observation of deep reinforcement learning (DRL) to overcome the scalability issue of operating numerous flexible resources and deliverability of energy flexibility to the real-time markets in the presence of the network constraints. To that end, the power distribution system is divided into multiple IHRs, where different types of flexible loads, energy storage systems, and solar plants with controllable inverters are operated through local IHR controllers, trained by deep deterministic policy gradient (DDPG) algorithm. Active power request and reactive power capacity of IHRs are then transmitted to a central flexibility controller, where a quadratic optimization model ensures the deliverability of the energy flexibility to the real-time energy market by satisfying the distribution network constraints. The proposed model is implemented on the 123-bus test power distribution system, demonstrating the capability of DRL-based hierarchical model for scalable operation of IHRs in order to offer deliverable energy flexibility to the real-time energy market.

Majidi, Majid↗

MO-FG-202-06: Improving the Performance of Gamma Analysis QA with Radiomics- Based Image Analysis

Purpose: The use of gamma analysis for IMRT quality assurance has well-known limitations. Traditionally, a simple thresholding technique is used to evaluated passing criteria. However, like any image the gamma distribution is rich in information which thresholding mostly discards. We therefore propose a novel method of analyzing gamma images that uses quantitative image features borrowed from radiomics, with the goal of improving error detection. Methods: 368 gamma images were generated from 184 clinical IMRT beams. For each beam the dose to a phantom was measured with EPID dosimetry and compared to the TPS dose calculated with and without normally distributed (2mm sigma) errors in MLC positions. The magnitude of 17 intensity histogram and size-zone radiomic features were derived from each image. The features that differed most significantly between image sets were determined with ROC analysis. A linear machine-learning model was trained on these features to classify images as with or without errors on 180 gamma images.The model was then applied to an independent validation set of 188 additional gamma distributions, half with and half without errors. Results: The most significant features for detecting errors were histogram kurtosis (p=0.007) and three size-zone metrics (p<1e-6 for each). The sizezone metrics detected clusters of high gamma-value pixels under mispositioned MLCs. The model applied to the validation set had an AUC of 0.8, compared to 0.56 for traditional gamma analysis with the decision threshold restricted to 98% or less. Conclusion: A radiomics-based image analysis method was developed that is more effective in detecting error than traditional gamma analysis. Though the pilot study here considers only MLC position errors, radiomics-based methods for other error types are being developed, which may provide better error detection and useful information on the source of detected errors. This work was partially supported by a grant from the Agency for Healthcare Research and Quality, grant number R18 HS022244-01.

60 APPLIED LIFE SCIENCES↗

A novel conditional generative model for efficient ensemble forecasts of state variables in large-scale geological carbon storage

Integrating monitoring data to efficiently update reservoir pressure and CO 2 plume distribution forecasts presents a significant challenge in geological carbon storage (GCS) applications. Inverse modeling techniques are commonly used to fuse observational data and refine reservoir model parameters, thereby improving state variable forecasts. However, these techniques often rely on linear or Gaussian assumptions, which can limit their effectiveness in accurately predicting state variables. Moreover, simulating large-scale three-dimensional (3D) GCS problems is computationally expensive, making iterative runs in inverse problems prohibitive. To address these challenges, we propose a conditional generative model utilizing the score-based diffusion method for real-time 3D pressure and saturation field distribution predictions. Our approach involves solving the score function with a mini-batch-based Monte Carlo estimator to generate labeled data. This data is subsequently employed to train a fully connected neural network, enabling it to learn the conditional sample generator within a supervised learning framework. This method enables the rapid generation of a large ensemble of predictions, facilitating comprehensive uncertainty quantification of state variables. Here we applied our method to forecast the dynamic 3D distributions of pressure and saturation fields over a 30-year injection period. The statistical assessment with low root mean square error (RMSE) values demonstrates that our method can accurately predict the spatiotemporal distributions of both pressure and saturation fields. Moreover, the developed conditional generative model shows high computational efficiency by generating 100 ensemble forecasts of 3D state variables in less than 10 min. The consistency between ensemble averages and ground truth values further illustrates the model’s capability to capture state variable dynamics during the CO 2 plume injection process. Notably, the ground truth values fall within the ensemble forecasts, indicating that our uncertainty quantification effectively captures variability and potential noise in the observations. Thus, the developed conditional generative model proves to be a more efficient, accurate, and practical tool for GCS applications, facilitating timely risk analysis and informed decision-making.

58 GEOSCIENCES↗

Observation of attosecond electron dynamics in the photoelectron momentum distribution of atoms using few-cycle laser pulses

The method of time-resolved measurement with ultrashort laser pulses is vital to the development of attosecond science. Pump-probe measurements using a train of attosecond pulses in combination with a near-infrared (NIR) multicycle driving laser have been successful in capturing the intercycle electron dynamics which repeats every optical cycle and leads to above-threshold ionization (ATI) spectra in the frequency domain. Here in this work, we study the effect of a carrier-envelope phase (CEP) in a few-cycle (< 6 fs) NIR laser pulse on the photoelectron momentum distribution (PMD) of a hydrogen atom and show that interference patterns in a PMD change dramatically with CEPs in the few-cycle regime. When the few-cycle driving laser pulse has a sine shape, the double-slit interference with characteristic modulation of ATI peaks dominates the PMD. On the other hand, when the driving pulse has a cosine shape, the holographical interference featured by a spider-like pattern is isolated. Our results suggest that the CEP-stable few-cycle laser pulses can be used to identify different types of intracycle interference structures in a PMD which reveal the underlying subcycle electron dynamics on an attosecond timescale.

74 ATOMIC AND MOLECULAR PHYSICS↗

Coarse-Grained Density Functional Theory Predictions via Deep Kernel Learning

Scalable electronic predictions are critical for soft materials design. Recently, the Electronic Coarse-Graining (ECG) method was introduced to renormalize all-atom quantum chemical (QC) predictions to coarse-grained (CG) resolutions using deep neural networks (DNNs). While DNNs can learn complex representations that prove challenging for kernel-based methods, they are susceptible to overfitting and the overconfidence of uncertainty estimations. Here, we develop ECG within a GPU-accelerated Deep Kernel Learning (DKL) framework to enable CG QC predictions using range-separated hybrid density functional theory (DFT), obtaining a 107 speedup relative to naive all-atom QC. By treating the predicted electronic properties as random Gaussian Processes, DKL incorporates CG mapping degeneracy by learning the distribution of electronic energies as a function of CG configuration. DKL-ECG accurately reproduces molecular orbital energies from range-separated DFT while facilitating efficient training via active learning using the uncertainties provided by DKL. Further, we show that while active learning algorithms enable efficient sampling of a more diverse configurational space relative to random sampling, all explored query methods exhibit comparable performance for the examined system. We attribute this result to the significant overlap of the feature space and output property distributions across multiple temperatures.

97 MATHEMATICS AND COMPUTING↗

INFORMATION: Special Report on "Selected Department of Energy Program Efforts to Implement the American Recovery and Reinvestment Act"

The American Recovery and Reinvestment Act of 2009 (Recovery Act) was enacted on February 17, 2009, to jumpstart the economy by creating or saving millions of jobs, spurring technological advances in health and science, and investing in the Nation's energy future. The Department of Energy received over $32.7 billion in Recovery Act funding for various science, energy, and environmental programs and initiatives. As of November 2009, the Department had obligated $18.3 billion of the Recovery Act funding, but only $1.4 billion had been spent. The Department's Offices of Energy Efficiency and Renewable Energy, Fossil Energy, Environmental Management, Science, and Electricity Delivery and Energy Reliability received the majority of funding allocated to the Department, about $32.3 billion. Obligating these funds by the end of Fiscal Year 2010, as required by the Recovery Act, and overseeing their effective use in succeeding years, represents a massive workload increase for the Department's programs. The effort to date has strained existing resources. As has been widely acknowledged, any effort to disburse massive additional funding and to expeditiously initiate and complete projects increases the risk of fraud, waste and abuse. It is, therefore, important for the Department's program offices to assess and mitigate these risks to the maximum extent practicable. In this light, we initiated this review as an initial step in the Office of Inspector General's charge to determine whether the Department's major program offices had developed an effective approach for identifying and mitigating risks related to achieving the goals and objectives of the Recovery Act. The Department's program offices included in our review identified risks and planned mitigation strategies that, if successfully implemented and executed, should help achieve the goals and objectives of the Recovery Act. While each office identified risks unique to its respective areas of responsibility, there were a number of risks shared in common. These included the mechanical and substantive requirements related to the award and distribution of funds; program and project performance monitoring; and, program and project execution activities. In particular, the offices self-identified common risks such as: (1) The inability to award and distribute funds in a timely manner to achieve the goals of the Recovery Act; (2) The sufficiency of monitoring procedures and resources to, among other things, prevent and detect fraud, waste and abuse throughout the performance period of financial assistance awards and contracts; and (3) The inherent cost, schedule and performance risks associated with first-of-a-kind, innovative research and demonstration projects. Our review confirmed that the Department had begun to implement a number of strategies designed to mitigate these and other program-specific risks. Our testing, however, identified challenges to the effective implementation of these mitigation strategies that need to be addressed if the Department is to meet the goals and objectives established by the Recovery Act. At the time of our review: (1) Program staffing resources, critical to the success of all other mitigation strategies, remained inadequate both in numbers and qualifications (certifications and training) for positions in procurement and acquisition, project management, and monitoring and oversight functions; (2) Performance measures for achieving Recovery Act goals such as distributing funds in an expeditious manner had not always been established and included in performance plans, and, in financial assistance and contract documents; and (3) Programs had not consistently demonstrated that previously reported deficiencies, identified through audits, inspections, investigations and other oversight activities, had been considered in designing mitigation strategies for the Recovery Act related risks. As we noted in our Special Report on the American Recovery and Reinvestment Act at the Department of Energy (OAS-RA-09-01, March 2009) these sorts of deficiencies, which were described in the March 2009 report, had adversely impacted the success of earlier Departmental projects. We concluded that consideration of these previously encountered internal control weaknesses was essential if the Department was to avoid the same or similar problems in executing the Recovery Act programs/projects. During the course of our audit we identified other internal control weakness indicators. When brought to their attention by the Office of Inspector General audit staff, program officials acted promptly to address these problems by modifying or improving their risk mitigation strategies. For instance, we found that the Office of Energy Efficiency and Renewable Energy, responsible for $16.8 billion in Recovery Act program activities, took steps to strengthen its merit review process to avoid potential conflict of interest concerns.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Agent-Based Model of Combined Community- and Jail-Based Take-Home Naloxone Distribution

Importance Opioid-related overdose accounts for almost 80 000 deaths annually across the US. People who use drugs leaving jails are at particularly high risk for opioid-related overdose and may benefit from take-home naloxone (THN) distribution. Objective To estimate the population impact of THN distribution at jail release to reverse opioid-related overdose among people with opioid use disorders. Design, Setting, and Participants This study developed the agent-based Justice-Community Circulation Model (JCCM) to model a synthetic population of individuals with and without a history of opioid use. Epidemiological data from 2014 to 2020 for Cook County, Illinois, were used to identify parameters pertinent to the synthetic population. Twenty-seven experimental scenarios were examined to capture diverse strategies of THN distribution and use. Sensitivity analysis was performed to identify critical mediating and moderating variables associated with population impact and a proxy metric for cost-effectiveness (ie, the direct costs of THN kits distributed per death averted). Data were analyzed between February 2022 and March 2024. Intervention Modeled interventions included 3 THN distribution channels: community facilities and practitioners; jail, at release; and social network or peers of persons released from jail. Main Outcomes and Measures The primary outcome was the percentage of opioid-related overdose deaths averted with THN in the modeled population relative to a baseline scenario with no intervention. Results Take-home naloxone distribution at jail release had the highest median (IQR) percentage of averted deaths at 11.70% (6.57%-15.75%). The probability of bystander presence at an opioid overdose showed the greatest proportional contribution (27.15%) to the variance in deaths averted in persons released from jail. The estimated costs of distributed THN kits were less than $\$$15 000 per averted death in all 27 scenarios. Conclusions and Relevance This study found that THN distribution at jail release is an economical and feasible approach to substantially reducing opioid-related overdose mortality. Training and preparation of proficient and willing bystanders are central factors in reaching the full potential of this intervention.

Tatara, Eric [Argonne National Laboratory (ANL), A↗

Noise Robustness and Experimental Demonstration of a Quantum Generative Adversarial Network for Continuous Distributions

Abstract The potential advantage of machine learning in quantum computers is a topic of intense discussion in the literature. Theoretical, numerical, and experimental explorations will most likely be required to understand its power. There have been different algorithms proposed to exploit the probabilistic nature of variational quantum circuits for generative modeling. In this paper, a hybrid architecture for quantum generative adversarial networks (QGANs) is employed and their robustness in the presence of noise is studied. A simple way of adding different types of noise to the quantum generator circuit is devised, and the noisy hybrid QGANs (HQGANs) are simulated numerically to learn continuous probability distributions, and to show that the performance of HQGANs remains unaffected. The effect of different parameters on the training time is also investigated to reduce the computational scaling of the algorithm and simplify its deployment on a quantum computer. The training on Rigetti's Aspen‐4‐2Q‐A quantum processing unit is then performed, and the results from the training are presented. The authors' results pave the way for experimental exploration of different quantum machine learning algorithms on noisy intermediate‐scale quantum devices.

Anand, Abhinav↗

Voltage Mining for (De)lithiation-Stabilized Cathodes and a Machine Learning Model for Li-Ion Cathode Voltage

Advances in lithium-metal anodes have inspired interest in discovery of Li-free cathodes, most of which are natively found in their charged state. This is in contrast to today's commercial lithium-ion battery cathodes, which are more stable in their discharged state. In this study, we combine calculated cathode voltage information from both categories of cathode materials, covering 5577 and 2423 total unique structure pairs, respectively. The resulting voltage distributions with respect to the redox pairs and anion types for both classes of compounds emphasize design principles for high-voltage cathodes, which favor later Period 4 transition metals in their higher oxidation states and more electronegative anions like fluorine or polyanion groups. Generally, cathodes that are found in their charged, delithiated state are shown to exhibit voltages lower than those that are most stable in their lithiated state, in agreement with thermodynamic expectations. Deviations from this trend are found to originate from different anion distributions between redox pairs. In addition, a machine learning model for voltage prediction based on chemical formulas is trained and shows state-of-the-art performance when compared to two established composition-based ML models for material properties predictions, Roost and CrabNet.

25 ENERGY STORAGE↗

Precise cosmological constraints from BOSS galaxy clustering with a simulation-based emulator of the wavelet scattering transform

For this study, we perform a reanalysis of the BOSS CMASS DR12 galaxy dataset using a simulation-based emulator for the wavelet scattering transform (WST) coefficients. Moving beyond our previous works, which laid the foundation for the first galaxy clustering application of this estimator, we construct a neural net-based emulator for the cosmological dependence of the WST coefficients and the 2-point correlation function multipoles, trained from the state-of-the-art suite of abacussummit simulations combined with a flexible halo occupation distribution (HOD) galaxy model. In order to confirm the accuracy of our pipeline, we subject it to a series of thorough internal and external mock parameter recovery tests, before applying it to reanalyze the CMASS observations in the redshift range 0.46 < z < 0.57. We find that a joint WST+2-point correlation function likelihood analysis allows us to obtain marginalized 1⁢σ errors on the Λ⁢ CDM parameters that are tighter by a factor of 2.5–6, compared to the 2-point correlation function, and by a factor of 1.4–2.5 compared to the WST-only results. This corresponds to a competitive 0.9%, 2.3% and 1% level of determination for parameters ω c , ⁢σ 8 &n s , respectively, and also to a 0.7% and 2.5% constraint on derived parameters h and ƒ⁡(z)⁢⁢σ 8 ⁡(z), in agreement with the Planck 2018 results. Our results reaffirm the constraining power of the WST and highlight the exciting prospect of employing higher-order statistics in order to fully exploit the power of upcoming stage-IV spectroscopic observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Power System Event Identification with Transfer Learning Using Large-scale Real-world Synchrophasor Data in the United States

The lack of sufficient labeled events and long training time limit the applicability of deep neural network-based power system event identification using synchrophasor data. In this paper, we propose to leverage transfer learning technique to boost the reliability and reduce the required training time of neural classifier for power system event identification. We use the weights of a neural classifier trained on one transmission system as the initial parameters of another neural classifier for a different transmission system. Numerical tests with real-world synchrophasor data from the Eastern and Western Interconnections of the United States show that the proposed transfer learning approach is very effective in not only improving the training reliability but also reducing the training time.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Sivers extraction with Neural Network

Pseudo-data with simulated experimental errors can be generated to train an ensemble of Artificial Neural Networks (ANN) implemented on a regression to extract Transverse Momentum-dependent Distributions (TMDs). A preliminary analysis is presented on the reliability in extraction of the Sivers function imposed in the pseudo-data given the bounds on the experimental errors, data sparsity, and complexity of phase-space.

Fernando, Ishara↗

Project Boeing SGS (Final Report)

Boeing and its partner, PJM Interconnection, teamed to bring advanced “defense-grade” technologies for cyber security to the US regional power grid through demonstration in PJM’s energy management environment. Under this cooperative project with the Department of Energy, Boeing and PJM have developed and demonstrated a host of technologies specifically tailored to the needs of PJM and the electric sector as a whole. The team has demonstrated to the energy industry a combination of processes, techniques and technologies that have been successfully implemented in the commercial, defense, and intelligence communities to identify, mitigate and continuously monitor the cyber security of critical systems. Guided by the results of a Cyber Security Risk-Based Assessment completed in Phase I, the Boeing-PJM team has completed multiple iterations through the Phase II Development and Phase III Deployment phases. Multiple cyber security solutions have been completed across a variety of controls including: Application Security, Enhanced Malware Detection, Security Incident and Event Management (SIEM) Optimization, Continuous Vulnerability Monitoring, SCADA Monitoring/Intrusion Detection, Operational Resiliency, Cyber Range simulations and hands on cyber security personnel training. All of the developed and demonstrated solutions are suitable for replication across the electric sector and/or the energy sector as a whole. Benefits identified include; Improved malware and intrusion detection capability on critical SCADA networks including behavioral-based alerts resulting in improved zero-day threat protection; Improved Security Incident and Event Management system resulting in better threat visibility, thus increasing the likelihood of detecting a serious event; Improved malware detection and zero-day threat response capability; Improved ability to systematically evaluate and secure in house and vendor sourced software applications; Improved ability to continuously monitor and maintain secure configuration of network devices resulting in reduced vulnerabilities for potential exploitation; Improved overall cyber security situational awareness through the integration of multiple discrete security technologies into a single cyber security reporting console; Improved ability to maintain the resiliency of critical systems in the face of a targeted cyber attack of other significant event; Improved ability to model complex networks for penetration testing and advanced training of cyber security personnel

24 POWER TRANSMISSION AND DISTRIBUTION↗

One-Step Ahead Prediction of Thermal Mixing Tee Sensors with Long Short Term Memory (LSTM) Neural Networks

High-temperature advanced reactors under development, such as sodium fast reactors (SFR) and molten salt cooled reactors (MSCR), are expected to offer lower levelized cost of energy (LCOE) compared to existing light water reactor (LWR’s). In the existing light water reactors (LWR’s), operation and maintenance (O&M) expenses constitute the largest fraction of the total operating cost. Some of the O&M costs are related maintenance of sensors which can fail due to exposure to harsh environment in a reactor. The O&M costs of Advanced Reactor (AR)’s are expected to constitute a significant fraction of the total cost as well, because of high temperature and radiation level in AR are likely to cause material fatigue and premature failure of sensors and components. The O&M costs in AR’s could be reduced through integration of advanced informatics of performance-related sensors into a digital twin designed for reactor monitoring. For example, machine learning (ML) could be employed for real-time validation and correction of performance-related sensors, and reducing the number of performance-related physical sensor units through virtual sensing. As part of the effort, we investigate real-time validation of thermal hydraulic sensors through one-step ahead forecasting of sensor values using long short-term memory (LSTM) recurrent neural networks (RNN). The sensors are installed in a flow loop containing a thermal mixing tee, which is a common experimental model to study thermal fatigue in a thermal hydraulic loop. In addition, nonlinear transients generated in a thermal mixing tee constitute a good challenge data set for training and validation of ML algorithms. Sensors in this study include thermocouples, flow meters, and optical fibers for distributed temperature sensing. In one experiment, measurement data sets were obtained for a loop was filled with water, and in another experiment, measurements were performed on a loop filled with liquid metal Galinstan. We have also conducted preliminary investigation of one-step ahead prediction of fiber optics-based distributed temperature sensing with LSTM networks. In predicting fiber-based temperature measurements, we treated each gauge pitch of the fiber as an independent sensor. Accuracy of one-step ahead forecasting was estimated by calculating root mean square error (RMSE) for the test segment of time series of each sensor. RMSE’s for temperature sensors in water loop were, for the most part, lower than for the same sensors in Galinstan loop. The RMSE’s for flow meters were similar for both loops. The RMSE’s for distributed temperature measured with the fiber optic sensor were similar to those of the point sensors. Results of this study demonstrated the capability of LSTM one-step ahead forecasting with RMSE comparable to uncertainty in sensor measurements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Cybersecurity of DER Systems: Cybersecurity Training for State Commissions

NARUC regularly hosts multi-day cybersecurity training events for commissioners and their staff to gain knowledge of IT/OT technologies, understand the spectrum of state and federal approaches to cybersecurity, and explore cybersecurity cost recovery challenges and innovative solutions to address them. About 300 commissioners and staffers typically register for these virtual events.

cybersecurity cost recovery↗

Condition-Based Maintenance of a Circulating Water System of a Canadian Nuclear Power Plant using Machine Learning and Statistical Tools

Canada Deuterium Uranium pressurized-heavy-water reactors (PHWR) are a type of nuclear power plant that generate clean and reliable energy. The scope of this work is to automate data analysis methodologies to inform a condition-based maintenance strategy of a circulating water system (CWS) of a PHWR. The multiunit CWS provides a continuous supply of water to cool steam condensers, even during transient scenarios, thereby improving the thermal efficiency. This work aims to develop a machine learning (ML) based approach to detect anomalies in heterogeneous data of a CWS in a PHWR to help inform a predictive maintenance strategy. The heterogeneous data include textual and numeric time series data for a PHWR. Natural-language-processing (NLP)-based models are used to analyze textual data contained in work orders and operator logs and an event-timeseries correlation detection method is applied to assist anomalies diagnoses for CWS. An ML model Robust Linear Model (RLM) is also used to remove the seasonal variations in the system variable distributions based on distributions of environmental variables. A machine learning model, Density-Based Spatial Clustering of Applications with Noise (DBSCAN), trained on both original data and data without any seasonal variations will then be used to detect if an anomaly exists. Thus, by moving to an automated methodology to detect, classify, and forecast anomalies, the maintenance strategy would be based on component condition instead of a time-based schedule.

97 - MATHEMATICS AND COMPUTING↗