Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Deriving Optimal Operational Rules for Mitigating Inter-area Oscillations

This paper introduces a new method to mitigate inter-area oscillations of a large scale interconnected power system by means of generation re-dispatch. The optimal operational control procedures are derived as the shortest distance from the current operating condition to a desired damping ratio of the oscillation mode by adjusting generator outputs. A sensitivity based method is used to select the most effective generators for generation re-dispatch and decision tree is trained to approximate the security boundary in a space characterized by the selected generators. The optimal operational rules can be found by solving an optimization problem where the boundary constraints are provided by the decision tree rules. This method is tested on a Western Electricity Coordinating Council (WECC) 179-bus simplified network model and simulation results have demonstrated the proof of concept and shown promising application in real time operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Wavelet and Deep-Learning-Based Approach for Generation System Problematic Parameters Identification and Calibration

Accurate models of generation systems are critical for maintaining reliable and secure grid operations. In this paper, a novel and systematic approach is proposed to identify and calibrate the generation system problematic parameters using continuous wavelet transform (CWT) and advanced deep-learning technology. The phasor measurement unit (PMU) data are used through “event playback” to check whether the parameter calibration is required, and if yes, a group of suspicious parameters will be identified as the primary problematic parameter candidates (PPCs). These primary PPCs are randomly perturbed to generate the event playback simulation data, which are used by the CWT and convolutional neural networks (CNNs) to further narrow down the primary PPCs into a smaller set of candidates. Then, the identified candidates are perturbed again to generate massive event playback simulation data for training a parameter calibration neural network. Here, we designed a multi-output neural network structure to find the mappings between the perturbed parameters and the simulation data using both CNN and long short-term memory (LSTM) models. Finally, the well-trained and tested CNN-LSTM model is used to estimate the accurate value of the suspicious parameters with actual PMU measurements. The proposed CNN-LSTM network can accurately and reliably estimate the generation-system problematic parameters, and has better performance when compared to other machine-learning methods, such as the multilayer perceptron network and the conditional variational autoencoder method. The accuracy and effectiveness of the proposed approach have been validated through simulation and real-world data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The AGR-3/4 fission product transport irradiation experiment

AGR-3/4 was the combined third and fourth planned irradiations for the U.S. Department of Energy Advanced Gas Reactor (AGR) Fuel Development and Qualification Program. The primary purpose of the AGR program is to support the development and qualification of tristructural isotropic (TRISO) coated particle fuel for use in High Temperature Gas-cooled Reactors. AGR-3/4 was designed as a fission product transport irradiation experiment whose specific objectives were to: (1) irradiate fuel containing UCO (uranium oxycarbide) designed-to-fail (DTF) fuel particles that provide a fixed source of fission products for subsequent transport through compact matrix and structural graphite materials, (2) assess the effects of sweep gas impurities on fuel performance and fission product transport, (3) provide irradiated fuel and material samples for post-irradiation examination and post-irradiation heating, and (4) support the refinement of fuel performance and fission product transport models. The AGR-3/4 test train was irradiated in the northeast flux trap of the Advanced Test Reactor at Idaho National Laboratory for 369.1 effective full power days from December 2011 to April 2014. The experiment was successful in achieving its specification goals in terms of burnup and fast fluence levels reached at the end of irradiation and fuel temperature levels maintained throughout irradiation: peak compact burnup reached 15.27% fissions per initial heavy-metal atom and peak compact fast fluence reached 5.32 × 10 25 n/m 2 (E > 0.18 MeV), while the time-average volume-average temperatures of the compacts ranged from 854 to 1345°C. Fission product release to birth ratios reached values in the 10 -4 - 10 -3 range early during irradiation as the DTF particles started to fail. In conclusion, subsequent post-irradiation examination will provide information on fission product distributions in matrix and core graphite materials, enabling refinement of fission product transport models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Seeking Repeating Anthropogenic Seismic Sources: Implications for Seismic Velocity Monitoring at Fault Zones

Abstract Seismic velocities in rocks are highly sensitive to changes in permanent deformation and fluid content. The temporal variation of seismic velocity during the preparation phase of earthquakes has been well documented in laboratories but rarely observed in nature. It has been recently found that some anthropogenic, high‐frequency (>1 Hz) seismic sources are powerful enough to generate body waves that travel down to a few kilometers and can be used to monitor fault zones at seismogenic depth. Anthropogenic seismic sources typically have fixed spatial distribution and provide new perspectives for velocity monitoring. In this work, we propose a systematic workflow to seek such powerful seismic sources in a rapid and straightforward manner. We tackle the problem from a statistical point of view, considering that persistent, powerful seismic sources yield highly coherent correlation functions (CFs) between pairs of seismic sensors. The algorithm is tested in California and Japan. Multiple sites close to fault zones show high‐frequency CFs stable for an extended period of time. These findings have great potential for monitoring fault zones, including the San Jacinto Fault and the Ridgecrest area in Southern California, Napa in Northern California, and faults in central Japan. However, extra steps, such as beamforming or polarization analysis, are required to determine the dominant seismic sources and study the source characteristics, which are crucial to interpreting the velocity monitoring results. Train tremors identified by the present approach have been successfully used for seismic velocity monitoring of the San Jacinto Fault in previous studies.

58 GEOSCIENCES↗

Automatic log analysis with NLP for the CMS workflow handling

The central Monte-Carlo production of the CMS experiment utilizes the WLCG infrastructure and manages daily thousands of tasks, each up to thousands of jobs. The distributed computing system is bound to sustain a certain rate of failures of various types, which are currently handled by computing operators a posteriori. Within the context of computing operations, and operation intelligence, we propose a Machine Learning technique to learn from the operators with a view to reduce the operational workload and delays. This work is in continuation of CMS work on operation intelligence to try and reach accurate predictions with Machine Learning. We present an approach to consider the log files of the workflows as regular text to leverage modern techniques from Natural Language Processing (NLP). In general, log files contain a substantial amount of text that is not human language. Therefore, different log parsing approaches are studied in order to map the log files’ words to high dimensional vectors. These vectors are then exploited as feature space to train a model that predicts the action that the operator has to take. This approach has the advantage that the information of the log files is extracted automatically and the format of the logs can be arbitrary. In this work the performance of the log file analysis with NLP is presented and compared to previous approaches.

Layer, Lukas↗

HC-NIDS: signatures and simulations for detecting cyber-attacks aiming to cause damage against cyber-physical energy systems

Physical device safety is typically implemented locally using embedded controllers, while operations safety is primarily performed in control centers. Safe operations can be enhanced by correct design of device-level control algorithms, and protocols, procedures and operator training at the control-room level, but all can fail. Moreover, these elements exchange data and issue commands via vulnerable communication layers. In order to secure these gaps and enhance operational safety, we believe monitoring of command sequences must be combined with an awareness of physical device limitations and automata models that capture safety mechanisms. One way of doing this is by leveraging specification-based intrusion detection to monitor for physical constraint violations. The method can also verify that physical infrastructure state is consistent with monitoring information and control commands exchanged between field devices and control centers. This additional security layer enhances protection from both outsider attacks and insider mistakes. We implemented specification-based SCADA command analyzers using physical constraint algorithms directly in the Bro framework and Broccoli APIs for three separate scenarios: a water heater, an automated distribution system, and an over-current protection scheme. To accomplish this, we added low-level analyzers capable of examining control system-specific protocol packets for both Modbus TCP and DNP3, and also higher-level analyzers able to interpret device command and data streams within the context of each device's physical capabilities and present operational state. Thus the software that we are making available includes the Bro/Broccoli scripts for these three scenarios, as well as simulators, written in C, of those scenarios that generate sample traffic that is monitored by the Bro/Broccoli scripts. In addition, we have also implemented systems to directly pull cyber-physical information from the OSIsoft PI historian system. We have included the Python scripts used to perform that monitoring.

Source record↗

HC-NIDS: signatures and simulations for detecting cyber-attacks aiming to cause damage against cyber-physical energy systems

Physical device safety is typically implemented locally using embedded controllers, while operations safety is primarily performed in control centers. Safe operations can be enhanced by correct design of device-level control algorithms, and protocols, procedures and operator training at the control-room level, but all can fail. Moreover, these elements exchange data and issue commands via vulnerable communication layers. In order to secure these gaps and enhance operational safety, we believe monitoring of command sequences must be combined with an awareness of physical device limitations and automata models that capture safety mechanisms. One way of doing this is by leveraging specification-based intrusion detection to monitor for physical constraint violations. The method can also verify that physical infrastructure state is consistent with monitoring information and control commands exchanged between field devices and control centers. This additional security layer enhances protection from both outsider attacks and insider mistakes. We implemented specification-based SCADA command analyzers using physical constraint algorithms directly in the Bro framework and Broccoli APIs for three separate scenarios: a water heater, an automated distribution system, and an over-current protection scheme. To accomplish this, we added low-level analyzers capable of examining control system-specific protocol packets for both Modbus TCP and DNP3, and also higher-level analyzers able to interpret device command and data streams within the context of each device's physical capabilities and present operational state. Thus the software that we are making available includes the Bro/Broccoli scripts for these three scenarios, as well as simulators, written in C, of those scenarios that generate sample traffic that is monitored by the Bro/Broccoli scripts. In addition, we have also implemented systems to directly pull cyber-physical information from the OSIsoft PI historian system. We have included the Python scripts used to perform that monitoring.

Source record↗

Generative learning for slow manifolds and bifurcation diagrams

In dynamical systems characterized by separation of time scales, the approximation of so called “slow manifolds”, on which the long term dynamics lie, is a useful step for model reduction. Initializing on such slow manifolds is a useful step in modeling, since it circumvents fast transients, and is crucial in multiscale algorithms (like the equation-free approach) alternating between fine scale (fast) and coarser scale (slow) simulations. In a similar spirit, when one studies the infinite time dynamics of systems depending on parameters, the system attractors (e.g., its steady states) lie on bifurcation diagrams (curves for one-parameter continuation, and more generally, on manifolds in state parameter space. Sampling these manifolds gives us representative attractors (here, steady states of ODEs or PDEs) at different parameter values. Algorithms for the systematic construction of these manifolds (slow manifolds, bifurcation diagrams) are required parts of the “traditional” numerical nonlinear dynamics toolkit. In more recent years, as the field of Machine Learning develops, conditional score-based generative models (cSGMs) have been demonstrated to exhibit remarkable capabilities in generating plausible data from target distributions that are conditioned on some given label. It is tempting to exploit such generative models to produce samples of data distributions (points on a slow manifold, steady states on a bifurcation surface) conditioned on (consistent with) some quantity of interest (QoI, observable). In this work, we present a framework for using cSGMs to quickly (a) initialize on a low-dimensional (reduced-order) slow manifold of a multi-time-scale system consistent with desired value(s) of a QoI (a “label”) on the manifold, and (b) approximate steady states in a bifurcation diagram consistent with a (new, out-of-sample) parameter value. This conditional sampling can help uncover the geometry of the reduced slow-manifold and/or approximately “fill in” missing segments of steady states in a bifurcation diagram. Finally, the quantity of interest, which determines how the sampling is conditioned, is either known a priori or identified using manifold learning-based dimensionality reduction techniques applied to the training data.

Dynamical systems↗

AENET–LAMMPS and AENET–TINKER : Interfaces for accurate and efficient molecular dynamics simulations with machine learning potentials

Machine-learning potentials (MLPs) trained on data from quantum-mechanics based first-principles methods can approach the accuracy of the reference method at a fraction of the computational cost. To facilitate efficient MLP-based molecular dynamics and Monte Carlo simulations, an integration of the MLPs with sampling software is needed. Here, we develop two interfaces that link the atomic energy network (ænet) MLP package with the popular sampling packages TINKER and LAMMPS. The three packages, ænet, TINKER, and LAMMPS, are free and open-source software that enable, in combination, accurate simulations of large and complex systems with low computational cost that scales linearly with the number of atoms. Scaling tests show that the parallel efficiency of the ænet–TINKER interface is nearly optimal but is limited to shared-memory systems. The ænet–LAMMPS interface achieves excellent parallel efficiency on highly parallel distributed memory systems and benefits from the highly optimized neighbor list implemented in LAMMPS. We demonstrate the utility of the two MLP interfaces for two relevant example applications: the investigation of diffusion phenomena in liquid water and the equilibration of nanostructured amorphous battery materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Big Data-Based Approach to Detect, Locate, and Enhance the Stability of an Unplanned Microgrid Islanding

In this paper, a big data-based approach is proposed for the security improvement of an unplanned microgrid islanding (UMI). The proposed approach contains two major steps: the first step is big data analysis of wide-area monitoring to detect a UMI and locate it; the second step is particle swarm optimization (PSO)-based stability enhancement for the UMI. First, an optimal synchrophasor measurement device selection (OSMDS) and matching pursuit decomposition (MPD)-based spatial-temporal analysis approach is proposed to significantly reduce the volume of data while keeping appropriate information from the synchrophasor measurements. Second, a random forest-based ensemble learning approach is trained to detect the UMI. When combined with grid topology, the UMI can be located. Then the stability problem of the UMI is formulated as an optimization problem and the PSO is used to find the optimal operational parameters of the UMI. An eigenvalue-based multiobjective function is proposed, which aims to improve the damping and dynamic characteristics of the UMI. Finally, the simulation results demonstrate the effectiveness and robustness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Role of the Consequence Management Home Team in the Fukushima Daiichi Response

The Consequence Management Home Team (CMHT) is a U.S. Department of Energy/National Nuclear Security Administration asset and played an important role in the U.S. response effort to the Fukushima Daiichi accident, ranging from the early days of the response to a continued involvement in supporting late phase efforts. Each stage of their work had distinct characteristics in terms of management of incoming data streams and creation of products. The CMHT assisted a variety of response organizations with modeling; radiological operations planning; field monitoring techniques; and the analysis, interpretation, and distribution of radiological data. In the Fukushima Daiichi response, the CMHT grew to include a broader range of support than was historically planned. Through their work, the social and economic impacts of a nuclear or radiological incident were minimized. The CMHT was an integral component of the response in Japan and acted as the central point from which all of the data and products flowed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decom- pose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high- level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗

Design and optimization of a modular hydrogen-based integrated energy system to maximize revenue via nuclear-renewable sources

Here, this paper demonstrates a novel modular distributed framework that uses optimal energy-dispatching strategies to enable greater flexibility and profitability in nuclear-renewable integrated energy systems (NR-IES). Hydrogen is used as a commodity in this framework since its production can improve grid stability and system operational flexibility, decarbonize heavy industry, and create an additional revenue stream for electricity generators, particularly nuclear power plants with high operational expenses. The proposed solution addresses the challenges associated with merging multiple software and services from various domains by using functional mock-up units (FMU) to co-simulate diverse subsystems designed in various platforms. The tightly coupled integrated energy system (IES) is optimized to maximize revenue by utilizing the deep reinforcement learning (DRL) technique to make smart dispatching decisions based on variable electricity prices and the availability of renewable energy. Proximal policy optimization (PPO) algorithm is used in training and testing the DRL agent. Over a period of 120 days, the proposed hydrogen-based IES framework showed about 10% revenue boost compared to a non-hydrogen generating baseline IES while also providing an easily-adoptable framework which can help to improve the flexibility of future generation nuclear power plants.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Computational characterization of the secondary droplets formed during the impingement of a train of ethanol drops

This paper uniquely characterizes the secondary droplets formed during the impingement of a train of ethanol drops, using three-dimensional direct numerical simulations performed under conditions studied experimentally by Yarin and Weiss. Our numerical results have been previously validated against experimental data demonstrating the ability to accurately capture the splashing dynamics. In this work, the predictive ability of the model is leveraged to gain further insight into secondary droplet formation. We present a robust post-processing algorithm, which scrutinizes the liquid volume fraction field in the volume-of-fluid method and quantifies the number, volume and velocity of secondary droplets. The high-resolution computational simulations enable secondary droplet characterization within close proximity of the impingement point at small length and time scales, which is extremely challenging to achieve experimentally. By studying the temporal evolution of secondary droplet formation, direct connections are made between liquid structures seen in the simulation and the instantaneous distribution of secondary droplets, leading to detailed insight into the instability-driven breakup process of lamellae. Time-averaged secondary droplet characteristics are also studied to describe the global distribution of secondary droplets. Such analysis is vital to understanding fuel drop impingement in direct injection engines, facilitating the development of highly accurate spray–wall interaction models for use in Lagrangian solvers.

42 ENGINEERING↗

Gray-Box Modeling for Distribution Systems With Inverter-Based Resources: Integrating Physics-Based and Data-Driven Approaches

Here, in this paper, we develop a novel gray-box modeling approach for distribution systems with inverter-based resources (IBRs). The proposed gray-box modeling method aims to improve estimation accuracy by taking advantages of both physics-based (white-box) and data-driven (black-box) modeling approaches. To this end, we utilize partial physical knowledge of the system, including the inverters’ structures and control diagrams, as well as the equivalent network model simplified through Kron reduction. The white-box model containing unknown parameters is then constructed with mathematical equations and an optimization-based method is subsequently employed to identify these unknown parameters within the white-box model. Next, the graybox modeling framework is then constructed by embedding the output variables of the white-box model into the input vector of a black-box model (represented using a neural network). Finally, the black-box section is trained using the collected input-output datasets and the gray-box model is then obtained. Furthermore, case studies demonstrate that our gray-box modeling approach effectively improves estimation accuracy compared to purely physics-based or data-driven methods.

42 ENGINEERING↗

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM: Preprint

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗

EMPOWERED Distributed Energy Resources Permit Accelerator Pilot

This report summarizes the EMPOWERED Distributed Energy Resources (DER) Permit Accelerator Pilot project. Its primary objective was to streamline the design, installation, permitting, and inspections of targeted Distributed Energy Resource (DER) solutions. Streamlining these processes is critical to strengthening and accelerating the adoption of DER solutions nationwide. Moreover, streamlined processes help expedite the clean energy transition and expand energy resilience by improving understanding and capability among key stakeholders like property owners, code officials, and the general workforce. The project team accomplished this by developing and deploying a set of design and permitting guides for simple DER solutions, which they rolled out via a permitting pilot program. The project team developed nine permitting and inspection guides for simple DER solutions, as follows: 1. Single-Family and Duplex: Electric Vehicle Service Equipment (EVSE), and Storage, Solar + Storage (each in two code cycles) 2. Multi-family and Office: EVSE, Storage, Solar + Storage (each in two code cycles) 3. A permitting process guide to support the implementation of the permitting guides. The guides cover key code requirements via plan review and field inspection checklists for code officials and building owners to follow to streamline the permitting and inspections process for DER solutions. Following the development of the initial set of guides, the project team formed two cohorts, each made up of four jurisdictions, to participate in the Permit Accelerator Pilot. Each cohort received training and technical assistance to support them in incorporating the guides into use. The project successfully engaged jurisdictions in two disparate US regions: Chelsea, Somerville, Natick, and Norwood in metro Boston; and Pima County, Town of Gilbert, Flagstaff, and Sedona in Arizona. Feedback gathered from the project was valuable in refining the guides to better address jurisdictional needs. After the pilot period, the project team developed final versions of the guides based on extensive feedback from the cohorts and from external technical peer review. Feedback included needs and barriers related to implementation, as well as detailed technical improvements from external peer review. The final guides were presented in a series of webinars with a national reach, with 192 attendees from 35 states in the live session of the final webinar, and the final guides are posted online and available for use nationwide. Key findings: • The most receptive jurisdictions were those adjacent to other jurisdictions that had already adopted similar initiatives. The least receptive jurisdictions were those in the midst of adopting new code cycles. • The most common barrier to jurisdictional adoption of new guidelines were internal administrative and process delays, more so than technical barriers. • The main technical barrier to adoption proved to be the concern of fire hazard risks posed by energy storage systems. There is some apprehension in the code enforcement community about the safety of the batteries. Education coordinated with fire and safety services will help alleviate concerns and increase confidence in the acceptance of innovative technologies. • Opportunities to further leverage and advance the guides and related resources include outreach, education, and jurisdictional support; updates to the resources to align with code cycle changes and local requirements; and advancements supporting emerging technologies.

14 SOLAR ENERGY↗

Deep Learning-Based Adaptive Remedial Action Scheme with Security Margin for Renewable-Dominated Power Grids

The Remedial Action Scheme (RAS) is designed to take corrective actions after detecting predetermined conditions to maintain system transient stability in large interconnected power grids. However, since RAS is usually designed based on a few selected typical operating conditions, it is not optimal in operating conditions that are not considered in the offline design, especially under frequently and dramatically varying operating conditions due to the increasing integration of intermittent renewables. The deep learning-based RAS is proposed to enhance the adaptivity of RAS to varying operating conditions. During the training, a customized loss function is developed to penalize the negative loss and suggest corrective actions with a security margin to avoid triggering under-frequency and over-frequency relays. Simulation results of the reduced United States Western Interconnection system model demonstrate that the proposed deep learning–based RAS can provide optimal corrective actions for unseen operating conditions while maintaining a sufficient security margin.

24 POWER TRANSMISSION AND DISTRIBUTION↗