Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed control and optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

High-Temperature Multi-Process Sensor Development and Demonstration at a Full-scale PC Combustion System

The main objective of this research program is to design, manufacture, and demonstrate a miniaturized, multi-process, monitoring system (mMPMS) for boiler condition management and easy system deployment to obtain a higher spatial resolution. This system will facilitate a Condition-Based Maintenance (CBM) philosophy that actively monitors the health of assets to predict and prevent failures and maximize availability and generating capacity at a reduced cost. CBM systems can provide boiler data that the advanced process control (APC) system can utilize for plant performance optimization, which is increasingly relevant as coal power plants shift from predominantly base-load operation to predominantly transient operation involving large load swings. The mMPMS is based on an electrochemical sensor that provides a real-time indication of the risk of damage to key locations in the radiant or convective section of a coal-fired boiler such as metal loss rates, heat flux, metal surface temperature, and deposit thickness. These indications can be utilized to optimize boiler performance as well as improve boiler availability in conjunction with corresponding operating conditions. This monitoring system was developed and tested in the high-temperature regions of coal-fired utility boilers in this project but can be applied to many other industries and applications as well. This project leveraged the existing electrochemical noise-based monitoring system and the new sensor design is small enough to be installed through the webbing of the waterwalls without the need for long shut-downs to bend tubes and to make it feasible to obtain high spatial resolution in the boiler. Data is transferred to the plant distributed control system (DCS) and any other control system. The sensor body that houses the sensor assembly was designed to ensure good conductive contact with boiler tubes to ensure the sensor is held at an identical temperature to the tube surface temperature. The data acquisition and signal conditioning modules were redesigned into a small footprint with optimized cooling of the module. System software was developed specifically for the new signal conditioning module and is compatible with plant PLCs. After the preliminary testing at a pilot-scale facility, the three mMPMS were installed at a full-scale pulverized coal-fired plant, PacifiCorp’s Hunter 3. The systems were demonstrated over 20,000 hours at the plant during regular operation. Also, the sensor data was fed to the plant’s advanced process control system to evaluate the corrosion control by the operation changes and utilized to understand the impacts of load cycling with different ramping up and down speeds. At the end of the project, the systems were converted to the permanent installation at the power plant to be used with the advanced process control system installed at the plant.

Advanced Sensors, Corrosion, Ash Deposition, Optim↗
DOE OSTI2022

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency control to maintain system reliability and security. Towards this end, great progress has been made in developing deep reinforcement learning (DRL) based grid control solutions in recent years. However, existing DRL-based solutions have two main limitations: 1) they cannot handle well with a wide range of grid operation conditions, system parameters, and contingencies; 2) they generally lack the ability to fast adapt to new grid operation conditions, system parameters, and contingencies, limiting their applicability for real-world applications. Here, in this paper, we mitigate these limitations by developing a novel deep meta-reinforcement learning (DMRL) algorithm. The DMRL combines the meta strategy optimization together with DRL, and trains policies modulated by a latent space that can quickly adapt to new scenarios. We test the developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed method, which achieves superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

HFIR LEU High Density Silicide Dispersion Optimized Design Neutronics Analyses with PHAME

A high-fidelity neutronics model of the Oak Ridge National Laboratory High Flux Isotope Reactor (HFIR) with the low-enriched uranium (LEU) high-density silicide dispersion Optimized fuel design was updated and analyzed to generate reactor physics-based metrics to support follow-on thermal hydraulic and transient analyses of this design. The Python HFIR Analysis and Measurement Engine (PHAME) was also updated to enhance the automation capabilities of the framework developed and maintained to perform these reactor physics modeling and simulation efforts. The automated framework significantly increases the efficiency and reproducibility to design and thoroughly analyzes HFIR LEU core designs, changes, and uncertainties. Reactor physics metrics evaluated include but are not limited to fuel depletion, cycle length, fission rate density distributions, axial power peaking factors, kinetics data, reactivity coefficients, control element worths, heat deposition rates, and decay heat. These neutronics results provide essential input to follow-on steady state thermal, thermal hydraulic and reactor transient analyses, which are subject of other reports. The Optimized design operates at 95 MW to maintain HFIR’s current highly enriched uranium core performance level at 85 MW.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Distribution Grid Incentive Design with Unknown Agent Behavior

Motivation: During extreme events, traditional grid regulation methods (e.g., energy prices, net power injection limits) may be insufficient. While system operators typically lack control over end-user grid interactions, (e.g., energy demand), incentives can influence behavior - for example, a user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. Problem: Optimize for the best incentive subject to system stability constraints. However, user behavior is unknown to the SO - i.e., for a given incentive, the amount of curtailed load or control variables exposed is unknown.

feedback based control↗
DOE OSTI2014

Decoupling Coupled Constraints Through Utility Design

Several multiagent systems exemplify the need for establishing distributed control laws that ensure the resulting agents' collective behavior satisfies a given coupled constraint. This technical note focuses on the design of such control laws through a game-theoretic framework. In particular, this technical note provides two systematic methodologies for the design of local agent objective functions that guarantee all resulting Nash equilibria optimize the system level objective while also satisfying a given coupled constraint. Furthermore, the designed local agent objective functions fit into the framework of state based potential games. Consequently, one can appeal to existing results in game-theoretic learning to derive a distributed process that guarantees the agents will reach such an equilibrium.

Li, N↗
DOE OSTI2023

Convex Q-Learning in Continuous Time with Application to Dispatch of Distributed Energy Resources

Convex Q-learning is a recent approach to reinforcement learning, motivated by the possibility of a firmer theory for convergence, and the possibility of making use of greater a priori knowledge regarding policy or value function structure. This paper explores algorithm design in the continuous time domain, with a finite-horizon optimal control objective. The main contributions are (i) The new Q-ODE: a model-free characterization of the Hamilton-Jacobi-Bellman equation. (ii) A formulation of Convex Q-learning that avoids approximations appearing in prior work. The Bellman error used in the algorithm is defined by filtered measurements, which is necessary in the presence of measurement noise. (iii) Convex Q-learning with linear function approximation is a convex program. It is shown that the constraint region is bounded, subject to an exploration condition on the training input. (iv) The theory is illustrated in application to resource allocation for distributed energy resources, for which the theory is ideally suited.

Lu, Fan↗
DOE OSTI2019

Asymptotic Behavior of Memristive Circuits

The interest in memristors has risen due to their possible application both as memory units and as computational devices in combination with CMOS. This is in part due to their nonlinear dynamics, and a strong dependence on the circuit topology. We provide evidence that also purely memristive circuits can be employed for computational purposes. In the present paper we show that a polynomial Lyapunov function in the memory parameters exists for the case of DC controlled memristors. Such a Lyapunov function can be asymptotically approximated with binary variables, and mapped to quadratic combinatorial optimization problems. This also shows a direct parallel between memristive circuits and the Hopfield-Little model. In the case of Erdos-Renyi random circuits, we show numerically that the distribution of the matrix elements of the projectors can be roughly approximated with a Gaussian distribution, and that it scales with the inverse square root of the number of elements. This provides an approximated but direct connection with the physics of disordered system and, in particular, of mean field spin glasses. Using this and the fact that the interaction is controlled by a projector operator on the loop space of the circuit. We estimate the number of stationary points of the approximate Lyapunov function and provide a scaling formula as an upper bound in terms of the circuit topology only.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A Review of Distributed Secondary Control Architectures in Islanded-Inverter-Based Microgrids

The increasing energy demand, the shortage of energy resources, and the environmental challenges faced by conventional power-generation systems are some of the ongoing challenges faced by modern power systems. Therefore, many efforts have been made by the scientific community to develop comprehensive solutions to overcome these issues. For instance, current technological advances have allowed the integration of distributed generators into the power systems, promoting the use of microgrids to overcome these issues. However, the use of renewable distributed generators have introduced new challenges to the traditional control system schemes. To overcome these challenges, a hierarchical control approach has been proposed for distributed renewable sources. In other words, the control scheme have been divided into three hierarchical levels, primary, secondary, and tertiary, to overcome the new challenges present in modern power systems. Due to extensiveness of this topic, this overview is focused on secondary control systems, mainly for AC isolated microgrids. To improve the power quality of modern systems, several secondary control schemes have been proposed to overcome the well-known problem of frequency and voltage deviation. Some of these schemes have also introduced adequate active/reactive power sharing techniques to optimize the utilization of resources. Additionally, other secondary control schemes have also focused on reducing the communication load, to lower the network cost and adding robustness against communication problems. This article presents an insight of the different control techniques used to overcome power quality and communication problems. A comprehensive overview of distributed secondary control techniques for islanded microgrids is presented. In addition, the implementation of these techniques is explained in an orderly and sequential manner.

14 SOLAR ENERGY↗
DOE OSTI2024

Multi-agent voltage control in distribution systems using GAN-DRL-based approach

Active distribution grids can experience voltage fluctuations and violations due to the high penetration of variable distributed energy resources (DERs). These problems might occur because of the uncertain and variable generation natures of these resources, especially solar photovoltaic resources, during panel shadowing scenarios. Volt-VAR control (VVC) is an efficient method that controls the reactive power set-points of the inverters to regulate the voltage of distribution grids. Although several VVC approaches have been proposed recently, the performance of these approaches degrades significantly if behind-the-meter solar generation data are unobservable/missing. Therefore, it is necessary to impute missing/unobservable PV data accurately to be utilized in VVC approaches. Further, this paper proposes a model-free, data-driven, centrally trained, and decentrally executed multi-agent deep reinforcement learning-based VVC architecture to regulate the voltage of distribution networks. A generative adversarial network (GAN) is incorporated to impute the unobservable PV data accurately, which improves the performance of the proposed control architecture. The proposed multi-agent-soft-actor–critic algorithm (MASAC)-based VVC technique utilizes the actual PV dataset as well as the imputed dataset from the GAN framework to learn the optimal coordinated control policy for controlling the optimal reactive power set-points of PV inverters. The effectiveness of the proposed approach is analyzed on a modified IEEE 34-bus test case with added PV inverters. The results are compared and analyzed with a base case model with no VVC and VVC with a local droop control approach, genetic algorithm optimization, and a centralized soft actor–critic-based approach. Moreover, the performance of the proposed approach is compared with that of a multi-agent VVC framework without using the PV generation data and load information as the system state. The results illustrate that the proposed method with more state input improves the voltage profile and reduces the power loss of the network across various loading and PV generation scenarios.

14 SOLAR ENERGY↗
DOE OSTI2019

Modeling Water Uptake and Pt Utilization in High Surface Area Carbon

Local transport losses limit high-current density performance of fuel-cells, especially at low Pt-loadings. Optimizing catalyst-layer structure and material properties to mitigate these losses is critical for wide-scale fuel-cell commercialization. Carbon supports form the primary porous structure of catalyst layers in which Pt particles are deposited and ionomer films are distributed. Unlike non-porous carbon supports, high surface area carbon support is unique in its relative humidity dependent Pt utilization and performance due to presence of Pt particles in the micropores interior of carbon particles. We model water uptake and Pt utilization in catalyst layers with high-surface-area carbon support. Interactions between functional groups on the carbon pore walls and water play a vital role in controlling water uptake from water vapor by catalyst layers. Ionomer is shown to influence proton access in micropores, even though it may not deposit into the micropores.

08 HYDROGEN↗
DOE OSTI2018

Applications of synchrophasor technologies in power systems

Synchrophasors are time-synchronized electrical measurements that represent both the magnitude and phase angle of the electrical sinusoids. Synchrophasors are measured by fast time-stamped devices called phasor measurement units (PMUs) to constitute the basis of real-time monitoring and control actions in the electric grid. Due to its enhanced situational awareness capabilities, many applications of PMUs are presented in the literature in the past decades. This paper presents a comprehensive summary of synchrophasor technology, its architecture, optimal placement techniques and its applications in electric power transmission and distribution systems. These applications include wide-area situational awareness and monitoring, state estimation, fault location and protective relaying, islanding detection etc. This review also covers some of the existing challenges in its implementation and its potential applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Layer-by-Layer-Processed Organic Solar Cells with 18.02% Efficiency Enabled by Regulating the Aggregation of Bottom Polymers

The fabrication of organic solar cells (OSCs) by a layer-by-layer (LBL) method has attracted growing attention in recent years. As already known, the pre-aggregates of conjugated polymers in solution have a profound impact on their microstructure morphology in films. Herein, by simply controlling the solution temperature and annealing processes, the pre-aggregation behavior of D18 polymer in solution can be fine-tuned and the microstructure of D18 bottom layer is well manipulated. The optimized D18 bottom layer can effectively regulate L8-BO upper-layer-forming suitable networks for efficient charge transportation. In addition, a vertical phase separation with a special D/D:A/A structure (P-i-N-type component distribution) is also formed. As a result, compared to the 16.43% power conversion efficiency (PCE) of the bulk heterojunction devices, such control enables bilayer OSC devices based on the polymer D18 and L8-BO to deliver an enhanced PCE of 18.02% with simultaneously improved short-circuit current density, open-circuit voltage, and fill factor. Importantly, it is also demonstrated in these results that the LBL deposition process utilizing the pre-aggregation of polymer and its fiber-network-forming ability is a very promising approach to improve charge dynamics, suppress carrier recombination, and fabricate highly efficient OSCs.

14 SOLAR ENERGY↗
DOE OSTI2024

Federated Deep Reinforcement Learning for Decentralized VVO of BTM DERs

The future of grid control requires a hybrid approach combining centralized and decentralized methods to fully utilize the potential of smart edge devices with artificial intelligence (AI) capabilities. This paper aims to develop and evaluate a federated deep reinforcement learning (FDRL) framework for decentralized adaptive volt-var optimization (VVO) of behind-the-meter (BTM) distributed energy resources (DERs). First, this paper models a single deep reinforcement learning (DRL) agent using the Markov Decision Process (MDP) framework for decentralized adaptive VVO of BTM DERs. Two DRL algorithms, soft actor-critic (SAC) and twin-delayed deep deterministic policy gradient (TD3), are compared for their effectiveness in optimizing VVO. Results show that TD3 outperforms SAC, achieving a 71.3% improvement in mean reward. Finally, the DRL agent is deployed within the FDRL framework, using the Flower platform, to enhance learning, provide adaptive control, and ensure data privacy for BTM DERs.

Ravi, Abhijith↗
DOE OSTI2018

A centralized-based method to determine the local voltage control strategies of distributed generator operation in active distribution networks

The increasing penetration of distributed generators (DGs) exacerbates the risk of voltage violations in active distribution networks (ADNs). The var capacity provided by DG inverters is a potential solution for voltage regulation. The conventional centralized control strategies limited by computation and communication burdens are difficult to meet the requirement of rapid voltage control. However, the local control strategies based on real-time measurements have a fast response to the frequent fluctuations of DG outputs. The performance of these local controllers depends on the tuning of the control parameters. This paper proposes a centralized-based method to determine the local voltage control strategies for DGs. A centralized parameter tuning model of control curves is built, in which and curves of DG inverters are mathematically formulated based on piecewise linearization. The original mixed-integer nonlinear programming (MINLP) model is converted into an effectively solved mixed-integer second-order cone programming (MISOCP) model using convex relaxation. The potential benefits of DG inverters are explored to regulate both reactive and curtailed active power, based on local voltage measurements. Case studies on a modified PG&E 69-node distribution system are carried out to verify the effectiveness of the proposed method. Results show that power losses of ADNs are significantly reduced and voltage profiles are also improved.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Nanoscale Control of Intrinsic Magnetic Topological Insulator MnBi 2 Te 4 Using Molecular Beam Epitaxy: Implications for Defect Control

Intrinsic magnetic topological insulators have emerged as a promising platform to study the interplay between the topological surface states and ferromagnetism. This unique interplay can give rise to a variety of exotic quantum phenomena, including the quantum anomalous Hall effect and axion insulating states. Here, in this study, utilizing molecular beam epitaxy (MBE), we present a comprehensive study of the growth of MnBi 2 Te 4 thin films on Si (111), epitaxial graphene, and highly ordered pyrolytic graphite substrates. By combining a suite of in situ characterization techniques, we obtain critical insights into the nanoscale control of MnBi 2 Te 4 epitaxial growth. First, we extract the free energy landscape for the epitaxial relationship as a function of the in-plane angular distribution. Then, by employing an optimized layer-by-layer growth, we determine the chemical potential and Dirac point of the thin film at different thicknesses and how this quantity is manifested by the dopant compensation from different antisite defects. Overall, these results establish a foundation for understanding the growth kinetics of MnBi 2 Te 4 and pave the way for future applications of MBE-grown thin films in emerging topological quantum materials.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Outlook towards deployable continual learning for particle accelerators

Particle accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization and control, anomaly detection and machine protection. With recent advancements, machine learning (ML) holds promise to assist in more advance prognostics, optimization, and control. While ML based solutions have been developed for several applications in particle accelerators, only few have reached deployment and even fewer to long term usage, due to particle accelerator data distribution drifts caused by changes in both measurable and non-measurable parameters. In this paper, we identify some of the key areas within particle accelerators where continual learning can allow maintenance of ML model performance with distribution drifts. Particularly, we first discuss existing applications of ML in particle accelerators, and their limitations due to distribution drift. Next, we review existing continual learning techniques and investigate their potential applications to address data distribution drifts in accelerators. By identifying the opportunities and challenges in applying continual learning, this paper seeks to open up the new field and inspire more research efforts towards deployable continual learning for particle accelerators.

43 PARTICLE ACCELERATORS↗
DOE OSTI2021

Collaborative Decision Approach for Electricity Pricing-demand Response Stackelberg Game

Demand response programs are considered as a valuable resource in smart grids that provide several advantages of load shifting, peak load reduction, mediating intermittency of renewable energy integration, etc. Flexible price-based incentives have been recognized as a critical strategy in motivating and compensating consumers' load adjustment actions for successful implementation of demand response. Game theoretical approaches, especially Stackelberg games are popularly adopted to model the relationship between electricity price and customers' demand response and solved by the classical centralized backward induction (BI) method. However, the BI method generally requires convexity of the follower's model for necessary optimality conditions, and the computational time of any centralized approach increases sharply with larger problem instances. In this paper, the Stackelberg game of electricity pricing-demand response between a distribution system operator (DSO) and load aggregators (LAs) is decomposed based on a collaborative optimization (CO) framework, where each LA is treated as a discipline with its own domain constraints (e.g. building temperature control), while the DSO at the system level tries to reduce the solution discrepancy and guide the searching towards optimality. Several groups of comparison experiments have demonstrated the effectiveness of the proposed collaborative decision approach in solving the demand response game.

Chen, Yang↗
DOE OSTI2022

Transmission-distribution long-term volt-var planning considering reactive power support capability of distributed PV

High penetration of grid-edge, inverter-based photovoltaic (PV) can cause significant voltage fluctuations not only at the distribution but also at the sub-transmission levels due to PV output intermittency. Traditional reactive power planning approaches do not consider intermittency, nor the possibility of coordinating the control of existing and future volt-ampere reactive resources. This paper proposes a reactive power planning tool for sub-transmission systems to mitigate voltage violations and fluctuations caused by high PV penetration and intermittency with a minimum investment cost. The planning tool coordinates with an optimization-based volt-var operational tool for: a) modeling the coordination of all existing var assets in both sub-transmission and distribution systems to reduce the need of new equipment, and b)selecting a set of scenarios with voltage violations, derived from PV intermittency c) testing the final investment decision. The tool obtains an investment need for each intermittency scenario with a proposed optimal power-flow framework with efficient techniques to handle a high number of discrete variables. Two options are provided for final planning decision: i) a conservative direct combination of investment need solutions and ii) a machine learning-based selection of representative investment needs at most time steps. The final investment decision options are verified using a realistic large-scale sub-transmission system and 5-minute PV and load data. The results show a significant voltage performance improvement with a lower investment cost for additional var equipment compared to conventional approaches.

14 SOLAR ENERGY↗