Search NASA⌕ Search

SEARCH · Search NASA

Results for “decentralized optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Decentralized Distribution System Restoration with Grid-Forming/Following Inverter-Based Resources

The high penetration of distributed energy resources (DERs) in active distribution systems has posed challenges to the centralized distribution system restoration (DSR) strategies in current practice. On the other hand, the advancement in smart inverter technologies enables the bottom-up restoration capability. This paper is motivated to develop a 3-layered hierarchical framework for decentralized DSR, based on the grid-forming (GFM) and grid-following (GFL) grid-edge inverters. The first layer presents the tertiary control, which determines the load pickup schedule and generation dispatch of DERs, using the alternating direction method of the multipliers algorithm. The second layer consists of two control functions: GFM control, which regulates voltage and frequency, establishing a stable grid for GFL inverters to follow; and GFL control, which regulates the real and reactive power. In the third layer, the primary control is proposed to regulate the inverter voltage and current, which is developed based on the virtual oscillator control (VOC). Furthermore, the developed framework is tested in the modified IEEE 13-node test feeder. Two scenarios of grid-connected and islanded operating modes are designed, and simulation results demonstrate the effectiveness of decentralized DSR strategies for controlling grid-edge inverters to enhance the distribution system resilience.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

On the Need for Communication for Voltage Regulation of Power Distribution Grids

We consider the problem of regulating the voltage profile of a power distribution grid by controlling the reactive power injection of distributed microgenerators. We define a very general class of purely local feedback controllers in which reactive power injection is adjusted based on the local voltage measurements. This class includes most of the solutions proposed in the literature and in the latest grid codes. We show that these strategies do not guarantee the desired regulation, as each of them can have an equilibrium that is not feasible with respect to the desired voltage and power constraints. We then propose a networked feedback law to show that, by adding short-range communication between microgenerators, it is possible to design control strategies that provably converge to the feasible set. This fundamental performance gap between local and networked strategies is finally illustrated via simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Traffic Signal Optimization by Integrating Reinforcement Learning and Digital Twins

Machine learning (ML) methods, especially reinforcement learning (RL), have been widely considered for traffic signal optimization in intelligent transportation systems. Most of these ML methods are centralized, lacking in scalability and adaptability in large traffic networks. Further, it is challenging to train such ML models due to the lack of training platforms and/or the cost of deploying and training in a real traffic networks. This paper presents an approach for the integration of decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin (DT) to optimize traffic signals for the reduction of traffic congestion and network-wide fuel consumption related to stopping. Specifically, the DGMARL agents learn traffic state patterns and make decisions regarding traffic signal control with assistance from a Digital Twin module, which simulates and replicates the traffic behaviors of a real traffic network. The proposed approach was evaluated using PTV-Vissim [1], a microscopic traffic simulation platform. PTV-Vissim is also the simulation engine of the DT, enabling emulation and optimization of the traffic signals on the MLK Smart Corridor in Chattanooga, Tennessee. Compared to an actuated signal control baseline approach, experiment results show that Eco_PI, a developed performance measure capturing the impact of stops on fuel consumption, was reduced by 44.27% in a 24-hour and an average of 29.88% in a PM-peak-hour scenario.

Multi-Agent Reinforcement Learning, Digital Twin, ↗
DOE OSTI2022

Roadmap for Deployment of Modularized Hydrothermal Liquefaction: Understanding the Impacts of Industry Learning, Optimal Plant Scale, and Delivery Costs on Biofuel Pricing

Hydrothermal liquefaction (HTL) is a promising technology for converting abundant organic wastes into fuels. Previous techno-economic analyses (TEAs) of HTL have been used to estimate the minimum fuel selling price (MFSP) of biofuel products, but these analyses often assume a bespoke plant design where each plant operates under unique process conditions and neglect transportation costs. However, transportation costs must be included in realistic TEAs, and further, a mass-produced fixed-scale modular plant design approach may be more effective than case-by-case plant design, provided that there is sufficient market capacity to benefit from modularization. This study estimates fuel price behavior in the presence of transportation costs and benefits stemming from modular plant design. This analysis indicates that a modular process capable of handling 60 dry tons per day (DTPD) is optimal, resulting in a ~25% reduction in MFSP (from $4.70/GGE, fully upgraded) at complete market feedstock utilization compared with case-by-case design. The associated cost reductions are attributable to learning benefits and modularization. Several HTL deployment “roadmaps” are then explored, with each roadmap consisting of different periods of case-by-case design followed by adoption of a modularized approach. A period of nonmodular industry growth up to market saturation of ~7% followed by implementation of modular plant design strikes a balance between the investment risk and learned cost reductions associated with modular plant design. However, if bespoke plants built during this period of nonmodular growth saturate more than 23% of available feedstock, learned cost reductions are significantly diminished. Here, this study points to the potential benefits of modularized and decentralized waste-to-energy processes when the modularization follows an optimal deployment strategy.

09 BIOMASS FUELS↗
DOE OSTI2022

DLMP of Competitive Markets in Active Distribution Networks: Models, Solutions, Applications, and Visions

Traditionally, the electric distribution system operates with uniform energy prices across all system nodes. However, as the adoption of distributed energy resources (DERs) propels a shift from passive to active distribution network (ADN) operation, a distribution-level electricity market has been proposed to manage new complexities efficiently. In addition, distribution locational marginal price (DLMP) has been established in the literature as the primary pricing mechanism. The DLMP inherits the LMP concept in the transmission-level wholesale market but incorporates characteristics of the distribution system, such as high $R/X$ ratios and power losses, system imbalance, and voltage regulation needs. The DLMP provides a solution that can be essential for competitive market operation in future distribution systems. This article first provides an overview of the current distribution-level market architectures and their early implementations. Next, the general clearing model, model relaxations, and DLMP formulation are comprehensively reviewed. The state-of-the-art solution methods for distribution market clearing are summarized and categorized into centralized, distributed, and decentralized methods. Then, DLMP applications for the operation and planning of DERs and distribution system operators (DSOs) are discussed in detail. Finally, visions of future research directions and possible barriers and challenges are presented.

42 ENGINEERING↗
DOE OSTI2018

Resilient Cyber Infrastructure for the Minimum Wind Curtailment Remedial Control Scheme

Integration of Distributed Energy Resources (DER) has been significantly increasing in the electric power grid. One of the predominant renewable energy sources, wind energy, possess a significant challenge for grid operations, due to its intermittency, uncertainty and variability. In changing operating conditions with wind uncertainty, part of wind may need to be curtailed for the safe utilization of the transmission system. In order to minimize the wind power curtailment and to keep the power flow on a transmission line under limits, a cyber resilient Distributed Remedial Action Scheme (DRAS) is developed in this paper. The RAS is formulated as an optimization problem, considering the real power flow constraints of the transmission lines and given wind variability. In this paper, DRAS is developed to operate even with failures in the computing nodes to make it cyber-resilient. Distributed simplex algorithm is used for optimization in the distributed RAS. The DRAS is implemented in a decentralized platform called Resilient Information Architecture Platform for Smart Grid (RIAPS) to enable cyber resiliency of DRAS. The effectiveness of the proposed approach is validated through offline simulations of the New England 39 bus system and online simulations of IEEE 14 bus test system. In conclusion, a cyber physical test bed utilizing Real Time Digital Simulator (RTDS), Phasor Measurement Units (PMUs), and BeagleBones has been used for the online simulation and validation of the developed cyber-resilient RAS.

17 WIND ENERGY↗
DOE OSTI2019

Economical and Engineering Aspects of Proactive Demand Participation: Centralized versus Bilateral Control Structure

The electric grid of the U.S. is evolving from a system characterized by large and centralized fossil-fueled power plants and passive customers to a network with high penetration of distributed energy resources and proactive customers. This project facilitated the evolution of the U.S. electric power grid by enabling proactive participation of demands in electricity market at the power distribution system level. This project has three major achievements. First, we designed a centralized distribution system operator managed electricity market and developed a three-phase alternating current optimal power flow algorithm to coordinate the operation of large-scale flexible loads and distributed energy resources. Second, we designed a decentralized bilateral coordinate framework for retail electricity market, where each participating customer is capable of making decisions regarding energy production and consumption based on information received from transactive neighbors. Third, the impacts of centralized and decentralized demand-side participation scheme on power system operations were evaluated with both large-scale simulations and hardware-in-the-loop demonstrations. The major activities and specific accomplishments of the technical tasks are summarized in Section II. The detailed design of centralized/hierarchical and decentralized/bilateral retail electricity markets and the comparison between the two markets are described in Section III. The accomplishments and conclusions of the project are presented in Section IV. The major findings of the project falls into three areas, hierarchical distribution system operator managed electricity market, bilateral electricity market and decentralized market coordination, and comparison of centralized and decentralized market coordination mechanisms. In the area of hierarchical distribution system operator managed electricity market design, an integrated wholesale and retail electricity market was shown to be highly effective in extracting the operational flexibility from distributed energy resources to provide services to the wholesale market. A chordal conversion based convex iteration algorithm is not only computationally efficiency but also achieves global optimal solution in coordinating the operations of a large number of heterogeneous distributed energy resources.In the area of decentralized market coordination approach, we showed that bilateral transactions among proactive customers and decentralized transaction clearing mechanism based on simultaneous second-price sealed-bid auction can encourage truthful bidding strategies from the market participations. In addition, the individual customers can rely on a portfolio optimization approach to maximize their returns while minimizing risks. In the area of comparison of centralized and decentralized market coordination mechanisms, we found that the centralized market design results in higher social welfare and lower wholesale market clearing price for electricity. In general, centralized market design favors distributed energy resources and fixed loads. The decentralized market design mostly benefits flexible loads and conventional generators.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2018

Robust Decentralized Secondary Frequency Control in Power Systems: Merits and Trade-Offs

Frequency restoration in power systems is conven- tionally performed by broadcasting a centralized signal to local controllers. As a result of the energy transition, technological advances, and the scientific interest in distributed control and optimization methods, a plethora of distributed frequency control strategies have been proposed recently that rely on communication amongst local controllers. In this paper we propose a fully decentralized leaky integral controller for frequency restoration that is derived from a classic lag element. We study steady-state, asymptotic optimality, nominal stability, input-to-state stability, noise rejection, transient performance, and robustness properties of this controller in closed loop with a nonlinear and multivariable power system model. Here, we demonstrate that the leaky integral controller can strike an acceptable trade-off between performance and robustness as well as between asymptotic disturbance rejection and transient convergence rate by tuning its DC gain and time constant. We compare our findings to conventional decentralized integral control and distributed- averaging-based integral control in theory and simulations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗
DOE OSTI2021

A stochastic biomass blending problem in decentralized supply chains

Blending biomass materials of different physical or chemical properties provides an opportunity to adjust the quality of the feedstock to meet the specifications of the conversion platform. We propose a model which identifies the right mix of biomass to optimize the performance of the thermochemical conversion process at the mini-mum cost. This is a chance-constraint programming (CCP) model which takes into account the stochastic nature of biomass quality. The proposed CCP model ensures that process requirements, which are impacted by physical and chemical properties of biomass, are met most of the time. We consider two problem settings, a centralized and a decentralized supply chain. We propose a mixed-integer linear program to model the blending problem in the centralized setting and a bilevel program to model the blending problem in the decentralized setting. We use the sample average approximation method to approximate the chance constraints, and propose solution algorithms to solve this approximation. We develop a case study for South Carolina using data provided by the Billion Ton Study. Based on our results, the blends identified consist mainly of pine and softwood residues. The blends identified and the suppliers selected by both models are different. The cost of the centralized supply chain is 2%–6% lower. The implications of these results are twofold. First, these results could lead to improved collaborations in the supply chain. Second, these results provide an estimate of the approximation error from assuming centralized decision making in the supply chain.

09 BIOMASS FUELS↗
DOE OSTI2021

Combined Techno-Economic Analysis and Life Cycle Assessment of an Integrated Direct Air Capture System with Advanced Algal Biofuel Production

The continuous increase in carbon dioxide (CO2) concentration in the atmosphere since the First Industrial Revolution correlates convincingly with the ongoing rise of the Earth's global average temperature contributing to climate change. As a response, carbon capture and sequestration (CCS) technologies are being implemented to mitigate anthropogenic CO2 emissions by capturing CO2 from high emitting point sources, such as power plants, refineries, and cement factories, and subsequently buried in geological formations underground for long term storage. Recently direct air capture (DAC) has emerged as a promising alternative technology that captures CO2 directly from the atmosphere for use or sequestration. This study investigates the potential synergistic benefits of integrating a solid amine-based DAC system with advanced algal biofuel production in photobioreactors (PBRs). DAC utilization allows the removal of atmospheric CO2 while also decoupling algae production facilities from anthropogenic point CO2 sources and avoiding the cost and logistics challenges of transporting CO2 long distances to remote facilities. Techno-economic analysis and life cycle assessment are performed to assess the economic and environmental benefits of heat and mass integration between the DAC and the PBR for biofuel production. The DAC-PBR system integration also considers on-site flue gas handling options, DAC capital utilization, the tradeoff between centralization or decentralization of key unit operations, and the PBR array. This presentation will discuss how optimizing DAC-PBR process integration can enhance the algal biofuel's economic and environmental sustainability and the prospect of DAC enabling the circular carbon economy.

algal biofuel production↗
DOE OSTI2021

Multilane Automated Driving With Optimal Control and Mixed-Integer Programming

Road vehicle lane changes often initiate traffic disturbances and can therefore impact road networks’ energy and time efficiency. Furthermore, unexpected changes in traffic conditions may also render lane changes counterproductive for the lane-changing vehicle. Vehicle-to-vehicle connectivity combined with anticipative control could address these challenges via improved lane change decisions by automated vehicles. In a move toward this objective, receding horizon control cast as a mixed-integer quadratic program is used to plan lane changing and acceleration in a coupled optimization. A long-term pacing module, based on Pontryagin’s minimum principle from optimal control theory, sets terminal and input references for receding horizon control to target a user’s expected travel time. To remove nonlinear vehicle dynamics from the receding horizon controller, lane change commands are passed to a pure pursuit steering module whose response is approximated by a second-order linear model. Here, comparison against a rule-based reactive algorithm in arterial and highway scenarios shows an 8.9%–13.7% reduction in energy consumption and a 5.2%–10.3% reduction in the travel time, along with navigational improvements.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Economies of Numbers Formulations for Optimal Process Family Design of Carbon Capture Systems

Enabling rapid, widespread deployment of many process variants across a range of design requirements is key to ensuring the widespread availability of critical decentralized technologies such as carbon capture systems. Unfortunately, traditional process design methods are not efficient for designing many similar variations of a process rapidly across a wide range of system requirements. Rather than considering each process variant as a separate design task, we have proposed viewing the entire set of variants as a “family.” In our work, we present rigorous optimization formulations that simultaneously design each variant within the family from a platform of available unit modules, largely inspired by product family and platform design.

Stinchfield, Georgia↗
DOE OSTI2023

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗
DOE OSTI2018

Smart Grid-Enabled CVR: An Advanced Application for Distribution Management Systems

A multilevel, multitasking smart grid-enabled conservation of voltage reduction (CVR) control and optimization methodology is proposed for advanced distribution management system (ADMS) platforms. The first level deals with the centralized optimization of volt/VAR optimization (VVO) devices; the second-level is for voltage control in the local domain or decentralized control; and the third level assesses the energy savings and CVR factor.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

This paper aims at developing a data-driven optimal control strategy for virtual synchronous generator (VSG) in the scenario where no expert knowledge or requirement for system model is available. Firstly, the optimal and adaptive control problem for VSG is transformed into a reinforcement learning task. Specifically, the control variables, i.e., virtual inertia and damping factor, are defined as the actions. Meanwhile, the active power output, angular frequency and its derivative are considered as the observations. Moreover, the reward mechanism is designed based on three preset characteristic functions to quantify the control targets: (1) maintaining the deviation of angular frequency within special limits; (2) preserving well-damped oscillations for both the angular frequency and active power output; (3) obtaining slow frequency drop in the transient process. Next, to maximize the cumulative rewards, a decentralized deep policy gradient algorithm, which features model-free and faster convergence, is developed and employed to find the optimal control policy. With this effort, a data-driven adaptive VSG controller can be obtained. By using the proposed controller, the inverter-based distributed generator can adaptively adjust its control variables based on current observations to fulfill the expected targets in model-free fashion. Finally, simulation results validate the feasibility and effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Achieving high ethylene yield in non-oxidative ethane dehydrogenation

Steam cracking of ethane, a non-catalytic thermochemical process, remains the dominant means of ethylene production. The severe reaction conditions and energy expenditure involved in this process incentivize the search for alternative reaction pathways and reactor designs which maximize ethylene yield while minimizing cost and energy input. Herein, we report a comparison of catalytic and non-catalytic non-oxidative dehydrogenation of ethane. We achieve ethylene yields as high as 67 % with an open tube quartz reactor without the use of a catalyst at residence times ~4 s. The open tube reactor design promotes simplicity, low cost, and negligible coke formation. Pristine quartz tubes were most effective, since coke formation was detected when defects were introduced by scratching the surface of the quartz. Surprisingly, the addition of solids to the quartz tube, such as quartz sand, alumina powder, or even Pt-based intermetallic catalysts, led to lower ethylene yield. Pt alloy catalysts are effective at lower temperatures, such as at 575 °C, but conversion is limited due to thermodynamic constraints. When operated at industrially relevant temperatures, such as 700 °C and above, these catalysts were not stable in our tests, causing ethylene yield to drop below that of the open tube. Furthermore, these results suggest that future research on non-oxidative dehydrogenation should be directed at optimizing reactor designs to improve the conversion of ethane to ethylene, since this approach shows promise for decentralized production of ethylene from natural gas deposits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗