SEARCH · Search NASA

Results for “Decentralized optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Decentralized Distribution System Restoration with Grid-Forming/Following Inverter-Based Resources

The high penetration of distributed energy resources (DERs) in active distribution systems has posed challenges to the centralized distribution system restoration (DSR) strategies in current practice. On the other hand, the advancement in smart inverter technologies enables the bottom-up restoration capability. This paper is motivated to develop a 3-layered hierarchical framework for decentralized DSR, based on the grid-forming (GFM) and grid-following (GFL) grid-edge inverters. The first layer presents the tertiary control, which determines the load pickup schedule and generation dispatch of DERs, using the alternating direction method of the multipliers algorithm. The second layer consists of two control functions: GFM control, which regulates voltage and frequency, establishing a stable grid for GFL inverters to follow; and GFL control, which regulates the real and reactive power. In the third layer, the primary control is proposed to regulate the inverter voltage and current, which is developed based on the virtual oscillator control (VOC). Furthermore, the developed framework is tested in the modified IEEE 13-node test feeder. Two scenarios of grid-connected and islanded operating modes are designed, and simulation results demonstrate the effectiveness of decentralized DSR strategies for controlling grid-edge inverters to enhance the distribution system resilience.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Traffic Signal Optimization by Integrating Reinforcement Learning and Digital Twins

Machine learning (ML) methods, especially reinforcement learning (RL), have been widely considered for traffic signal optimization in intelligent transportation systems. Most of these ML methods are centralized, lacking in scalability and adaptability in large traffic networks. Further, it is challenging to train such ML models due to the lack of training platforms and/or the cost of deploying and training in a real traffic networks. This paper presents an approach for the integration of decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin (DT) to optimize traffic signals for the reduction of traffic congestion and network-wide fuel consumption related to stopping. Specifically, the DGMARL agents learn traffic state patterns and make decisions regarding traffic signal control with assistance from a Digital Twin module, which simulates and replicates the traffic behaviors of a real traffic network. The proposed approach was evaluated using PTV-Vissim [1], a microscopic traffic simulation platform. PTV-Vissim is also the simulation engine of the DT, enabling emulation and optimization of the traffic signals on the MLK Smart Corridor in Chattanooga, Tennessee. Compared to an actuated signal control baseline approach, experiment results show that Eco_PI, a developed performance measure capturing the impact of stops on fuel consumption, was reduced by 44.27% in a 24-hour and an average of 29.88% in a PM-peak-hour scenario.

Multi-Agent Reinforcement Learning, Digital Twin, ↗

DOE OSTI2022

Roadmap for Deployment of Modularized Hydrothermal Liquefaction: Understanding the Impacts of Industry Learning, Optimal Plant Scale, and Delivery Costs on Biofuel Pricing

Hydrothermal liquefaction (HTL) is a promising technology for converting abundant organic wastes into fuels. Previous techno-economic analyses (TEAs) of HTL have been used to estimate the minimum fuel selling price (MFSP) of biofuel products, but these analyses often assume a bespoke plant design where each plant operates under unique process conditions and neglect transportation costs. However, transportation costs must be included in realistic TEAs, and further, a mass-produced fixed-scale modular plant design approach may be more effective than case-by-case plant design, provided that there is sufficient market capacity to benefit from modularization. This study estimates fuel price behavior in the presence of transportation costs and benefits stemming from modular plant design. This analysis indicates that a modular process capable of handling 60 dry tons per day (DTPD) is optimal, resulting in a ~25% reduction in MFSP (from $4.70/GGE, fully upgraded) at complete market feedstock utilization compared with case-by-case design. The associated cost reductions are attributable to learning benefits and modularization. Several HTL deployment “roadmaps” are then explored, with each roadmap consisting of different periods of case-by-case design followed by adoption of a modularized approach. A period of nonmodular industry growth up to market saturation of ~7% followed by implementation of modular plant design strikes a balance between the investment risk and learned cost reductions associated with modular plant design. However, if bespoke plants built during this period of nonmodular growth saturate more than 23% of available feedstock, learned cost reductions are significantly diminished. Here, this study points to the potential benefits of modularized and decentralized waste-to-energy processes when the modularization follows an optimal deployment strategy.

09 BIOMASS FUELS↗

DOE OSTI2022

DLMP of Competitive Markets in Active Distribution Networks: Models, Solutions, Applications, and Visions

Traditionally, the electric distribution system operates with uniform energy prices across all system nodes. However, as the adoption of distributed energy resources (DERs) propels a shift from passive to active distribution network (ADN) operation, a distribution-level electricity market has been proposed to manage new complexities efficiently. In addition, distribution locational marginal price (DLMP) has been established in the literature as the primary pricing mechanism. The DLMP inherits the LMP concept in the transmission-level wholesale market but incorporates characteristics of the distribution system, such as high $R/X$ ratios and power losses, system imbalance, and voltage regulation needs. The DLMP provides a solution that can be essential for competitive market operation in future distribution systems. This article first provides an overview of the current distribution-level market architectures and their early implementations. Next, the general clearing model, model relaxations, and DLMP formulation are comprehensively reviewed. The state-of-the-art solution methods for distribution market clearing are summarized and categorized into centralized, distributed, and decentralized methods. Then, DLMP applications for the operation and planning of DERs and distribution system operators (DSOs) are discussed in detail. Finally, visions of future research directions and possible barriers and challenges are presented.

42 ENGINEERING↗

DOE OSTI2026

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗

DOE OSTI2021

A stochastic biomass blending problem in decentralized supply chains

Blending biomass materials of different physical or chemical properties provides an opportunity to adjust the quality of the feedstock to meet the specifications of the conversion platform. We propose a model which identifies the right mix of biomass to optimize the performance of the thermochemical conversion process at the mini-mum cost. This is a chance-constraint programming (CCP) model which takes into account the stochastic nature of biomass quality. The proposed CCP model ensures that process requirements, which are impacted by physical and chemical properties of biomass, are met most of the time. We consider two problem settings, a centralized and a decentralized supply chain. We propose a mixed-integer linear program to model the blending problem in the centralized setting and a bilevel program to model the blending problem in the decentralized setting. We use the sample average approximation method to approximate the chance constraints, and propose solution algorithms to solve this approximation. We develop a case study for South Carolina using data provided by the Billion Ton Study. Based on our results, the blends identified consist mainly of pine and softwood residues. The blends identified and the suppliers selected by both models are different. The cost of the centralized supply chain is 2%–6% lower. The implications of these results are twofold. First, these results could lead to improved collaborations in the supply chain. Second, these results provide an estimate of the approximation error from assuming centralized decision making in the supply chain.

09 BIOMASS FUELS↗

DOE OSTI2021

Combined Techno-Economic Analysis and Life Cycle Assessment of an Integrated Direct Air Capture System with Advanced Algal Biofuel Production

The continuous increase in carbon dioxide (CO2) concentration in the atmosphere since the First Industrial Revolution correlates convincingly with the ongoing rise of the Earth's global average temperature contributing to climate change. As a response, carbon capture and sequestration (CCS) technologies are being implemented to mitigate anthropogenic CO2 emissions by capturing CO2 from high emitting point sources, such as power plants, refineries, and cement factories, and subsequently buried in geological formations underground for long term storage. Recently direct air capture (DAC) has emerged as a promising alternative technology that captures CO2 directly from the atmosphere for use or sequestration. This study investigates the potential synergistic benefits of integrating a solid amine-based DAC system with advanced algal biofuel production in photobioreactors (PBRs). DAC utilization allows the removal of atmospheric CO2 while also decoupling algae production facilities from anthropogenic point CO2 sources and avoiding the cost and logistics challenges of transporting CO2 long distances to remote facilities. Techno-economic analysis and life cycle assessment are performed to assess the economic and environmental benefits of heat and mass integration between the DAC and the PBR for biofuel production. The DAC-PBR system integration also considers on-site flue gas handling options, DAC capital utilization, the tradeoff between centralization or decentralization of key unit operations, and the PBR array. This presentation will discuss how optimizing DAC-PBR process integration can enhance the algal biofuel's economic and environmental sustainability and the prospect of DAC enabling the circular carbon economy.

algal biofuel production↗

DOE OSTI2021

Multilane Automated Driving With Optimal Control and Mixed-Integer Programming

Road vehicle lane changes often initiate traffic disturbances and can therefore impact road networks’ energy and time efficiency. Furthermore, unexpected changes in traffic conditions may also render lane changes counterproductive for the lane-changing vehicle. Vehicle-to-vehicle connectivity combined with anticipative control could address these challenges via improved lane change decisions by automated vehicles. In a move toward this objective, receding horizon control cast as a mixed-integer quadratic program is used to plan lane changing and acceleration in a coupled optimization. A long-term pacing module, based on Pontryagin’s minimum principle from optimal control theory, sets terminal and input references for receding horizon control to target a user’s expected travel time. To remove nonlinear vehicle dynamics from the receding horizon controller, lane change commands are passed to a pure pursuit steering module whose response is approximated by a second-order linear model. Here, comparison against a rule-based reactive algorithm in arterial and highway scenarios shows an 8.9%–13.7% reduction in energy consumption and a 5.2%–10.3% reduction in the travel time, along with navigational improvements.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2023

Economies of Numbers Formulations for Optimal Process Family Design of Carbon Capture Systems

Enabling rapid, widespread deployment of many process variants across a range of design requirements is key to ensuring the widespread availability of critical decentralized technologies such as carbon capture systems. Unfortunately, traditional process design methods are not efficient for designing many similar variations of a process rapidly across a wide range of system requirements. Rather than considering each process variant as a separate design task, we have proposed viewing the entire set of variants as a “family.” In our work, we present rigorous optimization formulations that simultaneously design each variant within the family from a platform of available unit modules, largely inspired by product family and platform design.

Stinchfield, Georgia↗

DOE OSTI2023

Two-Level Decentralized-Centralized Control of Distributed Energy Resources in Grid-Interactive Efficient Buildings

Explore the source record for details and available documents.

Huo, Xiang↗

DOE OSTI2023

ProvLight: Efficient Workflow Provenance Capture on the Edge-to-Cloud Continuum

Modern scientific workflows require hybrid infrastructures combining numerous decentralized resources on the IoT/Edge interconnected to Cloud/HPC systems (aka the Computing Continuum) to enable their optimized execution. Understanding and optimizing the performance of such complex Edge-to-Cloud workflows is challenging. Capturing the provenance of key performance indicators, with their related data and processes, may assist in understanding and optimizing workflow executions. However, the capture overhead can be prohibitive, particularly in resource-constrained devices, such as the ones on the IoT/Edge.To address this challenge, based on a performance analysis of existing systems, we propose ProvLight, a tool to enable efficient provenance capture on the IoT/Edge. We leverage simplified data models, data compression and grouping, and lightweight transmission protocols to reduce overheads. We further integrate ProvLight into the E2Clab framework to enable workflow provenance capture across the Edge-to-Cloud Continuum. This integration makes E2Clab a promising platform for the performance optimization of applications through reproducible experiments.We validate ProvLight at a large scale with synthetic workloads on 64 real-life IoT/Edge devices in the FIT IoT LAB testbed. Evaluations show that ProvLight outperforms state-of-the-art systems like ProvLake and DfAnalyzer in resource-constrained devices. ProvLight is 26—37x faster to capture and transmit provenance data; uses 5—7x less CPU; 2x less memory; transmits 2x less data; and consumes 2—2.5x less energy. ProvLight [1] and E2Clab [2] are available as open-source tools.

Rosendo, Daniel↗

DOE OSTI2021

Data-driven Optimal Control Strategy for Virtual Synchronous Generator via Deep Reinforcement Learning Approach

This paper aims at developing a data-driven optimal control strategy for virtual synchronous generator (VSG) in the scenario where no expert knowledge or requirement for system model is available. Firstly, the optimal and adaptive control problem for VSG is transformed into a reinforcement learning task. Specifically, the control variables, i.e., virtual inertia and damping factor, are defined as the actions. Meanwhile, the active power output, angular frequency and its derivative are considered as the observations. Moreover, the reward mechanism is designed based on three preset characteristic functions to quantify the control targets: (1) maintaining the deviation of angular frequency within special limits; (2) preserving well-damped oscillations for both the angular frequency and active power output; (3) obtaining slow frequency drop in the transient process. Next, to maximize the cumulative rewards, a decentralized deep policy gradient algorithm, which features model-free and faster convergence, is developed and employed to find the optimal control policy. With this effort, a data-driven adaptive VSG controller can be obtained. By using the proposed controller, the inverter-based distributed generator can adaptively adjust its control variables based on current observations to fulfill the expected targets in model-free fashion. Finally, simulation results validate the feasibility and effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Achieving high ethylene yield in non-oxidative ethane dehydrogenation

Steam cracking of ethane, a non-catalytic thermochemical process, remains the dominant means of ethylene production. The severe reaction conditions and energy expenditure involved in this process incentivize the search for alternative reaction pathways and reactor designs which maximize ethylene yield while minimizing cost and energy input. Herein, we report a comparison of catalytic and non-catalytic non-oxidative dehydrogenation of ethane. We achieve ethylene yields as high as 67 % with an open tube quartz reactor without the use of a catalyst at residence times ~4 s. The open tube reactor design promotes simplicity, low cost, and negligible coke formation. Pristine quartz tubes were most effective, since coke formation was detected when defects were introduced by scratching the surface of the quartz. Surprisingly, the addition of solids to the quartz tube, such as quartz sand, alumina powder, or even Pt-based intermetallic catalysts, led to lower ethylene yield. Pt alloy catalysts are effective at lower temperatures, such as at 575 °C, but conversion is limited due to thermodynamic constraints. When operated at industrially relevant temperatures, such as 700 °C and above, these catalysts were not stable in our tests, causing ethylene yield to drop below that of the open tube. Furthermore, these results suggest that future research on non-oxidative dehydrogenation should be directed at optimizing reactor designs to improve the conversion of ethane to ethylene, since this approach shows promise for decentralized production of ethylene from natural gas deposits.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Genetic algorithm for demand response: a stackelberg game approach

Demand response (DR) has gained a significant recent interest due to its potential for mitigating many power system problems. Game theory is a very effective tool to be utilized in DR management. In this paper, the DR between a distribution system operator (DSO) and load aggregators (LAs) is designed as a Stackelberg game, where the DSO acts as the leader and LAs are regarded as the followers. Due to the limitations of the centralized solution approaches, a genetic algorithm-based decentralized approach is proposed. To demonstrate the proposed approach, a case study concerning a day-ahead optimization for a real-time pricing market with a single DSO and three LAs is designed and optimized. The proposed approach is able to shift the demand peaks and prove that it has a great potential to be used for the Stackelberg game between a DSO and multiple LAs to fully exploit the potential of DR.

Amasyali, Kadir↗

DOE OSTI2020

Optimal Renewable Resource Allocation and Load Scheduling of Resilient Communities

This paper presents a methodology for enhancing community resilience through optimal renewable resource allocation and load scheduling in order to minimize unserved load and thermal discomfort. The proposed control architecture distributes the computational effort and is easier to be scaled up than traditional centralized control. The decentralized control architecture consists of two layers: The community operator layer (COL) allocates the limited amount of renewable energy resource according to the power flexibility of each building. The building agent layer (BAL) addresses the optimal load scheduling problem for each building with the allowable load determined by the COL. Both layers are formulated as a model predictive control (MPC) based optimization. Simulation scenarios are designed to compare different combinations of building weighting methods and objective functions to provide guidance for real-world deployment by community and microgrid operators. The results indicate that the impact of power flexibility is more prominent than the weighting factor to the resource allocation process. Allocation based purely on occupancy status could lead to an increase of PV curtailment. Further, it is necessary for the building agent to have multi-objective optimization to minimize unserved load ratio and maximize comfort simultaneously.

model predictive control↗

DOE OSTI2023

Techno-Economic Optimization of Advanced Energy Plants with Integrated Thermal, Mechanical, and Electro-Chemical Storage (Final Report)

The increasing use of renewable energy sources is leading to increased cycling of fossil-fueled power plants (FFPP) that are designed to operate at base-loaded conditions. Integrating energy storage facilities with the FFPPs can be helpful in reducing load-following operation of FFPPs. Decentralized deployment of energy storage facilities at the FFPP level has considerable advantages due to possibilities of smaller storage capacities, immediate benefits realized by the host power plant due to the increase in the efficiency, cleaner emission and higher plant life to name a few. Most importantly, deployment at the FFPP level can exploit the existing equipment items and facilities at the host power plant, thus reducing the CAPEX and reducing the storage capacity. However, realization of these benefits will critically depend on novel configuration/integration strategies with the least impact on the power plant operation and its configuration. Furthermore, dynamics of the entire integrated system including both the FFPP and the storage technologies must be taken into account to obtain the cost-optimal solution. With these motivations, the objective of this project was to complete a focused evaluation of decentralized deployments of energy storage facilities at the FFPP level. Promising thermal, chemical, mechanical, and electro-chemical storage technologies were evaluated with due consideration of their transient response to obtain various optimal system concepts that can minimize the levelized cost of storage. For thermal storage, cryogenic energy storage along with high temperature heat storage in molten salt as well as phase change material were evaluated. For mechanical storage, cryogenic air storage and pumped hydro storages were evaluated. For chemical storage, hydrogen storage was evaluated. For electrochemical storage, the team evaluated sodium sulfur, vanadium redox flow battery as well as Li-ion batteries. Integration of these storage technologies with the natural gas combined cycle (NGCC) and supercritical pulverized coal (SCPC) plants was considered. Six technologies, namely molten salt, cryogenics, compressed air, pumped hydro, H2 storage and Li-ion battery storage, were downselected based on their levelized cost of storage. It was observed that the ranking of the optimal storage technology can differ based on the host power plant technology even when same demand/supply/price profile for electricity are considered. It was also observed that as the variability in power demand varies, the ranking of the optimal storage technologies vary. However, for the same demand and LMP profile, top six optimal storage technologies for NGCC vs SCPC plants did not differ much even though LCOS for the same technology and optimal size of a given storage technology did differ. Detailed techno-economic assessment of these six technologies was undertaken.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2023

Efficient low-temperature, catalyst-free dehydrogenation of alkanes

Riley, Christopher Ryan↗

DOE OSTI2022

A Unified Testing Platform to Mature Blockchain Applications for Grid Emulation Environments

Blockchain technology is a relatively novel technology that can be used to develop more decentralized, autonomous and tamper-evident solutions. A feature that can aid Transactive Energy Systems to reach their goals by enabling individual actors to communicate and reach consensus with other participants in a more decentralized fashion. However, technical barriers to evaluate and adopt this type of technology within the electrical domain still exist. To facilitate this task, BLOSEM Unified Testing Platform (UTP), a DOE-sponsored, multi-lab effort intends to accelerate the development of solutions by offering a common set of reusable services that can be used to interconnect existent grid tools with blockchain services. UTP is intended to serve as development platform that can provide application engineers with the technical means to evaluate potential blockchain solutions, by enabling them to concentrate on the actual application functionalities while at the same time abstracting the connectivity and performance measurement tasks. The use of BLOSEM UTP is further demonstrated by implementing two potential use cases that are intended to validate both the feasibility of implementing these applications as blockchain-based solutions while also demonstrating the features provided by UTP.

blockchain co-simulation↗