Search NASA⌕ Search

SEARCH · Search NASA

Results for “power allocation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks

We consider the power allocation problem over shared spectrum for millimeter-Wave (mmWave) cellular downlink. Existing approaches usually find sub-optimal solutions by solving a non-convex optimization which leads to scalability issues due to centralized control. Therefore, distributed and adaptive approaches are desirable. Recently, model-free Deep Reinforcement Learning (DRL) has achieved success in such wireless resource management tasks. By modeling the radio environment as a Markov Decision Process (MDP) with the base stations (BSs) being the agents, power allocation can be automated at the agent level with comparable throughput performance to conventional centralized schemes. The multi-agent setting presents new challenges as the radio environment is impacted by the joint actions of the agents and is no longer stationary from any individual agent’s perspective. Existing literature bypasses this non-stationarity violation by ignoring it which may cause performance degradation. To tackle this issue, we propose a distributed continuous power allocation scheme based on a modified version of multi-agent Deep Deterministic Policy Gradient (MADDPG) that is tailored for the distributed multiple-agent setting. The proposed scheme employs a centralized-training distributed-execution framework where Q-functions are trained over subsets of BSs while each BS determines its transmit power based only on its own local observation. It admits constant per-BS communication and computation complexity and is thus scalable to large networks. Numerical evaluation shows that the proposed scheme adapts well to a wide range of interference conditions and can achieve comparable or better performance than several state-of-the-art non-learning approaches.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Distributed Power Allocation for 6-GHz Unlicensed Spectrum Sharing via Multi-agent Deep Reinforcement Learning

We consider the problem of power allocation over the 6 GHz Unlicensed National Information Infrastructure (UNII)- 5 spectrum. We propose a novel deep Reinforcement Learning (DRL)-based distributed power allocation scheme which utilizes the multi-agent Deep Deterministic Policy Gradient (MADDPG) algorithm. In particular, we model the base stations (BSs) as DRL agents that simultaneously determine the transmit powers to their scheduled user equipment (UE) in a synchronized manner. The power decision of each BS is based on its own observation of the radio environment, which consists of several local interference measurements and a limited amount of information obtained from other BSs. One advantage of the proposed scheme is that it addresses the single-agent non-stationarity problem of RL in the multi-agent scenario by incorporating the actions and observations of other BSs into each BS’s own critic which helps it to gain a more accurate perception of the overall radio environment. A centralized-training-distributed execution framework is used to train the policies where the critics are trained over the joint actions and observations of all BSs while the actor of each BS only takes the local observation as input in order to produce the transmit power. Simulation shows that the proposed power allocation scheme can achieve better throughput performance than several state-of-the-art approaches.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Model-Free Building Temperature Control and Power Allocation Under Measurement Time Delays

Taking a step towards a greener planet has created an increased need for a higher integration of renewable energy resources into the electric grid. Nonetheless, the intermittency and uncertainty associated with renewable generation have slowed down this integration. Demand response (DR) has been recently adopted to address this challenge by utilizing demand side flexibility and enabling the participation of many grid-interactive efficient buildings (GEBs). However, existing DR methods require significant modeling and/or training efforts and are computationally expensive. To address the aforementioned issues, we propose a model-free control (MFC)-based strategy that is robust to the time delays in the temperature measurements of the thermostatically controlled loads (TCLs). It assigns to each GEB a local controller to maintain the TCLs’ temperatures within desired comfort levels, while the load aggregator (LA) allocates the assigned reference power provided by the distribution system operator (DSO) to support a specific grid service, such as demand peak reduction, load shifting, balancing supply and demand, and consuming the solar photovoltaic power locally. We investigate the effects of such loss of information on the local control action as well as on meeting the power allocation constraint. We conclude that, for an appropriate choice of design parameters, the proposed MFC controller is satisfactorily robust to measurement time delays.

Telsang, Bhagyashri↗
DOE OSTI2021

Power allocation by load aggregator with heterogeneous loads using weighted projection

With the recently increasing adoption of transactive energy markets, the role of a load aggregator is becoming increasingly important. Among the many tasks of an aggregator, the task of managing the electricity consumption among a group of grid-interactive efficient buildings according to the demand on the grid is taken up. Specifically, here, the task of allocating a certain amount of power among the participating customers while respecting their preferences and comfort is considered. Modeling this as an aggregate flexibility, the virtual battery conditions that are employed to verify the feasibility of a candidate power profile are derived. A feasible power profile, when allocated, satisfies specified comfort bands. To determine the ideal power requirement of the loads, the model-free control method is employed. The feasible power profile is allocated by embedding the customers’ preferences through weights, posing the power constraint as a hyperplane, and employing a weighted projection from the ideal power requirements onto the constraint plane to solve the considered task. The proposed method is computationally efficient and scalable to any number of heterogeneous thermostatically controlled loads in buildings.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A Novel LDPP-MADDPG Approach for Distributed Power Allocation in mmWave Cellular Networks

This paper considers the problem of distributed beam scheduling and power allocation problem in millimeter- Wave (mmWave) cellular networks, in which multiple Base Stations (BSs) operate as individual operators over a shared spectrum. We propose a novel learning-aided approach that integrates the Lyapunov Drift-Plus-Penalty (LDPP) framework and Multi-agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithms. This offers a powerful approach to learning stable and constraint-aware policies, reaping the joint benefit of both LDPP and MADDPG, in complex multiagent environments. The major challenge for this approach is to integrate these two approaches in a meaningful and effective manner. The key idea to solve this problem is to introduce a novel feature of local observation that incorporates potential negative value of the reward function due to the stochastic constraints introduced by the LDPP framework. Empirical results demonstrate that our proposed scheme outperforms the baseline methods under various conditions.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Transactive Emergency Power Allocation

The devastating impacts of extreme weather events, many of which are climate-change related, are increasingly evident through the frequency and duration of outages on power grids, especially the distribution systems. One of the major modern-day concerns of utilities is dealing with such extreme supply outages where operators have used rolling blackouts as a contingency plan balance supply and demand while serving critical loads. Such events have significant repercussions social and economic costs. Such blackouts practices are a blunt instrument, depriving customers with low-capacity high-priority loads (i.e. refrigeration, water, telecommunication, etc.) that provide high marginal amenity. Our contribution presented in this work is a transactive emergency allocation mechanism that would provide some minimum level of service to all of the customers while enabling preference-based trading of this initial allocation. This is in contrast to the state-of-art TE mechanisms that allocate resources to customers solely based on their willingness-to-pay. The effectiveness of the proposed mechanism is demonstrated through simulation-based evaluation on a prototypical distribution system experiencing 12-hour scarcity-based emergency event due to extreme operating conditions. Simulation results clearly demonstrate the capability of the proposed transactive emergency allocation mechanism in effectively utilizing the available energy and providing some level of service to all customers to operate their high-priority loads throughout the extreme scarcity event while being economically efficient in allowing trading of allocation based on customer preferences.

transactive energy, power system economics, emerge↗
DOE OSTI2021

Power allocation for visible light communication

A system and method for providing optical multiple input and multiple output data communication using optical signals includes a plurality of light sources, a plurality of photodetectors, and at least one controller. The plurality of light sources are configured to emit optical signals to communicate data. The plurality of photodetectors are configured to sense the optical signals, and are embedded in at least one receiver. At least one of the plurality of photodetectors is configured to receive the optical signals from two or more of the plurality of light sources. The controller is configured to assign a transmit power to at least some of the plurality of light sources based on parameters of the plurality of photodetectors.

Brandt-Pearce, Maite↗
DOE OSTI2022

A Q-Learning-Based Approach for Distributed Beam Scheduling in mmWave Networks

We consider the problem of distributed downlink beam scheduling and power allocation for millimeter-Wave (mmWave) cellular networks where multiple base stations (BSs) belonging to different service operators share the same unlicensed spectrum with no centralized control or explicit coordination among them. Our goal is to design efficient distributed beam scheduling and power allocation schemes such that the network-level payoff, defined as the weighted sum of the total throughput and a power penalization term, can be maximized. To this end, we propose a distributed scheduling approach to power allocation and adaptation for efficient interference management over the shared spectrum by modeling each BS as an independent Q-learning agent. As a baseline, we compare the proposed approach to the state-of-the-art non-cooperative game-based approach which was previously developed for the same problem. We conduct extensive experiments under various scenarios to verify the effect of multiple factors on the performance of both approaches. Experiment results show that the proposed approach adapts well to different interference conditions by learning from experience and thus can achieve higher payoff than the game-based approach. The proposed approach can also be integrated into our previously developed Lyapunov stochastic optimization framework for the purpose of network utility maximization with optimality guarantee. As a result, the weights in the payoff function can be automatically and optimally determined by the virtual queue values from the sub-problems derived from the Lyapunov optimization framework.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Dynamic Interference Management for UAV-Assisted Wireless Networks

Here, we investigate a transmission mechanism aiming to improve the data rate between a base station (BS) and a user equipment (UE) through deploying multiple relaying UAVs. We consider the effect of interference incurred by another established communication network, which makes our problem challenging and different from the state of the art. We aim to design the 3D trajectories and power allocation for the UAVs to maximize the data flow of the network while keeping the interference on the existing communication network below a threshold. We utilize the mobility feature of the UAVs to evade the (un)-intended interference caused by (un)-intentional interferers. To this end, we propose an alternating-maximization approach to jointly obtain the 3D trajectories and the UAVs transmission powers. We handle the 3D trajectory design by resorting to spectral graph the power allocation through convex optimization techniques. We also approach the problem from the intentional interferer’s perspective where smart jammers chase the UAVs to effectively degrade the data flow of the network. We also extend our work to the case for multiple UEs. Finally, we demonstrate the efficacy of our proposed method through extensive simulations.

42 ENGINEERING↗
DOE OSTI2021

On Anomaly Detection for Transactive Energy Systems with Competitive Market

Two anomaly-detection criteria are proposed for transactive energy systems with competitive markets. Participants of transactive energy systems seek an optimal power allocation through hybrid economic-control methods to facilitate the integration of various types of distributed energy resources to power distribution systems. In transactive energy systems, every participant is assumed to be a rational entity, and consumers have diminishing marginal utility and suppliers have increasing marginal cost. With the first proposed anomaly-detection criterion, the monotonicity of marginal cost and marginal utility are examined. The impact of line flow constraints is also taken into consideration. Then, the second anomaly-detection criterion is proposed for TESs with marginal cost and marginal utility which change faster than a certain rate. The second criterion is more accurate than the first one for TES with marginal cost and marginal utility which change faster than a certain rate, but it requires the knowledge of that rate. Neither criteria requires more data than those necessary to find the optimal power allocation and the market-clear price in a transactive energy system. Therefore, the proposed criteria do not disclose any more data than necessary. As the monotonicity of marginal cost and marginal utility in a TES with competitive markets results in convex objective functions in an optimization problem and strongly convex ones when marginal cost and marginal utility changes faster than a certain rate, the two detection criteria are also applicable to anomaly detection of general convex optimization problems. Simulations are carried out to show the efficacy of the proposed criteria to detect anomalies caused by cyberattacks.

Wang, Peng↗
DOE OSTI2023

Physical Layer Security at a Point-to-Point MIMO System With 1-Bit DACs and ADCs

Low-resolution converters reduce the power consumption of wireless devices and help enable large energy-efficient arrays. In this letter, we evaluate the secrecy rate for the extreme case of 1-bit single-user multiple-input multiple-output systems following two signaling approaches. In the first method, the system uses discrete signaling. In the second, the system combines Gaussian signaling with artificial noise alongside power allocation. In the first case, we give a closed-form expression of the secrecy rate and propose an algorithm that provides near-optimal results for low signal-to-noise ratios (SNRs). Further, in the second scenario, depending on the channel state information, we suggest different precoding plans and derive a secrecy rate lower bound. At low SNR, power is allocated to the main signal. Only at high SNR is optimal power allocation effective. Moreover, knowing the eavesdropper channel greatly improves the system’s secrecy.

1-bit digital-to-analog (DAC) and analog-to-digita↗
DOE OSTI2025

EVSE DERMS Controls [SWR-26-010]

An MQTT (Message Queuing Telemetry Transport) and OCPP (Open Charge Point Protocol) based remote smart charging controller framework for AC Electric Vehicle Supply Equipments (EVSEs). The code in this repo allows for the National Laboratory of the Rockies (NLR) controls to interface with the real Distributed Energy Resource Management System (DERMS) and EVSEs in NLR's ESIF Optimization and Control Laboratory (OCL). Different charge management algorithms can be tested to determine which power allocation method is most effective with the overall goal of demonstrating clear and well documented test results as well as providing functional control algorithms which could be utilized to provide effective smart charge management (SCM) at EV charging stations. Different power allocation methods are programmed in lab_demo_controller.py and include allocation based on first come first served, equal sharing, state of charge (SOC), priority factors, and behind the meter control methods.

Panossian, Nadia [National Laboratory of the Rocki↗
DOE OSTI2021

Evaluating adaptive and predictive power management strategies for optimizing visualization performance on supercomputers

Power is becoming an increasingly scarce resource on the next generation of supercomputers, and should be used wisely to improve overall performance. One strategy for improving power usage is hardware overprovisioning, i.e., systems with more nodes than can be run at full power simultaneously without exceeding the system-wide power limit. With this study, we compare two strategies for allocating power throughout an overprovisioned system – adaptation and prediction – in the context of visualization workloads. While adaptation has been suitable for workloads with more regular execution behaviors, it may not be as suitable on visualization workloads, since they can have variable execution behaviors. This study considers a total of 104 experiments, which vary the rendering workload, power budget, allocation strategy, and node concurrency, including tests processing data sets up to 1 billion cells and using up to 18,432 cores across 512 nodes. Overall, we find that prediction is a superior strategy for this use case, improving performance up to 27% compared to an adaptive strategy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Energy management systems for forecasted demand error compensation using hybrid energy storage system in nanogrid

This paper proposes an energy management system (EMS) for nanogrids to balance the power supply and forecasted demand in consideration of forecasting errors arising from high instantaneous demand. The proposed EMS employs a power-balancing optimization process for forecasted demand and a reference power modulation strategy for forecasting errors. This power-balancing optimization utilizes nanogrid sources, such as photovoltaics, fuel cells, and batteries, to meet forecasted demand and a supercapacitor charging process to overcome issues with a low energy density. The proposed reference power modulation strategy is utilized to allocate power from a hybrid energy storage system consisting of a battery and supercapacitor in order to compensate for forecasting errors. In addition, this proposed strategy considers battery and supercapacitor constraints such as the power changing rate and total power limitations. Further, the power-balancing optimization process also operates at faster sampling rate than the reference power modulation process in order to improve the computational efficiency. The performance of the proposed EMS is evaluated using real data obtained from the Korea Electric Power Exchange.

25 ENERGY STORAGE↗
DOE OSTI2022

Analysis of Reactive Power Load Modeling Techniques for PV Impact Studies [Slides]

The increasing availability of advanced metering infrastructure (AMI) data has led to significant improvements in load modeling accuracy. However, since many AMI devices were installed to facilitate billing practices, few utilities record or store reactive power demand measurements from their AMI. When reactive power measurements are unavailable, simplifying assumptions are often applied for load modeling purposes, such as applying constant power factors to the loads. The objective of this work is to quantify the impact that reactive power load modeling practices can have on distribution system analysis, with a particular focus on evaluating the behaviors of distributed photovoltaic (PV) systems with advanced inverter capabilities. Quasi-static time-series simulations were conducted after applying a variety of reactive power load modeling approaches, and the results were compared to a baseline scenario in which real and reactive power measurements were available at all customer locations on the circuit. Overall, it was observed that applying constant power factors to loads can lead to significant errors when evaluating customer voltage profiles, but that performing per-phase time-series reactive power allocation can be utilized to reduce these errors by about 6x, on average, resulting in more accurate evaluations of advanced inverter functions.

14 SOLAR ENERGY↗
DOE OSTI2023

Optimal Power Management of Battery Energy Storage Systems via Ensemble Kalman Inversion

Optimal power management of battery energy storage systems (BESS) is crucial for their safe and efficient operation. Numerical optimization techniques are frequently utilized to solve the optimal power management problems. However, these techniques often fall short of delivering real-time solutions for large-scale BESS due to their computational complexity. To address this issue, this paper proposes a computationally efficient approach. We introduce a new set of decision variables called power-sharing ratios corresponding to each cell, indicating their allocated power share from the output power demand. We then formulate an optimal power management problem to minimize the system-wide power losses while ensuring compliance with safety, balancing, and power supply-demand match constraints. To efficiently solve this problem, a parametrized control policy is designed and leveraged to transform the optimal power management problem into a parameter estimation problem. We then implement the ensemble Kalman inversion to estimate the optimal parameter set. The proposed approach significantly reduces computational requirements due to 1) the much lower dimensionality of the decision parameters and 2) the estimation treatment of the optimal power management problem. Finally, we conduct extensive simulations to validate the effectiveness of the proposed approach. The results show promise in accuracy and computation time compared with explored numerical optimization techniques.

Farakhor, Amir↗
DOE OSTI2024

Fault-Tolerant Decentralized Control for Large-Scale Inverter-Based Resources for Active Power Tracking

Integration of inverter-based resources (IBRs) which lack the intrinsic characteristics such as the inertial response of the traditional synchronous-generator (SG)-based sources presents a new challenge in the form of analyzing the grid stability under their presence. While the dynamic composition of IBRs differs from that of the SGs, the control objective remains similar in terms of tracking the desired active power. This letter presents a decentralized primal-dual-based fault-tolerant control framework for the power allocation in IBRs. Overall, a hierarchical control algorithm is developed with a lower level addressing the current control and the parameter estimation for the IBRs and the higher level acting as the reference power generator to the low level based on the desired active power profile. The decentralized network-based algorithm adaptively splits the desired power between the IBRs taking into consideration the health of the IBRs transmission lines. The proposed framework is tested through a simulation on the network of IBRs and the high-level controller performance is compared against the existing framework in the literature. The proposed algorithm shows significant performance improvement in the magnitude of power deviation and settling time to the nominal value under faulty conditions as compared to the algorithm in the literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Achievable Rate and Energy Efficiency Analysis of Multiuser Relay-Aided Massive MIMO Downlink

In this article, the achievable sum rate and the energy efficiency (EE) are investigated for a multiuser relay-aided massive multiple-input–multiple-output (MIMO) downlink. Low-resolution digital-to-analog converters (DACs) are equipped at both the base station (BS) and the relay station (RS), and the amplify-and-forward protocol is adopted at the RS. Under the Rician fading channel, closed-form approximate expressions for the achievable sum rate are derived with perfect and imperfect channel state information. Furthermore, a more general power law is extracted to save transmit power without reducing the achievable sum rate, and a local optimal power allocation scheme is proposed to improve the channel capacity of active users. Then, the tradeoff between the achievable sum rate and the EE is discussed. The numerical results show that, due to the quantization noise, the transmit power has a limited increase in the achievable rate. In addition, it is more valuable to improve the DAC quantization bit at the RS when the number of BS antennas is larger than that of RS antennas. In addition, under strong line-of-sight channels or high pilot transmit power conditions, the channel estimation accuracy is higher, and the best tradeoff between the achievable sum rate and the EE can be obtained when the DAC quantization bit is 4.

25 ENERGY STORAGE↗