Search NASA⌕ Search

SEARCH · Search NASA

Results for “functional allocation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Kinetic, metabolic, and statistical analytics: addressing metabolic transport limitations among organelles and microbial communities

Microbial organisms engage in a variety of metabolic interactions. A crucial part of these interactions is the exchange of molecules between different organelles, cells, and the environment. The main forces mediating this metabolic exchange are transporters. This transport can be difficult to measure experimentally because several transport mechanisms remain opaque. However, theoretical calculations about the inputs and outputs of cells via metabolic exchanges have enabled the successful inference of the workings of intra-organismal and inter-organismal systems. Kinetic, metabolic, and statistical modeling approaches in combination with omics data are enhancing our knowledge and understanding about metabolic exchange and mass resource allocation. Furthermore, this model-driven analytics approach can guide effective experimental design and yield new insights into biological function and control.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Perennial grass root system specializes for multiple resource acquisitions with differential elongation and branching patterns

Roots optimize the acquisition of limited soil resources, but relationships between root forms and functions have often been assumed rather than demonstrated. Furthermore, how root systems co-specialize for multiple resource acquisitions is unclear. Theory suggests that trade-offs exist for the acquisition of different resource types, such as water and certain nutrients. Measurements used to describe the acquisition of different resources should then account for differential root responses within a single system. To demonstrate this, we grew Panicum virgatum in split-root systems that vertically partitioned high water availability from nutrient availability so that root systems must absorb the resources separately to fully meet plant demands. We evaluated root elongation, surface area, and branching, and we characterized traits using an order-based classification scheme. Plants allocated approximately 3/4th of primary root length towards water acquisition, whereas lateral branches were progressively allocated towards nutrients. However, root elongation rates, specific root length, and mass fraction were similar. Our results support the existence of differential root functioning within perennial grasses. Similar responses have been recorded in many plant functional types suggesting a fundamental relationship. Root responses to resource availability can be incorporated into root growth models via maximum root length and branching interval parameters.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

A metric framework for evaluating the resilience contribution of hydropower to the grid

This paper will describe a proposed framework for expressing the resilience of hydropower generation and provide initial case studies for three classes of hydropower, run-of-river hydropower, hydropower with reservoirs, and pumped storage hydropower. Hydropower has great flexibility to provide support during and after natural and man-made events that can disrupt critical infrastructure functionality. The concept of the framework provides for consideration of policy and rules, constraints of the water shed and other allocations of water, storage and plant capabilities to produce real and reactive power, and the strength of the delivery network. The paper details a resilience response metric that has inputs of state of storage and plant level constraints on real and reactive power production. Using the definition of resilience, based on maintaining a minimally normal operations, we provide a qualitative assessment of hydropower’s ability to address the various time scales comprising the “R”s of resilience.

13 HYDRO ENERGY↗
DOE OSTI2020

Optimal Renewable Resource Allocation and Load Scheduling of Resilient Communities

This paper presents a methodology for enhancing community resilience through optimal renewable resource allocation and load scheduling in order to minimize unserved load and thermal discomfort. The proposed control architecture distributes the computational effort and is easier to be scaled up than traditional centralized control. The decentralized control architecture consists of two layers: The community operator layer (COL) allocates the limited amount of renewable energy resource according to the power flexibility of each building. The building agent layer (BAL) addresses the optimal load scheduling problem for each building with the allowable load determined by the COL. Both layers are formulated as a model predictive control (MPC) based optimization. Simulation scenarios are designed to compare different combinations of building weighting methods and objective functions to provide guidance for real-world deployment by community and microgrid operators. The results indicate that the impact of power flexibility is more prominent than the weighting factor to the resource allocation process. Allocation based purely on occupancy status could lead to an increase of PV curtailment. Further, it is necessary for the building agent to have multi-objective optimization to minimize unserved load ratio and maximize comfort simultaneously.

model predictive control↗
DOE OSTI2024

Water foraging with dynamic roots in E3SM; The role of roots in terrestrial ecosystem memory on intermediate timescales (Final Technical Report)

Terrestrial ecosystems can show sustained responses to stress events that may last for years after the initial perturbation. This phenomenon is referred to as legacy or memory and it emerges from a set of ecosystem processes that are poorly captured by Earth System and Land Surface Models. Consequently, these models struggle to predict the impact that extreme climate events have on surface energy, carbon and hydrological exchange once a stressor such as drought has relaxed or in response to repeated exposure to stress. In this project, we set out to test how the addition of dynamic root profiles in land surface models impact the capacity for Earth System Models, such as the Department of Energy’s E3SM, to capture realistic legacy effects. Observations have shown that vegetation shifts their root profiles during stress events to forage for water and these altered root profiles may take years to relax back to the initial state. We hypothesized that the alteration of the belowground root structures may be a source of terrestrial ecosystem legacy that is missing from models. To test this idea we undertook three core activities. (1) We developed a global-scale analysis of the impact of dynamic roots on ecosystem legacy building from a recently developed dynamic root module. (2) We developed new root dynamics in the DOE’s Energy Land Model (ELM) that allowed not only root profiles to shift their profile but also simultaneously alter carbon allocation to fine root pools. We then tested the impact of these new dynamics with intensive sensitivity analysis at four long-term AmeriFlux sites. (3) We undertook detailed isotopic analysis of tree rings from these AmeriFlux sites to assess ecophysiological and ecohydrological legacy to stress events that can be used to benchmark the sensitivity experiments with ELM. From these core activities, we report the following key findings. Firstly, on a global scale, the addition of dynamic roots led to chronically water-stressed ecosystems recovering faster to climate stress while wetter ecosystem showed enhanced legacy. This is because across ecosystems, stress events were almost universally associated with water shortages that led to the development of deeper root profiles. These deeper root profiles proved beneficial for recovery from drought stress. While the root dynamics did not universally improve the modeled representation of legacy it showed complex transient dynamics that emerge from the addition of dynamic roots. Secondly, the sensitivity analysis illustrated long term shifts in rooting depths away from the prescribed default profile suggesting that initializing of root profiles could benefit from spin-up simulations that converge on locally optimized root profiles. In addition, by enabling dynamic allocation some of the sites predicted unrealistically low allocation to roots (and high allocation to leaves). While these changes did not dramatically alter modeled gross primary productivity, they illustrated that without more sophisticated root processes in models, there is little penalty to dramatically disinvest in roots. Thirdly, the isotopic analysis of tree rings showed highly distinct legacy responses across species and sites. For example, T. canadensis showed reduced transpiration the year after stress events illustrated by sustained elevated $\delta^{18}$O. In contrast, A saccharum displayed elevated $\delta^{13}$C associated with reduced stomatal conductance in response to the previous years’ stress event. These geochemical signatures of legacy were present despite tree growth returning to normal the year after the stress. The results show the importance of species-level dynamics in legacy that are absent in modeling that assumes common traits within plant functional types. In summary, the work here established new avenues to explore root dynamics in models while illustrating how additional root processes are needed before dynamic carbon allocation can be implemented. Lastly, this project provided mentorship to a postdoctoral fellow, training for an early career scientist and multiple undergraduate students recruited from a minority serving institution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Composition and metabolism of microbial communities in soil pores

Delineation of microbial habitats within the soil matrix and characterization of their environments and metabolic processes are crucial to understand soil functioning, yet their experimental identification remains persistently limited. We combined single- and triple-energy X-ray computed microtomography with pore specific allocation of 13 C labeled glucose and subsequent stable isotope probing to demonstrate how long-term disparities in vegetation history modify spatial distribution patterns of soil pore and particulate organic matter drivers of microbial habitats, and to probe bacterial communities populating such habitats. Here we show striking differences between large (30-150 µm Ø) and small (4-10 µm Ø) soil pores in (i) microbial diversity, composition, and life-strategies, (ii) responses to added substrate, (iii) metabolic pathways, and (iv) the processing and fate of labile C. We propose a microbial habitat classification concept based on biogeochemical mechanisms and localization of soil processes and also suggests interventions to mitigate the environmental consequences of agricultural management.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

The Latent Dirichlet Allocation model applied to airborne LiDAR data: A case study on mapping forest degradation associated with fragmentation and fire in the Amazon region

1. LiDAR data are being increasingly used to provide a detailed characterization of the vertical profile of forests. This characterization enables the generation of new insights on the influence of environmental drivers and anthropogenic disturbances on forest structure as well as on how forest structure influences important ecosystem functions and services. Unfortunately, extracting information from LiDAR data in a way that enables the spatial visualization of forest structure, as well as its temporal changes, is challenging due to the high dimensionality of these data. 2. In this study, we show how the Latent Dirichlet Allocation model applied to LiDAR data (LidarLDA) can be used to identify forest structural types and how the relative abundance of these forest types changes throughout the landscape. The code to fit this model is made available through the open-source r package LidarLDA in github. We illustrate the use of LidarLDA both with simulated data and data from a large-scale fire experiment in the Brazilian Amazon region. 3. Using simulated data, we demonstrate that LidarLDA accurately identifies the number of forest types as well as their spatial distribution and absorptance probabilities. For the empirical data, we found that LidarLDA detects both landscape-level patterns in forest structure as well as the strong interacting effect of fire and forest fragmentation on forest structure based on the experimental fire plots. More specifically, LidarLDA reveals that proximity to forest edge exacerbates the impact of fires, and that burned forests remain structurally different from unburned areas for at least 7 years, even when burned only once. Importantly, LidarLDA generates insights on the 3D structure of forest that cannot be obtained using more standard approaches that just focus on top-of-the-canopy information (e.g. canopy height models based on LiDAR data). 4. By enabling the mapping of forest structure and its temporal changes, we believe that LidarLDA will be of broad utility to the ecological research community.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Estimation of distributions via multilevel Monte Carlo with stratified sampling

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the joint cumulative distribution function (CDF) of a vector-valued quantity of interest in problems with random input parameters and initial conditions. Our approach combines MLMC with stratified sampling of the input sample space by replacing standard Monte Carlo at each level with stratified Monte Carlo initialized with proportionally allocated samples. We show that the resulting stratified MLMC (sMLMC) algorithm is more efficient than its standard MLMC counterpart due to the additional variance reduction provided by the stratification of the random parameter's domain, especially at the coarsest levels. Additional computational cost savings are obtained by smoothing the indicator function with a Gaussian kernel, which proves to be an efficient and robust alternative to recently developed polynomial-based techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Nutrient Dynamics in a Coupled Terrestrial Biosphere and Land Model (ELM-FATES-CNP)

We present a representation of nitrogen and phosphorus cycling in the Functionally Assembled Terrestrial Ecosystem Simulator, a demographic vegetation model within the Energy Exascale Earth System land model. This representation is modular, and designed to allow testing of multiple hypothetical approaches for carbon-nutrient coupling in plants. Novel model hypotheses introduced in this work include, (a) the controls on plant acquisition of aqueous mineralized nutrients in the soil and (b) fairly straight forward methods of allocating nutrients to specific plant organs and their losses through live plant turnover as well as litter fluxes generated through plant mortality. This combines the new with pre-existing hypotheses (such as nitrogen fixation and soil decomposition) into a system that can accommodate plant-soil dynamics for a large number of size- and functional-type-resolved plant cohorts within a time-since-disturbance-resolved ecosystem. Root uptake of nutrients is governed by fine root biomass, and plants vary in their fine root biomass allocation in order to balance carbon and nutrient limitations to growth. We test the sensitivity of the model to a wide range of parameter variations and structural representations, and in the context of observations at Barro Colorado Island, Panama. A key model prediction is that plants in the high-light-availability canopy positions allocate more carbon to fine roots than plants in low-light understory environments, given the widely different carbon versus nutrient constraints of these two niches within a given ecosystem. This model provides a basis for exploring carbon-nutrient coupling with vegetation demography within Earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Long-term compost amendment modulates wheat genotype differences in belowground carbon allocation, microbial rhizosphere recruitment and nitrogen acquisition

The implementation of soil health-promoting practices, such as cover cropping and compost application, has important implications for nutrient cycling and management in agroecosystems. At the same time, plant belowground carbon (C) allocation patterns can influence nutrient cycling and availability in soil through changes to the microbial community, but the effects may depend on the crop genotype and management practices in place. We evaluated belowground C allocation patterns using 13 C labeling and root architecture in two genotypes of winter wheat (Triticum aestivum) with different levels of exudation and belowground allocation strategies in soils with contrasting compost amendment legacy (108.7 Mg ha -1 every 2 years over 10 years vs. no compost). We also measured microbial community structure and function in the rhizosphere and quantified uptake of residue-derived N from 15 N-labelled cover crop residues. We found an interactive effect between soil management and genotype, where in the no-compost soil, the high-exudation genotype (Snowmass) increased exudation by over 4-fold, while the low-exudate genotype (Byrd) increased only 2-fold. While we did not observe genotype differences in rhizosphere enzyme activity or dissolved N pools, residue N uptake was 1.8 times greater for Snowmass in the compost-amended soil. There were more rhizosphere microbial taxa associated with the high-exudate genotype (Snowmass); nine bacterial and seven fungal families were indicative of Snowmass, versus one bacterial and four fungal families for Byrd. Our results suggest that the high-exudation strategy can influence the rhizosphere microbial community, and lead to greater short-term residue N uptake in high SOM soil. By directly linking root architecture, exudation, microbial communities, and N mineralization and uptake dynamics, this work demonstrates that plasticity in root C allocation is genotype-specific and influences microbial communities and nutrient cycling depending on the soil health context.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Calibrating the Classical Hardness of the Quantum Approximate Optimization Algorithm

The trading of fidelity for scale enables approximate classical simulators such as matrix product states (MPSs) to run quantum circuits beyond exact methods. A control parameter, the so-called bond dimension $\mathcal{χ}$ for MPSs, governs the allocated computational resources and the output fidelity. Here, we characterize the fidelity for the quantum approximate optimization algorithm by the expectation value of the cost function that it seeks to minimize and find that it follows a scaling law $\mathscr{F}$(ln $\mathcal{χ}$/N), where N is the number of qubits. With ln $\mathcal{χ}$ amounting to the entanglement that a MPS can encode, we show that the relevant variable for investigating the fidelity is the entanglement per qubit. Importantly, our results calibrate the classical computational power required to achieve the desired fidelity and benchmark the performance of quantum hardware in a realistic setup. For instance, we quantify the hardness of performing better classically than a noisy superconducting quantum processor by readily matching its output to the scaling function. Moreover, we relate the global fidelity to that of individual operations and establish its relationship with $\mathcal{χ}$ and N. We sharpen the requirements for noisy quantum computers to outperform classical techniques at running a quantum optimization algorithm in speed, size, and fidelity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Analysis of the Challenges in Developing Sample-Based Multi-fidelity Estimators for Non-deterministic Models

Multifidelity (MF) uncertainty quantification (UQ) seeks to leverage and fuse information from a collection of models to achieve greater statistical accuracy with respect to a single-fidelity counterpart, while maintaining an efficient use of computational resources. Despite many recent advancements in MF UQ, several challenges remain and these often limit its practical impact in certain application areas. In this manuscript, we focus on the challenges introduced by nondeterministic models to sampling MF UQ estimators. Nondeterministic models produce different responses for the same inputs, which means their outputs are effectively noisy. MF UQ is complicated by this noise since many state-of-the-art approaches rely on statistics, e.g., the correlation among models, to optimally fuse information and allocate computational resources. Here, we demonstrate how the statistics of the quantities of interest, which impact the design, effectiveness, and use of existing MF UQ techniques, change as functions of the noise. With this in hand, we extend the unifying approximate control variate framework to account for nondeterminism, providing for the first time a rigorous means of comparing the effect of nondeterminism on different multifidelity estimators and analyzing their performance with respect to one another. Numerical examples are presented throughout the manuscript to illustrate and discuss the consequences of the presented theoretical results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Rich Dynamics of a General Producer–Grazer Interaction Model under Shared Multiple Resource Limitations

Organism growth is often determined by multiple resources interdependently. However, growth models based on the Droop cell quota framework have historically been built using threshold formulations, which means they intrinsically involve single-resource limitations. In addition, it is a daunting task to study the global dynamics of these models mathematically, since they employ minimum functions that are non-smooth (not differentiable). To provide an approach to encompass interactions of multiple resources, we propose a multiple-resource limitation growth function based on the Droop cell quota concept and incorporate it into an existing producer–grazer model. The formulation of the producer’s growth rate is based on cell growth process time-tracking, while the grazer’s growth rate is constructed based on optimal limiting nutrient allocation in cell transcription and translation phases. We show that the proposed model captures a wide range of experimental observations, such as the paradox of enrichment, the paradox of energy enrichment, and the paradox of nutrient enrichment. Together, our proposed formulation and the existing threshold formulation provide bounds on the expected growth of an organism. Moreover, the proposed model is mathematically more tractable, since it does not use the minimum functions as in other stoichiometric models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Intra-canopy leaf trait variation facilitates high leaf area index and compensatory growth in a clonal woody encroaching shrub

Leaf trait variation enables plants to utilize large gradients of light availability that exist across canopies of high leaf area index (LAI), allowing for greater net carbon gain while reducing light availability for understory competitors. While these canopy dynamics are well understood in forest ecosystems, studies of canopy structure of woody shrubs in grasslands are lacking. To evaluate the investment strategy used by these shrubs, we investigated the vertical distribution of leaf traits and physiology across canopies of Cornus drummondii, the predominant woody encroaching shrub in the Kansas tallgrass prairie. We also examined the impact of disturbance by browsing and grazing on these factors. Our results reveal that leaf mass per area (LMA) and leaf nitrogen per area (Na) varied approximately threefold across canopies of C. drummondii, resulting in major differences in the physiological functioning of leaves. High LMA leaves had high photosynthetic capacity, while low LMA leaves had a novel strategy for maintaining light compensation points below ambient light levels. The vertical allocation of leaf traits in C. drummondii canopies was also modified in response to browsing, which increased light availability at deeper canopy depths. As a result, LMA and Na increased at lower canopy depths, leading to a greater photosynthetic capacity deeper in browsed canopies compared to control canopies. This response, along with increased light availability, facilitated greater photosynthesis and resource-use efficiency deeper in browsed canopies compared to control canopies. Furthermore, our results illustrate how C. drummondii facilitates high LAI canopies and a compensatory growth response to browsing—both of which are key factors contributing to the success of C. drummondii and other species responsible for grassland woody encroachment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Retrospective analysis of biochemical limitations to photosynthesis in 49 species: C 4 crops appear still adapted to pre‐industrial atmospheric [ CO 2 ]

Abstract Leaf CO 2 uptake ( A ) in C 4 photosynthesis is limited by the maximum apparent rate of PEPc carboxylation ( V pmax ) at low intercellular [CO 2 ] ( c i ) with a sharp transition to a c i ‐saturated rate ( V max ) due to co‐limitation by ribulose‐1:5‐bisphosphate carboxylase/oxygenase (Rubisco) and regeneration of PEP. The response of A to c i has been widely used to determine these two parameters. V max and V pmax depend on different enzymes but draw on a shared pool of leaf resources, such that resource distribution is optimized, and A maximized, when V max and V pmax are co‐limiting. We collected published A / c i curves in 49 C 4 species and assessed variation in photosynthetic traits between phylogenetic groups, and as a function of atmospheric [CO 2 ]. The balance of V max ‐ V pmax varied among evolutionary lineages and C 4 subtypes. Operating A was strongly V max ‐limited, such that re‐allocation of resources from V pmax towards V max was predicted to improve A by 12% in C 4 crops. This would not require additional inputs but rather altered partitioning of existing leaf nutrients, resulting in increased water and nutrient‐use efficiency. Optimal partitioning was achieved only in plants grown at pre‐industrial atmospheric [CO 2 ], suggesting C 4 crops have not adjusted to the rapid increase in atmospheric [CO 2 ] of the past few decades.

Pignon, Charles P.↗
DOE OSTI2024

Evolving Competitive Markets in SAPP: Leveraging Competitive Wholesale Electricity Markets to Drive Renewable Generation Capacity in the Southern African Power Pool (SAPP)

The SADC region has significant natural resource potential to increase renewable energy generation, improve electricity reliability, and support economic development. This research finds an apparent lack of confidence from electricity infrastructure investors in SAPP wholesale electricity markets, which increases risk perception and lowers the likelihood of capital deployment. With respect to free market fundamentals, competitive market obstacles and renewable energy development obstacles are characterized. Stakeholders identified the top obstacles to well-functioning competitive markets as insufficient transmission infrastructure for interconnection and regional movement of electricity, dominance of national single-buyer markets, and lack of or weak nation-state regulatory frameworks. Stakeholders prioritized the top three obstacles for renewable energy development as a lack of viable commercial arrangements for variable renewable energy (VRE) balancing, lack of functional and consistent nation-level regulations, and higher project costs related to reliance on imported equipment. With respect to potential solution options, stakeholders prioritized the development of new cost allocation and finance methods to facilitate new transmission expansion, training to educate new or potential new market entrants on SAPP processes, as well as modeling and analysis of regional SAPP participation benefits disaggregated to the nation-state level. From these perspectives, this research identified strategy options for consideration including transitioning SAPP to a regional transmission operator (RTO) for operation and planning of cross-border transmission facilities and market administration, shifting operations of SAPP member transmission systems to Independent System Operators (ISOs), establishing a regional regulatory authority and enhancing market data transparency. Implementing these reforms is expected to be challenging, but not insurmountable, given the domestic political, legal, and jurisdictional complexities of the SADC region.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Linking groundwater variability to ecosystem carbon and water use efficiencies across India

Carbon use efficiency (CUE) and water use efficiency (WUE) are important indicators of ecosystem health, reflecting the balance between carbon uptake and allocation, and the relationship between carbon assimilation and water loss. Although India shows large spatiotemporal variation in water table depth (WTD), and increasing groundwater stress, the influence of WTD on ecosystem functioning remains underexplored. This study uses satellite-based, modeled, and in-situ datasets to (1) quantify variations in CUE and WUE under shallow (SWTD) and deep (DWTD) WTD conditions across six homogeneous meteorological regions (HMRs), (2) evaluate temporal roles of gross primary productivity (GPP), net primary productivity (NPP), and evapotranspiration (ET) in driving these efficiencies, and (3) examine temporal responses to WTD shifts. SWTD regions generally showed 12 to 18 % higher GPP, 10 to 15 % higher NPP, and 10 to 20 % higher ET than DWTD zones, especially in semi-arid croplands and forests, leading to 8 to 12 % higher CUE and WUE. However, in humid and heavily irrigated regions such as northeastern and hilly India, CUE was up to 10 % higher in DWTD zones, possibly due to reduced respiration and better soil aeration compared to SWTD areas affected by waterlogging. During the Kharif (wet) season, DWTD croplands in humid zones had higher efficiencies, while in the Rabi (dry) season, SWTD croplands in northern India benefited from irrigation and cooler temperatures. These results highlight strong influence of WTD on carbon and water use processes and support the need for region-specific groundwater strategies.

Carbon use efficiency↗
DOE OSTI2023

A Novel Multi-Agent Deep Reinforcement Learning-enabled Distributed Power Allocation Scheme for mmWave Cellular Networks

We consider the power allocation problem over shared spectrum for millimeter-Wave (mmWave) cellular downlink. Existing approaches usually find sub-optimal solutions by solving a non-convex optimization which leads to scalability issues due to centralized control. Therefore, distributed and adaptive approaches are desirable. Recently, model-free Deep Reinforcement Learning (DRL) has achieved success in such wireless resource management tasks. By modeling the radio environment as a Markov Decision Process (MDP) with the base stations (BSs) being the agents, power allocation can be automated at the agent level with comparable throughput performance to conventional centralized schemes. The multi-agent setting presents new challenges as the radio environment is impacted by the joint actions of the agents and is no longer stationary from any individual agent’s perspective. Existing literature bypasses this non-stationarity violation by ignoring it which may cause performance degradation. To tackle this issue, we propose a distributed continuous power allocation scheme based on a modified version of multi-agent Deep Deterministic Policy Gradient (MADDPG) that is tailored for the distributed multiple-agent setting. The proposed scheme employs a centralized-training distributed-execution framework where Q-functions are trained over subsets of BSs while each BS determines its transmit power based only on its own local observation. It admits constant per-BS communication and computation complexity and is thus scalable to large networks. Numerical evaluation shows that the proposed scheme adapts well to a wide range of interference conditions and can achieve comparable or better performance than several state-of-the-art non-learning approaches.

99 GENERAL AND MISCELLANEOUS↗