Search NASA⌕ Search

SEARCH · Search NASA

Results for “policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A Two-Stage Quantum Reinforcement Learning Method for Multi-Objective Transmission Switching

Multi-objective transmission switching (MO-TS) problems involve the strategic reconfiguration of network topology to simultaneously optimize multiple objectives. As the system scale increases, finding feasible solutions becomes increasingly challenging due to the problem's nonlinearity and high computational complexity. To address these challenges, this paper proposes a two-stage quantum reinforcement learning method that leverages potential quantum advantages for MO-TS. In the first stage, candidate switching lines are identified using a graph-theoretical approach to reduce the problem's dimensionality. The second stage introduces a quantum-classical reinforcement learning framework, where a learnable measurement-based CNN-ResVQC architecture is developed to effectively reduce the input dimension for quantum processing, mitigate vanishing gradients, and enhance trainability while improving the quantum circuit's flexibility in modeling complex decision policies for MO-TS. Numerical studies on IEEE 14-bus, 57-bus, and 118-bus systems demonstrate that the proposed algorithm achieves superior training stability and faster convergence with approximately 1% of the network parameters required by classical algorithms, highlighting its effectiveness, efficiency, and scalability. Furthermore, the practicality is validated through its stable convergence under three common quantum noise channels.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

GreenThrift: Optimizing Carbon and Cost for Flexible Residential Loads

Reducing buildings’ carbon emissions is an important sustainability challenge. While scheduling flexible building loads has been previously used for a variety of grid and energy optimizations, carbon footprint reduction using such flexible loads poses new challenges since such methods need to balance both energy and carbon costs while also reducing user inconvenience from delaying such loads. This paper highlights the potential conflict between electricity prices and carbon emissions and the resulting trade-offs in carbon-aware and cost-aware load scheduling. To address this trade-off, we propose GreenThrift, a home automation system that leverages the scheduling capabilities of smart appliances and knowledge of future carbon intensity and cost to reduce both the carbon emissions and costs of flexible energy loads. At the heart of GreenThrift is an optimization technique that automatically computes schedules based on user configurations and preferences. We evaluate the effectiveness of GreenThrift using real-world carbon intensity data, electricity prices, and load traces from multiple locations and across different scenarios and objectives. Our results show that GreenThrift can replicate the offline optimal and retains 97% of the savings when optimizing the carbon emissions. Moreover, we show how GreenThrift can balance the conflict between carbon and cost and retain 95.3% and 85.5% of the potential carbon and cost savings, respectively.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Emulator-Based Bayesian Calibration of the CISNET Colorectal Cancer Models

Purpose To calibrate Cancer Intervention and Surveillance Modeling Network (CISNET)'s SimCRC, MISCAN-Colon, and CRC-SPIN simulation models of the natural history colorectal cancer (CRC) with an emulator-based Bayesian algorithm and internally validate the model-predicted outcomes to calibration targets.Methods We used Latin hypercube sampling to sample up to 50,000 parameter sets for each CISNET-CRC model and generated the corresponding outputs. We trained multilayer perceptron artificial neural networks (ANNs) as emulators using the input and output samples for each CISNET-CRC model. We selected ANN structures with corresponding hyperparameters (i.e., number of hidden layers, nodes, activation functions, epochs, and optimizer) that minimize the predicted mean square error on the validation sample. We implemented the ANN emulators in a probabilistic programming language and calibrated the input parameters with Hamiltonian Monte Carlo-based algorithms to obtain the joint posterior distributions of the CISNET-CRC models' parameters. We internally validated each calibrated emulator by comparing the model-predicted posterior outputs against the calibration targets.Results The optimal ANN for SimCRC had 4 hidden layers and 360 hidden nodes, MISCAN-Colon had 4 hidden layers and 114 hidden nodes, and CRC-SPIN had 1 hidden layer and 140 hidden nodes. The total time for training and calibrating the emulators was 7.3, 4.0, and 0.66 h for SimCRC, MISCAN-Colon, and CRC-SPIN, respectively. The mean of the model-predicted outputs fell within the 95% confidence intervals of the calibration targets in 98 of 110 for SimCRC, 65 of 93 for MISCAN, and 31 of 41 targets for CRC-SPIN.Conclusions Using ANN emulators is a practical solution to reduce the computational burden and complexity for Bayesian calibration of individual-level simulation models used for policy analysis, such as the CISNET CRC models. In this work, we present a step-by-step guide to constructing emulators for calibrating 3 realistic CRC individual-level models using a Bayesian approach.

artificial neural networks↗
DOE OSTI2026

Using Machine Learning to Understand Electric and Hybrid Vehicles Ownership in Burdened and Nonburdened Communities

Transitioning to electric and hybrid vehicles (EHVs) for all communities is a pivotal step toward sustainable transportation and environmental conservation. This paper aims to understand the adoption of EHVs, focusing on burdened communities (BCs) in the United States. The EHV ownership-based analysis combines two datasets—behavioral data from the Puget Sound Regional Travel Survey integrated with BCs (Justice40) data covering transportation insecurity, environmental burden, social vulnerability, health vulnerability, and climate and disaster risk burden. After creating this unique database, descriptive analysis and modeling are used to analyze the data and predict EHV ownership in the future. Specifically, we use a new method that combines particle swarm optimization (PSO) with a stacking model named PSO-Stacking, which incorporates heterogeneous base learners of machine learning and deep learning. PSO applies a customized objective function to select the optimal hyperparameters for heterogeneous learners within the stacking model, effectively addressing challenges such as multicollinearity, data imbalance, nonlinearity, and overfitting. The proposed solution covers more accurate results than standard benchmark models for EHV ownership in BCs and non-BCs. In addition, the results of the PSO-Stacking method are explained using the local interpretable model-agnostic explanations technique. Results show a negative correlation between the BCs indicators, that is, higher transportation insecurity associated with lower EHV ownership. Furthermore, BCs have higher future climate risk scores, diesel particulate matter levels, and PM2.5 in the air than non-BCs because of higher conventional vehicle ownership. These communities are at higher risk and can benefit from electrification, EV infrastructure, and EV policies to address environmental challenges.

Aslam, Zeeshan [ORNL]↗
DOE OSTI2025

Enhancing Power Resilience for Remote Communities: A Comprehensive Renewable Energy Solution for Itbayat Island

The island of Itbayat, Philippines, faces significant challenges in maintaining a reliable and resilient power supply due to its current reliance on a vulnerable power distribution system managed by a local electric cooperative. The existing infrastructure, which includes diesel generators and a radial network configuration with some above-ground lines, is highly susceptible to frequent typhoons and adverse weather conditions. These factors, combined with inadequate staffing and high operational costs, result in frequent power outages that disrupt daily life and hinder economic development. This white paper proposes a comprehensive solution to enhance the resilience and reliability of Itbayat's power system by integrating renewable energy sources, specifically solar photovoltaic (PV) systems, battery storage, and a microgrid controller. The proposed solution aims to reduce dependency on diesel fuel, optimize energy use, and provide a sustainable and robust power supply for the island. Key components of the solution include: 1. Solar PV Installation: Deploying solar PV panels to harness abundant solar energy, reducing reliance on diesel fuel. 2. Battery Storage Systems: Installing battery storage to store excess solar energy and ensure a continuous power supply during low solar generation periods. 3. Microgrid Controller: Implementing a microgrid controller to manage and optimize the integration of solar PV, battery storage, and existing diesel generators. The proposed solution addresses several critical issues, including system vulnerability, generator dependency, and operational inefficiencies. By adopting this innovative approach, Itbayat Island can achieve a more resilient, efficient, and sustainable energy infrastructure, ensuring a stable power supply for its residents and enhancing overall energy security.

14 SOLAR ENERGY↗
DOE OSTI2024

FORCE Update 2024

The Framework for Optimization of Resources and Economics (FORCE) tool suite is the U.S. Department of Energy’s Nuclear Integrated Energy Systems (IES) Program flagship tool suite for technoeconomic IES analysis of IES. This tool suite is useful for analysis designed to evaluate and improve the technoeconomics of energy production systems, particularly for systems including nuclear technology. In this report, we document the development activity for the FORCE tool suite to extend its capabilities as performed during fiscal year 2024. In addition to reliability and accessibility, capability is one of the three standards guiding the development of the FORCE tool suite and the software codes that are its constituent parts. Extending the capabilities of the FORCE tool suite allows analysis both within the IES program as well as industry, university, and laboratory partners to perform analysis with more accuracy, insight, and impactful narrative. Four areas of capability development were the focus of activity this year: economic parameter uncertainty quantification, multiresolution analysis, components-to-optimization workflow automation, and statespace construction workflows for real-time optimal control. In economic parameter uncertainty quantification, the ability of HERON to capture risk due to scenarios (weather and energy demand uncertainty) was expanded to also include uncertainties in financial parameters such as capital cost or operation and maintenance costs. By including these sources of uncertainty, which are sometimes very large compared with scenario uncertainty, HERON is better able to capture the risk posed by investment in various IES technology. Because of this, analysts can also consider the reduction in risks that can be realized by choice of some technologies. In multiresolution analysis, development activity extended on work completed previously. In fiscal year 2023, methods for decomposing time series signals, such as demand, solar and wind availability, and price profiles, were analyzed and down-selected to those most effective at splitting signals into different resolutions. These resolutions allow considering the influence of different energy demand and supply behaviors across different time scales. For example, energy demand might be divided into seasonal, weekly, and hourly profiles. In fiscal year 2024, this preliminary work was extended and implemented within the Risk Analysis Virtual Environment (RAVEN) risk and uncertainty analysis platform, which is used throughout the FORCE framework. This development of the “multi-resolution time series analysis” (MR-TSA) module in RAVEN allows training synthetic history generators on complex time series. These synthetic history generators can then be used in HERON for generating scenarios that represent possible market and weather scenarios that can be analyzed on different time scales. We envision completing this work in the future, implementing multiresolution dispatch optimization strategies that can make the most beneficial use of these stratified time histories. In components-to-optimization workflow development, workflows for translating user inputs of components into algorithms for algebraic optimization were selected and implemented. Similar algorithms within the Holistic Energy Resource Optimization Network (HERON) were separated from the main code base of HERON and gathered with the components-to-optimization workflows in the new Dispatch Optimization Variable Engine (DOVE) software library. This modularization allows FORCE users to analyze dispatch optimization and energy system duty cycles independently of HERON, which previously was a burdensome task. Additionally, these dispatch optimization algorithms, set up in an independent library, can now be used across all software applications within FORCE, especially including the real-time optimal control software Optimization of Real-time Capacity Allocation (ORCA). Allowing FORCE software to share dispatch optimization algorithms within a single library allows for improved software maintenance and reliability. In statespace characterization workflow development, alternative workflows for optimizing dispatch with additional technical accuracy was the focus, particularly to improve the real-time optimization decision making in ORCA. Using algorithms and workflows initially developed for the Feasible Actuator Range Modifier (FARM), workflows for determining the statespace representation of IES were identified and demonstrated. The resulting dispatch optimization required a more robust optimization algorithm than that originally used in HERON (and moved to DOVE), which required adding an alternate workflow to DOVE that can more accurately match the behavior of physical systems using a partial differential equation representation. In conclusion, capability developments in the FORCE tool suite in fiscal year 2024 have improved the ability of the FORCE tool suite to perform

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Project Planning for Community Resilience: Aquinnah and Chilmark, Massachusetts

This report presents the findings of an energy system planning study for the towns of Aquinnah and Chilmark, MA, on the island of Martha’s Vineyard, conducted under the U.S. Department of Energy ETIPP program. The study used the DER-CAM model to optimize the deployment of PV and battery microgrids to enhance energy resilience against power outages, particularly winter storms. Key findings show that PV is highly cost-effective and delivers net annual savings. However, due to limited rooftop space and low winter solar output, PV and battery storage alone cannot support the full critical load during outages. Solutions incorporating conventional backup generators were found to be more economically viable for achieving 100% critical load support.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

A framework and calculator for evaluating the impacts of shelf life extension and other food loss and waste reduction technologies

Optimization of the food supply chain (FSC) depends on reducing food waste, especially at the consumer stage, where a substantial portion of food is not eaten, but instead disposed of via landfill, incineration, or in-sink disposals. One key strategy is to increase the time that consumers have before food goes bad or expires. This study developed a framework to assess the efficacy of shelf-life extension (SLE) technologies for mitigating food loss and waste (FLW), such as packaging improvements. The impact flows through the entire FSC, reducing FLW, energy use, and other inputs at each stage. The framework and resulting calculator can be used to evaluate the impact of FLW reduction at any stage for any food commodity. As shown by two SLE cases, the calculator is valuable for policy-makers, government entities, and professionals, specifically those in marketing, business development, and capital projects teams, to comprehensively evaluate the impacts of FLW reduction technologies and practices. The framework and calculator are sensitive to the shape of the consumption curve, the fraction of inedible waste, and the current shelf life. The calculator was used to assess the impacts of the United States goal of reducing food waste by consumers through various SLE lengths. It was found that uptake of several near-ready-to-deploy SLE technologies would reduce annual food production demand by about 10–19 MMT and supply chain energy consumption by 240–410 PJ in the United States.

Food loss and waste (FLW)↗
DOE OSTI2025

Understanding and Modeling Pooled Rideshare Acceptance: Influential Factors, Preferred User Experiences, and Implications

This dissertation explores factors influencing pooled rideshare (PR) adoption to provide actionable insights for transportation network companies (TNCs) and policymakers. PR allows travelers to share rides with unknown passengers, offering benefits such as cost reduction and congestion relief. However, adoption remains limited due to safety concerns, privacy issues, and trust in rideshare platforms. A national U.S. survey with 5,385 respondents examined transportation preferences and barriers to PR adoption. Exploratory and confirmatory factor analyses identified five key factors influencing PR consideration—safety, service experience, privacy, traffic/environment, and time/cost. Second factor analyses examined ways to optimize PR experiences, revealing four factors—comfort/ease of use, convenience, vehicle technology/accessibility, and passenger safety. Privacy concerns, for instance, using regression analysis, were found to reduce the likelihood of PR adoption by 77%, and convenience had the potential to increase it by 156%. The Pooled Rideshare Acceptance Model (PRAM), based on the Technology Acceptance Model, assessed the impact of these factors using the Structural Equation Model (SEM). Privacy, safety, trust, and convenience had a large effect (Cohen's f2 > 0.35) on PR acceptance, while multigroup analyses (PRAMMA) explored 16 demographic variables such as gender, generation, and income, emphasizing the need for tailored strategies. Based on all the statistical analysis and workshops using descriptive statistics, 95 actionable recommendations were made from the riders' perspective. Findings highlight the importance of customized services, user experience improvements, and policy interventions to enhance PR adoption. This dissertation provides a roadmap for future research and policy development, ensuring evidence-based, practical strategies to improve PR services in the U.S. and beyond.

Gangadharaiah, Rakesh↗
DOE OSTI2026

Optimizing Fleet Operations With Telematics [Slides]

Through the U.S. Department of Energy's Energy to Communities (E2C) program, NLR, other national laboratory experts, and select organizations provide Expert Match - free, short-term technical assistance to address near-term energy challenges and questions. Expert Match is for community stakeholders who have decision-making power or influence in their community but need access to additional energy expertise to inform key upcoming decisions. This Expert Match request supported Prince William County, VA with information about fleet charging and telematics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Scale effects on core design, fuel costs, and spent fuel volume of pressurized water reactors

The desire to improve the economic competitiveness and deployment pace of nuclear energy through modularization, manufacturing, and series production had led to the development of smaller size reactors. As the standard 17x17 fuel technology is mainly maintained in the pressurized water reactors (PWRs) category, this translates into a lower number of fuel assemblies in the core and sometimes a reduced fuel height. To assess the impact of such scale change in core design on fuel cycle cost and spent fuel volume, a scoping analysis tool is developed based on infinite lattice calculations, leakage, fuel management reduced models, and levelized unit cost of electricity (LCOE) estimate. As such, cost dynamics driven by fuel specific power, burnup, core leakage, feed, cycle length, fuel assembly height as well as uranium market data are captured with consistent set of assumptions and analysis methods. A selection of 5 reactor designs representative of leading PWR developers is assessed and compared. Pursuing higher specific powers and optimal burnups are highlighted as the main fuel cost reduction drivers, nevertheless, practical limitations and opportunities must be evaluated to establish the feasibility of such enhanced fuel operation. In consequence, a detailed core design is performed using SIMULATE3 code for 5 PWR variations including natural and forced coolant circulation modes, two reactor scales, power densities of 73, 112, and 123 kW/l and higher discharge burnups. Design and optimization are performed at the lattice level, for the reflector, and at the core loading level. Satisfactory steady-state operation including power distribution, coolant operating limits, and reactivity requirements are analyzed and reported in this paper. The fuel economics of the detailed core designs confirm the scoping analysis findings. Despite the unlocked power uprates in small PWRs, the achievable burnup for a given fuel specific power requires more enrichment and shorter fuel height results in higher fabrication costs per mass of fuel, which makes scaling down core size a more expensive endeavor on the fuel cycle front. Spent fuel volumes are reported for the PWRs designed in this paper. Furthermore, these volumes are driven by the core average discharge burnup regardless of the scale in consideration. Additional cost and core performance aspects related to heavy reflector gains, fuel-reflector substitution, and disposal cost policy in the U.S. are examined.

42 ENGINEERING↗
DOE OSTI2026

Impacts of Regional Coordination on Transmission Needs for Power System Resource Adequacy [Slides]

Resource adequacy (RA) is an important component of bulk power system reliability that addresses whether there are sufficient resources available to meet electricity demand at all times. RA analysis is used to assess whether the planned power system will provide reliable electricity to consumers while accounting for equipment outages, weather variability, and load uncertainty. Coordination between regions can enable resource sharing to meet RA needs if sufficient transmission capacity exists. Transmission's role in RA coordination can be particularly pronounced for large power systems like the U.S. electricity grid which contains geographically diverse demand and weather-dependent resources. Depending on the level of coordination desired, existing inter-regional transmission capacity may not be sufficient. This study is designed to assess optimal pathways for the development of inter-regional transmission in the U.S. under varying levels of RA coordination. Results can inform long-term grid infrastructure planning and provide insights into potential benefits of greater coordination for generation and transmission planning between regional U.S. power systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Integration and Optimization of Loads, and Renewables for Grid-Interactive Efficient Buildings

Deploying advanced building control strategies in small- and medium-sized commercial buildings (SMBs) is critical but constrained by two major challenges: (1) the lack of sensor and control infrastructure (SCI) and (2) the significant engineering effort required for implementation and configuration. While these barriers limit large-scale adoption in SMBs, they remain underexplored in the literature, which has largely emphasized feasibility over scalability.

25 ENERGY STORAGE↗
DOE OSTI2024

Assessment of the impacts of renewable energy variability in long-term decarbonization strategies

To meet the nationally determined contributions proposed by the countries that signed the Paris Agreement, investments must be made in renewable generation technologies such as solar and wind. However, due to their high variability, these technologies pose challenges in terms of meeting demand or generating excess electricity. For this reason, energy system models are designed to capture this variability by considering flexibility technologies. Nevertheless, it is important to note that some energy system models lack integration with other sectors. Therefore, integrated assessment models have been employed to evaluate mitigation strategies, as they endogenously consider the linkages between energy and non-energy sectors. In addition, due to their complexity, these models do not account for the variability of renewable resources. Hence, this research aims to address this issue. Here, this work represents the first attempt to evaluate how the introduction of hourly resolution affects the outcomes of integrated assessment models, specifically focusing on the Global Change Analysis Model (GCAM). We employ a soft-linking approach between the GCAM and the Highway to Renewable Energy Systems model (H2RES, an hourly level energy system model) to accomplish this. The proposed approach is tested using Chile’s Nationally Determined Contributions under different hydrological profiles in the power sector. The results show that it is possible to use the capacity obtained from the Global Change Analysis Model and implement it on an hourly scale. However, the feasibility of implementation depends on high levels of flexibility technologies, such as battery energy storage. When given the choice of investments in renewable sources and flexible technologies, the optimal dispatch of the H2RES model show small differences than those obtained by GCAM-Chile. H2RES differs from GCAM-Chile in approximately 5% for wind and 3% for solar electricity generation in the year 2050. However, feasible integration of significant renewable sources is obtained with relatively high Critical Excess Electricity Production levels, reaching 20% in 2050. This excess electricity is attributed to the necessity for flexible technologies to manage the intermittency of renewables sources when hourly profiles of such sources are considered.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Single-Phase to Split-Phase Inverters with Advanced Grid Support Functions for Grid-Interactive Applications

This work presents a cost-effective single-phase to split-phase inverter with a reduced switch count, achieving grid interactive performance while maintaining operational efficiency. The proposed system integrates an Andronov-Hopf oscillator based secondary controller, which inherently embeds a nonlinear resistive droop architecture, ensuring rapid dynamic response. A Lyapunov energy function-based primary control enhances transient stability and regulation, while an internal model-based point of common coupling voltage estimation enables cost optimization without additional sensors. Equipped with advanced grid support functionalities, the inverter facilitates seamless distribution system operation with enhanced robustness. The effectiveness of the proposed architecture and control strategy is validated through MATLAB/Simulink and PLECS simulations, demonstrating its feasibility for high-performance grid-supportive applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Powered By CADET

The Capacity Expansion Decision Support for Distribution Networks (CADET) is a Python-based library and framework for creating electrical distribution system capacity planning tools for cost-effective, reliable power delivery. It enables the creation of modular, scalable, and extensible distribution capacity planning tools by providing a high-level optimization interface, parameter and options data managers, optimization constraint and objective libraries, generalized nomenclature, a system for tracking and modifying distribution network changes, optimization solution validation, and other capabilities. This webinar will describe 1) the motivation for creating CADET, 2) key designs, and 3) several use cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Community Public Mobility Using On-Demand, Low-Speed Electric Vehicles: A Case Study in Downtown St. Louis, Missouri

Legacy fixed route transit systems designed to serve commuters struggle to provide efficient and effective service for short neighborhood trips and for population groups unable to access and egress transit stops using active modes (e.g., elderly, disabled). Neighborhood on-demand transit (ODT) services using low-speed electric vehicles (LSEV) are an innovative technological solution that can help fill this gap in service (e.g., short, high-frequency trips) for diverse populations and trip types. This study evaluated user characteristics and travel behavior for a neighborhood ODT service (using LSEVs) in downtown St. Louis, Missouri using responses from a community survey (n=244), ridership data, and vehicle trajectory information. A comparative analysis between neighborhood ODT, fixed route transit, and transportation network companies (TNC) was also conducted from the perspectives of total travel time, cost, and greenhouse gas emissions. Ultimately, the goal of the analysis was to motivate and inform holistic public mobility systems where different services are optimized to meet specific community needs. Findings indicate that the neighborhood ODT was effective at reaching diverse populations (elderly (20%), lower income (27%), and households with limited access to private vehicles (34%)). ODT reduced total travel time by 32% compared to fixed route transit, produced 2.4 - 4.3 times less greenhouse gas emissions per passenger mile (compared to transit and TNCs), and was more affordable (free to users) than alternative options ($1 for transit, $10-12 for TNCs). Overall satisfaction rates were high, with 80% of respondents rating the service a 4 or 5 out of 5.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

A Novel LDPP-MADDPG Approach for Distributed Power Allocation in mmWave Cellular Networks

This paper considers the problem of distributed beam scheduling and power allocation problem in millimeter- Wave (mmWave) cellular networks, in which multiple Base Stations (BSs) operate as individual operators over a shared spectrum. We propose a novel learning-aided approach that integrates the Lyapunov Drift-Plus-Penalty (LDPP) framework and Multi-agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithms. This offers a powerful approach to learning stable and constraint-aware policies, reaping the joint benefit of both LDPP and MADDPG, in complex multiagent environments. The major challenge for this approach is to integrate these two approaches in a meaningful and effective manner. The key idea to solve this problem is to introduce a novel feature of local observation that incorporates potential negative value of the reward function due to the stochastic constraints introduced by the LDPP framework. Empirical results demonstrate that our proposed scheme outperforms the baseline methods under various conditions.

99 - GENERAL AND MISCELLANEOUS↗