Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Coordinated Modeling of Electric Grid and Natural Gas Network Operations

Presentation based upon full report of a Colorado case study and coordination framework, which is available at https://www.nrel.gov/docs/fy20osti/77096.pdf. JISEA analysts Brian Sergi, Omar Guerra, and Bri-Mathias Hodge will present on recent JISEA work on coordination between the natural gas and electricity sectors. Power and gas are becoming increasingly interdependent but weren't designed to function together. How does greater coordination impact system operations with different levels of solar and wind penetrations? This free JISEA presentation will take place in a Webinar on Tuesday, May 11, 2021 at 12 p.m.: Learn how greater coordination between the natural gas and electricity sectors impacts system operations with different levels of solar and wind penetrations. Presentation information includes: Historical and projected data for natural gas consumption and power generation in the United States as demonstrated by 2014 East Coast Polar Vortex, 2021 Texas Winter Storm Uri. Showing coupling points, FERC identified need for better coordination, different levels of coordination (decision making and optimization control), coordination framework. Case study on Colorado Front Range, ramping requirements and gas nominations, real-time dispatch (June and December scenarios), results of analysis of impacts of coordination on unserved load. Total real-time gas offtakes by node, impacts on unserved gas, effect on CO2 emissions. Discussions on clusions drawn from Colorado Case study expanded co-simulation via HELICS, objectives of the HELICS+ natural gas use case, modeling of hydrogen blending, techno economic assessment of blending, and blending impacts on energy content and pressure.

analysis↗
DOE OSTI2025

A Novel LDPP-MADDPG Approach for Distributed Power Allocation in mmWave Cellular Networks

This paper considers the problem of distributed beam scheduling and power allocation problem in millimeter- Wave (mmWave) cellular networks, in which multiple Base Stations (BSs) operate as individual operators over a shared spectrum. We propose a novel learning-aided approach that integrates the Lyapunov Drift-Plus-Penalty (LDPP) framework and Multi-agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithms. This offers a powerful approach to learning stable and constraint-aware policies, reaping the joint benefit of both LDPP and MADDPG, in complex multiagent environments. The major challenge for this approach is to integrate these two approaches in a meaningful and effective manner. The key idea to solve this problem is to introduce a novel feature of local observation that incorporates potential negative value of the reward function due to the stochastic constraints introduced by the LDPP framework. Empirical results demonstrate that our proposed scheme outperforms the baseline methods under various conditions.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2018

Ultrafine Pd ensembles anchored-Au 2 Cu aerogels boost ethanol electrooxidation

Modification of the noble metal-based aerogels from the atomic scale is rarely being investigated despite the rapid development of various metallic aerogels. Recent studies have verified that Pd ensembles are more effective than isolated Pd atoms toward electrooxidation of ethanol. However, the electrocatalytic efficiency is still insufficient. Here, for the first time, we successfully anchored Pd-ensembles on the surface of Au 2 Cu metallic hydrogels via kinetically controlled galvanic displacement reaction. The atomic configuration optimized Au 2 Cu@Pd metallic aerogels exhibited significantly enhanced mass activity ~11.6 times of commercial Pd and excellent stability with remained 90 % of mass activity after 300 potential cycle test. The ligand effect and geometric effect generated by the finely tailored atomic configurations including Pd ensembles and core-shell structure are critical for enhancing electrocatalytic efficiencies. Furthermore, the Pd ensembles anchored-Au 2 Cu aerogels hold a great promise for being potentially applied in devices such as direct alcohol fuel cells, biosensors and electronics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

LCOE*: Re-Thinking LCOE for Photovoltaic Systems

Solar industry is working towards reducing the levelized cost of energy (LCOE). The LCOE formulation includes various implicitly connected cost and physical design parameters. This entails complex cost analyses by economists, and electrical analysis and energy yield calculations of solar farms by device physicists/technologists. The standard formulation requires a constant exchange of information to optimize the design of a specific farm. In this paper, we present a fundamental reformulation of LCOE (in terms of LCOE*) to deconvolve the cost vs. energy yield analysis so that economists and technologists can work independently towards minimizing LCOE. We validate our LCOE* formulation by comparing LCOE calculated by the traditional vs. new method. We further provide a global analysis of LCOE* as an illustrative example. This LCOE* will accelerate new technology development (e.g. bifacial PV) by allowing a rapid and transparent analysis of its cost-performance trade-off.

14 SOLAR ENERGY↗
DOE OSTI2017

Kokhanok Mini-grid Business Case

A business case analysis was performed for the Village of Kokhanok. The business case analysis evaluated the optimal case from the technical analysis performed by the National Renewable Energy. The optimal case provided for repairing the two Vestas 17 (90 kW) wind turbine controllers and added electric thermal stoves and a battery. The project cost 0.5 million. The direct cost of electricity would likely decline from 0.69/kWh to 0.39/kWh. The direct costs don’t include administrative and distribution costs. The repair of controller and the addition of electric stoves reduced fuel consumption by 63% or approximately 22,000 gallons. The reduction in cost provides an opportunity for the Kokhanok Village Council to obtain financing through grants and loans to install renewable energy and reduce diesel fuel consumption to the cooperative

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Communication-Constrained Robust Control and Learning of Grid-Connected

The electric grid of things (EGoT) promises great potential for innovative grid services by tapping into vast load flexibility. However, the unique characteristics of EGoT, being a part of the cyber-physical electric power system, present both opportunities and challenges, especially concerning supply-demand balancing, stability, and communication constraints. Traditionally, centralized control was employed to ensure balance and stability in power systems. However, with the massive influx of EGoT devices, new strategies are needed to efficiently coordinate and control these distributed devices for optimal grid operations. While some studies have explored efficiency and economic models, there remains a gap in ensuring reliability under everyday operations and resilience during extreme conditions. Addressing this gap, this project develops the technology for an Energy Service Interface (ESI) that includes novel pricing, control, learning, and distributed optimization algorithms, which will enable utilities to recruit EGoT assets for crucial grid services such as load flexibility, voltage regulation, and situation-awareness. The key novelty of the proposed technology is the careful distribution of learning and control functions across utility and EGoT asset owners such that provably efficient and resilient grid operations are attained while respecting communication and information-exchange constraints. Specifically, the project team develops machine-learning enhanced load modeling methods to allow EGoT asset owners to learn their load capability and flexibility, and develops pricing-based and decentralized learning-based control so that asset owners can coordinate to meet system-wide demand-supply balance and reliability goals. For extreme situations involving high-impact, low-probability catastrophic events (termed the “black-sky” events), the team also develops (1) a “Feeder-Operating Center-on-a-Laptop” (FOCAL) software that can assist utility personnel in leveraging EGoT assets to accelerate the service recovery of damaged feeders, and (2) distributed optimization algorithms that can coordinate the operation points of EGoT devices under severe communication constraints. The proposed technology has been extensively tested and evaluated through simulations and on a testbed. In summary, as we transition into a more interconnected and digital power grid era, our project’s findings and developments offer a pivotal step toward guaranteeing both efficiency and resilience in the face of both everyday operations and rare “black-sky” events.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Where to cool off: a geospatial framework for placement of cooling centers

Indoor cooling is essential to reduce heat stress and increase passive survivability during heatwaves. Although air conditioning (AC) is recommended for maintaining indoor thermal comfort, low- and medium-income households in the U.S. often do not own an AC and/or limit AC usage to reduce energy consumption and associated costs, thereby risking their health and safety. With the frequency and intensity of heatwaves increasing, cooling centers are considered an appropriate alternative to indoor cooling and a possible mitigation strategy to prevent adverse health impacts of heat exposure. However, these centers are limited in numbers and not always accessible. This requires (i) developing a geospatial framework using physical and social factors for optimal siting of cooling centers to meet future needs and (ii) ranking of existing and potential cooling centers (schools, libraries, religious institutions) based on their accessibility among vulnerable populations and proximity to healthcare facilities. We developed and deployed a geospatial framework based on the Multi-criteria Decision Analysis approach in five U.S. cities (Los Angeles (LA), Phoenix, Austin, Atlanta, Miami) to evaluate the effectiveness of the framework in ranking cooling centers based on accessibility and population coverage. The results revealed that (i) access to cooling centers varies across cities and 32.2–50.7% of centers are within walking distance of the most vulnerable populations, (ii) vulnerable populations exposed to Urban Heat Island (UHI) effects are more likely to experience energy burden, and (iii) about 21.2–49.4% of population with high energy burden have access to these centers. Considering that more cooling centers are needed to assist energy burdened households alleviate heat exposure impacts, the framework developed herein could be adapted to incorporate other factors (e.g. health impacts, policies) to assess site suitability of existing shelters, identify potential sites for new cooling centers, and geo-target communities where energy efficient emerging technologies could be deployed to reduce heat stress.

58 GEOSCIENCES↗
DOE OSTI2020

Black-Box Optimization for Design of Concentrating Solar Power and Photovoltaic Hybrid Systems with Optimal Dispatch Decisions

The hybridization of concentrating solar power (CSP) and photovoltaics (PV) can enable dispatchable renewable electricity generation at a lower price than current stand-alone CSP systems. However, designing a CSP-PV hybrid system can be challenging because of the many degrees of freedom in design that affect the internal and external system interactions and trade-offs. We develop a methodology to determine optimal designs for CSP-PV hybrids by implementing NLopt's derivative-free, or “black-box,” algorithms around pre-existing CSP-PV hybrid simulation software that utilizes the National Renewable Energy Laboratory’s System Advisor Model (SAM); we then employ a dispatch optimization model to determine operational decisions that maximize a plant’s profits. We present optimal designs for CSP-PV hybrid systems dispatching against four time-of-delivery (ToD) pricing structures. NLopt’s algorithms can improve the base case design’s power purchase agreement (PPA) price by 15% to 21%, depending on the ToD pricing structure. In addition, we present the resulting optimal CSP-PV hybrid design’s annual performance metrics, which tend to have capacity factors between 50% and 62%, but are able to generate electricity during the year’s highest-valued periods about 90% of the time. Lastly, we investigate the trade-offs between capacity factor and PPA price using Pareto fronts and demonstrate that, for some ToD pricing structures, the system capacity factor can increase by 20% but at the expense of a 2% increase in PPA price.

black-box↗
DOE OSTI2017

Shungnak Mini-grid Business Case

A business case analysis was performed for the Village of Shungnak. The business case analysis evaluated the optimal case from the technical analysis performed by the Sandia National Laboratory using Microgrid Design Toolkit (MDT). The optimal case adds a 500 kW wind plant, 100 kW of solar photovoltaics (PV), 100 kW diesel and 46 kW of electric thermal stoves. The project cost 4.3 million. The direct cost of electricity would likely decline from 0.63/kWh to 0.55/kWh. The direct costs don’t include administrative and distribution costs. The addition of the renewable resources reduced diesel fuel consumption by more than 74% or approximately 96,000 gallons. The reduction in cost provides an opportunity for Alaska Village Electric Cooperative to obtain financing through grants and loans to install renewable energy and reduce diesel fuel consumption to the cooperative.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Poster: Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The rapid integration of artificial intelligence (AI) in the utility transmission and distribution (T&D) sector is revolutionizing traditional grid management practices. As utilities encounter complexities from evolving consumer behaviors and energy integration, AI becomes a critical solution for enhancing grid monitoring, fault detection, and operational optimization. However, increased reliance on interconnected technologies introduces significant cybersecurity risks, regulatory compliance challenges, and human factors concerns. This study proposes a strategic, responsible and consequence-driven approach to AI implementation, examining the dual nature of AI adoption by highlighting its transformative benefits for utilities and associated risks. It provides utilities with a framework for evaluating AI integration, enabling them to navigate challenges and capitalize on opportunities to achieve greater reliability, efficiency, and resilience in an increasingly complex energy landscape.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Resilient Cyber Infrastructure for the Minimum Wind Curtailment Remedial Control Scheme

Integration of Distributed Energy Resources (DER) has been significantly increasing in the electric power grid. One of the predominant renewable energy sources, wind energy, possess a significant challenge for grid operations, due to its intermittency, uncertainty and variability. In changing operating conditions with wind uncertainty, part of wind may need to be curtailed for the safe utilization of the transmission system. In order to minimize the wind power curtailment and to keep the power flow on a transmission line under limits, a cyber resilient Distributed Remedial Action Scheme (DRAS) is developed in this paper. The RAS is formulated as an optimization problem, considering the real power flow constraints of the transmission lines and given wind variability. In this paper, DRAS is developed to operate even with failures in the computing nodes to make it cyber-resilient. Distributed simplex algorithm is used for optimization in the distributed RAS. The DRAS is implemented in a decentralized platform called Resilient Information Architecture Platform for Smart Grid (RIAPS) to enable cyber resiliency of DRAS. The effectiveness of the proposed approach is validated through offline simulations of the New England 39 bus system and online simulations of IEEE 14 bus test system. In conclusion, a cyber physical test bed utilizing Real Time Digital Simulator (RTDS), Phasor Measurement Units (PMUs), and BeagleBones has been used for the online simulation and validation of the developed cyber-resilient RAS.

17 WIND ENERGY↗
DOE OSTI2017

Testing of Strategies for the Acceleration of the Cost Optimization

The general problem addressed in the Nuclear-Renewable Hybrid Energy System (N-R HES) project is finding the optimum economical dispatch (ED) and capacity planning solutions for the hybrid energy systems. In the present test-problem configuration, the N-R HES unit is composed of three electrical power-generating components, i.e. the Balance of Plant (BOP), the Secondary Energy Source (SES), and the Energy Storage (ES). In addition, there is an Industrial Process (IP), which is devoted to hydrogen generation. At this preliminary stage, the goal is to find the power outputs of each one of the N-R HES unit components (BOP, SES, ES) and the IP hydrogen production level that maximizes the unit profit by simultaneously satisfying individual component operational constraints. The optimization problem is meant to be solved in the Risk Analysis Virtual Environment (RAVEN) framework. The dynamic response of the N-R HES unit components is simulated by using dedicated object-oriented models written in the Modelica modeling language. Though this code coupling provides for very accurate predictions, the ensuing optimization problem is characterized by a very large number of solution variables. To ease the computational burden and to improve the path to a converged solution, a method to better estimate the initial guess for the optimization problem solution was developed. The proposed approach led to the definition of a suitable Monte Carlo-based optimization algorithm (called the preconditioner), which provides an initial guess for the optimal N-R HES power dispatch and the optimal installed capacity for each one of the unit components. The preconditioner samples a set of stochastic power scenarios for each one of the N-R HES unit components, and then for each of them the corresponding value of a suitably defined cost function is evaluated. After having simulated a sufficient number of power histories, the configuration which ensures the highest profit is selected as the optimal one. The component physical dynamics are represented through suitable ramp constraints, which considerably simplify the numerical solving. In order to test the capabilities of the proposed approach, in the present report, the dispatch problem only is tackled, i.e. a reference unit configuration is assumed, and each one of the N-R HES unit components is assumed to have a fixed installed capacity. As for the next steps, the main improvement will concern the operation strategy of the ES facility. In particular, in order to describe a more realistic battery commitment strategy, the ES operation will be regulated according to the electricity price forecasts.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2015

Estimating Reduced Consumption for Dynamic Demand Response

Growing demand is straining our existing electricity generation facilities and requires active participation of the utility and the consumers to achieve energy sustainability. One of the most effective and widely used ways to achieve this goal in the smart grid is demand response (DR), whereby consumers reduce their electricity consumption in response to a request sent from the utility whenever it anticipates a peak in demand. To successfully plan and implement demand response, the utility requires reliable estimate of reduced consumption during DR. This also helps in optimal selection of consumers and curtailment strategies during DR. While much work has been done on predicting normal consumption, reduced consumption prediction is an open problem that is under-studied. In this paper, we introduce and formalize the problem of reduced consumption prediction, and discuss the challenges associated with it. We also describe computational methods that use historical DR data as well as pre-DR conditions to make such predictions. Our experiments are conducted in the real-world setting of a university campus microgrid, and our preliminary results set the foundation for more detailed modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2018

MN Solar Pathways: Solar Potential Analysis of Minnesota-sited generation

As part of the Minnesota Solar Pathways project, funded in part by the Department of Energy’s Solar Energy Technologies Office, Clean Power Research completed a scenario-based analysis that estimates and optimizes the levelized cost of capacity for resource additions to generate 10% of Minnesota’s electricity from solar by 2025 and 70% of Minnesota’s electricity from solar and wind by 2050, using generation resources located only in Minnesota. The analysis concludes that it can be cheaper to overbuild solar + wind and curtail surplus than to store all generation. The analysis described in this report was followed by a second analysis completed in 2020 that used the same modeling framework from the Minnesota study to analyze high renewables penetrations across the Midcontinent Independent System Operator(MISO) region.

14 SOLAR ENERGY↗
DOE OSTI2023

Data-Centric AI and the Open Energy Data Initiative (OEDI)

This presentation emphasizes the critical importance of data-centric AI. The limitations of model-centric AI when dealing with poor or insufficient data are highlighted, and it is illustrated how training models on inaccurate or noisy data leads to suboptimal results. This talk advocates for a hybrid approach that combines a focus on data quality and model parameters to achieve optimal results. The Open Energy Data Initiative (OEDI) is introduced as a valuable resource for obtaining high-quality energy-related datasets, hosting nearly 2,000 publicly accessible datasets, including 99 solar-related datasets, totaling over 2.7 petabytes of data. OEDI's data lakes enable users to query and work with data without extensive transfers. In conclusion, the significance of data-centric AI and adherence to data curation best practices is emphasized, positioning OEDI as a prime source of high-quality data for AI and machine learning in the renewable energy sector.

AI↗
DOE OSTI2019

Predicting Storm Outages Through New Representations of Weather and Vegetation

This paper presents new developments in an outage prediction model (OPM) for an electric distribution network in the Northeastern United States and assesses their significance to the OPM performance. The OPM uses regression tree models fed by numerical weather prediction outputs, spatially distributed information on soil, vegetation, electric utility assets, and historical power outage data to forecast the number and spatial distribution of outages across the power distribution grid. New modules introduced hereby consist in 1) a storm classifier based on weather variables; 2) a multimodel optimization of regression tree output; and 3) a post-processing routine for more accurately describing tree-leaf conditions. Model implementations are tested through leave-one-storm-out cross-validations performed on 120 storms of varying intensity and characteristics. The results demonstrate that the median absolute percentage error of the new OPM version decreased from 130% to 59% for outage predictions at the service territory level, and the OPM skills for operational forecasts are consistent with the skills based on historical storm analyses.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Physics-Informed Evolutionary Strategy Based Control for Mitigating Delayed Voltage Recovery

Here, in this work we propose a novel data-driven, real-time power system voltage stability control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to secure system voltage stability. The problem is challenging due to the high-dimensional feature of the power system model and the fast-changing and uncertain nature of power system operation scenarios. To this end, a model-free and derivative-free guided ES method is applied. The method is further combined with a meta-learning strategy to make the learnt control policy automatically adapted to unseen operation conditions and fault scenarios, which is highly desired for real-time emergency control. Last but not least, physical knowledge is embedded in the above method through a trainable action mask technique to rule out unnecessary load shedding actions for better learning and control performance. Case studies on the IEEE 300-bus system and comparisons with other state-of-the-art benchmark methods verify the superiority of the proposed physics-informed guided meta ES method in realizing fast and adaptive power system voltage stability control.

42 ENGINEERING↗