SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

All sources NASA NTRS DOE OSTI

DOE OSTI2016

Economic Analysis and Optimal Sizing for behind-the-meter Battery Storage

This paper proposes methods to estimate the potential benefits and determine the optimal energy and power capacity for behind-the-meter BSS. In the proposed method, a linear programming is first formulated only using typical load profiles, energy/demand charge rates, and a set of battery parameters to determine the maximum saving in electric energy cost. The optimization formulation is then adapted to include battery cost as a function of its power and energy capacity in order to capture the trade-off between benefits and cost, and therefore to determine the most economic battery size. Using the proposed methods, economic analysis and optimal sizing have been performed for a few commercial buildings and utility rate structures that are representative of those found in the various regions of the Continental United States. The key factors that affect the economic benefits and optimal size have been identified. The proposed methods and case study results cannot only help commercial and industrial customers or battery vendors to evaluate and size the storage system for behind-the-meter application, but can also assist utilities and policy makers to design electricity rate or subsidies to promote the development of energy storage.

Wu, Di↗

DOE OSTI2023

DSS-SimPy-RL (Open-DSS and SimPy based Cyber-Physical RL environment) [SWR-23-29]

Recently, numerous data-driven approaches to control an electric grid using machine learning techniques have been investigated. With the advancement of reinforcement learning (RL) based techniques, gradually the conventional optimization based solvers are being replaced with RL approach where there is uncertainty in the environment such as renewable generation or cyber system emulation. However, to train an agent efficiently, it requires numerous interactions with an environment to learn the best policies. There are numerous RL environments for the power systems based on some well-known simulators, similarly there are environment for communication domains. While majority of the cyber emulators are based in an UNIX environment, the power simulators are based in the Windows-based operating system, the generation of cyber-physical mixed domain RL environment has been challenging. Existing co-simulation methods are efficient but resource and time intensive to generate large scale data set for training RL agents. Hence, this software focuses on development and validation of a mixed domain RL environment using Open DSS for the physical side and leverages a discrete event simulator python package, SimPy, for cyber-side emulation which is Operating Systems agnostic. Further utilizing this software co-simulation and training RL agents for re-routing based resilient control for network reconfiguration and volt-var control in power distribution feeder are performed.

Sahu, Abhijeet↗

DOE OSTI2019

Comprehensive Utilization of Seawater in China: A Description of the Present Situation, Restrictive Factors and Potential Countermeasures

China is a maritime power. However, as its economy develops rapidly, China lacks freshwater resources. The water resources per capita are low in China and are less than a quarter of the global mean value. The development and utilization of desalination, a new unconventional water resource in coastal areas, has gradually attracted the attention of the central and local governments. This paper introduces three aspects of the comprehensive utilization of seawater in China, including the desalination of seawater, the direct use of seawater, and the use of seawater as a chemical resource. Based on the recent status (2017) of comprehensive seawater utilization in China, the prospects for optimizing the utilization of seawater resources are presented. Furthermore, the restrictive factors and potential countermeasures for the increased use of seawater desalination are investigated. Several recommendations are presented, specifically, improving the laws, using regulations and standards related to desalination, strengthening the policies that support enterprises that use desalination, gradually improving the localization rate of key technologies and equipment, and devoting additional attention to the problems associated with brine processing. Seawater is expected to become an important supplemental source of water in coastal areas of China, and the resources needed for its use will be developed as a strategic and influential industry.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

REopt Lite Overview & Training Exercise

This training exercise provides users with an introduction to and hands-on, interactive exploration of REopt Lite's capabilities. REopt Lite is a free, publicly available techno-economic optimization web tool for distributed energy systems, developed at the National Renewable Energy Laboratory (NREL). REopt Lite helps organizations evaluate the economic viability of grid-connected solar photovoltaics (PV), wind turbines, and battery storage; identify system sizes and battery dispatch strategies to minimize energy costs; and estimate how long a system can sustain critical load during a grid outage. The model is formulated as a mixed-integer linear program based in an underlying application programming interface (API) that is also free and publicly available. This training activity is structured as a group exercise. Participants split into eight groups and each group is assigned a different hypothetical site to model and assess the opportunity for solar PV + battery storage. Groups work together to develop results for their site and then re-convene to compare and discuss results, inputs/drivers of the analysis, and other factors impacting the decision-making process for behind-the-meter solar PV and battery storage.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2019

An economic and policy case for proactive home energy management systems with photovoltaics and batteries

While Photovoltaics have become more cost-effective for homeowners, utilities still have to manage the uncertainty and variability that comes with it. Here, this paper explores the use of photovoltaic and battery storage for homeowners under different utility rates by adding a proactive energy management system to optimize battery usage. Results show that one of the proposed cases can greatly improve the economics of investing in both photovoltaics and a battery system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Water Quality Effects of Economically Viable Land Use Change in the Mississippi River Basin under the Renewable Fuel Standard

Demand for biofuel production driven by the Renewable Fuel Standard (RFS2) has coincided with increased land in corn production and increasing nitrogen (N) loss to the Gulf of Mexico. Diversifying cropland with perennial energy crops (miscanthus and switchgrass) may reduce N loss and improve water quality. However, the extent of these benefits depends on the mix of biomass feedstocks (corn stover, perennials) incentivized by the RFS2 and the extent to which energy crops displace N-intensive row crops. We developed an integrated economic-biophysical model to quantify the water quality impacts of three potential policy scenarios that provided corn ethanol at levels before the RFS2 (RFS1 baseline); 15 billion gallons of corn ethanol (corn ethanol only); or 16 billion gallons of cellulosic ethanol in addition to corn ethanol (corn + cellulosic ethanol). Our results showed that economically optimal locations for perennial energy crop production were distributed across idle cropland with lower intrinsic N loss than active cropland. We found stover removal incentivized by the RFS2 offset N loss benefits of perennial energy crops. Furthermore, this finding suggests that targeted incentives for N loss reduction are needed to supplement the RFS2 to induce displacement of N-intensive row crops with energy crops to reduce N losses.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Enzyme activities predicted by metabolite concentrations and solvent capacity in the cell

Experimental measurements or computational model predictions of the post-translational regulation of enzymes needed in a metabolic pathway is a difficult problem. Consequently, regulation is mostly known only for well-studied reactions of central metabolism in various model organisms. In this study, we use two approaches to predict enzyme regulation policies and investigate the hypothesis that regulation is driven by the need to maintain the solvent capacity in the cell. The first predictive method uses a statistical thermodynamics and metabolic control theory framework while the second method is performed using a hybrid optimization–reinforcement learning approach. Efficient regulation schemes were learned from experimental data that either agree with theoretical calculations or result in a higher cell fitness using maximum useful work as a metric. As previously hypothesized, regulation is herein shown to control the concentrations of both immediate and downstream product concentrations at physiological levels. Model predictions provide the following two novel general principles: (1) the regulation itself causes the reactions to be much further from equilibrium instead of the common assumption that highly non-equilibrium reactions are the targets for regulation; and (2) the minimal regulation needed to maintain metabolite levels at physiological concentrations maximizes the free energy dissipation rate instead of preserving a specific energy charge. The resulting energy dissipation rate is an emergent property of regulation which may be represented by a high value of the adenylate energy charge. In addition, the predictions demonstrate that the amount of regulation needed can be minimized if it is applied at the beginning or branch point of a pathway, in agreement with common notions. The approach is demonstrated for three pathways in the central metabolism of E. coli (gluconeogenesis, glycolysis-tricarboxylic acid (TCA) and pentose phosphate-TCA) that each require different regulation schemes. It is shown quantitatively that hexokinase, glucose 6-phosphate dehydrogenase and glyceraldehyde phosphate dehydrogenase, all branch points of pathways, play the largest roles in regulating central metabolism.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Price Formation in Zero-Carbon Electricity Markets: The Role of Hydropower

In April 2019, Water Power Technologies Office (WPTO) launched the HydroWIRES Initiative to understand, enable, and improve hydropower and pumped storage hydropower’s (PSH’s) contributions to reliability, resilience, and integration in the rapidly evolving U.S. electricity system. The unique characteristics of hydropower, including PSH, make it well suited to provide a range of storage, generation flexibility, and other grid services to support the cost-effective integration of variable renewable resources. The U.S. electricity system is rapidly evolving, bringing both opportunities and challenges for the hydropower sector. While increasing deployment of variable renewables such as wind and solar have enabled low-cost, clean energy in many U.S. regions, it has also created a need for resources that can store energy or quickly change their operations to ensure a reliable and resilient grid. Hydropower (including PSH) is not only a supplier of bulk, low-cost, renewable energy but also a source of large-scale flexibility and a force multiplier for other renewable power generation sources. Realizing this potential requires innovation in several areas: understanding value drivers for hydropower under evolving system conditions, describing flexible capabilities and associated tradeoffs associated with hydropower meeting system needs, optimizing hydropower operations and planning, and developing innovative technologies that enable hydropower to operate more flexibly.

13 HYDRO ENERGY↗

DOE OSTI2020

Power Split Supercharging: A Mild Hybrid Approach to Boost Fuel Economy

This work investigates an innovative low-voltage (<60 V) hybrid device that enables engine boosting and downsizing in addition to mild hybrid functionalities such as regenerative braking, start-stop, and torque assist. A planetary gear set and a brake permit the power split supercharger (PSS) to share a 9 kW motor between supercharging the engine and direct torque supply to the crankshaft. In contrast, most e-boosting schemes use two separate motors for these two functionalities. This single motor structure restricts the PSS operation to only one of the supercharging or parallel hybrid modes; therefore, an optimized decision making strategy is necessary to select both the device mode and its power split ratio. An adaptive equivalent consumption minimization strategy (A-ECMS), which uses the battery state of charge (SoC) history to adjust the equivalence factor, is developed for energy management of the PSS. The A-ECMS effectiveness is compared against a dynamic programming (DP) solution with full drive cycle preview through hardware-in-the-loop experiments on an engine dynamometer testbed. The experiments show that the PSS with A-ECMS reduces vehicle fuel consumption by 18.4% over standard FTP75 cycle, compared to a baseline turbocharged engine, while global optimal DP solution decreases the fuel consumption by 22.8% compared to the baseline.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

NASA NTRS2014

Integrating Land Cover Modeling and Adaptive Management to Conserve Endangered Species and Reduce Catastrophic Fire Risk

Land cover modeling is used to inform land management, but most often via a two-step process where science informs how management alternatives can influence resources and then decision makers can use this to make decisions. A more efficient process is to directly integrate science and decision making, where science allows us to learn to better accomplish management objectives and is developed to address specific decisions. Co-development of management and science is especially productive when decisions are complicated by multiple objectives and impeded by uncertainty. Multiple objectives can be met by specification of tradeoffs, and relevant uncertainty can be addressed through targeted science (i.e., models and monitoring). We describe how to integrate habitat and fuels monitoring with decision making focused on dual objectives of managing for endangered species and minimizing catastrophic fire risk. Under certain conditions, both objectives might be achieved by a similar management policy, but habitat trajectories suggest tradeoffs. Knowledge about system responses to actions can be informed by applying competing management actions to different land units in the same system state and by ideas about fire behavior. Monitoring and management integration is important to optimize state-specific management decisions and increase knowledge about system responses. We believe this approach has broad utility for and cover modeling programs intended to inform decision making.

adaptive management↗

DOE OSTI2023

Building the Case for Hybrid Energy Developments: Webinar Recording Day 1

INL, PNNL, and NREL, with support from our academic and industry partners, hosted a 2-day webinar to learn more about the benefits of hybrid energy systems, considerations for designing the right system for communities, and practical tools that can help with the design and development process. In Day 1 of this webinar, the focus was on why users might want to consider hybrid energy systems, and frameworks that could help inform design decisions for hybrid systems, including a valuation framework, resilience framework, and hybrid system design optimization framework.

14 SOLAR ENERGY↗

DOE OSTI2025

Optimal Economic Dispatch and Load-Following Strategies for Nuclear Integrated Energy Systems

The need for distributed and adaptable energy resources that can handle the growing unpredictability in both supply and demand is rising as the power system continues to modernize. In order to satisfy those needs and maintain grid resilience, nuclear power plants can dynamically control their output, despite typically being used as baseload generators. By incorporating energy storage and renewable energy sources, nuclear integrated energy systems are designed to satisfy the electrical and thermal demands of different end-user applications while ensuring flexible power operation. These systems generate revenue by participating in both wholesale and ancillary services electricity markets, as well as commodity markets for various byproducts generated from coupled industrial processes. This study addresses the economic dispatch efficiency of a tightly coupled nuclear integrated energy system comprising a gigawatt-scale light water reactor, commercialized in the U.S., a high-temperature steam electrolysis unit, a district heating network, and specified electrical loads. To demonstrate the nuclear power plant’s flexibility within the day-ahead unit commitment and economic dispatch framework, while maintaining equilibrium even during periods of refueling outages, this paper develops a mixed-integer linear programming framework that models the subsystems and components of its nuclear steam supply system. A systematic comparative analysis of flexible versus baseload nuclear power plant operation under varying levels of renewable energy integration indicates that flexible operation enhances system profitability by more than 18% while also increasing energy storage utilization, improving reactor responsiveness to load fluctuations, and allowing for greater participation across numerous electricity markets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Evaluating advanced nuclear fission technologies for future decarbonized power grids

Advanced nuclear fission, which encompasses various innovative nuclear reactor designs, could contribute to the decarbonization of the United States electricity sector. However, little is known about how cost-competitive these reactors would be compared to other technologies, or about which aspects of their designs offer the most value to a decarbonized power grid. We employ an electricity system optimization model and a case study of a decarbonized U.S. Eastern Interconnection circa 2050 to generate initial indicators of future economic value for advanced reactors and the sensitivity of future value to various design parameters, the availability of competing technologies, and the underlying policy environment. These results can inform long-term cost targets and guide near-term innovation priorities, investments, and reactor design decisions. We find that advanced reactors should cost $\$5.7$–$\$7.3$/W to gain an initial market share (assuming 30 year asset life and 3.5 %–6.5 % real weighted average cost of capital), while those that include thermal storage in their designs can cost up to $\$6.0$/W–$\$7.7$/W (not including cost of storage). Since the marginal value of advanced fission reactors declines as market penetration increases, break-even costs fall ~32 % at 100 GW of cumulative capacity and ~51 % at 300 GW. Additionally, policies that provide investment tax credits for nuclear energy create the most favorable environment for advanced nuclear fission. In conclusion, these findings can inform near-term resource allocation decisions by stakeholders, innovators and investors working in the energy technology sector.

Capacity expansion↗

DOE OSTI2022

Hydropower operation in future power grid with various renewable power integration

Hydropower generation may play an increasingly important role in the power grid under increasing contribution of variable renewable sources such as wind and solar. An improved understanding of the changes to hydropower dispatch under future higher VRE grid conditions reveals research gap that should be informed power grid planning and reservoir water releases policies considering multiple other water uses and varying hydrologic condition. Here this study aims to understand the role of hydropower in a changing power grid by employing a production cost model, PLEXOS, across future power system scenarios, planning horizons, and regions. We explore optimized hydropower dispatch to understand its potential role in minimizing the system cost and renewable curtailment. We also examine the sensitivity of hydropower revenue under various grid scenarios of the Eastern U.S. and hydrology conditions. Results indicate hydropower generation follows net load and compensates for the variability of solar and wind generation. Although energy prices are lower during some periods in the future grid scenarios, there is a potential for higher revenue for hydropower by providing both energy and ancillary services during times of stress. Additionally, hydropower revenue is sensitive to hydrology in the SERC region, which we considered as an example. The feasibility of hydropower dispatching with higher ramps between low and high hourly-capacity factors, as indicated in the optimization model, requires further study to consider other water use and ecology constraints.

13 HYDRO ENERGY↗

DOE OSTI2021

Restoring Critical Loads In Resilient Distribution Systems using A Curriculum Learned Controller

In this paper, we propose a curriculum learned reinforcement learning (RL) controller to facilitate distribution system critical load restoration (CLR), leveraging RL's fast online response and its outstanding optimal sequential control capability. Like many grid control problems, CLR is complicated due to the large control action space and renewable uncertainty in a heavily constrained non-linear environment with strong intertemporal dependency. The nature of the problem oftentimes causes the RL policy to converge to a poor-performing local optimum if learned directly. To overcome this, we design a two-stage curriculum in which the RL agent will learn generation control and load restoration decision under different scenarios progressively. Via curriculum learning, the trained RL controller is expected to achieve a better control performance, with critical loads restored as rapidly and reliably as possible. Using the IEEE 13-bus test system, we illustrate the performance of the RL controller trained by the proposed curriculum-based method.

curriculum learning↗

DOE OSTI2023

Rethinking the Price Formation Problem–Part 1: Participant Incentives under Uncertainty

Operators of organized wholesale electricity markets attempt to form prices in such a way that the private incentives of market participants are consistent with a socially optimal commitment and dispatch schedule. In the U.S. context, several competing price formation schemes have been proposed to address the non-convex production cost functions characteristic of most generation technologies. Here, this paper considers how the design and analysis of price formation policies for non-convex markets are affected by the uncertainty inherent in electricity demand and supply. We argue that by excluding uncertainty, the analytical framework underlying existing policies mischaracterizes the incentives of market participants, leading to inefficient price formation and poor incentives for flexibility. We establish favorable theoretical properties of a new construct, ex ante convex hull pricing , and demonstrate the difference between this idealized benchmark and existing methods on a large-scale test system. Given increased operational uncertainty with a transition to wind and solar generation, distortions caused by poor incentives for flexibility are likely to grow without improved price formation in organized wholesale markets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Restoring Critical Loads in Resilient Distribution Systems Using a Curriculum Learned Controller: Preprint

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE OSTI2023

Exploring sustainable electricity system development pathways in South America’s MERCOSUR sub-region

South America has abundant natural water and energy resources, and exploiting these resources to achieve a clean energy future is central to the continent’s economic and sustainable development objectives for the next several decades. Designing pathways to achieving this clean energy future requires better understanding the structural, techno-economic, and policy forces that may influence the future development of the electricity sector in the region. Here, we focus on an interconnected electricity system of five South American countries – Argentina, Brazil, Chile, Paraguay, and Uruguay – which represent major electricity generation, consumption, and trade dynamics in the region. We explore the implications of various forces that could shape the future composition of the power sector in the sub-region, including: evolving renewable energy cost and performance, natural gas prices, cross-border interconnection facilities, early retirement of installed hydropower, and different decarbonization goals. We use a model framework based on a power system planning platform (GridPath) to co-optimize investment and operations of generation, storage, and transmission facilities out to 2050. Our results in a Reference scenario indicate that the electricity system can maintain a relatively clean energy portfolio by leveraging existing hydropower capacity and integrating increasingly cost-competitive wind and solar power. However, dependence on natural gas in the region is likely to remain high. A low-carbon electricity system can cost-effectively be achieved through policy interventions (e.g., renewable portfolio standards) and by diversifying investments in wind, solar, battery storage, and some new hydropower capacity. We also find that existing hydropower is critical for maintaining reliable future grid operations. Enhanced regional electricity trade, mostly based on existing interconnection capacities with nominal investment in new transmission, can significantly benefit the clean energy transition in the region.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗