Search NASA⌕ Search

SEARCH · Search NASA

Results for “POLICIES”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating Impacts of the Inflation Reduction Act and Bipartisan Infrastructure Law on the U.S. Power System

The Inflation Reduction Act of 2022 (IRA) and the Infrastructure Investment and Jobs Act of 2021, commonly referred to as the 'Bipartisan Infrastructure Law (BIL),' collectively represent the largest commitment of the U.S. Federal Government to invest in the modernization and decarbonization of the U.S. energy system. The Congressional Budget Office (CBO) estimates that total support for the broad range of climate and clean energy programs, tax credits, and other incentives authorized through the two laws will exceed $430 billion from 2022 through 2031 (CRS 2022; CBO 2021, 2022). While the climate and clean energy provisions are numerous and have the potential to impact all aspects of the U.S. energy system from fuel and electricity production to final consumption in industry, transportation, and buildings, the provisions relevant to the electricity sector - in particular the suite of tax credits for clean generation, storage, and carbon dioxide ( CO 2 ) capture and storage - are expected to be some of the most consequential in terms of emissions reduction and clean energy deployment (Larsen et al. 2022; Jenkins, Mayfield, et al. 2022; Mahajan et al. 2022; Zhao et al. 2022). In this report, we detail the methods and results of a study estimating the potential impacts of key provisions of IRA and BIL on the contiguous U.S. power sector from present day through 2030. The analysis employs an advanced power system planning model, the Regional Energy Deployment System (ReEDS), to evaluate how major provisions from both laws impact investment in and operation of utility-scale generation, storage, and transmission, and, in turn, how those changes impact power system costs, emissions, and climate and health damages. While not exhaustive in capturing every provision, the analysis estimates the possible scale of power-sector impacts that could result from the modeled provisions in IRA and BIL. The study is structured around two scenarios to evaluate the potential impacts of both laws on the power sector: 1) No New Policy: A counter-factual scenario that reflects all Federal and state policies enacted as of September 2022, with exception to IRA and BIL, and assumes load growth consistent with the Energy Information Administration's Annual Energy Outlook 2022 (AEO22) Reference case (EIA 2022a); 2) IRA-BIL: A scenario reflecting all Federal and state policies enacted as of September 2022, including key IRA and BIL provisions, most notably the investment and production tax credits for zero-carbon emitting electricity generation and storage (ITC and PTC), the tax credit for CO 2 capture and storage (45Q), and the tax credit for existing nuclear plants (described further in Section 2.3). To account for the impacts of IRA and BIL on electrification, assumes increased load growth consistent with a scaled version of the Medium Electrification scenario from the Electrification Futures Study (Mai et al. 2018). These scenarios are simulated across seven sets of assumptions with varying projected future electricity market conditions, including technology costs and performance, natural gas prices, and the degree of availability, feasibility, and cost of development of renewable resources, electricity transmission, and CO 2 pipeline, injection, and storage infrastructure. In addition, we simulate two sensitivities on the 'policy' treatment in which we vary key assumptions pertaining to the realized value of the clean electricity ITC and PTC: 1) the cost of monetization of tax credits, and 2) the level of bonus crediting realized by project developers. We demonstrate that IRA and BIL have the collective potential to drive substantial growth in clean electricity by 2030, while reducing costs for consumers, mitigating climate change, and decreasing the human health impacts of power sector emissions. However, we also demonstrate that if expected cost improvements of clean technologies are not realized and/or constraints on deployment driven by factors such as supply-chain challenges, regulatory hurdles, and the social acceptability of energy infrastructure development limit the rate of clean energy and associated infrastructure deployment (such as transmission), then the share of clean generation achieved and the associated emissions benefits realized may be substantively reduced.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Inaugural Symposium of the Institute for Sustainable Energy and Environment, Virginia Commonwealth University

The Inaugural Symposium of the Institute for Sustainable Energy and Environment (ISEE) was held in Virginia Commonwealth University, Richmond, Virginia during April 26 – 28, 2023. The symposium addressed issues and challenges in energy and environment and highlighted the use of clean renewable energy to mitigate the adverse effects of fossil fuels and the greenhouse gases it produces. These issues are complex as the involve educating the public that the climate change is real, it is caused by the use of fossil fuels, it requires scientists and engineers to understand the fundamental science in the production and storage of renewable energy, it requires industries to manufacture and distribute the equipment necessary for commercial application of these technologies, it requires policy makers to put together policies and guidelines to make the transition from fossil fuels to renewable energies efficient, and it requires social scientists and educators to address environmental justice issues and create a workforce to sustain the transition. The symposium considered all the above issues with a diverse list of speakers from the federal and state government, industrial partners, and experts from science and technology to social sciences and public policy. Speakers from the White House Office of Science and Technology Policy, Department of Energy, universities, and non-governmental agencies discussed the challenges and solutions in Plenary as well as Panel sessions. The talks were recorded with permission from the speakers and the panelists and were put in the ISEE website. The participants included students, postdoctoral fellows, and professors from Virginia Commonwealth University and local area Historically Black College and Universities (HBCU) such as Virginia State University and Norfolk State University. The $5000 fund awarded by the Department of Energy were used to support the participation of students, postdoctoral fellows, and faculty from the HBCU institutions. The technical program the list of participants is provided later in the document.

08 HYDROGEN↗
DOE OSTI2022

Elaboration of Energy Balance: A Model for the Brazilian States

The energy balance constitutes a powerful management instrument for government agencies, as it offers an overview of the energy situation of the country (or region) and serves as a guide for energy policies and monitoring of these policies. Although Brazil has published the national energy balance for more than half a century, the national publication does not adequately address energy statistics at the level of the states. This occurs either due to the lack of specific data or the absence of total disaggregation. Accordingly, the elaboration and implementation of public policies for the energy sector in the Brazilian states lack consistent energy statistics. Therefore, this paper aims to present a model for the Brazilian states to elaborate the energy balance. The proposed model consists of applying internationally referenced methodologies to develop a user-friendly software, which includes automatic energy unit conversions, different chart styles, high-level data organization, and Sankey diagrams. As a result, the software can be adopted by local governments as a tool to maintain the state energy balance publication periodically, and hence obtain the detailed information necessary to manage and formulate energy policies. The advantage of the software is that it can be operated by non-experts and the energy flow as well as the entire report can be generated automatically. The proposed software was successfully used to generate the energy balance of the Mato Grosso do Sul state.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Solar PV Curtailment in Changing Grid and Technological Contexts: Preprint

Solar photovoltaic (PV) systems generate electricity with no marginal costs or emissions. As a result, PV output is almost always prioritized over other fuel sources and delivered to the electric grid. At increasing levels of PV penetration situations arise where PV is curtailed, either because of local supply/demand imbalances or to maintain system flexibility. In 2018, we estimate that about 6.5 million MWh of PV output was curtailed in four key countries: Chile, China, Germany, and the United States. We find that PV curtailment peaks in the spring and fall, when PV output is relatively high but electricity demand is relatively low. Similar to the case of wind, some PV curtailment is attributable to limited transmission capacity connecting sparsely populated solar-heavy regions to load centers.Grid policies generally seek to minimize curtailment because it is viewed as an economic and environmental loss. However, we argue that changing grid and technological contexts warrant new thinking on PV curtailment. In the grid context, as grids integrate more PV and other renewable energy generation, seeking an optimal level of accepted curtailment becomes more efficient than preventing it. In the technological context, emerging technologies such as advanced inverters and low-cost battery storage are making PV systems more flexible. With flexible PV, grid operators can use withheld PV output to provide various non-generation grid services. This withheld PV output is a form of curtailment under prevailing definitions of the term. Hence, policies that aim to minimize curtailment may undercut the ability of grid operators to fully use the emerging capabilities of flexible PV systems. We argue that the changing grid and technological contexts require a re-examination of the curtailment paradigm. We argue that PV output that is withheld to provide grid services is fundamentally different from output that goes unused in response to system constraints. As a result, we propose a more exclusive definition of curtailment as unused PV output rather than the more expansive conventional definition as any reduction in system output from its technical potential. The terminological distinction is more than a question of semantics. Facilitating grid services by withholding PV output may increase the potential value of flexible PV systems to the grid. This shift in thinking may allow grid operators and policymakers to think in terms of PV curtailment management rather than minimization. Effective curtailment management may include policies that increase PV system dispatchability, alternative PV compensation schemes that decouple generator revenue from system output, and policies to increase grid flexibility.

Chile↗
DOE OSTI2023

The role of corporate investment in start-ups for climate-tech innovation

Enabling and accelerating the full potential of energy innovation is a critical component of the global policy response to climate change. Incentivizing start-ups advancing climate-tech (i.e., products and services related to clean energy and climate change), has become central to innovation policy because start-ups are nimble (compared to incumbents), can quickly focus on bringing new technologies to market, and simultaneously create new jobs and catalyze local industries. Public policies to support climate-tech start-ups and efforts such as Mission Innovation tend to focus on increasing government spending (e.g., grants for research and development) or on creating demand pull for new technologies (e.g., feed-in-tariffs). But to go from research and development to widespread adoption of new products and services, start-ups need to grow and scale, and this requires support from private investors. Yet, research on how different investors can shape the direction of climate innovation—and how public policy can incentivize private investment in climate-tech start-ups to support the public good—is surprisingly sparse.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

A systematic review of building energy sufficiency towards energy and climate targets

Among the sufficiency, efficiency, and renewable frameworks for reducing energy use and energy-related carbon emissions, Building Energy Sufficiency (BES) is gaining attention from policy makers and engineers. Despite the significant role of the building sector in the success of national energy and climate plans, there is a lack of research on the drivers, technologies, and effective policy instruments required to achieve BES in the building operational phase. To fill this gap, this study presents a systematic review of the definition and paradigm of BES and concludes that BES should address both occupant demand and energy or emissions requirements simultaneously. The characteristics of occupant demand in building services are divided into four dimensions: time and space, quality and quantity, control and adjustment, and flexibility. Technical options regarding the building architecture, the envelope system, and the building energy system are reviewed. Finally, policy implications and recommendations are discussed. As a result, the multiple benefits and multidisciplinary nature of BES justify further research and accelerated policy implementation in developed and developing countries.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Energy storage solutions to decarbonize electricity through enhanced capacity expansion modelling

To meet ambitious global decarbonization goals, electricity system planning and operations will change fundamentally. With increasing reliance on variable renewable energy resources, energy storage is likely to play a critical accompanying role to help balance generation and consumption patterns. As grid planners, non-profit organizations, non-governmental organizations, policy makers, regulators and other key stakeholders commonly use capacity expansion modelling to inform energy policy and investment decisions, it is crucial that these processes capture the value of energy storage in energy-system decarbonization. Here we conduct an extensive review of literature on the representation of energy storage in capacity expansion modelling. We identify challenges related to enhancing modelling capabilities to inform decarbonization policies and electricity system investments, and to improve societal outcomes throughout the clean energy transition. Additionally, we further identify corresponding research activities that can help overcome these challenges and conclude by highlighting tangible real-world outcomes that will result from pursuing these research activities. Capacity expansion modelling (CEM) approaches need to account for the value of energy storage in energy-system decarbonization. A new Review considers the representation of energy storage in the CEM literature and identifies approaches to overcome the challenges such approaches face when it comes to better informing policy and investment decisions.

25 ENERGY STORAGE↗
DOE OSTI2021

Repeal of the Clean Power Plan: Social Cost and Distributional Implications

The Clean Power Plan (CPP) was repealed due to concerns about the “unnecessary, costly burdens” it may impose on electric utilities, thereby delaying efforts to reduce carbon dioxide emissions (CO 2 ) from the electricity sector. This paper examines the greenhouse gas and welfare implications of this repeal while incorporating the presence of the state renewable portfolio standards (RPS) in the US as the status quo. We assess the carbon abatement and welfare costs with the CPP relative to two alternative baselines: a no–policy baseline and a pre–existing policy baseline with the RPS. The CPP is implemented as a regional mass–based standard, a regional rate–based standard, or as a national mass–based standard with trading of emissions across regions over the 2022–2030 period. We find that the incremental discounted welfare costs per metric ton of CO 2 that would have been abated by the CPP relative to the RPS would be substantially lower than the global social cost of CO 2 . However, the overall costs of carbon abatement with the CPP added to the RPS would have become higher than the social cost of carbon when estimated relative to a no–policy baseline, except with a national mass–based CPP. Across all policy combinations and choice of baselines, the aggregate welfare costs were lowest under a national mass–based standard and highest under the regional rate–based standard. Here, we also find that the CPP would have imposed large welfare costs on consumers and fossil fuel producers while benefiting the renewable fuel producers.

, Q42↗
DOE OSTI2021

U.S. Renewables Portfolio Standards 2021 Status Update: Early Release

Berkeley Lab’s annual status report on U.S. renewables portfolio standards (RPS) provides an overview of key trends associated with U.S. state RPS policies. The report, published in slide-deck form, describes recent legislative revisions, key policy design features, compliance with interim targets, past and projected impacts on renewables development, and compliance costs. The 2021 Early Release, published in lieu of a 2020 edition, presents historical data through year-end 2019, with some limited results for the year 2020. Key trends from this edition of the report include the following: Evolution of state RPS programs: States continue to refine and revise their RPS policies. Among other significant changes since the start of 2019, eight states enacted higher RPS targets or created new clean-energy/zero-carbon targets (AZ, DC, MD, NM, NV, VA, WA), in most cases setting targets equal to at least 50% of retail sales. Historical impacts on renewables development: Roughly half of all growth in U.S. renewable electricity (RE) generation and capacity since 2000 is associated with state RPS requirements, though that percentage has declined in recent years, representing 23% of all U.S. RE capacity additions in 2019. However, within particular regions-namely, the Northeast and Mid-Atlantic-RPS policies continue to serve a central role in motivating RE growth. Future RPS demand and incremental needs: RPS demand growth through 2030 will require roughly 90 GW of new RE capacity and will require total U.S. non-hydro RE generation to reach 17% of electricity sales (compared to 12% in 2019). Relative to EIA projections, this amounts to roughly one-third of projected RE growth over the next decade. RPS target achievement to-date: States have generally met their interim RPS targets in recent years, with only a few exceptions reflecting unique, state-specific issues. REC pricing trends: Prices for NEPOOL Class I RECs rose steeply over 2019, reaching $40/MWh and remaining at roughly that level over 2020. PJM Tier I REC prices continued to rise at a modest pace over the course of 2020, reaching $10/MWh by year-end. Prices for solar RECs remained relatively stable over 2020, and continue to exhibit wide variation across states, with the highest prices ($200-450/MWh) in NJ, MA, and DC.RPS compliance costs and cost caps: RPS compliance costs in 2019 averaged roughly 2.6% of retail electricity bills in RPS states, compared to 2.3% in 2018, with costs in most states ranging from 0.5% to 4.5% of retail electricity bills.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Scenarios of Nuclear Energy Use in the United States for the 21st Century

The uncertainty in the cost of nuclear energy coinciding with efforts to address climate change are contributing to the uncertainty in the future role of nuclear energy in the US electricity system and the response to addressing global climate change. Sensitivity cases of alternative nuclear capital costs, ranging from 2600 to 6600 $\$ $/kW, were investigated with scenarios of alternative carbon mitigation policies, including 50, 100, and 150 $\$ $/tCO 2 carbon tax cases and economy-wide net-zero goals by 2050, 2060, and 2070 for the US. The resulting US nuclear power capacity ranged from 130 to 240 GW in 2050 and 90 to 450 GW in 2100 from nuclear cost sensitivity cases without carbon mitigation policies. Imposing policies to achieve the decarbonization of electricity and net-zero emission goals increased the range of nuclear power capacity from 190 to 460 GW in 2050 and 210 to 850 GW by 2100, where the range is from the low and high nuclear cost cases. Carbon penalties beyond 100 $\$ $/tCO 2 had a diminishing role on the expansion of nuclear power as the electricity sector becomes fully decarbonized. The 50 $\$ $/tCO 2 tax had the nuclear capital cost equivalency of 1000 $\$ $/kW reduction, while the 100 $\$ $/tCO 2 tax had the equivalency of 2000 $\$ $/kW reduction. Net-zero goals increased the contribution of nuclear power due to the increase in total electricity demand, but the delay in the timing of net-zero did not significantly affect the role of nuclear in the long-term. All net-zero goals were similar in their energy system impact with resulting carbon tax levels reaching 300 $\$ $/tCO 2 . Electricity is fully decarbonized in the net-zero scenarios and carbon pricing beyond 100 to 150 $\$ $/tCO 2 had little influence on the additional deployment of nuclear power. Regardless of the carbon policy, however, nuclear capital cost reductions had a clear and pronounced impact on the expanded deployment of nuclear power under all scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Third-Party Aggregation Rulemaking in MISO and SPP Footprints

The report highlights key considerations for retail regulators in the footprints of the Southwest Power Pool (SPP) or Midcontinent Independent System Operator (MISO) in states that previously opted out of allowing third-party aggregation participation under FERC Order 719 and that may want to explore reversing the decision due to a changing policy environment under new FERC orders (i.e., 2222) and/or tightening resource adequacy constraints. Through a document review and a series of 27 interviews with regulators, aggregators, and other industry professionals, this document provides a high-level policy overview of the retail regulator’s role in a selection of processes, rules, and regulations to better understand how states have treated and/or integrated aggregators into wholesale markets. The report summarizes findings in two sections: General Findings and Specific Policy Findings. The General Findings offer high level takeaways such as the fact that 17 of the 20 states in MISO and SPP footprints opted out of third party aggregations following Order 719. Additionally, there is only one state that is fully restructured in the MISO and SPP footprints whereas the rest are vertically integrated, and the majority of third-party aggregations in the U.S. take place in restructured states outside of these footprints. Even so, third-party aggregations do take place in MISO and SPP albeit in small numbers and in an ad hoc regulatory environment. The specific policy findings delve deeper into specific examples of state actions on the topics of jurisdiction, registration and licensing, data governance, dual participation, and dispute resolution. Tables in each category organize state actions into Tiers I-III, which roughly correspond to the possible level of involvement or possible change necessary by state regulators and/or legislators to implement these actions. The tier level does not indicate any value judgement, as each state has respective regulatory limitations and each decision comes with various tradeoffs. One main tradeoff is between simplicity and quick implementation versus comprehensive and prolonged implementation. In many cases, actions in Tier I could be implemented without significant changes by relying on the use of existing processes for an aggregator context. On the other hand, many actions in Tier III are more narrowly designed to address aggregators specifically, but often require more significant changes including the involvement of additional parties through stakeholder engagement or legislative action. In some cases, these tiers are discrete. However, state regulators may also choose to progress through these various tiers sequentially as they phase in aggregators while learning from their experience. With the ability to stack bulk system level services, distributed energy resource aggregations in MISO and SPP could provide various private benefits (e.g., increased value streams to the owner) as well as societally beneficial grid services (e.g., peaking capacity, ancillary services, and other services that increase the grid’s overall operational efficiency). In deciding how to best to enable these benefits, states and retail regulators must weigh various tradeoffs if considering reversing a previous opt out.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Product Innovation to Increase Low-to-Moderate-Income Customers' Adoption of Community Solar PV

This study aims to comprehensively analyze community solar project preferences for consumers and suppliers by conducting three distinct analyses. First we analyze the predictors of community solar contract adoption to understand how individual priorities affect the probability of adoption. Using an original data set of survey responses from potential community solar customers, we analyzed the predictors of contract adoption by employing a weighted logit model. We find that individuals who were previously familiar with community solar projects were significantly more likely to adopt than those who were not familiar. Secondly, a survey of community solar developers and financiers identified industry perceived barriers to community solar access and inclusion. Thirdly, we gathered payment performance information from community solar initiatives to measure how financial risks are perceived and how they interact with customer demographics. Our study is beneficial to the public by providing insights into the drivers and barriers of community solar adoption and sheds light on the importance of understanding individual priorities in designing effective community solar policies. The community solar industry has changed significantly since the beginning of this project. The industry continues to grow at a rapid rate, with an additional 7 gigawatts expected to come online between 2022 and 2027. With federal pressure to meet climate goals, as the harms of climate change continue to impact everybody, legislators are looking to community solar as a method to achieving their states energy policy goals. These new policies that push for low-to-moderate inclusion, coupled with the increase in community solar capacity illustrate a new era for the community solar industry. A number of policies have arisen in the last few months that push for more inclusive practices including the groundbreaking Solar for All program run by the EPA. The research created a “best practice” contract that can then be used, in conjunction with the manuscript and validated study, to pitch the industry on a more inclusive community solar product.

14 SOLAR ENERGY↗
DOE OSTI2023

Pathways to Carbon Neutrality 2050 in Malaysia and Kuala Lumpur

Malaysia has recently set an ambitious target of achieving carbon neutrality as early as 2050. To accomplish this, the country will need to strategically reduce its emissions across all sectors. In 2020, Malaysia emitted approximately 368 MtCO2e, with the largest sources of emissions including electricity (36% of total emissions), transportation (17%), and industry (15%)1. We find that the greatest reductions in emissions can therefore come from decarbonizing power generation and electrifying end-use sectors. Digitalization, smart technologies, and improved energy efficiency will significantly reduce economy-wide energy consumption. By leveraging efficient technologies, both Malaysia and Kuala Lumpur can address the challenges posed by rapid urbanization and climate change. Digitalization is a broad category that includes a variety of measures; for example, the wide adoption of high-efficiency appliances and lighting or improved building energy codes in the buildings sector. Similarly, technological improvements can advance industrial energy efficiency, and for transportation, smart technologies cover a shift from private to public transportation and the greater use of electric vehicles. While renewable energy (RE) will play a crucial role in decarbonization, achieving carbon neutrality in certain sectors will be difficult without emerging technologies like carbon capture and storage (CCS) and innovative fuel sources such as hydrogen. In order for Malaysia to rely on CCS as a mitigation option, early investment and incentives to the private sector will be critical. This holds for the use of hydrogen as well: investing in the necessary technology, infrastructure, and human capital will allow Malaysia to position itself as an innovator in the region and leverage these advanced technologies as a key part of its climate strategy. Another possible carbon removal option other than CCS would be a land-use sink; however, given that Malaysia is still developing and may deforest in the near-term, this report does not focus on the mitigation potential of land-use change. With its innovative and bold climate plans, Kuala Lumpur is primed to be a leader in regional climate change efforts. Kuala Lumpur is also engaged in several international collaborations to ensure sustainable city development such as the C40 network and the ASEAN Smart Cities Partnership. As such, the city will play a critical role in contributing to Malaysia’s overall climate goals and as a policy trendsetter through ambitious, scalable plans. One key factor in these emissions reductions is that Kuala Lumpur has full control over its building guidelines, allowing for ambitious policies resulting in significant emissions reductions. However, in other sectors, Kuala Lumpur has less direct control over regulations; for example, power generation and integration of RE are largely in the hands of the Malaysian government. With limited and primarily light industry, Kuala Lumpur’s contributions to emissions reductions here are curbed. And, while Kuala Lumpur has control over local transportation policies like increasing access to and quality of public transportation, broad shifts in transportation will stem from national-level policies. As such, multi-level governance is an integral component of Malaysia’s climate strategy and coordination between local and national governments will be essential in reducing emissions and achieving other climate goals. This report addresses these and other key challenges and opportunities Malaysia faces on the road to carbon neutrality.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Neural network approaches for parameterized optimal control

Here, we consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage to enable rapid decision-making and be able to react to changes in the parameter in the online stage. To tackle the curse of dimensionality arising when the state and/or parameter are high-dimensional, we represent the policy using neural networks. We compare two training paradigms: First, our model-based approach leverages the dynamics and definition of the objective function to learn the value function of the parameterized optimal control problem and obtain the policy using a feedback form. Second, we use actor-critic reinforcement learning to approximate the policy in a data-driven way. Using an example involving a two-dimensional convection-diffusion equation, which features high-dimensional state and parameter spaces, we investigate the accuracy and efficiency of both training paradigms. While both paradigms lead to a reasonable approximation of the policy, the model-based approach is more accurate and considerably reduces the number of PDE solves.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reinforcement learning for real-time process control in high-temperature superconductor manufacturing

With high efficiency and low energy loss, high-temperature superconductors (HTS) have demonstrated their profound applications in various fields, such as medical imaging, transportation, accelerators, microwave devices, and power systems. The high-field applications of HTS tapes have raised the demand for producing cost-effective tapes with long lengths in superconductor manufacturing. However, achieving the uniform and enhanced performance of a long HTS tape is challenging due to the unstable growth conditions in the manufacturing process. Although it is confirmed that the process parameters during the advanced metal organic chemical vapor deposition (A-MOCVD) process influence the uniformity of the produced HTS tapes, the high-dimensional process parameter signals and their complicated interactions make it difficult to develop an effective control policy. In this paper, we propose a local measure for the uniformity of HTS tapes to provide instant feedback for our control policy. Then, we model the manufacturing of HTS tapes as a Markov decision process (MDP) with continuous state and action spaces to assess the instant reward in real time in our feedback control model. As our MDP involves continuous and high-dimensional state and action spaces, a neural fitted Q-iteration (NFQ) algorithm is adopted to solve the MDP with artificial neural network (ANN) function approximation. The collinearity of process parameters can restrict our capability of adjusting the process parameters, which is addressed by the principal component analysis (PCA) in our method. The control policy adjusts the PCA of process parameters using the NFQ algorithm. In conclusion, based on our case studies on real A-MOCVD dataset, the obtained control policy increases the average uniformity of tapes by 5.6% and performs especially well on sample HTS tapes with a low uniformity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

Here this article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results for model-free DRL-based methods in power systems control problems. But in power systems applications, these model-free methods have certain issues related to training time (clock time) and sample efficiency; both are critical for making state-of-the-art DRL algorithms practically applicable. DRL-agent learns an optimal policy via a trial-and-error method while interacting with the real-world environment. It is also desirable to minimize the direct interaction of the DRL agent with the real-world power grid due to its safety-critical nature. Additionally, the state-of-the-art DRL-based policies are mostly trained using a physics-based grid simulator where dynamic simulation is computationally intensive, lowering the training efficiency. We propose a novel model-based DRL framework where a deep neural network (DNN)-based dynamic surrogate model (SM), instead of a real-world power grid or physics-based simulation, is utilized within the policy learning framework, making the process faster and more sample efficient. However, having stable training in model-based DRL is challenging because of the complex system dynamics of large-scale power systems. We addressed these issues by incorporating imitation learning to have a warm start in policy learning, reward-shaping, and multi-step loss in surrogate model training. Finally, we achieved 97.5% reduction in samples and 87.7% reduction in training time for an application to the IEEE 300-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

The impact of development priorities on power system expansion planning in sub-Saharan Africa

Sub-Saharan Africa faces unique barriers to electricity development due to the large proportion of the population that is un-electrified and the prevalence of rural populations. Typically, power system expansion planning models assume all potential consumers can be immediately electrified. This assumption is unrealistic in sub-Saharan Africa, where electrification will likely be a gradual process over a number of years. Furthermore, since a large proportion of the population in sub-Saharan Africa is located in rural regions, the prioritization of these regions may impact how the grid develops. In this research, we develop a multi-period optimization model for power generation and transmission system expansion planning in sub-Saharan Africa. In contrast to existing models, which assume full electrification, we consider a variety of electrification policies and analyze the impact of varying the electrification rate and policy on the cost and resources selected for power system expansion. We test our model on a case study of Rwanda. We find that varying the year in which full electrification is reached has a larger impact on cost and generation capacity than varying the electrification policy does, although, when urban and rural regions are considered equitably, more rooftop solar is built. Varying the electrification policies has a larger impact on transmission expansion than on generation expansion and this impact is amplified when starting from zero initial system capacity rather than the original Rwanda system. Additionally, a sensitivity analysis shows that tightening the bounds on CO 2eq emissions has a large impact on the generation portfolio and cost.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗