Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Learning Sequential Distribution System Restoration via Graph-Reinforcement Learning

We report a distribution service restoration algorithm as a fundamental resilient paradigm for system operators provides an optimally coordinated, resilient solution to enhance the restoration performance. The restoration problem is formulated to coordinate distribution generators and controllable switches optimally. A model-based control scheme is usually designed to solve this problem, relying on a precise model and resulting in low scalability. To tackle these limitations, this work proposes a graph-reinforcement learning framework for the restoration problem. We link the power system topology with a graph convolutional network, which captures the complex mechanism of network restoration in power networks and understands the mutual interactions among controllable devices. Latent features over graphical power networks produced by graph convolutional layers are exploited to learn the control policy for network restoration using deep reinforcement learning. The solution scalability is guaranteed by modeling distributed generators as agents in a multi-agent environment and a proper pre-training paradigm. Comparative studies on IEEE 123-node and 8500-node test systems demonstrate the performance of the proposed solution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Produced water sharing: Improved economics and reduced community impact – A Pennsylvania case study

Here, hydraulic fracturing for oil and gas extraction from unconventional reservoirs is water intensive. Between water sourced for fracturing purposes and water present in rock formations, operators often produce a greater volume of water than oil or gas. Historically, this surplus of produced water has mainly been disposed of via deep injection wells. Rising disposal costs, seasonally limited water availability, and concerns over induced seismicity have incentivized produced water recycling practices, where an operator uses produced water for hydraulic fracturing operations. The logistical challenges associated with produced water recycling have also encouraged operators to adopt ad-hoc water exchange practices, in which competing operators will exchange produced water for mutual cost savings. In this paper, we investigate the potential benefit from systematic produced water exchange among operators in Northeastern Pennsylvania. We leverage PARETO, a free and open-source modeling framework for produced water management optimization, to quantify the benefits of water exchange practices. In an example drawn from FracFocus data, we find that the adoption of systematic water sharing could improve produced water recycling rates from 49.2% to 99%, decreasing operating and trucking costs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Primer on Using Analysis to Guide Plastic Circularity

BOTTLE, funded by DOE's Advanced Materials & Manufacturing Technologies Office and Bioenergy Technologies Office (BETO), conducts analysis-guided R&D to change the way we recycle plastics. But what does analysis really mean? In this webinar, BOTTLE Analysis Co-Lead Dr. Taylor Uekert, a researcher with the National Renewable Energy Laboratory (NREL), will introduce key analysis techniques such as techno-economic analysis, life cycle assessment, and environmental justice evaluation. Relevant to both analysts and non-analysts, Dr. Uekert will cover the basics of analysis techniques and discuss how these methods are conducted and interpreted. She will provide examples from the BOTTLE portfolio demonstrating their use in benchmarking and optimizing the costs and environmental impacts of new innovations in plastic redesign and recycling. If you are working in the plastics recycling field - from experimental work to analysis to community-focused projects - you won't want to miss this talk. The webinar will end with a Q&A session.

analysis↗

Can exascale computing and explainable artificial intelligence applied to plant biology deliver on the United Nations sustainable development goals?

Human population growth and accelerated climate change necessitate agricultural improvements using designer crop ideotypes (idealized plants that can grow in niche environments). Diverse and highly skilled research groups must integrate efforts to bridge the gaps needed to achieve international goals toward sustainable agriculture. Given the scale of global agricultural needs and the breadth of multiple types of omics data needed to optimize these efforts, explainable artificial intelligence (AI with a decipherable decision making process that provides a meaningful explanation to humans) and exascale computing (computers that can perform 1018 floating-point operations per second, or exaflops) are crucial. Accurate phenotyping and daily-resolution climatype associations are equally important for refining ideotype production to specific environments at various levels of granularity. In this article, we review advances toward tackling technological hurdles to solve multiple United Nations Sustainable Development Goals and discuss a vision to overcome gaps between research and policy.

59 BASIC BIOLOGICAL SCIENCES↗

State Strategies for Valuing Distributed Energy Resources in Cost-Effective Locations

The deployment of Distributed Energy Resources (DERs), small-scale electricity generation sources or controllable loads connected to the distribution system or a facility served by the distribution system, can have wide-ranging and positive impacts for the electricity grid. Interconnecting a DER in a high-value location on the grid can unlock benefits beyond those that accrue to the off-taker or asset owner. When DERs are deployed optimally, not only can the individual consumer benefit, but the local utility, the electricity system, and other ratepayers can benefit as well. By engaging in locational DER planning, states can help protect their communities and ratepayers and can help ensure the reliability and resilience of the electricity system. This report explores states' role in better integrating locational value into DER siting and development. It first outlines some of the benefits that can be achieved through the deployment of DERs in high-value locations. It then looks at state policy and regulatory roles and the tools states can use to influence the location of DER development. The report next examines the challenges of locational DER planning, with a particular focus on the challenges that states face in influencing the location of DER development. It highlights three case studies from states that engaged in locational DER planning through the Multistate Initiative to Develop Solar in Locations that Provide Benefits to the Grid and then presents several lessons learned from these efforts. The final section of this report summarizes some recent publications related to locational value of DERs in the form of an abbreviated literature review.

14 SOLAR ENERGY↗

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗

Battery State-of-Health Aware Path Planning for a Mars Rover

A rover mission consists of visiting waypoints to gather scientific samples based on set requirements. However, rovers face operational uncertainties during the mission, affecting the performance of its electrical and mechanical components and overall mission success. Hence, it is critical to have a decision-making framework that is aware of the health state of the components when planning the path of the vehicle. In particular, battery degradation, and consequently the battery State of Health (SOH), can affect the optimality of decisions made by the autonomous system in the long term. This paper presents a decision-making system that incorporates information on the energy drawn from the battery (based on the vehicle’s velocity), terrain conditions, and model-based prognostic modules to assess the impact on the battery’s state of charge (SoC). The decision-making system was formulated as a Markov Decision Process (MDP) to reach the goal destination by sending commands in a determined amount of time while maintaining the battery SoC within the policy stated. The MDP problem was programmed using the open-source framework POMDPs.jl, which has a variety of online and offline solvers. To solve the MDP problem online, we used Monte Carlo Tree Search (MCTS). Results from simulations demonstrate the effect that battery degradation and charging plans have on decision-making.

Prognostics↗

Techno-economic analysis and life-cycle greenhouse gas mitigation cost of five routes to bio-jet fuel blendstocks

Decarbonizing the air transportation sector remains one of the most challenging hurdles to mitigating climate change. Lignocellulosic biomass-derived jet fuel blendstocks can contribute to the shift toward renewable, low-carbon energy sources for aircrafts. Producing these renewable jet fuel molecules from biomass requires advanced pathways with the potential for efficient and affordable conversion routes. Here, this paper presents a detailed techno-economic analysis and sensitivity analysis, including estimated minimum selling price (MSP), and life-cycle greenhouse gas (GHG) mitigation costs for five routes to four potential bio-jet fuel molecules – limonane via limonene, limonane via 1,8-cineole, tetrahydromethylcyclopentadiene dimer (RJ-4), bisabolane, and epi-isozizaane. The simulated biorefineries utilize biomass sorghum and an integrated high-gravity ionic liquid-based biomass deconstruction process. We present results reflecting the current state of the technology and potential future scenarios with improved yields. Among the conversion pathways and the fuel molecules evaluated in this study, limonane, bisabolane, and epi-isozizaane could reach an MSP of 0.73–0.91 dollars per L-Jet A (2.75–3.45 dollars per gal-Jet A) in optimized future cases, without a hypothetical lignin-derived co-product. RJ-4 requires a more costly upgrading process and catalysts, resulting in a comparatively higher MSP (1.33 dollars per L-Jet A or 5.04 dollars per gal-jet A). Based on the GHG footprints of each fuel, the minimum achievable carbon mitigation cost relative to conventional Jet-A is 29 dollars per metric ton CO 2e , which is just under double the current cap-and-trade market price in California. In the absence of any policy support, the economics could be improved through high-value uses for lignin. To reach a target selling price of 0.66 dollars per L-Jet A (2.50 dollars per gal), lignin-derived products would need to be sold for at least 1.9 dollars per kg. However, the higher energy density of these bio-based blendstocks offers valuable improvements in aircraft efficiency/range; we find that commercial airlines may be willing to pay a 4–14 cent per L premium for these bio-jet fuels. In conclusion, our results highlight the need for improvements beyond currently-reported yields for the biologically produced intermediates, identification of ideal microbial hosts, selection of metabolic pathways to achieve competitive production costs, and a focus on fuels with attractive properties that increase their value.

09 BIOMASS FUELS↗

Energy-Water Nexus Knowledge Discovery Framework, Experts' Meeting

Energy and water generation and delivery systems are inherently interconnected. With demand for energy growing, the energy sector is experiencing increasing competition for water. With increasing populationand changing environmental, socioeconomic, and demographic scenarios, new technology and investmentdecisions must be made for optimized and sustainable energy-water resource management. These decisionsrequire novel scientific insights into the complex interdependencies of energy-water infrastructures acrossmultiple space and time scales.On June 13, 2017 an Experts’ Meeting was convened for the purpose of informing the design of an integrateddata driven modeling, analysis, and visualization capability that can enable ecient local and regional decisionmakingregarding present and future energy-water infrastructure. This first multi-institute collaborativeEnergy-Water Nexus Knowledge Discovery Framework (EWN-KDF) will be informed by fundamentalscience and guided with strategic (federal) policy decisions in the service of ensuring national energyresilience.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Optimal dynamic remapping of parallel computations

A large class of computations are characterized by a sequence of phases, with phase changes occurring unpredictably. The decision problem was considered regarding the remapping of workload to processors in a parallel computation when the utility of remapping and the future behavior of the workload is uncertain, and phases exhibit stable execution requirements during a given phase, but requirements may change radically between phases. For these problems a workload assignment generated for one phase may hinder performance during the next phase. This problem is treated formally for a probabilistic model of computation with at most two phases. The fundamental problem of balancing the expected remapping performance gain against the delay cost was addressed. Stochastic dynamic programming is used to show that the remapping decision policy minimizing the expected running time of the computation has an extremely simple structure. Because the gain may not be predictable, the performance of a heuristic policy that does not require estimnation of the gain is examined. The heuristic method's feasibility is demonstrated by its use on an adaptive fluid dynamics code on a multiprocessor. The results suggest that except in extreme cases, the remapping decision problem is essentially that of dynamically determining whether gain can be achieved by remapping after a phase change. The results also suggest that this heuristic is applicable to computations with more than two phases.

Nicol, David M.↗

Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.

Geocorona↗

Advanced Transmission Technologies – GETs and HPCs Session 2: Advanced Power Flow Control and Transmission Topology Optimization

The INL TADA GETs Cohort Session 2, held on November 7, 2025, conducted in collaboration with ScottMadden, focused on two core Advanced Transmission Technologies (ATTs): Advanced Power Flow Control (APFC) and Transmission Topology Optimization (TTO). These technologies are pivotal in enhancing grid flexibility, reliability, and cybersecurity resilience. APFC, particularly through modular FACTS devices like Modular Static Synchronous Series Compensators (M-SSSCs), enables dynamic voltage injection to reroute power flows. The session highlighted the deployment benefits of APFC, such as rapid installation, minimal civil works, and re-deployability. Regulatory drivers like FERC Order 2023 mandate the inclusion of Grid-Enhancing Technologies (GETs) in interconnection studies. Case studies from Central Hudson, CAISO, and National Grid (UK) demonstrated APFC’s effectiveness in congestion relief and cost savings. The session also addressed cybersecurity concerns, including firmware vulnerabilities, SCADA integration risks, and supply chain dependencies. Participants engaged in interactive exercises to rank cybersecurity and supply chain risks, emphasizing the need for robust digital assurance strategies. TTO involves software-based reconfiguration of transmission networks to optimize power flow without new infrastructure. The session showcased its operational value, with examples from SPP, PJM, and MISO showing significant congestion cost reductions. Cybersecurity vulnerabilities were discussed, particularly in API security and software supply chains, referencing incidents like SolarWinds and attacks on Danish utilities. Digital assurance exercises explored worst-case scenarios, attack paths, and mitigation responsibilities between vendors and utilities. Reliability challenges such as algorithm stability, vendor dependency, and operator trust were also examined. Cross-cutting themes emphasized the importance of digital assurance tools, including Software Bills of Materials (SBOMs) and hardware-in-loop testing. Human performance, training, and operational confidence were identified as critical enablers of technology adoption. The session concluded with a preview of Session 3, which will focus on High Performance Conductors (HPCs) and risk-based cybersecurity tools. Session 2 of 3.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

In situ embedment of type K sheathed thermocouples with directed energy deposition

Advanced nuclear reactor systems require new technologies for heat transfer and system monitoring. Additive manufacturing (AM) offers the design flexibility to allow in-situ sensor embedment through smart manufacturing for real-time monitoring, and performance of these systems. Here, this study focuses on experiments investigating the feasibility of in-situ sensor embedment using directed energy deposition (DED). Type K thermocouples are embedded into 316L stainless steel (SS) samples using two different configurations (e.g., exposed and embedded tips) and two designs (e.g., flush to substrate) within an AM base. Embedded sensor samples are analyzed via in-situ measurements and high-temperature performance validation tests at 350ºC and 900ºC. Temperature performance results at both temperature tests show good agreement with manufacturer specifications proving that these sensors could still capture accurate temperature readings after in-situ embedment during DED processing. An additional optimization experiment was conducted on the exposed tip configuration using a surrogate thermocouple to improve tolerances and the embedment process. Results improved tolerances, lower porosity, smaller gaps between the sensor and base, and better junction contact for the sensor. Although further optimization of this embedment strategy is necessary to improve the structural stability and tolerances within the component, this research strategy provides a proof-of-feasibility for DED embedment with commercial sheathed thermocouples. This research provides early impact on embedment of sensor for multiple materials and complex geometric components..

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Comparative Study of Techno-Economics of Lithium-Ion and Lead-Acid Batteries in Micro-Grids in Sub-Saharan Africa

Microgrids stand to play an important role in expanding electricity access in Sub-Saharan Africa. Batteries, which are often a core element of micro-grids, represent a substantial portion of the capital cost and are therefore an important component of developing sustainable business models for micro-grid deployment. As a result, understanding key considerations for selecting a battery type and operating it effectively are foundational for taking micro-grid growth to scale across the sub-continent. While batteries have been deployed in many systems worldwide over the past few decades, unanswered questions remain on how best to apply them to the context of off-grid micro-grids in Sub-Saharan Africa. Building on analytical work with developers in Sub-Saharan Africa and tools at NREL, this report investigates battery techno-economics and optimal operation in micro-grids, including evaluating criteria to decide between deploying lead acid or lithium-ion batteries, discussing key design considerations for the enclosures that house the batteries, and how to effectively condition the enclosure.

25 ENERGY STORAGE↗

Smart distribution systems

The increasing importance of system reliability and resilience is changing the way distribution systems are planned and operated. To achieve a distribution system self-healing against power outages, emerging technologies and devices, such as remote-controlled switches (RCSs) and smart meters, are being deployed. The higher level of automation is transforming traditional distribution systems into the smart distribution systems (SDSs) of the future. The availability of data and remote control capability in SDSs provides distribution operators with an opportunity to optimize system operation and control. In this paper, the development of SDSs and resulting benefits of enhanced system capabilities are discussed. A comprehensive survey is conducted on the state-of-the-art applications of RCSs and smart meters in SDSs. Specifically, a new method, called Temporal Causal Diagram (TCD), is used to incorporate outage notifications from smart meters for enhanced outage management. To fully utilize the fast operation of RCSs, the spanning tree search algorithm is used to develop service restoration strategies. Optimal placement of RCSs and the resulting enhancement of system reliability are discussed. Distribution system resilience with respect to extreme events is presented. Furthermore, test cases are used to demonstrate the benefit of SDSs. Active management of distributed generators (DGs) is introduced. Future research in a smart distribution environment is proposed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Thermal Energy Storage for Electricity Peak-demand Mitigation: A Solution in Developing and Developed World Alike

In much of the developed world, air-conditioning in buildings is the dominant driver of summer peak electricity demand. In the developing world a steadily increasing utilization of air-conditioning places additional strain on already-congested grids. This common thread represents a large and growing threat to the reliable delivery of electricity around the world, requiring capital-intensive expansion of capacity and draining available investment resources. Thermal energy storage (TES), in the form of ice or chilled water, may be one of the few technologies currently capable of mitigating this problem cost effectively and at scale. The installation of TES capacity allows a building to meet its on-peak air conditioning load without interruption using electricity purchased off-peak and operating with improved thermodynamic efficiency. In this way, TES has the potential to fundamentally alter consumption dynamics and reduce impacts of air conditioning. This investigation presents a simulation study of a large office building in four distinct geographical contexts: Miami, Lisbon, Shanghai, and Mumbai. The optimization tool DER-CAM (Distributed Energy Resources Customer Adoption Model) is applied to optimally size TES systems for each location. Summer load profiles are investigated to assess the effectiveness and consistency in reducing peak electricity demand. Additionally, annual energy requirements are used to determine system cost feasibility, payback periods and customer savings under local utility tariffs.

25 ENERGY STORAGE↗

Distributed Wind Competitiveness Improvement Project

The Competitiveness Improvement Project (CIP) is a periodic solicitation through the U.S. Department of Energy and its National Renewable Energy Laboratory. The Competitiveness Improvement Project (CIP) is a periodic solicitation through the U.S. Department of Energy and its National Renewable Energy Laboratory. Manufacturers of small and medium wind turbines are awarded cost-shared grants via a competitive process to optimize their designs, develop advanced manufacturing processes, and perform turbine testing. The goals of the CIP are to make wind energy cost competitive with other distributed generation technology and increase the number of wind turbine designs certified to national testing standards. This fact sheet describes the CIP and funding awarded as part of the project.ufacturers of small and medium wind turbines are awarded cost-shared grants via a competitive process to optimize their designs, develop advanced manufacturing processes, and perform turbine testing. The goals of the CIP are to make wind energy cost competitive with other distributed generation technology and increase the number of wind turbine designs certified to national testing standards. This fact sheet describes the CIP and funding awarded as part of the project.

17 WIND ENERGY↗

Behind-the-Meter Solar + Storage Modeling Tool Comparison

Several techno-economic models exist to evaluate solar PV plus battery storage opportunities for behind-the-meter, commercial application. This tool comparison evaluates the methodological differences between several solar plus storage modeling tools and employs a case study to compare their outputs. The tools selected for comparison include NREL's REopt Lite, NREL's System Advisor Model (SAM), Homer Energy's Homer Grid, Geli ESyst, EPRI StorageVET, and LBL's DER-CAM. The comparison focuses on each tool's simulation and optimization capabilities, PV and battery performance modeling, dispatch strategies, and economic model assumptions and calculations, with brief mention of additional capabilities outside the scope of behind-the-meter PV and battery storage. This report describes the case study's tool inputs and outputs and dives into the differences in assumptions, methodologies, and capabilities between tools.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗