Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Economic Risk-Informed Maintenance Planning and Asset Management (Final Report)

The proposed work will provide a holistic framework for cost-minimizing risk-informed maintenance planning, including inspection, in light water reactors (LWRs). Specifically, we develop a two-tier framework that (a) coarsely minimizes the total maintenance cost during the remaining normal operating cycle of the plant prior to the next scheduled outage (long-term), subject to safety requirements, and (b) uses the outputs of the first model to develop a secondary optimization model to finely schedule maintenance activities to maximize the financial impact of these activities in the next week (short-term).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Electromagnetic Energy-Assisted Thermal Conversion of Fossil-Based Hydrocarbons to Low-Cost Hydrogen

The goal of this project was to develop and optimize catalysts for methane decomposition, particularly focusing on regeneration via an electromagnetic energy-assisted mechanism, to produce hydrogen more cost-effectively compared to electrolysis routes. To achieve this goal, the project pursued several key objectives. The project began with the preparation and testing of various catalysts. A nickel-silica based catalyst was identified as the most promising material for the pyrolysis of methane into carbon and hydrogen. Kinetic parameters for methane decomposition were determined, aiding in computational modeling efforts. Structured catalysts were investigated, highlighting the need for frequent cleaning or regeneration to maintain performance, with methane conversion rates exceeding 70% in tube furnace tests. Computational fluid dynamics modeling was employed to optimize reactor designs and electrode angles, leading the project team to propose a multi-compartment thermal conversion system for larger setups. This modeling work was important in understanding reaction characteristics, carbon deposition rates, and temperature profiles under various conditions. A bench-scale reactor system was assembled to evaluate catalyst regeneration using electromagnetic energy-assisted mechanisms. Experiments demonstrated the potential for carbon removal, though further optimization is needed. The carbon produced from the methane conversion process was evaluated for potential use in lithium-ion battery electrodes. The carbon exhibited properties similar to commercially available high-purity multi-walled carbon nanotubes and nanofibers, with a carbon content greater than 95%. Coin cell batteries assembled with this carbon showed that lower replacement levels (10% to 33%) outperformed the control group, improving specific capacity density and stability. However, higher replacement levels (100%) demonstrated poorer performance, suggesting that excessive carbon substitution negatively impacts battery performance. These findings indicate the potential marketability of the produced carbon as a component in lithium-ion batteries, though further testing is necessary to confirm long-term advantages and disadvantages associated with the use of the carbon product. These results however justified further technoeconomic assessments to determine if the process can provide low-cost hydrogen. The economic feasibility and technical performance of methane decomposition for hydrogen production were assessed, focusing on three plant configurations: 100E (electrically heated), 100C (combustion heated using produced hydrogen), and PE-Hybrid (a combination of pyrolysis (indicating decomposition) and electrolysis). The Levelized Cost of Hydrogen (LCOH) for the pyrolysis configurations was found to be approximately 25% lower than that of electrolysis. The 100E configuration had the lowest LCOH at $\$$3.12/kg. Including carbon product sales significantly improved the economics, with the 100C configuration achieving a negative LCOH of -$\$$0.35/kg. The PE-Hybrid configuration was not economically advantageous compared to pure pyrolysis plants due to its complexity and additional equipment requirements. Ultimately, methane pyrolysis presents a viable method for near carbon dioxide-free hydrogen production, with significant economic advantages over electrolysis, especially when considering the sale of carbon byproducts. The 100E and 100C configurations showed the most promise, with the choice between them ultimately depending on the prices of power and natural gas. In conclusion, this technology has the potential to lower hydrogen production costs by leveraging the methane decomposition process with the sale of valuable carbon byproducts. By optimizing catalyst performance and integrating electromagnetic energy-assisted regeneration, the process can achieve higher efficiency and economic viability, making it a competitive alternative to traditional hydrogen production methods.

08 HYDROGEN↗

Opportunities and Challenges for Nuclear-Renewable Hybrid Energy Systems

TTightly coupled nuclear-renewable hybrid energy systems (N-R HESs) are systems that link subsystems to generate dispatchable electricity and produce at least one industrial product from two or more energy resources. Because N-R HESs are designed to produce different products based on the value of those products in markets, their optimal designs and operations can be complex. This paper summarizes some key conclusions from a set of economic analyses of N-R HESs. Each N-R HES use case analyzed includes a nuclear reactor, a thermal power cycle to convert nuclear energy into electricity, either a wind or photovoltaic solar subsystem producing electricity, and an industrial process producing an energy or an industrial product. The analyses focused on identifying the optimal configuration and hours of operations for each N-R HES within ranges of hypothetical future electricity price profiles and industrial product prices. Four important insights are drawn from the results of those analyses.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Managing Uncertainty and Flexibility in Day-Ahead Electricity Markets

Net load imbalances from day ahead forecasts can lead to significant grid operations costs and are expected to increase as variable renewable energy adoption grows. We propose a new wholesale market product to manage the risk of net load imbalances called Flexibility Options. This product relies on probabilistic forecasts to estimate flexibility demand and would be co-optimized in the day-ahead market. We also propose stochastic methods that enable DER and flexible load aggregators to participate in flexibility markets while considering the uncertainty in weather and occupant behavior.

day-ahead market↗

Optimal operations of a nuclear-based integrated energy system: A mixed integer program approach

A nuclear-based integrated energy system (IES), consisting of multiple carbon-free energy generation and conversion technologies to meet heterogeneous end-use demands, offers a promising approach to decarbonizing the U.S. economy. Operating such an IES is challenging due to its complexity and the diverse end-use demands, such as heating and electricity. This paper aims to address the optimal operation of an IES composed of a small modular reactor (SMR), a steam manifold, a balance of plant (BOP), a high-temperature steam electrolysis (HTSE) system, a district heating (DH) network, and electrical grids. We formulate the system’s operation as a mixed integer linear programming (MILP) problem to maximize net revenues from sales of electricity and hydrogen. To evaluate the efficacy of the proposed model, we conduct a 24-hour simulation considering day-ahead (DA) electricity prices from CAISO and a varying DH demand profile with hourly resolution. The simulation results show that our model effectively optimizes the operation by selling electricity during on-peak periods and purchasing electricity for hydrogen production during off-peak periods, while satisfying operating constraints within the IES.

08 HYDROGEN↗

Assessment of the feedstock supply for siting single- and multiple-feedstock biorefineries in the USA and identification of prevalent feedstocks

An integrated multi-feedstock bioenergy (i.e., biofuel, biopower, or bioproduct) supply system has potential to reduce biomass supply system uncertainties and costs. This study identifies optimal configurations of multi-feedstock biomass-to-biorefinery supply chains and pertinent feedstock combinations based on spatial distribution of feedstock and lowest delivered cost to the biorefinery. We used the Supply Characterization Model (SCM) to allocate feedstock supplies to candidate biorefinery facilities. Model runs were performed for herbaceous energy crops, agriculture residue, and woody biomass available in 2017, 2022, 2025, and 2030 as estimated by the Policy Analysis System (POLYSYS) and Forest Sustainable and Economic Analysis Model (ForSEAM) models. Three feedstock supply scenarios were compared: (a) an herbaceous scenario: switchgrass, miscanthus, biosorghum, and corn stover; (b) a woody scenario: coppice wood, noncoppice wood, whole trees, and forestry residues, and (c) a mixed scenario: a combination of all feedstocks in herbaceous and woody scenarios. By 2030 the analyses predicted that 323, 168, and 473 biorefineries were sited in the herbaceous, woody, and mixed scenario, respectively, in the conterminous USA. Feedstock mixes supplied to the biorefineries were mostly dominated by a single feedstock. The most prominent feedstock mixes identified were: (1) switchgrass and miscanthus; (2) coppice and noncoppice wood; and (3) coppice wood, noncoppice wood, switchgrass and miscanthus. Biorefineries using multi-feedstock would be beneficial for growth of bioeconomy, however flexible and cost-effective conversion platforms should be developed to efficiently utilize multiple feedstocks. This analysis identifies biorefinery locations and feedstock supply mixes while minimizing delivered feedstock costs based on spatial and temporal feedstock availability.

09 BIOMASS FUELS↗

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Technology Development and Infusion by NASA's Entry Systems Modeling Project

This paper describes recent development of modeling and simulation technologies for entry systems and their infusion into NASA's exploration missions. Technology development is organized and prioritized using a system-level perspective, resulting in four broad technical areas of investment: (1) Thermal protection material modeling, (2) Shock layer kinetics and radiation, (3) Computational and experimental aerosciences, and (4) Guidance, navigation, and control. The paper will highlight key contributions from each of these areas, their impacts from a spacecraft and mission design perspective, and discuss planned future investment. Aspects of each technical area are only briefly summarized here. Thermal protection material modeling is geared toward high-fidelity, predictive models capable of optimizing design performance, post-flight reconstruction, and quantifying thermal protection system reliability. New computational tools and experimental techniques have been applied to Orion, MSL/Mars 2020, Mars InSight, and Mars Sample Return missions. Research and development in the area of shock layer kinetics has focused on air and CO2-based atmospheres. In both cases, substantial improvements in model uncertainty have directly impacted the development of mission margin policies, flight instrumentation design and analysis (Orion and Mars 2020), and have even revealed the importance of neglected phenomena like mid-wave infrared radiation of CO2. Aerosciences is a very broad area of interest in entry systems, yet a number of important challenges are being addressed: Coupled fluid-structure simulations of parachute inflation and dynamics affecting Orion, Commercial Crew, and Mars programs; Experimental and computational studies of vehicle dynamics; Multi-phase flow with dust particles to simulate augmentation of aerothermal environments at Mars during dust storms; and studies of roughness-induced heating augmentation relevant to tiled (Orion, Mars 2020) and woven (Mars Sample Return) thermal protection systems. Guidance and control in the context of entry systems has focused on development of methods for multi-axis control (i.e. pitch and yaw, rather than bank angle alone) of spacecraft during entry and descent, with precision landing requirements driven by Mars human exploration goals.

Barnhardt, Michael D.↗

A systematic solution to quantify economic values of vehicle grid integration

We report Vehicle-Grid-Integration (VGI) supplies one of the potential benefit extensions for electric vehicles (EVs) to make use of their parking time, which enables the EVs to provide grid services while still meeting consumer driving needs. However, the costs, benefits and risks of VGI still remain unclear, which limits the development of the VGI to promote the interaction between the EV and grid. In this study, we propose an integrated framework to quantify and utilize the aggregate flexibility of the EVs to supply the grid services in electricity markets. The integrated solution includes five sub-modules that cover end-to-end functionalities from individual EV energy consumption estimation to final monetary values calculation of providing grid services. Both wholesale market and local level charging management are formulated in the optimization module. A predictive control algorithm is proposed to allocate power to individual vehicles in real time, considering uncertainties from dispatch signal and travel behavior. Simulation results from 10,000 EVs indicate that the proposed optimization methods can significantly reduce the system cost in both wholesale market and retail market. Local tariff optimization reduces the electricity cost by 24.4% compared to uncontrolled charging. Wholesale market optimization results show that $\$$691 and $\$$255 revenues can be captured by each EV in ERCOT and CAISO markets per year, although with a conservative assumption on battery throughput cost at 0.16$\$$/kWh.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Foundational Report Series: Advanced Distribution Management Systems for Grid Modernization, DMS Integration of Distributed Energy Resources and Microgrids

Deregulation of the electric utility industry, environmental concerns associated with traditional fossil fuel-based power plants, volatility of electric energy costs, Federal and State regulatory support of “green” energy, and rapid technological developments all support the growth of Distributed Energy Resources (DERs) in electric utility systems and ensure an important role for DERs in the smart grid and other aspects of modern utilities. DERs include distributed generation (DG) systems, such as renewables; controllable loads (also known as demand response); and energy storage systems. This report describes the role of aggregators of DERs in providing optimal services to distribution networks, through DER monitoring and control systems—collectively referred to as a Distributed Energy Resource Management System (DERMS)—and microgrids in various configurations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Hot Rolling Scrap Reduction through Edge Cracking and Surface Defects Control

The design of future aircraft must address the combined demands for fuel efficiency, reduced emissions and lower operating costs. One contribution to these goals is weight savings through the development of new alloys and design techniques for airframe structures. This research contributes to the light-weighting through fabrication of monolithic components from advanced aluminum alloys by making a link between alloy processing history and in-service performance. Specifically, this research demonstrates the link between growing cracks with features of the alloy microstructure that follow from thermo-mechanical processing. This is achieved through a computer model of crack deviation. The model is validated against experimental data from production scale aluminum alloy plate, and demonstration of the effect of changes in processing history on crack growth is made. The model is cast in the open-source finite element code WARP3D, which is freely downloadable and well documented. This project provides benefit along several avenues. First, the technical contribution of the computer model offers the materials engineer a critical means of providing guidance both upstream, to process tuning to achieve optimal properties, and downstream, to enhance fault tolerance. Beyond the fuel savings and emissions reduction inherent in the light-weighting of aircraft structures, improved fault tolerance addresses demands for longer inspection intervals over baseline, and a lower life cycle cost.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Technology Case Study: Economic, Sustainability, and Deployment Considerations for Sustainable Aviation Fuels Produced via Lignocellulosic Sugar Catalysis

This report presents a technology case study reflecting one exemplary representative pathway for the conversion of lignocellulosic sugars to sustainable aviation fuels (SAF) via aqueous phase reforming (APR) catalysis, considered within a broader integrated biorefinery framework based on biochemical processing operations. While far from the only option for converting sugars to SAF, this pathway was selected as a case study here based on its relatively high technology maturity and simplistic processing approach (avoiding complex separations or other equipment scalability challenges), coupled with the potential for high fuel yields and favorable costs/carbon intensities with opportunities for further near-term optimization. The report considers key process integration and engineering design considerations for a modeled hypothetical, nth-plant commercial biorefinery, reflecting a number of processing options and parameters envisioned to be achievable as future goals. Resultant outputs from Aspen Plus process simulations are evaluated through techno-economic and life cycle analyses (TEA and LCA), including implications for marginal cost of CO2 abatement and inclusion of currently-applicable policy incentives. Moving beyond base case configurations, a number of alternative scenarios are also evaluated for their ability to further improve economics, greenhouse gas (GHG) emissions, and marginal cost of abatement, highlighting a path to achieve deep decarbonization goals of more than 70% GHG reduction for SAF (with the potential to reach net-negative carbon intensities in some cases) under reasonable fuel production costs. The report also highlights future opportunities and gaps for further research on this technology pathway.

09 BIOMASS FUELS↗

Space Shuttle RTOS Bayesian Network

With shrinking budgets and the requirements to increase reliability and operational life of the existing orbiter fleet, NASA has proposed various upgrades for the Space Shuttle that are consistent with national space policy. The cockpit avionics upgrade (CAU), a high priority item, has been selected as the next major upgrade. The primary functions of cockpit avionics include flight control, guidance and navigation, communication, and orbiter landing support. Secondary functions include the provision of operational services for non-avionics systems such as data handling for the payloads and caution and warning alerts to the crew. Recently, a process to selection the optimal commercial-off-the-shelf (COTS) real-time operating system (RTOS) for the CAU was conducted by United Space Alliance (USA) Corporation, which is a joint venture between Boeing and Lockheed Martin, the prime contractor for space shuttle operations. In order to independently assess the RTOS selection, NASA has used the Bayesian network-based scoring methodology described in this paper. Our two-stage methodology addresses the issue of RTOS acceptability by incorporating functional, performance and non-functional software measures related to reliability, interoperability, certifiability, efficiency, correctness, business, legal, product history, cost and life cycle. The first stage of the methodology involves obtaining scores for the various measures using a Bayesian network. The Bayesian network incorporates the causal relationships between the various and often competing measures of interest while also assisting the inherently complex decision analysis process with its ability to reason under uncertainty. The structure and selection of prior probabilities for the network is extracted from experts in the field of real-time operating systems. Scores for the various measures are computed using Bayesian probability. In the second stage, multi-criteria trade-off analyses are performed between the scores. Using a prioritization of measures from the decision-maker, trade-offs between the scores are used to rank order the available set of RTOS candidates.

Morris, A. Terry↗

A near-term to net zero alternative to the social cost of carbon for setting carbon prices

The social cost of carbon (SCC) is commonly described and used as the optimal CO 2 price. However, the wide range of SCC estimates provides limited practical assistance to policymakers setting specific CO 2 prices. In this study we describe an alternate near-term to net zero (NT2NZ) approach, estimating CO 2 prices needed in the near term for consistency with a net-zero CO 2 emissions target. This approach dovetails with the emissions-target-focused approach that frames climate policy discussions around the world, avoids uncertainties in estimates of climate damages and long-term decarbonization costs, offers transparency about sensitivities and enables the consideration of CO 2 prices alongside a portfolio of policies. We estimate illustrative NT2NZ CO 2 prices for the United States; for a 2050 net-zero CO 2 emission target, prices are US $ \$34$ to US $ \$64$ per metric ton in 2025 and US $ \$77$ to US $ \$124$ in 2030. These results are most influenced by assumptions about complementary policies and oil prices.

54 ENVIRONMENTAL SCIENCES↗

Game theoretic modeling and optimization of competition and collaboration in dual channel electronic waste supply chains

The rapid growth of electronic waste (e-waste) presents critical challenges for sustainable resource recovery and environmental protection. This study develops a dual-channel closed-loop supply chain (CLSC) model formulated as a hierarchical Stackelberg game, that integrates dynamic pricing and cost-sharing mechanisms to optimize both economic and environmental outcomes. The model explicitly captures strategic interactions between manufacturer-led and third-party recycling channels, accounting for consumer behavior, regulatory incentives, and market competition. Numerical simulations conducted (implemented over a four-iteration horizon using a commercial optimization solver) show that, relative to the baseline equilibrium, manufacturer profit increases from 11.6 thousand USD to 37.9 thousand USD (+226.8%), total recycled volume rises from 7,848 to 7,942 units (+1.2%), and collector profit nearly doubles under cost-sharing, enabling more equitable profit distribution. Furthermore, scenario-based simulations across Sub-Saharan Africa, high-income economies, and emerging Asian industrial countries reveal that infrastructure quality, policy intensity, and labor costs critically shape recycling efficiency and profit allocation. These findings demonstrate that subsidies alone are insufficient to ensure system efficiency. Instead, coordinated strategies that integrate internal incentive alignment with context-sensitive policy support are required. Overall, this study offers a robust framework for designing resilient, efficient, and regionally adaptable e-waste management systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems [SWR-22-07]

NREL's PowerGridworld provides a modular simulation environment for training heterogenous, grid-aware, multi-agent reinforcement learning (RL) policies at scale. The package enables the user to create component gym environments that can be composed into more complex agents. For example, a grid interactive building environment can be created by composing together component environments each encapsulating the building, PV, and battery physics. These multi-component environments can then be combined into multi-agent simulation where each agent's power consumption/injection becomes an input for solving the optimal power flow on a distribution feeder modeled in OpenDSS. Information from OpenDSS, such as bus voltages and line flows, can be included in the agents' observation spaces to enable grid-aware rewards. The default API for the PowerGridworld simulator conforms to RLLib's MultiAgent API and thus enables distributed training using HPC and cloud resources.

Biagioni, David↗