Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Managing Uncertainty and Flexibility in Day-Ahead Electricity Markets

Net load imbalances from day ahead forecasts can lead to significant grid operations costs and are expected to increase as variable renewable energy adoption grows. We propose a new wholesale market product to manage the risk of net load imbalances called Flexibility Options. This product relies on probabilistic forecasts to estimate flexibility demand and would be co-optimized in the day-ahead market. We also propose stochastic methods that enable DER and flexible load aggregators to participate in flexibility markets while considering the uncertainty in weather and occupant behavior.

day-ahead market↗
DOE OSTI2024

Optimal operations of a nuclear-based integrated energy system: A mixed integer program approach

A nuclear-based integrated energy system (IES), consisting of multiple carbon-free energy generation and conversion technologies to meet heterogeneous end-use demands, offers a promising approach to decarbonizing the U.S. economy. Operating such an IES is challenging due to its complexity and the diverse end-use demands, such as heating and electricity. This paper aims to address the optimal operation of an IES composed of a small modular reactor (SMR), a steam manifold, a balance of plant (BOP), a high-temperature steam electrolysis (HTSE) system, a district heating (DH) network, and electrical grids. We formulate the system’s operation as a mixed integer linear programming (MILP) problem to maximize net revenues from sales of electricity and hydrogen. To evaluate the efficacy of the proposed model, we conduct a 24-hour simulation considering day-ahead (DA) electricity prices from CAISO and a varying DH demand profile with hourly resolution. The simulation results show that our model effectively optimizes the operation by selling electricity during on-peak periods and purchasing electricity for hydrogen production during off-peak periods, while satisfying operating constraints within the IES.

08 HYDROGEN↗
DOE OSTI2020

Assessment of the feedstock supply for siting single- and multiple-feedstock biorefineries in the USA and identification of prevalent feedstocks

An integrated multi-feedstock bioenergy (i.e., biofuel, biopower, or bioproduct) supply system has potential to reduce biomass supply system uncertainties and costs. This study identifies optimal configurations of multi-feedstock biomass-to-biorefinery supply chains and pertinent feedstock combinations based on spatial distribution of feedstock and lowest delivered cost to the biorefinery. We used the Supply Characterization Model (SCM) to allocate feedstock supplies to candidate biorefinery facilities. Model runs were performed for herbaceous energy crops, agriculture residue, and woody biomass available in 2017, 2022, 2025, and 2030 as estimated by the Policy Analysis System (POLYSYS) and Forest Sustainable and Economic Analysis Model (ForSEAM) models. Three feedstock supply scenarios were compared: (a) an herbaceous scenario: switchgrass, miscanthus, biosorghum, and corn stover; (b) a woody scenario: coppice wood, noncoppice wood, whole trees, and forestry residues, and (c) a mixed scenario: a combination of all feedstocks in herbaceous and woody scenarios. By 2030 the analyses predicted that 323, 168, and 473 biorefineries were sited in the herbaceous, woody, and mixed scenario, respectively, in the conterminous USA. Feedstock mixes supplied to the biorefineries were mostly dominated by a single feedstock. The most prominent feedstock mixes identified were: (1) switchgrass and miscanthus; (2) coppice and noncoppice wood; and (3) coppice wood, noncoppice wood, switchgrass and miscanthus. Biorefineries using multi-feedstock would be beneficial for growth of bioeconomy, however flexible and cost-effective conversion platforms should be developed to efficiently utilize multiple feedstocks. This analysis identifies biorefinery locations and feedstock supply mixes while minimizing delivered feedstock costs based on spatial and temporal feedstock availability.

09 BIOMASS FUELS↗
DOE OSTI2023

Reinforcement learning building control approach harnessing imitation learning

Reinforcement learning (RL) has shown significant success in sequential decision making in fields like autonomous vehicles, robotics, marketing and gaming industries. This success has attracted the attention to the RL control approach for building energy systems which are becoming complicated due to the need to optimize for multiple, potentially conflicting, goals like occupant comfort, energy use and grid interactivity. However, for real world applications, RL has several drawbacks like requiring large training data and time, and unstable control behavior during the early exploration process making it infeasible for an application directly to building control tasks. To address these issues, an imitation learning approach is utilized herein where the RL agents starts with a policy transferred from accepted rule based policies and heuristic policies. This approach is successful in reducing the training time, preventing the unstable early exploration behavior and improving upon an accepted rule-based policy - all of these make RL a more practical control approach for real world applications in the domain of building controls.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2019

Technology Development and Infusion by NASA's Entry Systems Modeling Project

This paper describes recent development of modeling and simulation technologies for entry systems and their infusion into NASA's exploration missions. Technology development is organized and prioritized using a system-level perspective, resulting in four broad technical areas of investment: (1) Thermal protection material modeling, (2) Shock layer kinetics and radiation, (3) Computational and experimental aerosciences, and (4) Guidance, navigation, and control. The paper will highlight key contributions from each of these areas, their impacts from a spacecraft and mission design perspective, and discuss planned future investment. Aspects of each technical area are only briefly summarized here. Thermal protection material modeling is geared toward high-fidelity, predictive models capable of optimizing design performance, post-flight reconstruction, and quantifying thermal protection system reliability. New computational tools and experimental techniques have been applied to Orion, MSL/Mars 2020, Mars InSight, and Mars Sample Return missions. Research and development in the area of shock layer kinetics has focused on air and CO2-based atmospheres. In both cases, substantial improvements in model uncertainty have directly impacted the development of mission margin policies, flight instrumentation design and analysis (Orion and Mars 2020), and have even revealed the importance of neglected phenomena like mid-wave infrared radiation of CO2. Aerosciences is a very broad area of interest in entry systems, yet a number of important challenges are being addressed: Coupled fluid-structure simulations of parachute inflation and dynamics affecting Orion, Commercial Crew, and Mars programs; Experimental and computational studies of vehicle dynamics; Multi-phase flow with dust particles to simulate augmentation of aerothermal environments at Mars during dust storms; and studies of roughness-induced heating augmentation relevant to tiled (Orion, Mars 2020) and woven (Mars Sample Return) thermal protection systems. Guidance and control in the context of entry systems has focused on development of methods for multi-axis control (i.e. pitch and yaw, rather than bank angle alone) of spacecraft during entry and descent, with precision landing requirements driven by Mars human exploration goals.

Barnhardt, Michael D.↗
DOE OSTI2021

A systematic solution to quantify economic values of vehicle grid integration

We report Vehicle-Grid-Integration (VGI) supplies one of the potential benefit extensions for electric vehicles (EVs) to make use of their parking time, which enables the EVs to provide grid services while still meeting consumer driving needs. However, the costs, benefits and risks of VGI still remain unclear, which limits the development of the VGI to promote the interaction between the EV and grid. In this study, we propose an integrated framework to quantify and utilize the aggregate flexibility of the EVs to supply the grid services in electricity markets. The integrated solution includes five sub-modules that cover end-to-end functionalities from individual EV energy consumption estimation to final monetary values calculation of providing grid services. Both wholesale market and local level charging management are formulated in the optimization module. A predictive control algorithm is proposed to allocate power to individual vehicles in real time, considering uncertainties from dispatch signal and travel behavior. Simulation results from 10,000 EVs indicate that the proposed optimization methods can significantly reduce the system cost in both wholesale market and retail market. Local tariff optimization reduces the electricity cost by 24.4% compared to uncontrolled charging. Wholesale market optimization results show that $\$$691 and $\$$255 revenues can be captured by each EV in ERCOT and CAISO markets per year, although with a conservative assumption on battery throughput cost at 0.16$\$$/kWh.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2013

An Assessment of the Current US Radiation Oncology Workforce: Methodology and Global Results of the American Society for Radiation Oncology 2012 Workforce Study

Purpose: To determine the characteristics, needs, and concerns of the current radiation oncology workforce, evaluate best practices and opportunities for improving quality and safety, and assess what we can predict about the future workforce. Methods and Materials: An online survey was distributed to 35,204 respondents from all segments of the radiation oncology workforce, including radiation oncologists, residents, medical dosimetrists, radiation therapists, medical physicists, nurse practitioners, nurses, physician assistants, and practice managers/administrators. The survey was disseminated by the American Society for Radiation Oncology (ASTRO) together with specialty societies representing other workforce segments. An overview of the methods and global results is presented in this paper. Results: A total of 6765 completed surveys were received, a response rate of 19%, and the final analysis included 5257 respondents. Three-quarters of the radiation oncologists, residents, and physicists who responded were male, in contrast to the other segments in which two-thirds or more were female. The majority of respondents (58%) indicated they were hospital-based, whereas 40% practiced in a free-standing/satellite clinic and 2% in another setting. Among the practices represented in the survey, 21.5% were academic, 25.2% were hospital, and 53.3% were private. A perceived oversupply of professionals relative to demand was reported by the physicist, dosimetrist, and radiation therapist segments. An undersupply was perceived by physician's assistants, nurse practitioners, and nurses. The supply of radiation oncologists and residents was considered balanced. Conclusions: This survey was unique as it attempted to comprehensively assess the radiation oncology workforce by directly surveying each segment. The results suggest there is potential to improve the diversity of the workforce and optimize the supply of the workforce segments. The survey also provides a benchmark for future studies, as many changes in the healthcare field exert pressure on the workforce.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2014

Executive Order 13514: Federal Leadership in Environmental, Energy, and Economic Performance; Comprehensive Federal Fleet Management Handbook (Book)

A comprehensive Federal Fleet Management Handbook that builds upon the "Guidance for Federal Agencies on E.O. 13514 Section 12-Federal Fleet Management" and provides information to help fleet managers select optimal greenhouse gas and petroleum reduction strategies for each location, meeting or exceeding related fleet requirements, acquiring vehicles to support these strategies while minimizing fleet size and vehicle miles traveled, and refining strategies based on agency performance.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2017

Foundational Report Series: Advanced Distribution Management Systems for Grid Modernization, DMS Integration of Distributed Energy Resources and Microgrids

Deregulation of the electric utility industry, environmental concerns associated with traditional fossil fuel-based power plants, volatility of electric energy costs, Federal and State regulatory support of “green” energy, and rapid technological developments all support the growth of Distributed Energy Resources (DERs) in electric utility systems and ensure an important role for DERs in the smart grid and other aspects of modern utilities. DERs include distributed generation (DG) systems, such as renewables; controllable loads (also known as demand response); and energy storage systems. This report describes the role of aggregators of DERs in providing optimal services to distribution networks, through DER monitoring and control systems—collectively referred to as a Distributed Energy Resource Management System (DERMS)—and microgrids in various configurations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2016

Hot Rolling Scrap Reduction through Edge Cracking and Surface Defects Control

The design of future aircraft must address the combined demands for fuel efficiency, reduced emissions and lower operating costs. One contribution to these goals is weight savings through the development of new alloys and design techniques for airframe structures. This research contributes to the light-weighting through fabrication of monolithic components from advanced aluminum alloys by making a link between alloy processing history and in-service performance. Specifically, this research demonstrates the link between growing cracks with features of the alloy microstructure that follow from thermo-mechanical processing. This is achieved through a computer model of crack deviation. The model is validated against experimental data from production scale aluminum alloy plate, and demonstration of the effect of changes in processing history on crack growth is made. The model is cast in the open-source finite element code WARP3D, which is freely downloadable and well documented. This project provides benefit along several avenues. First, the technical contribution of the computer model offers the materials engineer a critical means of providing guidance both upstream, to process tuning to achieve optimal properties, and downstream, to enhance fault tolerance. Beyond the fuel savings and emissions reduction inherent in the light-weighting of aircraft structures, improved fault tolerance addresses demands for longer inspection intervals over baseline, and a lower life cycle cost.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Technology Case Study: Economic, Sustainability, and Deployment Considerations for Sustainable Aviation Fuels Produced via Lignocellulosic Sugar Catalysis

This report presents a technology case study reflecting one exemplary representative pathway for the conversion of lignocellulosic sugars to sustainable aviation fuels (SAF) via aqueous phase reforming (APR) catalysis, considered within a broader integrated biorefinery framework based on biochemical processing operations. While far from the only option for converting sugars to SAF, this pathway was selected as a case study here based on its relatively high technology maturity and simplistic processing approach (avoiding complex separations or other equipment scalability challenges), coupled with the potential for high fuel yields and favorable costs/carbon intensities with opportunities for further near-term optimization. The report considers key process integration and engineering design considerations for a modeled hypothetical, nth-plant commercial biorefinery, reflecting a number of processing options and parameters envisioned to be achievable as future goals. Resultant outputs from Aspen Plus process simulations are evaluated through techno-economic and life cycle analyses (TEA and LCA), including implications for marginal cost of CO2 abatement and inclusion of currently-applicable policy incentives. Moving beyond base case configurations, a number of alternative scenarios are also evaluated for their ability to further improve economics, greenhouse gas (GHG) emissions, and marginal cost of abatement, highlighting a path to achieve deep decarbonization goals of more than 70% GHG reduction for SAF (with the potential to reach net-negative carbon intensities in some cases) under reasonable fuel production costs. The report also highlights future opportunities and gaps for further research on this technology pathway.

09 BIOMASS FUELS↗
NASA NTRS2001

Space Shuttle RTOS Bayesian Network

With shrinking budgets and the requirements to increase reliability and operational life of the existing orbiter fleet, NASA has proposed various upgrades for the Space Shuttle that are consistent with national space policy. The cockpit avionics upgrade (CAU), a high priority item, has been selected as the next major upgrade. The primary functions of cockpit avionics include flight control, guidance and navigation, communication, and orbiter landing support. Secondary functions include the provision of operational services for non-avionics systems such as data handling for the payloads and caution and warning alerts to the crew. Recently, a process to selection the optimal commercial-off-the-shelf (COTS) real-time operating system (RTOS) for the CAU was conducted by United Space Alliance (USA) Corporation, which is a joint venture between Boeing and Lockheed Martin, the prime contractor for space shuttle operations. In order to independently assess the RTOS selection, NASA has used the Bayesian network-based scoring methodology described in this paper. Our two-stage methodology addresses the issue of RTOS acceptability by incorporating functional, performance and non-functional software measures related to reliability, interoperability, certifiability, efficiency, correctness, business, legal, product history, cost and life cycle. The first stage of the methodology involves obtaining scores for the various measures using a Bayesian network. The Bayesian network incorporates the causal relationships between the various and often competing measures of interest while also assisting the inherently complex decision analysis process with its ability to reason under uncertainty. The structure and selection of prior probabilities for the network is extracted from experts in the field of real-time operating systems. Scores for the various measures are computed using Bayesian probability. In the second stage, multi-criteria trade-off analyses are performed between the scores. Using a prioritization of measures from the decision-maker, trade-offs between the scores are used to rank order the available set of RTOS candidates.

Morris, A. Terry↗
DOE OSTI2020

A near-term to net zero alternative to the social cost of carbon for setting carbon prices

The social cost of carbon (SCC) is commonly described and used as the optimal CO 2 price. However, the wide range of SCC estimates provides limited practical assistance to policymakers setting specific CO 2 prices. In this study we describe an alternate near-term to net zero (NT2NZ) approach, estimating CO 2 prices needed in the near term for consistency with a net-zero CO 2 emissions target. This approach dovetails with the emissions-target-focused approach that frames climate policy discussions around the world, avoids uncertainties in estimates of climate damages and long-term decarbonization costs, offers transparency about sensitivities and enables the consideration of CO 2 prices alongside a portfolio of policies. We estimate illustrative NT2NZ CO 2 prices for the United States; for a 2050 net-zero CO 2 emission target, prices are US $ \$34$ to US $ \$64$ per metric ton in 2025 and US $ \$77$ to US $ \$124$ in 2030. These results are most influenced by assumptions about complementary policies and oil prices.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Game theoretic modeling and optimization of competition and collaboration in dual channel electronic waste supply chains

The rapid growth of electronic waste (e-waste) presents critical challenges for sustainable resource recovery and environmental protection. This study develops a dual-channel closed-loop supply chain (CLSC) model formulated as a hierarchical Stackelberg game, that integrates dynamic pricing and cost-sharing mechanisms to optimize both economic and environmental outcomes. The model explicitly captures strategic interactions between manufacturer-led and third-party recycling channels, accounting for consumer behavior, regulatory incentives, and market competition. Numerical simulations conducted (implemented over a four-iteration horizon using a commercial optimization solver) show that, relative to the baseline equilibrium, manufacturer profit increases from 11.6 thousand USD to 37.9 thousand USD (+226.8%), total recycled volume rises from 7,848 to 7,942 units (+1.2%), and collector profit nearly doubles under cost-sharing, enabling more equitable profit distribution. Furthermore, scenario-based simulations across Sub-Saharan Africa, high-income economies, and emerging Asian industrial countries reveal that infrastructure quality, policy intensity, and labor costs critically shape recycling efficiency and profit allocation. These findings demonstrate that subsidies alone are insufficient to ensure system efficiency. Instead, coordinated strategies that integrate internal incentive alignment with context-sensitive policy support are required. Overall, this study offers a robust framework for designing resilient, efficient, and regionally adaptable e-waste management systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems [SWR-22-07]

NREL's PowerGridworld provides a modular simulation environment for training heterogenous, grid-aware, multi-agent reinforcement learning (RL) policies at scale. The package enables the user to create component gym environments that can be composed into more complex agents. For example, a grid interactive building environment can be created by composing together component environments each encapsulating the building, PV, and battery physics. These multi-component environments can then be combined into multi-agent simulation where each agent's power consumption/injection becomes an input for solving the optimal power flow on a distribution feeder modeled in OpenDSS. Information from OpenDSS, such as bus voltages and line flows, can be included in the agents' observation spaces to enable grid-aware rewards. The default API for the PowerGridworld simulator conforms to RLLib's MultiAgent API and thus enables distributed training using HPC and cloud resources.

Biagioni, David↗
DOE OSTI2020

An Optimization-Based Planning Tool for On-Demand Mobility Service Operations

Regions worldwide are adopting and exploring low-speed automated electric shuttle (AES) service as an on-demand shared mobility service in dense geofenced urban areas. Building on this concept, the National Renewable Energy Laboratory (NREL) recently developed the Automated Mobility District (AMD) toolkit. The AMD toolkit—comprising of a travel micro-simulation model and an energy estimation model—estimates the mobility and energy impacts of a given shuttle configuration within an AMD. Early-stage AMD deployments need to find optimal operational configurations that include: (a) passenger capacity of an AES, (b) time-dependent routes, and (c) fleet size (AES units) to satisfy the demand for the region. This research extends the AMD toolkit functionality by developing an optimization-based planning module that will assist in the operations of AES units. We developed a constrained mixed-integer program accounting for passenger waiting time, battery range, and passenger capacity of AES units. For scalability, we demonstrated the Tabu search-based solution technique for a real-world network—a proposed AMD deployment in Greenville, South Carolina, USA. Compared to rule-based operations, our developed solution yields higher travel time and energy savings for the network at different demand levels. The sensitivity analyses for waiting time thresholds indicate nonlinearity in the system performance, underscoring the need to meet shared-use mobility user-level expectations. The developed optimization framework can be adapted and extended to accommodate different categories of shared-use on-demand mobility services.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗
DOE OSTI2023

Hydropower Value Drivers

Conventional hydro resources generate the majority of their value by providing energy under most conditions, but the relative fraction of value generated by providing ancillary services and capacity increases with increasing penetration of resources with zero fuel costs. Pumped storage hydropower resources generate the majority of their value by providing capacity under most conditions, but the relative fraction of value generated by providing energy increases with increasing penetration of resources with zero fuel costs. The total value of conventional hydropower generally decreases in systems with increasing penetration of resources with zero fuel costs; this is largely due to the associated decrease in average energy prices. The total value of pumped storage generally increases in systems with increasing penetration of resources with zero fuel costs, largely due to opportunities to operate in pumping mode when energy prices are low or even negative. Energy storage representation must be enhanced to ensure that models accurately capture system value streams for these resources. Current power system models have a limited ability to capture the price dynamics of ancillary services, and it is still challenging to assess the role and magnitude of ancillary service value streams in future systems. Power systems are currently in a state of rapid and dramatic evolution due to a number of different factors, including the increasing penetration of variable renewable energy (VRE) sources, such as wind and solar, and battery energy storage systems (BESS). This evolution will change the way power systems are fundamentally planned and operated. Some of these changes may be incremental, while others may be more significant, but the result will likely be parallel evolution in the definition and requirement of different grid services and therefore a subsequent shift in their relative values. This report presents a framework developed to identify such system value drivers and quantify their relative impact on several different value streams, with a specific focus on implications for conventional hydropower and pumped storage hydropower (PSH) resources. This value drivers framework (VDF) encompasses five core analytical steps: 1. Identify potential drivers and develop scenarios, 2. Execute production cost models, 3. Calibrate prices, 4. Optimize hydropower operations, and 5. Quantify value drivers.

13 HYDRO ENERGY↗