Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Investigating a Renewable-Resource-Targeting Mobile Aquaculture System Using Route Optimization Based on Optimal Foraging Theory

Aquaculture systems require careful consideration of location, which determines water conditions, pollution impacts, and hazardous conditions. Mobility may be able to address these factors while also supporting the targeting of renewable energy sources such as wind, wave, and solar power throughout the year. In this paper, a purpose-built mobile aquaculture ship is identified and modeled with a combination of renewable energy harvesting capabilities as a case study with the objective of assessing the potential benefits of targeting high renewable energy potentials to power aquaculture operations. A route optimization algorithm is created and tuned to simulate the mobility of the aquaculture platform and cost-basis comparisons are made to a stationary system. The small spatial variability in renewable energy potential when combining multiple resources significantly limits the benefits of a mobile, renewable-targeting aquaculture system. On the other hand, the consistent energy harvest from a blend of renewable energy types (13 kW installed wind capacity, 661 m 2 installed solar, and 1 m characteristic width wave-energy converter) suggests that the potential benefits of a mobile platform for offshore aquaculture (mitigation of environmental and social concerns, any potential positive impact on yields, hazard avoidance, etc.) can likely be pursued without significant increases in energy harvester costs.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Operations Optimization of Nuclear Hybrid Energy Systems

We proposed a plan for nuclear hybrid energy systems (NHES) as an effective element to incorporate high penetration of clean energy. Our paper focuses on the operations optimization of two specific NHES configurations to address the variability raised from various markets and renewable generation. Both analytical and numerical approaches are used to obtain the optimization solutions. Furthermore, key economic figures of merit are evaluated under optimized and constant operations to demonstrate the benefit of the optimization, which also suggests the economic viability of considered NHES under proposed operations optimizer. Furthermore, sensitivity analysis on commodity price is conducted for better understanding of considered NHES.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Integration of Experimental Hydroprocessing and FCC Data with Process (Aspen Plus) and Refinery Optimization (Aspen PIMS) Models

NREL's Economic, Sustainability, and Market Analysis (ESMA) team develops process models in Aspen Plus to support techno-economic analysis (TEA) and life-cycle assessment (LCA) of conversion pathways from renewable and circular resources to fuels and chemicals. These tools are being applied to assess probable operational constraints or bottlenecks associated with refinery co-processing and repurposing opportunities. The team also utilizes optimizable refinery models to quantify opportunities for biofuel and bioproduct pathways through integration with existing refining infrastructure. The goals of analysis are to model the transition of refineries to renewable and circular feedstocks and quantify the costs production and CO2 abatement through utilization of existing refineries. At the core of the ESMA team's work is the process data derived from conversion experiments on hydroprocessing and fluid catalytic cracking performed at NREL. The objective of this presentation is to highlight new analysis approaches and capabilities in pathway analysis and refinery optimization modeling with specific emphasis on integration of experimental data.

BIOMASS FUELS,ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17-18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2015

CO₂ emission mitigation and fossil fuel markets: Dynamic and international aspects of climate policies

This paper explores a multi-model scenario ensemble to assess the impacts of idealized and non-idealized climate change stabilization policies on fossil fuel markets. Under idealized conditions climate policies significantly reduce coal use in the short- and long-term. Reductions in oil and gas use are much smaller, particularly until 2030, but revenues decrease much more because oil and gas prices are higher than coal prices. A first deviation from optimal transition pathways is delayed action that relaxes global emission targets until 2030 in accordance with the Copenhagen pledges. Fossil fuel markets revert back to the no-policy case: though coal use increases strongest, revenue gains are higher for oil and gas. To balance the carbon budget over the 21st century, the long-term reallocation of fossil fuels is significantly larger—twice and more—than the short-term distortion. This amplifying effect results from coal lock-in and inter-fuel substitution effects to balance the full-century carbon budget. The second deviation from the optimal transition pathway relaxes the global participation assumption. The result here is less clear-cut across models, as we find carbon leakage effects ranging from positive to negative because trade and substitution patterns of coal, oil, and gas differ across models. In summary, distortions of fossil fuel markets resulting from relaxed short-term global emission targets are more important and less uncertain than the issue of carbon leakage from early mover action.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Macro Analysis to Estimate Electric Vehicles Fast-Charging Infrastructure Requirements in Small Urban Areas

Electric vehicles (EVs) are known to reduce emissions and fossil fuel dependency. However, the limited range, long charging time, and inadequate charging infrastructure have hampered the adoption of EVs. The current EV charging infrastructure planning studies and tools require detailed information, extensive resources, and skills that can be a significant barrier to urban areas for finding the required charging infrastructure to support a targeted EV market share. This study generates regression models to estimate the number of direct current fast charging stations and the chargers to support the EV charging demand for urban areas. These models provide macro-level estimates of the required infrastructure investment in urban areas, which can be easily implemented by policy-makers and city planners. This study incorporates data obtained from applying a disaggregate optimization-based charger placement model, developed recently by the same authors, for multiple case studies to generate the required data to calibrate the macro-level models, in the state of Michigan. This simulated data set includes the number of charging stations and chargers for each market share, technology advancement scenario, and the transportation network topology. The results show that the number of charging stations reduces with battery size and charging power and increases with EV market share and the road network lane length. The number of chargers reduces with charging power, whereas it increases with battery size, EV market share, and vehicle miles traveled in the system. The model developed here can be applied to any state having urban characteristics and weather conditions similar to Michigan.

Engineering↗
NASA NTRS1987

Task allocation among multiple intelligent robots

Researchers describe the design of a decentralized mechanism for allocating assembly tasks in a multiple robot assembly workstation. Currently, the approach focuses on distributed allocation to explore its feasibility and its potential for adaptability to changing circumstances, rather than for optimizing throughput. Individual greedy robots make their own local allocation decisions using both dynamic allocation policies which propagate through a network of allocation goals, and local static and dynamic constraints describing which robots are elibible for which assembly tasks. Global coherence is achieved by proper weighting of allocation pressures propagating through the assembly plan. Deadlock avoidance and synchronization is achieved using periodic reassessments of local allocation decisions, ageing of allocation goals, and short-term allocation locks on goals.

Gasser, L.↗
NASA NTRS2005

Planning with Continuous Resources in Stochastic Domains

We consider the problem of optimal planning in stochastic domains with metric resource constraints. Our goal is to generate a policy whose expected sum of rewards is maximized for a given initial state. We consider a general formulation motivated by our application domain--planetary exploration--in which the choice of an action at each step may depend on the current resource levels. We adapt the forward search algorithm AO* to handle our continuous state space efficiently.

Mausam, Mausau↗
NASA NTRSDate not supplied

Fe3 Traffic Simulator Overview

NASA Ames developed a first of its kind air traffic simulation tool known as Flexible engine for Fast time evaluation of Flight environments (Fe3). The patent-pending technology is a robust simulation tool that provides the capability of statistically analyzing the high-density and low-altitude traffic system. With this capability, stakeholders can study the impacts of critical components (such as wind, surveillance, communication, collision, avoidance, traffic rules, energy consumption, etc.) in the low-altitude high-density traffic system, gain insights and help define requirements, policies, and protocols for a safe and efficient traffic system, and assess operational risks and optimize fight schedules.

Flexible engine for Fast time evaluation of Flight↗
DOE OSTI2021

Distribution Market-Clearing and Pricing Considering Coordination of DSOs and ISO: An EPEC Approach

Distribution-level electricity market provides a platform for trading energy and grid services from large-amount of small-scale distributed energy resources (DERs) located on distribution grids. The behavior of the DERs in the distribution electricity market may ultimately impact the market-clearing and locational marginal prices (LMPs) in the wholesale market. This paper proposes a bi-level optimization model for distribution market clearing and distribution locational marginal pricing (DLMP) considering the interactions between distribution and transmission wholesale markets. In the proposed model, the upper-level model represents the distribution system operator (DSO) market-clearing and the lower-level model represents the wholesale market-clearing by the independent system operator (ISO). The LMP at the substation will impact the DER dispatch and power demands of the DSO as well as the DLMP. In turn, the power demands of the DSO will further impact the ISO market and its LMPs. The equilibrium problem with equilibrium constraints (EPEC) approach is applied to find the equilibria of multiple DSOs and the ISO. The EPEC problem is transformed into a single-level mixed-integer convex problem in order to allow for efficient solving. Finally, the effectiveness of the proposed model and solution method are demonstrated through case studies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2018

US alternative jet fuel deployment scenario analyses identifying key drivers and geospatial patterns for the first billion gallons ,

The aviation sector's commitments to carbon-neutral growth in international aviation starting in 2020, and the desire to improve supply surety, price stability, and the environmental performance of aviation fuels, have led to broad interest in sustainable alternative jet fuels. Here, we use the system-dynamics-based biomass scenario model (BSM), focused on alternative jet fuel production capacity evolution, and the geospatially explicit Freight and Fuel Transportation Optimization Tool (FTOT), focused on optimal feedstock and fuel flows over the transportation system, to explore the incentive effects on alternative jet fuel production capacity trajectories and potential geospatial patterns of production and delivery in the USA. Scenarios presented here focus on readily available waste feedstocks (waste fats, oils and greases, municipal solid waste, and crop and forestry residues) and conversion technologies included in the ASTM D7566 synthesized aviation turbine fuels specification. The BSM modeling of possible deployment trajectories from 2015 to 2045 suggests that up to 8 billion gallons may be available by 2045 depending on the policies and incentives implemented. Both approaches suggest that 200 million to 1 billion gallons per year of alternative jet fuel production are possible in 2030 given multiple incentives and a favorable investment climate, and that capital costs and technology maturation rates will affect deployment of different fuel production technologies, and therefore the feedstocks needed. Further collaboration on these modeling approaches would reduce methodological blind spots while providing insights into future industry trajectories.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Dispatch Optimization, System Design and Cost Benefit Analysis of a Nuclear Reactor with Molten Salt Thermal Storage

Variable renewable energy availability has increased the volatility in energy prices in most markets. Nuclear power plants, with a large ratio of capital to variable costs, have historically operated as base load energy suppliers but the need for more flexible operation is increasing. We simulate the techno-economic performance of a 950 MWt nuclear power plant, based on the Westinghouse lead-cooled fast reactor, coupled with molten salt thermal storage as a method for flexible energy dispatch. We use the System Advisor Model to model the nuclear reactor thermal power input and power cycle operating modes. We combine this robust engineering model with a mixed-integer linear program model for optimized dispatch scheduling. We then simulate the coupled nuclear and thermal storage system under different market scenarios with varying price volatility. We find that the coupled plant outperforms the base plant under markets where energy price peaks fluctuate by a factor of two or more about the mean price. We show that a calculated power purchase agreement price for the plant improves by up to 10% when operating under California energy market conditions. Sensitivity analysis on the thermal storage cost shows that the optimal design remains unchanged even when doubling costs.

25 ENERGY STORAGE↗
DOE OSTI2023

Exploiting electricity market dynamics using flexible electrolysis units for retrofitting methanol synthesis

Here we investigate the economic viability of integrating flexible electrolysis units to produce hydrogen in methanol synthesis processes. Specifically, we investigate whether this approach can help reduce methanol production costs by strategically exploiting dynamics of electricity markets. Our study integrates high-fidelity process simulations, optimization tools, and microkinetic modeling (informed by density functional theory) to conduct detailed techno-economic analyses and to compare performance against traditional processes that use hydrogen produced via steam-methane reforming (SMR). We also use this approach to estimate the levelized cost of hydrogen (LCOH) as a function of time-varying electricity prices (from day-ahead and real-time prices) and of key techno-economic parameters. Our results show that the proposed electrification framework is cost-competitive under certain electricity market conditions. Specifically, we find that, when the electrolysis system is operated in flexible mode (and can respond to dynamics of electricity markets), the associated electricity cost nearly collapses to zero. Conversely, when the unit is not flexible (and cannot respond to markets), the electricity cost comprises 60% of the total cost. Our results also reveal that the LCOH of the flexible electrolysis system participating in real-time electricity markets is 31% lower than the LCOH obtained from SMR. Overall, this indicates that exploiting the dynamics of electricity markets can make hydrogen production cost-competitive and this can lead to viable alternatives to electrify methanol production and other hydrogen-based processes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Research and Development Opportunities for Technologies to Influence Water Consumption Behavior

In April 2015, Argonne National Laboratory hosted a two-day workshop that convened water experts and stakeholders from across industry, government, and academia to undertake three primary tasks: 1) identify technology characteristics that are favorable for motivating behavioral change, 2) identify barriers that have prevented the development and market adoption of technologies with these characteristics in the water sector, and 3) identify concrete research and development pathways that could be undertaken to overcome these barriers, increase the penetration of technologies that influence water consumption behavior, and ultimately reduce domestic water consumption. While efforts to reduce water consumption have gained momentum in recent years, there are a number of key barriers that have limited the effectiveness of such efforts. Chief among these is the fact that many consumers have limited awareness of their water consumption patterns because of poor data availability, and/or are unmotivated to reduce their consumption because of low costs and split incentives. Without improved data availability and stronger price signals, it will be difficult to effect true transformative behavioral change. This report also reviews a number of technology characteristics that have successfully motivated behavioral change in other sectors, as well as several technologies that could be developed specifically for the water sector. Workshop participants discussed how technologies that provide active feedback and promote measurable goals and social accountability have successfully influenced changes in other types of behavior. A range of regulatory and policy actions that could be implemented to support such efforts are also presented. These include institutional aggregation, revenue decoupling, and price structure reforms. Finally, several R&D pathways were proposed, including efforts to identify optimal communication strategies and to better understand consumer perceptions and psychology as they relate to human behavior regarding water consumption. The findings presented here can help to inform policy makers as they develop new policies and seek to support new research to help consumers use water more efficiently. It is our hope that these findings will also be utilized to prioritize topics for additional follow-up workshops to address individual issues and barriers more directly and in more detail. The goal of such future workshops will be to develop specific solutions, research plans, and technology development pathways that can be undertaken to increase the market penetration of technologies that effect behavioral change and reduce water consumption.

42 ENGINEERING↗
DOE OSTI2022

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗
DOE OSTI2021

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. Here, the framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗
DOE OSTI2017

Optimizing Storage and Renewable Energy Systems with REopt

Under the right conditions, behind the meter (BTM) storage combined with renewable energy (RE) technologies can provide both cost savings and resiliency. Storage economics depend not only on technology costs and avoided utility rates, but also on how the technology is operated. REopt, a model developed at NREL, can be used to determine the optimal size and dispatch strategy for BTM or off-grid applications. This poster gives an overview of three applications of REopt: Optimizing BTM Storage and RE to Extend Probability of Surviving Outage, Optimizing Off-Grid Energy System Operation, and Optimizing Residential BTM Solar 'Plus'.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

What Can We Learn from US National Transmission Studies?

Multiple US regions have announced new electricity transmission plans, are actively revisiting the future role of transmission, and could benefit from findings from recent national-scale transmission studies. A review of seven national studies shows that significant transmission expansion is cost-optimal for serving new demand, integrating additional resources, and supporting grid reliability. A majority of the reviewed scenarios, which span a range of policy and technology assumptions, include at least a doubling of the transmission system by 2050. The national studies find substantial net system cost savings from transmission expansion and high benefit-cost ratios for transmission investments. The results are derived through multi-value, nationally coordinated, co-optimized, multi-scenario modeling, which is an approach that could yield lower-cost pathways compared to current industry planning practices.

24 POWER TRANSMISSION AND DISTRIBUTION↗