Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Regional Energy Deployment System (ReEDS) Model Documentation: Version 2018

The Regional Energy Deployment System (ReEDS) model is a capacity expansion and dispatch model for the contiguous U.S. electric power sector that relies on system-wide least cost optimization to estimate the type and location of future generation and transmission capacity.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Methodology for Exploring Water and Hydropower Operating Criteria That Simultaneously Improve Economic and Environmental Considerations

Despite the reliability and flexibility of hydropower, the operation of hydroelectric power plants may have significant impacts on the downstream river system, including its water stage, sediment transport, and water temperature, ultimately affecting the ecology. To address these challenges, there is a need to identify water scheduling patterns that improve both hydropower economics and the environment relative to current operations. This paper presents a new methodology to explore promising operational criteria/rules that can achieve such improvements. Typical environmental impact statements and relicensing processes generally perform detailed site-specific analyses of a few alternatives that focus on reservoir water release operating rules and their associated environmental impacts. In contrast, the methodology presented in this article uses a widely applicable approach that explores a much larger solution space. This large set of potential alternatives can be represented in a multidimensional space for which one axis represents the economic value and the other axis quantify individual environmental impacts (e.g., sediment transport and fish growth), and they are explored via two approaches: a Monte Carlo simulation that identifies “win–win” alternatives and a multi-objective optimization problem that identifies Pareto-optimal alternatives.

13 HYDRO ENERGY↗

Discovering mechanisms for materials microstructure optimization via reinforcement learning of a generative model

Abstract The design of materials structure for optimizing functional properties and potentially, the discovery of novel behaviors is a keystone problem in materials science. In many cases microstructural models underpinning materials functionality are available and well understood. However, optimization of average properties via microstructural engineering often leads to combinatorically intractable problems. Here, we explore the use of the reinforcement learning (RL) for microstructure optimization targeting the discovery of the physical mechanisms behind enhanced functionalities. We illustrate that RL can provide insights into the mechanisms driving properties of interest in a 2D discrete Landau ferroelectrics simulator. Intriguingly, we find that non-trivial phenomena emerge if the rewards are assigned to favor physically impossible tasks, which we illustrate through rewarding RL agents to rotate polarization vectors to energetically unfavorable positions. We further find that strategies to induce polarization curl can be non-intuitive, based on analysis of learned agent policies. This study suggests that RL is a promising machine learning method for material design optimization tasks, and for better understanding the dynamics of microstructural simulations.

36 MATERIALS SCIENCE↗

Cooperative fault management for resilient integration of renewable energy

Cooperative fault management (CFM) is designed herein to control different types of renewable energy resources cooperatively during electrical faults. This paper studies systems with a high penetration of photovoltaic (PV) energy and wind energy. First, CFM leverages power converters of PV farms to boost the ride-through capability of nearby doubly-fed induction generators (DFIGs). By controlling PV farms’ output voltages to change smoothly during both fault initiation and fault clearance, the widely used crowbar in DFIGs is less likely to be activated. Crowbar activation adversely makes DFIGs lose controllability and absorb reactive power. The second contribution is the development of a software-defined CFM controller and a controller in-the-loop demonstration of the real-time performance of this optimization-based CFM. CFM capitalizes on distributed optimization formulation to enable flexibility, plug-and-play, and privacy-preserving. Computation time, however, is a major concern for optimization-based dynamics control. Here, real-time controller-in-the-loop simulation results show optimization-based CFM can output reference values around 60 ms and is quick enough for dynamic control.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Transportation Hub Infrastructure Expansion: Decision Support Under Uncertainty

The Athena project (www.athena-mobility.org) has worked to investigate the relationship between the Dallas-Fort Worth Airport (DFW) and the greater Dallas area in order to better understand and therefore better inform future decision-making regarding the critical infrastructure that influence mobility between the airport and the city. Through this work, infrastructure related to curbside pickup and drop-off, parking, public transit, and the road network congestion were identified as critical to the operation of the DFW transportation hub. The infrastructure analysis and expansion aspect of the Athena project is focused on the restructuring of the CTA curb as a hierarchical curb and the building or repurposing of parking infrastructure as the interplay between these two areas. Many sources of uncertainty exist that may impact future airport and transportation hub operations, such as passenger volume growth, population demographic changes over time, electric vehicle (EV) adoption rates, and autonomous vehicle (AV) adoption rates. Due to these sources of uncertainty, we have selected for our research a modeling framework that can capture various types of uncertainty and hedge against those uncertainties in the optimization process. We analyze road network and curb congestion, the rise of transportation networking companies, trends in parking usage, existing policies around this infrastructure, airport revenue streams, and other contributing factors to enable infrastructure decision making with less uncertainty. To accomplish this wholistic analysis, we have developed a novel multi-stage, multi-period stochastic optimization model which considers the airport's decisions from 2025-2045 under different possible future macro trajectories and day-to-day variations in operational conditions captured as "annual representation of operations" scenarios with respective probabilities. This model has also been designed to leverage the outputs of various efforts under the Athena project to create a combined decision framework for infrastructure decisions. These various efforts include the route optimization model, the ASPIRES simulation, the mode choice model, and the SUMO traffic simulation. Our computational experiments of this system at scale have resulted in a working version of our infrastructure model which enables the explicit representation and consideration of various sources of uncertainty in the decision process to enable robust, flexible decision-making. This model has been effectively run on NREL's HPC system, Eagle, with large numbers of stochastic scenarios and shows promise as a scalable tool for robust consideration of uncertainties in airport planning. We have tested our model using 30,240 operational circumstances in total, resulting in a problem with more 200 million variables. This model was solved in several different configurations, and a workflow to simulate the performance of the infrastructure model results was developed and deployed. In general, our results indicate that a combination of remote parking, remote curb infrastructure, and dynamic pricing can generate revenue, reduce emissions, accommodate emerging technologies such as AVs and EVs, and manage airport passenger growth over time. We note the success of the proposed strategy depends on the data collection and forecasting abilities of DFW. We have also seen that the AV adoption by TNCs might necessitate larger amounts of remote curb. The results of this work inform strategies for airport infrastructure decision making, as well as demonstrate the value of an adaptable model, but also indicate that there are avenues remaining where further research would be of value.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Cross Cutting Structural Design for Exploration Systems

The challenge of our new National Space Policy and NASA's Vision for Space Exploration (VSE) is keyed to the development of more effective space access and transportation systems. Optimizing in-space systems through innovative cross cutting structural designs that reduce mass, combine functional requirements and improve performance can significantly advance spacecraft designs to meet the ever growing demands of our new National Space Policy. Dependence on limited structural designs is no longer an option. We must create robust materials, forms, function and evolvable systems. We must advance national policy objectives in the design, development, test and operation of multi-billion dollar new generation crew capsules by enabling them to evolve in meeting the requirements of long duration missions to the moon and mars. This paper discusses several current issues and major design drivers for consideration in structural design of advanced spacecraft systems. Approaches to addressing these multifunctional requirements is presented as well as a discussion on utilizing Functional Analysis System Technique (FAST) in developing cross cutting structural designs for future spacecraft. It will be shown how easy it is to deploy such techniques in any conceptual architecture definition or ongoing preliminary design. As experts in merging mission, safety and life support requirements of the frail human existence into robust vehicle and habitat design, we will conquer the final frontier, harness new resources and develop life giving technologies for mankind through more innovative designs. The rocket equation tells us that a reduction in mass optimizes our propulsive results. Primary and secondary structural elements provide for the containment of gases, fluids and solids; translate and sustain loads/impacts; conduct/radiate thermal energy; shield from the harmful effects of radiation; provide for grounding/bonding of electrical power systems; compartmentalize operational functions; and provide physical interface with multiple systems. How can we redefine, combine, substitute, rearrange and otherwise modify our structural systems to reduce mass? New technologies will be needed to fill knowledge gaps and propagate new design methods. Such an integrated process is paramount in maintaining U.S. leadership and in executing our national policy goals. The cross cutting process can take many forms, but all forms will have a positive affect on the demanding design environment through initial radical thinking. The author will illustrate such cross cutting results achievable through a formal process called FAST. The FAST example will be used to show how a multifunctional structural system concept for long duration spacecraft might be generated.

Semmes, Edmund B.↗

REopt Lite Web Tool

NREL developed a free, publicly available web version of the REopt (TM) renewable energy integration and optimization platform called REopt Lite. REopt Lite recommends the optimal size and dispatch strategy for grid-connected photovoltaics (PV) and battery storage at a site. It also allows users to explore how PV and storage can increase a site's resiliency during a grid outage.

24 POWER TRANSMISSION AND DISTRIBUTION↗

How to support EV adoption: Tradeoffs between charging infrastructure investments and vehicle subsidies in California

Supporting the adoption of zero-emission vehicle (ZEVs), including plug-in electric vehicles (EVs), has become a priority for governments due to their ability to reduce petroleum demand, improve air quality, and reduce carbon dioxide (CO2) emissions. Optimal strategies to accelerate EV adoption must weigh the relative value of alternative policy mechanisms to consumers, including public charging infrastructure and vehicle purchase subsidies. We use a historically validated light-duty vehicle consumer choice tool, the ADOPT model, to simulate personal light-duty vehicle adoption and related emissions in California. ADOPT is updated to incorporate a quantification of the tangible value of public charging infrastructure, allowing us to simulate the impact of investments in public charging infrastructure and vehicle purchase subsidies under different scenarios. We show that both policies result in increased EV adoption, with the most effective policy varying depending on vehicle technology assumptions. Under conservative technology improvement assumptions, infrastructure investments are most effective in promoting EV sales and reducing CO2 emissions, while under optimistic technology improvement assumptions a combination of infrastructure and subsidies best supports EV sales and CO2 emission reductions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

State Models to Incentivize and Streamline Small Hydropower Development

In 2016, the hydropower fleet in the United States produced more than 6 percent (approximately 265,829 gigawatt-hours [GWh]) of the total net electricity generation. The median-size hydroelectric facility in the United States is 1.6 MW and 75 percent of total facilities have a nameplate capacity of 10 MW or less. Moreover, the U.S. Department of Energy's Hydropower Vision study identified approximately 79 GW hydroelectric potential beyond what is already developed. Much of the potential identified is at low-impact new stream-reaches, existing conduits, and non-powered dams with a median project size of 10 MW or less. To optimize the potential and value of small hydropower development, state governments are crafting policies that provide financial assistance and expedite state and federal review processes for small hydroelectric projects. This report analyzes state-led initiatives and programs that incentivize and streamline small hydroelectric development.

13 HYDRO ENERGY↗

Agrivoltaics: Unlocking the Potential of Dual Land Use

This tutorial will delve into the practical and technical considerations for agrivoltaic systems, including crop selection, agricultural practices, and solar energy optimization. Leveraging insights from successful case studies, we'll address challenges such as policy barriers and regulatory gaps while exploring opportunities and incentives for implementation. With a focus on PV expertise, attendees will gain actionable knowledge on designing and evaluating dual-use systems that balance energy generation with agricultural productivity.

14 SOLAR ENERGY↗

Large scale nonlinear numerical optimal control for finite element models of flexible structures

This paper discusses the development of large scale numerical optimal control algorithms for nonlinear systems and their application to finite element models of structures. This work is based on our expansion of the optimal control algorithm (DDP) in the following steps: improvement of convergence for initial policies in non-convex regions, development of a numerically accurate penalty function method approach for constrained DDP problems, and parallel processing on supercomputers. The expanded constrained DDP algorithm was applied to the control of a four-bay, two dimensional truss with 12 soft members, which generates geometric nonlinearities. Using an explicit finite element model to describe the structural system requires 32 state variables and 10,000 time steps. Our numerical results indicate that for constrained or unconstrained structural problems with nonlinear dynamics, the results obtained by our expanded constrained DDP are significantly better than those obtained using linear-quadratic feedback control.

Shoemaker, Christine A.↗

Product Lifecycle Management and the Quest for Sustainable Space Exploration Solutions

Product Lifecycle Management (PLM) is an outcome of lean thinking to eliminate waste and increase productivity. PLM is inextricably tied to the systems engineering business philosophy, coupled with a methodology by which personnel, processes and practices, and information technology combine to form an architecture platform for product design, development, manufacturing, operations, and decommissioning. In this model, which is being implemented by the Marshall Space Flight Center (MSFC) Engineering Directorate, total lifecycle costs are important variables for critical decision-making. With the ultimate goal to deliver quality products that meet or exceed requirements on time and within budget, PLM is a powerful concept to shape everything from engineering trade studies and testing goals, to integrated vehicle operations and retirement scenarios. This briefing will demonstrate how the MSFC Engineering Directorate is implementing PLM as part of an overall strategy to deliver safe, reliable, and affordable space exploration solutions and how that strategy aligns with the Agency and Center systems engineering policies and processes. Sustainable space exploration solutions demand that all lifecycle phases be optimized, and engineering the next generation space transportation system requires a paradigm shift such that digital tools and knowledge management, which are central elements of PLM, are used consistently to maximum effect. Adopting PLM, which has been used by the aerospace and automotive industry for many years, for spacecraft applications provides a foundation for strong, disciplined systems engineering and accountable return on investment. PLM enables better solutions using fewer resources by making lifecycle considerations in an integrative decision-making process.

Caruso, Pamela W.↗

Controlling Tensegrity Robots through Evolution using Friction based Actuation

Traditional robotic structures have limitations in planetary exploration as their rigid structural joints are prone to damage in new and rough terrains. In contrast, robots based on tensegrity structures, composed of rods and tensile cables, offer a highly robust, lightweight, and energy efficient solution over traditional robots. In addition tensegrity robots can be highly configurable by rearranging their topology of rods, cables and motors. However, these highly configurable tensegrity robots pose a significant challenge for locomotion due to their complexity. This study investigates a control pattern for successful locomotion in tensegrity robots through an evolutionary algorithm. A twelve-rod hardware model is rapidly prototyped to utilize a new actuation method based on friction. A web-based physics simulation is created to model the twelve-rod tensegrity ball structure. Square-waves are used as control policies for the actuators of the tensegrity structure. Monte Carlo trials are run to find the most successful number of amplitudes for the square-wave control policy. From the results, an evolutionary algorithm is implemented to find the most optimized solution for locomotion of the twelve-rod tensegrity structure. The software pattern coupled with the new friction based actuation method can serve as the basis for highly efficient tensegrity robots in space exploration.

Tensegrit↗

A Vision for Co-optimized T&D System Interaction with Renewables and Demand Response

The evolution of the power system to the reliable, effi- cient and sustainable system of the future will involve development of both demand- and supply-side technology and operations. The use of demand response to counterbalance the intermittency of re- newable generation brings the consumer into the spotlight. Though individual consumers are interconnected at the low-voltage distri- bution system, these resources are typically modeled as variables at the transmission network level. In this paper, a vision for co- optimized interaction of distribution systems, or microgrids, with the high-voltage transmission system is described. In this frame- work, microgrids encompass consumers, distributed renewables and storage. The energy management system of the microgrid can also sell (buy) excess (necessary) energy from the transmission system. Preliminary work explores price mechanisms to manage the microgrid and its interactions with the transmission system. Wholesale market operations are addressed through the devel- opment of scalable stochastic optimization methods that provide the ability to co-optimize interactions between the transmission and distribution systems. Modeling challenges of the co-optimization are addressed via solution methods for large-scale stochastic op- timization, including decomposition and stochastic dual dynamic programming.

14 SOLAR ENERGY↗

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure --- this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗

SPATIAL GRAPH ATTENTION AND CURIOSITY-DRIVEN POLICY FOR ANTIVIRAL DRUG DISCOVERY

We developed Distilled Graph Attention Policy Network (DGAPN), a reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention (sGAT) mechanism that leverages self-attention over both node and edge attributes as well as encoding the spatial structure - this capability is of considerable interest in synthetic biology and drug discovery. An attentional policy network is introduced to learn the decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with stability. Exploration is driven by the stochasticity of the action space design and the innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while reducing the complexity of paths to chemical synthesis.

Wu, Y↗

Assessing uncertainty in the timing of energy use during cost-optimal distributed energy technology selection and sizing

This paper empirically derives uncertainty ranges in cost-optimal solar PV and storage sizing by comparing results from the REopt Lite optimization platform from metered data and a set of simulated Department of Energy Commercial Reference Building (CRB) profiles at 65 sites. We find load profile shape alone does not explain a site’s optimal configurations (i.e., PV, Storage, PV and Storage, No System). Still, load profile shape does introduce uncertainty to optimal PV and storage capacities. Across all cases where PV is part of an optimal configuration, we find the average ratio of power capacities derived from metered loads to capacities derived from CRB profiles to be 0.97 (and as high as 1463), where 1 would be a perfect match in system size. For storage, the ratio is 1.6 (and as high as 42). We also assess how, in the absence of complete metered data, a CRB profile can be selected that would be expected to yield the most similar solar PV and storage capacities. From those metrics that can be available from billing data (i.e., peak demand, monthly load totals), we find that uncertainty is most reduced by selecting the CRB’s with an annual peak occurring at the most similar time, or those with the lowest average root mean square error (RMSE) among monthly peak loads. This research can help improve the implementation and interpretation of results derived from simulated load profiles and is an important next step in advancing smart grid solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

National Community Solar Partnership Multifamily Affordable Housing Portfolio Screening Approach

Community solar offers multiple benefits to providers and residents of multifamily affordable housing (MFAH), including access to affordable renewable energy for low- and moderate-income households, tax credits and other financial benefits for property owners, and increased community resilience when paired with energy storage. Even so, MFAH providers interested in realizing these benefits may need support to identify where to start or how to expand and accelerate solar deployment across their property portfolios once they have completed their first few installations. This fact sheet describes a portfolio screening approach for MFAH providers to evaluate their multi-state building portfolios for community solar project viability. The approach was developed by the National Renewable Energy Laboratory as part of its support for the National Community Solar Partnership (NCSP) MFAH Collaborative. By utilizing NREL's companion Policy Screening Workbook in conjunction with the web-based tools PVWatts® Calculator and REopt™ (Renewable Energy Integration and Optimization), MFAH providers can take a data-informed approach to identifying and prioritizing buildings in their portfolios that are most amenable to community solar development.

community solar↗