Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

REopt: A Platform for Energy System Integration and Optimization

REopt is a techno-economic decision support model used to optimize energy systems for buildings, campuses, communities, and microgrids. The primary application of the model is for optimizing the integration and operation of behind-the-meter energy assets. This report provides an overview of the model, including its capabilities and typical applications; inputs and outputs; economic calculations; technology descriptions; and model parameters, variables, and equations. The model is highly flexible, and is continually evolving to meet the needs of each analysis. Therefore, this report is not an exhaustive description of all capabilities, but rather a summary of the core components of the model.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2017

Robust planning of dynamic wireless charging infrastructure for battery electric buses

Battery electric buses with zero tailpipe emissions have great potential in improving environmental sustainability and livability of urban areas. However, the problems of high cost and limited range associated with on-board batteries have substantially limited the popularity of battery electric buses. The technology of dynamic wireless power transfer (DWPT), which provides bus operators with the ability to charge buses while in motion, may be able to effectively alleviate the drawbacks of electric buses. In this paper, we address the problem of simultaneously selecting the optimal location of the DWPT facilities and designing the optimal battery sizes of electric buses for a DWPT electric bus system. The problem is first constructed as a deterministic model in which the uncertainty of energy consumption and travel time of electric buses is neglected. The methodology of robust optimization (RO) is then adopted to address the uncertainty of energy consumption and travel time. The affinely adjustable robust counterpart (AARC) of the deterministic model is developed, and its equivalent tractable mathematical programming is derived. Both the deterministic model and the robust model are demonstrated with a real-world bus system. The results of our study demonstrate that the proposed deterministic model can effectively determine the allocation of DWPT facilities and the battery sizes of electric buses for a DWPT electric bus system; and the robust model can further provide optimal designs that are robust against the uncertainty of energy consumption and travel time for electric buses.

25 ENERGY STORAGE↗
DOE OSTI2022

Optimizing process-based models to predict current and future soil organic carbon stocks at high-resolution

From hillslope to small catchment scales (< 50 km 2 ), soil carbon management and mitigation policies rely on estimates and projections of soil organic carbon (SOC) stocks. Here we apply a process-based modeling approach that parameterizes the MIcrobial-MIneral Carbon Stabilization (MIMICS) model with SOC measurements and remotely sensed environmental data from the Reynolds Creek Experimental Watershed in SW Idaho, USA. Calibrating model parameters reduced error between simulated and observed SOC stocks by 25%, relative to the initial parameter estimates and better captured local gradients in climate and productivity. The calibrated parameter ensemble was used to produce spatially continuous, high-resolution (10 m 2 ) estimates of stocks and associated uncertainties of litter, microbial biomass, particulate, and protected SOC pools across the complex landscape. Here, subsequent projections of SOC response to idealized environmental disturbances illustrate the spatial complexity of potential SOC vulnerabilities across the watershed. Parametric uncertainty generated physicochemically protected soil C stocks that varied by a mean factor of 4.4 × across individual locations in the watershed and a – 14.9 to + 20.4% range in potential SOC stock response to idealized disturbances, illustrating the need for additional measurements of soil carbon fractions and their turnover time to improve confidence in the MIMICS simulations of SOC dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

New Tool Evaluates the Financial Viability of Pumped Storage Hydropower

The rapidly evolving electricity system with increasing variable renewable energy (VRE) resources provides both opportunities and challenges for the power sector. With the significant ramps and intermittency associated with VRE resources, the requirements and need for additional flexible resources increase. Pumped storage hydropower (PSH) provides flexibility to the electricity grid to replace fossil fuel plants, which are responsible for 25% of U.S. emissions. PSH projects support various aspects of power system operations, including flexibility, ramping capability, energy, ancillary service, black start, and others. The significant potential of hydropower requires understanding the different value drivers to the electricity system specific to the location of a project and then optimizing the plant for the different system values. Thus, determining the value of PSH projects and their many services and contributions to the electricity system can be a challenge for potential developers, system owners, regulators, policy makers, and consultants.

13 HYDRO ENERGY↗
DOE OSTI2024

Deep reinforcement learning for optimal control of induction welding process

Optimizing induction welding (IW) process parameters for the application of joining thermoplastic composites is challenging as it requires achieving complex spatiotemporal thermal characteristics along the weld-line to obtain desired weld quality. We formulate an optimal control problem which captures these requirements and seeks to optimize the IW coil speed using a fast-acting dynamic IW process model. We develop a novel Deep Reinforcement Learning (DRL) framework to solve this computationally challenging control problem and demonstrate via simulation study that the learned DRL feedback control policy results in better spatiotemporal thermal characteristics as compared to the current state-of-the-art.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Zero-Emissions Roadmap for Oakland County

This document outlines a strategic pathway for Oakland County, Michigan to achieve zero emissions by 2050 under the Clean Energy to Communities (C2C) Program. The report encompasses analyses and high-level modeling to guide Oakland County in its emission reduction goals. Key methods include establishing an emissions inventory baseline with ongoing evaluation of future projects’ emissions impacts. Core elements include decommissioning old infrastructure, enhancing energy efficiency, deploying hybrid and ground-source heat pumps, and transitioning to electric fleets. It is proposed to structure the planning process into 5-year strategic plans to make the decarbonization process manageable. The document also emphasizes the need for reassessment of goals and periodic updates to remain adaptive to technological advancements and funding considerations. A matrixed approach for evaluating projects by cost and emissions savings is suggested to optimize decision-making given finite resources.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Integrated Modeling Approach for Optimal Management of Water, Energy and Food Security Nexus

We report that water, energy and food (WEF) are inextricably interrelated. Effective planning and management of limited WEF resources to meet current and future socioeconomic demands for sustainable development is challenging. WEF production/delivery may also produce environmental impacts; as a result, green-house-gas emission control will impact WEF nexus management as well. Nexus management for WEF security necessitates integrated tools for predictive analysis that are capable of identifying the tradeoffs among various sectors, generating cost-effective planning and management strategies and policies. To address these needs, we have developed an integrated model analysis framework and tool called WEFO. WEFO provides a multi-period socioeconomic model for predicting how to satisfy WEF demands based on model inputs representing productions costs, socioeconomic demands, and environmental controls. WEFO is applied to quantitatively analyze the interrelationships and trade-offs among system components including energy supply, electricity generation, water supply-demand, food production as well as mitigation of environmental impacts. WEFO is demonstrated to solve a hypothetical nexus management problem consistent with real-world management scenarios. Model parameters are analyzed using global sensitivity analysis and their effects on total system cost are quantified. Lastly, the obtained results demonstrate how these types of analyses can be helpful for decision-makers and stakeholders to make cost-effective decisions for optimal WEF management.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2014

Robust Unit Commitment Considering Uncertain Demand Response

Although price responsive demand response has been widely accepted as playing an important role in the reliable and economic operation of power system, the real response from demand side can be highly uncertain due to limited understanding of consumers' response to pricing signals. To model the behavior of consumers, the price elasticity of demand has been explored and utilized in both research and real practice. However, the price elasticity of demand is not precisely known and may vary greatly with operating conditions and types of customers. To accommodate the uncertainty of demand response, alternative unit commitment methods robust to the uncertainty of the demand response require investigation. In this paper, a robust unit commitment model to minimize the generalized social cost is proposed for the optimal unit commitment decision taking into account uncertainty of the price elasticity of demand. By optimizing the worst case under proper robust level, the unit commitment solution of the proposed model is robust against all possible realizations of the modeled uncertain demand response. Numerical simulations on the IEEE Reliability Test System show the e ectiveness of the method. Finally, compared to unit commitment with deterministic price elasticity of demand, the proposed robust model can reduce the average Locational Marginal Prices (LMPs) as well as the price volatility.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Learning Optimal Power Flow Solutions using Linearized Models in Power Distribution Systems

Solving nonlinear optimal power flow (OPF) problem is computationally expensive, and poses scalability challenges for power distribution networks. An alternative to solving the original nonlinear OPF is the linear approximated OPF models. Although, these linear approximated OPF models are fast, the resulting solutions may result in significant optimality gap. Lately, the application of machine learning (ML) methods in successfully solving the nonlinear OPF has been reported. These methods learn and estimate the nonlinear control policies using a purely data-driven approach. In this paper, we propose an approach to complements the ML based approach to solving OPF using solutions from known linearized OPF model. Specifically, we use supervised learning to map the solutions of linear OPF to nonlinear control variables. Unlike, the traditional ML based methods for OPF that approximate the full distribution feeder model using function approximation, our approach uses a two-node approximation of radial networks. The proposed approach is validated using IEEE 123 bus test system for OPF solutions obtained using the nonlinear OPF models.

optimal power flow, power distribution systems, su↗
DOE OSTI2017

Optimizing Microgrid Energy Delivery Under High Uncertainty

One of the largest transitions in the power system today is the shift to a more sustainable and resilient power system. This is being driven by public opinion, changes in regulatory policies, and advancements in smart grid technologies. The most noticeable changes taking place is the integration of distributed energy sources (DERs); this study uses the term DER in the most general way as a resource that can be manipulated to alter energy delivery and flow in the transmission and distribution networks. Also, here it is preferred to focus on energy as the true need while power is a function of the equipment rating. As such, wind and solar, demand that can be manipulated, electric vehicles, electric energy storage, thermal storage, and storage in water system are all considered DERs. These additions to the distribution system are evolving the operation of distribution feeders into microgrids- communication, computing, and control-enabled resources that produce, transport, and utilize energy in a manner that provides cost, reliability, and resilience benefits. As this evolution progresses, the planning and operational management (scheduling and control) must explicitly include the consideration of risk. The management of system risk is currently in the purview of the utility and will likely remain so in the future. However, as each microgrid, as well as federation of microgrids, sees autonomy in order to provide maximum benefits to their constituents, they must assume responsibility to manage their internal risk. The primary scope of this study is the scheduling of resources in a distribution feeder(s) operating as microgrids. The study explores a distribution algorithm to develop the transactive schedule for the DERs, to minimize cost and risk over a time horizon, and an initial laboratory-scale to conduct implementation on distributed hardware. Results from case studies are presented that show that solutions derived by the distributed algorithm are valid. This study also discusses the continuing work on the expansion of: 1) the distributed algorithm from a deterministic to stochastic optimization formulation, and 2) implementation of the distributed algorithm into real-time simulation within the Power System laboratory at New Mexico State University (NMSU) and expanding to the Southwest Technology Development Institute located at NMSU where actual solar, energy storage, and demand response resources are installed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2014

A multi-scale spatial approach to address environmental effects of small hydropower development

Hydropower development continues to grow worldwide in developed and developing countries. While the ecological and physical responses to dam construction have been well documented, translating this information into planning for hydropower development is extremely difficult. Very few studies have conducted environmental assessments to guide site-specific or widespread hydropower development. Herein, we propose a spatial approach for estimating environmental effects of hydropower development at multiple scales, as opposed to individual site-by-site assessments (e.g., environmental impact assessment). Because the complex, process-driven effects of future hydropower development may be uncertain or, at best, limited by available information, we invested considerable effort in describing novel approaches to represent environmental concerns using spatial data and in developing the spatial footprint of hydropower infrastructure. Furthermore, we then use two case studies in the US, one at the scale of the conterminous US and another within two adjoining rivers basins, to examine how environmental concerns can be identified and related to areas of varying energy capacity. We use combinations of reserve-design planning and multi-metric ranking to visualize tradeoffs among environmental concerns and potential energy capacity. Spatial frameworks, like the one presented, are not meant to replace more in-depth environmental assessments, but to identify information gaps and measure the sustainability of multi-development scenarios as to inform policy decisions at the basin or national level. Most importantly, the approach should foster discussions among environmental scientists and stakeholders regarding solutions to optimize energy development and environmental sustainability.

13 HYDRO ENERGY↗
DOE OSTI2021

Monitoring agroecosystem productivity and phenology at a national scale: A metric assessment framework

Effective measurement of seasonal variations in the timing and amount of production is critical to managing spatially heterogeneous agroecosystems in a changing climate. Although numerous technologies for such measurements are available, their relationships to one another at a continental extent are unknown. Using data collected from across the Long-Term Agroecosystem Research (LTAR) network and other networks, we investigated correlations among key metrics representing primary production, phenology, and carbon fluxes in croplands, grazing lands, and crop-grazing integrated systems across the continental U.S. Metrics we examined included gross primary productivity (GPP) estimated from eddy covariance (EC) towers and modelled from the Landsat satellite, Landsat NDVI, and vegetation greenness (Green Chromatic Coordinate, GCC) from tower-mounted PhenoCams for 2017 and 2018. Overall, our analysis compared production dynamics estimated from three independent ground and remote platforms using data for 34 agricultural sites constituting 51 site-years of co-located time series. Pairwise sensor comparisons across all four metrics revealed stronger correlation and lower root mean square error (RMSE) between end of season (EOS) dates (Pearson R ranged from 0.6 to 0.7 and RMSE from 32.5 to 67.8) than start of season (SOS) dates (0.46 to 0.69 and 40.4 to 66.2). Overall, moderate to high correlations between SOS and EOS metrics complemented one another except at some lower productivity grazing land sites where estimating SOS can be challenging. Growing season length estimates derived from 16-day satellite GPP (179.1 days) were significantly longer than those from PhenoCam G CC (70.4 days, p adj < 0.0001) and EC GPP (79.6 days, p adj < 0.0001). Landscape heterogeneity did not explain differences in SOS and EOS estimates. Annual integrated estimates of productivity from EC GPP and PhenoCam G CC diverged from those estimated by Landsat GPP and NDVI at sites where annual production exceeds 1000 gC/m –2 yr –1 . Based on our results, we developed a “metric assessment framework” that articulates where and how metrics from satellite, eddy covariance and PhenoCams complement, diverge from, or are redundant with one another. The framework was designed to optimize instrumentation selection for monitoring, modeling, and forecasting ecosystem functioning with the ultimate goal of informing decision-making by land managers, policy-makers, and industry leaders working at multiple scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Maximization of the annual energy production of wind power plants by optimization of layout and yaw-based wake control: Maximization of wind plant AEP by optimization of layout and wake control

This paper presents a wind plant modeling and optimization tool that enables the maximization of wind plant annual energy production (AEP) using yaw-based wake steering control and layout changes. The tool is an extension of a wake engineering model describing the steady-state effects of yaw on wake velocity profiles and power productions of wind turbines in a wind plant. To make predictions of a wind plant's AEP, necessary extensions of the original wake model include coupling it with a detailed rotor model and a control policy for turbine blade pitch and rotor speed. This enables the prediction of power production with wake effects throughout a range of wind speeds. We use the tool to perform an example optimization study on a wind plant based on the Princess Amalia Wind Park. In this case study, combined optimization of layout and wake steering control increases AEP by 5%. The power gains from wake steering control are highest for region 1.5 inflow wind speeds, and they continue to be present to some extent for the above-rated inflow wind speeds. The results show that layout optimization and wake steering are complementary because significant AEP improvements can be achieved with wake steering in a wind plant layout that is already optimized to reduce wake losses.

17 WIND ENERGY↗
DOE OSTI2022

Enabling Floating Solar (FPV) Deployment: Policy and Operational Considerations

Floating solar photovoltaics, or "floating PV", offer an opportunity for scaling up the deployment of renewable energy on inland and offshore bodies of water. Floating PV presents the opportunity to: increase clean energy generation to help meet growing demand; lessen the potential for land-use conflicts; help existing hydropower systems optimize their operation; and adapt to increasing temperatures and drought events by reducing the rate of evapotranspiration of waterways. There is significant promise for floating PV deployment in several Southeast Asian countries, especially those rich in hydropower resources, such as Laos and Thailand, but deployment remains limited. This slide deck presents an overview of NREL's research on (1) the policy, economic, environmental, and cultural barriers that currently exist, (2) recently completed modeling exercise on the potential operational benefits of pairing floating PV and hydropower, (3) international best practices that can be adopted to Southeast Asia, and (4) plans for high-resolution floating PV technical potential assessment.

Asia Clean Energy Forum↗
DOE OSTI2022

Data-Driven Distribution System Coordinated PV Inverter Control Using Deep Reinforcement Learning

The deployment of distributed solar photovoltaic (PV) systems has increased consistently over the past decades. High penetrations of PVs could cause a series of adverse grid impacts, such as voltage violations. The recent development of smart inverter technologies rises the incentives of developing PV control solutions that regulate the inverter output power and seeking the optimization on system operational objectives. This paper proposes a data-driven control solution based on deep reinforcement learning (DRL) to optimize PV inverters for voltage regulation. The proposed solution can minimize PV real power curtailment while maintaining network voltage at an acceptable range. Comparison results between the proposed DRL control algorithms with deep deterministic policy gradient (DDPG) and volt-var control on a real feeder in west Colorado highlight the advantage of the proposed framework in controlling the system voltage while minimizing the PV real power curtailment.

deep reinforcement learning↗
NASA NTRS2010

Managing the Risk for Early Onset Osteoporosis in Long-Duration Astronauts Due to Spaceflight

Early Onset Osteoporosis is probably the most recognized but poorly understood long-term health risk due to spaceflight. Osteoporosis management is primarily prophylactic and clinical interventions rely upon the ability to predict fractures which is currently determined by surrogate measures of bone strength. The RMAT for Early Onset Osteoporosis identified some open issues related to the fact that long-duration astronauts compose a unique group of subjects for which clinical approaches for osteoporosis management do not apply. Long-duration astronauts are healthy, young (25 to 55 years of age), predominantly male, and physical fit relative to the typical osteoporosis patient. Moreover, during prolonged space missions (typically 6-month missions) the skeleton not only adapts to weightlessness, but is influenced by numerous risk factors induced by operational constraints, e.g., inability to maintain preflight weight-bearing and aerobic activities, sub-optimal dietary intake (e.g., high sodium content for food stability, lack of fresh fruit and vegetables), suppression of vitamin D metabolism by uv shielding, and remote medicine care. Moreover, adaptation results in novel changes to astronauts bones that cannot be detected by current medically-useful measures. Consequently, a panel of clinicians (recognized leaders and policy-makers in osteoporosis) was convened to review the dataset of bone measures and bone loss risk factors in long-duration astronauts. Driven by the queries in the RMAT, the panel was charged to determine 1) if an intervention is required to prevent this risk, 2) what type and at what time would intervention be optimal, 3) what is the clinical trigger that would require a medical response from flight surgeons and 4) how should research data be used in the clinical care of astronauts. Hence, the RMAT determined that a bone health policy need to be formulated specific for this unique cohort subjected to a novel skeletal condition

Sibonga, Jean D.↗
DOE OSTI2022

DRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing

Cluster schedulers are crucial in high-performance computing (HPC). They determine when and which user jobs should be allocated to available system resources. Existing cluster scheduling heuristics are developed by human experts based on their experience with specific HPC systems and workloads. However, the increasing complexity of computing systems and the highly dynamic nature of application workloads have placed tremendous burden on manually designed and tuned scheduling heuristics. More aggressive optimization and automation are needed for cluster scheduling in HPC. In this work, we present an automated HPC scheduling agent named DRAS (Deep Reinforcement Agent for Scheduling) by leveraging deep reinforcement learning. DRAS is built on a hierarchical neural network incorporating special HPC scheduling features such as resource reservation and backfilling. An efficient training strategy is presented to enable DRAS to rapidly learn the target environment. Once being provided a specific scheduling objective given by the system manager, DRAS automatically learns to improve its policy through interaction with the scheduling environment and dynamically adjusts its policy as workload changes. We implement DRAS into a HPC scheduling platform called CQGym. CQGym provides a common platform allowing users to flexibly evaluate DRAS and other scheduling methods such as heuristic and optimization methods. Furthermore, the experiments using CQGym with different production workloads demonstrate that DRAS outperforms the existing heuristic and optimization approaches by up to 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Extreme-scale stochastic optimization and simulation via learning-enhanced decomposition and parallelization (Final Technical Report)

Stochastic optimization and simulation models ubiquitously arise in designing and operating complex service/engineering systems. They can be extreme in scale due to high-dimensional data and decisions, and can also involve decisions made sequentially in response to newly revealed data, both causing significant computational challenge. The objective of this research is to explore a unified framework that integrates machine learning with discrete optimization and risk-averse modeling, to improve the efficiency of decomposition paradigms for stochastic optimization and simulations at extreme scale. The models we consider represent a broad class of complex decision-making problems, where 0-1 or continuous decisions are made before and/or after knowing multiple sources of uncertainties that could be correlated. We will employ machine learning methods to dynamically decide and prioritize computational procedures, including cut generation, branching, and bounding of the optimal objective. Furthermore, the research will shed new lights on the traditional decomposition algorithms for extreme-scale computing. Deliverables of the research include new modeling and computational methods for advancing the state-of-the-art research in optimization and simulation, bringing many relevant risk-averse, data-driven optimization problems in practice within the range of tractability. Examples include distributed computing server scheduling and sensor deployment for monitoring critical infrastructures. Success in this effort will enable progress in solving multiple extreme-scale problems in the complex system design and operations arising from DoE missions in energy, environment, and national security.

24 POWER TRANSMISSION AND DISTRIBUTION↗