Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

A simulation‐based integrated virtual testbed for dynamic optimization in smart manufacturing systems

Abstract In a manufacturing system, production control‐related decision‐making activities occur at different levels. At the process level, one of the main control activities is to tune the parameters of individual manufacturing equipment. At the system level, the main activity is to coordinate production resources and to route parts to appropriate workstations based on their processing requirement, priority indices, and control policy. At the factory level, the goal is to plan and schedule the processing of parts at different operations for the entire system in order to optimize certain objectives. Note that the results of such activities at different levels are closely coupled and affect the overall performance of the manufacturing system as a whole. Therefore, it is important to systematically integrate these control and optimization activities into one unified platform to ensure the goal of each individual activity is aligned with the overall performance of the system. In this paper, we develop a simulation‐based virtual testbed that implements dynamic optimization, automatic information exchange, and decision‐making from the process‐level, system‐level, and factory‐level of a manufacturing system into an integrated computation environment. This is demonstrated by connecting a Python‐based numerical computation program, discrete‐event simulation software (Simul8), and an optimization solver (CPLEX) via a third‐party master program. The application of this simulation‐based virtual testbed is illustrated by a case study in a machining shop.

Sun, Yuting↗

Optimizing dispatch for a concentrated solar power tower

Concentrating solar power (CSP) systems employ a sophisticated thermal receiver, power cycle, and a heliostat field, comprised of thousands of mirrors spread over hundreds of acres of land, and are most cost-effective with relatively large quantities of energy storage which can be scheduled for dispatch. We exercise an existing optimization model that maximizes revenue over a year-long time horizon, solved using a standard 48-h look-ahead policy at hourly fidelity on a CSP system under development in California. The system employs molten salt power tower technology with a 150 MWe (net) turbine, eight hours of thermal storage at full load, and a solar field that provides 1.75 times the rated turbine thermal power. The model considers system configuration and interoperability aspects, such as storage tank size, production capacities, and ramp rates, and determines decisions that expedite financing, permitting, and plant design. Relative to results achieved via industry practice, the existing optimization model reduces the number of power cycle (i.e., turbine) start-up events by 86.4%, thereby improving net revenue by more than 8.5% annually; this corresponds to an approximately $140 M increase in net revenue over the lifetime of the plant, taking a step towards advancing the long-term economic viability of large-scale renewable energy systems. Sensitivity analysis on uncertain parameter values provides insight regarding those values that influence profit most significantly.

14 SOLAR ENERGY↗

Spatial Optimization of Multiscale Biorefinery Deployment for a Diversified Bioeconomy in the United States

Strategic biorefinery siting is critical for a diversified bioeconomy, yet industry, policy, and research often focus on either large-scale biofuel plants or smaller-scale specialty bioproduct facilities, with limited coordination across scales. We address this gap by modeling biorefinery deployment spanning a 28-fold difference in capacity. We developed an open-source, spatially explicit framework integrating techno-economic analysis with logistics and refinery cost surrogate models to evaluate multiscale miscanthus-derived biorefineries across the rainfed U.S. for the production of ethanol, succinic acid, lactic acid, potassium sorbate, and acrylic acid. Overall costs change little as feedstock density increases, while transport distances decrease by ∼30 to 67% (∼100 km) and siting flexibility improves. Specifically, a 5-fold feedstock density increase (2% to 10% of suitable land) reduces minimum selling prices by <10% (e.g., 0.27 USD·gal –1 for ethanol). This limited economic sensitivity suggests dense planting is not required for competitive deployment, particularly for smaller-scale facilities. Representing collection areas as irregular rather than circular expands the feasible space under low-density scenarios. While large-scale refineries anchor regional supply chains, smaller facilities retain spatial flexibility even when large refineries are established. These findings highlight the importance of spatial representation and multiscale coordination for robust, regionally tailored biomanufacturing networks to advance renewable carbon integration without extensive land conversion.

biorefinery siting↗

Electric Grid Expansion Planning with High Levels of Variable Generation

Renewables are taking a large proportion of generation capacity in U.S. power grids. As their randomness has increasing influence on power system operation, it is necessary to consider their impact on system expansion planning. To this end, this project studies the generation and transmission expansion co-optimization problem of the US Eastern Interconnection (EI) power grid with a high wind power penetration rate. In this project, the generation and transmission expansion problem for the EI system is modeled as a mixed-integer programming (MIP) problem. This study analyzed a time series creation method to capture the diversity of load and wind power across balancing regions in the EI system. The obtained time series can be easily introduced into the MIP co-optimization problem and then solved robustly through available MIP solvers. Simulation results show that the proposed time series generation method and the expansion co-optimization model and can improve the expansion result significantly after considering the diversity of wind and load across EI regions. The improved expansion plan that combines generation and transmission will aid system planners and policy makers to maximize the social welfare. This study shows that modelling load and wind variations and diversities across balancing regions will produce significantly different expansion result compared with former studies. For example, if wind is modeled in more details (by increasing the number of wind output levels) so that more wind blocks are considered in expansion planning, transmission expansion will be larger and the expansion timing will be earlier. Regarding generation expansion, more wind scenarios will slightly reduce wind generation expansion in the EI system and increase the expansion of other generation such as gas. Also, adopting detailed wind scenarios will reveal that it may be uneconomic to expand transmission networks for transmitting a large amount of wind power through a long distance in the EI system. Incorporating more details of renewables in expansion planning will inevitably increase the computational burden. Therefore, high performance computing (HPC) techniques are urgently needed for power system operation and planning optimization. As a scoping study task, this project tested some preliminary parallel computation techniques such as breaking down the simulation task into several sub-tasks based on chronology splitting or sample splitting, and then assigning these sub-tasks to different cores. Testing results show significant time reduction when a simulation task is split into several sub-tasks for parallel execution.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Image-Guided Radiotherapy in Paediatrics: A Survey of International Patterns of Practice

Image-guided radiation therapy (IGRT) is widely used in the treatment of various tumour types in both adult and paediatric patients. However, there are no international guidelines on its optimal use in paediatric radiotherapy. This study proposes to evaluate the current patterns of practice regarding IGRT policy in paediatric patients compared with adult patients through an international survey.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Modeling ocean, rail, and truck transportation flows to support policy analysis

Freight transportation represents about 9.5% of GDP in the U.S., it is responsible for about 8% of greenhouse gas emissions, and supports the import and export of about 3.6 trillion in international trade. It is therefore important that the national freight transportation system is designed and operated efficiently. Hence, this paper develops a mathematical model to estimate international and domestic freight flows across ocean, rail, and truck modes, which can be used to study the impacts of changes in our infrastructure, as well as the imposition of new user fees and changes in operating policies. The model integrates a user equilibrium-based logit argument for path selection with a system optimal argument for rail network operations. This leads to the development of a unique solution procedure that is demonstrated in a large-scale analysis focused on all intercity freight and U.S export/import containerized freight. The model results are compared with the reported flow volumes. Here, the model is applied to two case studies: a disruption of the seaports of Los Angeles and Long Beach (LA and LB) similar to the impacts that would be felt in an earthquake; and implementation of new user fees at the California ports.

99 GENERAL AND MISCELLANEOUS↗

CSP Plant Optimization Study for the California Power Market (“CalCSP”) (Final Technical Report)

Concentrating Solar Power (CSP) with thermal energy storage offers a unique and strategic opportunity to support California’s clean energy transition. Unlike photovoltaic (PV) systems, CSP with thermal storage can generate electricity after sunset and during periods of high demand, making it a valuable complement to intermittent renewable resources. CSP also provides synchronous, inertia-contributing generation, long-duration storage, and flexible dispatch—capabilities increasingly important as thermal plants retire. This report summarizes the findings of the CSP Plant Optimization Study for the California Power Market or “CalCSP study,” which evaluated the technical, economic, environmental, and policy factors that influence the deployment of CSP technologies in California. The CalCSP study was conducted to assess how CSP can contribute to California’s long-term decarbonization goals while enhancing grid reliability, supporting local economic development, and making efficient use of land and transmission resources. It draws on detailed modeling of CSP performance and costs, site suitability analysis, policy reviews, and stakeholder engagement across utilities, regulators, developers, and community organizations. The analysis focuses on mature molten-salt tower technology and incorporates lessons learned from the global CSP fleet, distinguishing today’s CSP from earlier first-of-a-kind projects in the U.S. The findings support a more prominent role for CSP in California’s evolving clean energy landscape. With strategic planning, targeted policy support, and continued cost improvements, CSP can complement PV and batteries to deliver reliable, around-the-clock clean electricity—especially in areas with high solar resource and constrained grid capacity.

14 SOLAR ENERGY↗

Stochastic Optimal Power Flow Based on Data-Driven Distributionally Robust Optimization

We propose a data-driven method to solve a stochastic optimal power flow (OPF) problem based on limited information about forecast error distributions. The objective is to determine power schedules for controllable devices in a power network to balance operational cost and conditional value-at-risk (CVaR) of device and network constraint violations. These decisions include scheduled power output adjustments and reserve policies, which specify planned reactions to forecast errors in order to accommodate fluctuating renewable energy sources. Instead of assuming the uncertainties across the networks follow prescribed probability distributions, we assume the distributions are only observable through a finite training dataset. By utilizing the Wasserstein metric to quantify differences between the empirical data-based distribution and the real data-generating distribution, we formulate a distributionally robust optimization OPF problem to search for power schedules and reserve policies that are robust to sampling errors inherent in the dataset. A multi-stage closed-loop control strategy based on model predictive control (MPC) is also discussed. A simpIe numerical example illustrates inherent tradeoffs between operational cost and risk of constraint violation, and we show how our proposed method offers a data-driven framework to balance these objectives.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multistage robust optimization for the day-ahead scheduling of hybrid thermal-hydro-wind-solar systems

The integration of large-scale uncertain and uncontrollable wind and solar power generation has brought new challenges to the operations of modern power systems. In a power system with abundant water resources, hydroelectric generation with high operational flexibility is a powerful tool to promote a higher penetration of wind and solar power generation. In this paper, we study the day-ahead scheduling of a thermal-hydro-wind-solar power system. The uncertainties of renewable energy generation, including uncertain natural water inflow and wind/solar power output, are taken into consideration. We explore how the operational flexibility of hydroelectric generation and the coordination of thermal-hydro power can be utilized to hedge against uncertain wind/solar power under a multistage robust optimization (MRO) framework. To address the computational issue, mixed decision rules are employed to reformulate the original MRO model with a multi-level structure into a bi-level one. Column-and-constraint generation (C &CG) algorithm is extended into the MRO case to solve the bi-level model. The proposed optimization approach is tested in three real-world cases. Furthermore, the computational results demonstrate the capability of hydroelectric generation to promote the accommodation of uncertain wind and solar power.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Robust optimisation-based microgrid scheduling with islanding constraints

This paper proposes a robust optimization based optimal scheduling model for microgrid operation considering constraints of islanding capability. Our objective is to minimize the total operation cost, including generation cost and spinning reserve cost of local resources as well as purchasing cost of energy from the main grid. In order to ensure the resiliency of a microgrid and improve the reliability of the local electricity supply, the microgrid is required to maintain enough spinning reserve (both up and down) to meet local demand and accommodate local renewable generation when the supply of power from the main grid is interrupted suddenly, i.e., microgrid transitions from grid-connected into islanded mode. Prevailing operational uncertainties in renewable energy resources and load are considered and captured using a robust optimization method. With proper robust level, the solution of the proposed scheduling model ensures successful islanding of the microgrid with minimum load curtailment and guarantees robustness against all possible realizations of the modeled operational uncertainties. Numerical simulations on a microgrid consisting of a wind turbine, a PV panel, a fuel cell, a micro-turbine, a diesel generator and a battery demonstrate the effectiveness of the proposed scheduling model.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Quasi-Stochastic Approximation and Off-Policy Reinforcement Learning: Preprint

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning and often an efficient approach to solving (or approximating the solution to) complex optimal control problems. In many cases, however, practitioners are unable to apply these techniques because of an inherent high variance. This paper aims to provide a general foundation for 'quasi-stochastic approximation,' in which all of the processes under consideration are deterministic, much like quasi-Monte Carlo for variance reduction in simulation. The variance reduction can be substantial, subject to tuning of pertinent parameters in the algorithm. This paper introduces a new coupling argument to establish the optimal rate of convergence provided the gain is sufficiently large. These results are established for linear models and tested also in nonideal settings. A major application of these general results is a new class of reinforcement learning algorithms for deterministic state space models. In this setting, the main contribution is a class of algorithms for approximating the value function for a given policy, using a different policy designed to introduce exploration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A comprehensive techno-eco-assessment of CO 2 enhanced oil recovery projects using a machine-learning assisted workflow

Carbon dioxide enhanced oil recovery (CO 2 -EOR) projects not only extract residual oil but also sequestrate CO 2 in the depleted reservoirs. Here, this study develops a machine-learning-based workflow to co-optimize the hydrocarbon recovery, CO 2 sequestration volume and project net present value (NPV) simultaneously. Considering the trade-off relationships among the objective functions, support vector regression with Gaussian kernel (Gaussian- SVR) proxies are coupled with multi-objective particle swarm optimization (PSO) protocol and generate Pareto optimal solutions. Taking advantage of the high computational efficacy of the proxy model, economic uncertainties introduced by tax credits, capital costs and oil price are investigated by this study. The results indicate that the tax incentive policy (Section 45Q) plays a vital role in enhancing the economic returns of CO 2 -EOR projects, especially under the depression of crude oil market. The proposed workflow has been successfully implemented to optimize a water alternative CO 2 (CO 2 -WAG) injection project in a depleted oil sand in the US. The optimization results yield an incremental oil production of 15.8 MM STB and 1.37 MM metric tons of CO 2 storage in a 20-year development strategy, with the highest project NPV to be 205.6 MM US dollars.

03 NATURAL GAS↗

OPFLearnData: Dataset for Learning AC Optimal Power Flow

The datasets are resulting from OPFLearn.jl, a Julia package for creating AC OPF datasets. The package was developed to provide researchers with a standardized way to efficiently create AC OPF datasets that are representative of more of the AC OPF feasible load space compared to typical dataset creation methods. The OPFLearn dataset creation method uses a relaxed AC OPF formulation to reduce the volume of the unclassified input space throughout the dataset creation process. The dataset contains load profiles and their respective optimal primal and dual solutions. Load samples are processed using AC OPF formulations from PowerModels.jl. More information on the dataset creation method can be found in our publication, "OPF-Learn: An Open-Source Framework for Creating Representative AC Optimal Power Flow Datasets" and in the package website: https://github.com/NREL/OPFLearn.jl.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Least-Cost Pathways for India's Electric Power Sector

The Government of India has a target of deploying 175 GW from renewable energy by 2022 and 40% of electricity capacity from renewable energy by 2030 and has indicated that ambitions for 2030 could be higher. Rapid changes in technology costs and performance could drive further deployment of wind and solar capacity beyond these policy targets. Increased deployment of variable renewable energy (VRE) raises new questions for power system planning regarding the optimal siting of generation capacity, trade-offs between generation and transmission infrastructure, and system flexibility needs. This study aims to evaluate least-cost pathways for India's electric power system over the period 2017-2047. Uniquely, this work considers an expanded planning horizon and range of scenarios not previously analyzed in national planning studies in India. The data collection and model design processes undertaken for this study provides a framework for recurring planning studies. This study finds anticipated changes in electricity demand and component costs can drive a significant shift in India's future electricity supply and how this system will be operated. In the Base scenario, the share of generation from VRE reaches 54% by 2047. Reducing the capital cost of wind has a larger impact on VRE penetration than reducing the capital cost of solar PV or battery storage. In the lowest wind cost scenario (40% capital cost decline by 2047 relative to the Base scenario), the penetration of VRE in the generation mix reaches 722%, exceeding the penetration levels achieved when the cost of battery storage or solar PV are reduced by an even greater 50%. In a future system with high penetrations of RE, capacity additions are driven by the coincidence of demand and RE generation rather than peak demand alone. This study finds the system could have surplus capacity during the peak demand months of July–September because this period corresponds to periods with high wind speeds and more wind generation available to meet peak demand. By contrast, new capacity is needed to meet demand during moderate demand months of October–November when output from wind plants falls more than 75% nationally compared to the previous two months. Finally, the success for gas for electricity production may depend on cost competitiveness rather than fuel availability. Increasing the amount of gas available for electricity production had no significant impact on the capacity or generation mix by 2047, as determined from a scenario that significantly increases fuel availability throughout the planning horizon. In fact, over 80% of new gas fuel available for the power sector remains unused. This suggests the high cost of gas plant operations relative to other technologies may constrain the expansion of gas generation in India more than fuel availability.

14 SOLAR ENERGY↗

Arbitrage and Capacity Firming in Coordination with Day-Ahead Bidding of a Hybrid PV Plant

A hybrid PV plant (HPP) combines a photovoltaic (PV) plant with a battery energy storage system (BESS), which is considered a promising step towards the future of renewable power plants by the U.S. Department of Energy. When the renewable penetration reaches a significant level, a hybrid PV plant can bid in as a controllable thermal plant in the future electricity market. In this study, a bidding and BESS scheduling model is proposed for the HPP. The robust optimization (RO) technique has been utilized to identify the worst-case scenario of uncertainties during the bidding process. To address the overly conservative issue of the single-stage RO, we have decoupled the BESS schedule for arbitrage and PV capacity firming by a two-stage RO formulation. By comparing the output of single-stage RO and two-stage RO, the two-stage RO bids and schedules in a more aggressive manner, which increases the income of HPP. Also, the penalty of under-generation is considered in our model so that the day-ahead bidding decision and arbitrage schedules can be adjusted based on the potential UNDER-GENERATION penalty. Because the proposed model is non-convex and contains multi-stages, the Column-and-Constraint Generation (C&CG) algorithm is applied to the model as the solution. The proposed model has shown better economic performance compared to a state-of-art single-stage bidding method in case studies.

BESS scheduling↗

Multiagent Flight Control in Dynamic Environments with Cooperative Coevolutionary Algorithms

Dynamic flight environments in which objectives and environmental features change with respect to time pose a difficult problem with regards to planning optimal flight paths. Path planning methods are typically computationally expensive, and are often difficult to implement in real time if system objectives are changed. This computational problem is compounded when multiple agents are present in the system, as the state and action space grows exponentially. In this work, we use cooperative coevolutionary algorithms in order to develop policies which control agent motion in a dynamic multiagent unmanned aerial system environment such that goals and perceptions change, while ensuring safety constraints are not violated. Rather than replanning new paths when the environment changes, we develop a policy which can map the new environmental features to a trajectory for the agent while ensuring safe and reliable operation, while providing 92% of the theoretically optimal performance

Experimentation↗

Solar plus: A review of the end-user economics of solar PV integration with storage and load control in residential buildings

Batteries and load control devices can increase the value of distributed solar photovoltaics (PV) from multiple perspectives - end-user, utility, and social. This review paper summarizes the end-user economics of battery and load control technologies that increase the value of PV by controlling and temporally shifting PV output, an approach referred to as 'solar plus.' Solar plus can increase on-site PV use. The literature shows that these values justify the incremental costs of solar plus devices for a wide variety of technologies, geographies, and customer load profiles, especially for customers in three rate structure contexts: where PV is sold to the grid at a lower value than the customer's retail rate, in time-of-use rates where peak periods do not coincide with PV output, and in demand charge rates where load peaks do not coincide with PV output. Rate structure and policy reform may be necessary to ensure that increasing solar plus deployment provides both end-user and system-level benefits.

14 SOLAR ENERGY↗

Stochastic risk-sensitive market integration for renewable energy: Application to ocean wave power plants

With the expected increase of intermittent renewable energy resources on the electric power grid, short-term reserve markets can prove to be a critical reliability asset. This paper introduces and tests a potential market structure that includes a short-term reserve market for renewable resources where the realized energy is drawn within the bounds of the hourly capacity offered. The study presents a risk-aware stochastic model that determines, based on the day-ahead offer derived using a classic newsvendor formula, the best intraday offers for a renewable energy power plant. The stochastic approach takes into account the uncertainties of energy production and market prices. The proposed risk-sensitive model aims to maximize the renewable power plant's revenues and minimize potential risks of loss in a multi-product multi-timescale market setup. To demonstrate the effectiveness of the proposed formulation, we study the case of a hypothetical 750-kW wave power plant coupled with energy storage. The study shows that the risk of profit loss is not uniformly distributed across the risk-aversion factor space. We also find that the introduction of the short-term reserve market results in a wider range of conditional value at risk while inducing 5% profit increase and a lower profit reduction across the risk range. In addition, the study reveals that the short-term reserve market is profitable for both the system operator and the wave energy power plant considered.

24 POWER TRANSMISSION AND DISTRIBUTION↗