Search NASA⌕ Search

SEARCH · Search NASA

Results for “optimal scheduling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Economic Dispatch Optimization of Multi-Unit SMR Site

With the increase of integration of variable renewable into the grid, grid resilience can be compromised without flexible electricity suppliers. Flexible operation of NPP can expand the scope of integration of new nuclear power plants in regions with high share of renewables. It also provides opportunity to increase profits through participation in ancillary services. In this research, NuScale modules are used as the case study. NuScale is an integrated pressurized water reactor with thermal power of 250 MWth. Having multiple units can provide higher flexibility in changing power levels and supplying the grid with electricity all year long. Additionally, load-following might perturbate the ordered sequence of refueling (every 24 months for NuScale). To maintain the 2 year refueling cycles, the loading patterns will need to be adjusted in a year-to-year basis, resulting in additional unnecessary costs. Another solution is to find the optimal outage schedule. This will also shift the focus of the planned outage to a more optimized predictive outages and maintenance. Results from short-term optimization (i.e., daily participation in energy and ancillary services markets) shows that average commitment to regulation down ancillary service markets during late night and early morning hours can increase revenues. Participating in upward reserves during pre-work commuting hours and early evening hours can also generate additional revenues due to high ramp up of electricity demand. Having multiple units at a single site can also help operate flexibly. Results from long-term optimization show that daily fluctuation in electric power is usually handled by few units while other units operate on base-load profile. It is possible to combine base-load operation with flexible operation to extend component remaining useful life in some units and find optimal outage schedule for the units.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Unlocking Autonomous Telescopes through Reinforcement Learning: An Offline Framework and Insights from a Case Study

Optimizing observational astronomy campaigns is becoming a complex and expensive task for next-generation telescopes, where manual planning of observations may tend to reach suboptimal results in terms of optimization.Reinforcement Learning (RL) has been well-demonstrated as a valuable approach for training autonomous systems, and it may provide the basis for self-driving telescopes capable of scanning the sky and optimizing the scheduling for astronomy campaigns.We have developed a framework for the optimization of telescope scheduling using RL techniques, based on a dataset containing data on a discrete set of sky locations that the telescope should visit, and a reward metric. We compared several RL algorithms applied to an offline simulation dataset based at the Stone Edge Observatory, considering a discrete set of sky locations to visit and using “t-effective” as a reward metric, a measure of the quality of the data.Deep Q-Networks (DQNs), belonging to the class of value-based methods, have shown remarkable success in the optimization of astronomical observations in our dataset. In the full environment, the average reward value in each state was found to be 92%±5% of the maximum possible reward, while on the test set it resulted in 87%±9% of the maximum possible reward.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Occupant Preference-Aware Load Scheduling for Resilient Communities

The load scheduling of resilient communities in the islanded mode is subject to many uncertainties such as weather forecast errors and occupant behavior stochasticity. To date, it remains unclear how occupant preferences affect the effectiveness of the load scheduling of resilient communities. This paper proposes an occupant thermal preference-aware load scheduler for resilient communities operating in the islanded mode. First, key resilience indicators are selected to quantify its impacts on the load scheduling of a resilient community. A deterministic model predictive control-based load scheduling framework is adopted as the baseline. Then, a chance-constrained controller is proposed to address the occupant-induced uncertainty in room temperature setpoints. Finally, the chance-constrained controller is compared with the deterministic controller on a virtual community testbed based on a real-world net-zero energy community in Florida, U.S. Results have shown that the proposed chance-constrained controller performs better in terms of serving occupants’ thermal preference and the required battery sizes compared to the deterministic controller with the presence of the assumed stochastic occupant behavior. This work indicates that it is necessary to consider the stochasticity of the occupant behavior when designing optimal load schedulers for resilient communities.

Wang, Jing↗
DOE OSTI2023

Self-Driving Telescopes: Autonomous Scheduling of Astronomical Observation Campaigns with Offline Reinforcement Learning

Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a particular set of observational needs. These observational needs are typically in strong competition with one another. This poses a challenging multi-objective optimization problem that remains unsolved. The effectiveness of Reinforcement Learning (RL) as a valuable paradigm for training autonomous systems has been well-demonstrated, and it may provide the basis for self-driving telescopes capable of optimizing the scheduling for astronomy campaigns. Simulated datasets containing examples of interactions between a telescope and a discrete set of sky locations on the celestial sphere can be used to train an RL model to sequentially gather data from these several locations to maximize a cumulative reward as a measure of the quality of the data gathered. We use simulated data to test and compare multiple implementations of a Deep Q-Network (DQN) for the task of optimizing the schedule of observations from the Stone Edge Observatory (SEO). We combine multiple improvements on the DQN and adjustments to the dataset, showing that DQNs can achieve an average reward of 87%+-6% of the maximum achievable reward in each state on the test set. This is the first comparison of offline RL algorithms for a particular astronomical challenge and the first open-source framework for performing such a comparison and assessment task.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Sizing Energy Storage System for Energy Arbitrage in Extreme Fast Charging Station

This paper proposes a non-linear programming (NLP) model to optimally size the energy storage system (ESS) and obtain an optimal energy management for energy arbitrage of an extreme fast charging station (XFCS) for electric vehicles (EVs), with minimized total cost of XFCS operation and ESS investment. Different from most reported work on sizing the ESS for EV charging stations, this paper proposes a pragmatic approach to model the ESS life degradation and accurately count the ESS cycles. Moreover, this work incorporates the peak demand charges in the operational cost of the charging station which are often overlooked in the literature. The proposed model is formulated and solved using AIMMS. Finally, a thorough sensitivity analysis is performed to offer insights into how different input parameters impact the ESS sizing and savings from the energy arbitrage perspective.

25 ENERGY STORAGE↗
DOE OSTI2023

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗
DOE OSTI2020

Extracting and Generating PV Soiling Profiles for Analysis, Forecasting, and Cleaning Optimization

The identification and prediction of the daily soiling profiles of a photovoltaic site is essential to plan the optimal cleaning schedule. In this article, we analyze and propose various methods to extract and generate photovoltaic soiling profiles, in order to improve the analysis and the forecast of the losses. New soiling rate extraction methods are proposed to reflect the seasonal variability of the soiling rates and, for this reason, are found to identify the most convenient cleaning day with the highest accuracy for the investigated sites. Also, we present an approach that could be used to predict future soiling losses through the implementation of stochastic weather generation algorithms whose ability to identify in advance the best cleaning schedule is also successfully tested. The methods presented in this article can optimize the operation and maintenance schedule and could make it possible, in the future, to predict soiling losses through analysis based only on environmental parameters, such as rainfall and particulate matter, without the need of long-term soiling data.

14 SOLAR ENERGY↗
DOE OSTI2020

Voltage Restoration in Microgrids using Temporal Logic Specifications

This paper proposes an energy storage controller synthesis method for voltage restoration in microgrids with respect to temporal logic specifications (TLSs). TLSs is introduced in this paper as a formalism to control the voltage variation of a critical bus against an operational bounds over time. The power system with synchronous generator (SG) connected to a critical load bus is modeled as a set of differential-algebraic equations and a simplified analytical model is derived to describe the voltage variation of this critical bus. The control objective is to schedule an optimal control input signal from a supportive energy storage system (ESS) connected to the critical bus, such that the voltage variation of the latter satisfies the TLSs, such as a finite-time restoration. The proposed control is verified on a lumped distribution system model. With this control diagram, supportive controllers can be designed to make voltage behaviors comply with grid codes and avoid unnecessary relay actions.

Taousser, Fatima Zohra↗
DOE OSTI2020

Post-Disturbance Dynamic Distribution System Restoration with DGs and Mobile Resources

Distributed generations (DGs) can act as emergency power supplies when distribution systems suffer from outages. However, the generation capabilities of DGs are generally limited by a number of factors including weather conditions, fuel limitations, etc. In this context, mobile resources that are able to reallocate resources to desired locations are regarded as important complements to conventional fixed DGs in assisting distribution system restoration. In this paper, a distribution system restoration model with DGs and mobile resources is proposed. Firstly, the dispatch and allocation of mobile resources are modeled with respect to the characteristics of the traffic network. Then the developed mobile resource models are integrated into the distribution system restoration model to co-optimize the scheduling of DGs and mobile resources. Uncertainty factors are managed by a model predictive control approach so that system operators can dynamically adjust the restoration strategy with the up-to-date information. The effectiveness of the proposed method is validated through an IEEE 13-bus test system.

distributed generations (DGs)↗
DOE OSTI2020

Optimal Renewable Resource Allocation and Load Scheduling of Resilient Communities

This paper presents a methodology for enhancing community resilience through optimal renewable resource allocation and load scheduling in order to minimize unserved load and thermal discomfort. The proposed control architecture distributes the computational effort and is easier to be scaled up than traditional centralized control. The decentralized control architecture consists of two layers: The community operator layer (COL) allocates the limited amount of renewable energy resource according to the power flexibility of each building. The building agent layer (BAL) addresses the optimal load scheduling problem for each building with the allowable load determined by the COL. Both layers are formulated as a model predictive control (MPC) based optimization. Simulation scenarios are designed to compare different combinations of building weighting methods and objective functions to provide guidance for real-world deployment by community and microgrid operators. The results indicate that the impact of power flexibility is more prominent than the weighting factor to the resource allocation process. Allocation based purely on occupancy status could lead to an increase of PV curtailment. Further, it is necessary for the building agent to have multi-objective optimization to minimize unserved load ratio and maximize comfort simultaneously.

model predictive control↗
DOE OSTI2024

Large-scale simulation-based parametric analysis of an optimal precooling strategy for demand flexibility in a commercial office building

Achieving success with grid-interactive efficient buildings (GEBs) is closely tied to the utilization of flexible loads. A valuable strategy involves the implementation of precooling techniques before high-demand events, such as peak hours, by adjusting zone air temperature setpoints. This leads to a reduction in thermal loads and peak electricity demand during these times, as the building’s thermal mass stores and subsequently releases thermal energy. However, the effectiveness of the pre-cooling optimization is highly contingent on specific conditions such as building thermal properties, weather conditions, utility rate structure, HVAC equipment sizing, etc. Therefore, investigating the impacts of these condition-specific factors is crucial, especially when considering precooling strategies that utilize thermal mass in commercial buildings. In this paper, we first devised a novel heuristic control approach that incorporates parameterized optimal precooling thermostat schedules to enhance demand flexibility in a commercial office building. Subsequently, we conducted a thorough performance evaluation of this control strategy. Here, the optimal thermostat schedule was parameterized using three optimization variables: the precooling start time, the precooling end time, and the precooling temperature setpoint. Utilizing the DOE medium-sized office building as the virtual testbed, we showed that the parameterized schedule effectively approximates model predictive control and requires drastically reduced computational overhead. In addition, we investigated the impact of different influencing factors on the optimal precooling strategy. These factors include building thermal mass, outdoor air conditions, and energy price profiles. Using high-performance computing, we simulated a total of 225 scenarios, consisting of three levels of thermal mass, five typical outdoor air temperature profiles, and fifteen time-of-use price plans. The results demonstrate that optimal thermostat scheduling could save substantial energy cost in medium-sized office buildings with heavy thermal mass but with some energy penalty. Although the potential for cost savings is lower in buildings with low and medium thermal mass, the energy penalty remains consistent in all three thermal mass scenarios. The study also highlights the need to account for zone diversity and recognize that a one-size-fits-all-zone setpoint schedule may not be suitable for all zones and can lead to unnecessary energy wastage. Furthermore, the results highlight that while outdoor air conditions play a role in cost and energy performance, the cooling load exerts a more immediate and substantial influence on cost savings in precooling strategies. Although cost savings are comparable under certain conditions with the same cooling load, observed deviations in energy penalty indicate potential disparities in the efficiency of the HVAC system during the load-shifting process. In addition, the duration of peak pricing and the ratio between peak and off-peak times exhibit clear correlations with cost savings and energy consumption, aligning with intuitive expectations. These findings offer valuable insights for optimizing precooling strategies in office buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Route Optimization for Energy Efficient Airport Shuttle Operations - A Case Study from Dallas Fort Worth International Airport

Air travel and requisite surface traffic supporting passenger arrival/departure constitutes a significant portion of travel and emissions in cities with large airports. An airport trip can segment into three parts namely: i) travel from a location in the city to the airport; ii) travel from a parking lot or rental car center to the terminal (i.e., within the airport premises), and iii) travel inside the terminal. Depending on the airport access mode all or a part of these legs comprise a traveler’s journey to the airport. The priority of airport ground transport management teams is to provide passengers with a seamless travel experience within the airport, so it is understandable that within airport shuttle routes might not be optimized for minimizing energy consumption. Solutions that meet the dual objective of reducing energy consumption from airport shuttle operations without compromising on passenger travel experience are key to improving system efficiency. There is currently a dearth of research and tools that can inform airports in making such decisions. Addressing this need, this research effort puts forth an optimization model that generates optimal shuttle routes for a given set of constraints, and a discrete-event simulator that evaluates the optimal solutions in a stochastic environment to understand the tradeoffs between passenger wait times, and within airport shuttle energy consumption. The proposed set of tools are tested in the context of optimizing airport shuttles routes within the Dallas Fort Worth International Airport (DFW). In addition to shuttle spatial positioning, and passenger demand information, high-fidelity vehicle data was collected using data loggers installed on DFW shuttles. Results show that 20% energy reduction in shuttle operations is possible with a modest two-minute increase in average passenger wait times. The tools developed in this research effort are designed to be generalizable and can help optimize shuttle operations planning at any major airport.

air travel↗
DOE OSTI2023

Driving Next-Generation Workflows from the Data Plane

We observe the emergence of a new generation of scientific workflows that process data produced at a sustained rate by scientific instruments and large scale numerical simulations. This data is consumed by multiple analysis, visualization, or Machine Learning components not only to enable inference and justify the scientific program, but also to monitor and steer the evolution of these experiments. In such workflows, moving intermediate data efficiently is key to performance, more than efficiently scheduling computational tasks. However, most traditional workflow management systems focus on optimizing task scheduling and then deal with data management, assuming a “move little, compute for long” model, which makes them unfit to the efficient management of this new generation of workflows. Therefore, we advocate for a new way to manage scientific workflows. We propose to consider an efficiently and independently managed data plane that can store and stream data. Workflows compute components, in the application plane can then interact with the data plane, abstracted from complexities of data management. Then, the role of a workflow management system would become that of a control plane that allows users to connect services together to execute the workflow and manages connections between the application and data planes. In this position paper, we characterize several next-generation workflow motifs and describe how their interaction with the data plane is a challenge to traditional workflow management systems. Then, we express a set of requirements that a workflow management system should meet to efficiently manage next-generation workflows at different scales. Based on these requirements, we expose our vision of driving next-generation workflows from the data plane and list remaining open challenges.

Suter, Fred↗
DOE OSTI2022

Autonomous Energy Management Software System for Small Commercial Buildings in Support of Decarbonization (Abstract)

The primary goal for the project is to develop and validate an autonomous energy management software (AEMS) system that will continuously optimize small commercial building operations by minimizing energy consumption and cost, providing a solution for maximizing decarbonization benefits from electrification of buildings. The work will leverage vast experience of Pacific Northwest National Laboratory (PNNL) research and development staff who have over two decades of experience in developing and successfully transferring software technologies to the private sector. This solution will be jointly developed with Intellimation LLC who plans to use it to scale their building energy efficiency offering. The project plan will include collaboratively working with Intellimation to package a set of solutions into the AEMS system, validate and demonstrate their capability, and value proposition through field demonstrations. If the deployment of the AEMS system optimizes RTUs’ set points, schedules, setbacks and optimal start and results in energy consumption reduction of 20%, the technical potential savings is approximately 675 trillion Btus of site energy savings and 2,000 trillion Btus of source energy. It will also result in carbon reductions of approximately 2.4 MMTCO2 and contribute to the climate change mitigation plans of many cities and states across the United States. Additional cost savings and emissions reduction are possible from management of peak electricity demand. The primary outcome will be an AEMS system that can be deployed at scale on small commercial buildings to improve operating efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Decentralized Failure-Tolerant Optimization of Electric Vehicle Charging

We present a decentralized failure-tolerant algorithm for optimizing electric vehicle (EV) charging, using charging stations as computing agents. The algorithm is based on the alternating direction method of multipliers (ADMM) and it has the following features: (i) It handles capacity, peak demand, and ancillary services coupling constraints. (ii) It does not require a central agent collecting information and performing coordination (e.g. an aggregator), instead all agents exchange information and computations are carried out in a fully decentralized fashion. (iii) It can withstand the failure of any number of computing agents, as long as the remaining computing agents are in a connected communications network. We construct this algorithm by reformulating the optimal EV charging problem in a decomposable form, amenable to ADMM, and then developing efficient decentralized solution methods for the subproblems dealing with coupling constraints. We conduct numerical experiments on industry-scale synthetic EV charging datasets, with up to 1,152 charging stations, using a high performance computing cluster. The experiments demonstrate that the proposed algorithm can solve the optimal EV charging problem fast enough to permit the integration of EV charging with real-time electricity markets, even in the presence of failures.

42 ENGINEERING↗
DOE OSTI2025

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize multiple performance metrics, including job wait time and system throughput. Traditional heuristic-based scheduling algorithms increasingly struggle and lack the efficiency needed to meet the demands and address the complexity and scale of modern HPC systems. Consequently, recent research efforts have focused on leveraging advancements in Artificial Intelligence (AI) and Deep Learning (DL), particularly Reinforcement Learning (RL), to develop more adaptable and intelligent scheduling strategies. Previous RL-based scheduling approaches have explored a range of algorithms, from Deep Q-Networks (DQN) to Proximal Policy Optimization (PPO), and more recently, hybrid methods that integrate Graph Neural Networks (GNNs) with RL techniques. However, a common limitation across these methods is their reliance on relatively small datasets, with few methods being evaluated using large-scale, multi-million-job trace datasets representative of real-world HPC workloads. Moreover, existing RL schedulers face scalability issues due to centralized policy updates, which hinder training efficiency and performance when applied to large datasets. This study introduces a novel RL-based scheduler utilizing Decentralized Distributed Proximal Policy Optimization (DD-PPO) algorithm, which supports large-scale distributed training across multiple workers without requiring parameter synchronization at every step. By eliminating reliance on centralized updates to a shared policy, the DD-PPO scheduler enhances scalability, training efficiency, and sample utilization. Experimental validation using a large real-world dataset containing over 11.5 million job traces collected from petascale HPC systems over six years assesses the influence of dataset scale on training effectiveness and compares DD-PPO performance to traditional and advanced scheduling approaches. The experimental results demonstrate improved scheduling performance in comparison to both heuristic-based schedulers and existing RL-based scheduling algorithms.

AI↗
DOE OSTI2023

Deep reinforcement learning to discover multi-fuel injection strategies for compression ignition engines

Over the past several decades, regulation of compression ignition engine emissions has become increasingly stringent as concern about the environmental and health implications of these emissions has grown. These changing constraints have led to a series of new, alternative fuel injection strategies that aim to maintain power output while reducing in-cylinder generated emissions by operating in the low-temperature combustion (LTC) regime. These advanced injection strategies are created and retuned for individual combinations of engine geometry, fuel, and emissions constraints. Deep reinforcement learning has been shown to be an effective alternative to traditional optimization approaches for highly combinatorial control problems, such as discovering the optimal injection schedules for compression ignition engines. In this study, we deploy a previously presented deep reinforcement learning framework to iteratively optimize a series of engine geometries over a range of increasingly strict NO x emissions regulations. We then examine the resulting injection schedules. We discuss the potential for using this deep reinforcement learning framework for fuel selection screening and for discovering unique injection strategies for different engine geometries and future emissions standards.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Enhanced deep neural networks with transfer learning for distribution LMP considering load and PV uncertainties

As the flexibility of generation and demand increases in distribution systems, the residential loads are emerging as a promising means to participate in demand response and the transactive energy market. Market pricing is an instrumental mechanism for the distribution system operator to exploit the full potential of the flexible resources. The distribution locational marginal price (DLMP) can be used to guide the residential load consumption. This type of market signal helps the distribution system operator to optimize the scheduling of all resources while satisfying related network constraints through a day-ahead market. However, solving the optimization problem for large-scale systems can be computationally expensive. To address the scalability and practicability limitations of the DLMP framework, a learning-based approach is proposed in this paper to complement the day-ahead distribution market framework. Here, the proposed approach combines long short-term memory and transfer learning to develop deep neural network that can capture the spatial–temporal correlation of the input data. The model can determine the optimal DLMP for each node in a distribution system without the system parameters required to formulate the optimization problem. Testing results on IEEE 33-bus and 123-bus systems show that the proposed approach can generate a comparable DLMP against the optimization solutions.

24 POWER TRANSMISSION AND DISTRIBUTION↗