Safe Reinforcement Learning-Based Resilient Proactive Scheduling for a Commercial Building Considering Correlated Demand Response
Not Available
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Systems, apparatuses, and methods for performing temperature-aware task scheduling and proactive power management. A SoC includes a plurality of processing units and a task queue storing pending tasks. The SoC calculates a thermal metric for each pending task to predict an amount of heat the pending task will generate. The SoC also determines a thermal gradient for each processing unit to predict a rate at which the processing unit's temperature will change when executing a task. The SoC also monitors a thermal margin of how far each processing unit is from reaching its thermal limit. The SoC minimizes non-uniform heat generation on the SoC by scheduling pending tasks from the task queue to the processing units based on the thermal metrics for the pending tasks, the thermal gradients of each processing unit, and the thermal margin available on each processing unit.
Remote sensing systems have firmly established a role in providing immense value to commercial industry, scientific exploration, and national security. Continued maturation of sensing technology has reduced the cost of deploying highly-capable sensors while at the same time increased reliance on the information these sensors can provide. The demand for time on these sensors is unlikely to diminish. Coordination of next-generation sensor systems, larger constellations of satellites, unmanned aerial vehicles, ground telescopes, etc. is prohibitively complex for existing heuristics-based scheduling techniques. The project was a two-year collaboration spanning multiple Sandia centers and included a partnership with Texas A&M University. We have developed algorithms and software for collection scheduling, remote sensor field-of-view pointing models, and bandwidth-constrained prioritization of sensor data. Our approach followed best practices from the operations research and computational geometry communities. These models provide several advantages over state of the art techniques. In particular, our approach is more flexible compared to heuristics that tightly couple models and solution techniques. First, our mixed-integer linear models afford a rigorous analysis so that sensor planners can quantitatively describe a schedule relative to the best possible. Optimal or near-optimal schedules can be produced with commercial solvers in operational run-times. These models can be modified and extended to incorporate different scheduling and resource constraints and objective function definitions. Further, we have extended these models to proactively schedule sensors under weather and ad hoc collection uncertainty. This approach stands in contrast to existing deterministic schedulers which assume a single future weather or ad hoc collection scenario. The field-of-view pointing algorithm produces a mosaic with the fewest number of images required to fully cover a region of interest. The bandwidth-constrained algorithms find the highest priority information that can be transmitted. All of these are based on mixed-integer linear programs so that, in the future, collection scheduling, field-of-view, and bandwidth prioritization can be combined into a single problem. Experiments conducted using the developed models, commercial solvers, and benchmark datasets have demonstrated that proactively scheduling against uncertainty regularly and significantly outperforms deterministic schedulers.
We introduce the problem of scheduling observations on a constellation of remote sensors, to maximize the aggregate quality of the collections obtained. While automated tools exist to schedule remote sensors, they are often based on heuristic scheduling techniques, which typically fail to provide bounds on the quality of the resultant schedules. To address this issue, we first introduce a novel deterministic mixed-integer programming (MIP) model for scheduling a constellation of one to n satellites, which relies on extensive pre-computations associated with orbital propagators and sensor collection simulators to mitigate model size and complexity. Our MIP model captures realistic and complex constellation-target geometries, with solutions providing optimality guarantees. We then extend our base deterministic MIP model to obtain two-stage and three-stage stochastic MIP models that proactively schedule to maximize expected collection quality across a set of scenarios representing cloud cover uncertainty. Our experimental conclusions on instances of one and two satellites demonstrate that our stochastic MIP models yield significantly improved collection quality relative to our base deterministic MIP model. We further demonstrate that commercial off-the-shelf MIP solvers can produce provably optimal or near-optimal schedules from these models in time frames suitable for sensor operations.
Resilience is the ability of power systems to prepare for and adapt to low-probability, high-impact incidents and withstand and recover rapidly from disruptions. With the ageing of electricity distribution infrastructure and increasing threats of weather-related incidents and natural disasters, the need to effectively enhance the resilience of the electricity distribution system has become urgent and has attracted worldwide attention. Although there are an increasing number of publications related to enhancing resilience strategies, resilience is an emerging concept in power systems. Existing practices are mostly focused on deploying distributed energy resources (DERs) and microgrids, hardening the existing infrastructures and building redundant capacities. However, from a broader perspective, resilience enhancement of power distribution system is a systematic engineering, involving long-term system planning and upgrading (e.g., deployment of smart grid technologies and intelligent switches), short-term proactive scheduling, real-time robust and resilient control of DERs, and post-event restoration and recovery strategies. Based on this point, this Special Issue in IET Energy System Integration focuses on soliciting the most recent and original technologies, scheduling and control strategies for improving the resilience of power distribution system. Eight papers are presented in this Special Issue, covering various aspects related to resilience enhancement of power distribution system, including fault-tolerant frequency measurement, robust scheduling of integrated electricity and district heating systems, robust control of DERs, efficient methods for safety verification as well as novel graph theory-based approach to restore the distribution systems after multiple simultaneous faults. A brief introduction of these 8 papers is provided below.
Abstract not provided.
The increasing demands for electricity and the increase in extreme weather conditions are putting unprecedented pressure on our electric grids. Often, this pressure leads to electrical component failures, which might ignite wildfires. This work develops a novel model to balance the reliability of power network operations and the risk of wildfire ignition by opti- mizing the operational schedule of power transmission networks considering time-varying risk measures that include exogenous and operational factors. Energy storage systems are considered to deliver power during peak wildfire hours and enable temporal load shifting. The problem is formulated as a mixed-integer linear program that maximizes a weighted sum of the served power demand and the reduction in grid-induced wildfire risk. The results demonstrate the ability of the model to significantly reduce wildfire risk without considerable load shedding.
Not provided.
Across embedded, mobile, enterprise, and HPC systems, computer architectures are becoming more heterogeneous and complex. This complexity is causing a crisis in programming systems and performance portability. Several programming systems are working to address these challenges, but the increasing architectural diversity is forcing software stacks and applications to specialize for each architecture. As we show, all of these approaches critically depend on their runtime system for discovery, execution, scheduling, and data orchestration. To address this challenge, we believe that a more agile and proactive runtime system is essential to increase performance portability and improve user productivity. In this regard, we have designed and implemented IRIS: a portable runtime system exploiting multiple heterogeneous programming systems. IRIS can discover available resources, manage multiple diverse programming systems (e.g., CUDA, Hexagon, HIP, Level Zero, OpenCL, OpenMP) simultaneously in the same execution, respect data dependencies, orchestrate data movement proactively, and provide for user-configurable scheduling. Our evaluation on three architectures, ranging from Qualcomm Snapdragon to a Summit supercomputer node, shows that IRIS improves portability across a wide range of diverse heterogeneous architectures with negligible overhead.
From edge to exascale, computer architectures are becoming more heterogeneous and complex. The systems typically have fat nodes, with multicore CPUs and multiple hardware accelerators such as GPUs, FPGAs, and DSPs. This complexity is causing a crisis in programming systems and performance portability. Several programming systems are working to address these challenges, but the increasing architectural diversity is forcing software stacks and applications to be specialized for each architecture. As we show, all of these approaches critically depend on their software framework for discovery, execution, scheduling, and data orchestration. To address this challenge, we believe that a more agile and proactive software framework is essential to increase performance portability and improve user productivity. To this end, we have designed and implemented IRIS: a performance-portable framework for cross-platform heterogeneous computing. IRIS can discover available resources, manage multiple diverse programming platforms (e.g., CUDA, Hexagon, HIP, Level Zero, OpenCL, OpenMP) simultaneously in the same execution, respect data dependencies, orchestrate data movement proactively, and provide for user-configurable scheduling. To simplify data movement, IRIS introduces a shared virtual device memory with relaxed consistency among different heterogeneous devices. IRIS also adds an automatic kernel workload partitioning technique using the polyhedral model so that it can resize kernels for a wide range of devices. Our evaluation on three architectures, ranging from Qualcomm Snapdragon to a Summit supercomputer node, shows that IRIS improves portability across a wide range of diverse heterogeneous architectures with negligible overhead.
Radioactive decay of naturally occurring Radon-222 present in just-produced natural gas can lead to deposition of its radiogenic daughter, Lead-210, and subsequent radiogenic progeny within natural gas handling, treatment, and distribution facilities. Worker safety issues and disposal challenges arise when these accumulate to radiologically problematic activity levels. This is due to the 22.3-year half-life of Lead-210, allowing for multi-decade period of accumulation to occur and to persist, even after facility operations have ceased. Due to the far shorter half-lives of Lead-210 radiogenic progeny, especially that of Polonium-210, secular equilibrium within the Lead-210-Bismuth-210-Polonium-210 decay chain is quickly approached during facility operations and achieved after facility operations end. Lead-210 that accumulates in pipe scale can complicate any subsequent intrusive facility modifications, such as disassembly and dismantlement, potentially exposing workers to adverse radioactivity and impeding recycling and/or disposal of radiologically impacted equipment or other material. Experience has shown it is not strictly the presence of Lead-210 that is problematic but rather its 'unexpected' presence when this Technologically Enhanced Naturally Occurring Radioactive Material (TENORM) is discovered during intrusive work not incorporating radiological health and safety and material handling plans. Conversely, when implementing a program that proactively considers the potential for Lead-210, this form of TENORM simply becomes another 'special waste' that can be safely, efficiently, and effectively addressed during a decommissioning effort, without associated adverse worker exposures, project cost over-runs, and schedule delays. This paper will discuss how proactive radioactive scanning quickly and safely identified Lead-210 and its radiogenic progeny within a natural gas sweetening and compressor station located in northern Montana, a portion of which was undergoing decommissioning, aiding in safe and compliant material handling and recycling. The location of this operation necessitated that the decommissioning program be completed on schedule to prevent weather-related impacts due to the onset of adverse winter conditions. Further, the radioactive data acquired during this project will be shown to provide important insight into historic behavior of Lead-210 in terms of its disposition and its more recent decay. From these data, it became possible to back-model the average activity of Radon-222 within the natural gas being processed during the life of the operation, how the estimated Radon-222 activity within the processed natural gas conformed to measured Radon-222 at various other natural gas fields, and how this information can be leveraged in developing safe and successful plans for future intrusive work at this and companion site operations. This presentation will also note the apparent preferential accumulation of Lead-210 within both rubber-based materials, such as gaskets and seals, and grease-based products found within natural gas flow lines. Thoughts regarding processes that may lead to this finding will be explored. (authors)
Distributed learning is now routinely conducted on cloud as well as dedicated clusters. Training with elastic resources brings new challenges and design choices. Prior studies focus on runtime performance and assume a static algorithmic behavior. In this work, by analyzing the impact of of resource scaling on convergence, we introduce schedules for synchronous stochastic gradient descent that proactively adapt the number of learners to reduce training time and improve convergence. Our approach no longer assumes a constant number of processors throughout training. In our experiment, distributed stochastic gradient descent with dynamic schedules and reduction momentum achieves better convergence and significant speedups over prior static ones. Numerous distributed training jobs running on cloud may benefit from our approach.
Airports globally are shifting from ICE-powered to electric Ground Support Equipment (eGSE) to enhance efficiency, reduce operational costs, and improve operator health. Leveraging predictable routes, flat terrain, and low operational speeds, airports provide ideal conditions for electrification. This study evaluates freight GSE electrification at Dallas-Fort Worth International Airport (DFW), USA, using the Agile@ platform, which integrates three analytical methods: Freight Facility Model (FFM), Activity-Structure-Intensity-Fuel (ASIF), and Monte Carlo simulations. Results from 10,000 simulations indicate modest but critical increases in electricity demand and significant variability in GSE energy consumption. These insights emphasize the importance of data-driven scheduling, targeted maintenance, and strategic infrastructure planning. For high-uncertainty scenarios, airports are advised to deploy buffer energy storage systems (battery banks), implement demand-response charging strategies, schedule flexible workforce shifts, and prioritize proactive maintenance-particularly for equipment with higher operational uncertainty, such as tug tractors with trailers. Agile@ thus offers a robust, scalable, and data-driven framework to optimize long-term GSE planning and enhance reliability across diverse airport environments.
To improve the viability of nuclear power plants, there is a need to reduce their operational costs. Operational costs account for a significant portion of a plant’s yearly budget, due to their scheduled-based maintenance approach. In order to reduce these costs, proactive methods are required that estimate and forecast the state of a machine in real time to optimize maintenance schedules. In this research, we use Bayesian networks to develop a framework that can forecast the remaining useful life of a centrifugal pump. To do so, we integrate survival analysis with Bayesian statistics to forecast the health of the pump conditional to its current state. We complete our research by successfully using the Bayesian network on a case study. This solution provides an informed probabilistic viewpoint of the pumping system for the purpose of predictive maintenance.
Almost half of the total energy used in the U.S. buildings is consumed by heating, ventilation and air conditionings (HVAC) according to EIA statistics. Among various driving factors to energy performance of building, operations and maintenance play a significant role. Many researches have been done to look at design efficiencies and operational controls for improving energy performance of buildings, but very few study the impacts of HVAC systems maintenance. Different practices of HVAC system maintenance can result in substantial differences in building energy use. If a piece of HVAC equipment is not well maintained, its performance will degrade. If sensors used for control purpose are not calibrated, not only building energy usage could be dramatically increased, but also mechanical systems may not be able to satisfy indoor thermal comfort. Properly maintained HVAC systems can operate efficiently, improve occupant comfort, and prolong equipment service life. In the paper, maintenance practices for HVAC systems are presented based on literature reviews and discussions with HVAC engineers, building operators, facility managers, and commissioning agents. We categorize the maintenance practices into three levels depending on the maintenance effort and coverage: 1) proactive, performance-monitored maintenance; 2) preventive, scheduled maintenance; and 3) reactive, unplanned or no maintenance. A sampled list of maintenance issues, including cooling tower fouling, boiler/chiller fouling, refrigerant over or under charge, temperature sensor offset, outdoor air damper leakage, outdoor air screen blockage, outdoor air damper stuck at fully open position, and dirty filters are investigated in this study using field survey data and detailed simulation models. The energy impacts of both individual maintenance issue and combined scenarios for an office building with central VAV systems and central plant were evaluated by EnergyPlus simulations using three approaches: 1) direct modeling with EnergyPlus, 2) using the energy management system feature of EnergyPlus, and 3) modifying EnergyPlus source code. The results demonstrated the importance of maintenance for HVAC systems on energy performance of buildings. The research is intended to provide a guideline to help practitioners and building operators to gain the knowledge of maintaining HVAC systems in efficient operations, and prioritize HVAC maintenance work plan. The paper also discusses challenges of modeling building maintenance issues using energy simulation programs.
For every $1 billion invested in projects, $97 million is wasted due to poor project performance. That means 9.7% of money spent on projects is wasted due to poor risk and uncertainty management. High-risk projects, similar to those in waste remediation, have the most to lose. A solid quantitative risk management program is one of the keys to increasing the likelihood that a project will succeed. A quantitative risk program solves two major problems that challenge the effective management of risk and uncertainty: 1. Risks arise at all levels of an organization; however, not all organizational levels have an effective way to identify and resolve them. This can lead to risks that, even if identified, are not reported. 2. Decision-makers are often forced to operate solely on intuition when implementing mitigation strategies, not fully understanding the effects that certain decisions have on the program's cost and schedule. A quantitative risk program uses a risk register and builds it into the project/program integrated schedule to assess the impact of these risks, typically at the 80% confidence contingency level for specific milestones and/or project completion. Implementing a quantitative risk program drives a forward-thinking, proactive mentality to problem solving into all levels of the organization. A healthy risk program for regular reporting and communication ensures that all members of an organization are thinking about risks and using their communication channels to resolve them. It gives a method of communication and incentive for all levels in the organization and helps to ensure that risks will be reported and resolved. Pacific Northwest National Laboratory (PNNL) has developed tools and methods that provide a level of realism for analyzing different scenarios and estimating contingency that does not exist in the standard industry risk tool kit. These tools and methods provide decision-makers with actionable, quantitatively based information to guide their decision making. The first tool is a probabilistic branching risk model for mitigation strategies. Current quantitative risk analysis tools in the industry simulate two cases: fully mitigated and un-mitigated. In the fully mitigated case, the user assumes that every planned mitigation activity is successful. In the un-mitigated case, the user assumes that none are successful. The truth lies between these two extremes. The PNNL team has developed a probabilistic risk model for mitigation scenarios that includes a probability that a mitigation activity will succeed and a probability that a mitigation action will be funded. These probabilities are elicited from subject matter experts and ensure that the contingency calculations at the specified confidence are approaching reality. The second tool developed at PNNL is the Risk Box, which is a tool that integrates with different scenarios in the risk register. For example, say the user is faced with two different and mutually exclusive mitigation actions to reduce a risk. The Risk Box methodology performs the contingency calculations and then displays them on a time-phased graph that shows how each scenario reduces the risk contingency needed on the project/program. This graph then provides quantitative information to show decision-makers which mitigation action provides the greatest reduction (cost and schedule) in risk contingency for the program. Implementing these and other tools within a structured risk program increases the likelihood that a project will come in on schedule and budget, ensures that all personnel are proactively thinking about problems and resolutions, creates communication channels for all members to submit and resolve potential problems, produces a prioritized list of risk rankings to focus leadership on issues that may cause the biggest problems, and implements processes that drive updates to the risk program as the risk profile changes. PNNL has been developing these methods and using them on projects for over 20 years. They have been successfully applied on waste management projects, high-tech research and development projects, and construction projects, and they continue to be used on a number of U.S. Department of Energy projects today. (authors)
This report is for the first fiscal year of this ECRP project. This ECRP project aims to study the response of liquid-phase clouds to aerosol perturbation and reduce the related uncertainty in the DOE Earth system model. During this fiscal year, this project mainly made progress on the tasks about observational analyses for Objective 1; and successfully set up two Large-Eddy Simulation (LES) models for Objective 2. A postdoctoral researcher and a graduate student summer intern are on board and fully dedicated to this project. In addition to internal collaboration within LLNL, this project has routinely maintained external collaboration with scientists from universities, NASA Langley Research Center, and other DOE national laboratories. For the next reporting period, we plan to complete the tasks scheduled for the second year. Furthermore, we will promote the findings to communities of interest and proactively seek new collaborations to increase the impact of this project.
This report is being submitted for the task “Final Report” of DOE NEUP Project 15-8121 “Automatic Imagery Data Analysis for Proactive Computer-Based Workflow Management during Nuclear Power Plant Outages.” Typical nuclear power plant (NPP) outages always involve thousands of maintenance and refueling activities and a large number of workers in limited workspaces, while having tight schedules and zero-tolerance for accidents. During an outage, thousands of workers will be working in various workspaces across the NPP. High outage costs and expensive delays (approximately 1.5 million dollars of loss per day of delay) in NPP maintenance demand tight outage schedules. In packed workspaces, an automatic system that monitors human behaviors in real-time and provides insights about current and pending schedule deviations from the plan is critical for ensuring: 1) effective collaboration among workers and worker teams from different trades; 2) less waste of time and resources due to the lack of situational awareness; and 3) proactive outage project control. The overall goal of this project is to test the hypothesis that real-time imagery-based object tracking and spatial analysis, as well as human behavior modeling of outage participants, will significantly improve the efficiency of outage control while lowering the rates of accidents and incidents. Three objectives of this project are: 1) Establish real-time object tracking and spatiotemporal analysis methods that automatically assess the productivity of field activities and detect anomalous spatiotemporal relationships among activities that cause inefficiencies and risks; 2) Establish realtime human tracking and human factor modeling methods for automatically diagnosing unexpected actions of and interactions between outage participants, those which cause inefficient collaborations between Advanced Outage Control Center (AOCC), satellite outage centers, NPP workers, and maintenance service providers; and 3) Test the proposed automated object tracking, human behavior modeling, and spatiotemporal analysis methods in outage control case studies in order to characterize the effectiveness of automated imagery-data-driven methods in proactively improving the efficiency and safety of workflows in outage coordination and risk management. Recent studies of detailed human behavior monitoring on construction sites have examined the potential of applying advanced computer vision algorithms in detecting and tracking anomalous workers (i.e., workers who do not wear hard hats or safety vests) for ensuring job site safety. Some studies of human factor studies revealed the importance of modeling detailed interactions between individuals within and across teams in better understanding the impact of human in proactive project control. Other studies in the construction domain have developed computational simulation frameworks that formalize detailed spatiotemporal interactions between tasks in order to simulate the impacts of individual tasks on the performance of workflows. While integrated analyses that combine human factor assessment, as well as image processing and simulation, are in demand for effective decision-making, limited studies have examined the potential of such integrated analyses in NPP outage control. This research project has examined an automatic outage monitoring and control system that integrates human factor analysis, computer vision techniques, and simulation methods in order to enable engineers to better understand the interactions between humans, resources, and workflows during outage processes. The project aims at providing NPP maintenance agencies insights into more efficient use of limited resources in extending the life of a nuclear plant, as well as reducing waste while ensuring sufficient generation of electricity. This study is significant for the safety of nuclear plants, sustainable electricity generation for livable communities, and cost savings for maintaining electricity infrastructures in the United States.