Search NASA⌕ Search

SEARCH · Search NASA

Results for “strategy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Gaming the beamlines—employing reinforcement learning to maximize scientific outcomes at large-scale user facilities

Abstract Beamline experiments at central facilities are increasingly demanding of remote, high-throughput, and adaptive operation conditions. To accommodate such needs, new approaches must be developed that enable on-the-fly decision making for data intensive challenges. Reinforcement learning (RL) is a domain of AI that holds the potential to enable autonomous operations in a feedback loop between beamline experiments and trained agents. Here, we outline the advanced data acquisition and control software of the Bluesky suite, and demonstrate its functionality with a canonical RL problem: cartpole. We then extend these methods to efficient use of beamline resources by using RL to develop an optimal measurement strategy for samples with different scattering characteristics. The RL agents converge on the empirically optimal policy when under-constrained with time. When resource limited, the agents outperform a naive or sequential measurement strategy, often by a factor of 100%. We interface these methods directly with the data storage and provenance technologies at the National Synchrotron Light Source II, thus demonstrating the potential for RL to increase the scientific output of beamlines, and layout the framework for how to achieve this impact.

36 MATERIALS SCIENCE↗

A general Bayesian algorithm for the autonomous alignment of beamlines

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional expensive-to-sample optimization problem involving the simultaneous treatment of many optical elements with correlated and nonlinear dynamics. Bayesian optimization is a strategy of efficient global optimization that has proved successful in similar regimes in a wide variety of beamline alignment applications, though it has typically been implemented for particular beamlines and optimization tasks. In this paper, we present a basic formulation of Bayesian inference and Gaussian process models as they relate to multi-objective Bayesian optimization, as well as the practical challenges presented by beamline alignment. We show that the same general implementation of Bayesian optimization with special consideration for beamline alignment can quickly learn the dynamics of particular beamlines in an online fashion through hyperparameter fitting with no prior information. We present the implementation of a concise software framework for beamline alignment and test it on four different optimization problems for experiments on X-ray beamlines at the National Synchrotron Light Source II and the Advanced Light Source, and an electron beam at the Accelerator Test Facility, along with benchmarking on a simulated digital twin. We discuss new applications of the framework, and the potential for a unified approach to beamline alignment at synchrotron facilities.

47 OTHER INSTRUMENTATION↗

Validation of HVAC Hardware-in-the-Loop Simulation for Advanced Control Strategies in Smart Homes: Preprint

Residences with smart thermostats can use advanced control strategies to manage their cooling/heating demand, but it is difficult to evaluate optimal control strategies for flexible heating, ventilation, and air conditioning (HVAC) systems in a traditional laboratory setting. The HVAC hardware-in-the-loop (HIL) system combines physical HVAC equipment and a physical thermostat with a simulated house to enable realistic operation of the hardware in any climate. This HIL platform allows researchers to evaluate advanced control strategies for homes with different construction or vintage types, as well as different climates and occupancy schedules. To demonstrate the capabilities of the HVAC HIL system, experimental results with a SEER 16, HSPF 9.5, 3 ton single-speed air source heat pump are validated against past field data collected from a heavily instrumented, unoccupied, retrofit house located in Sacramento, California. Three different cooling strategies are recreated in the HVAC HIL platform, including two different pre-cooling schedules that were designed to shift energy use away from the evening peak. The room temperatures, heat pump energy use, and run time show good agreement between the field data and HIL experimental results for three strategies.

cooling strategies↗

Cyber risk assessment and investment optimization using game theory and ML-based anomaly detection and mitigation for wide-area control in smart grids

The electric power grid is increasingly becoming susceptible to cyber attacks that exploit vulnerabilities in the smart grid control, information, and physical layers. Successful cyber attacks can have catastrophic impacts on the social and economic well-being of any nation all over the globe. It has, thus, become imperative to secure the smart grid against such adversarial actions to ensure stable, secure, and reliable operation of the grid. The existing research and industry practices prove to be inadequate in terms of providing pragmatic and effective defense methodologies and measures for long-term cybersecurity planning and real-time cybersecurity for grid operation. For example, existing works lack models that incorporate uncertain behavior of cyber-attackers and pragmatic defense measures for cyber risk assessment and cybersecurity investment optimization which often provide unreliable and strictly qualitative solutions to these problems. At the same time, with the growing number of cyber incidents in the grid, there still exists a need to develop attack-resilient algorithms for wide-area monitoring, protection, and control (WAMPAC) applications like the wide-area voltage control systems (WAVCS) for Flexible AC Transmissions Systems (FACTS) that lack in scalable and feasible solutions from the cybersecurity perspective. This dissertation proposes novel models and methodologies for: (1) Cybersecurity planning, and (2) Cybersecurity for system operation. The cybersecurity planning is achieved through cyber risk assessment and cybersecurity resource investment optimization for long-term cybersecurity of the grid using game theory and attack-defense trees. Cybersecurity for system operation consists of development of cyber anomaly detection and mitigation algorithms for flexible AC transmission system (FACTS) controller-based wide-area voltage control systems (WAVCS) using machine learning (ML), and software defined networking-based moving target defense network routing for achieving real-time cyber-physical security for grid operations. This is followed by hardware-in-the-loop (HIL) implementation and evaluation of these attack prevention, detection, and mitigation algorithms and methodologies showcasing their feasibility in a close to real-world environment. For cybersecurity planning, a novel approach involving a combination of game theory and attack defense trees (ADT) for optimal cybersecurity resource allocation in the smart grid is proposed. This methodology involves modeling of the cyber-physical smart grid substations as ADTs, defining attacker costs, defense costs, and attack probabilities for attack access points. Using game theoretical formulation, optimal defense strategies for the defender of the system to invest cybersecurity resources in the grid are obtained. Additionally, a game-theoretic framework is developed for quantitative cyber-physical risk assessment of the grid under a dynamically changing cyber threat space and uncertain behavior of cyber attackers which is further used to optimize investments in the smart grid's cybersecurity resources. The attacker, defender, and the smart grid system are modeled while incorporating attacker-stochasticity and federal guidelines for smart grid cybersecurity. This allows quantification of threat, vulnerabilities, and attack impact of the grid for quantitative risk assessment. The defender's budget to invest in the security resources in the grid is optimized based on the strategies leading to minimum system risk. The evaluation of the proposed solutions highlight the feasibility for practical implementation of these methodologies and algorithms in the smart grid, while taking the federal requirements and guidelines for smart grid security into consideration. For achieving cybersecurity for system operation, attack prevention, detection, and mitigation algorithms and methodologies are developed specifically for FACTS-based WAVCS. Anomaly detection and mitigation in the WAVCS are achieved using algorithms based on machine learning which involves offline training and testing of ML models with CPS datasets incorporating physics-based features that allow accurate distinction between system faults and cyber attacks. For attack prevention, a methodology based on software defined network (SDN)-based moving target defense (MTD) network routing is proposed that enables prevention of Denial of Service (DoS) type attacks on the smart grid communication system. Subsequently, these methodologies and algorithms are implemented and evaluated on an HIL testbed that allows for real-time attack prevention, detection, and mitigation of emulated cyber attacks on the WAVCS in a close to real-world environment. The results show highly accurate and efficient performance of the implemented algorithms and methodologies with the smart grid system operating within the NERC's system operation limits even in the presence of DoS and data integrity cyber attacks. This work opens up future research opportunities in other directions such as (1) Expanding cybersecurity planning methodologies to real-time cyber contingency analysis with different game formulations; and (2) Applying the cybersecurity for system operation algorithms to broader categories of wide-area control applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Incorporate day-ahead robustness and real-time incentives for electricity market design

In this paper, we propose a two-stage electricity market framework to explore the participation of distributed energy resources (DERs) in a day-ahead (DA) market and a real-time (RT) market. The objective is to determine the optimal bidding strategies of the aggregated DERs in the DA market and generate online incentive signals for DER-owners to optimize the social-welfare taking into account network operational constraints. Distributionally robust optimization is used to explicitly incorporate data-based statistical information of renewable forecasts into the supply/demand decisions in the DA market. We evaluate the conservativeness of bidding strategies distinguished by different risk aversion settings. In the RT market, a bi-level time-varying optimization problem is proposed to design the online incentive signals to tradeoff the RT imbalance penalty for distribution system operators (DSOs) and the costs of individual DER-owners. This enables tracking their optimal dispatch to provide fast balancing services, in the presence of time-varying network states while satisfying the voltage regulation requirement. Simulation results on both DA wholesale market and RT balancing market demonstrate the necessity of this two-stage design, and its robustness to uncertainties, the performance of convergence, the tracking ability and the feasibility of the resulting network operations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Resilience Evaluation and Enhancement for Island City Integrated Energy Systems

Extreme natural hazards, such as hurricanes or earthquakes, have a high probability of threatening energy supply security and causing high-order contingencies to island city-integrated energy systems (IC-IESs). To better evaluate and enhance resilience, a novel approach is proposed in this work for IC-IESs. The resilience of an IC-IES is analyzed from both the system level and the component level. At the system level, the impacts of extreme natural disasters are quantified. At the component level, the importance of individual components is analyzed through pre-failure and post-failure indices. The pre-failure index identifies the system’s weak links before an energy interruption, and the post-failure index determines the optimal repair strategy to restore the service. The proposed indices are solved by the impact increment method (IIM), which significantly improves computational efficiency without much affecting result accuracy. Numerical simulation studies are conducted on the modified Barry Island IES and IES E123-G48-H32 test systems. Furthermore, the results validate the effectiveness of the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Energy performance of an operational government building retrofitted with ceiling phase change material tiles in a mixed-humid climate

The aging U.S. building stock requires various retrofit measures to enhance their energy efficiency. Here, this study explores the integration of thermal energy storage and advanced building controls as viable retrofit solutions for load flexibility and peak demand response while maintaining the occupants' comfort. A detailed assessment is conducted on the energy use of an administrative building in Sumner County, Kansas, focusing on the implementation of phase change materials (PCMs) in the ceiling of occupied zones. First, a time-resolved, whole-building energy model is developed in EnergyPlus, incorporating complex thermal behaviors such as air exchange between the plenum space and occupied zones, envelope leakage, and operational schedules. The model is then validated using experimental field test data, and subsequently a parametric assessment of key PCM properties and application strategies is performed to evaluate cooling electricity demand benefits. The parametric study shows that the optimal retrofit strategy, comprising a PCM with 23°C peak melting temperature, 0.125 in. (3.17 mm) thickness, and 150 kJ/kg latent heat, combined with active controls that include 8 h of precooling, forced convection under the ceiling, and a 2°C thermostat setback during peak hours, can result in a maximum load shift during the peak period of 99.6 % and the total electricity savings during the peak period of 98.9 % for the optimum case and thus provide significant cost savings under time-of-use pricing scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluating Spatial Accelerator Architectures with Tiled Matrix-Matrix Multiplication.

There is a growing interest in custom spatial accelerators for machine learning applications. These accelerators employ a spatial array of processing elements (PEs) interacting via custom buffer hierarchies and networks-on-chip. The efficiency of these accelerators comes from employing optimized dataflow (i.e., spatial/temporal partitioning of data across the PEs and fine-grained scheduling) strategies to optimize data reuse. The focus of this work is to evaluate these accelerator architectures using a tiled general matrix-matrix multiplication (GEMM) kernel. To do so, we develop a framework that finds optimized mappings (dataflow and tile sizes) for a tiled GEMM for a given spatial accelerator and workload combination, leveraging an analytical cost model for runtime and energy. Finally, our evaluations over five spatial accelerators demonstrate that the tiled GEMM mappings systematically generated by our framework achieve high performance on various GEMM workloads and accelerators.

42 ENGINEERING↗

Evaluating Spatial Accelerator Architectures with Tiled Matrix-Matrix Multiplication

There is a growing interest in custom spatial accelerators for machine learning applications. These accelerators employ a spatial array of processing elements (PEs) interacting via custom buffer hierarchies and networks-on-chip. The efficiency of these accelerators comes from employing optimized dataflow (i.e., spatial/temporal partitioning of data across the PEs and fine-grained scheduling) strategies to optimize data reuse. The focus of this work is to evaluate these accelerator architectures using a tiled general matrix-matrix multiplication (GEMM) kernel. To do so, we develop a framework that finds optimized mappings (dataflow and tile sizes) for a tiled GEMM for a given spatial accelerator and workload combination, leveraging an analytical cost model for runtime and energy. Our evaluations over five spatial accelerators demonstrate that the tiled GEMM mappings systematically generated by our framework achieve high performance on various GEMM workloads and accelerators.

43 PARTICLE ACCELERATORS↗

Multifidelity multiobjective optimization for wake-steering strategies

Abstract. Wake steering is an emerging wind power plant control strategy where upstream turbines are intentionally yawed out of perpendicular alignment with the incoming wind, thereby “steering” wakes away from downstream turbines. However, trade-offs between the gains in power production and fatigue loads induced by this control strategy are the subject of continuing investigation. In this study, we present a multifidelity multiobjective optimization approach for exploring the Pareto front of trade-offs between power and loading during wake steering. A large eddy simulation is used as the high-fidelity model, where an actuator line representation is used to model wind turbine blades and a rainflow-counting algorithm is used to compute damage equivalent loads. A coarser simulation with a simpler loads model is employed as a supplementary low-fidelity model. Multifidelity Bayesian optimization is performed to iteratively learn both a surrogate of the low-fidelity model and an additive discrepancy function, which maps the low-fidelity model to the high-fidelity model. Each optimization uses the expected hypervolume improvement acquisition function, weighted by the total cost of a proposed model evaluation in the multifidelity case. The multifidelity approach is able to capture the logit function shape of the Pareto frontier at a computational cost only 30 % that of the single-fidelity approach. Additionally, we provide physical insights into the vortical structures in the wake that contribute to the Pareto front shape.

17 WIND ENERGY↗

Baseline Fuel Fabrication Facility

PRO-RR is the research reactor focused program element of the broader Proliferation Resistance Optimization program (PRO-X) under the National Nuclear Safety Administration (NNSA) in the U.S. Department of Energy (DOE). PRO-X provides a framework for integrating proliferation resistance in nuclear system designs to minimize weapons usable nuclear materials (WUNM) production and diversion pathways while optimizing systems performance for peaceful use missions. PRO-RR applies the PRO-X mission objectives to research reactor system design. This document serves as one of the foundational documents for the PRO-RR-Fuel System Design technical team by documenting a baseline fuel fabrication facility to be used for further optimization studies. The PRO-RR-Fuel System Design technical team consists of subject matter experts from Argonne National Laboratory (Argonne) and Savannah River National Laboratory (SRNL). In order to develop specific strategies for fuel fabrication facilities to optimize proliferation resistance, performance, and safety, a baseline fuel fabrication facility design basis was developed. Having a baseline design basis allows for the qualitative and quantitative comparison of design choices in the optimization process. This report describes the baseline fuel fabrication facility and general optimization strategy. Chapter 2 describes the fuel system selected for examination, the fabrication process used as the baseline, a description of the model developed to track uranium utilization, and a generic floorplan of the fabrication facility. Chapter 3 describes the overarching optimization strategy that could be implemented for a fabrication facility.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Economic NMPC for a Reversible Solid Oxide Cell

Reversible solid oxide fuel cells (rSOCs) offer the flexibility to operate in tandem with the electric grid by switching between fuel cell and electrolysis modes based on real-time electricity prices. However, their complex, tightly coupled dynamic behavior poses significant challenges in determining optimal operating strategies. In this work, we present an economic nonlinear model predictive control (E-NMPC) framework to optimize the operation of rSOCs. The proposed E-NMPC is applied to a detailed rSOC flowsheet model that includes a utility scale rSOC module as well as balance-of-plant equipment necessary for thermal management. Our results demonstrate that in fuel cell mode, the E-NMPC strategy reduces hydrogen consumption compared to conventional set-point tracking NMPC, while maintaining the same level of electricity output. Also, in electrolysis mode, the E-NMPC yields a marginal improvement in hydrogen production. In addition, we explore the integration of a battery with the rSOC system to enhance flexibility in meeting electricity production and consumption targets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Strategies for microgrid operation under real-world conditions

Microgrids are an increasingly relevant technology for integrating renewable energy sources into electricity systems. Based on a microgrid implementation in California, in this study we investigate microgrid operation under real-world conditions. These conditions have not yet been considered in combination and encompass energy charges, demand charges, export limits, as well as uncertainty about future electricity demand and generation in the microgrid. Under these conditions, we evaluate the performance of two frequently applied groups of strategies for microgrid operation. The first group is composed of proactive strategies that optimize decisions based on forecasts of future electricity generation and demand. The second group includes reactive strategies that make operational decisions based exclusively on the current state of the microgrid. We evaluate the performance of the strategies under varying operational parameters, forecast accuracies, and microgrid configurations—well beyond our Californian showcase. Our results confirm the expectation that proactive strategies outperform reactive ones in the majority of settings. Yet, reactive strategies can perform better under short control intervals or under moderate prediction errors of PV generation or demand. Furthermore, the interplay between real-world conditions and operational strategies reveals several additional insights for research on microgrid operation. First, we find that demand charges and export limits decisively affect microgrid performance. Second, the impact of forecast errors is highly non-linear and non-monotonous. Third, escalating negative interactions between forecast errors and demand charges make proactive strategies benefit from longer control intervals. This result is contrary to existing best practice, which promotes short control intervals to minimize the impact of uncertainty.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Electric Water Heaters for Transactive Systems: Model Evaluations and Performance Quantification

Electric water heaters (EWHs) are opportune appliances for implementing demand-side control. EWH models serve as a fundamental step toward accurately estimating EWH flexibility potential and designing proper control strategies. Existing studies have adapted numerous modeling approaches in evaluating the potential of EWHs for a variety of grid applications. This paper presents an analytical study that evaluates the performance of state-of-art EWH models in terms of accuracy and computational complexity for adaptation in evaluation studies for the transactive system. The work proposes a transactive control strategy that optimally utilizes the thermal inertia of EWHs for providing grid services. Here, the performance of the control strategy and the impact of modeling accuracy is evaluated for device-level and feeder-level use cases using the IEEE 123 node test distribution system appropriately populated with EWHs. The simulation results illustrate the effectiveness of the control strategy in reducing the feeder demand during peak period by 13% and also quantities the impact of using simplified modeling approaches for determining the potential of EWHs for providing grid services.

42 ENGINEERING↗

Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning

Residential heating, ventilation, and air conditioning (HVAC) has been considered as an important demand response resource. However, the optimization of residential HVAC control is no trivial task due to the complexity of the thermal dynamic models of buildings and uncertainty associated with both occupant-driven heat loads and weather forecasts. In this paper, we apply a novel model-free deep reinforcement learning (RL) method, known as the deep deterministic policy gradient (DDPG), to generate an optimal control strategy for a multi-zone residential HVAC system with the goal of minimizing energy consumption cost while maintaining the users’ comfort. Here, the applied deep RL-based method learns through continuous interaction with a simulated building environment and without referring to any prior model knowledge. Simulation results show that compared with the state-of-art deep Q network (DQN), the DDPG-based HVAC control strategy can reduce the energy consumption cost by 15% and reduce the comfort violation by 79%; and when compared with a rule-based HVAC control strategy, the comfort violation can be reduced by 98%. In addition, experiments with different building models and retail price models demonstrate that the well-trained DDPG-based HVAC control strategy has high generalization and adaptability to unseen environments, which indicates its practicability for real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Optimal experimental design for prediction based on push-forward probability measures

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Co-optimization of nuclear reactor flexible power operation and maintenance scheduling

As flexible power operation of nuclear power plants becomes more attractive due to the reduction in fossil-fueled dispatchable generation on energy grids, finding optimal power production strategies that balance revenue generation with operational concerns becomes more complex. This article presents a general framework to aid operators in designing economically optimal long term dispatch strategies for nuclear power plants. The principal novelty is the linking of estimated system remaining useable life (RUL) to strategic operational decisions. It is shown that, depending on the relationship between the fixed costs from maintenance and the associated lost revenue from an outage, it can be economically optimal in the long term to delay a maintenance outage and not perform this alongside refueling. For a given relationship between power ramping and degradation, optimal strategies were found that discouraged load following in some situations while minimizing unnecessary maintenance. It is shown that heavy load following can cause maintenance and refueling outages to diverge due to their inverse relationships with respect to load following, potentially leading to a significant loss in capacity factor. As a result, this general framework can be applied to specific reactor dispatch allowing operators to adapt operational strategies as future grid conditions change.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Digital Twin Development for Real Time Optimization

In the real-time optimization operation process of the integrated energy system, digital twin (DT) can support operators to find optimal dispatching strategy. In this research, the DT framework interfacing (external) system-level simulation model, RAVEN, and Python-based optimization framework has been developed. Simple demonstration of finding optimal input values minimizing an objective function with the DT framework has been presented.

25 ENERGY STORAGE↗