Search NASA⌕ Search

SEARCH · Search NASA

Results for “Control Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Recompression Closed Brayton Cycle Control Options Nuclear Science

The attractive performance of the S-CO 2 recompression cycle arises from the thermo-physical properties of carbon dioxide near the critical point. However, to ensure efficient operation of the cycle near the critical point, precise control of the heat removal rate by the pre-cooler upstream of the main compressor is required. With respect to the S-CO 2 recompression cycle at SNL, presently an operator is tasked with manually adjusting the opening of the valve that governs the water flow rate through the pre-cooler. This report describes a procedure to design an automatic controller that uses the water flow rate as a controlling variable to regulate the S-CO 2 temperature at the pre-cooler outlet. The work relies on the GPASS control-oriented model of the pre-cooler developed last year. A model-based approach is used to design a PI (Proportional-Integral) controller. Then a transfer function describing the influence of the water flow rate on the S-CO 2 outlet temperature is derived from the pre-cooler model. Suitable values for the controller gains are then derived and finally the gains are tested on the initial time-discrete non-linear model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Methodology for interpretable reinforcement learning model for HVAC energy control

Deep reinforcement learning (DRL) approaches have been used in various application areas to improve efficiency, optimization, or automation. However, very little is known about how the DRL algorithms make decisions and what features affect their performance. Using a case study of a DRL based Heating, Ventilation and Air Conditioning (HVAC) optimization methodology, we demonstrate how we can address these challenges by applying interpretability tools and systematically exploring the model inputs for better understanding the DRL behaviour and decision making process. We developed a methodology for interpretable reinforcement learning and evaluated our approach in real-world house located in Knoxville, TN. Our findings explain the reasoning behind DRL-based optimization decisions under different circumstances which has been discussed and confirmed by the experts in the field.

Kotevska, Olivera↗

Use of a controlled experiment and computational models to measure the impact of sequential peer exposures on decision making

It is widely believed that one’s peers influence product adoption behaviors. This relationship has been linked to the number of signals a decision-maker receives in a social network. But it is unclear if these same principles hold when the “pattern” by which it receives these signals vary and when peer influence is directed towards choices which are not optimal. To investigate that, we manipulate social signal exposure in an online controlled experiment using a game with human participants. Each participant in the game decides among choices with differing utilities. We observe the following: (1) even in the presence of monetary risks and previously acquired knowledge of the choices, decision-makers tend to deviate from the obvious optimal decision when their peers make a similar decision which we call the influence decision, (2) when the quantity of social signals vary over time, the forwarding probability of the influence decision and therefore being responsive to social influence does not necessarily correlate proportionally to the absolute quantity of signals. To better understand how these rules of peer influence could be used in modeling applications of real world diffusion and in networked environments, we use our behavioral findings to simulate spreading dynamics in real world case studies. We specifically try to see how cumulative influence plays out in the presence of user uncertainty and measure its outcome on rumor diffusion, which we model as an example of sub-optimal choice diffusion. Together, our simulation results indicate that sequential peer effects from the influence decision overcomes individual uncertainty to guide faster rumor diffusion over time. However, when the rate of diffusion is slow in the beginning, user uncertainty can have a substantial role compared to peer influence in deciding the adoption trajectory of a piece of questionable information.

97 MATHEMATICS AND COMPUTING↗

OCHRE: The Object-oriented, Controllable, High-resolution Residential Energy Model for Dynamic Integration Studies

Electrification and the growth of distributed energy resources (DERs), including flexible loads, are changing the energy landscape of electric distribution systems and creating new challenges and opportunities for electric utilities. Changes in demand profiles require improvements in distribution system load models, which have not historically accounted for device controllability or impacts on customer comfort. Although building modeling research has focused on these features, there is a need to incorporate them into distribution load models that include DERs and can be used to study grid-interactive buildings. In this paper, we present the Object-oriented, Controllable, High-resolution Residential Energy (OCHRE) model. OCHRE is a controllable thermal-electric residential energy model that captures building thermal dynamics, integrates grid-dependent electrical behavior, contains models for common DERs and end-use loads, and simulates at a time resolution down to 1 minute. It includes models for space heaters, air conditioners, water heaters, electric vehicles, photovoltaics, and batteries that are externally controllable and integrated in a co-simulation framework. Using a proposed zero energy ready community in Colorado, we co-simulate a distribution grid and 498 all-electric homes with a diverse set of efficiency levels and equipment properties. We show that controllable devices can reduce peak demand within a neighborhood by up to 73% during a critical peak period without sacrificing occupant comfort. We also demonstrate the importance of modeling load diversity at a high time resolution when quantifying power and voltage fluctuations across a distribution system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗

OpenFacadeControl: enabling integration of automated facades with other building systems

Automated facades are, for the most part, still considered as separate from other building systems throughout the design, installation, commissioning, operation, and maintenance cycle. This takes place despite the fact that their energy and comfort performance are deeply interlinked with the operation of lighting and HVAC systems. Over the last two decades, research has shown that there are significant advantages from operating facades as an integrated system with the rest of the building. Nevertheless, significant barriers prevent this type of integration becoming more common. One of them is the lack of a platform that is inexpensive to implement and that easily allows the practical implementation of integrated control algorithms across fenestration and other building systems, using a variety of communications protocols. This is particularly challenging when automated facades are installed in existing buildings, where interaction with legacy building systems that were installed over the past lifetime of the building can require a high degree of interoperability. OpenFacadeControl (OFC) is an open-source controls framework aimed at unified control of facades and other building systems, including the sharing of third-party sensor information. Through leveraging the Volttron controls platform, it allows the integration of systems and sensors that are manufactured by different companies and that use different communications protocols into an ensemble that functions as a single system. OFC is designed to enable integrated control algorithms of varying degrees of complexity, ranging from simple, heuristic controls to more sophisticated approaches like model-predictive control. Use of a research version to test advanced lighting and shading strategies in a full-scale experimental testbed has demonstrated the ease of deploying advanced control solutions using OpenFacadeControl. This paper presents the structure of OpenFacadeControl and a demonstration case showing the use of OFC in laboratory tests of advanced lighting and fenestration controls that coordinated motorized shades communicating via the BACnet building communications standard and lights communicating via internet-protocol-based application programming interface (API), based on the readings of a shared light level sensor communicating via a different API.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

System and method for operator control of heterogeneous unmanned system teams

A control architecture and associated control methods are under development to allow a single user to control a team of multiple heterogeneous UMS as they conduct multi-faceted (i.e. multi-objective) missions in real time is disclosed. The control architecture is hierarchical, modular and layered and enables operator interaction at each layer, ensuring the human operator is in close control of the unmanned team at all times. The architecture and key data structures are introduced. Two approaches to distributed collaborative control of heterogeneous unmanned systems are described, including an extension of homogeneous swarm control and a novel application of distributed model predictive control. Initial results are presented, demonstrating heterogeneous UMS teams conducting collaborative missions.

47 OTHER INSTRUMENTATION↗

Laboratory Evaluation of Federated, Hierarchical Controls for Distribution Power System Management: Preprint

The connection of more loads and distributed energy resources (DERs) to the distribution power system brings both challenges and opportunities to system operators. There are opportunities to aggregate flexible loads and DERs to provide transmission grid services, but the coordinated actions of DERs being managed by independent, third-party DER aggregators to support transmission system operations can present challenges. We developed a federated DER management architecture and control framework that aims to manage heterogeneous DERs to deliver reliable transmission grid services while respecting distribution system constraints. The controls include stochastic day-ahead optimization, model predictive control, and a simple real-time management scheme. We present simulation results obtained from a realistic laboratory test bed of federated controls managing DERs within a substation service area to make the substation net power follow the optimal net power determined by the day-ahead optimization based on cost and limiting reverse power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Site demonstration and performance evaluation of MPC for a large chiller plant with TES for renewable energy integration and grid decarbonization

Thermal energy storage (TES) for a cooling plant is a crucial resource for load flexibility. Traditionally, simple, heuristic control approaches, such as the storage priority control which charges TES during the nighttime and discharges during the daytime, have been widely used in practice, and shown reasonable performance in the past benefiting both the grid and the end-users such as buildings and district energy systems. However, the increasing penetration of renewables changes the situation, exposing the grid to a growing duck curve, which encourages the consumption of more energy in the daytime, and volatile renewable generation which requires dynamic planning. The growing pressure of diminishing greenhouse gas emissions also increases the complexity of cooling TES plant operations as different control strategies may apply to optimize operations for energy cost or carbon emissions. This paper presents a model predictive control (MPC), site demonstration and evaluation results of optimal operation of a chiller plant, TES and behind-meter photovoltaics for a campus-level district cooling system. The MPC was formulated as a mixed-integer linear program for better numerical and control properties. Compared with baseline rule-based controls, the MPC results show reductions of the excess PV power by around 25%, of the greenhouse gas emission by 10%, and of peak electricity demand by 10%.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗

An Experimental Study of Uncertainty Considerations Associated with Predicting Auto-ignition Timing using Livengood-Wu Integral Method

The application of the Livengood-Wu (LW) integral method as a tool to estimate knock onset in spark ignited (SI) engines and combustion phasing in advanced compression ignition (ACI) engines has been demonstrated through simulations several times. In this study, the effect of uncertainties associated with parameters required for the LW integral method, when used as a tool for model based control of ignition timing in an ACI engine, were experimentally studied using five full boiling range gasoline fuels. As a first step, the method was applied to experimental data from a rapid compression machine and it was found that the ability of the LW integral method to predict ignition timing was very sensitive to the performance of the chemical kinetic model of each fuel. The method was subsequently applied to experimental data from a single-cylinder gasoline engine with simple approximations for the LW integral input parameters, and it was found that the predicted time of ignition was significantly different from the actual start of combustion. Systematic evaluation of various parametric uncertainties conducted thereafter showed that the uncertainty in cylinder charge temperature has the greatest influence. Improved methods of estimating cylinder charge temperature are proposed to account for the previously determined corrections, to enable the use of the LW integral method for model based control of ignition timing.

Compression Ignition↗

Model-Predictive Cascade Mitigation in Electric Power Systems With Storage and Renewables-Part I: Theory and Implementation

A novel model predictive control (MPC) scheme is developed for mitigating the effects of severe line-overload disturbances in electrical power systems. A piece-wise linear convex approximation of line losses is employed to model the effect of transmission line power flow on conductor temperatures. Control is achieved through a receding-horizon model predictive control (MPC) strategy which alleviates line temperature overloads and thereby prevents the propagation of outages. The MPC strategy adjusts line flows by rescheduling generation, energy storage and controllable load, while taking into account ramp-rate limits and network limitations. In Part II of this paper, the MPC strategy is illustrated through simulation of the IEEE RTS-96 network, augmented to incorporate energy storage and renewable generation.

Almassalkhi, MR↗

Heat Transfer Salts for Nuclear Reactor Systems - Chemistry Control, Corrosion Mitigation, and Modeling

The concept of a molten salt reactor has existed for nearly sixty years. Previously all work was done during a large collaborative effort at Oak Ridge National Laboratory, culminating in a research reactor which operated for 15,000 hours without major error. This technical success has garnished interest in modern, high temperature, reactor schemes. Research using molten fluoride salts for nuclear applications requires a steady supply of high grade molten salts. There is no bulk supplier of research grade fluoride salts in the world, so a facility which could provide all the salt needed for testing at the University of Wisconsin had to be produced. Two salt purification devices were made for this purpose, a large scale purifier, and a small scale purifier, each designed to clean the salts from impurities and reduce their corrosion potential. As of now, the small scale has performed with flibe salt, hydrogen, and hydrogen fluoride, yielding clean salt. This salt is currently being used in corrosion testing facilities at the Massachusetts Institute of Technology and the University of Wisconsin. Working with the beryllium based salts requires extensive safety measures and health monitoring to prevent the development of acute or chronic beryllium disease, two pulmonary diseases created by an allergic reaction to beryllium in the lungs. Extensive health monitoring, engineering controls, and environment monitoring had to be set up with the University of Wisconsin department of Environment, Health and Safety. The hydrogen fluoride required for purification was also an extreme health hazard requiring thoughtful planning and execution. These dangers have made research a slow and tedious process. Simple processes, such as chemical handling and clean-up, can take large amounts of ingenuity and time. Other work has complemented the experimental research at Wisconsin to advance high temperature reactor goals. Modeling work has been performed in house to re-evaluate thermophysical properties of flibe and flinak. Pacific Northwest National Laboratories has focused on evaluating the fluorinating gas nitrogen trifluoride as a potential salt purification agent. Work there was performed on removing hydroxides and oxides from flinak salt under controlled conditions. Lastly, the University of California Berkeley has spent considerable time designing and simulating reactor components with fluoride salts at high temperatures. Despite the hurdles presented by the innate chemical hazards, considerable progress has been made. The stage has been set to perform new research on salt chemical control which could advance the fluoride salt cooled reactor concept towards commercialization. What were previously thought of as chemical undesirable, but nuclear certified, alloys have been shown to be theoretically compatible with fluoride salts at high temperatures. This preliminary report has been prepared to communicate the construction of the basic infrastructure required for flibe, as well as suggest original research to performed at the University of Wisconsin. Simultaneously, the contents of this report can serve as a detailed, but introductory guide to allow anyone to learn the fundamentals of chemistry, engineering, and safety required to work with flibe salt.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

An encoder–decoder LSTM-based EMPC framework applied to a building HVAC system

Numerous studies have demonstrated the benefit of economic model predictive control (EMPC) applied to building heating, ventilation, and air conditioning (HVAC) systems. However, the construction and training of predictive models for building HVAC systems are widely recognized as a key technological barrier preventing large-scale adoption of EMPC for buildings. In this work, an encoder–decoder long short-term memory-based EMPC framework is developed. The key advantage of the approach is that a model may be automatically generated from a list of inputs and outputs. From the definition of inputs and outputs, the constructed model may be trained and automatically embedded into the EMPC framework for real-time estimation and control. The overall end-to-end EMPC framework from model training to on-line estimation and control are described. To this end, the encoder–decoder model provides a natural framework for state estimation (encoder), which is required to provide an initial condition for the predictive model of EMPC (decoder). Closed-loop simulations using EnergyPlus are performed to demonstrate the approach. The simulated closed-loop system consists of a building zone from a multi-zone building, which is served by an air handling unit-variable air volume HVAC system. For the HVAC example considered, the trained encoder–decoder model can predict the indoor air temperature and HVAC sensible cooling rate of a building zone over a two-day horizon with high accuracy. Overall, we find that considering a time-of-use electric rate structure, the EMPC, which manipulates the zone temperature setpoint, can reduce the HVAC power consumption cost relative to keeping the zone temperature setpoint at its maximum value (i.e., minimum energy approach).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗