Search NASA⌕ Search

SEARCH · Search NASA

Results for “Setpoints”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Distributed Rules-Based Deconfliction of ADMS Applications - Part 2: Conceptual Implementation

This work introduces a rules-based deconfliction methodology for resolving conflicting device control commands issued by advanced power applications considering a range of technical, economic, environmental, and social objectives. The methodology is designed to serve as one of multiple alternative implementations (along with application cooperation and global optimization) for the numerical component of the Deconfliction Pipeline. Development of the methodology is divided into two parts. The first document previously defined the requirements, context, and methods for decomposing the deconfliction problem using the Laminar Coordination Framework and Variable Grid Structures. The deconfliction problem was decomposed into a distributed optimization problem based on the concept of quasi-static grid segments, which form independent distributed areas for control and coordination. It was recommended that selection of the optimal number of decompositions of the deconfliction problem be made based on a tradeoff analysis between computational speed and global optimality. This second document defines an initial set of technical, economic, and environmental criteria, as well as thirty specific qualitative rules that are used as part of the deconfliction methodology to eliminate non-viable setpoint alternatives. The deconfliction optimization problem is converted into a ranking of individual discrete setpoints, which are scored by the extent to which they satisfy specific decision criteria. The ranking is determined through the concepts of deconfliction exclusivity, priority, and preference. Several multi-criteria decision-making frameworks are examined with the simple multi-attribute rating technique exploiting ranks (SMARTER) recommended as a simple implementation alternative that aligns with the steps of the rules-based deconfliction methodology.

97 MATHEMATICS AND COMPUTING↗

Distributed Rules-Based Deconfliction of ADMS Applications: Part 1: Requirements & Decomposition

This work introduces a rules-based deconfliction methodology for resolving conflicting device control commands issued by advanced power applications considering a range of technical, economic, environmental, and social objectives. The methodology is designed to serve as one of multiple alternative implementations (along with application cooperation and global optimization) for the numerical component of the Deconfliction Pipeline. Development of the methodology is divided into two parts. This first document introduces the requirements, context, and methods for decomposing the deconfliction problem using the Laminar Coordination Framework and Variable Grid Structures. The deconfliction problem is decomposed into a distributed optimization problem based on the concept of quasi-static grid segments, which form independent distributed areas for control and coordination. Selection of the optimal number of decompositions of the deconfliction problem should be made based on a tradeoff analysis between computational speed and global optimality. This second document will define an initial set of technical, economic, and environmental criteria, as well as thirty specific qualitative rules that are used as part of the deconfliction methodology to eliminate non-viable setpoint alternatives. The deconfliction optimization problem is converted into a ranking of individual discrete setpoints, which are scored by the extent to which they satisfy specific decision criteria. The ranking is determined through the concepts of deconfliction exclusivity, priority, and preference. Several multi-criteria decision-making frameworks are examined with the simple multi-attribute rating technique exploiting ranks (SMARTER) recommended as a simple implementation alternative that aligns with the steps of the rules-based deconfliction methodology.

97 MATHEMATICS AND COMPUTING↗

Performance Demonstration of an Occupancy Sensor-enabled Integrated Solution for Commercial Buildings

Traditionally, a single-loop fixed-gain controller is applied to supply fan (SF) and cooling coil (CC) valve controls while a fixed-damper position control is applied to outdoor air (OA) damper control at air handling units (AHUs) in commercial buildings. With the increasing application of occupancy sensors, the information generated by occupancy sensors is applied to not only reduce the electricity loads from lighting and controllable plug loads, but also reset OA intake and minimum supply airflow setpoints. Meanwhile, these intermittent operation actions greatly elevate the dynamics of AHU systems, which may introduce unstable SF and CC valve operations and inaccurate OA flow control at AHUs and consequently degrade maximum energy efficiency gains. With virtual fan and valve flow meter technologies, two advanced controls, including cascade control and gain scheduling control, can be implemented on both the SF and CC valve, and an advanced control using a virtual OA flow meter can be implemented on OA damper integrated with occupancy sensors. The goal of this project is to demonstrate the savings, cost, and performance of an integrated solution that integrates the three advanced HVAC controls with occupancy sensors to allow accurate and stable AHU operations in real buildings. The project objectives are to: 1) develop and validate an advance SF control algorithm; 2) develop and validate an advanced CC valve control algorithm; 3) validate an algorithm to implement a virtual OA flow meter; and 4) demonstrate the savings, cost, and performance of the integrated solution in real buildings. The technical approaches are to: 1) select a test system at the University of Oklahoma; 2) develop and implement the algorithms of advanced SF and CC valve controls and validate the performance; 3) develop and implement the advanced OA control using a virtual OA flow meter and validate the performance; 4) demonstrate the savings, cost, and performance of the proposed integrated solution with and without three advanced HVAC controls; and 5) disseminate the project results through publications and presentations. For the SF control, both the gain scheduling and cascade controls can improve the fan energy performance by reducing the fan power during the transient period and the fan control performance at lower speeds by reducing fan speed variation. Moreover, the gain scheduling control provides a simple and low-cost solution and is recommended. The fan power savings can reach 30% in a transient period. For the CC valve control, the gain scheduling control can considerably reduce the supply air temperature oscillation range and frequency under both higher and lower load conditions and the control valve response is much more stable. As a result, the gain scheduling control is recommended. The projected pump energy consumption can be reduced by 68.5%. With the developed virtual OA flow meter, the OA can be accurately controlled at its setpoint, which is determined based on the actual number of occupants in the building provided by occupancy sensors. The RMSE of the proposed OA control is 15.9 L/s. The energy data shows that the fan power and CC cooling energy were significantly reduced. On the other hand, the energy savings majorly results from the occupancy sensors and the energy savings by the advanced HVAC controls is minimal because that the controllers in the test AHU were tuned with very slow response. An annual technical savings potential is estimated as 0.5 quads in the commercial sector.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Alaska's Rural Building Stock: a Validation Study Using ResStock and Field Data

The availability of accurate national data on demographics, building stock, and energy use is vital for modeling residential buildings and evaluating decarbonization strategies. However, rural and Indigenous populations, including those in rural Alaska, are typically underrepresented in these datasets. These communities face unique challenges due to their remote locations, severe weather conditions, and limited access to resources, resulting in high energy burden. This report examines how rural Alaskan communities are underrepresented in the ResStock housing model and highlights the need for improved data to address their unique housing and energy challenges. Thus, this report examines the representation of rural Alaskan communities within the national housing stock model, ResStock. A validation study was conducted, considering ResStock, Field Data and Aerial and 3D-view data collection (A3DDC) datasets. The validation process started by using the down selecting approach on the ResStock building stock dataset. For the purpose of this study, only the rural Alaska Boroughs and Census areas located in ASHRAE IECC Climate Zone 8 were considered to ensure a more accurate and fair comparison with the field data, which was collected in rural areas located in climate zone 8, specifically within the Nome Census area. While ResStock may accurately represent several characteristics of the building stock for rural Alaska, some differences between modeled, field data, and aerial and 3D-view data collection datasets were identified. The following building characteristics have a high impact on modeled energy consumption and demonstrated large differences: Revisit heating setpoints and consider a substantially higher setpoint distribution, it could potentially address "missing loads" if this is the case. Develop and include Toyo heating in future modeling for ResStock and EnergyPlus. Remove natural gas as a water heater fuel type outside of North Slope County. Foundation type updated to have more crawlspaces rather than basements. Infiltration rates need reexamination for a larger distribution toward higher infiltration rates. Include more vinyl and less brick in exterior wall type and revise wall color for greater proportion of light rather than dark color. Roof material revised from majority shingles to majority metal. Update number of occupants to higher number of occupant count. Building orientation represents a higher proportion of south facing buildings rather than relatively equal. The findings suggest that updating ResStock's probability logic could better represent rural Alaskan buildings. ResStock can be utilized to identify the best upgrades or energy efficiency and energy efficiency improvements, helping community leaders in making more informed decisions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Use of Hardware-in-the-Loop to De-Risk Field Deployment of Hydrogen Assets

Grid-forming assets are required in microgrids to act as voltage-frequency masters. These grid-forming assets can operate in two modes of operation: grid-following mode and grid-forming mode. In grid-following mode of operation, these assets will follow real power and reactive power setpoints and in grid-forming mode of operation these assets will follow voltage and frequency setpoints. Traditionally, diesel generators or natural gas-based generators are widely used to act as a voltage-frequency master. However, many utilities are aiming to replace generators with grid forming-inverters supplied by solar photovoltaics (PV), batteries or fuel cells. Since grid-forming assets need a long-term reliable energy source, fuel cells are a reasonable and viable choice to supply the grid-forming inverters, but some of the challenges facing the wide deployment of grid-forming fuel cell inverters need to be addressed. Specifically, in our proposed work, we aim to focus on the interconnection and interoperability requirements of grid-forming fuel cell inverters. Currently, state-of-the-art fuel cell inverters follow the general interconnection requirements of distributed energy resources (DERs) and general interoperability requirements of DERs, but these requirements were built with PV and battery systems in mind. Fuel cells have different operational requirements, and therefore these requirements need to be appropriately modified for the grid operators to use. These additional steps add to the investment and operational cost to the grid operators. Through the ARIES platform, this proposed project aims to bridge this gap and use power hardware-in-the-loop (PHIL) and controller hardware-in-the-loop (CHIL) experiments to inform the creation of open-source interconnection and interoperability information that can aid in faster and cheaper installation and operation of grid-forming fuel cell inverters.

08 HYDROGEN↗

EUI Benchmarks for Net-Zero Energy Buildings in India

In our study we present EUI benchmarks for NZEBs for six building types across residential and non-residential typologies and for India's five climate zones. This approach is similar to the simulation-based benchmarks used by the B3 program in Minnesota, the Cal-Arch methodology in California, and the US Solar Decathlon approach, which combine simulations with actual building data. Of the six building types we explore one in detail with a range of operation scenarios, specifically narrowing down the EUI benchmarks for mixed-mode building operation and for variable temperature set-points as prescribed in the National Building Code of India.The contribution of this work is to provide rigorous end-use level EUI benchmarks for six building types, and to describe a method for simulation-based EUI benchmarks for mixed-mode operation with variable setpoints to highlight the difference between the standard approach used for the five building types and the On-Site Construction Worker Housing which additionally has the mixed-mode variable setpoint approach.On-Site Construction Worker Housings are typically poorly constructed temporary structures, without adequate thermal comfort, It is critical to provide adequate thermal comfort to protect people from the warming effects of climate change, and to discover super efficient and cost-effective ways to do so.The methodology used for the On-Site Construction Worker Housing (CWH) results in an 80% acceptability according to the India Model for Adaptive Comfort in the National Building Code of India. EUIs of all six buildings are 60% lower than the minimum compliance with India's Energy Conservation Building Codes, providing benchmarks for efficiency levels. The end-use level EUI benchmarks are now provided to over 1800 Solar Decathlon India participants so that they can compare the performance of their NZEB designs.In particular, the CWH results provide an insight into the importance of the mixed-mode operation with variable temperature set-points. The results from the simulation study show that for an NZEB target, the EUI with standard thermal comfort model and without mixed operation is 58.26 kWh/m2*year, while that with the variable set-points of the adaptive model with mixed mode operation is 24.23 kWh/m2*year. This is a 58% reduction in EUI. Given that many building types including residential, and non-residential operate in mixed mode, it is important to take this work further to develop mixed-mode operation NZEB benchmarks so that the carbon intensity of these buildings could be lower than the standard thermal comfort model approach.

benchmarking↗

Combining Generative Modeling and Advanced Control for Building Scenario Generation

Buildings make up a large portion of energy consumption in the U.S. today. Understanding their energy consumption patterns can improve their efficiency, but requires detailed models that rely on incomplete or unknown information. Previous work has shown that artificial intelligence (AI) can be used to predict missing information and even suggest upgrades to improve building efficiency. However, building upgrades may require undesirable upfront costs. Oppositely, advanced control could improve building efficiency with negligible upfront cost. To explore the tradeoffs between these two approaches, in this work we propose a workflow to compute optimal temperature setpoint schedules to minimize energy consumption and operational cost. Results show that modifying the temperature setpoints in a building using model predictive control (MPC) can effectively reduce its energy consumption and operational cost. This optimal operation cannot fully meet a desired goal. However, we show that by considering MPC in addition to component upgrades, a desired goal can be met with significantly less upfront costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-input, multi-output regulator design for constant disturbances and non-zero set points with application to automatic landing in a crosswind

Undesirable steady offsets result when a stationary, linear regulator using state feedback is subjected to constant disturbances and/or non-zero setspoints. To eliminate these offsets, the disturbances and non-zero setpoints can be fed forward to the control. Only when the number of outputs is less than or equal to the number of control inputs can the outputs be maintained at arbitrary non-zero setpoints. The state and the disturbance may be estimated using a constant gain Kalman filter or by modeling the constant disturbances as exponentially correlated processes with long correlation times.

Holley, W. E.↗

Actively controlled shaft seals for aerospace applications

This study experimentally investigates an actively controlled mechanical seal for aerospace applications. The seal of interest is a gas seal, which is considerably more compact than previous actively controlled mechanical seals that were developed for industrial use. In a mechanical seal, the radial convergence of the seal interface has a primary effect on the film thickness. Active control of the film thickness is established by controlling the radial convergence of the seal interface with piezoelectric actuator. An actively controlled mechanical seal was initially designed and evaluated using a mathematical model. Based on these results, a seal was fabricated and tested under laboratory conditions. The seal was tested with both helium and air, at rotational speeds up to 3770 rad/sec, and at sealed pressures as high as 1.48 x 10(exp 6) Pa. The seal was operated with both manual control and with a closed-loop control system that used either the leakage rate or face temperature as the feedback. The output of the controller was the voltage applied to the piezoelectric actuator. The seal operated successfully for both short term tests (less than one hour) and for longer term tests (four hours) with a closed-loop control system. The leakage rates were typically 5-15 slm (standard liters per minute), and the face temperatures were generally maintained below 100 C. When leakage rate was used as the feedback signal, the setpoint leakage rate was typically maintained within 1 slm. However, larger deviations occurred during sudden changes in sealed pressure. When face temperature was used as the feedback signal, the setpoint face temperature was generally maintained within 3 C, with larger deviations occurring when the sealed pressure changed suddenly.

Salant, Richard F.↗

Actively Controlled Shaft Seals for Aerospace Applications

This study experimentally investigates an actively controlled mechanical seal for aerospace applications. The seal of interest is a gas seal, which is considerably more compact than previous actively controlled mechanical seals that were developed for industrial use. In a mechanical seal, the radial convergence of the seal interface has a primary effect on the film thickness. Active control of the film thickness is established by controlling the radial convergence of the seal interface with a piezoelectric actuator. An actively controlled mechanical seal was initially designed and evaluated using a mathematical model. Based on these results, a seal was fabricated and tested under laboratory conditions. The seal was tested with both helium and air, at rotational speeds up to 3770 rad/sec, and at sealed pressures as high as 1.48 x 10(exp 6) Pa. The seal was operated with both manual control and with a closed-loop control system that used either the leakage rate or face temperature as the feedback. The output of the controller was the voltage applied to the piezoelectric actuator. The seal operated successfully for both short term tests (less than one hour) and for longer term tests (four hours) with a closed-loop control system. The leakage rates were typically 5-15 slm (standard liters per minute), and the face temperatures were generally maintained below 100C. When leakage rate was used as the feedback signal, the setpoint leakage rate was typically maintained within 1 slm. However, larger deviations occurred during sudden changes in sealed pressure. When face temperature was used as the feedback signal, the setpoint face temperature was generally maintained within 3 C, with larger deviations occurring when the sealed pressure changes suddenly. the experimental results were compared to the predictions from the mathematical model. The model was successful in predicting the trends in leakage rate that occurred as the balance ratio and sealed pressure changed, although the leakage rates were not quantitatively predicted with a high degree of accuracy. This model could be useful in providing valuable design information for future actively controlled mechanical seals.

Salant, Richard F.↗

Thermal analysis of HGFQ using FIDAP(trademark): Solidification front motion

The High Gradient Furnace with Quench (HGFQ) is being designed by NASA/MSFC for flight on the International Space Station. The furnace is being designed specifically for solidification experiments in metal and metallic alloy systems. The HGFQ Product development Team (PDT) has been active since January 1994 and their effort is now in early Phase B. Thermal models have been developed both by NASA and Sverdrup (support contractor) to assist in the HGFQ design effort. Both these models use SINDA as a solution engine, but the NASA model was developed using PATRAN and includes more detail than the Sverdrup model. These models have been used to guide design decisions and have been validated through experimentation on a prototypical 'Breadboard' furnace at MSFC. One facet of the furnace operation of interest to the designers is the sensitivity of the solidification interface location to changes in the furnace setpoint. Specifically of interest is the motion (position and velocity) of the solidification front due to a small perturbation in the furnace temperature. FIDAP(TM) is a commercially available finite element program for analysis of heat transfer and fluid flow processes. Its strength is in solution of the Navier-Stokes equations for incompressible flow, but among its capabilities is the analysis of transient processes involving radiation and solidification. The models presently available from NASA and Sverdrup are steady-state models and are incapable of computing the motion of the solidification front. The objective of this investigation is to use FIDAP(TM) to compute the motion of the solidification interface due to a perturbation in the furnace setpoint.

Woodbury, Keith A.↗

The Development of a Control System for a 5 Kilowatt Free Piston Stirling Space Convertor

The new NASA Vision for Exploration, announced by President Bush in January 2004, proposes an ambitious program that plans to return astronauts to the moon by the 2018 time frame. A recent NASA study entitled "Affordable Fission Surface Power Study" recommended a 40 kWe, 900 K, NaK-cooled, Stirling conversion for 2020 launch. Use of two of the nominal 5 kW converters allows the system to be dynamically balanced. A group of four dual-converter combinations that would yield 40 kWe can be tested to validate the viability of Stirling technology for space fission surface power systems. The work described in this paper deals specifically with the control system for the 5 kW convertor described in the preceding paragraph. This control system is responsible for maintaining piston stroke to a setpoint in the presence of various disturbances including electrical load variations. Pulse starting of the FSPE convertor is also an inherent part of such a control system. Finally, the ability to throttle the engine to match the required output power is discussed in terms of setpoint control. Several novel ideas have been incorporated into the piston stroke control strategy that will engender a stable response to disturbances in the presence of midpoint drift while providing useful data regarding the position of both the power piston and displacer.

Kirby, Raymond L.↗

Design and Testing of a Variable Pressure Regulator for the Constellation Space Suit

The next generation space suit requires additional capabilities for controlling and adjusting internal pressure than previous design suits. Next generation suit pressures will range from slight pressure, for astronaut prebreath comfort, to hyperbaric pressure levels for emergency medical treatment. Carleton was awarded a contract in 2008 to design and build a proof of concept bench top demonstrator regulator having five setpoints which are selectable using input electronic signaling. Although the basic regulator architecture is very similar to the existing SOP regulator used in the current EMU, the major difference is the electrical selectivity of multiple setpoints rather than the mechanical On/Off feature found on the SOP regulator. The concept regulator employs a linear actuator stepper motor combination to provide variable compression to a custom design main regulator spring. This concept allows for a continuously adjustable outlet pressures from 8.2 psid (maximum) down to "firm" zero thus effectively allowing it to serve as a shutoff valve. This paper details the regulator design and presents test results on regulation band width, command set point accuracy; slue rate and regulation stability, particularly when the set point is being slued. Projections for a flight configuration version are also offered for performance, architectural layout and weight.

Gill, Larry↗

The Development of a Control System for a 5 Kilowatt Free Piston Stirling Engine Convertor

The new NASA Vision for Exploration, announced by President Bush in January 2004, proposes an ambitious program that plans to return astronauts to the moon by the 2018 time frame. A recent NASA study entitled "Affordable Fission Surface Power Study" recommended a 40 kWe, 900 K, NaK-cooled, Stirling convertors for 2020 launch. Use of two of the nominal 5 kW convertors allows the system to be dynamically balanced. A group of four dual-convertor combinations that would yield 40 kWe can be tested to validate the viability of Stirling technology for space fission surface power systems. The work described in this paper deals specifically with the control system for the 5 kW convertor described in the preceding paragraph. This control system is responsible for maintaining piston stroke to a setpoint in the presence of various disturbances including electrical load variations. Pulse starting of the Free Piston Stirling Engine (FPSE) convertor is also an inherent part of such a control system. Finally, the ability to throttle the engine to match the required output power is discussed in terms of setpoint control. Several novel ideas have been incorporated into the piston stroke control strategy that will engender a stable response to disturbances in the presence of midpoint drift while providing useful data regarding the position of both the power piston and displacer.

Kirby, Raymond L.↗

Spacecraft Radiator Freeze Protection Using a Regenerative Heat Exchanger

An active thermal control system architecture has been modified to include a regenerative heat exchanger (regenerator) inboard of the radiator. Rather than using a radiator bypass valve a regenerative heat exchanger is placed inboard of the radiators. A regenerator cold side bypass valve is used to set the return temperature. During operation, the regenerator bypass flow is varied, mixing cold radiator return fluid and warm regenerator outlet fluid to maintain the system setpoint. At the lowest heat load for stable operation, the bypass flow is closed off, sending all of the flow through the regenerator. This lowers the radiator inlet temperature well below the system set-point while maintaining full flow through the radiators. By using a regenerator bypass flow control to maintain system setpoint, the required minimum heat load to avoid radiator freezing can be reduced by more than half compared to a radiator bypass system.

Ungar, Eugene K.↗

Geoscience Laser Altimetry System (GLAS) Loop Heat Pipe Anomaly and On Orbit Testing

The Geoscience Laser Altimetry System (GLAS) is the sole instrument on the ICESat Satellite. On day 230 of 2003, the GLAS Component Loop Heat Pipe (CLHP) entered a slow circulation mode that resulted in the main electronics box reaching its hot safing temperature, after which the entire instrument was turned off. The CLHP had a propylene working fluid and was actively temperature controlled via a heater on the compensation chamber. The slow circulation mode happened right after a planned propulsive yaw maneuver with the spacecraft. It took several days to recover the CLHP and ensure that it was still operational. The recovery occurred after the entire instrument was cooled to survival temperatures and the CLHP compensation chamber cycled on a survival heater. There are several theories as to why this slow circulation mode exhibited itself, including: accumulation of Non-Condensible Gas (NCG), the secondary wick being under designed or improperly implemented, or an expanded (post-launch) leak across the primary wick. Each of these is discussed in turn, and the secondary wick performance is identified as the most likely source of the anomalous behavior. After the anomaly, the CLHP was controlled to colder temperatures to improve its performance (as the surface tension increases with lower temperature, as does the volume of liquid in the compensation chamber) and only precursor pulses occurred later in the mission. After GLAS s last laser failed, in late 2009, a decision was made to conduct engineering tests of both LHPs to try and duplicate this flight anomaly. The engineering tests consisted of control setpoint changes, sink changes, and one similar propulsive Yaw maneuver. The only test that showed any similar anomaly precursors on the CLHP was the propulsive maneuver followed by a setpoint increase. The ICESat Satellite was placed in a decaying orbit and ended its mission on August 30, 2010 in Barents Sea.

Baker, Charles↗

Cryobotics: Extreme Cold Environment Testing

The extreme cold environment test chamber was designed to conduct research in cryobotics; an area of study that focuses on robotic systems and rotating machinery operating in extreme cold environments including Earth, low Earth orbit, Mars, Moon, asteroids, Solar orbit, planetary orbit, or those encountered during travel among these destinations. The test chamber incorporates a modular dynamometer, consisting of a variety of brakes, torque sensors and motors to be easily interchanged between tests. Each test employs a unique test profile that incorporates different setpoints of applied torques and velocities for a given period or number of revolutions. The modularity of the dynamometer setup allows for any combination of motor, gearbox to be tested. The chamber has been used to run tests for various projects including Bulk Metallic Glass Gears (BMGG), Volatiles Investigating Polar Exploration Rover (VIPER), Intelligent Payload Experiment (IPEX), and Pilot Excavator. Various upgrades have been made to the extreme cold environment test chamber for the use of cryobotic research. These upgrades greatly increased the autonomous capabilities of the test set up by providing redundancies in the hardware and software. The redundancies were primarily added to protect the integrity of the cryohead. A new strapping and insulation method was performed to create the thermal conductive path from the actuators to the cryohead. The software was upgraded to include temperature setpoint control, further increasing the autonomous capabilities of the test. This paper goes into detail regarding the upgrades made to the extreme cold environment test chamber, as well as highlights the results from a COLDArm acceptance test.

Jonathan Drew Smith↗

Flexible Reinforcement Learning Framework for Building Control using EnergyPlus-Modelica Energy Models

In recent years, reinforcement learning (RL) methods have been greatly enhanced by leveraging deep learning approaches. RL methods applied to building control have shown potential in many applications due to their ability to complement or replace conventional methods such as model-based or rule-based controls. However, RL-based building control software is likely tailored either to one target building system or to a specific RL method so that significant additional effort would be required to customize the RL-based controller for use in other building systems or with other RL approaches. Also, RL-based building controls usually depend on building energy simulations to train controllers, so emulating building dynamics (i.e., thermal dynamics and control dynamics) and capturing sub-hourly dynamic profiles are crucial to further the development of effective RL-based building control methods. To address these challenges, we present an open source RL-based control software employing a high-fidelity hybrid EnergyPlus-Modelica building energy model which emulates building dynamics at 1-minute resolution. This software consists of decoupled components (environment, building emulator, control agent, and RL algorithm), which allows for quick prototyping and benchmarking of standard RL algorithms in different systems; for example, a single component can be replaced without revising all of the software. To demonstrate this software framework, we conducted a benchmark study using an EnergyPlus-Modelica building energy model for a Chicago office building with an RL-based controller to dynamically control the chilled water temperature setpoint and the air handling unit supply air temperature setpoint on selected floors.

Lee, Joon-Yong↗