Engineering topics

Kim, Donghun

Publications and source records attributed to Kim, Donghun.

At least 19 records

DOE OSTI2026

Approximation of refrigerant thermophysical properties using neural networks to speed up transient thermofluid simulations

Accurate and efficient evaluations of refrigerant thermophysical properties and their partial derivatives are essential for transient simulations of thermofluid systems, where several computations need to be executed at each integration time step. Since the utilization of an Equation of State for retrieving properties based on a pair of independent inputs typically involves numerical iterations in solution procedures, when the input variables differ from the refrigerant state variables employed in dynamic models, a variety of approaches including lookup table interpolation and curve fitting have been developed to explicitly approximate these properties based on the state variables, and consequently eliminate internal iterations. This paper presents an alternative method that exploits derivative-informed neural networks to model refrigerant properties explicitly from inputs of pressure and enthalpy, while ensuring consistent partial derivatives generated by differentiating the neural networks. Computational speed and accuracy of the proposed approach are demonstrated via transient simulations of a discretized heat exchanger model in Modelica, and comparisons against other property evaluation routines. Simulation results indicate that the proposed approach can realize a significant speedup with negligible discrepancies in predicted transients. The method is implemented in an open-source Modelica library.

Ma, Jiacheng↗

DOE OSTI2026

Digitizing Today’s Buildings in the Real World: Lessons from Field Demonstrations

Digital twins, created by generating a virtual replica of a building, enable safe evaluation of operational scenarios and applications like fault detection and diagnosis and advanced controls. However, a prerequisite is the creation of a machine-readable digital representation of a building, currently hindered by fragmented information scattered across mechanical drawings, point lists, and natural language sequences. As a result, digital twin development remains labor-intensive, error-prone, and difficult to validate. To address these challenges, two efforts from ASHRAE aim to support the digitalization of buildings. ASHRAE s223 establishes a semantic model of buildings, representing system components, configuration, and data sources. ASHRAE s231 defines a vendor-neutral programming language for expressing their control logic. As the industry evaluates implementing them in their products, understanding the challenges that vendors and implementers may face is crucial. In this paper, we present findings and lessons learned from field demonstrations in five buildings that implemented control applications using ASHRAE s223 and s231. The demonstrations highlight how semantic modeling and formalized control descriptions can significantly reduce software development time, manual point mapping, and hard-coding. Beyond time efficiency, they enable reliable automation by minimizing human interpretation and providing a means for consistency across projects. We describe the processes and best practices for model creation and model usage, from translating heterogeneous building documentation into semantic representations to implementing control logic in real-world systems. Finally, we discuss the challenges that persist, including integration with legacy software environments, gaps in interoperability, and the level of expertise still required to effectively leverage semantic models.

Prakash, Anand Krishnan↗

DOE OSTI2026

Prime Time for Model-Predictive Control? Assessing the Technical and Market Readiness of Advanced Controls in Buildings

Despite three decades of extensive research and field testing that have consistently validated the benefits of Model Predictive Control (MPC) in building applications, the technology has seen limited market adoption. This paper evaluates the readiness of MPC for widespread deployment, showcases recent demonstrations and field tests across diverse building types, including residential, small commercial, large commercial, and campus settings. Our results demonstrate that MPC can optimize system operations to achieve load shifting, minimize curtailment of on-site generation, and reduce energy costs by up to 80 %, while maintaining or improving occupant comfort. We also show that MPC can effectively control large assets, such as MW-sized thermal storage systems, and respond to dynamic pricing signals. However, achieving scale remains difficult due to labor-intensive workflows, reliance on a “PhD-in-the-loop” for MPC design and maintenance, susceptibility to fragile data infrastructure, and persistent workforce education and acceptance barriers. To bridge this gap, we outline a transition from bespoke, labor intensive prototypes toward streamlined, segment-targeted deployment strategies that leverage model templates, semantic tools, and generative AI. By automating control configuration and reducing engineering effort, these recommendations provide a pathway for transforming successful research demonstrations into scalable, market ready solutions for MPC-based controls.

Pritoni, Marco↗

DOE OSTI2026

Field testing and validation of a low-cost MPC for demand flexibility for grid-interactive K-12 schools

K-12 school buildings account for the highest energy consumption within the public sector. Implementing advanced HVAC controls in grid-interactive K-12 schools could bring substantial economic advantages and grid flexibility. Our previous study demonstrated that a low-cost model predictive control (MPC) solution, which coordinates multiple packaged units, can enable demand flexibility without major hardware upgrades. However, a significant gap remains between academic pilots and market-ready scalable solutions. This paper extends the previous single-site pilot to a multi-site demonstration involving three school campuses (95 total units) through a commercial technology transfer process. Addressing the challenge of verifying performance with sparse field data, we present a new statistical approach using Bayesian methods to estimate the MPC’s effect on peak demand. Unlike traditional methods, this approach robustly quantifies uncertainty in non-normal, limited datasets. The results confirm the solution’s replicability, achieving a 21.6–38.9% reduction in HVAC peak demand (10.8–22.1% at the site-level) with > 98% probability across diverse locations. Finally, we document critical barriers to scaling software-as-a-service (SaaS) solutions–such as API instability and diverse legacy systems–and offer practical strategies to accelerate the commercial adoption of grid-interactive efficient buildings.

Ham, Sang Woo↗

DOE OSTI2026

A practical control strategy for demand flexibility with ensured occupant comfort in grid-interactive efficient buildings

This study proposes a practical and simplified demand response (DR) control strategy from the perspective of grid-interactive efficient buildings (GEBs), aiming to secure demand flexibility while ensuring occupant thermal comfort. Focusing on summer on-peak periods, a linear demand response (LDR) strategy that integrates cooling setpoint adjustment and lighting dimming was designed, and its performance was quantitatively evaluated. A case study was conducted using EnergyPlus-based simulations for a U.S. DOE small office prototype building under summer on-peak weather conditions. Compared with a conventional rapid demand response (RDR) strategy, the proposed LDR approach gradually reduced electrical loads while maintaining occupant thermal comfort indices, including predicted mean vote (PMV) and predicted percentage of dissatisfied (PPD), within acceptable comfort ranges. Quantitative analysis of demand flexibility using the grid-interactive impact index (GII) and the flexibility strength index (FSI) showed that the LDR strategy provided approximately 12.5% demand flexibility during DR periods and achieved an electricity cost reduction of about 8.8%. In addition, the results of the part-load ratio (PLR)-based cooling system performance analysis showed that, in the on-peak period, the LDR strategy exhibited improved cooling performance compared with the baseline. Overall, this study shows the potential of a practical DR control strategy that can simultaneously achieve occupant comfort and demand flexibility without relying on complex advanced control technologies.

Jung, Dong Eun↗

DOE OSTI2026

Virtual refrigerant charge sensor for variable-speed heat pumps based on feature selection

The refrigerant charge level in heat pump systems significantly impacts their energy efficiency. Virtual refrigerant charge (VRC) sensing technology has been comprehensively investigated and well-established due to its lower cost compared to physical sensors. However, the previous VRC research often relied on expert judgment and physical reasoning for their variable selection, which can potentially select redundant (or highly correlated) or insignificant features, and it is also primarily focused on single-speed systems. To address these challenges, this study proposes a VRC algorithm for variable-speed heat pumps that selects features through a rigorous feature selection method in combination with physical insights. We also propose a piecewise linear model structure segmented by subcooling temperature to accurately predict charge levels, particularly when subcooling temperatures are substantially low. The proposed algorithm was evaluated using experimental data of a residential R410A heat pump, and the performance was compared with two baseline VRC algorithms. The results are: (1) The proposed algorithm outperforms for the case with subcooling temperature less than 1 °C. (2) The proposed algorithm achieves a tested mean absolute percentage error (MAPE) of 4.23%, and improves the overall accuracy for cooling conditions by approximately 60%, compared with the two baseline algorithms. (3) The proposed algorithm uses two fewer features and improves the accuracy for undercharge cooling conditions by 68.0%, compared with baseline algorithm 2. These improvements enhance prediction accuracy and prevent overfitting, providing a more reliable refrigerant charge level prediction and helping improve the heat pump energy efficiency.

Liang, Chenjiyu↗

DOE OSTI2026

Seasonal performance evaluation of zero-superheat active refrigerant charge control for variable-speed heat pumps

Heat pumps account for a significant portion of electricity consumption in buildings, making their energy efficiency a critical area of research. Control optimization is recognized as an effective approach for enhancing the efficiency of building HVAC systems. Specifically, since the efficiency of heat pumps increases with reduced superheat and the optimal refrigerant charge level varies with operating conditions, zero-superheat active charge control is a promising strategy to maximize the system’s COP. However, due to its complexity, this control strategy remains in the research phase and has only been tested under limited operating conditions. This paper proposes a methodology to evaluate the seasonal performance improvement of zero-superheat active charge control across a full range of heating conditions in buildings. The methodology includes the development of an optimal controller that utilizes an accumulator to store excess refrigerant and manages the active charge level at zero superheat through subcooling control, as well as the creation of a detailed physics-based heat pump model. Targeted a 3-ton variable-speed heat pump with R410A refrigerant, we selected ten U.S. cities representing different climate regions for seasonal performance evaluation. Our simulations indicate that, depending on the climate conditions, the optimal control strategy could achieve energy savings ranging from 5.8 % to 8.0 % over the entire heating season. These results suggest that zero-superheat active charge control, combined with coordinated compressor and fan speeds, could substantially improve the energy efficiency of heat pump systems while maintaining the required heating capacity.

Guo, Fangzhou↗

DOE OSTI2025

Tensorized Interior Radiative Heat Transfer for a Scalable and Calibrated Building Energy Simulator

Building energy simulation is a critical tool for developing and testing advanced control strategies, such as Reinforcement Learning (RL), to provide demand flexibility and affordable energy costs. The recently introduced Smart Buildings Control Suite (sbsim) provides a lightweight, scalable, and data-calibrated simulation environment based on a 2D finite-difference model. However, the initial model primarily focused on conductive and convective heat transfer, neglecting the significant impact of long-wave radiative heat exchange between interior surfaces. This paper presents a significant extension to the sbsim framework by incorporating a physically-grounded model for interior radiative heat transfer. Our primary contribution is the development and integration of a fully tensorized radiative heat transfer module, which preserves the computational efficiency and scalability of the original simulator. This was achieved by developing a pipeline for view factor calculation, including an algorithm to identify directly seeing surfaces within complex floor plans, and formulating the net radiation equations for efficient execution on modern hardware accelerators. We validate the numerical accuracy of our tensorized implementation by comparing its results against a traditional iterative approach, demonstrating identical outcomes. This enhancement increases the physical fidelity of sbsim, enabling more accurate training of RL agents for building energy optimization.

Ham, Sang woo↗

DOE OSTI2025

Reinforcement Learning Control for Buildings Co-Optimizing Energy, Comfort, and Indoor Air Quality: An Annual Assessment

Efficient control of Heating, Ventilation, and Air Conditioning (HVAC) systems is crucial for optimizing energy use and maintaining indoor comfort in buildings. Traditional control methods, such as PID control, cannot handle energy use trade-offs among multiple components in the building energy system at a supervisory level. Reinforcement learning (RL) presents a promising solution, offering adaptive and data-driven control strategies that optimize performance over time. However, RL also faces several challenges, including the conflicts encountered in co-optimizing energy savings, occupant comfort, and indoor air quality, and the requirement for extensive interactions with the environment in training. We proposed a flexible simulation platform that integrates a hybrid model for RL training and designed an RL agent to control the entire central HVAC system, focusing on co-optimizing energy consumption, thermal comfort, and indoor air quality ($\text{CO}_{2}$ and PM2.5 concentrations). Finally, we evaluated the RL agent's performance over an annual cycle. Our findings indicate that the RL agent can effectively manage the HVAC system with 14.7 % energy savings annually and balance multiple objectives, which demonstrates significant potential for improving HVAC system control and sustainability in buildings.

Guo, Fangzhou↗

DOE OSTI2025

Virtual Refrigerant Charge Sensing Method for Next-Generation Refrigerant in Residential Heat Pumps

The charge level of refrigerant in heat pump systems significantly affects their operational performance. Virtual refrigerant charge (VRC) sensing technology has been well-established for traditional refrigerants (HFCs and HCFCs) for its low cost compared to physical sensors. However, other than traditional refrigerants, HFOs are increasingly used in next-generation heat pumps; whether these conventional VRC sensing methods remain applicable for heat pump systems utilizing next-generation refrigerants requires further investigation. To address these issues, this study develops a low-cost VRC sensing method for next-generation refrigerant heat pumps used in residential buildings. The developed algorithm is evaluated by using simulation models to evaluate the accuracy, considering an R454B heat pump with a nominal heating capacity of 51K Btu/hr (14.95 kW) as an example, and compared with those of the two reference VRC sensing algorithms. Though the developed VRC sensing algorithm and the two reference methods can accurately predict the charge level for the R454B heat pump system (with mean absolute percentage error for various cooling and heating conditions less than 7%), the developed VRC sensing algorithm uses fewer sensors and improves the overall accuracy for heating conditions by 7.1%, and the accuracy for undercharge cooling conditions 14.2%, compared with a mainstream algorithm. This technology will complement physical leakage detectors, and promote the adoption of next-generation heat pump systems, along with reducing wasted energy and maintenance costs.

Liang, Chenjiyu↗

DOE OSTI2025

Designing reinforcement learning algorithms for building HVAC control: From experimental observation to simulation comparisons

Advanced supervisory-level control with reinforcement learning (RL) is regarded as a promising solution for HVAC systems to minimize energy consumption while maintaining thermal comfort and indoor air quality. However, most RL applications were conducted in the simulation environment rather than real-world HVAC systems. This paper developed a value-based RL controller termed Deep Q-Network (DQN) for a typical central HVAC system and evaluated its performance in a building test facility. By comparing DQN with a rule-based controller, the study not only demonstrated the cases where DQN could properly maintain indoor comfort but also discussed possible reasons why DQN failed in some other situations. Recognizing the limitations of value-based RL algorithms from the experimental tests, a simulation study was conducted to compare DQN with an alternative RL approach, an actor–critic algorithm termed Deep Deterministic Policy Gradient (DDPG). In scenarios with a relatively large action space, DDPG outperformed DQN by requiring fewer computational resources and achieving better thermal comfort, lower energy consumption, and more stable control actions. The findings suggest that the ability of DDPG to handle continuous control variables more effectively allows for faster convergence in training and more precise control in practice, which enhances the overall efficiency and reliability of the HVAC system.

Guo, Fangzhou↗

DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗

DOE OSTI2024

Reduced-dimension Bayesian optimization for model calibration of transient vapor compression cycles

Development and calibration of first-principles dynamic models of vapor compression cycles (VCCs) is of critical importance for applications that include control design and fault detection and diagnostics. Nevertheless, the inherent complexity of models that are represented by large systems of differential–algebraic equations leads to significant challenges for model calibration processes that utilize classical gradient-based methods. Bayesian optimization (BO) is a sample-efficient and gradient-free approach using a probabilistic surrogate model and optimal search over a feasible parameter space. Despite the benefits of BO in reducing computational costs, challenges remain in dealing with a high-dimensional calibration task resulting from a large set of parameters that have significant impacts on system behavior and need to be calibrated simultaneously. This paper presents a reduced-dimension BO framework for calibrating transient VCCs models where the calibration space is projected to a low-dimensional subspace for accelerating convergence of the solution algorithm and consequently reducing the number of transient simulations. The proposed approach was demonstrated via two case studies associated with different VCC applications where 10 parameters were calibrated in each case using laboratory measurements. The reduced-dimension BO framework only required 1 / 8 th of the iterations associated with a standard BO method that deals with high-dimensional calibration parameters for converged solutions and yielded comparable accuracy. Furthermore, both calibrated models revealed significant accuracy improvements compared to uncalibrated models.

Ma, Jiacheng↗

DOE OSTI2024

HP-FLEX MPC v0.1.0

HP-FLEX MPC is control software developed by Lawrence Berkeley National Laboratory with support from the California Energy Commission (CEC) through EPIC-19-301. HP-FLEX aims to provide load flexibility for heat pumps (HPs) in response to dynamic grid signals (including Time-of-Use, Dynamic Pricing, and Critical Peak Pricing) while maintaining thermostat temperatures within user-specified bounds. The software includes a system-identification module, which models the dynamics of the building envelope with thermostat data, and a control module based on a model predictive controller (MPC) to make optimal decisions. HP-FLEX receives forecasts of outdoor air temperature, solar irradiation, and internal gain (if available), as well as trajectories of energy price, temperature lower and upper bounds over a prediction horizon. It then optimizes heating and cooling capacities to minimize energy cost and peak power (with a user-defined weight on peak power) over the prediction horizon, while maintaining room air temperature within the temperature constraints, and outputs the optimal thermostat setpoints.

Kim, Donghun↗

DOE OSTI2024

Practical challenges of model predictive control (MPC) for grid interactive small and medium commercial buildings

To the urgent call for mitigating climate change, substantial initiatives have been undertaken to deploy grid-interactive heating, ventilation, and air-conditioning (HVAC) controls, such as model predictive control (MPC) for buildings. These efforts typically aim to curtail peak energy demand, shift load and enhance overall energy efficiency. With the recent development of low-cost MPC technologies that don’t require extensive instrumentation or manual modeling, small and medium commercial buildings (SMCBs), which rarely utilize advanced HVAC control systems, have become candidates for grid-interactive efficient buildings (GEBs). However, despite the potential benefits and maturity of the technology itself, several practical challenges remain in real-world implementation. In this paper, we share the practical challenges that we have encountered in implementing and testing three types of MPC solutions (ON/OFF unit, dualfuel, and VRF systems) on multiple SMCB sites. We describe the MPC deployment process and discuss the lessons learned. The site selection, eligibility, and retrofit availability (e.g., utility price structure, thermostat communications, etc.) are the main discussion points at the beginning of the project. Also, the modeling automation and the best practices for interacting with endusers and handling erroneous situations are presented for successful operations.

woo Ham, Sang↗

DOE OSTI2024

Decarbonization of heat pump dual fuel systems using a practical model predictive control: Field demonstration in a small commercial building

In the transition from fossil fuel to electrified heating, a concerning trend is emerging in certain regions of the US. Owners of buildings with gas-based systems leave them in place after adding heat pumps (HPs). Existing control solutions for these hybrid (dual fuel) systems are rudimentary and fall short of realizing the full carbon reduction potential of these systems. Model predictive control (MPC) is often regarded as the benchmark for achieving optimal control in integrated systems. However, in the case of small-medium commercial buildings (SMCBs), the control and communication infrastructure required to facilitate the implementation of such advanced controls is often lacking. This paper presents a field implementation of easy-to-deploy MPC for a dual fuel heating system consisting of HPs and a gas-fired furnace (GF) for SMCBs. The control system is deployed on an open-source middleware platform and utilizes low-cost sensor devices to be used for real SMCBs without major retrofits. Here, we demonstrated this MPC in a real office building with 5 HPs and 1 GF for 2 months. The test results showed that MPC reduced 27% of cost while completely eliminating GF usage by shifting 23% of the thermal load from occupied-peak time to non-occupied-non-peak times.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Hot, cold, or just right? An infrared biometric sensor to improve occupant comfort and reduce overcooling in buildings via closed-loop control

To improve occupant comfort and save energy in buildings, we have developed a closed-loop air conditioning (AC) sensor-controller that predicts occupant thermal sensation from the thermographic measurement of skin temperature distribution, then uses this information to reduce overcooling (cooling-energy overuse that discomforts occupants) by regulating AC output. Taking measures to protect privacy, it combines thermal-infrared (TIR) and color (visible spectrum) cameras with machine vision to measure the skin-surface temperature profile. Since the human thermoregulation system uses skin blood flow to maintain thermoneutrality, the distribution of skin temperature can be used to predict warm, neutral, and cool thermal states. We conducted a series of human-subject thermal-sensation trials in cold-to-hot environments, measuring skin temperatures and recording thermal sensation votes. We then trained random-forest classification machine-learning models (classifiers) to estimate thermal sensation from skin temperatures or skin-temperature differences. The estimated thermal sensation was input to a proportional integral (PI) control algorithm for the AC, targeting a sensation level between neutral and warm. Our sensor-controller includes a sensor assembly, server software, and client software. The server software orients the cameras and transmits images to the client software, which in turn assesses occupant skin temperature distribution, estimates occupant thermal sensation, and controls AC operation. A demonstration conducted in a conference room in an office building near Houston, TX showed that our system reduced overcooling, decreasing AC load by 42% when the room was occupied while improving occupant comfort (fraction of “comfortable” votes) by 15 percentage points.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Development of Building Design Optimization Methodology: Residential Building Applications

Building design optimization is a highly complex problem, requiring long computational running processes because of the many options that exist when a building is being designed. This paper introduces an integrated approach through which to perform this optimization within an acceptable time frame. The approach includes the methods of variable selection, model simplification, and a sequential optimization process. Using singular value decomposition, a large number of design variables is reduced to a smaller subset that can be solved more quickly through the optimization algorithm. To expedite the variable selection process, a modeling approach that quickly simulates annual energy consumption was developed to replace full annual energy simulations. The developed methodology was applied to two residential buildings in the US, and the results are discussed herein. To assess the accuracy of the integrated optimization methodology, the optimized life cycle costs are compaa variables demonstrating the strongest contributions in the optimization study were identified. The proposed methodology significantly shortened the time requirements for the optimization processes of the two case studies by 74% and 84%; the optimized life cycle costs were within 0.05% and 0.06%, respectively, of the optimum point.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗