Search NASA⌕ Search

SEARCH · Search NASA

Results for “control methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

CO2 Acquisition Membrane (CAM)

The objective of CAM is to develop, test, and analyze thin film membrane materials for separation and purification of carbon dioxide (CO2) from mixtures of gases, such as those found in the Martian atmosphere. The membranes are targeted toward In Situ Resource Utilization (ISRU) applications that will operate in extraterrestrial environments and support future unmanned and human space missions. A primary application is the Sabatier Electrolysis process that uses Mars atmosphere CO2 as raw material for producing water, oxygen, and methane for rocket fuel and habitat support. Other applications include use as an inlet filter to collect and concentrate Mars atmospheric argon and nitrogen gases for habitat pressurization, and to remove CO2 from breathing gases in Closed Environment Life Support Systems (CELSS). CAM membrane materials include crystalline faujasite (FAU) zeolite and rubbery polymers such as silicone rubber (PDMS) that have been shown in the literature and via molecular simulation to favor adsorption and permeation of CO2 over nitrogen and argon. Pure gas permeation tests using commercial PDMS membranes have shown that both CO2 permeance and the separation factor relative to other gases increase as the temperature decreases, and low (Delta)P(Sub CO2) favors higher separation factors. The ideal CO2/N2 separation factor increases from 7.5 to 17.5 as temperature decreases from 22 C to -30 C. For gas mixtures containing CO2, N2, and Ar, plasticization decreased the separation factors from 4.5 to 6 over the same temperature range. We currently synthesize and test our own Na(+) FAU zeolite membranes using standard formulations and secondary growth methods on porous alumina. Preliminary tests with a Na(+) FAU membrane at 22 C show a He/SF6 ideal separation factor of 62, exceeding the Knudsen diffusion selectivity by an order of magnitude. This shows that the membrane is relatively free from large defects and associated non-selective (viscous flow) transport mechanisms. The Membrane Test Facility (MTF) has been developed to measure membrane permeance over a wide range of temperature and pressure. The facility uses two volume compartments separated by the membrane that are instrumented to measure temperature, delta pressure across the membrane, and gas composition. A thermal shroud supports and encloses the membrane, and provides temperature control. Methods were developed to determine membrane permeance using the first order decay of the pressure difference between the sealed compartments, using the total pressure for pure gases, and partial pressure of each species in gas mixtures. The technique provides an end-to-end measurement of gas permeance that includes concentration polarization effects. Experiments have shown that in addition to membrane permeance properties, the geometry and design of associated structures play an important role in how membrane systems will function on Mars.

Mason, Larry W.↗
DOE OSTI2018

Experimental demonstration of hydraulic jump control in liquid metal channel flow using Lorentz force

Here in this paper, hydraulic jump control using electromagnetic force in a liquid metal flow is presented. The control methods used give insight into the hydraulic jump behavior in the presence of magnetic fields and electrical currents. Flowing liquid metals is a proposed solution to heat flux challenges posed in fusion reactors, specifically the tokamak. Unfortunately, thin, fast-flowing liquid metal divertor concepts for fusion reactors are susceptible to hydraulic jumps that drastically reduce the liquid metal flow speed, leading to potential problems such as excessive evaporation, unsteady power removal, and possible plasma disruption. Highly electrically conductive flows within the magnetic fields do not exhibit traditional hydraulic jump behavior. There is very little research investigating the use of externally injected electrical currents and magnetic fields to control liquid metal hydraulic jumps. By using externally injected electrical currents and a magnetic field, a Lorentz force (also referred to as j × B force) may be generated to control the liquid metal jump behavior. In this work, a free-surface liquid metal—GaInSn eutectic or “galinstan”$-$flow through an electrically insulating rectangular duct was investigated. It was shown that applying a Lorentz force has a repeatable and predictable impact on the hydraulic jump, which can be used for liquid metal control within next-generation fusion reactors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Experimental demonstration of hydraulic jump control in liquid metal channel flow using Lorentz force

In this paper, hydraulic jump control using electromagnetic force in a liquid metal flow is presented. The control methods used give insight into the hydraulic jump behavior in the presence of magnetic fields and electrical currents. Flowing liquid metals is a proposed solution to heat flux challenges posed in fusion reactors, specifically the tokamak. Unfortunately, thin, fast-flowing liquid metal divertor concepts for fusion reactors are susceptible to hydraulic jumps that drastically reduce the liquid metal flow speed, leading to potential problems such as excessive evaporation, unsteady power removal, and possible plasma disruption. Highly electrically conductive flows within the magnetic fields do not exhibit traditional hydraulic jump behavior. There is very little research investigating the use of externally injected electrical currents and magnetic fields to control liquid metal hydraulic jumps. By using externally injected electrical currents and a magnetic field, a Lorentz force (also referred to as j × B force) may be generated to control the liquid metal jump behavior. In this work, a free-surface liquid metal—GaInSn eutectic or “galinstan”—flow through an electrically insulating rectangular duct was investigated. It was shown that applying a Lorentz force has a repeatable and predictable impact on the hydraulic jump, which can be used for liquid metal control within next-generation fusion reactors.

MHD↗
NASA NTRS1999

Cathodes Delivered for Space Station Plasma Contactor System

The International Space Station's (ISS) power system is designed with high-voltage solar arrays that typically operate at output voltages of 140 to 160 volts (V). The ISS grounding scheme electrically ties the habitat modules, structure, and radiators to the negative tap of the solar arrays. Without some active charge control method, this electrical configuration and the plasma current balance would cause the habitat modules, structure, and radiators to float to voltages as large as -120 V with respect to the ambient space plasma. With such large negative floating potentials, the ISS could have deleterious interactions with the space plasma. These interactions could include arcing through insulating surfaces and sputtering of conductive surfaces as ions are accelerated by the spacecraft plasma sheath. A plasma contactor system was baselined on the ISS to prevent arcing and sputtering. The sole requirement for the system is contained within a single directive (SSP 30000, paragraph 3.1.3.2.1.8): "The Space Station structure floating potential at all points on the Space Station shall be controlled to within 40 V of the ionospheric plasma potential using a plasma contactor." NASA is developing this plasma contactor as part of the ISS electrical power system. For ISS, efficient and rapid emission of high electron currents is required from the plasma contactor system under conditions of variable and uncertain current demand. A hollow cathode plasma source is well suited for this application and was, therefore, selected as the design approach for the station plasma contactor system. In addition to the plasma source, which is referred to as a hollow cathode assembly, or HCA, the plasma contactor system includes two other subsystems. These are the power electronics unit and the xenon gas feed system. The Rocketdyne Division of Boeing North American is responsible for the design, fabrication, assembly, test, and integration of the plasma contactor system. Because of technical and schedule considerations, the NASA Lewis Research Center was asked to manufacture and deliver the engineering model, the qualification model, and the flight HCA units for the plasma contactor system as government furnished equipment. To date, multiple units have been built. One cathode has demonstrated approximately 28 000-hr lifetime, two development HCA units have demonstrated over 15 000-hr lifetime, and one HCA unit has demonstrated more than 38 000 ignitions. All eight flight HCA's have been manufactured, acceptance tested, and are ready for delivery to the flight contractor.

Patterson, Michael J.↗
NASA NTRS1991

Investigation of air transportation technology at Ohio University, 1990-1991

The status of the Joint University Program is given. Brief synopsis of some areas of research follow. The study of spectrum efficient methods for transmitting weather information to aircraft has resulted in definition of an improved amplitude and phase modulation process which permits reutilization of voice channels for both voice and data. The system is being implemented for testing. Multisensor navigation systems introduce increased flexibility and performance for aviation, at the expense of increased complexity. Insuring a high level of system reliability and integrity requires that faults not only be detected, but also isolated to specific elements, so that the remaining capabilities of the system may be used with confidence. An algorithm was developed. The JUP has served as a vehicle for reporting work accomplished in evoked potential vision tracking experiments to determine the engineering parameters of this input and control method. Application of GPS in an interferometric mode permits accurate measurement of differential motion; aircraft attitude may be determined using GPS only, with multiple antennas.

Lilley, Robert W.↗
NASA NTRS2010

Development of Supersonic Retro-Propulsion for Future Mars Entry, Descent, and Landing Systems

Recent studies have concluded that Viking-era entry system technologies are reaching their practical limits and must be succeeded by new methods capable of delivering large payloads (greater than 10 metric tons) required for human exploration of Mars. One such technology, termed Supersonic Retro-Propulsion, has been proposed as an enabling deceleration technique. However, in order to be considered for future NASA flight projects, this technology will require significant maturation beyond its current state. This paper proposes a roadmap for advancing the component technologies to a point where Supersonic Retro-Propulsion can be reliably used on future Mars missions to land much larger payloads than are currently possible using Viking-based systems. The development roadmap includes technology gates that are achieved through testing and/or analysis, culminating with subscale flight tests in Earth atmosphere that demonstrate stable and controlled flight. The component technologies requiring advancement include large engines capable of throttling, computational models for entry vehicle aerodynamic/propulsive force and moment interactions, aerothermodynamic environments modeling, entry vehicle stability and control methods, integrated systems engineering and analyses, and high-fidelity six degree-of-freedom trajectory simulations. Quantifiable metrics are also proposed as a means to gage the technical progress of Supersonic Retro-Propulsion. Finally, an aggressive schedule is proposed for advancing the technology through sub-scale flight tests at Earth by 2016.

Edquist, Karl T.↗
DOE OSTI2017

Engineering Considerations for Remote Refabrication of EBR-II Fuel Elements

The development of remote controlled methods for manufacturing EBR-II fuel elements was influenced by many interacting factors. Radiation levels within the process cell have been predicted to range from 10 3 to 10 7 rad per hour. Radiation damage to organic lubricant, electrical insulations, elastic seals, and protective coatings precludes the use of many standard machine components. Heat generated in the fuel by absorbed radiation makes forced cooling necessary in many operations. Oxygen must be exluded from all operations where the fuel is exposed. Equipment must be designed for remote maintenance and component replacement within the limitation of available manipulators. The EBR-II fuel consisted of fissium alloy pins sodium bonded in stainless steel tubes. Precision casting was chosen as the basis for refabricating the fuel pins. Remote controlled equipment was developed to cast, assemble, and inspect the EBR-II fuel elements. Radiation resistant, plug-in machine components were developed to give reasonable life expectancy and to allow remote maintenance and replacement.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2012

SCaN Testbed Software Development and Lessons Learned

National Aeronautics and Space Administration (NASA) has developed an on-orbit, adaptable, Software Defined Radio (SDR)Space Telecommunications Radio System (STRS)-based testbed facility to conduct a suite of experiments to advance technologies, reduce risk, and enable future mission capabilities on the International Space Station (ISS). The SCAN Testbed Project will provide NASA, industry, other Government agencies, and academic partners the opportunity to develop and field communications, navigation, and networking technologies in the laboratory and space environment based on reconfigurable, SDR platforms and the STRS Architecture.The SDRs are a new technology for NASA, and the support infrastructure they require is different from legacy, fixed function radios. SDRs offer the ability to reconfigure on-orbit communications by changing software for new waveforms and operating systems to enable new capabilities or fix any anomalies, which was not a previous option. They are not stand alone devices, but required a new approach to effectively control them and flow data. This requires extensive software to be developed to utilize the full potential of these reconfigurable platforms. The paper focuses on development, integration and testing as related to the avionics processor system, and the software required to command, control, monitor, and interact with the SDRs, as well as the other communication payload elements. An extensive effort was required to develop the flight software and meet the NASA requirements for software quality and safety. The flight avionics must be radiation tolerant, and these processors have limited capability in comparison to terrestrial counterparts. A big challenge was that there are three SDRs onboard, and interfacing with multiple SDRs simultaneously complicatesd the effort. The effort also includes ground software, which is a key element for both the command of the payload, and displaying data created by the payload. The verification of the software was an extensive effort. The challenges of specifying a suitable test matrix with reconfigurable systems that offer numerous configurations is highlighted. Since the flight system testing requires methodical, controlled testing that limits risk, a nearly identical ground system to the on-orbit flight system was required to develop the software and write verification procedures before it was installed and tested on the flight system. The development of the SCAN testbed was an accelerated effort to meet launch constraints, and this paper discusses tradeoffs made to balance needed software functionality and still maintain the schedule. Future upgrades are discussed that optimize the avionics and allow experimenters to utilize the SCAN testbed potential.

radio communication↗
DOE OSTI2025

Virtual to Physical: Reinforcement Learning to Optimize SNS Particle Accelerator Controls

Complex accelerators must have control systems that can handle dynamic nonlinear environments. This makes traditional control methods unsuitable as they can struggle to adapt to these uncertainties. This provides an ideal environment for reinforcement learning algorithms as they are adaptable and generalizable. We present a reinforcement learning pipeline that can effectively handle the dynamics of a complex accelerator. We test and prove our pipelines capabilities on multiple environments including the Spallation Neutron Source (SNS) and the Beam Test Facility (BTF) at Oakridge National Lab (ORNL). Due to the limited time available to train an online algorithm like reinforcement learning on a real accelerator, we utilize a virtual twin accelerator (VIRAC) developed by ORNL to pretrain the policy and show its ability to converge in the virtual environment. We then test the adaptability of the pretrained RL model by applying it on the real accelerator and comparing the results. Utilizing our Scientific Optimization and Controls Toolkit (SOCT) and open-source standards such as Gymnasium we create and solve for a MEBT orbit correction problem in the SNS and an emittance maximization problem in the BTF. We show how Twin Delayed Deep Deterministic Policy Gradient (TD3) can solve this optimization environment in the virtual accelerator and transfer this policy onto the real accelerator for inference and model retraining. We show how reinforcement learning can be utilized as a control system for complex accelerators and provide a model pipeline for how an implementation performs and can be adapted to new accelerator control problems.

Kasparian, Armen [Thomas Jefferson National Accele↗
NASA NTRSDate not supplied

3D Construction of Biologically Derived Materials

System for the 3D Construction of Biologically Derived Materials, Structures, and Parts NASA has developed a novel approach for macroscale biomaterial production by combining synthetic biology with 3D printing. Cells are biologically engineered to deposit desired materials, such as proteins or metals, derived from locally available resources. The bioengineered cells build different materials in a specified 3D pattern to produce novel microstructures with precise molecular composition, thickness, print pattern, and shape. Scaffolds and reagents can be used for further control over material product. This innovation provides modern design and fabrication techniques for custom-designed organic or organic-inorganic composite biomaterials produced from limited resources. Benefits Conserves resources. Few raw or bulk starting materials needed Enables custom design of diverse materials Fast, portable, macroscale, on-demand manufacturing High-fidelity microstructures Uses commercially available parts Applications Biomaterials, biotechnology Organic-inorganic composite materials On-demand manufacturing In situ resource utilization Space stations Military Infrastructure materials The Technology Once genes for a desired material type, delivery mode, control method and affinity have been chosen, assembling the genetic components and creating the cell lines can be done with well-established synthetic biology techniques. A 3D microdeposition system is used to make a 3D array of these cells in a precise, microstructure pattern and shape. The engineered cells are suspended in a printable 'ink'. The 3D microdeposition system deposits minute droplets of the cells onto a substrates surface in a designed print pattern. Additional printer passes thicken the material. The cell array is fed nutrients and reagents to activate the engineered genes within the cells to create and deposit the desired molecules. These molecules form the designed new material. If desired, the cells may be removed by flushing. The end product is thus a 3D composite microstructure comprising the novel material. This innovation provides a fast, controlled production of natural, synthetic, and novel biomaterials with minimum resource overhead and reduced pre- and post-processing requirements.

3D↗
NASA NTRS2018

LUVOIR Primary Mirror Segment Alignment Control With Joint Laser Metrology and Segment Edge Sensing

An approach is developed for the alignment and stability maintenance of the LUVOIR segmented primary mirror using a segment state estimation and wavefront control method based on a hybrid segment motion sensing architecture of laser truss metrology and segment edge sensors. Our current computer model was generated for LUVOIR Architecture Option A with a 15-meter aperture, 120segment primary mirror. The methodology and simulation results will be presented and analyzed. JPL has a long history of technology development in laser metrology and edge sensors, including work in SIM [7], Keck and TMT [8], CCAT [3] and LUVOIR [1]. We will discuss our current efforts of LUVOIR laser metrology and edge-sensor models development, showing sensitivities of sensor measurements to various mirror eigenmodes, removing global modes and strengthening weak modes by performing joint (hybrid) laser-metrology and edge sensing. We will define and derive an important performance metric called wavefront error multiplier (WEM), and show that WEM provides a simple link between sensor errors and the closed-loop (controlled) system wavefront error. We will show WEM values for several hybrid sensor configuration options studied. We will discuss an algorithm for mirror shape control and maintenance through segment state and wavefront estimations using joint edge-metrology sensing. We will compare simulated performance of mirror state estimation, wavefront estimation and wavefront control based on joint edge-metrology sensing among several sensor configurations, and show the impact of sensor error distributions on the segmented mirror alignment performance. Mirror shape control performance will be also be evaluated in terms of imaging contrast between inner working angles (IWA) and outer working angles (OWA) of a LUVOIR coronagraph. The research was carried out at the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration. LUVOIR is a mission concept under study for the next astronomy Decadal Survey—the information presented in this paper is pre-decisional and is provided for planning and discussion purposes only.

Shelton, Chris↗
DOE OSTI2022

Thermal storage system with coupled tanks

Methods and apparatus are disclosed for high-efficiency thermal storage with a fluid-filled “battery” tank positioned within a fluid-filled “reservoir” tank. Fluid loops couple the tanks to a heat pump and a building. The heat pump can charge the battery tank or deliver thermal energy (cold or heat) to a building, using the reservoir tank or ambient air as a thermal energy source. The battery tank can discharge energy to the building jointly with the heat pump or, at periods of peak electricity usage, with the heat pump switched off. Operating modes allow significant savings in electricity usage and mitigate the “duck curve.” Low duty cycle usage of the reservoir enables efficient underground thermal storage with less digging than conventional geothermal technologies. Additional efficiency is achieved with phase change materials installed inside a tank or in a tank wall, providing temperature regulation. Control methods are disclosed.

15 GEOTHERMAL ENERGY↗
NASA NTRS1992

Indian Ocean analyses

The background and goals of Indian Ocean thermal sampling are discussed from the perspective of a national project which has research goals relevant to variation of climate in Australia. The critical areas of SST variation are identified. The first goal of thermal sampling at this stage is to develop a climatology of thermal structure in the areas and a description of the annual variation of major currents. The sampling strategy is reviewed. Dense XBT sampling is required to achieve accurate, monthly maps of isotherm-depth because of the high level of noise in the measurements caused by aliasing of small scale variation. In the Indian Ocean ship routes dictate where adequate sampling can be achieved. An efficient sampling rate on available routes is determined based on objective analysis. The statistical structure required for objective analysis is described and compared at 95 locations in the tropical Pacific and 107 in the tropical Indian Oceans. XBT data management and quality control methods at CSIRO are reviewed. Results on the mean and annual variation of temperature and baroclinic structure in the South Equatorial Current and Pacific/Indian Ocean Throughflow are presented for the region between northwest Australia and Java-Timor. The mean relative geostrophic transport (0/400 db) of Throughflow is approximately 5 x 106 m3/sec. A nearly equal volume transport is associated with the reference velocity at 400 db. The Throughflow feeds the South Equatorial Current, which has maximum westward flow in August/September, at the end of the southeasterly Monsoon season. A strong semiannual oscillation in the South Java Current is documented. The results are in good agreement with the Semtner and Chervin (1988) ocean general circulation model. The talk concludes with comments on data inadequacies (insufficient coverage, timeliness) particular to the Indian Ocean and suggestions on the future role that can be played by Data Centers, particularly with regard to quality control of data as research bodies are replaced by operational bodies in the Global Ocean Observing System.

Meyers, Gary↗
DOE OSTI2025

Techno-Economic Analysis for the Addition of a Thermal Energy Storage System to a Central Plant

Increasing energy demand and rising peak loads present significant challenges for energy management in commercial and institutional settings. As climate change drives greater cooling needs, central plants must navigate the complex tradeoffs between operational efficiency, cost control, and grid stability. Thermal energy storage (TES) systems offer a viable solution by shifting energy consumption from peak to off-peak periods, thereby reducing peak demand, lowering utility expenses, and improving grid resilience. However, the success of TES implementation hinges on appropriate system sizing, effective control strategies, and alignment with local utility rate structures. This article presents a techno-economic analysis of integrating a chilled water TES system into the central plant at California State University, Dominguez Hills. Drawing on historical load profiles and utility tariffs, we assess three TES sizing approaches and their corresponding control strategies from both energy and economic perspectives. This article utilizes a model-based approach to assess the impact of TES sizing and control strategies on the techno-economic feasibility of integrating TES into an existing central plant. The models employed for this analysis were calibrated using 4 years of historical data. Here, the results demonstrated that utility tariffs and the campus's operational profiles dictate the most feasible sizing and control methods. The findings offer valuable insights for institutions and commercial building managers exploring sustainable energy solutions. By demonstrating how optimized TES strategies can improve operational efficiency while achieving financial savings, this study highlights the potential for TES to align performance with cost effectiveness in real-world applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

An Information Theoretic Approach to Identify Dominant Voltage Influencers for Unbalanced Distribution Systems

Smart distribution grid with multiple renewable energy sources can experience random voltage fluctuations due to variable generation, which may result in voltage violations. Traditional voltage control algorithms are inadequate to handle fast voltage variations. Therefore, new dynamic control methods are being developed that can significantly benefit from the knowledge of dominant voltage influencer (DVI) nodes. DVI nodes for a particular node of interest refer to nodes that have a relatively high impact on the voltage fluctuations at that node. Conventional power flow-based algorithms to identify DVI nodes are computationally complex, which limits their use in real-time applications. This paper proposes a novel information theoretic voltage influencing score (VIS) that quantifies the voltage influencing capacity of nodes with DERs/active loads in a three phase unbalanced distribution system. VIS is then employed to rank the nodes and identify the DVI set. VIS is derived analytically in a computationally efficient manner and its efficacy to identify DVI nodes is validated using the IEEE 37-node test system. It is shown through experiments that KL divergence and Bhattacharyya distance are effective indicators of DVI nodes with an identifying accuracy of more than 90%. Additionally, the computation burden is also reduced by an order of 5, thus providing the foundation for efficient voltage control.

42 ENGINEERING↗
DOE OSTI2024

Direct pulse-level compilation of arbitrary quantum logic gates on superconducting qutrits

Advanced simulations and calculations on quantum computers require high-fidelity implementations of quantum operations. The universal gateset approach builds complex unitaries from a small set of primitive gates, often resulting in a long gate sequence, which is typically a leading factor in the total accumulated error. Compiling a complex unitary for processors with higher-dimensional logical elements, such as qutrits, exacerbates the accumulated error per unitary, since an even longer gate sequence is required. Optimal control methods promise time- and resource-efficient compact gate sequences and, therefore, higher fidelity. These methods generate pulses that can directly implement any complex unitary on a quantum device. In this work, we demonstrate that any arbitrary qubit and qutrit gate can be realized with high fidelity, which can significantly reduce the length of a gate sequence. We generate and test pulses for a large set of randomly selected arbitrary unitaries on several quantum processing units (QPUs): the Lawrence Livermore National Laboratory Quantum Device and Integration Testbed’s (QuDIT’s) standard QPU and three of Rigetti’s QPUs: Ankaa-2, Ankaa-9Q-1, and Aspen-M-3. On the QuDIT platform’s standard QPU, the average fidelity of random qutrit gates is 97.9 ± 0.5% measured with conventional QPT and 98.8 ± 0.6% from QPT with gate folding. Rigetti’s Ankaa-2 achieves random qubit gates with an average fidelity of 98.4 ± 0.5% (conventional QPT) and 99.7 ± 0.1% (QPT with gate folding). On Ankaa-9Q-1 and Aspen-M-3, the average fidelities with conventional qubit QPT measurements were higher than 99% (see Appendix). Here we show that optimal control gates are robust to drift for at least 3 h and that the same calibration parameters can be used for all implemented gates. Our work promises that the calibration overheads for optimal control gates can be made small enough to enable efficient quantum circuits based on this technique.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Ten questions concerning reinforcement learning for building energy management

As buildings account for approximately 40% of global energy consumption and associated greenhouse gas emissions, their role in decarbonizing the power grid is crucial. The increased integration of variable energy sources, such as renewables, introduces uncertainties and unprecedented flexibilities, necessitating buildings to adapt their energy demand to enhance grid resiliency. Consequently, buildings must transition from passive energy consumers to active grid assets, providing demand flexibility and energy elasticity while maintaining occupant comfort and health. This fundamental shift demands advanced optimal control methods to manage escalating energy demand and avert power outages. Reinforcement learning (RL) emerges as a promising method to address these challenges. Here, in this paper, we explore ten questions related to the application of RL in buildings, specifically targeting flexible energy management. We consider the growing availability of data, advancements in machine learning algorithms, open-source tools, and the practical deployment aspects associated with software and hardware requirements. Our objective is to deliver a comprehensive introduction to RL, present an overview of existing research and accomplishments, underscore the challenges and opportunities, and propose potential future research directions to expedite the adoption of RL for building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Grey-box and ANN-based building models for multistep-ahead prediction of indoor temperature to implement model predictive control

Model-based predictive control (MPC) strategies for heating, ventilation, and air-conditioning (HVAC) systems present an opportunity to lower building energy consumption and operational costs. Such approaches rely on the development of a model to precisely forecast building thermal dynamics, such as room air temperature or heating/cooling rate, and make control-related decisions. The control-oriented modeling of building energy systems should be accurate in predicting indoor conditions and present low computational complexity. These features are the key challenge of implementing advanced control methods such as MPC. Extant studies on building modeling for MPC have focused on step-ahead forecasting techniques to forecast building thermal dynamics, while multistep-ahead forecasting is essential. Moreover, machine learning model suitable in case of the domain-based engineering expertise are also not available. To this aim, we perform a comparative analysis of the grey-box model based on a resistance-capacitance (RC) thermal network and a machine learning model composed of an artificial neural network (ANN) for multistep-ahead prediction of building thermal dynamics using current and historical data. Actual experimental data obtained from the Flexible Research Platform (FRP) in Oak Ridge National Laboratory (US) are used for estimation and validation purposes. The average root mean squared error (RMSE) of the grey-box and ANN models are 0.89 °C and 1.02°C, respectively. Finally, the results indicate that the grey-box model outperforms the ANN model in the considered validation periods in terms of accuracy and prediction stability.

42 ENGINEERING↗