Search NASA⌕ Search

SEARCH · Search NASA

Results for “localized tuning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Studies in Software Cost Model Behavior: Do We Really Understand Cost Model Performance?

While there exists extensive literature on software cost estimation techniques, industry practice continues to rely upon standard regression-based algorithms. These software effort models are typically calibrated or tuned to local conditions using local data. This paper cautions that current approaches to model calibration often produce sub-optimal models because of the large variance problem inherent in cost data and by including far more effort multipliers than the data supports. Building optimal models requires that a wider range of models be considered while correctly calibrating these models requires rejection rules that prune variables and records and use multiple criteria for evaluating model performance. The main contribution of this paper is to document a standard method that integrates formal model identification, estimation, and validation. It also documents what we call the large variance problem that is a leading cause of cost model brittleness or instability.

data mining↗

Tuning counterion chemistry to reduce carrier localization in doped semiconducting carbon nanotube networks

Understanding and controlling the impact that electrostatic interactions have on the transport of injected charge carriers is important for the utilization of pi-conjugated semiconductors in opto-electronic applications. Here, we explore the impact of dopant chemical and electronic structure on the doping efficacy and charge carrier transport in semiconducting single-walled carbon nanotube (s-SWCNT) networks using molecular charge-transfer dopants based on functionalized icosahedral dodecaborane (DDB) clusters. Calculations indicate that localization of electron density on the DDB core reduces the coulombic interactions that contribute to hole localization in the s-SWCNTs, thereby improving charge carrier transport. The enhanced delocalization produces an increase in the electrical conductivity and thermopower at lower charge carrier densities, yielding enhanced thermoelectric transport and a thermoelectric power factor that surpasses the previous best in class for enriched s-SWCNT thin-film networks. This strategy can be applied broadly across pi-conjugated semiconductors to tune and enhance performance in a variety of energy harvesting devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Graph states of atomic ensembles engineered by photon-mediated entanglement

Abstract Graph states are a broad family of entangled quantum states, each defined by a graph composed of edges representing the correlations between subsystems. Such states constitute versatile resources for quantum computation and quantum-enhanced measurement. Their generation and engineering require a high level of control over entanglement. Here we report on the generation of continuous-variable graph states of atomic spin ensembles, which form the nodes of the graph. We program the entanglement structure encoded in the graph edges by combining global photon-mediated interactions in an optical cavity with local spin rotations. By tuning the entanglement between two subsystems, we either localize correlations within each subsystem or enable Einstein–Podolsky–Rosen steering—a strong form of entanglement that enables the extraction of precise information from one subsystem through measurements on the other. We further engineer a four-mode square graph state, highlighting the flexibility of our approach. Our method is scalable to larger and more complex graphs, laying groundwork for measurement-based quantum computation and advanced protocols in quantum metrology.

74 ATOMIC AND MOLECULAR PHYSICS↗

Tuning Multigrid Methods with Robust Optimization and Local Fourier Analysis

Local Fourier analysis is a useful tool for predicting and analyzing the performance of many efficient algorithms for the solution of discretized PDEs, such as multigrid and domain decomposition methods. The crucial aspect of local Fourier analysis is that it can be used to minimize an estimate of the spectral radius of a stationary iteration, or the condition number of a preconditioned system, in terms of a symbol representation of the algorithm. In practice, this is a “minimax” problem, minimizing with respect to solver parameters the appropriate measure of work, which involves maximizing over the Fourier frequency. Often, several algorithmic parameters may be determined by local Fourier analysis in order to obtain efficient algorithms. Analytical solutions to minimax problems are rarely possible beyond simple problems; the status quo in local Fourier analysis involves grid sampling, which is prohibitively expensive in high dimensions. In this paper, we propose and explore optimization algorithms to solve these problems efficiently. Finally, several examples, with known and unknown analytical solutions, are presented to show the effectiveness of these approaches.

97 MATHEMATICS AND COMPUTING↗

Climatologically tuned reflectivity-rain rate relations and links to area-time integrals

An effort is made to determine relationships between reflectivity (Z) and rain rate (R) which are tuned to the local climatology. The development of such relations was motivated by the need to understand the role of precipitation in controlling general circulation and in affecting such phenomena as ENSO. Attention is given to methods of deriving such relations and how they are linked to area integral rainfall measurements. In essence, the relation is tuned so that the probability distribution of reflectivity, P(Z), replicates that of R over some predetermined space-time climatic domain. Thus, the accurate measurement of the average R over any smaller domain depends on how closely the sampled P(Z) approximates the climatic P(Z). The probability matching method used is a modification of the approach of Calheiros and Zawadzki (1987) and Rosenfeld (1980). The technique is applied to data from Germany and the eastern tropical Atlantic (GATE).

Atlas, David↗

Nonempirical Prediction of the Length-Dependent Ionization Potential in Molecular Chains

The ionization potential of molecular chains is well-known to be a tunable nanoscale property that exhibits clear quantum confinement effects. State-of-the-art methods can accurately predict the ionization potential in the small molecule limit and in the solid-state limit, but for intermediate, nanosized systems prediction of the evolution of the electronic structure between the two limits is more difficult. Recently, optimal tuning of range-separated hybrid functionals has emerged as a highly accurate method for predicting ionization potentials. This was first achieved for molecules using the ionization potential theorem (IPT) and more recently extended to solid-state systems, based on an ansatz that generalizes the IPT to the removal of charge from a localized Wannier function. Here, we study one-dimensional molecular chains of increasing size, from the monomer limit to the infinite polymer limit using this approach. By comparing our results with other localization-based methods and where available with experiment, we demonstrate that Wannier-localization-based optimal tuning is highly accurate in predicting ionization potentials for any chain length, including the nanoscale regime.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geometry, spin coupling, and dielectric control of redox potentials in [4Fe–4S] Clusters

Iron–sulfur (Fe–S) clusters are common biological cofactors that facilitate vital redox reactions. Despite extensive research, the molecular basis of redox potential tuning in ferredoxin-like proteins remains an active area of debate. In this study, we combine statistical analysis of over one thousand [4Fe–4S]-containing protein structures from the Protein Data Bank (PDB) with broken-symmetry and extended broken-symmetry density functional theory to examine how cysteine ligand orientations and environmental screening affect redox properties of the clusters. We identified five main ligand configurations, three of which are predominant in natural structures. Among these, the adiabatic electron affinity differs by less than 0.1 V, indicating that, while geometry plays a secondary role, it allows localized fine-tuning of redox properties. In contrast, electrostatic and solvation effects primarily determine the overall potential range.

Computational Chemistry↗

Imaging real-space flat band localization in kagome magnet FeSn

Kagome lattices host flat bands due to their frustrated lattice geometry, which leads to destructive quantum interference of electron wave functions. Here, we report imaging of the kagome flat band localization in real-space using scanning tunneling microscopy. We identify both the Fe 3 Sn kagome lattice layer and the Sn 2 honeycomb layer with atomic resolution in kagome antiferromagnet FeSn. On the Fe 3 Sn lattice, at the flat band energy determined by the angle resolved photoemission spectroscopy, tunneling spectroscopy detects an unusual state localized uniquely at the Fe kagome lattice network. We further show that the vectorial in-plane magnetic field manipulates the spatial anisotropy of the localization state within each kagome unit cell. Our results are consistent with the real-space flat band localization in the magnetic kagome lattice. We further discuss the magnetic tuning of flat band localization under the spin–orbit coupled magnetic kagome lattice model.

36 MATERIALS SCIENCE↗

Investigating Low-Altitude Constellations of Ad-Hoc Lunar PNT System for Distributed Spacecraft Autonomy

In this study, we examine a low-altitude Lunar Position, Navigation, and Timing (LPNT) constellations and the localization performance of Centralized Extended Kalman Filter (CEKF) and Decentralized Extended Kalman Filter (DEKF) algorithms. The primary investigation involves a 100-node swarm operating at a 100 km altitude, in contrast to previous studies that examined a 21-node asset in a frozen-orbit at 5,500 km. The autonomous operation of large-scale swarm is based on two-way Inter-Satellite Link (ISL) measurements, which involve pseudoranges and relative velocities among swarm nodes. We perform a numerical assessment of the two filtering approaches, utilizing ‘fully sampled’ measurements from all available assets as well as ‘two ISL’ measurements where each spacecraft is restricted to only two antennas. This research includes an analysis of CEKF under 2-ISL constraints and evaluates the performance of DEKF in a 100-node swarm, which has not been explored in previous studies. In addition, we examine the impact of increasing the sampling frequency for DEKF, showing that the update cycle can be shortened from a 10-minute interval. A novel approach for ‘2-ISL limited’ DEKF will also be introduced, using a matching formulation that exhaustively enumerates all potential matches. This study provides valuable insights into large-scale distributed swarm operations, considering various filter configurations, sampling frequencies, matching strategies, and scalability of CEKF and DEKF for low-altitude LPNT applications. The Lunar PNT technology plays a key role in providing reliable and robust navigation services on the Moon's surface and the South pole, where the primary Lunar missions are planned. To support upcoming Lunar missions, including small satellites from NASA's Commercial Lunar Payload Services program, the Lunar PNT system must be adaptable to smaller platforms like CubeSats. Driven by the growing involvement of public and private exploration partnerships, the traditional low Earth orbit missions are shifting to beyond geosynchronous orbit [1]. These upcoming missions aim to foster a sustainable and innovative exploration program, in collaboration with commercial and international partners, to facilitate human expansion throughout the solar system and return new knowledge and opportunities to Earth [2]. As part of this trend, there are increasing efforts to utilize science missions in Lunar orbit to develop a non-dedicated and ad-hoc PNT network system. Two traditional approaches, the Deep Space Network (DSN) and the weak signal Global Positioning System (GPS), are established deep-space navigation technologies for missions beyond the geosynchronous orbit. Beginning in 1958, the DSN was developed to communicate with the Explorer 1 spacecraft based on the use of radiometric tracking in spacecraft navigation [3]. The DSN is capable of providing nearly unfettered coverage to spacecraft beyond low-Earth orbit (LEO), however, increased space mission volume has created concerns about future expectations of DSN usage for spacecraft navigation [4]. For cislunar mission applications, the position accuracy using DSN achieves 100 m (3σ) with at least three geometrically diverse ground stations when using radiometric tracking alone [5]. The DSN's dependence on Earth-based ground stations restricts its operational capabilities to periods of Earth visibility. This limitation, coupled with its poor localization performance, renders the DSN unsuitable for future lunar missions that demand continuous tracking and precise positioning. To satisfy the increasing requirements of DSN in Lunar applications, spacecrafts are also required to improve their onboard antenna power and efficiency of the transmission. However, there is an important aggregate cost trade between adding capabilities to every spacecraft and adding to a capacity on the ground that serves multiple spacecraft [6]. A weak GPS system can provide PNT service while the user spacecraft is bound to the Moon, leveraging a single, steerable high gain antenna with the relatively narrow beam which includes all the sources in its field of view [7]. However, the higher the altitude the receiver is above the GPS constellations, the poorer and the weaker are the relative geometry and the received signal powers, respectively, leading to a significant navigation accuracy reduction [8]. The transmitted power becomes weaker with increasing distance from the Earth as well as signals tracked from one of the side lobes of the GPS antenna pattern. As a results, the number of visible satellites and relative geometric condition of the GPS satellites at very high altitude drops dramatically and reduces the navigation solution accuracy. Therefore, the weak GPS system is also not an ideal way to provide PNT service to upcoming Lunar missions when considering its limited geometric condition and the recued navigation accuracy. Another navigation approach on the Moon is being developed, similar to the Global Navigation Satellite System (GNSS) on Earth, aiming to offer navigation service with continuous 24/7 coverage across the entire Lunar surface. For example, lunar communications relay and navigation systems (LCRNS) by NASA and Lunar navigation satellite systems (LNSS) by JAXA are designed to serve as dedicated Position, Navigation, and Timing (PNT) systems for the Moon. However, designing a dedicated LNSS and PNT service involves additional challenges, which are unique to the lunar environment, including limited payload capacity for the CubeSat platform, i.e., the size, weight, and power (SWaP) of the onboard clock, limited lunar ground monitoring stations, and limited financial investment as compared to the legacy Earth-GPS [9]. NASA’s focus on utilizing CubeSat platforms on the Moon leads to an alternative Lunar navigation platform that leverages the existing Lunar science and exploration assets. The small satellites used in Lunar missions can be used to create a low-cost, autonomous, ad-hoc, and on-demand mission-centric Lunar PNT swarm capable of providing PNT services to these low-cost lunar missions [10]. As upcoming Lunar missions will often operate at low-altitude about 30 km to 100 km for scientific observations and mapping purposes, the low-altitude orbital constellations could be employed to create an ad-hoc Lunar PNT system. However, several issues must be addressed, such as the instability of these orbits, which often require maintenance or are only suitable for short-duration missions, operating for fewer than 90 days. Additionally, at an altitude of 100 km, the satellites have a limited period during which they are above the horizon and capable of providing PNT service to users. The implementation of a non-dedicated, ad-hoc Lunar navigation constellation facilitates on-demand PNT services. A preliminary study of ad-hoc Lunar PNT system was conducted using 21 spacecraft in 5,5000 km altitude frozen orbits to test its feasibility and a basic performance of orbital asset localization among ad-hoc Lunar constellations in small satellites format [10]. These swarm assets are designed for autonomous localization with minimal Earth interaction, reducing dependency on bandwidth and ground resources. The design in [10] demonstrated the feasibility of a decentralized PNT approach, specifically employing a DEKF approach for state estimation, which helps minimize onboard operating costs. The DEKF method distributes computation across individual satellites, which lightens the computational load while maintaining accuracy in orbit ephemeris and clock offsets, similar to centralized systems [11]. In a follow-on study [12], each spacecraft was limited to 2 communications antennae, forcing the selection of measurements and scheduling spacecraft activities to perform the measurements. A matching algorithm is implemented to select the best measurements and schedule position estimation updates. The decentralized localization performance is also investigated with increasing levels of network degradation for swarm assets considering the impact of intermittent and permanent communication failure, to demonstrate the robustness and fidelity of the decentralized Lunar PNT service [13]. This study confirmed that the ad-hoc PNT constellations in frozen orbit are highly robust and resilient to communication failures. However, unlike frozen orbit swarm assets, the low-altitude satellites have a limited ground view at an altitude of 100 km, where the ad-hoc Lunar constellation consists of 98 low-altitude satellites, evenly distributed across seven circular polar orbital planes, alongside two satellites in a frozen orbit at an altitude of 5,500 km (Figure 1). Therefore, the number of satellites visible to ground users is significantly limited in low-altitude orbit constellations. As each visibility of a spacecraft remains intact for only a few ticks before it moves out of the field of view, the ground user encounters challenges in maintaining continuous navigation service, resulting in sparse availability and provision of Lunar PNT system. Consequently, service availability is primarily restricted to the Lunar South Pole region (Figure 2). Given these limitations and concerns, the localization performance of low-altitude swarm assets will be assessed in this study. We focus on the investigation of the localization performance of low-altitude swarm assets and ground users near the Lunar South Pole. The overall flow of the Lunar PNT simulation incorporates the DEKF approach of asset localization and the weighted least-squares approach in user localization (Figure 3). The autonomous Lunar PNT simulation is primarily implemented in MATLAB, where the DEKF based on the matching scheduler is implemented with Google’s OR-tools as a model builder and Gurobi optimization tool as a backend solver. The General Mission Analysis Tool (GMAT) is utilized to generate ephemeris data for swarm assets, and accounts for satellite orbital details, mass, and perturbations like solar radiation pressure and drag coefficients. Each ephemeris dataset is produced in the Moon International Celestial Reference Frame (ICRF) inertial coordinate system. For state estimation, the distributed swarm assets rely on two-way Inter-Satellite Link (ISL) measurements, which involve tracking pseudoranges and relative velocities between visible satellites and anchor nodes during each observation. Numerical evaluations of the decentralized localization process are conducted to demonstrate the feasibility of the low-altitude PNT system in providing reliable navigation services. The main approach involves using DEKF and CEKF to localize 100 satellites in low-altitude constellations, where the CEKF is implemented to serve as a baseline for comparing the performance of distributed algorithms. In both cases, we evaluate ‘fully sampled’ measurements from all available assets, and ‘two ISL’ measurements when spacecraft are constrained to have only two antennas. We test four estimation techniques: CEKF fully sampled, CEKF two ISL, DEKF fully sampled, and DEKF two ISL filters. As the DEKF update cycle is comprised of network setup, communication, and computations, a global broadcast network and 2-way ISL network setup will take from 4 to 6 minutes as maximum [12]. In this simulation, the DEKF update cycle is set to 10 minutes, including a 4-minute latency for obtaining and computing the actual measurement updates. We experiment an increased update cycle to demonstrate the feasibility and evaluate the impact on localization performance using various tuning values for measurement noise covariances (Figures 4 and 5). By comparing centralized and decentralized approaches using a matching algorithm, we analyze the influence of cross-correlation factors in the covariance matrix, assuming 100% reliability of all assets and measurements. The increased frequency and the adjustments of tuning parameters reveal distinct error patterns between the two scenarios. The localization accuracy of the swarm assets and ground users is assessed by taking the median error across 100 assets and one ground user (84.9°S, 137.5°E) over 7-day simulation period (Table 1). Since the user localization accuracy is significantly affected by the performance of the swarm assets, it is crucial to maintain high localization accuracy within the swarm. This study will continue to explore decentralized filtering for autonomous LPNT operations, with further investigation of an 'iterative' matching approach which enumerates every valid matching pair, planned for the following month.

Yeji Kim↗

Tunable Stochasticity in an Artificial Spin Network

Metamaterials present the possibility of artificially generating advanced functionalities through engineering of their internal structure. Artificial spin networks, in which a large number of nanoscale magnetic elements are coupled together, are promising metamaterial candidates that enable the control of collective magnetic behavior through tuning of the local interaction between elements. In this work, the motion of magnetic domain-walls in an artificial spin network leads to a tunable stochastic response of the metamaterial, which can be tailored through an external magnetic field and local lattice modifications. This type of tunable stochastic network produces a controllable random response exploiting intrinsic stochasticity within magnetic domain-wall motion at the nanoscale. An iconic demonstration used to illustrate the control of randomness is the Galton board. In this system, multiple balls fall into an array of pegs to generate a bell-shaped curve that can be modified via the array spacing or the tilt of the board. A nanoscale recreation of this experiment using an artificial spin network is employed to demonstrate tunable stochasticity. Furthermore, this type of tunable stochastic network opens new paths toward post-Von Neumann computing architectures such as Bayesian sensing or random neural networks, in which stochasticity is harnessed to efficiently perform complex computational tasks.

Artificial spin network↗

Constraining the Chiral Magnetic Effect with charge-dependent azimuthal correlations in Pb-Pb collisions at $ \sqrt{s_{\mathrm{NN}}} $ = 2.76 and 5.02 TeV

Systematic studies of charge-dependent two- and three-particle correlations in Pb-Pb collisions at $ \sqrt{s_{\mathrm{NN}}} $ = 2.76 and 5.02 TeV used to probe the Chiral Magnetic Effect (CME) are presented. These measurements are performed for charged particles in the pseudorapidity ( η ) and transverse momentum ( p T ) ranges | η | < 0 . 8 and 0 . 2 < p T < 5 GeV/ c . A significant charge-dependent signal that becomes more pronounced for peripheral collisions is reported for the CME-sensitive correlators γ 1, 1 =$\langle4cos( φ α + φ β - 2Ψ 2 )$\rangle$ and γ 1, - 3 = $\langle$cos( φ α - 3 φ β + 2Ψ 2 )$\rangle$. The results are used to estimate the contribution of background effects, associated with local charge conservation coupled to anisotropic flow modulations, to measurements of the CME. A blast-wave parametrisation that incorporates local charge conservation tuned to reproduce the centrality dependent background effects is not able to fully describe the measured γ 1 , 1 . Finally, the charge and centrality dependence of mixed-harmonics three-particle correlations, of the form γ 1, 2 = $\langle$cos( φ α + 2 φ β - 3Ψ 3 )$\rangle$, which are insensitive to the CME signal, verify again that background contributions dominate the measurement of γ 1 , 1 .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Localizing individual exciton on a quantum Hall antidot

Excitons are bond states of electron-hole pairs formed through Coulomb interaction. While excitonic phases have been widely studied in semiconductors and quantum Hall double-layers, prior works largely focus on bulk systems with large number of excitons, limiting their applications in quantum devices. Here, employing the approach of quantum Hall antidot with two spatially separated edge channels, we demonstrate a type of quantum Hall quasiparticle exciton which represents a quantum-coherent bound state of an electron and a hole situated on their corresponding edges coupled through intralayer tunneling and Coulomb interaction. This approach allows localization and electrical tuning of individual quantum Hall excitons. Quantum-coherent dynamics of exciton are observed in the gate-dependence of antidot conductance peaks near the electron-hole resonance, which signifies a quantum superposition of vacuum- and electron-hole pairing states. Modeling the electron-hole pair as a coupled two-level system, semi-quantitative understanding of experimental observations is achieved. This work opens avenues for creating quantum systems of multiple quantum Hall quasiparticles.

36 MATERIALS SCIENCE↗

Anisotropic excitonic magnetism from discrete C 4 symmetry in CeRhIn 5

Anisotropy in strongly correlated materials is a central parameter in determining the electronic ground state and is tuned through the local crystalline electric field. This is notably the case in the CeCo x Rh 1 − x In 5 system where the ground-state wave function can provide the basis for antiferromagnetism and/or unconventional superconductivity. We develop a methodology to understand the local magnetic anisotropy and experimentally investigate with neutron spectroscopy applied to antiferromagnetic ( T N = 3.8 K ) CeRhIn 5 , which is isostructural to d -wave superconducting ( T c = 2.3 K ) CeCoIn 5 . Through diagonalizing the local crystal field Hamiltonian with discrete tetragonal C 4 point group symmetry and coupling these states with the random phase approximation, we find two distinct modes polarized along the crystallographic c and a − b planes, agreeing with experiment. The anisotropy and bandwidth, underlying the energy scale of these modes, are tuneable with a magnetic field which we use experimentally to separate in energy single and multiparticle excitations thereby demonstrating the instability of excitations polarized within the crystallographic a − b plane in CeRhIn 5 . We compare this approach to a S eff = 1 2 parametrizations and argue for the need to extend conventional SU(2) theories of magnetic excitations to utilize the multilevel nature of the underlying crystal-field basis states constrained by the local point-group C 4 symmetry. Published by the American Physical Society 2024

Brener, D. J. (ORCID:0000000333400177)↗

Carbon and Hydrocarbon Particle Seeding in Air-Breathing Rotating Detonation Engine

Within the power generation community, the rotating detonation engine (RDE) is only growing in popularity with its increased performance, simple mechanism, and operation. Although significant testing is underway to characterize the RDE for integration with conventional gas turbines, this entire system is still at a relatively low technology readiness level. In the midst of RDE research, there is an initiative to understand solid particle seeding effects in the detonation performance. Under investigation at the University of Central Florida is a Department of Energy (DOE) 15.24 cm (6 in.) RDE, with a solid particle seeder in parallel with its H2 and air flow lines. Previous work on this system involved carbon particle detonation; however, the tested particles were taken one step further to include more sustainable, greener hydrocarbon particles. Testing of powdered sugar, peanut flour, and cornstarch, along with previous carbon black tests have shown not only successful detonability, but a noticeable effect on the detonation wave dynamics. Side-by-side with a particle burning model being developed, an operational map can be determined for the hydrocarbon particles particularly, which can be tuned with the local flow conditions to achieve peak operability while replacing fuels with sustainable alternatives that could even be grown.

Engineering↗

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to nonlinear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗

Grid-Interactive Multi-Zone Building Control Using Reinforcement Learning with Global-Local Policy Search: Preprint

In this paper, we develop a grid-interactive multi-zone building controller based on a deep reinforcement learning (RL) approach. The controller is designed to facilitate building operation during normal conditions and demand response events, while ensuring occupants comfort and energy efficiency. We leverage a continuous action space RL formulation, and devise a two-stage global-local RL training framework. In the first stage, a global fast policy search is performed using a gradient-free RL algorithm. In the second stage, a local fine-tuning is conducted using a policy gradient method. In contrast to the state-of-the-art model predictive control (MPC) approach, the proposed RL controller does not require complex computation during real-time operation and can adapt to non-linear building models. We illustrate the controller performance numerically using a five-zone commercial building.

30 DIRECT ENERGY CONVERSION↗