Search NASA⌕ Search

SEARCH · Search NASA

Results for “select agent designation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Application of multi-criteria decision analysis techniques and decision support framework for informing select agent designation for agricultural animal pathogens

The United States Department of Agriculture (USDA), Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents and toxins (Select Agent List) that potentially threaten agricultural health and safety, the procedures governing the transfer of those agents, and training requirements for entities working with them. Every 2 years the USDA DASAT reviews the Select Agent List, using subject matter experts (SMEs) to perform an assessment and rank the agents. To assist the USDA DASAT biennial review process, we explored the applicability of multi-criteria decision analysis (MCDA) techniques and a Decision Support Framework (DSF) in a logic tree format to identify pathogens for consideration as select agents, applying the approach broadly to include non-select agents to evaluate its robustness and generality. We conducted a literature review of 41 pathogens against 21 criteria for assessing agricultural threat, economic impact, and bioterrorism risk and documented the findings to support this assessment. The most prominent data gaps were those for aerosol stability and animal infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. The MCDA analysis supported the intuitive sense that select agents should rank high on the relative risk scale when considering agricultural health consequences of a bioterrorism attack. However, comparing select agents with non-select agents indicated that there was not a clean break in scores to suggest thresholds for designating select agents, requiring subject matter expertise collectively to establish which analytical results were in good agreement to support the intended purpose in designating select agents. The DSF utilized a logic tree approach to identify pathogens that are of sufficiently low concern that they can be ruled out from consideration as a select agent. In contrast to the MCDA approach, the DSF rules out a pathogen if it fails to meet even one criteria threshold. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

60 APPLIED LIFE SCIENCES↗

Application of Multi-Criteria Decision Analysis Techniques for Informing Select Agent Designation and Decision Making

The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding “by eye” may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

60 APPLIED LIFE SCIENCES↗

Application of multi-criteria decision analysis techniques and decision support framework for informing plant select agent designation and decision making

The United States Department of Agriculture (USDA) Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents (Select Agents List) that threaten crops of economic importance to the United States and regulates the procedures governing containment, incident response, and the security of entities working with them. Every 2 years the USDA DASAT reviews their select agent list, utilizing assessments by subject matter experts (SMEs) to rank the agents. We explored the applicability of multi-criteria decision analysis (MCDA) techniques and a decision support framework (DSF) to support the USDA DASAT biennial review process. The evaluation includes both current and non-select agents to provide a robust assessment. We initially conducted a literature review of 16 pathogens against 9 criteria for assessing plant health and bioterrorism risk and documented the findings to support this analysis. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for ensuring accuracy. Scoring criteria were adopted to ensure consistency. The MCDA supported the expectation that select agents would rank high on the relative risk scale when considering the agricultural consequences of a bioterrorism attack; however, application of analytical thresholds as a basis for designating select agents led to some exceptions to current designations. A second analytical approach used agent-specific data to designate key criteria in a DSF logic tree format to identify pathogens of low concern that can be ruled out for further consideration as select agents. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

59 BASIC BIOLOGICAL SCIENCES↗

Design, Selection, and Evaluation of Reinforcement Learning Single Agents for Ground Target Tracking

Previous approaches for small fixed-wing unmanned air systems that carry strapdown rather than gimbaled cameras achieved satisfactory ground target tracking performance using both standard and deep reinforcement learning algorithms. However, these approaches have significant restrictions and abstractions to the dynamics of the vehicle, such as constant airspeed and constant altitude, because the number of states and actions was necessarily limited. Thus, extensive tuning was required to obtain good tracking performance. The expansion from 4 state–action degrees of freedom to 15 enabled the agent to exploit previous reward functions that produced novel yet undesirable emergent behavior. This paper investigates the causes of and various potential solutions to undesirable emergent behavior in the ground target tracking problem. A combination of changes to the environment, reward structure, action space simplification, command rate, and controller implementation provides insight into obtaining stable tracking results. Consideration is given to reward structure selection and refinement to mitigate undesirable emergent behavior. Results presented in the paper for a simulated environment of a single unmanned air system tracking a randomly moving single ground target show that a soft actor–critic algorithm can produce feasible tracking trajectories without limiting the state space and action space, provided that the environment is properly posed.

Engineering↗

Tunable CHA/AEI Zeolite Intergrowths with A Priori Biselective Organic Structure‐Directing Agents: Controlling Enrichment and Implications for Selective Catalytic Reduction of NOx

Abstract A novel ab initio methodology based on high‐throughput simulations has permitted designing unique biselective organic structure‐directing agents (OSDAs) that allow the efficient synthesis of CHA/AEI zeolite intergrowth materials with controlled phase compositions. Distinctive local crystallographic ordering of the CHA/AEI intergrowths was revealed at the nanoscale level using integrated differential phase contrast scanning transmission electron microscopy (iDPC STEM). These novel CHA/AEI materials have been tested for the selective catalytic reduction (SCR) of NOx, presenting an outstanding catalytic performance and hydrothermal stability, even surpassing the performance of the well‐established commercial CHA‐type catalyst. This methodology opens the possibility for synthetizing new zeolite intergrowths with more complex structures and unique catalytic properties.

Bello‐Jurado, Estefanía↗

Tunable CHA/AEI Zeolite Intergrowths with A Priori Biselective Organic Structure‐Directing Agents: Controlling Enrichment and Implications for Selective Catalytic Reduction of NOx

Abstract A novel ab initio methodology based on high‐throughput simulations has permitted designing unique biselective organic structure‐directing agents (OSDAs) that allow the efficient synthesis of CHA/AEI zeolite intergrowth materials with controlled phase compositions. Distinctive local crystallographic ordering of the CHA/AEI intergrowths was revealed at the nanoscale level using integrated differential phase contrast scanning transmission electron microscopy (iDPC STEM). These novel CHA/AEI materials have been tested for the selective catalytic reduction (SCR) of NOx, presenting an outstanding catalytic performance and hydrothermal stability, even surpassing the performance of the well‐established commercial CHA‐type catalyst. This methodology opens the possibility for synthetizing new zeolite intergrowths with more complex structures and unique catalytic properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Characterization of Lanthanum Monazite Surface Chemistry and Crystal Morphology through Density Functional Theory and Experimental Approaches

Monazite is a rare earth element (REE)-containing mineral that consists of (REE)PO 4 formal units and is one of the most important sources of these critical materials. The concentration of REEs from mined monazite ore often involves froth flotation, which is a beneficiation process that enhances the efficiency of downstream processing. The effectiveness of froth flotation is largely governed by the ability of collector agents to selectively bind to monazite particles. Thus, a molecular-level understanding of monazite interfacial chemistry is integral to the design of effective collector agents. To address this need, we performed density functional theory (DFT) calculations and a variety of experimental techniques to characterize La-monazite and elucidate its crystal morphology. Interestingly, we find minimal differences in the predicted morphologies of La-monazite for hydrous and anhydrous environments, which are largely dominated by low-index facets (e.g., {110}, {100}, and {010}). Indexing of synthesized La-monazite crystals via X-ray diffraction also uncovers {110} and {100} as the predominant facets. The average surface energies of 0% and 100% water coverage La-monazite crystals were predicted to be 0.87 and 0.76 J/m 2 , respectively, while calorimetry suggests values of 1.30 and 1.15 J/m 2 , respectively. The apparent discrepancies between the theoretical and experimental values are expected and attributed to defects present in physical crystals, in contrast to the perfect mineral surfaces in simulations. The difference in surface energy between the 0% and 100% water coverage morphologies predicted by theory is consistent with the value measured via calorimetry. DFT reveals a wide range of adsorption energies for water across the studied facets, but in all cases, water is predicted to strongly bind to monazite surfaces with an average adsorption energy of -92.7 kJ/mol for a La-monazite single crystal. Finally, this study provides the groundwork necessary for the rational design of froth flotation collector agents by granting molecular-level insight into the predominant facets of monazite.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The development and use of decision support framework for informing selection of select agent toxins with modelling studies to inform permissible toxin amounts

Many countries have worked diligently to establish and implement policies and processes to regulate high consequence pathogens and toxins that could have a significant public health impact if misused. In the United States, the Antiterrorism and Effective Death Penalty Act of 1996 (Public Law 104-132, 1996), as amended by the Bioterrorism Preparedness and Response Act of 2002 (Public Law 107-188, 2002) requires that the Department of Health and Human Services (HHS) [through the Centers for Disease Control and Prevention (CDC)] establish a list of bacteria, viruses, and toxins that have the potential to pose a severe threat to public health and safety. Currently, this list is reviewed and updated on a biennial basis using input from subject matter experts (SMEs). We have developed decision support framework (DSF) approaches to facilitate selection of select toxins and, where toxicity data are known, conducted modelling studies to inform selection of toxin amounts that should be excluded from select agent regulations. Exclusion limits allow laboratories to possess toxins under an established limit to support their research or teaching activities without the requirement to register with the Federal Select Agent Program. Fact sheets capturing data from a previously vetted SME workshop convened by CDC, literature review and SME input were developed to assist in evaluating toxins using the DSF approach. The output of the DSF analysis agrees with the current select toxin designations, and no other toxins evaluated in this study were recommended for inclusion on the select agent and toxin list. To inform the selection of exclusion limits, attack scenarios were developed to estimate the amount of toxin needed to impact public health. Scenarios consisted of simulated aerosol releases of a toxin in high-population-density public facilities and the introduction of a toxin into a daily consumable product supply chain. Using published inhalation and ingestion median toxic dose (TD 50 ) and median lethal dose (LD 50 ) values, where available, a range of toxin amounts was examined to estimate the number of people exposed to these amounts in these scenarios. Based on data generated by these models, we proposed toxin exclusion values corresponding to levels below those that would trigger a significant public health response (i.e., amounts estimated to expose up to ten people by inhalation or one hundred people by ingestion to LD 50 or TD 50 levels of toxin in the modeled scenarios).

60 APPLIED LIFE SCIENCES↗

Non-target RNA depletion strategy to improve sensitivity of next-generation sequencing for the detection of RNA viruses in poultry

PCR-based assays have become the benchmark for detecting pathogens of poultry and other livestock; however, these techniques are limited in their ability to detect multiple infecting agents, provide limited genetic information on the pathogen, and, for RNA viruses, must be reviewed frequently to assure high sensitivity and specificity. In contrast, untargeted, high-throughput sequencing can rapidly detect all infecting agents in a sample while providing genomic sequence information to allow more in-depth characterization of viruses. Although next-generation sequencing (NGS) offers many advantages, one of its primary limitations is low sensitivity to pathogens given the abundance of host and other non-target sequences in sequencing libraries. We explored methods for improving the sensitivity of NGS to detect respiratory and enteric viruses in poultry from RNA extracts of swab samples. We employed commercial and custom-designed negative enrichment strategies to selectively deplete the most abundant rRNA reads from the host and non-target bacteria; host RNA was diminished from up to 40% of total reads to as low as 3%, and the total number of reads assigned to abundant bacterial classes were reduced greatly. Our treatment resulted in up to a 700-fold increase in the number of viral reads, detection of a greater number of viral agents, and higher average genome coverage for pathogens. Depletion assays added only 2 h to the NGS library preparation workflow. Custom depletion probe design offered significant cost savings (US$7–12 per sample) compared to commercial kits (US$30–50 per sample).

Parris, D. Joshua↗

Controlled Synthesis of SnO 2 Nanocrystals with Tunable Band Gaps

Tin(IV) oxide nanocrystals (SnO 2 NCs) have significant potential in various applications, with their performance closely related to their band gap. The band gap is influenced by the size and shape of the NCs, which can be precisely controlled by adjusting reaction conditions. In this study, we present deliberately designed synthesis protocols to produce high-quality SnO 2 NCs with tunable band gaps using different methods. Key factors affecting the synthesis include control of the oxidizing agent, reaction temperature, solvent selection, and reaction time optimization. The resulting NCs were characterized by using TEM, XRD, XPS, and optical spectroscopy. Notably, SnO 2 NCs synthesized by controlling the oxidizing agent (air injection) in a hot organic solution were smaller in size and exhibited abundant oxygen vacancies. In contrast, extending the reaction time or using ethanol as a solvent in hydrothermal systems facilitated larger spherical or rod-like SnO 2 NCs with fewer oxygen vacancies. Further analysis of the band gap and valence band maximum energy revealed that the abundant vacancies in SnO 2 NCs synthesized with the air-controlled hot organic solution method resulted in a narrower band gap and an upshifted valence band. These synthetic strategies illustrate the potential for deliberately designing SnO 2 NCs with optimized electronic structures for various applications.

band gap↗

Deep reinforcement learning for class imbalance fault diagnosis of equipment in nuclear power plants

In equipment fault diagnosis in nuclear power plants, there may be far more samples in one class (e.g., a health state) than in another class (e.g., a fault state). The distribution of data in each class is highly skewed. Most machine learning algorithms are suitable for balanced training datasets. When faced with imbalanced samples, these algorithms tend to provide good identification for the majority classes and bias for the minority classes. However, the misclassification of minority classes can lead to high costs. To address the above problem, this paper develops a deep reinforcement learning-based diagnosis method that models fault diagnosis as a sequential decision-making process. At each time step, the agent receives the state of the environment represented by the training samples and then takes a diagnosis action guided by a policy. If the action is correct/incorrect, the agent receives a positive/negative reward. The reward for minority classes is higher than that for majority classes. The agent’s goal is to obtain as many cumulative rewards as possible in the process, i.e., to identify the sample as correctly as possible. Six demonstration scenarios are constructed, depending on the selected fault datasets and the designed model structures. Experiments show that the proposed method achieves a higher weighted-averaged F1 score than the classical supervised learning method in most cases of class imbalance. Finally, the proposed method has potential applications in the field of class imbalance fault diagnosis of equipment in nuclear power plants.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Strapped calix[4]pyrroles: from syntheses to applications

Supramolecular chemistry is a central topic in modern chemistry. It touches on many traditional disciplines, such as organic chemistry, inorganic chemistry, physical chemistry, materials chemistry, environmental chemistry, and biological chemistry. Supramolecular hosts, inter alia macrocyclic hosts, play critical roles in supramolecular chemistry. Calix[4]pyrroles, non-aromatic tetrapyrrolic macrocycles defined by sp 3 hybridized meso bridges, have proved to be versatile receptors for neutral species, anions, and cations, as well as ion pairs. Compared to the parent system, octamethylcalix[4]pyrrole and its derivatives bearing simple appended functionalities, strapped calix[4]pyrroles typically display enhanced binding affinities and selectivities. In this review, we summarize advances in the design and synthesis of strapped calix[4]pyrroles, as well as their broad utility in molecular recognition, supramolecular extraction, separation technology, ion transport, and as agents capable of inhibiting cancer cell proliferation. Future challenges within this sub-field are also discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Model-based Hierarchical Reinforcement Learning for Improved Physical Security Design: A Prototype

Prior work in FY24 developed an adversarial AI agent aid in path analysis of physical protection systems. This agent, trained using a model-based reinforcement learning algorithm, was able to successfully learn the most vulnerable path in facilities. It was able to extend the current state of practice for physical protection design by exhibiting dynamic behavior based on current environmental conditions. Whereas PathTrace largely performs a static, graph-based analysis, the AI agent was able to make decisions based on relative position in the facility, current conditions (was the adversarial agnet discovered?), and proximity to secondary targets. The agent demonstrated some novel capabilities, but had limitations that need to be resolved before it can be used for production purposes. For example, the adversarial agent generalizes poorly and takes a relatively long time to train. Nonetheless, there is still considerable promise for developing the adversarial agent further in order to explore even richer, more dynamic behaviors (e.g., adversary motivations, environmental debris, and more). This work considers a complementary idea; development of a planning agent. The planning agent is envisioned as an auto-complete-like tool that can help accelerate security system design by human experts. The agent would respect existing barriers and sensors placed by a human expert while offering cost-effective suggestions (i.e., implicitly balancing effectiveness with cost) to improve the design. The goal is for this agent to be part of an expert’s toolbox, not to totally upend the current state-of-practice, or to displace human experts. The ultimate goal would be concurrent training of both the adversarial and planning agent together, to learn entirely through self-play. This would represent an entirely new way of performing system deign. We selected a hierarchical, model-based reinforcement learning algorithm to serve as the planning agent. This is an extension of concepts used in the prior FY24 adversarial agent work. There, we had a single agent acting an environment. Here, we have two different sub-agents (policies), working together, to form a complete agent. There is a manager policy, which can select abstract goals on slower time scales, and a worker, which performs primitive actions to reach goals selected by the manager. It is worth noting that this class of algorithm is challenging to work with. From our understanding, our work is one of the first successful uses of model-based reinforcement learning (MBRL) in nuclear energy1 , and likely the first hierarchical model-based reinforcement learning application in nuclear energy. Further, this work is one of the first known attempts to apply AI to perform a design tasks in nuclear energy. Consequently, there were significant implementation challenges and the bulk of the work was focused on successful implementation and algorithm design. The results presented here are very low technology readiness level as a consequence of the lack of related literature, but still represent a significant step forward in the pursuit of applied AI for design.

42 ENGINEERING↗

Direct synthesis of ordered mesoporous materials from thermoplastic elastomers

Abstract The ability to manufacture ordered mesoporous materials using low-cost precursors and scalable processes is essential for unlocking their enormous potential to enable advancement in nanotechnology. While templating-based methods play a central role in the development of mesoporous materials, several limitations exist in conventional system design, including cost, volatile solvent consumption, and attainable pore sizes from commercial templating agents. This work pioneers a new manufacturing platform for producing ordered mesoporous materials through direct pyrolysis of crosslinked thermoplastic elastomer-based block copolymers. Specifically, olefinic majority phases are selectively crosslinked through sulfonation reactions and subsequently converted to carbon, while the minority block can be decomposed to form ordered mesopores. We demonstrate that this process can be extended to different polymer precursors for synthesizing mesoporous polymer, carbon, and silica. Furthermore, the obtained carbons possess large mesopores, sulfur-doped carbon framework, with tailorable pore textures upon varying the precursor identities.

36 MATERIALS SCIENCE↗

Structure Activity Relationship Approach toward the Improved Separation of Rare-Earth Elements Using Diglycolamides

The separation of adjacent lanthanides continues to be a challenge worldwide because of the similar physical and chemical properties of these elements and a necessity to advance the use of clean-energy applications. In this paper, a systematic structure–performance relationship approach toward understanding the effect of N-alkyl group characteristics in diglycolamides (DGAs) on the separation of lanthanides(III) from a hydrochloric acid medium is presented. In addition to the three most extensively studied DGA complexants [N,N,N',N'-tetra(n-octyl)diglycolamide, TODGA; N,N,N',N'-tetra(2-ethylhexyl)diglycolamide, TEHDGA; N,N'-dimethyl-N,N'-di(n-octyl)diglycolamide, DMDODGA], 12 new extracting agents with varying substitution patterns were designed to study the interplay of steric and electronic effects that control rare-earth element extraction. Subtle changes in the structure around diglycolamide carbonyl oxygen atoms result in dramatic shifts in the lanthanide extraction strength and selectivity. The effects of the chain length and branching position of N-alkyl substituents in DGAs are elaborated on with the use of experimental, computational, and solution-structure characterization techniques.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Design nanoporous metal thin films via solid state interfacial dealloying

Thin-film solid-state interfacial dealloying (thin-film SSID) is an emerging technique to design nanoarchitecture thin films. The resulting controllable 3D bicontinuous nanostructure is promising for a range of applications including catalysis, sensing, and energy storage. Using a multiscale microscopy approach, we combine X-ray and electron nano-tomography to demonstrate that besides dense bicontinuous nanocomposites, thin-film SSID can create a very fine (5–15 nm) nanoporous structure. Not only is such a fine feature among one of the finest fabrications by metal-agent dealloying, but a multilayer thin-film design enables creating nanoporous films on a wider range of substrates for functional applications. Through multimodal synchrotron diffraction and spectroscopy analysis with which the materials’ chemical and structural evolution in this novel approach is characterized in details, we further deduce that the contribution of change in entropy should be considered to explain the phase evolution in metal-agent dealloying, in addition to the commonly used enthalpy term in prior studies. Here, the discussion is an important step leading towards better explaining the underlying design principles for controllable 3D nanoarchitecture, as well as exploring a wider range of elemental and substrate selections for new applications.

36 MATERIALS SCIENCE↗

Open Building Control

Best practice control sequences are often not implemented correctly, or are not implemented at all, in large commercial buildings. This typically leads to 10-30 percent energy waste, along with reduced occupant productivity and unnecessary equipment wear. The current process of designing and implementing such control sequences is a manual process that starts with designers who often don’t have adequate training, then requires controls programmers to interpret and program a verbose written sequence. This process has been shown to fail to deliver high performance control sequences at scale. The Open Building Control project digitizes the current control delivery process. The project is developing tools for system designers to select control sequences, assess their energy performance and load flexibility potential using whole building simulation, specify the sequence for implementation using machine-to-machine translation by a control provider and formally testing the as-installed sequences by a commissioning agent. The project developed tools for each stage of this delivery process. The key innovation of the project is the development of the Control Description Language, a language that allows such a digitized control delivery process with end-to-end verification. Libraries of control sequences have been implemented using the Control Description Language, and their performance has been demonstrated using whole building energy simulation. An automated translation of such sequences to a commercial control product line has been conducted using a prototype translator. Tools for formal verification of as-installed control sequences relative to their specification have been developed and demonstrated. The American Society of Heating, Refrigerating and Air-Conditioning Engineers (ASHRAE) started the process of forming a committee to make this language an ASHRAE/ANSI Standard. This new standard will complement existing and emerging ASHRAE standards for building communication and semantic modeling by providing a standard for expressing the control logic - the actual brain of the building. We expect this language and the process it enables to be an important contribution to the deployment of high performance building control sequences at scale because it allows taming the complexity of the control delivery process, which is continually increasing due to the need for higher performance and increased load flexibility to meet goals for net zero energy and increased renewable integration.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A transfer learning approach to energy-efficient control of small and medium-sized commercial buildings

Model-free reinforcement learning (RL) provides a data-driven and adaptive approach to optimize building energy use while satisfying occupant comfort. This powerful tool does not need any prior knowledge about the environment and system it is optimizing and can adapt its policy based on the changes in captures. Like any other data-driven tool, it faces high training costs due to the extensive agent-environment interactions required to capture long-term building dynamics and user comfort. Transfer learning, particularly policy distillation, offers a promising way to accelerate training by leveraging pretrained RL agents in different building and system types. Here, this study investigates online student distillation, in which the student model updates its neural network weights using outputs from teacher models. The work introduces a student distillation strategy designed for efficient knowledge transfer, along with a teacher selection method that ensures high-quality guidance. The approach is validated using a highly calibrated whole building energy model for a small/medium commercial building test facility. Results show substantial reductions in training time and data requirements while surpassing the performance of ASHRAE Guideline 36, an advanced rule-based control strategy. The distilled RL model required 45% less data and achieved 20% higher cumulative rewards than a state-of-the-art RL model, with faster convergence and lower energy consumption. These outcomes demonstrate that effective transfer learning enables a scalable and data-efficient energy management solution for commercial buildings.

ASHRAE guideline 36↗