SEARCH · Search NASA

Results for “Intelligent Adaptive Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Adaptive Fault Detection Based on Neural Networks and Multiple Sampling Points for Distribution Networks and Microgrids

Smart networks such as microgrid (MG) and active distribution networks (ADN) have been recently playing an important role in power system operation. The design and implementation of appropriate protection systems for such networks must be addressed, which imposes new technical challenges. This paper presents the implementation and validation aspects of an adaptive fault detection strategy based on neural networks (NNs) and multiple sampling points for ADN and MG. The solution is implemented on an edge device. Artificial NNs are used to derive a data-driven model that uses only local measurements to detect fault states of the network without the need for communication infrastructure. Multiple sampling points are used to derive a data-driven model, which allows the generalization considering the implementation in physical systems. The adaptive fault detector model is implemented on a Jetson Nano system, which is a single-board computer (SBC) with a small Graphic Processing Unit (GPU) intended to run machine learning loads at the edge. The proposed method is tested in a physical, real-life, low-voltage network located at Universidad del Norte, Colombia. This testing network is based on the IEEE-13 Node Test Feeder scaled down to 220 V. The validation in a simulation environment shows the accuracy and dependability above 99.6%, while the real-time tests show the accuracy and dependability of 95.5% and 100%, respectively. Without hard-to-derive parameters, the easy-to-implement embedded model highlights the potential for real-life applications.

42 ENGINEERING↗

DOE OSTI2024

Towards intelligent emergency control for large-scale power systems: Convergence of learning, physics, computing and control

Here, this paper has delved into the pressing need for intelligent emergency control in large-scale power systems, which are experiencing significant transformations and are operating closer to their limits with more uncertainties. Learning-based control methods are promising and have shown effectiveness for intelligent power system control. However, when they are applied to large-scale power systems, there are multifaceted challenges such as scalability, adaptiveness, and security posed by the complex power system landscape, which demand comprehensive solutions. The paper first proposes and instantiates a convergence framework for integrating power systems physics, machine learning, advanced computing, and grid control to realize intelligent grid control at a large scale. Our developed methods and platform based on the convergence framework have been applied to a large (more than 3000 buses) Texas power system, and tested with 56 000 scenarios. Our work achieved a 26% reduction in load shedding on average and outperformed existing rule-based control in 99.7% of the test scenarios. The results demonstrated the potential of the proposed convergence framework and DRL-based intelligent control for the future grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Organismic materials for beyond von Neumann machines

The elementary basis of intelligence in organisms with a central nervous system includes neurons and synapses and their complex interconnections forming neural circuits. In non-neural organisms such as slime mold with gel-like media, viscosity modulation enables adaptation to changing environments. At a larger scale, collective intelligence emerges via social interactions and feedback in animal colonies. Learning and memory are therefore multi-scale features that evolve as a result of constant interactions with the environment. There is growing interest in emulating such features of intelligence in computing machines and autonomous systems. Materials that can respond to their environment in a manner similar to organisms (referred to as "organismic materials") therefore may be of interest as hardware components in artificial intelligence machines. In this brief review, we present a class of semiconductors called correlated oxides as candidates for learning machines. The term "correlated" refers to the fact that electrons in such lattices strongly interact and the ground state is not what is predicted by classical band theory. Such materials can undergo insulator-metal transitions at near ambient conditions under external stimuli such as thermal or electrical fields, strain, and chemical doping. Depending on the mechanism driving the transition, intermediate states can be metastable with different volatilities, and the time scales of phase change can be controlled over many orders of magnitude. The change in electronic properties can be sharp or gradual, leading to digital or analog behavior. These properties enable the realization of artificial neurons and synapses and emulate the associative and non-associative learning characteristics found in various organisms. We examine microscopic properties concerning electronic and structural transitions leading to collective behavior and theoretical treatments of the ground state and dynamical response, showcasing VO 2 as a model system. Next, we briefly review algorithms designed from the plasticity demonstrated by phase changing systems. Finally, we conclude the brief review with suggestions for future research toward realizing non-von Neumann machines.

42 ENGINEERING↗

DOE OSTI2013

Intelligent Software Agents: Sensor Integration and Response

Abstract In a post Macondo world the buzzwords are Integrity Management and Incident Response Management. The twin processes are not new but the opportunity to link the two is novel. Intelligent software agents can be used with sensor networks in distributed and centralized computing systems to enhance real-time monitoring of system integrity as well as manage the follow-on incident response to changing, and potentially hazardous, environmental conditions. The software components are embedded at the sensor network nodes in surveillance systems used for monitoring unusual events. When an event occurs, the software agents establish a new concept of operation at the sensing node, post the event status to a blackboard for software agents at other nodes to see , and then react quickly and efficiently to monitor the scale of the event. The technology addresses a current challenge in sensor networks that prevents a rapid and efficient response when a sensor measurement indicates that an event has occurred. By using intelligent software agents - which can be stationary or mobile, interact socially, and adapt to changing situations - the technology offers features that are particularly important when systems need to adapt to active circumstances. For example, when a release is detected, the local software agent collaborates with other agents at the node to exercise the appropriate operation, such as: targeted detection, increased detection frequency, decreased detection frequency for other non-alarming sensors, and determination of environmental conditions so that adjacent nodes can be informed that an event is occurring and when it will arrive. The software agents at the nodes can also post the data in a targeted manner, so that agents at other nodes and the command center can exercise appropriate operations to recalibrate the overall sensor network and associated intelligence systems. The paper describes the concepts and provides examples of real-world implementations including the Threat Detection and Analysis System (TDAS) at the International Port of Memphis and the Biological Warning and Incident Characterization System (BWIC) Environmental Monitoring (EM) Component. Technologies developed for these 24/7 operational systems have applications for improved real-time system integrity awareness as well as provide incident response (as needed) for production and field applications.

emergency response↗

DOE OSTI2024

Exascale Computing and Data Handling: Challenges and Opportunities for Weather and Climate Prediction

The emergence of exascale computing and artificial intelligence offer tremendous potential to significantly advance Earth system prediction capabilities. However, enormous challenges must be overcome to adapt models and prediction systems to use these new technologies effectively. A 2022 WMO report on exascale computing recommends “urgency in dedicating efforts and attention to disruptions associated with evolving computing technologies that will be increasingly difficult to overcome, threatening continued advancements in weather and climate prediction capabilities.” Further, the explosive growth in data from observations, model and ensemble output, and postprocessing threatens to overwhelm the ability to deliver timely, accurate, and precise information needed for decision-making. Artificial intelligence (AI) offers untapped opportunities to alter how models are developed, observations are processed, and predictions are analyzed and extracted for decision-making. Given the extraordinarily high cost of computing, growing complexity of prediction systems, and increasingly unmanageable amount of data being produced and consumed, these challenges are rapidly becoming too large for any single institution or country to handle. This paper describes key technical and budgetary challenges, identifies gaps and ways to address them, and makes a number of recommendations.

Atmosphere↗

DOE OSTI2020

Fault-tolerant grid frequency measurement algorithm during transients

Many critical electric grid operations rely on accurate grid frequency measurements. Unfortunately, the measurement accuracy can be easily undermined by power system transient faults. During a power system transient fault, the power grid voltages and currents are usually highly distorted by high-frequency components. What is worse, the power grid signals could have discontinuity during some system transient faults such as phase angle jump, and the discontinuity could result in large measurement errors to state-of-the-art grid measurement algorithms. In this study, a fault-tolerant grid frequency measurement algorithm during transients is proposed. The new algorithm consists of two stages. The first stage is a transient detector, and it can detect the occurrence of system transient faults instantaneously. The second stage is the intelligent frequency estimator, and it will adapt its measurements according to the transient detector. The performance of the algorithm is evaluated under different steady-state and transient conditions. Both dependability and security of the fault-tolerant algorithm are assessed by using PSCAD simulation data and IEEE Standard test data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

A Cybersecurity Threat Profile for a Connected Lighting System

In anticipation of improved energy performance and cost savings, cities and building owners are increasingly considering “smart lighting initiatives” that aim to convert their collection of simple luminaires (i.e., lighting fixtures) into an intelligent connected lighting system (CLS) capable of remotely monitoring energy consumption and fault conditions, and possibly implementing adaptive lighting schemes. The U.S. Department of Energy (DOE) has set an national goal of tripling the energy efficiency and demand flexibility of the buildings sector by 2030, relative to 2020 levels 1. It is forecast that connected lighting systems can contribute to that goal by delivering 125 TWh of annual energy savings by 2035 2, equivalent to the annual output of 50 typical (500 MW) power plants. However, these energy savings and the DOE goal are put at significant risk if connected technologies are not adopted due to real or perceived cybersecurity concerns. Connected IoT devices such as these have historically been rife with vulnerabilities which sometimes put security considerations secondary to functionality and operability. What are the cybersecurity threats that will impact these systems, as formerly banal luminaires transition into intelligent connected devices that collect information about themselves, their surrounding environment, and possibly us? In this paper we analyze a threat profile performed on a fault-detection use case for streetlights. A threat profile establishes security requirements, justifies security measures, yields actionable controls, and effectively communicates risk to stakeholders. This effort provides critical information for making threat-based decisions to increase security at a reasonable cost, and can effectively be used by development teams, software architects, and managers to make cybersecurity a part of their ongoing culture of awareness, training, and prevention. This leads to more secure systems and better-understood security. On-premise, cloud, and hybrid architectures with different authentication mechanisms were modeled and later categorized using the Microsoft STRIDE framework. An analysis of the recommended controls for each threat was performed to determine which controls could and should be put in place by manufacturers or third-party suppliers, and which controls need to be left up the end-user to implement. Fifty-seven threats were identified. Among our key findings: (1) 65% (37/57) of the threats did not involve the luminaires, but rather the other components needed to communicate with and manage them; (2) 63% (36/57) of the threats could have been mitigated through manufacturer-implemented defensive techniques or “controls”; and (3) 23% (13/57) of the threats were dependent on the network configuration. Recommendations based on the results of this work are made to key stakeholder groups. Notably, lighting technology developers are advised to address all threats that can be reasonably controlled with baked-in technology solutions (e.g., encryption or authentication controls), and employ some form of secure supply chain management and tracking where other parts (e.g., sensors, microprocessors) of a luminaire must also be built and manufactured with the proper security controls in place. Developers should also review threats involving assets not developed in-house to understand how connectivity with other devices will affect their product during system operation and determine if a compensating control for a defense-in-depth strategy will be needed. Finally, those interested in deploying CLS should compare the differences between cloud and on-premise models to determine which is more suitable for their needs and the abilities of their security team.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Development of X-ray Wavefront Sensing Techniques for Adaptive Optics Control at the Advanced Photon Source

The planning and construction of new and upgraded high-brightness X-ray synchrotron and free electron laser sources, such as the Advanced Photon Source upgrade project (APS-U), are driving numerous opportunities to advance X-ray science and technologies. At the same time, an increasing number of highly diverse beamline experiments demand wavefront-preserving adaptive X-ray optics with both high precision and flexibility. At the APS, significant effort has been devoted to developing next-generation adaptive and corrective optics combined with state-of-the-art at-wavelength wavefront sensing techniques and an intelligent feedback control system for the automation and self-alignment of beamline optical systems. This article reviews recent achievements in these areas at the APS. Further, these include the development of in-situ wavefront sensing, the application in active feedback control of ultra-precision deformable mirrors, and the exploration of non-invasive wavefront sensing techniques for adaptive optics and beamline diagnostics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Emulation of Synaptic Plasticity in WO 3 ‐Based Ion‐Gated Transistors

Neuromorphic systems, inspired by the human brain, promise significant advancements in computational efficiency and power consumption by integrating processing and memory functions, thereby addressing the von Neumann bottleneck. This paper explores the synaptic plasticity of a WO3-based ion-gated transistor (IGT) in [EMIM][TFSI] and a 0.1 mol L −1 LiTFSI in [EMIM][TFSI] for neuromorphic computing applications. Cyclic voltammetry (CV), transistor characteristics, and atomic force microscopy (AFM) force–distance (FD) profiling analyses reveal that Li + brings about ion intercalation, together with higher mobility and conductance, and slower response time (τ). WO 3 IGTs exhibit spike amplitude-dependent plasticity (SADP), spike number-dependent plasticity (SNDP), spike duration-dependent plasticity (SDDP), frequency-dependent plasticity (FDP), and paired-pulse facilitation (PPF), which are all crucial for mimicking biological synaptic functions and understanding how to achieve different types of plasticity in the same IGT. The findings underscore the importance of selecting the appropriate ionic medium to optimize the performance of synaptic transistors, enabling the development of neuromorphic systems capable of adaptive learning and real-time processing, which are essential for applications in artificial intelligence (AI).

36 MATERIALS SCIENCE↗

DOE OSTI2018

Fuzzy Controllers in the Adaptive Control System of a CNC Lathe

Traditional approaches to improving the technological system of CNC metal-cutting machines include increasing the rigidity, periodic maintenance and repair of its components, and operating at lower speeds. In practice, the most economical approach is stabilization of the inputs to the system. The development of adaptive control systems with stabilization of the cutting forces improves the precision and quality of machining in CNC metal-cutting machines, the productivity, and tool life. However, classical PID controllers are only effective in stabilizing the cutting forces in such systems if continuous real-time parameter adjustment is possible. That sharply increases the complexity of the controller. A new mathematical apparatus based on artificial intelligence (including fuzzy logic) permits the solution of adaptive control problems that previously could hardly even be formulated. The present work addresses the use of fuzzy logic in automatic stabilization of the cutting force for CNC lathes. Simulation of a fuzzy controller shows that this approach to automatic stabilization of the cutting force increases the machining efficiency on existing equipment with indeterminacy in the characteristics of the cutting system and the working environment.

42 ENGINEERING↗

DOE OSTI2022

Antiviral Strategies Against SARS-CoV-2: A Systems Biology Approach

The unprecedented scientific achievements in combating the COVID-19 pandemic reflect a global response informed by unprecedented access to data. We now have the ability to rapidly generate a diversity of information on an emerging pathogen and, by using high-performance computing and a systems biology approach, we can mine this wealth of information to understand the complexities of viral pathogenesis and contagion like never before. These efforts will aid in the development of vaccines, antiviral medications, and inform policymakers and clinicians. Here we detail computational protocols developed as SARS-CoV-2 began to spread across the globe. They include pathogen detection, comparative structural proteomics, evolutionary adaptation analysis via network and artificial intelligence methodologies, and multiomic integration. These protocols constitute a core framework on which to build a systems-level infrastructure that can be quickly brought to bear on future pathogens before they evolve into pandemic proportions.

Teixeira Prates, Erica↗

DOE OSTI2015

Controlling Subsurface Fractures and Fluid Flow: A Basic Research Agenda

From beneath the surface of the earth, we currently obtain about 80-percent of the energy our nation consumes each year. In the future we have the potential to generate billions of watts of electrical power from clean, green, geothermal energy sources. Our planet’s subsurface can also serve as a reservoir for storing energy produced from intermittent sources such as wind and solar, and it could provide safe, long-term storage of excess carbon dioxide, energy waste products and other hazardous materials. However, it is impossible to underestimate the complexities of the subsurface world. These complexities challenge our ability to acquire the scientific knowledge needed for the efficient and safe exploitation of its resources. To more effectively harness subsurface resources while mitigating the impacts of developing and using these resources, the U.S. Department of Energy established SubTER – the Subsurface Technology and Engineering RD&D Crosscut team. This DOE multi-office team engaged scientists and engineers from the national laboratories to assess and make recommendations for improving energy-related subsurface engineering. The SubTER team produced a plan with the overall objective of “adaptive control of subsurface fractures and fluid flow.”This plan revolved around four core technological pillars—Intelligent Wellbore Systems that sustain the integrity of the wellbore environment; Subsurface Stress and Induced Seismicity programs that guide and optimize sustainable energy strategies while reducing the risks associated with subsurface injections; Permeability Manipulation studies that improve methods of enhancing, impeding and eliminating fluid flow; and New Subsurface Signals that transform our ability to see into and characterize subsurface systems. The SubTER team developed an extensive R&D plan for advancing technologies within these four core pillars and also identified several areas where new technologies would require additional basic research. In response, the Office of Science, through its Office of Basic Energy Science (BES), convened a roundtable consisting of 15 national lab, university and industry geoscience experts to brainstorm basic research areas that underpin the SubTER goals but are currently underrepresented in the BES research portfolio. Held in Germantown, Maryland on May 22, 2015, the round-table participants developed a basic research agenda that is detailed in this report. Highlights include the following: -A grand challenge calling for advanced imaging of stress and geological processes to help understand how stresses and chemical substances are distributed in the subsurface—knowledge that is critical to all aspects of subsurface engineering; -A priority research direction aimed at achieving control of fluid flow through fractured media; -A priority research direction aimed at better understanding how mechanical and geochemical perturbations to subsurface rock systems are coupled through fluid and mineral interactions; -A priority research direction aimed at studying the structure, permeability, reactivity and other properties of nanoporous rocks, like shale, which have become critical energy materials and exhibit important hallmarks of mesoscale materials; -A cross-cutting theme that would accelerate development of advanced computational methods to describe heterogeneous time-dependent geologic systems that could, among other potential benefits, provide new and vastly improved models of hydraulic fracturing and its environmental impacts; -A cross-cutting theme that would lead to the creation of “geo-architected materials” with controlled repeatable heterogeneity and structure that can be tested under a variety of thermal, hydraulic, chemical and mechanical conditions relevant to subsurface systems; -A cross-cutting theme calling for new laboratory studies on both natural and geo-architected subsurface materials that deploy advanced high-resolution 3D imaging and chemical analysis methods to determine the ;rates and mechanisms of fluid-rock processes, and to test predictive models of such phenomena. Many of the key energy challenges of the future demand a greater understanding of the subsurface world in all of its complexity. This greater under- standing will improve the ability to control and manipulate the subsurface world in ways that will benefit both the economy and the environment. This report provides specific basic research pathways to address some of the most fundamental issues of energy-related subsurface engineering.

15 GEOTHERMAL ENERGY↗

DOE OSTI2019

Innovative Hot Lab Concept for Advanced D and D Application - 19175

Hot Labs are used in the nuclear industry for various purposes: maintenance of nuclear reactor, sampling and testing of fuel, inspection activities and decommissioning. Despite their vast use, their current designs and operations do not meet entirely today's needs and requirements of the operations nor tomorrow's. This paper will give an overview of the research and investigations performed around Hot Cells design and concept in order to integrate new operability modes and functions. The overall idea is to bring modularity, flexibility and adaptability to the Hot Lab nuclear industry. Taking the key principles of Model Based System Engineering, an interoperable data model, the most advanced digital technologies (Building Information Modelling - BIM, Virtual Reality / Augmented Reality, Artificial Intelligence), and looking at all the life-cycle of such a facility, a concept design of a new type of Hot Lab has been developed. Four mains aspects are implemented during this study: Implement the principles of the Industry 4.0; use modular and flexible solutions; explore the concept of in service maintenance and predictive maintenance; optimise the decommissioning and dismantling process by taking into account the entire life-cycle of the facility. The design was developed as a case study taking several assumptions to adapt to any project. The design developed demonstrates that modularity and flexibility can be brought in without compromising the core safety functions of such a facility. This Hot Lab concept brings the current Hot Lab to the next level as the design has been adapted to meet the current operational needs, implement novel ideas and consider its entire life-cycle. This paper will demonstrate how decommissioning and dismantling operations can become more efficient and safer with such a concept. In addition, the Model Based System Engineering approach used from the beginning of the design phase allows to have an optimum architecture during its entire lifetime. It also allowed to flag new topics to be further developed for the benefit of the nuclear industry as a whole. A first example would be the development of the Control System using digital tools and artificial intelligence to run remotely controlled equipment inside the Hot Lab. Assystem is an international engineering group. As a key participant in the nuclear industry for over 50 years, the Group supports its clients in managing their capital expenditure throughout their asset life-cycles. Assystem can offer support in project management, design, digital engineering, industrial control systems, security and safety and industrial digitalisation. Assystem's Imagine program is an internal program intending to serve as an incubator for the development of innovations. The Innovative Hot Lab project integrates one of the four innovation projects Assystem choose to develop and invest in. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2015

Options of system integrated environment modelling in the predicated dynamic cyberspace

In this article there are briefly mentioned some selected options of contemporary conception of cybernetic system models in the corresponding and possible integratable environment with modern system dynamics thinking and all this in the cyberspace of possible projecting of predicted system characteristics. The key to new capabilities of system integration modelling in the considered cyberspace is mainly the ability to improve the environment and the system integration options, all this with the aim of modern control in the hierarchically arranged dynamic cyberspace, e.g. in the currently desired electronic business with information. The aim of this article is to assess generally the trends in the use of modern modelling methods considering the cybernetics applications verified in practice, modern concept of project management and also the potential integration of artificial intelligence in the new projecting and project management of integratable and intelligent models, e.g. with the optimal structures and adaptable behaviour.The article results from the solution of a specific research partial task at the faculty; especially the moments proving that the new economics will be based more and more on information, knowledge system defined cyberspace of modern management, are stressed in the text.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

LCLS Big Data Handling – How I Learned to Stop Worrying and Love the Data Deluge

Advanced data and computing systems are vital to Linac Coherent Light Source (LCLS) operations, data interpretation and overall scientific productivity. The transition to MHz-era operation marks a fundamental change in scale that requires new infrastructure and architectures to link LCLS to the required scale of computing needed for scientific interpretation. The LCLS-II Data System meets big data challenges by implementing configurable data reduction that can adapt to multiple science areas, real-time analysis frameworks to provide visualization and fast feedback, and the ability to transfer data to local and remote computational facilities for near real time analysis at the appropriate scale. Feature extracted information generated in the data analysis pipeline - at the edge, local compute, or remote High-Performance Computing (HPC) resources - can be used to steer experiments and inform user decisions during beam time. Artificial Intelligence and Machine Learning (AI/ML) techniques present new opportunities to rapidly analyse large datasets and direct experiments, but create new challenges in scaling, adaptability, complexity, and trustworthiness. We describe how the LCLS-II Data System architecture addresses its data-driven challenges in the areas of data acquisition, data processing, data management, and workflow orchestration to decrease the overall time-to-science and provide a vision for future developments.

artificial intelligence↗

DOE OSTI2025

Glancing Angle Deposition in Gas Sensing: Bridging Morphological Innovations and Sensor Performances

Glancing Angle Deposition (GLAD) has emerged as a versatile and powerful nanofabrication technique for developing next-generation gas sensors by enabling precise control over nanostructure geometry, porosity, and material composition. Through dynamic substrate tilting and rotation, GLAD facilitates the fabrication of highly porous, anisotropic nanostructures, such as aligned, tilted, zigzag, helical, and multilayered nanorods, with tunable surface area and diffusion pathways optimized for gas detection. This review provides a comprehensive synthesis of recent advances in GLAD-based gas sensor design, focusing on how structural engineering and material integration converge to enhance sensor performance. Key materials strategies include the construction of heterojunctions and core–shell architectures, controlled doping, and nanoparticle decoration using noble metals or metal oxides to amplify charge transfer, catalytic activity, and redox responsiveness. GLAD-fabricated nanostructures have been effectively deployed across multiple gas sensing modalities, including resistive, capacitive, piezoelectric, and optical platforms, where their high aspect ratios, tailored porosity, and defect-rich surfaces facilitate enhanced gas adsorption kinetics and efficient signal transduction. These devices exhibit high sensitivity and selectivity toward a range of analytes, including NO2, CO, H2S, and volatile organic compounds (VOCs), with detection limits often reaching the parts-per-billion level. Emerging innovations, such as photo-assisted sensing and integration with artificial intelligence for data analysis and pattern recognition, further extend the capabilities of GLAD-based systems for multifunctional, real-time, and adaptive sensing. Finally, current challenges and future research directions are discussed, emphasizing the promise of GLAD as a scalable platform for next-generation gas sensing technologies.

Chemistry↗

DOE OSTI2016

Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting

This study discuss, intelligent buildings are quickly becoming cohesive and integral entities of cyber-physical ecosystems. Modern buildings adapt to internal and external elements and thrive on ever increasing data sources such as ubiquitous smart devices and sensors while mimicking various approaches previously known in software, hardware, and bio inspired systems. This article provides an overview of intelligent buildings of the future from a range of perspectives. First, a brief overview of prospects of U.S. and world energy consumption, concepts of smart buildings as integral entities of smart grids is presented. This is followed by a discussion of the role of connectivity and interoperability as well as current issues and solutions in the areas of security, resilience, and humans in realm of intelligent buildings. The article dives into detail about the intelligence aspect of intelligent buildings of the future. The learning and predictive Artificial Intelligence (AI) techniques behind many of the concepts of intelligent buildings are reviewed, including the latest techniques such as deep learning. As a concrete application of AI in the realm of intelligent buildings, prediction of energy consumption/load/demand, which is a much researched application of AI in the realm of intelligent buildings, is elaborated. The discussion is focused on most recent advancements of AI based demand prediction and the overview consists of existing research and a case study conducted by the authors for deep learning based demand prediction. Then, the article discusses the role of humans in intelligent buildings. Different types of human-building interactions are identified. Further, the article presents how each type of human-building interaction can benefit the overall control of intelligent buildings. The section is concluded by elaborating a case study conducted by the authors to achieve effective and efficient human-building interaction. The article is concluded with compilation of future insights based on latest technological advancements in U.S. industry and government.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2025

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize multiple performance metrics, including job wait time and system throughput. Traditional heuristic-based scheduling algorithms increasingly struggle and lack the efficiency needed to meet the demands and address the complexity and scale of modern HPC systems. Consequently, recent research efforts have focused on leveraging advancements in Artificial Intelligence (AI) and Deep Learning (DL), particularly Reinforcement Learning (RL), to develop more adaptable and intelligent scheduling strategies. Previous RL-based scheduling approaches have explored a range of algorithms, from Deep Q-Networks (DQN) to Proximal Policy Optimization (PPO), and more recently, hybrid methods that integrate Graph Neural Networks (GNNs) with RL techniques. However, a common limitation across these methods is their reliance on relatively small datasets, with few methods being evaluated using large-scale, multi-million-job trace datasets representative of real-world HPC workloads. Moreover, existing RL schedulers face scalability issues due to centralized policy updates, which hinder training efficiency and performance when applied to large datasets. This study introduces a novel RL-based scheduler utilizing Decentralized Distributed Proximal Policy Optimization (DD-PPO) algorithm, which supports large-scale distributed training across multiple workers without requiring parameter synchronization at every step. By eliminating reliance on centralized updates to a shared policy, the DD-PPO scheduler enhances scalability, training efficiency, and sample utilization. Experimental validation using a large real-world dataset containing over 11.5 million job traces collected from petascale HPC systems over six years assesses the influence of dataset scale on training effectiveness and compares DD-PPO performance to traditional and advanced scheduling approaches. The experimental results demonstrate improved scheduling performance in comparison to both heuristic-based schedulers and existing RL-based scheduling algorithms.

AI↗