Search NASA⌕ Search

SEARCH · Search NASA

Results for “agentic systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Nanostructured mixed metal oxides as catalysts and method of making thereof

A method of forming a metal oxide material having a rod shape or polyhedral nanostructure includes preparing a first reverse micro-emulsion system comprising an aqueous precipitating agent dispersion and a second reverse micro-emulsion system containing an aqueous metal salt dispersion; combining the micro-emulsions together to initiate a reaction; allowing the reaction to continue to form a product mixture comprising a metal oxide gel and aqueous media; separating the metal oxide gel from the aqueous media; collecting the metal oxide gel; and calcining the metal oxide gel to form the metal oxide material. The metal oxide material corresponds to the chemical formula of La2MxNi1-xO4, Pr2-yAyNiO4, or La2-zDzNiO4, wherein M is copper, cobalt, iron, manganese, chromium, aluminum, or platinum; A is lanthanum or neodymium; D is calcium, barium or strontium; x ranges from 0 to 1; y ranges from 0 to 2; and z ranges from 0 to 0.25.

Nikolla, Eranda↗
DOE OSTI2020

Flexible Service Contracting for Risk Management within Integrated Transmission and Distribution Systems

The general objective of our project has been to investigate the ability of Independent Distribution System Operators (IDSOs), functioning as linkage agents for Integrated Transmission and Distribution (ITD) systems, to facilitate the flexible availability and usage of reserve in support of ITD system operations. This general objective is in accordance with Order 2222 of the U.S. Federal Energy Regulatory Commission (FERC), titled “Participation of Distributed Energy Resource Aggregations in Markets Operated by Regional Transmission Organizations and Independent System Operators”. The Final Rule for FERC Order 2222 was issued on September 17, 2020. The primary contribution of our project is that we have formulated an innovative energy management Transactive Energy Design (TES) approach for ITD systems that provides promising support for our project objective. Specifically, we have developed a new type of IDSO-managed TES design for distribution system operations, as well as new types of swing contracts permitting IDSOs to participate in transmission system operations as providers of reserve harnessed from distribution system resources in return for appropriate compensation. Together, these design elements constitute a scalable market-based approach facilitating efficient reserve procurement for ITD system operations from a fuller range of power resources. The efficacy of our approach has been demonstrated by means of detailed conceptual analyses as well as test case simulations. To implement the latter, we have developed the ITD TES Platform V2.0, a computational platform that permits the modeling and software implementation of ITD system operations over time. The Electric Reliability Council of Texas (ERCOT) energy region has been used as the empirical anchor for the development of this platform. Our conceptual and test-case work has been reported in a Wiley/IEEE Press book, two refereed book chapters, and seven refereed journal articles. The key components comprising the ITD TES Platform V2.0 have been released as documented open-source software at online GitHub repositories.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Crowd Dynamics: Modeling and Control of Multiagent Systems

This review aims to present recent developments in modeling and control of multiagent systems. A particular focus is set on crowd dynamics characterized by complex interactions among agents, also called social interactions, and large-scale systems. Specifically, in a crowd each individual agent interacts with a field generated by the other agents and the environment. These systems can be modeled at the microscopic scale by ordinary differential equations, while an alternative description at the mesoscopic scale is given by a partial differential equation for the propagation of the probability density of the agents. Control actions can be applied at the individual level as well as at the level of the corresponding fields. This article presents and compares different control types, and the specific application to multilane, multiclass traffic is developed in some detail, showing the main tools at work in a hybrid setting with relevant impacts on autonomous driving.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Compounds for reactivation of acetylcholinesterase and related compositions methods and systems

Described herein are oxime compounds capable of inactivating a nerve agent, blood brain barrier (BBB)-penetration, and/or reactivation of nerve agent-inhibited acetylcholinesterase (AChE) and related methods, systems and compositions for inactivation of one or more nerve agents, therapeutic and/or prophylactic treatment of an individual, and/or decomposition of nerve agent for decontamination.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

A Randomization-Based, Zero-Trust Cyberattack Detection Method for Hierarchical Systems

This paper demonstrates a novel randomization-based approach for verifying power system control signals with application to detecting cyberattacks. We consider fully connected hierarchical systems containing multiple local agents and a global "trust" agent. The global agent uses a time-varying randomized assignment scheme to identify corrupt network links based on principles of zero trust and majority rule. To evaluate the performance of this detection approach, we implement our algorithm in MATLAB and run it against nearly 43 million unique attack scenarios spanning a range of system sizes. For each scenario, the algorithm determines whether the identified corruptions satisfy a set of validity constraints reflecting network topology and uses that result to say whether the recovered state value for one or more local agents is malicious. We compare the algorithm's determination to the true state of the system to assess performance and find that classification accuracy converges to 100% as system size increases, suggesting that the validity constraints become more difficult to satisfy for larger systems. We further explore the scenarios that evade detection to understand practical implications for employing this detection approach.

cybersecurity↗
DOE OSTI2022

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗
DOE OSTI2025

Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building

With the recent demand for decarbonization and energy efficiency, advanced HVAC control using Deep Reinforcement Learning (DRL) becomes a promising solution. Due to its flexible structures, DRL has been successful in energy reduction for many HVAC systems. However, only a few researches applied DRL agents to manage the entire central HVAC system and control multiple components in both the water loop and the air loop, owing to its complex system structures. Moreover, those researches have not extended their applications by incorporating the indoor air quality, especially both CO2 and PM2.5concentrations, on top of energy saving and thermal comfort, as achieving those objectives simultaneously can cause multiple control conflicts. What's more, DRL agents are usually trained on the simulation environment before deployment, so another challenge is to develop an accurate but relatively simple simulator. Therefore, we propose a DRL algorithm for a central HVAC system to co-optimize energy consumption, thermal comfort, indoor CO2 level, and indoor PM2.5 level in an office building. To train the controller, we also developed a hybrid simulator that decoupled the complex system into multiple simulation models, which are calibrated separately using laboratory test data. The hybrid simulator combined the dynamics of the HVAC system, the building envelope, as well as moisture, CO2, and particulate matter transfer. Three control algorithms (rule-based, MPC, and DRL) are developed, and their performances are evaluated on the hybrid simulator environment with a realistic scenario (i.e., with stochastic noises). The test results showed that, the DRL controller can save 21.4 % of energy compared to a rule-based controller, and has improved thermal comfort, reduced indoor CO2 concentration. The MPC controller showed an 18.6 % energy saving compared to the DRL controller, mainly due to savings from comfort and indoor air quality boundary violations caused by unmeasured disturbances, and it also highlights computational challenges in real-time control due to non-linear optimization. Finally, we provide the practical considerations for designing and implementing the DRL and MPC controllers based on their respective pros and cons.

Guo, Fangzhou↗
DOE OSTI2023

Linkages Between NREL's dGen, REopt, and SAM Models

This webinar describes linkages between NREL's dGen, SAM, and REopt tools that were developed as a part of the RiDER project, including specifying utility rates in the SAM GUI and using them in dGen adoption analysis, and using REopt to determine optimal system sizes for dGen agents.

dGen↗
DOE OSTI2024

Buyers Collusion in Incentivized Forwarding Networks: A Multi-Agent Reinforcement Learning Study

We present the issue of monetarily incentivized forwarding in a multi-hop mesh network architecture from an economic perspective. It is anticipated that credit-incentivized forwarding and relaying will be a simple method of exchanging transmission power and spectrum for connectivity. However, gateways and forwarding nodes, like any other free market, may create an oligopolistic market for the users they serve. In this study, a coalition scheme between buyers aims to address price control by gateways or nodes closer to gateways. In a Stackelberg competition game, buyer agents (users) and sellers (gateways) make decisions using reinforcement learning (RL), with decentralized Deep Q-Networks to buy and sell forwarding resources. We allow communication links between the buyers with a limited messaging space, without defining a collusion mechanism. The idea is to demonstrate that through messaging, and RL tacit collusion can emerge between agents in a decentralized setup. The multi-agent reinforcement learning (MARL) system is presented and analyzed from a machine-learning perspective. Moreover, MARL dynamics are discussed via mean field analysis to better understand divergence causes and make implementation recommendations for such systems. Finally, the simulation results show the results of coordination among the users.

42 ENGINEERING↗
DOE OSTI2026

Agentic artificial intelligence for multistage physics experiments at a large-scale user facility particle accelerator

We present a language-model-driven agentic artificial intelligence (AI) system to autonomously execute multistage physics experiments on a production synchrotron light source. Implemented at the Advanced Light Source particle accelerator, the system translates natural language user prompts into structured execution plans that combine archive data retrieval, control-system channel resolution, automated script generation, controlled machine interaction, and analysis. In a representative machine physics task, we show that preparation time was reduced by 2 orders of magnitude relative to manual scripting even for a system expert, while operator-standard safety constraints were strictly upheld. Core architectural features, plan-first orchestration, bounded tool access, and dynamic capability selection, enable transparent, auditable execution with fully reproducible artifacts. These results establish a blueprint for the safe integration of agentic AI into accelerator experiments and demanding machine physics studies, as well as routine operations, with direct portability across accelerators worldwide and, more broadly, to other large-scale scientific infrastructures.

Accelerator/storage ring control systems↗
DOE OSTI2025

Privacy-Preserving Average Consensus With Beaver Triple and Communication Obfuscation

A privacy-preserving average consensus algorithm is proposed that synergizes the Beaver triple in secret sharing theory and noise obfuscation. The algorithm safeguards the initial values of agents against passive adversaries in a multiagent system. It is proved that the proposed algorithm can concurrently ensure average consensus and privacy, while also reducing the online computation and communication overhead compared to encryption-based ones. In addition, it imposes a less stringent condition for privacy preservation compared to certain noise-obfuscation techniques.

Beaver triple↗
DOE OSTI2025

Simultaneous Control of Unburned NH 3 and NO x Emissions From High Load Dual-Fuel Ammonia Operation on a High-Speed Diesel Engine Using a Cu-SCR System

Dual-fuel ammonia strategies are being investigated as a promising way to utilize NH 3 as an alternative fuel for internal combustion engines in the maritime sector. One of the remaining barriers to implementing dual-fuel NH 3 combustion strategies is understanding ways to minimize unburned NH 3 and nitrogen oxide (NO x ) emissions from these engines, both of which are elevated relative to a conventional diesel baseline. Selective catalytic reduction (SCR) systems are widely used for lean NO x emission controls for engines across transportation and stationary energy applications. SCR systems use a reducing agent, such as NH 3 , to react with NO x in the exhaust, converting it into nitrogen and water. Typically, NH 3 is injected into the exhaust as a urea solution. In dual-fuel NH 3 engines, where unburned NH 3 is present in the exhaust, an SCR system could be used to mitigate both NH 3 and NO x emissions. The presented work evaluates a commercial copper-zeolite SCR and ammonia slip catalyst system, designed for on-road diesel engine applications, for controlling unburned NH 3 and NO x emissions from a dual-fuel NH 3 combustion engine. The aftertreatment system was installed downstream of a single-cylinder four-stroke diesel engine that has been modified for dual-fuel ammonia use. Furthermore, the emissions were characterized by using a Fourier transform infrared spectrometer for both late- and early-injection diesel pilot strategies over three air–fuel equivalence ratios spanning from 1.6 to 1.0 at 1200 rpm and 12.6 bar IMEP g condition (with greater than 95% ammonia energy fraction). Initial findings indicate that the SCR achieves more than 99% NO x conversion with less than 50 ppm NH 3 slip at air–fuel equivalence ratios greater than 1.4 at the operating conditions investigated. However, these benefits are accompanied by additional N 2 O emissions that are formed over the Cu-SCR.

Catalysts↗
DOE OSTI2020

Application of Gaussian Bayes classifier to differentiate chlorine-based chemical agents

The Portable Isotopic Neutron Spectroscopy (PINS) is a commercialized system developed by Idaho National Laboratory (INL) to examine chemical warfare agents (CWA) non-destructively, utilizing Prompt Gamma Neutron Activation Analysis (PGNAA) techniques. The PINS system takes advantage of a high-resolution gamma-ray spectrum from a mechanically-cooled high-purity germanium (HPGe) detector. One of the difficult technical challenges is to discriminate the chlorine-based chemical agents. Especially, CN, CNB, CNS and CG have similar chemical compositions to make it hard to discriminate them with a higher confidence. Current identification algorithms for PINS systems with 252-Cf sources have been improved and updated continuously as more field data became available, and new algorithms was studied to complement the current algorithms by adopting the Gaussian Bayes classifier. These new algorithms were intended to be applied to a subset of chlorine-based chemical agents, and their main goal is discriminate CN, CNB, CNS and CG with their ratios of the chlorine neutron inelastic 1763keV peak to the chlorine thermal neutron capture 1959keV peak, which is referred to as the “Cl i/c” or “clic” ratio in this study. The Cl i/c ratios were assumed to follow Gaussian distributions with the means and the standard deviations unique to their corresponding chemical agents. The prior probabilities of these four chemical agents were optimized with a collection of field data to achieve the best performance in terms of precision or positive predictive value (PPV). Finally, their posterior probabilities as functions of the Cl i/c ratio were implemented in the current version of PINS analysis software in order to be tested with more field data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

Hybrid Imitation Learning for Real-Time Service Restoration in Resilient Distribution Systems

Self-healing capability is a critical factor for a resilient distribution system, which requires intelligent agents to automatically perform service restoration online, including network reconfiguration and reactive power dispatch. Here, the article proposes the imitation learning framework for training such an agent, where the agent will interact with an expert built based on the mixed-integer program to learn its optimal policy, and therefore significantly improve the training efficiency compared with exploration-dominant reinforcement learning (RL) methods. This significantly improved training efficiency makes the training problem under N-k scenarios tractable. A hybrid policy network is proposed to handle tie-line operations and reactive power dispatch simultaneously to further improve the restoration performance. The 33-bus and 119-bus systems with N-k disturbances are employed to conduct the training. The results indicate that the proposed method outperforms traditional RL algorithms such as the deep-Q network.

42 ENGINEERING↗
DOE OSTI2020

Deep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems

This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (DRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in distribution networks to an intelligent deep Q-network (DQN) framework, which avoids solving a specific optimization model directly when facing time-varying operating conditions in the systems. We consider statuses/ratios of switchable capacitors, voltage regulators, and smart inverters installed at distributed generators as the action variables of the agents. A delicately designed reward function guides these agents to interact with the distribution system, in the direction of reinforcing voltage regulation and power loss reduction simultaneously. The forward-backward sweep method for radial three-phase distribution systems provides accurate power flow results within a few iterations to the DRL environment. The proposed method realizes the dual goals for VVO. We test this algorithm on the unbalanced IEEE 13-bus and 123-bus systems. Numerical simulations validate the excellent performance of this method in voltage regulation and power loss reduction.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2021

Moving Beyond the Standard of Care: Accelerate Testing of Radiation-Drug Combinations

Radiation therapy is a major treatment modality used in > 60% of cancer patients as definitive local treatment for inoperable locoregionally confined tumors and as palliative therapy. Although cytotoxic chemotherapy enhances the effectiveness of treatment, the benefit over radiation therapy alone is modest. There is a need to enhance the effectiveness of local tumor control over what sequentially or concurrently administered cytotoxic chemotherapy provides. Although many biological pathways are known to enhance the effectiveness of radiation therapy, there is currently a paucity of drugs approved for use in combination. Several clinical trials have tested the effectiveness of combining targeted agents or immunotherapies with radiation therapy, but the results of these trials have been negative, likely stemming from the relative lack of preclinical evidence using appropriate experimental standardization or model systems. Accelerating the identification of agents tested in an appropriate clinical context and experimental systems or models would greatly enhance the potential to bring forward early testing of drugs that would not only be safe but also more effective. This article provides an overview of the opportunities and challenges of developing therapeutics to combine with radiation therapy, and some guidance toward preclinical and early clinical testing to improve the chance that advanced phase testing of drug-radiation combinations would be successful in the long term.

62 RADIOLOGY AND NUCLEAR MEDICINE↗