Search NASA⌕ Search

SEARCH · Search NASA

Results for “Agent”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Signal Whisperers: Enhancing Wireless Reception Using DRL-Guided Reflector Arrays

This paper presents a multi-agent reinforcement learning (MARL) approach for controlling adjustable metallic reflector arrays to enhance wireless signal reception in non-line-of-sight (NLOS) scenarios. Unlike conventional reconfigurable intelligent surfaces (RIS) that require complex channel estimation, our system employs a centralized training with decentralized execution (CTDE) paradigm where individual agents corresponding to reflector segments autonomously optimize reflector element orientation in three-dimensional space using spatial intelligence based on user location information. Through extensive ray-tracing simulations with dynamic user mobility, the proposed multi-agent beam-focusing framework demonstrates substantial performance improvements over single-agent reinforcement learning baselines, while maintaining rapid adaptation to user movement within one simulation step. Comprehensive evaluation across varying user densities and reflector configurations validates system scalability and robustness. The results demonstrate the potential of learning-based approaches for adaptive wireless propagation control.

deep reinforcement learning↗

Constrained Turret Defense with Fixed Final Time

In this paper, we extend existing turret defense differential game formulations involving a turn-constrained turret and mobile agent to include specified final time and a constraint. For the purposes of this analysis, the specified final time may represent some exogenous input, perhaps representing the time at which some other event will take place. As for the constraint, it represents a no-fly zone for the mobile agent. The scenario is formulated as a two-player, zero-sum differential game and solved via the method of characteristics (i.e., back-propagation of equilibrium trajectories). Three different trajectory types make up the solution: trajectories that end with the turret aligned with the mobile agent, trajectories that end with the mobile agent on the constraint boundary, and regular trajectories.

differential game, game theory↗

Langmuir adsorption model to assess the impact of silane coupling on nano-dispersion of silica in SBR

Surface active agents are often used to improve dispersion of nanoparticles. Quantitative correlation between these surface-active molecules and nanoscale dispersion is absent from the literature partly because a quantitative measure of nanoscale dispersion does not exist. Recently, we have developed the Virial-van der Waals method to quantify dispersion in nanocomposites using virial coefficients. In this paper, the Langmuir adsorption model is used to quantify the influence of surface-active agents on nano-scale dispersion in terms of the effective second virial coefficient B 2 *. The impact of silane coupling agent on the nano-dispersion and silica aggregate structure in precipitated silica/SBR nanocomposites is demonstrated. It is shown that the higher viscosity SBR matrix led to a greater silica aggregate structural breakup, while lower viscosity matrix improved surface silanization. The isomeric content of the SBR, which impacts the dielectric behavior, impacted whether the system could be modeled through a mean-field or specific interactions. We earlier showed that larger aggregates improve dispersion, and this is reaffirmed in these results. After account is made for aggregate size, nano-scale dispersion improves with the addition of silane coupling agent. The behavior is well modeled using Langmuir monolayer adsorption.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Investigating the Theranostic Potential of Elementally Matched [ 43 Sc]Sc-PSMA-617 and [ 47 Sc]Sc-PSMA-617

The theranostic approach, which employs diagnostic radiopharmaceuticals to select patients who would benefit from targeted radiotherapy agents, has become an invaluable strategy for effective medical care. Scandium radionuclides offer the advantage of forming elementally matched and chemically identical diagnostic and therapeutic compounds, making them ideal candidates for this strategy. PSMA-617 is an established prostate-specific membrane antigen targeting agent and can be used as a proof of concept to investigate 43 Sc, the diagnostic nuclide, and 47 Sc, the therapeutic nuclide, as a theranostic pair. Methods: Cellular uptake, competitive binding assays, and internalization studies were carried out using LNCaP or PC-3 cell lines. [ 43 Sc]Sc-PSMA-617 was used in PET imaging studies in LNCaP or PC-3 tumor models, with time points ranging from 1–9 h. LNCaP tumor-bearing mice injected with [ 47 Sc]Sc-PSMA-617 were imaged using SPECT up to 48 h. A longitudinal study was carried out using LNCaP tumor-bearing mice imaged with [ 43 Sc]Sc-PSMA-617 prior to receiving a therapeutic dose of [ 47 Sc]Sc-PSMA-617. Results: 43 Sc and 47 Sc were incorporated into PSMA-617 at radiochemical yields of >99%. Cellular uptake studies demonstrated high uptake and specificity to PSMA receptors for [ 47 Sc]Sc-PSMA-617. In vivo PET studies showed specificity of [ 43 Sc]Sc-PSMA-617 while SPECT studies demonstrated tumor retention of [ 47 Sc]Sc-PSMA-617 up to 48 h. [ 47 Sc]Sc-PSMA-617 demonstrated therapeutic efficacy by delaying tumor growth and increasing survival rates from a single administered dose in xenograft models. More importantly, the PET results from [ 43 Sc]Sc-PSMA-617 PET were highly correlated with the therapeutic response from [ 47 Sc]Sc-PSMA-617, showing that 43 Sc PET data can predict therapeutic outcomes in individual animals from 47 Sc agents, even in animals sharing a genetic background and implanted with tumors from the same cell line. Conclusions: Two chemically identical, PSMA-targeting radioscandium pharmaceuticals demonstrated in vivo stability, specificity and retention in PSMA+ tumor models. A theranostic study showed that a higher 43 Sc PET SUVmean was strongly correlated to therapeutic response from the 47 Sc agent, demonstrating that 43 Sc and 47 Sc can be used as an elementally matched theranostic pair.

Biodistribution↗

Characterization of spent nuclear fuel canister surface roughness using surface replicating molds

In this study we present a replication method to determine surface roughness and to identify surface features when a sample cannot be directly analyzed by conventional techniques. As a demonstration, this method was applied to an unused spent nuclear fuel dry storage canister to determine variation across different surface features. In this study, an initial material down-selection was performed to determine the best molding agent and determined that non-modified Polytek PlatSil23-75 provided the most accurate representation of the surface while providing good usability. Other materials that were considered include Polygel Brush-On 35 polyurethane rubber (with and without Pol-ease 2300 release agent), Polytek PlatSil73-25 silicone rubber (with and without PlatThix thickening agent and Pol-ease 2300 release agent), and Express STD vinylpolysiloxane impression putty. The ability of PlatSil73-25 to create an accurate surface replica was evaluated by creating surface molds of several locations on surface roughness standards representing ISO grade surfaces N 3 , N 5 , N 7 , and N 8 . Overall, the molds were able to accurately reproduce the expected roughness average (R a ) values, but systematically over-estimated the peak-valley maximum roughness (R z ) values. Using a 3D printed sample cell, several locations across the stainless steel spent nuclear fuel canister were sampled to determine the surface roughness. These measurements provided information regarding variability in normal surface roughness across the canister as well as a detailed evaluation on specific surface features (e.g., welds, grind marks, etc.). The results of these measurements can support development of dry storage canister ageing management programs, as surface roughness is an important factor for surface dust deposition and accumulation. This method can be applied more broadly to different surfaces beyond stainless steel to provide rapid, accurate surface replications for analytical evaluation by profilometry.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DISTRI: Distributed Multi-Facility HPC Simulator (DISTRI) v2.1

DISTRI is an advanced network simulator designed for multi-facility computational infrastructures with agentic behavior. It simulates HPC facilities where computational resources act as autonomous agents, making intelligent decisions about job scheduling, load balancing, and resource allocation. The simulator focuses on developing and testing decentralized algorithms that promote resilience and efficiency in multi-facility environments. Key Features: - Agentic Resource Behavior: Processors and DTNs act as autonomous agents with decision-making capabilities - Pheromone-Based Load Balancing: Decentralized load balancing inspired by ant colony optimization - Dual Topology Support: Mesh (normal operations) and Dumbell (network testing) topologies - Comprehensive TCP Simulation: Realistic TCP implementations with multiple congestion control algorithms - Failure Resilience Testing: Processor failure simulation with automatic job reassignment - Extensive Visualization: Detailed performance analysis and metrics collection - Research-Ready: Designed for algorithm development and benchmarking

Bez, Jean Luca [Lawrence Berkeley National Laborat↗

Wolf

The Workflow Orchestration Language Framework (WOLF) is an agentic framework grounded in natural language with an architecture inspired by reinforcement learning (RL)—designed to orchestrate, scale, and accelerate complex workflows. The concept of WOLF was born out of the very successful ASC Tri-lab Multi-Agent Design Assistant (MADA) project, but extends beyond its domain-specific design agents to provide a more general and extensible architecture. WOLF capitalizes on the lessons learned from MADA and is fully aligned with Sutton’s The Bitter Lesson—that the most enduring progress in AI comes from general-purpose methods that scale with computation, rather than narrow techniques built on domain-specific human knowledge. In this spirit, WOLF enables agents to autonomously learn workflows, capture strategies as reusable playbooks, and build a growing corpus of interpretable, auditable “wisdom artifacts.” These artifacts, expressed in natural language, bridge human and machine understanding while preserving adaptability and scalability as computational power continues to expand.

Boureima, Ismaeal↗

AI-Ready Semantic Infrastructure for CEBAF: From CED to PALS Knowledge Graphs

JLab and PNNL are jointly developing an AI-ready data ecosystem that exposes the Continuous Electron Beam Acceleration Facility’s (CEBAF’s) operational configuration, lattice description, and control-system channels to agentic optimization frameworks through a standards-based semantic layer. The effort integrates the existing facility-specific CEBAF Element Database (CED) with extensions of the emerging facility-agnostic Particle Accelerator Lattice Standard (PALS) to produce a knowledge graph (KG) containing coherent, machine-interpretable views of devices, signals, and regions. With this KG, CEBAF’s setpoints, readbacks, and device hierarchies become queryable using a uniform declarative graph query language (e.g., Neo4j Cypher), providing intents and inspectable semantics suitable for agentic control. The resulting graph-backed interfaces will allow autonomous agents to retrieve authoritative machine configurations, reason over device- and signal-level relationships, and execute tuning and diagnostic workflows without bespoke CEBAF-specific logic, thereby delivering a scalable pathway from operational data to trustworthy agentic accelerator tuning frameworks.

Zhang, He [Thomas Jefferson National Accelerator F↗

Topology-Aware Reinforcement Learning for Voltage Control: Centralized and Decentralized Strategies

Volt-VAR control (VVC) methods based on deep reinforcement learning (DRL) can effectively control distribution grid voltage and minimize power loss by implementing corrective and preventive control measures on the reactive power output of inverter-based distributed energy resources (DERs). However, model-free DRL-based VVC approaches usually cannot capture the important topological feature of the power system since they use a fully-connected network (FCN) to deliver the action. Therefore, this paper proposes a graph convolutional network (GCN)-based DRL approach that can employ the topological information of the network to take better control action for regulating the voltage. Our implementation allows for both centralized and decentralized configurations, utilizing a single agent and multiple agents respectively. Although the centralized GCN-based DRL approach has its advantages of minimizing voltage fluctuation and power loss, it is not suitable for large scale power systems due to its challenges in terms of scalability, computation speed and potential single points of failure. Therefore, these problems can be resolved using the decentralized GCN-based DRL approach. Moreover, to ensure the safe operation of the model, our proposed approach incorporates an exponential barrier function while formulating the reward function for each agent. To validate performance of the proposed approaches, the proposed model is tested on modified IEEE test systems and the performances are measured in terms on voltage fluctuation reduction, minimization of power loss and computational speed. Finally, the results show that the proposed topology-aware approach outperforms the FCN-based DRL approach in terms of reducing voltage fluctuation and minimizing power loss of the network. Moreover, it is shown that the decentralized GCN-based DRL has faster computational speed than other approaches.

42 ENGINEERING↗

A novel digital lifecycle for Material‐Process‐Microstructure‐Performance relationships of thermoplastic olefins foams manufactured via supercritical fluid assisted foam injection molding

Abstract This research significantly enhances the applicability of thermoplastic olefins (TPOs) in the automotive industry using supercritical N 2 as a physical foaming agent, effectively addressing the limitations of traditional chemical agents. It merges experimental results with simulations to establish detailed material‐process‐microstructure‐performance (MP2) relationships, targeting 5–20% weight reductions. This innovative approach labeled digital lifecycle (DLC) helps accurately predict tensile, flexural, and impact properties based on the foam microstructure, along with experimentally demonstrating improved paintability. The study combines process simulations with finite element models to develop a comprehensive digital model for accurately predicting mechanical properties. Our findings demonstrate a strong correlation between simulated and experimental data, with about a 5% error across various weight reduction targets, marking significant improvements over existing analytical models. This research highlights the efficacy of physical foaming agents in TPO enhancement and emphasizes the importance of integrating experimental and simulation methods to capture the underlying foaming mechanism to establish material‐process‐microstructure‐performance (MP2) relationships. Highlights Establishes a material‐process‐microstructure‐performance (MP2) for TPO foams Sustainably produces TPO foams using supercritical (ScF) N 2 with 20% lightweighting Shows enhanced paintability for TPO foam improved surface aesthetics Digital lifecycle (DLC) that predicts both foam microstructure and properties DLC maps process effects & microstructure onto FEA mesh for precise prediction

Engineering↗

Synthesis and characterization of biobased copolyesters based on pentanediol: (2) Poly(pentylene adipate–co–terephthalate)

Traditionally, most flexible food packaging is made of linear low-density polyethylene (LLDPE) which cannot easily be recycled, nor will it degrade in a reasonable timescale. In this work, a biobased biodegradable polyester alternative was investigated as a possible replacement for LLDPE. High molecular weight poly (pentylene adipate-co-terephthalate) with a 40/60 adipic acid/terephthalic acid mole ratio was synthesized using direct esterification and polycondensation. Glycerol and hexane-1,2,5,6-tetrol were added as branching agents to better match the structure of the LLDPE which in turn might help the ability of these materials in film-blowing. Thermal, mechanical, and rheological properties of the copolyesters were thoroughly investigated. All copolyesters had a weight-average molecular weight of over 140,000 g/mol, which is necessary for proper rheology, and were thermally stable up to 350°C. Here, the addition of branching agents led to a slight decrease in crystallinity, d-spacing, melting temperature, enthalpy of melting, stress at break, and elongation at break. However, an increase in Young's modulus and complex viscosity at high frequency were observed compared to PPeAT60 without branching agent added. Although the improved crystallinity and mechanical properties of the copolyesters made them viable for film-blowing, the slow crystallization rate creates a major challenge.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bleach Rescues Nannochloropsis from an Obligate Parasite and Alters Microbial and Metabolite Signatures of Outdoor Cultures

Chemical agents are commonly used to protect algal crops. Yet, few studies have characterized the effects of these agents on associated microbial communities to understand effects on microbial functions relevant to algal crop production and protection. Here, we used shotgun metagenomic sequencing and untargeted exometabolite profiling to link the application of bleach, a -cidal agent used to protect algae from pests, to changes in community composition, metabolic pathways, and exometabolies - at a whole community level. Bleach protected the algal crop from crashing but altered bacterial diversity. Analysis of metagenome-assembled genomes (MAGs) revealed a classic predator-prey cycle between Oligoflexus and our target alga Nannochloropsis. Olifoflexus genomes from our study were notably similar to a previously identified BALO (Bdellovibrio and like organism), FD111, known to kill Nannochloropsis cultures, providing strong evidence that an FD111-like organism was responsible for the crash. Metabolic pathway composition differed between bleached and unbleached ponds, with abundance of twelve pathways related to stress tolerance, including the superpathway of methylglyoxal degradation, lipid IVA biosynthesis, and ectoine biosynthesis, greater in bleached ponds compared to unbleached ponds. Virulence factors related to adherence, biofilm formation, motility, and pathogenicity increased dramatically in bleached ponds with time, although this increase was not coupled with an increase in pathogens - algal or otherwise - or a decline in algal health. Our study highlights the importance of coupling 16S rRNA gene sequencing with whole genome data and other -omics tools to sketch a larger picture of community structure and function in crop systems. Moreover, our results highlight that continued long-term bleaching may lead to negative effects to crop health or downstream adverse health effects to humans or animals, depending on the algal product (i.e. human supplements or animal feedstocks). Future work on alternative treatment methods that would reduce resistance is necessary in the field.

09 BIOMASS FUELS↗

Comprehensive assessment of deep reinforcement learning approaches for economic dispatch in nuclear-driven microgrids

As the electrical grid integrates more variable renewable energy sources such as wind and solar, the demand for distributed and flexible systems to address this increased variability becomes critical. Nuclear-driven microgrids provide a promising solution by offering stable generation to complement intermittent renewables, ensuring grid reliability and operating efficiency. This paper proposes a recurrent deep reinforcement learning framework for optimal economic dispatch in a nuclear-powered microgrid integrating renewable energy sources, small modular reactors, battery storage systems, and balance-of-plant dynamics. A three-agent control architecture is developed, where demand and renewable energy agents act as forecasters, and a reinforcement learning-based dispatch agent performs real-time energy allocation. A nonlinear programming formulation is first used to generate an optimal baseline for benchmarking. The proposed dispatch controller, based on Proximal Policy Optimization enhanced with Long Short-Term Memory networks, exploits temporal correlations in system dynamics by taking advantage of the time series used as inputs to improve policy robustness under uncertainty. Comparative analysis against established deep reinforcement learning methods, including Proximal Policy Optimization with a feedforward architecture, Soft Actor-Critic, and Twin Delayed Deep Deterministic Policy Gradient, demonstrates superior performance. Numerical results indicate that the proposed controller achieves a 0.39% cost reduction relative to the nonlinear programming benchmark and outperforms other learning-based methods by generating additional revenue of up to 0.35%. All reinforcement learning controllers compute dispatch actions in less than 0.3 s, resulting in a computational speedup of more than three orders of magnitude over the nonlinear programming baseline. The findings of this paper highlight their applicability for real-time operation and control in nuclear-integrated microgrids under volatile operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Rapid Crystallization of Zeolites with Controllable Defects: Disentangling Fluoride Concentration and pH Using NH 4 F

Zeolite synthesis is typically conducted either under basic conditions or in neutral fluoride media using hydrofluoric acid (HF). While basic (OH − ) conditions generally result in faster zeolite crystallization, they can also increase the likelihood of framework defects and crystal intergrowths. In contrast, synthesis in neutral fluoride media tends to produce fewer defects because fluoride balances positive charges from structure-directing agents. However, this method often requires significantly longer crystallization times and involves the handling of dangerous HF. In the present study, we pursue the best of both synthesis conditions, rapid syntheses with controllable defect concentrations, by disentangling of mineralizing agent and chargebalancing agent using ammonium fluoride (NH 4 F) as an alternative to HF. We have investigated the use of NH 4 F in the syntheses of siliceous and aluminum-containing zeolite A (LTA, small pore), ZSM-5 (MFI, medium pore), and siliceous Beta(*BEA, large pore). The crystallization times of all four zeolites decreased substantially with an increasing NH 4 F concentration. Crystallization times were reduced from 24 to 4 h (Si-LTA), 96 to 36 h (Al-LTA), 240 to 6 h (ZSM-5), and 24 to 3 h (Si-*BEA). Additionally, increasing the NH 4 F concentration in the synthesis mixtures decreases the defect densities of siliceous zeolites. Raman spectroscopy, along with 29 Si MAS NMR, 19 F MAS NMR, 13 C MAS NMR, and fluorine elemental analysis of Si-LTA samples confirms that the reduction in charged defects (Si−O − ) is due to the higher incorporation of F − within the double four-membered ring (D4R) present in the LTA samples. We show that the accelerated crystallization is due to the role of F − in enhancing the silica mineralization rate (formation of silicon hexafluoride species) and stabilizing D4Rs under basic conditions. As a result, combining basic and fluoride-mediated synthesis could therefore be advantageous for faster zeolite production and improved control over structural properties for a wide variety of zeolite structures.

Anions↗

Probing the Redox Reactivity of Alkyl Bound Astatine: A Study on the Formation and Cleavage of a Stable At–C Bond

The formation of a stable alkyl At–C bond occurs during the shipment of 211 At on a 3-octanone-impregnated column and the reactivity of 211 At stripped from columns has been studied. The 211 At could not be recovered from the 3-octanone organic phase using nitric acid or sodium hydroxide, even up to 10 and 15.7 M, respectively. Several reducing and oxidizing agents, including hydrazine, hydroxylamine, ascorbic acid, ceric ammonium nitrate, potassium permanganate, sodium hypochlorite, and calcium hypochlorite were used to promote the recovery of 211 At. The most effective reducing agent was hydroxylamine, where ~70% of the 211 At was recovered, while among oxidizing agents ceric ammonium nitrate, potassium permanganate, and sodium hypochlorite all showed near quantitative recovery of 211 At. These results indicate an At–C bond is being formed during the shipment of the column and a redox reaction is required for bond cleavage to occur. Furthermore, DFT calculations have been used to propose several products of an AtO + -3-octanone reaction, with 4-astato-5-hydroxy-octa-3-one being the most probable.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Force-Triggered, Biobased Sealants for Prefabricated Building Components: Toward Improved Efficiency and Performance

The prefabricated building construction industry has made extensive progress in expediting the manufacture of prefabricated components at off-site plants. However, the sealing of joints between these components, which is crucial to ensuring the weatherproofing of the assembly, still represents a labor-intensive, on-site effort that relies on the manual installation of tapes and caulks. Here, to reduce work at the jobsite and improve the airtightness and waterproofness of building envelopes, we developed a sealant that can be installed at the plant on prefab components and have the curing reaction triggered at the jobsite by using microencapsulation technology to separate the reactive agents. A series of force-triggered, high-strength, and fast-curing sealants derived from biobased feedstocks were developed, which consist of a biobased epoxy agent encapsulated in a polymer shell, embedded in a biobased amine curing agent. The shell of the microcapsules allows an effective separation of the reactive species in the one-part sealant, allowing shelf stability to an otherwise fast-curing system as well as improving the hydrophobicity of the whole system. When force activates and breaks the microcapsules, the highly reactive epoxy and amine mix and cure, exhibiting peel strength values of up to 143 ppi (pounds per inch). The hydrophobicity of the sealants allows them to retain up to 94% of the original peel strength after complete submersion in water for 24 h, showcasing the water resistivity of the sealant system. The open-air shelf stability of the sealant complex is demonstrated by the obtention of peel strength values of ∼16 ppi when triggering the curing reaction even after being exposed 8 months to open air and humidity. The successful on-demand triggering of curing reactions and the shelf stability provide efficacy of these force-triggered sealants for installation on prefabricated components, storage for months prior to delivery, and assembly at a jobsite. These force-triggered biobased sealants for prefabricated buildings can result in lower installation time and cost and better performance than tapes and caulks at the jobsite.

biobased↗

Explainable physics-based constraints on reinforcement learning for accelerator optimization

We present a reinforcement learning (RL) framework for optimizing particle accelerator experiments that builds explainable physics-based constraints on agent behavior. The goal is to increase transparency and trust by letting users verify that the agent’s decision-making process incorporates suitable physics. Our algorithm uses a learnable surrogate function for physical observables, such as energy, and uses them to fine-tune how actions are chosen. This surrogate can be represented by a neural network or by an interpretable sparse dictionary model. We test our algorithm on a range of particle accelerator optimization environments designed to emulate the Continuous Electron Beam Accelerator Facility at Jefferson Lab. By examining the mathematical form of the learned constraint function, we are able to confirm the agent has learned to use the established physics of each environment. In addition, we find that the introduction of a physics-based surrogate enables our RL algorithms to reliably converge for difficult high-dimensional accelerator optimization environments.

explainability↗

Harnessing Machine Learning for Agnostic Biodetection

The United States’ current list-based approach to biodefense is limited because it considers only known biological agents. Alternatively, developing and adopting a system based on agent-agnostic signatures would enable detection and characterization of both known and novel agents, thereby engendering greater adaptability in the face of an evolving threat landscape. Machine learning (ML) could aid in such a transition, as it can recognize and encode highly complex patterns from multiple input data modalities and has already demonstrated success in many healthcare and defense applications. Functionalizing ML for environmental biodetection requires understanding current technical capabilities. In this article, we provide a systematic review of existing ML platforms and discuss anticipated development efforts needed to achieve effective ML-enabled, agnostic biodetection.

60 APPLIED LIFE SCIENCES↗