SEARCH · Search NASA

Results for “Agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

DOE OSTI2024

Overlooked cooling effects of albedo in terrestrial ecosystems

Radiative forcing (RF) resulting from changes in surface albedo is increasingly recognized as a significant driver of global climate change but has not been adequately estimated, including by Intergovernmental Panel on Climate Change (IPCC) assessment reports, compared with other warming agents. Here, we first present the physical foundation for modeling albedo-induced RF and the consequent global warming impact (GWI Δα ). We then highlight the shortcomings of available current databases and methodologies for calculating GWI Δα at multiple temporal scales. There is a clear lack of comprehensive in situ measurements of albedo due to sparse geographic coverage of ground-based stations, whereas estimates from satellites suffer from biases due to the limited frequency of image collection, and estimates from earth system models (ESMs) suffer from very coarse spatial resolution land cover maps and associated albedo values in pre-determined lookup tables. Field measurements of albedo show large differences by ecosystem type and large diurnal and seasonal changes. As indicated from our findings in southwest Michigan, GWI Δα is substantial, exceeding the RF Δα values of IPCC reports. Inclusion of GWI Δα to landowners and carbon credit markets for specific management practices are needed in future policies. We further identify four pressing research priorities: developing a comprehensive albedo database, pinpointing accurate reference sites within managed landscapes, refining algorithms for remote sensing of albedo by integrating geostationary and other orbital satellites, and integrating the GWI Δα component into future ESMs.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Adaptive Reinforcement Learning (ARL) Control of a Multi-port Resonant Converter in UAV Systems

This study presents an adaptive reinforcement learning (ARL) control framework for a multi-port resonant converter used in hybrid unmanned aerial vehicle (UAV) power systems. The converter integrates high-frequency half-bridge input ports connected to a rectified engine–generator set and a battery energy storage system, along with a semi-bridgeless active rectifier supplying the propulsion load. A deep RL agent is trained to dynamically regulate inter-port phase-shift commands in real time based on flight conditions and load power demand. The ARL controller autonomously identifies phase-shift combinations that maximize conversion efficiency while maintaining stable and coordinated power flow, even under rapidly varying operating scenarios. This data-driven approach eliminates the need for explicit system modeling or extensive manual tuning and enables coordinated control among multiple power ports without inter-port communication. Experimental results validate that the ARL based strategy achieves reliable power sharing and consistently high-efficiency operation across diverse UAV operating conditions.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗

DOE OSTI2026

TETA Autoresearch [SWR-26-089]

TETA Autoresearch is a template repository based on github.com/karpathy/autoresearch for AI-assisted research science in the TETA group in the Center for Integrated Mobility Sciences (CIMS) center at the National Laboratory of the Rockies. This software is a template for running autonomous research experiments that iteratively improve an ML model for a single optimization objective. Two execution modes share one harness: LLM mode - an agent (e.g. Claude Code) edits a scaffold train.py one change at a time, tagging each experiment, logging reasoning, and pushing results. Defined by program.md. Optimizer mode - an Optuna-backed driver (TPE / CMA-ES / Random) iterates over a domain-defined search space. Defined by optimizers/. RouteE (vehicle energy prediction) is the reference domain under domains/routee/. Adding a new domain is mechanical - see EXTENDING.md.

Reinicke, Nicholas [National Laboratory of the Roc↗

DOE OSTI2025

Corrosion Behavior of Hydrophobic Coatings in Aqueous CO2 Environments

Internal corrosion is caused by gas impurities such as CO2, moisture, and H2S, leading to material degradation. To combat this, the National Energy Technology Laboratory (NETL) developed a novel hydrophobic coating to reduce surface hydrophobicity and enhance the corrosion resistance of steel. NETL’s approach uses multi-layer hydrophobic coatings, a novel and promising coating that could potentially revolutionize the industry's approach to internal corrosion mitigation. This work aims to investigate the corrosion performance of the hydrophobic coating and determine the water uptake. Electrochemical corrosion experiments were carried out on bare X65 carbon steel without and with coating in 3.5 wt.% NaCl saturated with CO2 at 20 °C to follow the water uptake as a function of exposure time. Linear polarization resistance (LPR) was used to determine the corrosion rate for carbon steel immersed in a NaCl electrolyte saturated with CO2. Electrochemical impedance spectroscopy (EIS) of uncoated and coated bare carbon steel was investigated. The analyses of impedance models and water uptake behaviors of hydrophobic coatings were studied for 200 hours during the corrosion process. The water uptake was estimated using the Brasher and Kingsbury relation. The results showed that the superhydrophobic coating that was developed used innovative nano-based materials to act as protection layers on the surface of metallic parts against mechanical aggressors, corrosion, and fouling agents.

corrosion behavior↗

DOE OSTI2026

From natural language to control signals: a conceptual framework for semantic channel finding in complex experimental infrastructure

Modern experimental platforms such as particle accelerators, fusion devices, telescopes, and industrial process control systems expose tens to hundreds of thousands of control and diagnostic channels, accumulated over decades of hardware evolution. Operators and AI systems alike depend on informal expert knowledge, inconsistent naming conventions, and scattered documentation to locate the signals required for monitoring, troubleshooting, and automated control, creating a persistent bottleneck for reliability, scalability, and emerging language-model-driven interfaces. We formalize semantic channel finding, the task of mapping natural-language intent to concrete control-system signals, as a general problem in complex experimental infrastructure, and introduce a four-paradigm conceptual framework to guide architecture selection based on facility-specific data regimes. The paradigms span (i) direct in-context lookup over small, curated channel dictionaries, (ii) constrained hierarchical navigation through structured trees, (iii) interactive agent exploration using iterative reasoning and tool-based database queries, and (iv) ontology-grounded semantic search that decouples channel meaning from facility-specific naming conventions. We demonstrate the practical feasibility of each paradigm through proof-of-concept implementations at four operational facilities spanning two orders of magnitude in scale: from compact free-electron lasers to large synchrotron light sources, operating under diverse control-system architectures ranging from clean hierarchical naming schemes to legacy environments with decades of heterogeneous conventions. Where evaluated against expert-curated operational queries, these instantiations achieve 90%–97% accuracy, validating the framework’s applicability across real-world deployment scenarios. To accelerate adoption across the broader scientific and industrial control-system community, we release open-source, plug-and-play implementations of all three interactive paradigms-direct lookup, hierarchical navigation, and middle-layer exploration-within the Osprey framework, together with tools for channel database generation, interactive testing, and minimal-configuration deployment. This work establishes semantic channel finding as a foundational capability for human-centric and agentic AI interfaces at large-scale facilities, providing both a systematic framework for architecture design and practical resources to enable adoption without building custom infrastructure from scratch.

channel finding↗

DOE OSTI2026

System-of-systems optimization of hydrogen infrastructure for heavy-duty freight corridors: The interstate 10 case study

Medium and heavy-duty freight transportation requires hydrogen energy infrastructure that is cost-effective, operationally reliable, spatially coherent, and resilient to demand variability along major corridors. This paper presents an integrated hydrogen corridor planning framework using Oak Ridge National Laboratory's OR-AGENT that couples freight-driven, route-resolved hydrogen demand modeling with optimized station siting, sizing, and station-level techno-economic analysis. The framework is demonstrated for the Interstate 10 freight corridor and the Houston-to-Los-Angeles region. Hydrogen demand is derived from high-resolution origin–destination freight data, duty-cycle characterization, and physics-based energy consumption modeling. Candidate refueling sites are selected from existing heavy-duty diesel fueling locations and optimized subject to onboard storage and station capacity constraints. Resulting station throughputs are evaluated using established techno-economic models for electrolytic hydrogen production and dispensing infrastructure. Results show that a regional, portfolio-level aggregation, average dispensed electrolytic hydrogen cost of $6.87–$7.26/kg is currently feasible, and is strongly influenced by demand density and utilization.

Sujan, Vivek [ORNL] (ORCID:0000000269882342)↗

DOE OSTI2026

CodeScribe Agent

SF-26-086 CodeScribe introduces a structured, multi-stage pipeline that combines deterministic program analysis with LLM-powered translation to enable incremental, testable Fortran-to-C++ migration. First, `code-scribe index` traverses the project directory tree and produces `scribe.yaml` metadata files recording all modules, subroutines, and functions at each level, giving the LLM accurate structural context instead of a hallucinated codebase model. Second, `code-scribe draft` performs the deterministic portion of translation — converting Fortran types to C++ equivalents, replacing `use` statements with `#include` and `using namespace` directives, and detecting constructs requiring special handling — while embedding`scribe-prompt` annotations that guide the LLM through non-trivial cases such as statement-function-to-lambda conversions and `extern "C"` wrapper generation. Third, `code-scribe translate` applies project-specific TOML-based few-shot prompt templates and submits the composed prompt to a pluggable LLM backend (OpenAI, Anthropic, Argonne ARGO, any OpenAI-compatible endpoint, or local Hugging Face checkpoints), producing a C++ source file, a header, and a Fortran-C++ interface file for each translated routine so the codebase compiles and runs correctly throughout the migration. Beyond translation, CodeScribe includes a tool-using coding agent (`code-scribe agent`) with read, bash, edit, and write capabilities, and a bounded loop mode (`code-scribe loop`) that runs repeated stateless agent sessions over a task file with restricted tool access — enabling sustained, auditable software development workflows for broader scientific computing tasks.

Dhruv, Akash [Argonne National Laboratory (ANL), A↗

DOE OSTI2026

Optimization-based approaches to control of connected and automated vehicles: Principles, complexities, applications, challenges, and outlook

Safe and optimal motion control for connected and automated vehicles (CAVs) poses a fundamental optimization challenge at the intersection of system complexity, environmental uncertainty, and stringent real-time constraints. Existing surveys address this challenge in isolation – focusing either on specific control techniques or individual uncertainty sources – without providing a unified framework that characterizes the trade-offs among computational tractability, performance verifiability, and adaptive generalization across paradigms. This review addresses that gap by presenting a cohesive analytical framework concentrated on the decision-making and trajectory optimization layers of the CAV autonomy stack. We systematically analyze three major optimization paradigms – first-principles model-based optimization, data-driven methods, and hybrid synergistic architectures – evaluating each against four core complexity axes: problem formulation, constraint handling, optimality guarantees, and robustness. Key applications including platooning, trajectory planning, collision avoidance, and cooperative control are examined to reveal recurring methodological patterns and critical operational constraints that limit real-world performance. Our synthesis identifies verifiable hybrid architectures, incentive-aligned multi-agent cooperation, and hardware-algorithm co-design as the defining research frontiers, and distills a targeted agenda for developing CAV control systems that are simultaneously safe, computationally efficient, and deployable in the full complexity of real-world traffic environments.

Muzahid, Abu Jafar Md [University of Tennessee, Kn↗

DOE OSTI2025

Reinforcement Learning for In-Spill Optimization of the Mu2e Resonant Extraction: Compensating Non-Stationarity

We present design considerations and challenges for the fast machine learning component of a third-order resonant beam extraction regulation system being commissioned to deliver steady beam rates to the mu2e experiment at Fermilab. Dedicated quadrupoles drive the tune toward the 29/3 resonance each spill, extracting beam at kV multiwire septa. The overall Spill Regulation System consists of (1) a “slow” process using ~100-spill averages to adjust the base quad ramp infrequently, (2) a feedforward harmonic content compensator, and (3) the “fast” ML agent reacting during each ongoing spill with on-the-fly additive corrections to the sum of (1) and (2). We have demonstrated improved beam-rate steadying for a fast ML agent compared to a PID controller using a quasi-physical spill simulation, and demonstrated distillation of that simulation into a predictive surrogate model. Current work includes a data-and-training pipeline to generate data-aware surrogates with real-world dynamics, even as the dynamics shift unpredictably. The surrogates are to act as RL environments against which to train our fast ML control agents before deploying them on FPGA in the live system. Further current efforts focus on modeling and controlling beam loss around the storage ring, understanding additional available hardware inputs to the model, and the interplay of these with beam-steadying performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Adsorptive behavior of poly (vinylidene fluoride) membranes for the recovery of lignin-derived hydrophobic deep eutectic solvents

Abstract Recently, membrane technology has gained significant traction as an energy-efficient alternative to traditional thermal processes for solvent recovery. Deep eutectic solvents (DESs) have emerged as sustainable alternatives to conventional organic solvents, yet a systematic methodology for selecting compatible membrane materials for their recovery remains underdeveloped. This study established a predictive framework for membrane material selection in hydrophobic DES applications using Hansen Solubility Parameters (HSP) with inverted criteria targeting materials with relative energy difference (RED) values greater than 1.0. Flat sheet membranes were fabricated via the non-solvent induced phase separation (NIPS) technique. Four NIPS fabricated polymer membranes were evaluated: polysulfone, cellulose acetate, polyvinylidene fluoride (PVDF) fabricated with polyethylene glycol (PEG) as a pore-forming agent, and polybenzimidazole (PBI). The HSP approach successfully predicted membrane-solvent compatibility, with polysulfone (RED = 0.6) and cellulose acetate (RED = 0.9) dissolving completely within 24 h, while PVDF (RED = 1.9) and PBI (RED = 1.1) maintained structural integrity throughout a 7-day exposure period. Furthermore, PVDF demonstrated superior performance with minimal weight gain (3.0%), hydrophobic surface characteristics (122° water contact angle), and enhanced mechanical properties following DES exposure. Comprehensive chemical and morphological characterization confirmed PVDF’s chemical stability and revealed a surface-selective interaction mechanism involving simultaneous PEG (pore-forming agent) extraction and DES component adsorption. Adsorption kinetics followed pseudo-first-order behavior with reversible characteristics, best described by the Temkin isotherm model (R² = 0.9987). PVDF membranes-maintained separation functionality with average lignin rejection (75.2 ± 7.69%) and demonstrated filtration permeability of 2.0 ± 0.34 LMH/bar. This methodology provides a rational approach for membrane selection in emerging solvent systems, contributing to the advancement of sustainable separation technologies for DES-based biomass processing applications.

Science & Technology - Other Topics↗

DOE OSTI2025

Reinforcement Learning‐Based Adaptation of Grid Following Inverter's Internal Controller to Networked Microgrids' Strengths

The varying topological configurations, generator commitments and dispatches, and dynamic load demand lead to changing system's strengths during the operations of networked microgrids. When the system's strengths significantly change, the fixed control gains at large devices may result in unsatisfactory system performance; this necessitates the tuning of the control gains at large devices to adapt to the changing system's strengths. In this paper, observer-based reinforcement learning (RL) is utilised to automatically tune the proportional-integral (PI) gains of phase lock loop (PLL) controller of grid-following (GFL) inverters to adapt to the changing strengths of microgrids and networked microgrids. The RL agent in this framework augments an observer predicting system's strengths, from which the RL control policy will adjust accordingly to tune the PLL controller's gains towards the system's strengths. Also, to enhance the control performance, the recently introduced Barrier function-based RL framework is leveraged for the design of reward function to prevent the high frequency nadir. An operational 26 kV electric distribution system, which is modelled as networked microgrids, is used to illustrate the need and effectiveness of the proposed RL-tuned control.

frequency response↗

DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Nanolipoprotein particle (NLP) vaccine confers protection against Yersinia pestis aerosol challenge in a BALB/c mouse model

Introduction: Yersinia pestis is the etiological agent of plague, a disease that remains a concern as demonstrated by recent outbreaks in Madagascar. Infection with Y. pestis results in a rapidly progressing illness that can only be successfully treated with antibiotics given shortly after symptom onset. Live attenuated or whole cell inactivated vaccines confer protection against bubonic plague, but pneumonic plague has been more difficult to prevent. Novel effective subunit vaccine formulations may circumvent some of these shortfalls. Here, we compare the immunogenicity generated by an advanced subunit vaccine (F1V fusion protein) and a nanolipoprotein particle (NLP)-based vaccine. Methods: The NLP, a high-density lipoprotein mimetic, provides a nanoscale delivery platform for recombinant Y. pestis antigens LcrV (V) and F1. BALB/c mice were immunized via subcutaneous injection twice, three or four weeks apart. Four weeks later, splenocytes and sera were collected for immune profiling, and mice were challenged with aerosolized Y. pestis CO92. Results: Both formulations induced a strong IgG response against the F1 and V proteins, along with a robust memory B cell response and a balanced cell-mediated immune response as evidenced by both Th1- and Th2-related cytokines. The NLP-based vaccine induced a stronger cytokine response against F1, V, and F1V proteins relative to the F1V vaccine. As with F1V, the inclusion of Alhydrogel (Alu) in NLP vaccine formulations was critical for enhanced immunogenicity and protective efficacy. Mice that received two doses of F1:V:NLP + Alu and CpG were completely protected from a challenge with approximately eight median lethal doses of aerosolized Y. pestis CO92 and this protection confirmed the well-documented synergy between the F1 and V antigens in context of pneumonic plague. The NLPs have defined regions of polarity that facilitates the incorporation of a wide range of adjuvants and antigens with distinct physicochemical properties and are an excellent candidate platform for the development of multi-antigen vaccines.

F1↗

DOE OSTI2024

Evaluating disease surveillance strategies for early outbreak detection in contact networks with varying community structure

Disease surveillance systems allow public health agencies to respond to emerging diseases before they become widespread. Developing such systems requires identifying optimal ways to monitor in the context of an epidemic outbreak; this problem is known as sensor selection. Contact networks represent the dynamics of interaction in a population and are used to model how a disease spreads in a population and to explore strategies of sensor selection. We evaluated five sensor selection strategies on their ability to provide an early warning of a COVID-like outbreak in synthetic contact networks encapsulated in four network scenarios. Three of these scenarios assessed different aspects of community structure. The fourth scenario employed a contact network representing the population and interactions of 6.8 million people in New York City, constructed from an agent-based simulation using census and transportation data. This scenario exemplifies how sensor selection strategies may perform in a real-world, urban context. Our findings suggest that the choice of the optimal strategy depends heavily on the community structure of the network. Strategies that select highly connected nodes or maximize network coverage are the optimal surveillance strategy for outbreak detection in many network community structures. However, a naive implementation of these strategies may fail to provide an early warning at all—including in the New York City scenario. Moreover, these methods are impractical for real-world use as they require knowledge of the underlying contact network. Instead, a selection strategy that starts with a set of random nodes and then performs a random walk through a chain of neighbors reliably provides early warnings without requiring prior knowledge of the network. We find this method, called “random chain”, to be the most pragmatic for implementation in a real-world disease surveillance context.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2026

Surrogates for Valve-Controlled Pipe Flow: Accelerating Nuclear Reactor Design

Neural surrogate models are developed to replace expensive steady-state RANS CFD simulations for valve-controlled pipe flow in nuclear reactor design. Using parametric CFD data generated with MOOSE Pronghorn across a range of valve geometry and flow conditions, three approaches are compared: a POD-based reduced-order model, a structured UNet on a cylindrical grid, and unstructured models (DeepONet and BiStride MeshGraphNet) on nondimensionalized point clouds. POD achieves the highest accuracy (99%) with fast inference but requires storing all solution snapshots, while the DeepONet and BSMS-GNN both achieve ~89% accuracy at sub-second inference, with the BSMS-GNN offering superior geometric generalizability. These surrogates enable rapid ranking of candidate valve designs and can warm-start CFD solvers to accelerate convergence, supporting agentic design iteration on the Prometheus platform.

42 - ENGINEERING↗

DOE OSTI2024

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Distributed optimization for multi-commodity urban traffic control

A distributed method for concurrent traffic signal and routing control of traffic networks is proposed. The method is based on the multi-commodity store-and-forward model, in which the destinations are the commodities. The system benefits from the communication between vehicles and infrastructure, providing optimal signal timings to intersections and routes to vehicles on a link-by-link basis. Using the augmented Lagrangian to model the constraints into the objective, the baseline centralized problem is decomposed into a set of objective-coupled subproblems, one for each intersection, enabling the solution to be computed by a distributed- gradient projection algorithm. Further, the intersection agents only need to communicate and coordinate with neighboring intersections to ensure convergence to the optimal solution while tolerating suboptimal iterations that offer more flexibility, unlike other distributed approaches. Through microsimulation, we demonstrate the effectiveness of the proposed algorithm in traffic networks with time-varying demand. Computational analysis shows that the distributed problem is suitable for real-time applications. A robustness analysis show that the distributed formulation enables a graceful degradation of the system in case of failure.

Augmented Lagrangian↗