Search NASA⌕ Search

SEARCH · Search NASA

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Distributed fiber-optic sensing in a subscale high-temperature superconducting dipole magnet

High-temperature superconductors, such as REBa2Cu3O7−x (REBCO, RE = rare earth), are becoming pivotal for high-field magnet technology for future circular colliders and compact fusion reactors. The U.S. Magnet Development Program, in collaboration with industry, is developing REBCO magnet technology using round conductors consisting of multiple REBCO tapes. For these multi-tape cables, traditional instrumentation, such as voltage taps and resistive strain gauges, become insufficient to help measure and understand the performance-limiting factors in these model magnets. Distributed fiber-optic sensing (DFOS) is a potential solution to address this challenge. Although DFOS is well established for various applications, measuring temperature and strain in high-temperature superconducting magnets is in its infancy. Here we report the detailed implementation and test results of DFOS based on Rayleigh scattering in a subscale canted cosθ (CCT) dipole magnet using high-temperature superconducting CORC® wires. We co-wound optical fibers in each layer of the CCT magnet and compared different types of commercial fibers and mold-release agents to reduce the power attenuation in the fibers. The DFOS allowed us to measure mechanical deformation and temperature along the conductor during tests at 77 and 4.2 K. The measured strain agreed quantitively with a finite-element mechanical model of the subscale magnet. Our results indicate that DFOS can effectively identify locations of strain and temperature changes, offering unique insight into magnet performance that can advance our understanding and development of the REBCO magnet technology for high-energy physics and fusion applications.

Luo, Linqing↗
DOE OSTI2026

GridCoPilot for Thermal Events: An LLM-Based Platform for Power Grid Reliability Analysis

Large Language Models show promise for translating natural language into database queries, but deploying such systems in safety-critical domains requires high reliability. We present an application of GridCoPilot to thermal event analysis (heatwaves and coldwaves) that affect power grid reliability. Our approach uses a LangChain SQL Agent to translate natural language queries into auditable SQL statements, with deterministic visualization routines that parse the structured query results. We introduce structural framing as a design principle, we integrate a NERC-region-level event library with county-level meteorology and decompose the combined data into three relational tables (event metadata, county-level event details, and a county-to-NERC subregion mapping), using prompt-guided joins to direct the model toward correct multi-table queries. For two core analytical patterns (identifying worst events by region and by region-year), the system achieved 100% SQL accuracy across all 16 NERC subregions and both event types (64 queries total). These results validate the approach for target use cases, though performance on diverse natural language formulations requires further investigation. We discuss design trade-offs, failure modes including JSON output truncation, and pathways for extending this approach to other hazard domains.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Transactive Energy Systems: The Market-based Coordination of Distributed Energy Resources

This paper synthesizes a unifying framework that captures a large class of transactive energy systems studied in the literature. The framework consists of four key elements: agent preferences, control decisions, information structure, and solution concept. Among them, agent preference specifies the preferred outcome by each agent and models the conflict of interest in decision making. Control decision specifies the set of decisions for each agent to maximize its payoff. Information structure describes the information available to each agent before it makes a decision. Solution concept encodes the rationality assumptions of each agent in the system. These elements are important in identifying and distinguishing different transactive energy systems. In this paper, we use them to analyze a number of important ones, including the competitive equilibrium, Stackelberg game, reverse Stackelberg game, and mechanism design. Each class of these problems is formulated as a special case of the proposed transactive energy systems. Their connections and differences are discussed. Available tools and results for each category of problems are surveyed.

Li, Sen↗
DOE OSTI2023

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

OpenABLext: An automatic code generation framework for agent-based simulations on CPU-GPU-FPGA heterogeneous platforms

The execution of agent-based simulations (ABSs) on hardware accelerator devices such as graphics processing units (GPUs) has been shown to offer great performance potentials. However, in heterogeneous hardware environments, it can become increasingly difficult to find viable partitions of the simulation and provide implementations for different hardware devices. To automate this process, we present OpenABLext, an extension to OpenABL, a model specification language for ABSs. By providing a device-aware OpenCL backend, OpenABLext enables the co-execution of ABS on heterogeneous hardware platforms consisting of central processing units, GPUs, and field programmable gate arrays (FPGAs).We present a novel online dispatching method that efficiently profiles partitions of the simulation during run-time to optimize the hardware assignment while using the profiling results to advance the simulation itself. In addition, OpenABLext features automated conflict resolution based on user-specified rules, supports graph-based simulation spaces, and utilizes an efficient neighbor search algorithm. We show the improved performance of OpenABLext and demonstrate the potential of FPGAs in the context of ABS. We illustrate how co-execution can be used to further lower execution times. OpenABLext can be seen as an enabler to tap the computing power of heterogeneous hardware platforms for ABS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Spatial Impacts of Electric Vehicle Charging on Power Grid Stability: A Downtown Atlanta Case Study

The rapid increase in electric vehicle (EV) charging demand poses a potential risk to power grid stability, particularly as the spatial distribution of this demand remains underexplored. Existing research often focuses on technical optimization models while overlooking the geographic and human dynamics that affect energy consumption. This study addresses this gap by incorporating mobility data to estimate both building energy use and EV charging demand while also considering geographic factors for a better understanding of grid load. Using agent-based simulations and the Open-Source Distribution System Simulator, the study evaluates the effect of various EV penetration scenarios on grid voltage and unbalance. The results show that, although voltage remains within acceptable limits at lower EV penetration rates, significant voltage drop and unbalance occur as EV penetration exceeds 40%, particularly in residential areas with high charging demand. This study offers a framework for integrating spatial analysis and mobility data in power network simulations, providing insights for future EV infrastructure planning.

Pan, Melrose [ORNL] (ORCID:000000031627448X)↗
DOE OSTI2023

3D_MolGNN_RL

3D-MolGNNRL, couples reinforcement learning (RL) to a deep generative model based on 3D-Scaffold to generate target candidates specific to a protein pocket building up atom by atom from the core scaffold. 3D-MolGNNRL provides an efficient way to optimize key features within a protein pocket using a parallel graph neural network model. The agent learns to build molecules in 3D space while optimizing the binding affinity, potency, and synthetic accessibility of the candidates generated for the SARS-CoV-2 Main protease

Kumar, Neeraj↗
DOE OSTI2025

HEPTAPOD: Orchestrating High Energy Physics Workflows Towards Autonomous Agency

Many workflows in high-energy-physics (HEP) stand to benefit from recent advances in transformer-based large language models (LLMs). While early applications of LLMs focused on text generation and code completion, modern LLMs now support orchestrated agency: the coordinated execution of complex, multi-step tasks through tool use, structured context, and iterative reasoning. We introduce the HEP Toolkit for Agentic Planning, Orchestration, and Deployment (HEPTAPOD), an orchestration framework designed to bring this emerging paradigm to HEP pipelines. The framework enables LLMs to interface with domain-specific tools, construct and manage simulation workflows, and assist in common utility and data analysis tasks through schema-validated operations and run-card-driven configuration. To demonstrate these capabilities, we consider a representative Beyond the Standard Model (BSM) Monte Carlo validation pipeline that spans model generation, event simulation, and downstream analysis within a unified, reproducible workflow. HEPTAPOD provides a structured and auditable layer between human researchers, LLMs, and computational infrastructure, establishing a foundation for transparent, human-in-the-loop systems.

Menzo, Tony [Alabama U.; Fermilab] (ORCID:00000002↗
DOE OSTI2022

Thermal and concentration effects on 1 H NMR relaxation of Gd 3+ -aqua using MD simulations and measurements

We report gadolinium-based contrast agents are key in clinical MRI for enhancing the longitudinal NMR relativity (r 1 ) of hydrogen nuclei ( 1 H) in water and improving the contrast among different tissues. The importance of MRI in clinical practice cannot be gainsaid, yet the interpretation of MRI relies on models with severe assumptions, reflecting a poor understanding of the molecular-scale relaxation processes. In a step towards building a clearer understanding of the relaxation processes, here we investigate thermal and concentration effects on r 1 of the Gd 3+ -aqua complex using both semi-classical molecular dynamics (MD) simulations and measurements. We follow the MD simulation approach recently introduced by [Singer et al., Phys. Chem. Chem. Phys., 2021, 23, 20974], in which no NMR relaxation model or free-parameter is assumed to predict r 1 , thereby bringing new insights into the physics of r 1 on a molecular scale. We expand the autocorrelation function G(t) in terms of molecular modes and determine the thermal activation energies of the two largest modes, both of which are consistent with the range of literature values for rotational diffusion. We also determine the activation energies for translational diffusion and low-field electron-spin relaxation, both of which are consistent with the literature. Furthermore, we validate the MD simulations at human body temperature and concentrations of the paramagnetic ion used in clinical MRI, and we quantify the uncertainties in both simulations and measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Sequential Decision Making (SDM) for Mesh Refinement and Model Selection in Multiscale, Multi-Physics Applications

Intelligent automation and decision support are needed to enhance computational efficiency and robustness in multiscale and multi-physics problems, including materials science, manufacturing, and climate and weather modeling. Current scientific computing approaches for enabling decisions by scientists fail to explore the role of learning, reasoning, and probabilistic planning. Often these decisions are not performed in real-time during the computation but are made prior to the start of the computation, which must be interrupted in order to make changes to the prior choices. Such interruptions at different stages of the computation increase the total computing time and the need for a human expert to frequently monitor the results. State of art scientific computing methods consist of rule-based algorithms that cannot automatically adapt to a dynamically changing computing environment. The development of a Sequential Decision Making (SDM) framework will automate scientific computing by optimizing the policies for mesh refinement, time-stepping, model and algorithm selection, resource allocation, and pre and post-processing. Our agent SDM framework for scientific computing will consist of data-driven learning (Classifier), automated reasoning (contextual knowledge), and probabilistic planning (Reinforcement Learning). In this project, we focused on three problems to demonstrate our SDM framework on a set of ordinary and partial differential equations. Classification of Lorenz system regions using Feed-Forward Neural Networks examined learning in the SDM framework. On the other hand, reasoning and planning in the SDM framework were used in two problems: adaptive time-stepping for nonlinear ODEs using on-policy RL algorithms, and adaptive mesh refinement for 2-D PDEs using off-policy RL algorithms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Optimizing Long Term Hydrogen Fueling Infrastructure Plans on Freight Corridors for Heavy Duty Fuel Cell Electric Vehicles

The development of a future hydrogen energy economy will require the development of several hydrogen market and industry segments including a hydrogen based commercial freight transportation ecosystem. For a sustainable freight transportation ecosystem, the supporting fueling infrastructure and the associated vehicle powertrains making use of hydrogen fuel will need to be co-established. This paper develops a long-term plan for refueling infrastructure deployment using the OR-AGENT (Optimal Regional Architecture Generation for Electrified National Transportation) tool developed at the Oak Ridge National Laboratory, which has been used to optimize the hydrogen refueling infrastructure requirements on the I-75 corridor for heavy duty (HD) fuel cell electric commercial vehicles (FCEV). This constraint-based optimization model considers existing fueling locations, regional specific vehicle fuel economy and weight, vehicle origin and destination (OD), vehicle volume by class and infrastructure costs to characterize in-mission refueling requirements for a given freight corridor. The authors applied this framework to determine the ideal long term public access locations for hydrogen refueling (constrained by existing fueling stations and dispensing technology), the minimal viable cost to deploy sufficient hydrogen fuel dispensers, and associated equipment, to accommodate a growing population of hydrogen fuel cell trucks. So the framework discussed in this paper can be expanded and applied to additional electrified powertrains as well as a larger interstate system, expanded regional corridor, or other transportation networks.

08 HYDROGEN↗
DOE OSTI2023

Optimizing Hydrogen Fueling Infrastructure Plans on Freight Corridors for Heavy-Duty Fuel Cell Electric Vehicles

The development of a future hydrogen energy economy will require the development of several hydrogen market and industry segments including a hydrogen-based commercial freight transportation ecosystem. For a sustainable freight transportation ecosystem, the supporting fueling infrastructure and the associated vehicle powertrains making use of hydrogen fuel will need to be co-established. This article introduces the OR-AGENT (Optimal Regional Architecture Generation for Electrified National Transportation) tool developed at the Oak Ridge National Laboratory, which has been used to optimize the hydrogen refueling infrastructure requirements on the I-75 corridor for heavy-duty (HD) fuel cell electric commercial vehicles (FCEV). This constraint-based optimization model considers existing fueling locations, regional-specific vehicle fuel economy and weight, vehicle origin and destination (O-D), and vehicle volume by class and infrastructure costs to characterize in-mission refueling requirements for a given freight corridor. The authors applied this framework to determine the ideal public access locations for hydrogen refueling (constrained by existing fueling stations), the minimal viable cost to deploy sufficient hydrogen fuel dispensers, and associated equipment, to accommodate a growing population of hydrogen fuel cell trucks. The framework discussed in this article can be expanded and applied to a larger interstate system, expanded regional corridor, or other transportation network. This article is the third in a series of papers that defined the model development to optimize a national hydrogen refueling infrastructure ecosystem for HD commercial vehicles.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

An mRNA vaccine encoding the Ebola virus glycoprotein induces high neutralizing antibody titers and provides strong protection against lethal infections in mouse models

Ebola virus (EBOV) is the causative agent of Ebola disease (EBOD), a viral hemorrhagic fever with a notably high case fatality rate. Current treatments for EBOD are limited to monoclonal antibodies or two licensed viral vector vaccines, a recombinant vesicular stomatitis virus (rVSV)-vectored vaccine or an adenovirus and modified vaccinia Ankara regimen. However, comparisons of protection, efficacy, and durability with alternative nucleotide platforms remain understudied. Here, we evaluated the immunogenicity of an mRNA vaccine expressing the EBOV glycoprotein (GP) in parallel with rVSV- and DNA-based vaccine platforms. The mRNA EBOV-GP vaccine, formulated in lipid nanoparticles, elicited significantly higher levels of total IgG and neutralizing antibody titers compared to the rVSV-EBOV-GP vaccine. Linear antibody epitope analysis indicated a preference for targeting the mucin-like domain in EBOV-GP1 following rVSV-based vaccination, while the mRNA platform distinctly targeted the internal fusion loop of EBOV-GP2. After characterizing the immunogenicity of the mRNA vaccine, two models of EBOD were used to demonstrate its protective efficacy: a surrogate rVSV-based challenge model of EBOD using type-I interferon deficient C57BL/6 mice and infection of BALB/c mice with authentic mouse-adapted EBOV. In both studies, the EBOV mRNA vaccine fully protected the mouse cohorts against morbidity and mortality. Additionally, the EBOV mRNA vaccine produced greater neutralizing antibody titers compared to the DNA EBOV-GP vaccine. These results suggest that an mRNA vaccine expressing EBOV-GP can induce robust, functional humoral responses that are protective against EBOD, warranting further development as an alternative to, or as part of a vaccine strategy including, viral vectored vaccines.

DNA vaccines↗
DOE OSTI2021

Emergency Voltage Regulation in Power Systems via Ripple-Type Control

With increasing penetrations of volatile renewable generation and cyber-physical disruptions, ensuring the safe operation of bulk power systems has become unprecedentedly challenging. Because communication and computational costs restrict centralized system dispatch to being called upon every few minutes, and because purely local schemes are shown to be insufficient, distributed controls have been advocated for handling unanticipated system conditions in real time. The applicability of distributed control schemes, however, is fundamentally limited by their need for widespread communication and model cognizance. In this context, we put forth a hybrid, low-communication, saturation-driven protocol for the coordination of control agents that are distributed over a physical system and are allowed to communicate with peers over a "hotline" communication network. Under this protocol, when agents observe a constraint violation based on local measurements, they respond locally until their control resources saturate, in which case they send a beacon for assistance to peer agents. The scheme ensures that minor violations are efficiently mitigated via fast local controls, whereas severe violations can be handled by collaboration among a relatively small set of agents. We evaluate the performance of this scheme via numerical tests on the IEEE 14-bus test feeder, where agents act upon noisy measurements under diverse scenarios of load variations and severe low-/high-voltage events.

collaboration↗
DOE OSTI2025

Node-Solution Microenvironment Governs the Selectivity of Thioanisole Oxidation within Catalytic Zr-Based Metal–Organic Framework

Lewis acidic metal oxides, including zirconia (ZrO 2 ), are catalytically active toward oxidative reactions in the presence of sacrificial oxidants like t-butyl hydroperoxide (TBHP). The structural ambiguity and heterogeneity of the ZrO 2 surface impose challenges to chemists in understanding the reaction mechanism down to atomic-level precision. The inorganic, Zr-oxo nodes of many crystalline metal–organic frameworks (MOFs) structurally mimic ZrO 2 . Herein, we report three novel findings: (A) Zr-based MOF, Zr-MOF-808 is catalytically competent in activating TBHP to induce oxygen atom transfer (OAT) reactions to a model substrate, thioanisole, at room temperature, (B) its reaction mechanism can be derived with greater structural precision owing to the crystallinity of the MOF, and (C) the node-binding agent and other reaction conditions significantly impact the selectivity between the singly oxidized methyl phenyl sulfoxide vs the doubly oxidized sulfone. These findings suggest that both the activity and selectivity of OAT reactions within Zr-MOF-808 are governed by the chemistry occurring at the interface of the node and the surrounding reaction medium. Implications of these findings in OAT reactions and other MOF/metal oxide-catalyzed relevant catalysis are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Techno-economic Analysis and Life Cycle Assessment of Gluconic Acid and Xylonic Acid Production from Waste Materials

Organic acid-based bioleaching has attracted significant research interest for the recovery of rare earth elements(REEs) and other critical metals. Utilizing biologically produced leaching agents, known as biolixiviants, derived from waste materials holds great promise for enhancing the economic viability and environmental sustainability of bioleaching processes. Here this study focuses on the modeling and optimization of biolixiviant production using corn stover (CS), date palm clippings (DP), and nonrecyclable paper (NP). Techno-economic analysis revealed that gluconic acid production from NP is more cost-effective than that from CS and DP, with respective costs of $0.04/kg, $0.06−0.08/kg, and $0.06−0.09/kg of the biolixiviant, yielding gluconic acid concentrations of 135.39, 172.90, and 176.87 mM, respectively. Life cycle assessment demonstrated that biolixiviant production from NP exerts the lowest environmental impact compared with the other evaluated substrates. When applied to the bioleaching of a neodymium−iron−boron magnet swarf, the biolixiviant derived from NP exhibits the highest leaching efficiencies, confirming its cost and environmental competitiveness in comparison to CS and DP

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

A Learning-based Power Management Method for Networked Microgrids Under Incomplete Information

In this paper, we present a model-free reinforcement learning (RL)-based technique to solve the power management problem of networked microgrids (MGs), when the utility has only limited or no detailed knowledge of the MG asset models.The proposed method consists of two levels: at the first level, using an approximate RL strategy and aggregated data, a utility agent determines the locational price signals to maximize its profit under incomplete information on the MGs’ private data behind their points of common coupling (PCC). The proposed RL strategy enables the utility to adapt to changing system conditions and learn from previous experiences, while respecting the data ownership of the MGs. At the second level, the MGs receive the price signals to dispatch their generation/storage assets individually over look-ahead decision time window, while considering power flow constraints. The performance of the proposed RL technique has been verified under realistic operational scenarios.

Zhang, Qianzhi↗
DOE OSTI2021

Emergency Voltage Regulation in Power Systems via Ripple-Type Control: Preprint

With increasing penetration of volatile renewable generation and cyber-physical disruptions, ensuring safe operation of bulk power systems has become unprecedentedly challenging. Since communication and computational costs restrict centralized system dispatch to be called upon every few minutes; and purely local schemes are shown to be insufficient, distributed controls have been advocated for handling unanticipated system conditions in real time. However, the applicability of distributed control schemes is fundamentally limited by their need for widespread communication and model cognizance. In this con-text, we put forth a hybrid low-communication saturation-driven protocol for the coordination of control agents that are distributed over a physical system and are allowed to communicate with peers over a ‘hotline’ communication network. Under this protocol, when agents observe a constraint violation based on local measurements, they respond locally until their control resources saturate, in which case they send a beacon for assistance to peer agents. The scheme ensures that minor violations are efficiently mitigated via fast local controls, while severe violations may be handled by a collaboration of a relatively small set of agents. We evaluate the performance of this scheme via extensive numerical tests on the IEEE 14-bus test feeder, where agents act upon noisy measurements under diverse scenarios of random load variations and severe low/high voltage events.

distributed control↗