Search NASA⌕ Search

SEARCH · Search NASA

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Spacecraft autonomy using onboard processing for a SAR constellation mission

The Autonomous Sciencecraft Experiment (ASE) will fly onboard the Air Force TechSat 21 constellation of three spacecraft scheduled for launch in 2006. ASE uses onboard continuous planning, robust task and goal-based execution, model-based mode identification and reconfiguration, and onboard machine learning and pattern recognition to radically increase science return by enabling intelligent downlink selection and autonomous retargeting. In this paper we discuss how these AI technologies are synergistically integrated in a hybrid multi-layer control architecture to enable a virtual spacecruft science agent. Demonstration of these capabilities in a flight environment will open up tremendous new opportunities in planetary science, space physics, and earth science that would be unreachable without this technology.

Autonomous Sciencecraft Experiment ASE virtual spa↗

Emergency Voltage Regulation in Power Systems via Ripple-Type Control: Preprint

With increasing penetration of volatile renewable generation and cyber-physical disruptions, ensuring safe operation of bulk power systems has become unprecedentedly challenging. Since communication and computational costs restrict centralized system dispatch to be called upon every few minutes; and purely local schemes are shown to be insufficient, distributed controls have been advocated for handling unanticipated system conditions in real time. However, the applicability of distributed control schemes is fundamentally limited by their need for widespread communication and model cognizance. In this con-text, we put forth a hybrid low-communication saturation-driven protocol for the coordination of control agents that are distributed over a physical system and are allowed to communicate with peers over a ‘hotline’ communication network. Under this protocol, when agents observe a constraint violation based on local measurements, they respond locally until their control resources saturate, in which case they send a beacon for assistance to peer agents. The scheme ensures that minor violations are efficiently mitigated via fast local controls, while severe violations may be handled by a collaboration of a relatively small set of agents. We evaluate the performance of this scheme via extensive numerical tests on the IEEE 14-bus test feeder, where agents act upon noisy measurements under diverse scenarios of random load variations and severe low/high voltage events.

distributed control↗

A Sequential Model Predictive and Deep Reinforcement Learning-Based Controller for Distribution System Outage Mitigation under Hurricane Events

This paper proposes a proactive outage mitigation framework for power distribution networks to withstand hurricane-induced disruptions. It leverages Model Predictive Control (MPC) to identify safe lines for proactive switching during hurricanes, minimizing the risk of cascading failures and voltage violations. The switching strategies optimized by MPC are sequentially integrated with a Deep Reinforcement Learning agent using the Advantage Actor-Critic algorithm, enabling dynamic line switching to maximize connected buses and minimize voltage violations in real time. Using a probabilistic hurricane model, the framework predicts line failures and adapts to varying conditions to enhance grid resilience. Simulations on the IEEE 123-bus system demonstrate its effectiveness in maintaining high connectivity and minimizing disruptions. Real-time testing with an RTDS confirms the practicality and reliability of the proposed approach.

Selim, Alaa [University of Connecticut]↗

ToPolyAgent: AI agents for coarse-grained bead-spring topological polymer simulations

We introduce ToPolyAgent, a multi-agent AI framework for performing coarse-grained molecular dynamics (MD) simulations of topological polymers through natural language instructions. By integrating large language models (LLMs) with domain-specific computational tools, ToPolyAgent supports both interactive and autonomous simulation workflows across diverse polymer architectures, including linear, ring, brush, and star polymers, as well as dendrimers. The system consists of four LLM-powered agents: a Config Agent for generating initial polymer–solvent configurations, a Simulation Agent for executing LAMMPS-based MD simulations and conformational analyses, a Report Agent for compiling markdown reports, and a Workflow Agent for streamlined autonomous operations. Interactive mode incorporates user feedback loops for iterative refinements, while autonomous mode enables end-to-end task execution from detailed prompts. We demonstrate ToPolyAgent's versatility through case studies involving diverse polymer architectures under varying solvent conditions, thermostats, and simulation lengths. Furthermore, we highlight its potential as a research assistant by directing it to investigate the effect of interaction parameters on the linear polymer conformation, and the influence of grafting density on the persistence length of the brush polymer. By coupling natural language interfaces with rigorous simulation tools, ToPolyAgent lowers barriers to complex computational workflows and advances AI-driven materials discovery in polymer science. It lays the foundation for autonomous and extensible multi-agent scientific research ecosystems.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗

A Mobility-Driven Approach to Modeling Building Energy

Buildings are one of the primary energy consumers in any city's energy use [12]. Presence and absence of humans is a major contributing factor to the energy use in a building. In this paper, we present an approach to generating a realistic model of human building occupancy throughout a typical work week. We use the Toolbox for Urban Mobility Systems (TUMS) to generate a synthetic population based on population distribution estimates, we schedule the population's daily commute based on National Household Travel Survey (NHTS) survey data, and we simulate their daily travel patterns using an agent-based transportation simulation (TRANSIMS). We process and fuse the simulation output to produce a list of the first and last seen location of each agent in the simulation. Based on the arrival at the last destination, we map each agent to one of the nearby buildings. Using these agent arrivals, as well as NHTS data, we create an hourly occupancy schedule for each building. We successfully demonstrate this workflow at the example of the Chicago Loop, a major business district in Chicago, Illinois.

Berres, Andy↗

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Drug discovery efforts at George Mason University

With over 39,000 students, and research expenditures in excess of $200 million, George Mason University (GMU) is the largest R1 (Carnegie Classification of very high research activity) university in Virginia. Mason scientists have been involved in the discovery and development of novel diagnostics and therapeutics in areas as diverse as infectious diseases and cancer. Below are highlights of the efforts being led by Mason researchers in the drug discovery arena. To enable targeted cellular delivery, and non-biomedical applications, Veneziano and colleagues have developed a synthesis strategy that enables the design of self-assembling DNA nanoparticles (DNA origami) with prescribed shape and size in the 10 to 100 nm range. The nanoparticles can be loaded with molecules of interest such as drugs, proteins and peptides, and are a promising new addition to the drug delivery platforms currently in use. The investigators also recently used the DNA origami nanoparticles to fine tune the spatial presentation of immunogens to study the impact on B cell activation. These studies are an important step towards the rational design of vaccines for a variety of infectious agents. To elucidate the parameters for optimizing the delivery efficiency of lipid nanoparticles (LNPs), Buschmann, Paige and colleagues have devised methods for predicting and experimentally validating the pKa of LNPs based on the structure of the ionizable lipids used to formulate the LNPs. These studies may pave the way for the development of new LNP delivery vehicles that have reduced systemic distribution and improved endosomal release of their cargo post administration. To better understand protein-protein interactions and identify potential drug targets that disrupt such interactions, Luchini and colleagues have developed a methodology that identifies contact points between proteins using small molecule dyes. The dye molecules noncovalently bind to the accessible surfaces of a protein complex with very high affinity, but are excluded from contact regions. When the complex is denatured and digested with trypsin, the exposed regions covered by the dye do not get cleaved by the enzyme, whereas the contact points are digested. The resulting fragments can then be identified using mass spectrometry. The data generated can serve as the basis for designing small molecules and peptides that can disrupt the formation of protein complexes involved in disease processes. For example, using peptides based on the interleukin 1 receptor accessory protein (IL-1RAcP), Luchini, Liotta, Paige and colleagues disrupted the formation of IL-1/IL-R/IL-1RAcP complex and demonstrated that the inhibition of complex formation reduced the inflammatory response to IL-1B. Working on the discovery of novel antimicrobial agents, Bishop, van Hoek and colleagues have discovered a number of antimicrobial peptides from reptiles and other species. DRGN-1, is a synthetic peptide based on a histone H1-derived peptide that they had identified from Komodo Dragon plasma. DRGN-1 was shown to disrupt bacterial biofilms and promote wound healing in an animal model. The peptide, along with others, is being developed and tested in preclinical studies. Other research by van Hoek and colleagues focuses on in silico antimicrobial peptide discovery, screening of small molecules for antibacterial properties, as well as assessment of diffusible signal factors (DFS) as future therapeutics. The above examples provide insight into the cutting-edge studies undertaken by GMU scientists to develop novel methodologies and platform technologies important to drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗

Agent independent task planning

Agent-Independent Planning is a technique that allows the construction of activity plans without regard to the agent that will perform them. Once generated, a plan is then validated and translated into instructions for a particular agent, whether a robot, crewmember, or software-based control system. Because Space Station Freedom (SSF) is planned for orbital operations for approximately thirty years, it will almost certainly experience numerous enhancements and upgrades, including upgrades in robotic manipulators. Agent-Independent Planning provides the capability to construct plans for SSF operations, independent of specific robotic systems, by combining techniques of object oriented modeling, nonlinear planning and temporal logic. Since a plan is validated using the physical and functional models of a particular agent, new robotic systems can be developed and integrated with existing operations in a robust manner. This technique also provides the capability to generate plans for crewmembers with varying skill levels, and later apply these same plans to more sophisticated robotic manipulators made available by evolutions in technology.

Davis, William S.↗

Experimental And Numerical Evaluation Of Gaseous Agents For Suppressing Cup-Burner Flames In Low Gravity

Longer duration missions to the moon, to Mars, and on the International Space Station (ISS) increase the likelihood of accidental fires. NASA's fire safety program for human-crewed space flight is based largely on removing ignition sources and controlling the flammability of the material on-board. There is ongoing research to improve the flammability characterization of materials in low gravity; however, very little research has been conducted on fire suppression in the low-gravity environment. Although the existing suppression systems aboard the Space Shuttle (halon 1301, CF3Br) and the ISS (CO2 or water-based form) may continue to be used, alternative effective agents or techniques are desirable for long-duration missions. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of analytical models, which include detailed combustion-suppression chemistry and radiation sub-models, so that the model can be used to interpret (and predict) the suppression behavior in low gravity; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches.

Takahashi, Fumiaki↗

Reinforcement Learning with Autonomous Small Unmanned Aerial Vehicles in Cluttered Environments

We present ongoing work in the Autonomy Incubator at NASA Langley Research Center (LaRC) exploring the efficacy of a data set aggregation approach to reinforcement learning for small unmanned aerial vehicle (sUAV) flight in dense and cluttered environments with reactive obstacle avoidance. The goal is to learn an autonomous flight model using training experiences from a human piloting a sUAV around static obstacles. The training approach uses video data from a forward-facing camera that records the human pilot's flight. Various computer vision based features are extracted from the video relating to edge and gradient information. The recorded human-controlled inputs are used to train an autonomous control model that correlates the extracted feature vector to a yaw command. As part of the reinforcement learning approach, the autonomous control model is iteratively updated with feedback from a human agent who corrects undesired model output. This data driven approach to autonomous obstacle avoidance is explored for simulated forest environments furthering autonomous flight under the tree canopy research. This enables flight in previously inaccessible environments which are of interest to NASA researchers in Earth and Atmospheric sciences.

Tran, Loc↗

A Real-Time Big Data Control-Theoretical Framework for Cyber-Physical-Human Systems [Book Chapter]

It is known that cyber-physical-human systems naturally arise from interdependent infrastructure systems and smart connected communities. Such applications require ubiquitous information sensing and processing, intelligent machine-to-machine communication for a seamless coordination, as well as intelligent interactions between humans and machines. This chapter presents a control-theoretical framework to model heterogeneous physical dynamic systems, information and communication, as well as cooperative controls and/or distributed optimization of such interconnected systems. It is shown that efficient analytical and computational algorithms can be modularly designed and hierarchically implemented to operate and optimize cyber-physical-human systems, first to quantify individually the input–output relationship of nonlinear dynamic behaviors of every physical subsystem, then to coordinate locally both cyber-physical interactions of neighboring agents as well as physical-human interactions, and finally to dynamically model and optimize the overall networked system. The hierarchical structure makes the overall optimization and control problem scalable and solvable. Moreover, the three levels integrate individual designs and optimization, distributed cooperative optimization, and decision-making through real-time, data-driven, model-based learning and control. Specifically, one of the contributions of the chapter is to demonstrate how the combination of dissipativity theory and cooperative control serves as a natural framework and promising tools to analyze, optimize, and control such large-scale system. Application to digital grid is investigated as an illustrative example.

97 MATHEMATICS AND COMPUTING↗

Non-Isothermal Calorimetric Studies of the Crystallization of Lithium Disilicate Glass

The influence of preannealing treatments on the polymorphic crystallization of lithium disilicate glasses is examined. As expected, glasses heated at different rates through the temperature range where there is significant nucleation develop widely different numbers of nuclei. This can dramatically influence the stability and transformation characteristics of the annealed glass. Non-isothermal differential scanning calorimetry (DSC) and differential thermal analysis (DTA) measurements are demonstrated to be useful to probe the nucleation behavior. The first systematic investigations of particle size effects on the non-isothermal transformation behavior are presented and discussed. Based on DTA and microscopy experiments, we show that small particles of lithium disilicate glasses crystallize primarily by surface crystallization. The relative importance of surface versus volume crystallization is examined by varying particle size, by introducing nucleating agents and by exposing glasses to atmospheres of different water content. These data are analyzed quantitatively using a numerical model developed in a second paper following in this volume.

Ray, C. S.↗

Cellular Decomposition Based Hybrid-Hierarchical Control Systems with Applications to Flight Management Systems

The work in this research project has been focused on the construction of a hierarchical hybrid control theory which is applicable to flight management systems. The motivation and underlying philosophical position for this work has been that the scale, inherent complexity and the large number of agents (aircraft) involved in an air traffic system imply that a hierarchical modelling and control methodology is required for its management and real time control. In the current work the complex discrete or continuous state space of a system with a small number of agents is aggregated in such a way that discrete (finite state machine or supervisory automaton) controlled dynamics are abstracted from the system's behaviour. High level control may then be either directly applied at this abstracted level, or, if this is in itself of significant complexity, further layers of abstractions may be created to produce a system with an acceptable degree of complexity at each level. By the nature of this construction, high level commands are necessarily realizable at lower levels in the system.

Caines, P. E.↗

Application of multidimensional structural characterization to detect and describe moderate forest disturbance

The study of vegetation community and structural change has been central to ecology for over a century, yet the ways in which disturbances reshape the physical structure of forest canopies remain relatively unknown. Moderate severity disturbances affect different canopy strata and plant species, resulting in variable structural outcomes and ecological consequences. Terrestrial lidar (light detection and ranging) offers an unprecedented view of the interior arrangement and distribution of canopy elements, permitting the derivation of multidimensional measures of canopy structure that describe several canopy structural traits (CSTs) with known links to ecosystem function. We used lidar-derived CSTs within a machine learning framework to detect and describe the structural changes that result from various disturbance agents, including moderate severity fire, ice storm damage, age-related senescence, hemlock woolly adelgid, beech bark disease, and chronic acidification. We found that fire and ice storms primarily affected the amount and position of vegetation within canopies, while acidification, senescence, pathogen, and insect infestation altered canopy arrangement and complexity. Only two of the six disturbance agents significantly reduced leaf area, counter to common assumptions regarding many moderate severity disturbances. While findings are limited in their generalizability due to lack of replication among disturbances, they do suggest that the current limitations of standard disturbance detection methods—such as optical-based remote sensing platforms, which are often above-canopy perspectives—limit our ability to understand the full ecological and structural impacts of disturbance, and to evaluate the consistency of structural patterns within and among disturbance agents. A more broadly inclusive definition of ecological disturbance that incorporates multiple aspects of canopy structural change may potentially improve the modeling, detection, and prediction of functional implications of moderate severity disturbance as well as broaden our understanding of the ecological impacts of disturbance.

54 ENVIRONMENTAL SCIENCES↗

Geopolymer Cements: Resistance-Engineered Sewer Infrastructure for Longevity using Innovative, Energy-efficient, Synthesis Techniques (RESILIENT)

The primary objective of this project was to engineer an ultra-acid-resistant low-calcium alkali-activated cement paste for wastewater infrastructure applications to address the critical need for concrete materials with enhanced sulfuric acid resistance compared to ordinary Portland cement (OPC) concrete. In this project, the first milestone was to benchmark the sulfuric acid (SA) resistance of OPC and metakaolin-based geopolymer cement pastes. The second milestone was to model, select, and evaluate the efficacy of metal cation additions on the SA resistance of geopolymer cements. The third milestone was to create synthetic metakaolin that performed similarly to natural metakaolin. The fourth milestone was to design, build, and test the efficacy of four abiotic and biotic nano seeding agents. The fifth and final milestone was to quantify the breakeven material cost requirements and estimated environmental lifecycle costs of the most durable geopolymer cement formulations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

Advancing global change biology through experimental manipulations: Where have we been and where might we go?

Abstract This commentary summarizes the publication history of Global Change Biology for works on experimental manipulations over the past 25 years and highlights a number of key publications. The retrospective summary is then followed by some thoughts on the future of experimental work as it relates to mechanistic understanding and methodological needs. Experiments for elevated CO 2 atmospheres and anticipated warming scenarios which take us beyond historical analogs are suggested as future priorities. Disturbance is also highlighted as a key agent of global change. Because experiments are demanding of both personnel effort and limited fiscal resources, the allocation of experimental investments across Earth's biomes should be done in ecosystems of key importance. Uncertainty analysis and broad community consultation should be used to identify research questions and target biomes that will yield substantial gains in predictive confidence and societal relevance. A full range of methodological approaches covering small to large spatial scales will continue to be justified as a source of mechanistic understanding. Nevertheless, experiments operating at larger spatial scales encompassing organismal, edaphic, and environmental diversity of target ecosystems are favored, as they allow for the assessment of long‐term biogeochemical feedbacks enabling a full range of questions to be addressed. Such studies must also include adequate investment in measurements of key interacting variables (e.g., water and nutrient availability and budgets) to enable mechanistic understanding of responses and to interpret context dependency. Integration of ecosystem‐scale manipulations with focused process‐based manipulations, networks, and large‐scale observations will aid more complete understanding of ecosystem responses, context dependence, and the extrapolation of results. From the outset, these studies must be informed by and integrated with ecosystem models that provide quantitative predictions from their embedded mechanistic hypotheses. A true two‐way interaction between experiments and models will simultaneously increase the rate and robustness of Global Change research.

Hanson, Paul J.↗