Search NASA⌕ Search

SEARCH · Search NASA

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Adsorptive behavior of poly (vinylidene fluoride) membranes for the recovery of lignin-derived hydrophobic deep eutectic solvents

Abstract Recently, membrane technology has gained significant traction as an energy-efficient alternative to traditional thermal processes for solvent recovery. Deep eutectic solvents (DESs) have emerged as sustainable alternatives to conventional organic solvents, yet a systematic methodology for selecting compatible membrane materials for their recovery remains underdeveloped. This study established a predictive framework for membrane material selection in hydrophobic DES applications using Hansen Solubility Parameters (HSP) with inverted criteria targeting materials with relative energy difference (RED) values greater than 1.0. Flat sheet membranes were fabricated via the non-solvent induced phase separation (NIPS) technique. Four NIPS fabricated polymer membranes were evaluated: polysulfone, cellulose acetate, polyvinylidene fluoride (PVDF) fabricated with polyethylene glycol (PEG) as a pore-forming agent, and polybenzimidazole (PBI). The HSP approach successfully predicted membrane-solvent compatibility, with polysulfone (RED = 0.6) and cellulose acetate (RED = 0.9) dissolving completely within 24 h, while PVDF (RED = 1.9) and PBI (RED = 1.1) maintained structural integrity throughout a 7-day exposure period. Furthermore, PVDF demonstrated superior performance with minimal weight gain (3.0%), hydrophobic surface characteristics (122° water contact angle), and enhanced mechanical properties following DES exposure. Comprehensive chemical and morphological characterization confirmed PVDF’s chemical stability and revealed a surface-selective interaction mechanism involving simultaneous PEG (pore-forming agent) extraction and DES component adsorption. Adsorption kinetics followed pseudo-first-order behavior with reversible characteristics, best described by the Temkin isotherm model (R² = 0.9987). PVDF membranes-maintained separation functionality with average lignin rejection (75.2 ± 7.69%) and demonstrated filtration permeability of 2.0 ± 0.34 LMH/bar. This methodology provides a rational approach for membrane selection in emerging solvent systems, contributing to the advancement of sustainable separation technologies for DES-based biomass processing applications.

Science & Technology - Other Topics↗
DOE OSTI2025

Reinforcement Learning‐Based Adaptation of Grid Following Inverter's Internal Controller to Networked Microgrids' Strengths

The varying topological configurations, generator commitments and dispatches, and dynamic load demand lead to changing system's strengths during the operations of networked microgrids. When the system's strengths significantly change, the fixed control gains at large devices may result in unsatisfactory system performance; this necessitates the tuning of the control gains at large devices to adapt to the changing system's strengths. In this paper, observer-based reinforcement learning (RL) is utilised to automatically tune the proportional-integral (PI) gains of phase lock loop (PLL) controller of grid-following (GFL) inverters to adapt to the changing strengths of microgrids and networked microgrids. The RL agent in this framework augments an observer predicting system's strengths, from which the RL control policy will adjust accordingly to tune the PLL controller's gains towards the system's strengths. Also, to enhance the control performance, the recently introduced Barrier function-based RL framework is leveraged for the design of reward function to prevent the high frequency nadir. An operational 26 kV electric distribution system, which is modelled as networked microgrids, is used to illustrate the need and effectiveness of the proposed RL-tuned control.

frequency response↗
DOE OSTI2024

Computational and Systems Biology Advances to Enable Bioagent Agnostic Signatures

Enumerated threat agent lists have long driven biodefense priorities. The global SARS-CoV-2 pandemic demonstrated the limitations of searching for known threat agents as compared to a more agnostic approach. Recent technological advances are enabling agent-agnostic biodefense, especially through the integration of multi-modal observations of host-pathogen interactions directed by a human immunological model. Although well-developed technical assays exist for many aspects of human-pathogen interaction, the analytic methods and pipelines to combine and holistically interpret the results of such assays are immature and require further investments to exploit new technologies. In this manuscript, we discuss potential immunologically based bioagent-agnostic approaches and the computational tool gaps the community should prioritize filling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Evaluate the System-Level Impact of Connected and Automated Vehicles Coupled with Shared Mobility: An Agent-based Simulation Approach

With the rapid growth of information and communication technologies, Connected and Automated Vehicles (CAVs) are deemed to be disruptive with the potential to significantly improve overall transportation system efficiency, however, may bring Vehicle Miles Traveled (VMT) increase or other issues. Further, shared mobility systems are another disruptive force that is reshaping our travel patterns. To quantify the combined impact of CAV and shared mobility on travel behavior, traffic performance and energy efficiency, we develop a mesoscopic simulation-based framework for mobility and energy efficiency evaluation considering the disruptive transportation technologies. Under this framework, we develop novel models for energy intensity and modal activity, and evaluated a variety of energy scenarios for different combinations of CAV applications, various levels of automation, roadway characteristics, and traffic conditions, while also varying different vehicle types and fuel/powertrain technologies. Based applying this modeling suite to a calibrated BEAM simulation network in Riverside California, it was found that cooperative automated driving in general will improve mobility, but automated vehicles, even when deployed in a shared autonomous fleet, will likely bring an increase of VMT (up to 36%) due to mode shifts and deadheading. Ride-hailing vehicles typically have better energy efficiency and a higher share of electric vehicles, which helps offset the negative impact from VMT increases when estimating the system-level energy consumption. In general, simulation results show a 6% increase in energy consumption for the scenarios with an increasing shift to ride-hailing modes.

42 ENGINEERING↗
DOE OSTI2023

Deep Reinforcement Learning Based Smart Water Heater Control for Reducing Electricity Consumption and Carbon Emission

Water heating is the third largest electricity consumer in U.S. households, after space heating and cooling. Thus, water heaters represent a significant potential for reducing electricity consumption and associated CO2 emissions of residential buildings. To this end, this study proposes a model-free deep reinforcement learning (RL) approach that aims to minimize the electricity consumption and the CO2 emissions of a heat pump water heater without affecting user comfort. In this approach, a set of RL agents focusing on either electricity saving or emission reduction, with different look ahead periods, were trained using the deep Q-networks (DQN) algorithm and their performance was tested on different hot water usage and Marginal Operating Emissions Rate (MOER) profiles. The testing results showed that the RL agents that focus on electricity saving can save electricity in the range of 12–22% by operating the water heater with maximum heat pump efficiency and minimum electric element utilization. On the other hand, the RL agents that focus on emission reduction reduced emissions in the range of 18–37% by making use of the variable MOER values. These RL agents used the heat pump and/or an element when the MOER values are low due to the availability of renewable energy sources (e.g., solar and wind) and mostly avoided the periods of carbon-intensive periods. Overall, these results showed that the proposed RL approach can help minimize the electricity consumption and the CO2 emissions of a heat pump water heater without having any prior knowledge about the device.

Amasyali, Kadir↗
DOE OSTI2021

Decentralized Voltage Control of Large-Scale Distribution System with PVs Based on MADRL

This paper proposes a model-free decentralized control framework for the voltage regulation of large-scale distribution systems through the coordinated control of PV inverters. This is achieved by developing a novel interaction mechanism between the surrogate model and the centralized training and decentralized execution multiagent deep reinforcement learning framework. Specifically, the sparse Gaussian processes regression method is first utilized to develop the surrogate model of the original distribution system for reward calculation during the training stage, where each agent represents a sub-region in the centralized fashion for coordination strategy learning. After that, the learned control rules are used to inform controllers within each sub-region for real-time decisions with only local measurements. Comparative tests among various methods on the EPRI Ckt5 test system demonstrate the effectiveness of the proposed method.

distribution system↗
DOE OSTI2019

Integrating narratives into decision making for complex systems engineering design issues

Abstract Engineering decision making and design requires collaboration between groups from different disciplines, each with different tools, vocabulary, and concerns. Traditional engineering decision‐making tools are generally based on understanding the decision makers’ values, modeling uncertainty with probability, and selecting the alternative that maximizes utility. This rational approach to decision making may not be well understood or used by many stakeholders involved in the engineering design process. Constructing narratives, a basic means of human communication, may aid in engineering communication and comprehension and help with decision making. Narratives represent events by means of a story and usually include characters or agents who cause events and to whom events happen. This paper recommends three methods for how the use of narrative can be applied to the area of engineering decision making. These methods include connecting the decision maker to the analysis, creating narrative simulations for training decision makers, and fostering consensus in problems with multiple stakeholders. An illustrative example of designing a better cookstove for the developing world demonstrates the role that understanding narratives of various stakeholders can play for accomplishing complex systems engineering.

MacKenzie, Cameron A.↗
DOE OSTI2022

Removal of Non-Specifically Bound Proteins Using Rayleigh Waves Generated on ST-Quartz Substrates

Label-free biosensors are plagued by the issue of non-specific protein binding which negatively affects sensing parameters such as sensitivity, selectivity, and limit-of-detection. In the current work, we explore the possibility of using the Rayleigh waves in ST-Quartz devices to efficiently remove non-specifically bound proteins via acoustic streaming. A coupled-field finite element (FE) fluid structure interaction (FSI) model of a surface acoustic wave (SAW) device based on ST-Quartz substrate in contact with a liquid loading was first used to predict trends in forces related to SAW-induced acoustic streaming. Based on model predictions, it is found that the computed SAW body force is sufficient to overcome adhesive forces between particles and a surface while lift and drag forces prevent reattachment for a range of SAW frequencies. We further performed experiments to validate the model predictions and observe that the excitation of Rayleigh SAWs removed non-specifically bound (NSB) antigens and antibodies from sensing and non-sensing regions, while rinsing and blocking agents were ineffective. An amplified RF signal applied to the device input disrupted the specific interactions between antigens and their capture antibody as well. ST-quartz allows propagation of Rayleigh and leaky SH-SAW waves in orthogonal directions. Thus, the results reported here could allow integration of three important biosensor functions on a single chip, i.e., removal of non-specific binding, mixing, and sensing in the liquid phase.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Regeneration of critical-sized defects, in a goat model, using a dextrin-based hydrogel associated with granular synthetic bone substitute

Abstract The development of injectable bone substitutes (IBS) have obtained great importance in the bone regeneration field, as a strategy to reach hardly accessible defects using minimally invasive techniques and able to fit to irregular topographies. In this scenario, the association of injectable hydrogels and bone graft granules is emerging as a well-established trend. Particularly, in situ forming hydrogels have arisen as a new IBS generation. An in situ forming and injectable dextrin-based hydrogel (HG) was developed, aiming to act as a carrier of granular bone substitutes and bioactive agents. In this work, the HG was associated to a granular bone substitute (Bonelike®) and implanted in goat critical-sized calvarial defects (14 mm) for 3, 6 and 12 weeks. The results showed that HG improved the handling properties of the Bonelike® granules and did not affect its osteoconductive features, neither impairing the bone regeneration process. Human multipotent mesenchymal stromal cells from the umbilical cord, extracellular matrix hydrolysates and the pro-angiogenic peptide LLKKK18 were also combined with the IBS. These bioactive agents did not enhance the new bone formation significantly under the conditions tested, according to micro-computed tomography and histological analysis.

Pereira, Isabel↗
DOE OSTI2024

Modulating Ce 3+ Sites in Ce-Zr Oxide Nanocatalysts through Protamine Biomineralization for Organophosphate Dephosphorylation

Catalytic is a crucial reaction for environmental detoxication of pesticides and neutralization of various molecules classified as chemical warfare agents. Herein, we report on a series of tunable Ce-Zr-based metal oxides, (Zr a Ce 1–a O x ) prepared using a facile biomineralization technique, as catalysts for organophosphates dephosphorylation. Synchrotron scattering and spectroscopy methods showcase that Zr a Ce 1–a O x catalysts are highly defective and exhibit an abundance of Ce 3+ sites that promote oxygen vacancies needed for enhanced dephosphorylation reactions. The catalytic performance was assessed using a model para-nitrophenyl phosphate reaction and showcases a strong dependence on Zr dopant concentration and subsequent tuning of the Ce 3+ /Ce 4+ ratio. Analysis of synchrotron datasets allowed structure-performance correlations between the Ce 3+ concentration and associated oxygen vacancies, the dephosphorylation rate constant, and Zr concentration to be established, confirming that Ce 3+ as active sites is positively correlated with the rate constant. We envision that similar biomineralization approaches can be used to fabricate Ce 3+ -rich Ce-Zr oxide for environmental application in dephosphorylation and other hydrolysis reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Distributed Optimal Power Management for Battery Energy Storage Systems: A Novel Accelerated Tracking ADMM Approach

Optimal power management (OPM) is critical for large-scale battery energy storage systems. Today’s methods often require formidable computational effort due to the design based on centralized numerical optimization. Thus, this paper investigates computationally distributed OPM where the agents based on the cells communicate over a network to cooperatively solve the OPM problem. We propose an accelerated tracking alternating direction method of multipliers (ADMM) algorithm to solve the distributed OPM. The proposed algorithm embeds dynamic average consensus and Nesterov’s acceleration technique in the ADMM algorithm. Not only is the proposed algorithm fully distributed without a need for fusion or aggregating nodes, but it also accelerates convergence. The paper formulates the OPM in a model predictive control framework where it seeks to regulate the charging/discharging power of each battery cell to minimize the total power losses and promote balanced use of the constituent cells while complying with the safety constraints. The paper provides ample simulation results to demonstrate the effectiveness and advantages of the proposed distributed OPM in terms of computation and convergence.

Farakhor, Amir↗
DOE OSTI2022

Adsorption and exchange reactions of iodine molecules at the alumina surface: modelling alumina-iodine reaction mechanisms

Harnessing aluminum oxidation energy requires navigating the particle's passivation shell composed of alumina. The shell is a barrier to aluminum oxidation but can also exothermically react with halogenated species and therefore contribute to the overall energy generated during aluminum particle combustion. Fluorination reactions with alumina have been studied because fluorine is abundant in binder formulations that commonly surround aluminum particles in an energetic mixture. However, iodine has emerged as an alternative halogenated-based binder or oxidizer because iodine gas provides ancillary benefits such as chemical neutralization of biological agents or sterilization of contaminated environments. Furthermore, this study used density functional theory (DFT) calculations to evaluate potential reaction pathways for aluminum–iodine combustion. Relative to fluorinated fragments such as HF and F – , the adsorption energies associated with HI and I– are nearly triple the exchange reaction energy available from fluorination reactions with alumina (–189 and –278 kJ mol –1 for HI and I – , respectively). However, exchange reactions between iodinated species and the alumina surface are energetically unfavorable. These results explain that through adsorption, alumina surface exothermic reactions with iodine are more energetic than with fluorine fragments. Experiments performed with differential scanning calorimetry (DSC) confirm the higher magnitude of energy generated for iodination compared with fluorination reactions with alumina. Additionally, strong adsorption energies can promote synthesis of new shell chemistries. Adsorption in solution will promote alumina dissolution and iodine precipitation reactions to produce hydroxyl complexes and iodinated species synthesized on the surface of the particle, thereby replacing alumina with alternative passivation shell chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Pedestrian-Involved Traffic Signal Optimization Using Decentralized Graph-based Multi-Agent Reinforcement Learning

Incorporating pedestrian movements in traffic signal timing optimization is essential for ensuring smooth and safe urban transportation systems. To develop an effective signal timing plan, it is crucial to comprehend how various pedestrian accommodation strategies impact both vehicle and pedestrian flow. This study explores the application of the Decentralized Graph-based Multi-Agent Reinforcement Learning (DGMARL) method for signal timing optimization. It considers both pedestrian and vehicle traffic state and assesses the effects of fixed and adaptive pedestrian request response on traffic and signal timing. The evaluation of DGMARL encompasses vehicles Eco_PI which is fuel consumption impact related to vehicle stops and stop delay, and pedestrian waiting time to ensure overall system efficiency. The proposed approach was evaluated using a Digital Twin microscopic traffic simulation model of MLK Smart Corridor in Chattanooga, Tennessee. The evaluation outcomes of vehicles Eco_PI, pedestrian waiting time and serving time are compared with the actuated and DGMARL signal timing with fixed pedestrian recall and minimum recall to determine the most suitable approaches for various traffic conditions. The results indicated that, on average, the strategy of Signal timing optimization with adaptive pedestrian request response improved the Eco_PI by 32.43%, and Signal timing optimization with both automated pedestrian traffic demand and adaptive pedestrian request response improved the Eco_PI by 31.62% compared to the actuated and DGMARL signal timing with fixed pedestrian recall and minimum recall.

K Kumarasamy, Vijayalakshmi↗
DOE OSTI2025

Nanolipoprotein particle (NLP) vaccine confers protection against Yersinia pestis aerosol challenge in a BALB/c mouse model

Introduction: Yersinia pestis is the etiological agent of plague, a disease that remains a concern as demonstrated by recent outbreaks in Madagascar. Infection with Y. pestis results in a rapidly progressing illness that can only be successfully treated with antibiotics given shortly after symptom onset. Live attenuated or whole cell inactivated vaccines confer protection against bubonic plague, but pneumonic plague has been more difficult to prevent. Novel effective subunit vaccine formulations may circumvent some of these shortfalls. Here, we compare the immunogenicity generated by an advanced subunit vaccine (F1V fusion protein) and a nanolipoprotein particle (NLP)-based vaccine. Methods: The NLP, a high-density lipoprotein mimetic, provides a nanoscale delivery platform for recombinant Y. pestis antigens LcrV (V) and F1. BALB/c mice were immunized via subcutaneous injection twice, three or four weeks apart. Four weeks later, splenocytes and sera were collected for immune profiling, and mice were challenged with aerosolized Y. pestis CO92. Results: Both formulations induced a strong IgG response against the F1 and V proteins, along with a robust memory B cell response and a balanced cell-mediated immune response as evidenced by both Th1- and Th2-related cytokines. The NLP-based vaccine induced a stronger cytokine response against F1, V, and F1V proteins relative to the F1V vaccine. As with F1V, the inclusion of Alhydrogel (Alu) in NLP vaccine formulations was critical for enhanced immunogenicity and protective efficacy. Mice that received two doses of F1:V:NLP + Alu and CpG were completely protected from a challenge with approximately eight median lethal doses of aerosolized Y. pestis CO92 and this protection confirmed the well-documented synergy between the F1 and V antigens in context of pneumonic plague. The NLPs have defined regions of polarity that facilitates the incorporation of a wide range of adjuvants and antigens with distinct physicochemical properties and are an excellent candidate platform for the development of multi-antigen vaccines.

F1↗
DOE OSTI2019

Adsorption of Nickel Ion in Aqueous Using Rubber-Based Hydrogel

This work reports about a rubber-based hydrogel from liquid natural rubber (LNR) and acrylic acid (AAc) by using potassium persulfate (KPS) as an initiator and N,N-methylenebisacrylamide (MBA) as a crosslinking agent. The structure, stability, and morphology of the hydrogel were confirmed by using Fourier transform infrared spectroscopy, thermogravimetric analysis, and scanning electron microscope. The optimisation of the swelling capacity and Ni{sup 2+} removal percentage by the rubber-based hydrogel was conducted by using 5-level-2-factor response surface methodology. The effect of AAc:LNR ratio (0.59–3.41 g/g) and MBA concentration (0.02–0.23 M) parameters was studied with constant KPS concentration (0.05 M) used. Quadratic models for both responses (swelling and Ni{sup 2+} removal percentage) were successfully developed by using statistical analysis. The swelling degree and Ni{sup 2+} removal percentage of hydrogel were improved when high AAc:LNR ratio and lower MBA concentration were used. The R{sup 2} values for these quadratic models were 0.9891 and 0.9939 (swelling and Ni{sup 2+} removal percentage), respectively, which showed that the models were well-fitted with the experimental data. From the analysis, the optimum conditions for maximum swelling capacity (1181.90%) and Ni{sup 2+} removal percentage (26.74%) were hydrogel with AAc:LNR ratio 3.00 g/g and 0.05 M of MBA.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Mechanism of Catalysis by L -Asparaginase

Two bacterial type II L -asparaginases, from Escherichia coli and Dickeya chrysanthemi, have played a critical role for more than 40 years as therapeutic agents against juvenile leukemias and lymphomas. Despite a long history of successful pharmacological applications and the apparent simplicity of the catalytic reaction, controversies still exist regarding major steps of the mechanism. In this report, we provide a detailed description of the reaction catalyzed by E. coli type II L -asparaginase (EcAII). Our model was developed on the basis of new structural and biochemical experiments combined with previously published data. The proposed mechanism is supported by quantum chemistry calculations based on density functional theory. In this work, we provide strong evidence that EcAII catalyzes the reaction according to the double-displacement (ping-pong) mechanism, with formation of a covalent intermediate. Several steps of catalysis by EcAII are unique when compared to reactions catalyzed by other known hydrolytic enzymes. Here, the reaction is initiated by a weak nucleophile, threonine, without direct assistance of a general base, although a distant general base is identified. Furthermore, tetrahedral intermediates formed during the catalytic process are stabilized by a never previously described motif. Although the scheme of the catalytic mechanism was developed only on the basis of data obtained from EcAII and its variants, this novel mechanism of enzymatic hydrolysis could potentially apply to most (and possibly all) L -asparaginases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Evaluating disease surveillance strategies for early outbreak detection in contact networks with varying community structure

Disease surveillance systems allow public health agencies to respond to emerging diseases before they become widespread. Developing such systems requires identifying optimal ways to monitor in the context of an epidemic outbreak; this problem is known as sensor selection. Contact networks represent the dynamics of interaction in a population and are used to model how a disease spreads in a population and to explore strategies of sensor selection. We evaluated five sensor selection strategies on their ability to provide an early warning of a COVID-like outbreak in synthetic contact networks encapsulated in four network scenarios. Three of these scenarios assessed different aspects of community structure. The fourth scenario employed a contact network representing the population and interactions of 6.8 million people in New York City, constructed from an agent-based simulation using census and transportation data. This scenario exemplifies how sensor selection strategies may perform in a real-world, urban context. Our findings suggest that the choice of the optimal strategy depends heavily on the community structure of the network. Strategies that select highly connected nodes or maximize network coverage are the optimal surveillance strategy for outbreak detection in many network community structures. However, a naive implementation of these strategies may fail to provide an early warning at all—including in the New York City scenario. Moreover, these methods are impractical for real-world use as they require knowledge of the underlying contact network. Instead, a selection strategy that starts with a set of random nodes and then performs a random walk through a chain of neighbors reliably provides early warnings without requiring prior knowledge of the network. We find this method, called “random chain”, to be the most pragmatic for implementation in a real-world disease surveillance context.

60 APPLIED LIFE SCIENCES↗