Search NASA⌕ Search

SEARCH · Search NASA

Results for “agent based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Biomass Scenario Model: BETO Analysis Platform Peer Review; NREL (National Renewable Energy Laboratory)

The Biomass Scenario Model (BSM) is a unique, carefully validated, state-of-the-art fourth-generation model of the domestic bioenergy supply chain which explicitly focuses on policy issues and their potential side effects. It integrates resource availability, behavior, policy, and physical, technological, and economic constraints. The BSM uses system-dynamics simulation to model dynamic interactions across the supply chain; it tracks the deployment of biofuels given technological development and the reaction of the investment community to those technologies in the context of land availability, the competing oil market, consumer demand for biofuels, and government policies over time. It places a strong emphasis on the behavior and decision-making of various economic agents. The model treats the major infrastructure-compatible fuels. Scenario analysis based on the BSM shows that the biofuels industry tends not to rapidly thrive without significant external actions in the early years of its evolution. An initial focus for jumpstarting the industry typically has strongest results in the BSM in areas where effects of intervention have been identified to be multiplicative. In general, we find that policies which are coordinated across the whole supply chain have significant impact in fostering the growth of the biofuels industry and that the production of tens of billions of gallons of biofuels may occur under sufficiently favorable conditions.

09 BIOMASS FUELS↗

Topology-Aware Reinforcement Learning for Voltage Control: Centralized and Decentralized Strategies

Volt-VAR control (VVC) methods based on deep reinforcement learning (DRL) can effectively control distribution grid voltage and minimize power loss by implementing corrective and preventive control measures on the reactive power output of inverter-based distributed energy resources (DERs). However, model-free DRL-based VVC approaches usually cannot capture the important topological feature of the power system since they use a fully-connected network (FCN) to deliver the action. Therefore, this paper proposes a graph convolutional network (GCN)-based DRL approach that can employ the topological information of the network to take better control action for regulating the voltage. Our implementation allows for both centralized and decentralized configurations, utilizing a single agent and multiple agents respectively. Although the centralized GCN-based DRL approach has its advantages of minimizing voltage fluctuation and power loss, it is not suitable for large scale power systems due to its challenges in terms of scalability, computation speed and potential single points of failure. Therefore, these problems can be resolved using the decentralized GCN-based DRL approach. Moreover, to ensure the safe operation of the model, our proposed approach incorporates an exponential barrier function while formulating the reward function for each agent. To validate performance of the proposed approaches, the proposed model is tested on modified IEEE test systems and the performances are measured in terms on voltage fluctuation reduction, minimization of power loss and computational speed. Finally, the results show that the proposed topology-aware approach outperforms the FCN-based DRL approach in terms of reducing voltage fluctuation and minimizing power loss of the network. Moreover, it is shown that the decentralized GCN-based DRL has faster computational speed than other approaches.

42 ENGINEERING↗

PrEP: Probability of Encounter between Ports of Entry A case study of the US-Mexico border

PrEP aims to explore the field of psychophysics as it applies to the movement of adversaries across international borders. This test experiment uses the US-Mexico border as a case study – beginning with certain assumptions regarding the adversary, the model utilizes environmental and population data to estimate risk perception, and predict routes that a smuggler may take. Additionally, I analyze the impact that destination-based attractive forces may have on agent movement. I found that these attractive forces may improve the validity of the model if they carry less influence that the repulsive forces.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Siting and sizing of public–private charging stations impacts on household and electric vehicle fleets

To facilitate the provision of electric vehicle charging stations (EVCS) in urban areas, this study investigates the benefits of co-locating fleet-owned chargers with public charging stations to enable construction incentives and cord-sharing cost savings. Shared EVCS can serve charging demand from both user types: private (household) EV owners and those managing fleet vehicles – like shared and fully automated EV (SAEV) fleets. Using POLARIS to simulate all person-travel across the 6-county Austin, Texas region, new EVCS were sited and sized with DC fast-charging (DCFC) plugs to lower operating and construction costs while providing public + private (PP) service across an 81-square-mile core geofence (where 200 SAEVs were active) over 24-hour days. When co-location is permitted, 115 DCFC cords were added to the 23 existing (publicly available) stations to enable SAEVs and household EVs (HHEVs) charging access, within the geofence. Each 250-mile-range SAEV was simulated to travel an average of 330 miles per day, serve over 92 person-trips, and recharge 2.7 times a day (for 2.4 h per session). The new DCFC plugs were primarily added to public EVCS at shopping centers and schools, and in residential settings along freeways. The average plug served 4.8 EVs per day. Most co-located PP EVCS permitted immediate (no-wait) charging, except for 2 stations along freeways that averaged 8 min of wait time to begin charging. In conclusion, the co-location strategy lowered fleet owners’ initial EVCS construction costs by 12 % (thanks to cord-sharing to avoid cord duplication), while reducing SAEV wait times to just 3.1 min (versus 10.7 min if SAEV managers had to build and operate their own EVCS).

EV charging modeling↗

WE-D-BRE-04: Modeling Optimal Concurrent Chemotherapy Schedules

Purpose: Concurrent chemo-radiation therapy (CCRT) has become a more common cancer treatment option with a better tumor control rate for several tumor sites, including head and neck and lung cancer. In this work, possible optimal chemotherapy schedules were investigated by implementing chemotherapy cell-kill into a tumor response model of RT. Methods: The chemotherapy effect has been added into a published model (Jeong et al., PMB (2013) 58:4897), in which the tumor response to RT can be simulated with the effects of hypoxia and proliferation. Based on the two-compartment pharmacokinetic model, the temporal concentration of chemotherapy agent was estimated. Log cell-kill was assumed and the cell-kill constant was estimated from the observed increase in local control due to concurrent chemotherapy. For a simplified two cycle CCRT regime, several different starting times and intervals were simulated with conventional RT regime (2Gy/fx, 5fx/wk). The effectiveness of CCRT was evaluated in terms of reduction in radiation dose required for 50% of control to find the optimal chemotherapy schedule. Results: Assuming the typical slope of dose response curve (γ50=2), the observed 10% increase in local control rate was evaluated to be equivalent to an extra RT dose of about 4 Gy, from which the cell-kill rate of chemotherapy was derived to be about 0.35. Best response was obtained when chemotherapy was started at about 3 weeks after RT began. As the interval between two cycles decreases, the efficacy of chemotherapy increases with broader range of optimal starting times. Conclusion: The effect of chemotherapy has been implemented into the resource-conservation tumor response model to investigate CCRT. The results suggest that the concurrent chemotherapy might be more effective when delayed for about 3 weeks, due to lower tumor burden and a larger fraction of proliferating cells after reoxygenation.

60 APPLIED LIFE SCIENCES↗

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗

Graph Convolutional Network-Based Topology Embedded Deep Reinforcement Learning for Voltage Stability Control

Topological variations in power system is a common phenomenon and can impose significant challenges to traditional controllers of power system. Recent study revealed the strength of deep reinforcement learning (DRL) based approaches in power system preventive and corrective control. But topological variations are difficult to capture using classical fully connected neural network (FCN) model and has not been explicitly modeled in previous work. Hence, we develop a Graph Convolutional Network (GCN) based DRL framework to tackle topology changes in control design of power system. The GCN model exploits the graph structure of the power network and helps the DRL agent to embed the topology information during learning process. Our GCN based approach is evaluated using the IEEE-39 bus system and it outperforms the FCN-based DRL scheme in terms of training convergence and control performance considering grid topology changes.

Hossain, Ramij Raja↗

Distributed deep reinforcement learning for simulation control

Abstract Several applications in the scientific simulation of physical systems can be formulated as control/optimization problems. The computational models for such systems generally contain hyperparameters, which control solution fidelity and computational expense. The tuning of these parameters is non-trivial and the general approach is to manually ‘spot-check’ for good combinations. This is because optimal hyperparameter configuration search becomes intractable when the parameter space is large and when they may vary dynamically. To address this issue, we present a framework based on deep reinforcement learning (RL) to train a deep neural network agent that controls a model solve by varying parameters dynamically. First, we validate our RL framework for the problem of controlling chaos in chaotic systems by dynamically changing the parameters of the system. Subsequently, we illustrate the capabilities of our framework for accelerating the convergence of a steady-state computational fluid dynamics solver by automatically adjusting the relaxation factors of the discretized Navier–Stokes equations during run-time. The results indicate that the run-time control of the relaxation factors by the learned policy leads to a significant reduction in the number of iterations for convergence compared to the random selection of the relaxation factors. Our results point to potential benefits for learning adaptive hyperparameter learning strategies across different geometries and boundary conditions with implications for reduced computational campaign expenses 4 4 Data and codes available at https://github.com/Romit-Maulik/PAR-RL . .

42 ENGINEERING↗

Augmenting LLM-Based Agents for Improved Performance in Pentesting and Commissioning Operational Technology in Critical Infrastructure

Artificial intelligence (AI), and more specifically large language models (LLMs) have the potential for use in penetration testing (“pentesting”) against devices, networks, and computer systems in information technology (IT). We explore the possibility of extending pentesting from IT systems to operational technology (OT) systems, which are more obscure than IT systems in their protocols and design. A challenge therefore exists when applying pretrained LLMs to OT systems as corpora are likely to underrepresent OT systems in comparison to other more prevalent systems. We evaluate augmentations of LLMs with various methods, especially retrieval augmented generation (RAG), to improve performance of the LLMs in the OT domain. In addition to pentesting, some of the testing of these OT devices may include commissioning to ensure that the newly installed devices work correctly. Our framework may also be applied in such cases.

97 MATHEMATICS AND COMPUTING↗

Beyond the List: Bioagent-Agnostic Signatures Could Enable a More Flexible and Resilient Biodefense Posture Than an Approach Based on Priority Agent Lists Alone

As of 2021, the biothreat policy and research communities organize their efforts around lists of priority agents, which elides consideration of novel pathogens and biotoxins. For example, the Select Agents and Toxins list is composed of agents that historic biological warfare programs had weaponized or that have previously caused great harm during natural outbreaks. Similarly, lists of priority agents promulgated by the World Health Organization and the National Institute of Allergy and Infectious Diseases are composed of previously known pathogens and biotoxins. To fill this gap, we argue that the research/scientific and biodefense/biosecurity communities should categorize agents based on how they impact their hosts to augment current list-based paradigms. Specifically, we propose integrating the results of multi-omics studies to identify bioagent-agnostic signatures (BASs) of disease—namely, patterns of biomarkers that accurately and reproducibly predict the impacts of infection or intoxication without prior knowledge of the causative agent. Here, we highlight three pathways that investigators might exploit as sources of signals to construct BASs and their applicability to this framework. The research community will need to forge robust interdisciplinary teams to surmount substantial experimental, technical, and data analytic challenges that stand in the way of our long-term vision. However, if successful, our functionality-based BAS model could present a means to more effectively surveil for and treat known and novel agents alike.

59 BASIC BIOLOGICAL SCIENCES↗

Novel mutant-selective EGFR kinase inhibitors against EGFR T790M

The clinical efficacy of epidermal growth factor receptor (EGFR) kinase inhibitors in EGFR-mutant non-small-cell lung cancer (NSCLC) is limited by the development of drug-resistance mutations, including the gatekeeper T790M mutation. Strategies targeting EGFR T790M with irreversible inhibitors have had limited success and are associated with toxicity due to concurrent inhibition of wild-type EGFR. All current EGFR inhibitors possess a structurally related quinazoline-based core scaffold and were identified as ATP-competitive inhibitors of wild-type EGFR. Here we identify a covalent pyrimidine EGFR inhibitor by screening an irreversible kinase inhibitor library specifically against EGFR T790M. These agents are 30- to 100-fold more potent against EGFR T790M, and up to 100-fold less potent against wild-type EGFR, than quinazoline-based EGFR inhibitors in vitro. They are also effective in murine models of lung cancer driven by EGFR T790M. Co-crystallization studies reveal a structural basis for the increased potency and mutant selectivity of these agents. These mutant-selective irreversible EGFR kinase inhibitors may be clinically more effective and better tolerated than quinazoline-based inhibitors. Our findings demonstrate that functional pharmacological screens against clinically important mutant kinases represent a powerful strategy to identify new classes of mutant-selective kinase inhibitors.

59 BASIC BIOLOGICAL SCIENCES↗

DualTrust: A Trust Management Model for Swarm-Based Autonomic Computing Systems

Trust management techniques must be adapted to the unique needs of the application architectures and problem domains to which they are applied. For autonomic computing systems that utilize mobile agents and ant colony algorithms for their sensor layer, certain characteristics of the mobile agent ant swarm -- their lightweight, ephemeral nature and indirect communication -- make this adaptation especially challenging. This thesis looks at the trust issues and opportunities in swarm-based autonomic computing systems and finds that by monitoring the trustworthiness of the autonomic managers rather than the swarming sensors, the trust management problem becomes much more scalable and still serves to protect the swarm. After analyzing the applicability of trust management research as it has been applied to architectures with similar characteristics, this thesis specifies the required characteristics for trust management mechanisms used to monitor the trustworthiness of entities in a swarm-based autonomic computing system and describes a trust model that meets these requirements.

99 GENERAL AND MISCELLANEOUS↗

Argonne Below Ground Model Part II: Population Dynamics, Exposure, and Fomite Transport

The Argonne Below Ground Model (BGM) was developed to provide a comprehensive simulation capability for analysis of subway threats at the level of the whole system. To assess the health consequences of an attack, BGM incorporates an agent-based population-effects component, described in this report, in which the movement of each person in the system is independently modeled, allowing their individual exposure, their resulting health effects, and their behavior to be determined.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

The value of integrating pre-clinical data to predict nausea and vomiting risk in humans as illustrated by AZD3514, a novel androgen receptor modulator

Nausea and vomiting are components of a complex mechanism that signals food avoidance and protection of the body against the absorption of ingested toxins. This response can also be triggered by pharmaceuticals. Predicting clinical nausea and vomiting liability for pharmaceutical agents based on pre-clinical data can be problematic as no single animal model is a universal predictor. Moreover, efforts to improve models are hampered by the lack of translational animal and human data in the public domain. AZD3514 is a novel, orally-administered compound that inhibits androgen receptor signaling and down-regulates androgen receptor expression. Here we have explored the utility of integrating data from several pre-clinical models to predict nausea and vomiting in the clinic. Single and repeat doses of AZD3514 resulted in emesis, salivation and gastrointestinal disturbances in the dog, and inhibited gastric emptying in rats after a single dose. AZD3514, at clinically relevant exposures, induced dose-responsive “pica” behaviour in rats after single and multiple daily doses, and induced retching and vomiting behaviour in ferrets after a single dose. We compare these data with the clinical manifestation of nausea and vomiting encountered in patients with castration-resistant prostate cancer receiving AZD3514. Our data reveal a striking relationship between the pre-clinical observations described and the experience of nausea and vomiting in the clinic. In conclusion, the emetic nature of AZD3514 was predicted across a range of pre-clinical models, and the approach presented provides a valuable framework for predicition of clinical nausea and vomiting. - Highlights: • Integrated pre-clinical data can be used to predict clinical nausea and vomiting. • Data integrated from standard toxicology studies is sufficient to make a prediction. • The use of the nausea algorithm developed by Parkinson (2012) aids the prediction. • Additional pre-clinical studies can be used to confirm and quantify the risk.

60 APPLIED LIFE SCIENCES↗

Bus.py

GridLAB-D is an agent? based distribution system simulation environment that allows fine-grained end-user models, including geospatial and network topology detail. GridLAB-D addresses the lack of runtime interaction by designing a flexible communication interface, Bus.py (pronounced bus-dot-pie), that uses Python to pass messages between one or more GridLAB-D instances and a Smart Grid simulator.

Hansen, Timothy↗

Modeling Success in FLOSS Project Groups

A significant challenge in software engineering is accurately modeling projects in order to correctly forecast success or failure. The primary difficulty is that software development efforts are complex in terms of both the technical and social aspects of the engineering environment. This is compounded by the lack of real data that captures both the measures of success in performing a process, and the measures that reflect a group s social dynamics. This research focuses on the development of a model for predicting software project success that leverages the wealth of available open source project data in order to accurately model the behavior of those software engineering groups. Our model accounts for both the technical elements of software engineering as well as the social elements that drive the decisions of individual developers. We use agent-based simulations to represent the complexity of the group interactions, and base the behavior of the agents on the real software engineering data acquired. For four of the five project success measures, our results indicate that the developed model represents the underlying data well and provides accurate predictions of open source project success indicators.

97 MATHEMATICS AND COMPUTING↗

Coordinated Unmanned Aircraft System (UAS) and Ground-Based Weather Measurements to Predict Lagrangian Coherent Structures (LCSs)

Concentrations of airborne chemical and biological agents from a hazardous release are not spread uniformly. Instead, there are regions of higher concentration, in part due to local atmospheric flow conditions which can attract agents. We equipped a ground station and two rotary-wing unmanned aircraft systems (UASs) with ultrasonic anemometers. Flights reported here were conducted 10 to 15 m above ground level (AGL) at the Leach Airfield in the San Luis Valley, Colorado as part of the Lower Atmospheric Process Studies at Elevation—a Remotely-Piloted Aircraft Team Experiment (LAPSE-RATE) campaign in 2018. The ultrasonic anemometers were used to collect simultaneous measurements of wind speed, wind direction, and temperature in a fixed triangle pattern; each sensor was located at one apex of a triangle with ∼100 to 200 m on each side, depending on the experiment. A WRF-LES model was used to determine the wind field across the sampling domain. Data from the ground-based sensors and the two UASs were used to detect attracting regions (also known as Lagrangian Coherent Structures, or LCSs), which have the potential to transport high concentrations of agents. This unique framework for detection of high concentration regions is based on estimates of the horizontal wind gradient tensor. To our knowledge, our work represents the first direct measurement of an LCS indicator in the atmosphere using a team of sensors. Our ultimate goal is to use environmental data from swarms of sensors to drive transport models of hazardous agents that can lead to real-time proper decisions regarding rapid emergency responses. The integration of real-time data from unmanned assets, advanced mathematical techniques for transport analysis, and predictive models can help assist in emergency response decisions in the future.

54 ENVIRONMENTAL SCIENCES↗