Search NASA⌕ Search

SEARCH · Search NASA

Results for “evolutionary games”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

18 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evolutionary Game Dynamics between Distributed Energy Resources and Microgrid Operator: Balancing Act for Power Factor Improvement

This article investigates the intricate dynamics between Distributed Energy Resources (DERs) and the Microgrid Operator (MGO) within a microgrid interconnected with the main grid. Employing an evolutionary game framework, the study scrutinizes the strategic evolution of DERs’ decision-making processes in their interactions with the MGO. Modeled as an evolutionary game, these interactions encapsulate the strategies adopted by DERs, resulting in stable equilibrium strategies over time. Motivated by direct benefits linked to increased active power production, DERs strive to sell all available power, while the MGO focuses on optimizing the microgrid’s overall performance. The study assesses the microgrid’s performance in terms of its power factor, emphasizing the strategic balance DERs must achieve in their active power generation to avoid penalization. This penalization results in decreased individual utility for DERs due to the overall power factor decrease resulting from their prioritization of active power generation. Additionally, the diminished overall power factor implies a decrease in MGO utility. The individual utility of each DER is further influenced by the strategies adopted by other DERs, impacting the penalization factor. Leveraging a modified IEEE 13-node distribution microgrid consisting of three DERs, the study presents case studies encompassing both cooperative and non-cooperative evolutionary game scenarios. These case studies illuminate the intricacies of interactions and the resulting equilibrium outcomes.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Simulating policy interventions in the interfirm diffusion of low-carbon technologies: An agent-based evolutionary game model

Policy interventions are frequently used by authorities around the world to mitigate carbon emissions. However, economic systems are essentially complex adaptive systems, which often exhibit unexpected responses to exogenous interventions and leave intervenors in a dilemma, even if the interventions are elaborately designed. To explore the behaviors of the diffusion system regarding low-carbon technologies, this study builds an agent-based model (ABM) to simulate enterprises' reactions to multiple policy interventions aimed at spurring low-carbon technology diffusion. The simulated enterprises are in a complex network where they play evolutionary games with their neighbors, which enables the model to possess two critical features of economic systems: adaptiveness and equilibrium. The model reveals a dilemma of policy interventions: intuitively, carbon taxes, asymmetric penalties (only imposed on un-low-carbon enterprises) and subsidies can improve the diffusion, which is consistent with previous research; counter-intuitively, all these policies turn out to be inefficient or even harmful to low-carbon enterprises because of the diffusion system's high adaptiveness. Specifically, when carbon taxes and penalties increase, both the low-carbon and un-low-carbon enterprises end up with the equilibrium of equivalent but lower profits. In contrast, all the enterprises earn equivalent but more profits even though subsidies are only given to the low-carbon enterprises, which implies that the un-low-carbon enterprises (indirectly) grab a portion of the subsidies and accordingly weaken the incentive effect of subsidies. These system behaviors are summarized as "equalizing effect" because the system tends to equalize the impact of both positive and negative interventions among all enterprises even though the policy interventions are asymmetrically imposed on one type of the enterprises. The findings also indicate that policies implemented to enlarge green market sizes can help policymakers bypass the dilemma.

Agent-based modeling↗
DOE OSTI2017

Genome-driven evolutionary game theory helps understand the rise of metabolic interdependencies in microbial communities

Metabolite exchanges in microbial communities give rise to ecological interactions that govern ecosystem diversity and stability. It is unclear, however, how the rise of these interactions varies across metabolites and organisms. Here we address this question by integrating genome-scale models of metabolism with evolutionary game theory. Specifically, we use microbial fitness values estimated by metabolic models to infer evolutionarily stable interactions in multi-species microbial “games”. We first validate our approach using a well-characterized yeast cheater-cooperator system. We next perform over 80,000 in silico experiments to infer how metabolic interdependencies mediated by amino acid leakage in Escherichia coli vary across 189 amino acid pairs. While most pairs display shared patterns of inter-species interactions, multiple deviations are caused by pleiotropy and epistasis in metabolism. Moreover, simulated invasion experiments reveal possible paths to obligate cross-feeding. Our study provides genomically driven insight into the rise of ecological interactions, with implications for microbiome research and synthetic ecology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Evolutionary Game and Simulation Research of Blockchain-Based Co-Governance of Emergency Supply Allocation

Recently, with the spread of COVID-19 pandemic, emergency supply allocation system is drawing more and more social attention. Emergency supply allocation system is an important part of emergency governance system. It reflects social organizations’ credibility, public safety, and the modernization level of social governance. However, emergency supply allocation system still has some problems, such as information asymmetry, different desires of participants, unreasonable allocation, and so on. At present, it is widely accepted that the advantage of blockchain in co-governance could be of great help in solving above problems. And in order to distinguish the effect of blockchain to the emergency supply allocation, the paper builds a tripartite evolutionary game model among the government, social organizations, and the public to analyse the impact of blockchain platform on emergency supply allocation. The simulation analysis shows the following: (1) The strategy choices of the government have a crucial impact on the evolution and stability of social organizations’ strategies. It needs a long-term process to guide social organizations practicing active allocation, and the government should accelerate to build the blockchain platform to promote this process. (2) With the help of blockchain platform, the increment of penalty intensity of the government is conductive to increasing the probabilities that social organizations practice active allocation and the government practices strict supervision. (3) Blockchain platform has a significant impact on social organizations’ choice for active allocation in many aspects, such as the positive and negative effects of social organizations, effect’s increasing multiple, and the cost of the public informing. In the end, some suggestions are presented to improve the co-governance of emergency supply allocation.

Zhao, Huawei↗
DOE OSTI2018

Peer-to-Peer Energy Trading in a Prosumer-Based Community Microgrid: A Game-Theoretic Model

This paper proposes a novel game-theoretic model for peer-to-peer (P2P) energy trading among the prosumers in a community. The buyers can adjust the energy consumption behavior based on the price and quantity of the energy offered by the sellers. There exist two separate competitions during the trading process: 1) price competition among the sellers; and 2) seller selection competition among the buyers. The price competition among the sellers is modeled as a noncooperative game. The evolutionary game theory is used to model the dynamics of the buyers for selecting sellers. Moreover, an M-leader and N-follower Stackelberg game approach is used to model the interaction between buyers and sellers. Two iterative algorithms are proposed for the implementation of the games such that an equilibrium state exists in each of the games. The proposed method is applied to a small community microgrid with photo-voltaic and energy storage systems. Simulation results show the convergence of the algorithms and the effectiveness of the proposed model to handle P2P energy trading. The results also show that P2P energy trading provides significant financial and technical benefits to the community, and it is emerging as an alternative to cost-intensive energy storage systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2014

Emergence of microbial networks as response to hostile environments

The majority of microorganisms live in complex communities under varying conditions. One pivotal question in evolutionary biology is the emergence of cooperative traits and their sustainment in altered environments or in the presence of free-riders. Co-occurrence patterns in the spatial distribution of biofilms can help define species’ identities, and systems biology tools are revealing networks of interacting microorganisms. However, networks of inter-dependencies involving micro-organisms in the planktonic phase may be just as important, with the added complexity that they are not bounded in space. An integrated approach linking imaging, “Omics” and modeling has the potential to enable new hypothesis and working models. In order to understand how cooperation can emerge and be maintained without abilities like memory or recognition we use evolutionary game theory as the natural framework to model cell-cell interactions arising from evolutive decisions. We consider a finite population distributed in a spatial domain (biofilm), and divided into two interacting classes with different traits. This interaction can be weighted by distance, and produces physical connections between two elements allowing them to exchange finite amounts of energy and matter. Available strategies to each individual of one class in the population are the propensities or “willingness” to connect any individual of the other class. Following evolutionary game theory, we propose a mathematical model which explains the patterns of connections which emerge when individuals are able to find connection strategies that asymptotically optimize their fitness. The process explains the formation of a network for efficiently exchanging energy and matter among individuals and thus ensuring their survival in hostile environments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

The study on knowledge transferring incentive for information system requirement development

Information system requirement development is a process of users’ knowledge sharing and transferring. However the tacit requirements developing is a main problem during requirement development process, for the reason of difficult to encoding, express, and communicate. Knowledge fusion and corporate effort is needed to finding tacit requirements. Under this background, our paper try to find out the rule of effort dynamic evolutionary of software developer and user by building an evolutionary game model on the condition of incentive system. And in addition this paper provides an in depth discussion at the end of this paper.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The effects of allelochemical transfer on the dynamics of hosts, parasitoids, and competing hyperparasitoids

Allelochemicals produced by plants may be ingested by herbivorous insects and transferred to higher trophic levels with potentially deleterious effects. We develop a system of differential equations to investigate the effect of the transfer of allelochemicals, such as nicotine, on the population dynamics of a system of hosts, parasitoids, and two competing hyperparasitoids that attack different life stages of the parasitoids. We find both somewhat deleterious effects of nicotine on the larvae-attacking hyperparasitoids and increased attack rates for the pupae-attacking hyperparasitoids can promote coexistence. We also use an evolutionary game-theoretic approach to determine the optimal distribution of hyperparasitoid attacks among nicotine-producing and nicotine-free plants. With strong deleterious effects of nicotine and increased attack rates for the pupae-attacking hyperparasitoid, we find both species attack parasitoids on the nicotine-free plant but only pupae-attacking hyperparasitoids attack parasitoids on the nicotine-producing plant.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

The Art of War: Beyond Memory-one Strategies in Population Games

We show that the history of play in a population game contains exploitable information that can be successfully used by sophisticated strategies to defeat memory-one opponents, including zero determinant strategies. The history allows a player to label opponents by their strategies, enabling a player to determine the population distribution and to act differentially based on the opponent’s strategy in each pairwise interaction. For the Prisoner’s Dilemma, these advantages lead to the natural formation of cooperative coalitions among similarly behaving players and eventually to unilateral defection against opposing player types. We show analytically and empirically that optimal play in population games depends strongly on the population distribution. For example, the optimal strategy for a minority player type against a resident TFT population is ALLC, while for a majority player type the optimal strategy versus TFT players is ALLD. Such behaviors are not accessible to memory-one strategies. Drawing inspiration from Sun Tzu’s the Art of War, we implemented a non-memory-one strategy for population games based on techniques from machine learning and statistical inference that can exploit the history of play in this manner. Via simulation we find that this strategy is essentially uninvadable and can successfully invade (significantly more likely than a neutral mutant) essentially all known memory-one strategies for the Prisoner’s Dilemma, including ALLC (always cooperate), ALLD (always defect), tit-for-tat (TFT), winstay-lose-shift (WSLS), and zero determinant (ZD) strategies, including extortionate and generous strategies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

CrowdPhase: crowdsourcing the phase problem

The idea of attacking the phase problem by crowdsourcing is introduced. Using an interactive, multi-player, web-based system, participants work simultaneously to select phase sets that correspond to better electron-density maps in order to solve low-resolution phasing problems. The human mind innately excels at some complex tasks that are difficult to solve using computers alone. For complex problems amenable to parallelization, strategies can be developed to exploit human intelligence in a collective form: such approaches are sometimes referred to as ‘crowdsourcing’. Here, a first attempt at a crowdsourced approach for low-resolution ab initio phasing in macromolecular crystallography is proposed. A collaborative online game named CrowdPhase was designed, which relies on a human-powered genetic algorithm, where players control the selection mechanism during the evolutionary process. The algorithm starts from a population of ‘individuals’, each with a random genetic makeup, in this case a map prepared from a random set of phases, and tries to cause the population to evolve towards individuals with better phases based on Darwinian survival of the fittest. Players apply their pattern-recognition capabilities to evaluate the electron-density maps generated from these sets of phases and to select the fittest individuals. A user-friendly interface, a training stage and a competitive scoring system foster a network of well trained players who can guide the genetic algorithm towards better solutions from generation to generation via gameplay. CrowdPhase was applied to two synthetic low-resolution phasing puzzles and it was shown that players could successfully obtain phase sets in the 30° phase error range and corresponding molecular envelopes showing agreement with the low-resolution models. The successful preliminary studies suggest that with further development the crowdsourcing approach could fill a gap in current crystallographic methods by making it possible to extract meaningful information in cases where limited resolution might otherwise prevent initial phasing.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Optimizing thermodynamic trajectories using evolutionary and gradient-based reinforcement learning

Here using a model heat engine, we show that neural-network-based reinforcement learning can identify thermodynamic trajectories of maximal efficiency. We consider both gradient and gradient-free reinforcement learning. We use an evolutionary learning algorithm to evolve a population of neural networks, subject to a directive to maximize the efficiency of a trajectory composed of a set of elementary thermodynamic processes; the resulting networks learn to carry out the maximally efficient Carnot, Stirling, or Otto cycles. When given an additional irreversible process, this evolutionary scheme learns a previously unknown thermodynamic cycle. Gradient-based reinforcement learning is able to learn the Stirling cycle, whereas an evolutionary approach achieves the optimal Carnot cycle. Our results show how the reinforcement learning strategies developed for game playing can be applied to solve physical problems conditioned upon path-extensive order parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2019

Optimizing thermodynamic trajectories using evolutionary reinforcement learning

Using a model heat engine we show that neural network-based reinforcement learning can identify thermodynamic trajectories of maximal efficiency. We use an evolutionary learning algorithm to evolve a population of neural networks, subject to a directive to maximize the efficiency of a trajectory composed of a set of elementary thermodynamic processes; the resulting networks learn to carry out the maximally-efficient Carnot, Stirling, or Otto cycles. Given additional irreversible processes this evolutionary scheme learns a hitherto unknown thermodynamic cycle. Our results show how the reinforcement learning strategies developed for game playing can be applied to solve physical problems conditioned upon path-extensive order parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Identifying Vulnerabilities and Hardening Attack Graphs for Networked Systems

We investigate efficient security control methods for protecting against vulnerabilities in networked systems. A large number of interdependent vulnerabilities typically exist in the computing nodes of a cyber-system; as vulnerabilities get exploited, starting from low level ones, they open up the doors to more critical vulnerabilities. These cannot be understood just by a topological analysis of the network, and we use the attack graph abstraction of Dewri et al. to study these problems. In contrast to earlier approaches based on heuristics and evolutionary algorithms, we study rigorous methods for quantifying the inherent vulnerability and hardening cost for the system. We develop algorithms with provable approximation guarantees, and evaluate them for real and synthetic attack graphs.

attack graphs↗
DOE OSTI2021

Reinforcement learning in discrete action space applied to inverse defect design

Abstract Reinforcement learning (RL) algorithms that include Monte Carlo Tree Search (MCTS) have found tremendous success in computer games such as Go, Shiga and Chess. Such learning algorithms have demonstrated super-human capabilities in navigating through an exhaustive discrete action search space. Motivated by their success in computer games, we demonstrate that RL can be applied to inverse materials design problems. We deploy RL for a representative case of the optimal atomic scale inverse design of extended defects via rearrangement of chalcogen (e.g. S) vacancies in 2D transition metal dichalcogenides (e.g. MoS 2 ). These defect rearrangements and their dynamics are important from the perspective of tunable phase transition in 2D materials i.e. 2H (semi-conducting) to 1T (metallic) in MoS 2 . We demonstrate the ability of MCTS interfaced with a reactive molecular dynamics simulator to efficiently sample the defect phase space and perform inverse design—starting from randomly distributed S vacancies, the optimal defect rearrangement of defects corresponds a line defect of S vacancies. We compare MCTS performance with evolutionary optimization i.e. genetic algorithms and show that MCTS converges to a better optimal solution (lower objective) and in fewer evaluations compared to GA. We also comprehensively evaluate and discuss the effect of MCTS hyperparameters on the convergence to solution. Overall, our study demonstrates the effectives of using RL approaches that operate in discrete action space for inverse defect design problems.

42 ENGINEERING↗
DOE OSTI2024

Intrinsic and environmental drivers of pairwise cohesion in wild Canis social groups

Animals within social groups respond to costs and benefits of sociality by adjusting the proportion of time they spend in close proximity to other individuals in the group (cohesion). Variation in cohesion between individuals, in turn, shapes important group-level processes such as subgroup formation and fission–fusion dynamics. Although critical to animal sociality, a comprehensive understanding of the factors influencing cohesion remains a gap in our knowledge of cooperative behavior in animals. We tracked 574 individuals from six species within the genus Canis in 15 countries on four continents with GPS telemetry to estimate the time that pairs of individuals within social groups spent in close proximity and test hypotheses regarding drivers of cohesion. Pairs of social canids (Canis spp.) varied widely in the proportion of time they spent together (5%–100%) during seasonal monitoring periods relative to both intrinsic characteristics and environmental conditions. The majority of our data came from three species of wolves (gray wolves, eastern wolves, and red wolves) and coyotes. For these species, cohesion within social groups was greatest between breeding pairs and varied seasonally as the nature of cooperative activities changed relative to annual life history patterns. Across species, wolves were more cohesive than coyotes. For wolves, pairs were less cohesive in larger groups, and when suitable, small prey was present reflecting the constraints of food resources and intragroup competition on social associations. Pair cohesion in wolves declined with increased anthropogenic modification of the landscape and greater climatic variability, underscoring challenges for conserving social top predators in a changing world. We show that pairwise cohesion in social groups varies strongly both within and across Canis species, as individuals respond to changing ecological context defined by resources, competition, and anthropogenic disturbance. Our work highlights that cohesion is a highly plastic component of animal sociality that holds significant promise for elucidating ecological and evolutionary mechanisms underlying cooperative behavior.

59 BASIC BIOLOGICAL SCIENCES↗