Learning to coordinate in complex networks

Sven Van Segbroeck, Steven de Jong, Ann Nowe, Francisco C. Santos, Tom Lenaerts*

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    19 Citations (Web of Science)

    Abstract

    Designing an adaptive multi-agent system often requires the specification of interaction patterns between the different agents. To date, it remains unclear to what extent such interaction patterns influence the dynamics of the learning mechanisms inherent to each agent in the system. Here, we address this fundamental problem, both analytically and via computer simulations, examining networks of agents that engage in stag-hunt games with their neighbors and thereby learn to coordinate their actions. We show that the specific network topology does not affect the game strategy the agents learn on average. Yet, network features such as heterogeneity and clustering effectively determine how this average game behavior arises and how it manifests itself. Network heterogeneity induces variation in learning speed, whereas network clustering results in the emergence of clusters of agents with similar strategies. Such clusters also form when the network structure is not predefined, but shaped by the agents themselves. In that case, the strategy of an agent may become correlated with that of its neighbors on the one hand, and with its degree on the other hand. Here, we show that the presence of such correlations drastically changes the overall learning behavior of the agents. As such, our work provides a clear-cut picture of the learning dynamics associated with networks of agents trying to optimally coordinate their actions.

    Original languageEnglish
    Pages (from-to)416-427
    Number of pages12
    JournalAdaptive Behavior
    Volume18
    Issue number5
    DOIs
    Publication statusPublished - Oct 2010

    Keywords

    • Complex networks
    • evolutionary game theory
    • learning automata
    • SOCIAL DILEMMAS
    • DYNAMICS
    • POPULATIONS
    • COOPERATION
    • GRAPHS

    Cite this