Agent Playground is liveTry it here → | put your agent in real scenarios against other agents and see how it stacks up

At a Glance

How much past interaction agents remember doesn't have a single effect: the same memory length can destroy cooperation in one language model but boost it in another, so the model's internal disposition matters more than the game rules.

What They Found

When agents were powered by one commercial language model, adding longer memory caused cooperation to collapse into widespread defection; with a different, lightly aligned model, longer memory produced stronger and more stable cooperation. Agents were given Big Five personality scores and natural-language interaction histories; their decisions and movement produced distinct group patterns (stable cooperation, cyclical collapse, or scattered defection) depending on memory length and model choice. Sentiment analysis of the agents’ reasoning showed the two models interpreted the same memories in opposite emotional tones, providing a micro-level explanation for the divergent group outcomes. This aligns with Consensus-Based Decision Pattern and hints at how Handoff Pattern could influence memory-driven handoffs in agent workflows.
Not sure where to start?Get personalized recommendations
Learn More

By the Numbers

1Experimental setup: 100 agents, 500 time steps per trial, 10 independent trials per memory condition (memory lengths tested: 0,1,2,3).
2Prisoner’s Dilemma payoffs used: temptation = 2.0, reward = 1.0, punishment = -1.0, sucker = -2.0.
3Model-contrasting outcomes by memory: Gemini 2.0 Flash moved from cooperative clusters at memory 0 to scattered defection at memory 3; Gemma 3:4b showed the opposite trend, forming dense cooperative clusters at memory 2 and 3.

What This Means

Engineers building multi-agent systems and people responsible for agent governance should care because model choice (not just interaction rules) can flip group-level trust and cooperation. Researchers and evaluators designing agent-to-agent evaluation, reputation systems, or pre-deployment tests should explicitly check how models interpret memory and how that affects group behavior. For broader evaluation guidance, see Evaluation.

Key Figures

Figure 1: Three classes of the SPS model. (a) Class A: scattered and wandering defectors; (b) Class B: multiple and stable cooperative clusters; (c) Class C: repeated occurrences of emergence and collapse of cooperative clusters. Blue circles represent cooperating agents; red circles represent defecting agents.
Fig 1: Figure 1: Three classes of the SPS model. (a) Class A: scattered and wandering defectors; (b) Class B: multiple and stable cooperative clusters; (c) Class C: repeated occurrences of emergence and collapse of cooperative clusters. Blue circles represent cooperating agents; red circles represent defecting agents.
Figure 2: Schematic overview of the LLM agent’s decision-making process. The left panel shows the overall structure of the prompt template; the individual components are described in detail in the text. The right panel shows a concrete example for agent i i at a specific time step: the top-right box presents the input data (current state, personality traits, interaction history, and neighborhood), the lower diagram visually represents the spatial configuration, and the output box shows the agent’s final decision (strategy, movement, and reasoning).
Fig 2: Figure 2: Schematic overview of the LLM agent’s decision-making process. The left panel shows the overall structure of the prompt template; the individual components are described in detail in the text. The right panel shows a concrete example for agent i i at a specific time step: the top-right box presents the input data (current state, personality traits, interaction history, and neighborhood), the lower diagram visually represents the spatial configuration, and the output box shows the agent’s final decision (strategy, movement, and reasoning).
Figure 3: Agent spatial configurations for L m = 0 , 1 , 2 L_{m}=0,1,2 , and 3 3 (Gemini 2.0 Flash). Each row shows snapshots at t = 10 , 30 , 50 , 100 t=10,30,50,100 , and 500 500 for the corresponding L m L_{m} condition. Blue circles represent cooperating agents; red circles represent defecting agents. (a) L m = 0 L_{m}=0 : cooperative clusters form and grow (Class B-like); (b) L m = 1 L_{m}=1 : cyclical formation and collapse of clusters (Class C-like); (c) L m = 2 L_{m}=2 : gradual transition toward defection; (d) L m = 3 L_{m}=3 : rapid convergence to scattered defection (Class A-like).
Fig 3: Figure 3: Agent spatial configurations for L m = 0 , 1 , 2 L_{m}=0,1,2 , and 3 3 (Gemini 2.0 Flash). Each row shows snapshots at t = 10 , 30 , 50 , 100 t=10,30,50,100 , and 500 500 for the corresponding L m L_{m} condition. Blue circles represent cooperating agents; red circles represent defecting agents. (a) L m = 0 L_{m}=0 : cooperative clusters form and grow (Class B-like); (b) L m = 1 L_{m}=1 : cyclical formation and collapse of clusters (Class C-like); (c) L m = 2 L_{m}=2 : gradual transition toward defection; (d) L m = 3 L_{m}=3 : rapid convergence to scattered defection (Class A-like).
Figure 4: Pearson correlation coefficients between Big Five personality traits and agent behavioral characteristics ( L m = 1 L_{m}=1 condition, Gemini 2.0 Flash). Each cell shows the mean Pearson r r value averaged over 10 trials; cells marked “-” indicate non-significant correlations ( p ≥ 0.05 p\geq 0.05 ). Warmer colors indicate positive correlations; cooler colors indicate negative correlations.
Fig 4: Figure 4: Pearson correlation coefficients between Big Five personality traits and agent behavioral characteristics ( L m = 1 L_{m}=1 condition, Gemini 2.0 Flash). Each cell shows the mean Pearson r r value averaged over 10 trials; cells marked “-” indicate non-significant correlations ( p ≥ 0.05 p\geq 0.05 ). Warmer colors indicate positive correlations; cooler colors indicate negative correlations.

Ready to evaluate your AI agents?

Learn how ReputAgent helps teams build trustworthy AI through systematic evaluation.

Learn More

Considerations

Only two language models were compared, so results may not generalize across all model families or versions. Memory was represented as short recent interaction histories (0–3 steps) in natural language, not as richer qualitative impressions or long-term summaries. The experimental environment is a specific spatial Prisoner’s Dilemma setting; different games, populations, or prompt designs could change outcomes. Potential risks include Inter-Agent Miscommunication arising from divergent model interpretations of memory.

Methodology & More

The study replaced rule-based decision rules in a spatial social-particle model with language-model-driven agents that receive their current state, Big Five personality scores, and a short natural-language interaction history (memory length 0–3). Each agent’s language model returned a next action (cooperate or defect), a movement vector, and a short natural-language reasoning statement; the system ran 100-agent simulations for 500 steps with 10 trials per condition. Two models were compared: a heavily aligned commercial model (Gemini 2.0 Flash) and a lighter-weight open-style model (Gemma 3:4b). Results showed qualitatively opposite effects of memory length. With Gemini, cooperation degraded as memory length increased—going from stable cooperative clusters at no memory to cyclical collapse and eventually scattered defection at the longest memory. With Gemma, longer memory improved reciprocity and produced denser, more stable cooperative clusters. Sentiment analysis of the agents’ reasoning revealed that Gemini’s language about memory became more negative as memory length grew, while Gemma’s became more positive, suggesting that each model’s internal disposition toward past interactions drives the macro-level dynamics. The work implies that emergent social behavior in multi-agent systems can be driven more by what the model “believes” about past interactions than by the formal interaction rules, so practitioners should evaluate models’ memory interpretation as part of multi-agent trust and agent-to-agent evaluation pipelines. This can be conceptually related to Sub-Agent Delegation Pattern and other pattern-based governance approaches to distribute reasoning across agents.
Avoid common pitfallsLearn what failures to watch for
Learn More
Credibility Assessment:

Authors have mid-range h-indices (≈15–16) indicating established researchers; arXiv venue and missing institutional info keep it from higher rating.