da9b7228b2
- Source: inbox/archive/2024-11-00-ruiz-serra-factorised-active-inference-multi-agent.md - Domain: ai-alignment - Extracted by: headless extraction cron (worker 6) Pentagon-Agent: Theseus <HEADLESS>
3.8 KiB
| type | domain | description | confidence | source | created | secondary_domains | |
|---|---|---|---|---|---|---|---|
| claim | ai-alignment | Individual free energy minimization in multi-agent active inference systems does not guarantee collective free energy minimization because ensemble-level EFE characterizes basins of attraction that may not align with individual optima | experimental | Ruiz-Serra et al., 'Factorised Active Inference for Strategic Multi-Agent Interactions' (AAMAS 2025) | 2026-03-11 |
|
Individual free energy minimization in multi-agent systems does not guarantee collective free energy minimization because ensemble-level expected free energy characterizes basins of attraction that may not align with individual optima
Ruiz-Serra et al. demonstrate through game-theoretic analysis that when multiple active inference agents interact strategically, each agent minimizing its individual expected free energy (EFE) does not necessarily produce optimal collective outcomes. The ensemble-level EFE "characterizes basins of attraction of games with multiple Nash Equilibria under different conditions" but "is not necessarily minimised at the aggregate level."
This finding reveals a fundamental tension between individual and collective optimization in multi-agent active inference systems. Each agent maintains factorised generative models with "explicit, individual-level beliefs about the internal states of other agents" and uses these beliefs for strategic planning. However, the interaction structure—the specific game form, communication channels, and coordination mechanisms—determines whether individual optimization produces collective intelligence or suboptimal equilibria.
The paper applies this framework to iterated normal-form games with 2 and 3 players, showing how active inference agents navigate both cooperative and non-cooperative strategic interactions. The key insight is that active inference dynamics alone are insufficient for collective optimization—the specific design of interaction structures matters critically.
Evidence
- Ruiz-Serra et al. (2024) demonstrate through formal analysis of multi-agent active inference that ensemble-level EFE is not necessarily minimized at aggregate level
- The framework shows this through application to games with multiple Nash equilibria where individual optimization can lock into suboptimal collective states
- Each agent uses factorised generative models to represent beliefs about other agents' internal states, enabling Theory of Mind within active inference
- The finding holds across 2-player and 3-player iterated normal-form games in both cooperative and non-cooperative settings
Implications
This finding has direct architectural implications for multi-agent AI systems:
- Coordination mechanisms are necessary, not optional: Pure agent autonomy with individual optimization is insufficient for collective intelligence
- Interaction structure design is critical: The specific form of agent interaction (review processes, communication protocols, decision mechanisms) shapes whether individual research produces collective optimization
- Evaluator roles are formally justified: Cross-domain synthesis and evaluation roles exist precisely because individual agent optimization doesn't guarantee collective outcomes
Relevant Notes:
- AI alignment is a coordination problem not a technical problem
- collective intelligence requires diversity as a structural precondition not a moral preference
- designing coordination rules is categorically different from designing coordination outcomes as nine intellectual traditions independently confirm
- partial connectivity produces better collective intelligence than full connectivity on complex problems because it preserves diversity
Topics: