Tag
MafiaScope is an open testbed that uses the social deduction game Mafia to probe LLM agents' beliefs non-invasively and in real-time, enabling fine-grained analysis of machine Theory of Mind through structured probe questions, interactive visualization, and counterfactual replay.
A developer describes building a multi-agent voice social-deduction game, solving turn-taking with a central conductor but struggling with shared memory and preserving social subtext when compressing conversation history into structured state.
Introduces a triadic variant of the Werewolf social-deduction game with a Jester role to evaluate multi-hop theory of mind in LLMs. Experiments show that current models struggle with the inverted incentives, exposing limitations in their reasoning about opponents' utilities.