Theory of Mind - LLM vs Human
Summary
A reflection on the difference between LLM theory of mind and human theory of mind, arguing that LLMs lack affective empathy due to their reliance on objective data, while humans integrate subjective experiences.
Similar Articles
Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations
This paper proposes a new interactive evaluation paradigm for Theory of Mind in LLMs, finding that improvements on static benchmarks do not translate to better performance in dynamic human-AI interactions, highlighting the need for interaction-based assessments.
Can LLMs Introspect? A Reality Check
This paper argues that recent claims about LLMs' ability to introspect are not justified, as behavioral evidence alone cannot distinguish genuine introspection from pattern matching on surface-level cues. The authors re-examine two evaluation paradigms and find that models rely on input-level features rather than genuine access to internal states.
Interpretable Humans, Alien LLMs: Expert Analysis of Latent Structures in Assessment Responses
The study uses exploratory factor analysis to compare latent structures in human and LLM responses on assessments, revealing that LLMs rely on statistically opaque mechanisms unlike human reasoning.
Evaluating LLMs as Human Surrogates in Controlled Experiments
This paper evaluates whether off-the-shelf LLMs can reliably simulate human responses in controlled behavioral experiments by comparing LLM-generated data with human survey responses on accuracy perception. The findings show that while LLMs capture directional effects and aggregate belief-updating patterns, they do not consistently match human-scale effect magnitudes, clarifying when synthetic LLM data can serve as behavioral proxies.
Evaluating Theory of Mind in Reasoning Models: Robustness over Reasoning
This arXiv paper evaluates theory of mind capabilities in reasoning LLMs, finding increased robustness to prompt variations and task perturbations. The authors interpret gains as evidence for a robustness-based account rather than a new ToM-specific ability.