Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces
摘要
The paper proposes an Inverse Theory of Mind (IToM) pipeline that infers user beliefs, preferences, and decision-making traits from observed interactions, using LLM-driven counterfactual reasoning to synthesize structured user personas for adaptive content recommendation across modalities, including a VisionOS spatial banking app.
查看缓存全文
缓存时间: 2026/08/13 15:25
# Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent Interfaces Source: [https://arxiv.org/html/2608.11354](https://arxiv.org/html/2608.11354) ## Inverse Theory of Mind Modeling for Content Recommendation: From Web Browsing to Dynamic Intelligent InterfacesCCS:Information systems Recommender systemsCCS:Human\-centered computing Mixed / augmented realityCCS:Computing methodologies Reasoning about belief and knowledgeCCS:Computing methodologies Natural language generation Mengyu ChenNote:The first two authors contributed equally to this research\.email:[mengyu\.chen@jpmchase\.com](mailto:[email protected])Affiliation:JPMorganChase,New York City,NY,USAFeiyu Luemail:[feiyu\.lu@jpmchase\.com](mailto:[email protected])Affiliation:JPMorganChase,New York City,NY,USA,Chun\-Fu \(Richard\) ChenNote:Corresponding authors\.email:[richard\.cf\.chen@jpmchase\.com](mailto:[email protected])Affiliation:JPMorganChase,New York City,NY,USA,Lucas Vinh Tranemail:[lucas\.vinhtran@chase\.com](mailto:[email protected])Affiliation:JPMorganChase,London,UKandJay Katukuriemail:[jay\.katukuri@chase\.com](mailto:[email protected])Affiliation:JPMorganChase,Palo Alto,CA,USA © none ###### Abstract\. Modern recommender systems treat observed actions as reliable proxies for user preferences, yet interactions often reflect exploration or comparison rather than stable preference expression\. As interfaces evolve from static layouts toward generative UIs and immersive extended reality \(XR\), the need for deeper, modality\-agnostic user understanding grows: these adaptive environments must decide not only*what*to present but*where*,*when*,*how prominently*, and most importantly*why*a user acts\. We propose an Inverse Theory of Mind \(IToM\) pipeline that reasons backward from observed interactions to infer the beliefs, preferences, and decision\-making traits that explain behavior\. The pipeline reconstructs each user’s decision context, including what was chosen and what alternatives were available, applies LLM\-driven counterfactual reasoning to produce evidence\-grounded natural\-language belief statements, and synthesizes these beliefs through multi\-hypothesis abductive inference into a structured*user persona*\. We evaluate on the OPeRA dataset against ground\-truth personality assessments, attitudinal surveys, and interview\-based personas across four tasks: next action prediction, shopping attitude alignment, Big Five personality inference, and held\-out category prediction\. Results show that inferred personas match or exceed ground\-truth personas and that multi\-hypothesis reasoning is essential for accurate personality prediction\. We further demonstrate cross\-modal transferability with a persona\-driven spatial banking application on VisionOS\. ###### Keywords: Theory of Mind, User modeling, Persona synthesis, Recommender systems, LLM reasoning, Generative UI, Extended reality, Adaptive interfaces, Persona prediction ## 1\.Introduction Recommender systems have made substantial progress in predicting user behavior from large\-scale interaction histories, including clicking, viewing, and scrolling\. Methods such as collaborative filtering\([34](https://arxiv.org/html/2608.11354#bib.bib1);[24](https://arxiv.org/html/2608.11354#bib.bib2)\), sequential models\([32](https://arxiv.org/html/2608.11354#bib.bib7);[69](https://arxiv.org/html/2608.11354#bib.bib8)\), and generative retrieval with semantic item IDs\([57](https://arxiv.org/html/2608.11354#bib.bib70)\)recommend items by learning latent patterns from past interactions\. More recently, Large Language Model \(LLM\)\-based recommenders have emerged, using language understanding and reasoning for more conversational and explainable recommendations\([18](https://arxiv.org/html/2608.11354#bib.bib10);[81](https://arxiv.org/html/2608.11354#bib.bib13)\)\. Despite these advances, there is limitation with such methods\.*Interaction based*systems learn statistical patterns over a specific behavior type \(e\.g\., clicks, purchases, ratings\) and can only predict the next behavior of that same type\([43](https://arxiv.org/html/2608.11354#bib.bib34);[23](https://arxiv.org/html/2608.11354#bib.bib72)\)\. Even recent approaches that scale sequence length\([23](https://arxiv.org/html/2608.11354#bib.bib72)\)or integrate collaborative semantics into LLMs\([87](https://arxiv.org/html/2608.11354#bib.bib71)\)remain bound to this scope\. At the same time, user interfaces are evolving toward generative UIs\([70](https://arxiv.org/html/2608.11354#bib.bib60);[40](https://arxiv.org/html/2608.11354#bib.bib61)\)that compose novel layouts on the fly, which aims at offering personalized experiences that adapt to particular users and devices \(e\.g\., mobile, desktop, and spatial extended reality \(XR\) systems\)\. These emerging paradigms need to decide not only*what*to show but*where*,*when*, and*how*to present it, which demands a richer model of the user than click histories can provide\.*Persona\-based*approaches offer that richer model by constructing profiles that capture interests, goals, personality traits, values, and life context\([83](https://arxiv.org/html/2608.11354#bib.bib69);[49](https://arxiv.org/html/2608.11354#bib.bib37)\), but they traditionally require qualitative data such as user interviews, demographic surveys, or manually authored persona templates\([8](https://arxiv.org/html/2608.11354#bib.bib42);[39](https://arxiv.org/html/2608.11354#bib.bib49)\), which are expensive, intrusive, and difficult to scale\. The common missing piece is an understanding of the*rationale*behind user behavior\. In cognitive science, reasoning about others’ beliefs, goals, and intentions is known as Theory of Mind \(ToM\)\([54](https://arxiv.org/html/2608.11354#bib.bib15);[78](https://arxiv.org/html/2608.11354#bib.bib17)\)\. ToM is well suited to user modeling because it is context\-dependent, interpretable, and modality\-agnostic\. By applying ToM*inversely*, reasoning backward from observed actions to the beliefs that generated them, we can extract persona\-level understanding from ordinary interaction traces without requiring qualitative data\. Building on this perspective, we propose an*Inverse Theory of Mind*\(IToM\) pipeline that performs*abductive inference*, reasoning from observed behavior to its best explanation, over user interaction traces\. Our pipeline transforms raw event metadata into human\-readable belief representations through action summarization, context reconstruction, and optimization\. We then synthesize these user beliefs into a structured*user persona*: a cognitive profile capturing the user’s interests, motivational drives, life context, and values\. We use LLM as the reasoning engine at each stage, producing evidence\-grounded belief statements and persona profiles rather than opaque latent vectors\. Once constructed, the persona can be used as a portable user model for tasks such as personality\-aligned attitude inference, shopping preference forecasting, or content adaptation for novel interfaces\. Applications can use the persona through standard prompting without task\-specific retraining\([83](https://arxiv.org/html/2608.11354#bib.bib69)\)\. We validate the approach on the OPeRA dataset\([76](https://arxiv.org/html/2608.11354#bib.bib31)\), which pairs fine\-grained user action logs from Amazon shopping sessions with ground\-truth interview transcripts, personality assessments, and shopping attitude surveys\. Our contributions are: - •We propose*Inverse Theory of Mind*as a paradigm that bridges interaction\-based recommenders \(data\-rich but scope\-bound\) and persona\-based methods \(rich understanding but dependent on costly qualitative data\), and instantiate it as a multi\-stage abductive inference pipeline that reconstructs decision contexts, infers counterfactual\-grounded beliefs, and synthesizes them into a modality\-agnostic user persona from behavioral traces alone\. - •We introduce*multi\-hypothesis persona synthesis*, generating diverse personality interpretations of the same behavioral evidence and aggregating them with adaptive confidence weighting\. - •We validate on real\-world browsing data \(OPeRA\), comparing inferred personas against ground\-truth interviews and personality assessments, demonstrating that behaviorally inferred personas support downstream tasks \(shopping\-attitude alignment, personality inference, held\-out category prediction\) beyond the scope of interaction\-based methods\. - •We present an illustrative spatial banking prototype on VisionOS as a proof\-of\-concept for persona portability across interaction modalities, where personas inferred from 2D browsing data inform 3D layout and content selection\. ## 2\.Related Work ### 2\.1\.User Modeling and Intent Inference Recommender systems have progressed from matrix factorization on explicit ratings\([34](https://arxiv.org/html/2608.11354#bib.bib1)\)through implicit\-feedback methods\([28](https://arxiv.org/html/2608.11354#bib.bib4);[60](https://arxiv.org/html/2608.11354#bib.bib3);[71](https://arxiv.org/html/2608.11354#bib.bib5)\)to deep sequential models that capture temporal patterns via recurrent networks, self\-attention, bidirectional transformers and beyond\([26](https://arxiv.org/html/2608.11354#bib.bib6);[32](https://arxiv.org/html/2608.11354#bib.bib7);[69](https://arxiv.org/html/2608.11354#bib.bib8);[16](https://arxiv.org/html/2608.11354#bib.bib9)\)\. Recent generative retrieval and industrial\-scale systems push this paradigm further by framing recommendation as token generation over learned item IDs\([57](https://arxiv.org/html/2608.11354#bib.bib70)\)or modeling tens of thousands of interactions\([23](https://arxiv.org/html/2608.11354#bib.bib72)\)\. Integrating LLMs into recommendation has opened additional directions, including text\-to\-text task unification\([18](https://arxiv.org/html/2608.11354#bib.bib10)\), LLM fine\-tuning and instruction\-following for recommendation\([3](https://arxiv.org/html/2608.11354#bib.bib11);[84](https://arxiv.org/html/2608.11354#bib.bib36)\), zero\-shot ranking and conversational recommendation\([27](https://arxiv.org/html/2608.11354#bib.bib12);[25](https://arxiv.org/html/2608.11354#bib.bib85)\), prompt enrichment strategies for personalized recommendation\([45](https://arxiv.org/html/2608.11354#bib.bib84)\), and hybrid collaborative\-language reasoning\([88](https://arxiv.org/html/2608.11354#bib.bib14);[87](https://arxiv.org/html/2608.11354#bib.bib71)\)\. Recent work explores LLM\-driven user interest profiling from interaction histories\([11](https://arxiv.org/html/2608.11354#bib.bib81);[48](https://arxiv.org/html/2608.11354#bib.bib82);[61](https://arxiv.org/html/2608.11354#bib.bib83)\)\. PEARL\([48](https://arxiv.org/html/2608.11354#bib.bib82)\)retrieves and re\-ranks representative snippets from a user’s existing text;[11](https://arxiv.org/html/2608.11354#bib.bib81)cluster consumption logs into LLM\-generated interest journeys; and UserLLM\([61](https://arxiv.org/html/2608.11354#bib.bib83)\)conditions generation on precomputed embedding\-based user representations\. A parallel line argues for natural\-language user profiles as a route to transparent and scrutable recommendation\([56](https://arxiv.org/html/2608.11354#bib.bib87);[59](https://arxiv.org/html/2608.11354#bib.bib88)\), typically assembling profiles from explicit user statements or curated text\. Complementing these, session\-based approaches model intra\-session dynamics through graph neural networks or attention mechanisms\([82](https://arxiv.org/html/2608.11354#bib.bib29);[38](https://arxiv.org/html/2608.11354#bib.bib30)\), e\-commerce models classify browsing versus purchasing intent\([43](https://arxiv.org/html/2608.11354#bib.bib34);[22](https://arxiv.org/html/2608.11354#bib.bib33)\), and probabilistic click models formalize examination and click decisions in web search\([12](https://arxiv.org/html/2608.11354#bib.bib35)\)\. In planning and robotics, goal recognition treats intent inference as an inverse problem over observed action sequences\([58](https://arxiv.org/html/2608.11354#bib.bib43);[68](https://arxiv.org/html/2608.11354#bib.bib44)\)\. These methods, including LLM\-enhanced variants, achieve strong next\-item or next\-action prediction yet remain scope\-bound: they model statistical regularities within a single interaction type, reduce intent to a categorical label or scalar reward, and cannot transfer to tasks requiring a different domain of user understanding, such as personal goals, lifestyle profiling, or adaptation to an unseen interface modality\. Inverse reinforcement learning \(IRL\) moves closer to latent motivations by recovering reward functions from demonstrated trajectories\([53](https://arxiv.org/html/2608.11354#bib.bib45);[9](https://arxiv.org/html/2608.11354#bib.bib46)\)\. Zhao et al\.\([86](https://arxiv.org/html/2608.11354#bib.bib48)\)introduced mental reward models that use distributional IRL to infer users’ internal satisfaction, and Wang et al\.\([75](https://arxiv.org/html/2608.11354#bib.bib47)\)discover causal rather than co\-occurrence relations among user actions, improving both accuracy and explainability\. These approaches produce richer signals than categorical intent labels but still operate in numeric reward spaces rather than interpretable representations of why a user acts\. A separate line of work constructs user personas to drive recommendation and simulation\([83](https://arxiv.org/html/2608.11354#bib.bib69);[49](https://arxiv.org/html/2608.11354#bib.bib37);[85](https://arxiv.org/html/2608.11354#bib.bib32)\)\. However, these approaches assume that the persona is given as input, authored manually or derived from qualitative sources such as demographic and personality profiles\([8](https://arxiv.org/html/2608.11354#bib.bib42);[39](https://arxiv.org/html/2608.11354#bib.bib49)\), rather than inferred from behavioral traces\. Our work bridges these two directions by introducing belief inference as an intermediate representation, constructing personas from behavioral traces without qualitative data\. ### 2\.2\.Theory of Mind in AI Theory of Mind \(ToM\) refers to the cognitive ability to attribute beliefs, desires, and intentions to others\([54](https://arxiv.org/html/2608.11354#bib.bib15);[4](https://arxiv.org/html/2608.11354#bib.bib16)\)\. Computational approaches formalize ToM as Bayesian inverse planning over goals and beliefs\([2](https://arxiv.org/html/2608.11354#bib.bib18);[1](https://arxiv.org/html/2608.11354#bib.bib19);[30](https://arxiv.org/html/2608.11354#bib.bib20);[46](https://arxiv.org/html/2608.11354#bib.bib40)\), and neural meta\-learning has shown that ToM\-like reasoning can be acquired from agent trajectories\([55](https://arxiv.org/html/2608.11354#bib.bib21)\)\. Recent multi\-agent work applies ToM to LLM\-based collaboration through explicit belief tracking, hypothesis\-driven goal attribution, and inverse reinforcement learning\([37](https://arxiv.org/html/2608.11354#bib.bib38);[14](https://arxiv.org/html/2608.11354#bib.bib39);[80](https://arxiv.org/html/2608.11354#bib.bib41)\), though these remain confined to game\-like or synthetic settings\. Evaluations confirm that LLMs can pass false\-belief tasks and perform higher\-order belief reasoning\([35](https://arxiv.org/html/2608.11354#bib.bib22);[66](https://arxiv.org/html/2608.11354#bib.bib26)\), though with notable gaps on certain tasks\([62](https://arxiv.org/html/2608.11354#bib.bib23);[72](https://arxiv.org/html/2608.11354#bib.bib25);[63](https://arxiv.org/html/2608.11354#bib.bib24);[65](https://arxiv.org/html/2608.11354#bib.bib27);[10](https://arxiv.org/html/2608.11354#bib.bib28)\)\. ToM\-inspired reasoning has also entered applied settings recently\. Liu et al\.\([42](https://arxiv.org/html/2608.11354#bib.bib51)\)show that ToM\-aware recommendations increase consumer trust, and Pawar et al\.\([51](https://arxiv.org/html/2608.11354#bib.bib52)\)apply ToM to surface user intent from partial interaction sequences\. These results indicate that modeling why a user acts yields richer understanding than predicting what they do next, yet all operate in forward\-reasoning or single\-intent settings\. ### 2\.3\.Personalization for Adaptive and Spatial Interfaces Emerging interface paradigms, including generative UIs that compose layout and content dynamically\([70](https://arxiv.org/html/2608.11354#bib.bib60);[40](https://arxiv.org/html/2608.11354#bib.bib61)\)and XR environments that distribute content across the user’s visual field\([21](https://arxiv.org/html/2608.11354#bib.bib54)\), require the system to decide not only what to show but where, when, and how prominently, demanding richer user models than click histories alone can provide\. Current XR personalization relies predominantly on in\-session physiological and attentional signals such as gaze, head pose, RL\-driven placement, and affective biometrics\([13](https://arxiv.org/html/2608.11354#bib.bib55);[41](https://arxiv.org/html/2608.11354#bib.bib56);[44](https://arxiv.org/html/2608.11354#bib.bib58);[47](https://arxiv.org/html/2608.11354#bib.bib57)\)\. Li et al\.\([36](https://arxiv.org/html/2608.11354#bib.bib50)\)move toward deeper modeling by applying Belief\-Desire\-Intention reasoning to proactive AR assistance, though their BDI states are hand\-designed rather than inferred from data\. These methods are effective within a session but face severe cold\-start limitations\. A complementary strategy bootstraps personalization from data collected in established modalities; however, existing LLM\-based persona approaches\([49](https://arxiv.org/html/2608.11354#bib.bib37);[39](https://arxiv.org/html/2608.11354#bib.bib49);[8](https://arxiv.org/html/2608.11354#bib.bib42)\)construct personas from qualitative sources such as surveys or comments, rather than*inferring*them from behavioral traces\. ## 3\.Methodology ### 3\.1\.ToM\-Inspired User Modeling Bridging the gap between interaction\-based and persona\-based methods requires extracting the*rationale*behind each action\. This relies on*abductive belief inference*grounded in Theory of Mind \(ToM\)\. Rather than reasoning forward from beliefs to predict actions, we reason*backward*from observed actions to infer the beliefs that generated them, a form of inference to the best explanation\([2](https://arxiv.org/html/2608.11354#bib.bib18);[30](https://arxiv.org/html/2608.11354#bib.bib20)\)\. Three properties of ToM make it particularly suited to this task\. *Context\-dependence\.*ToM infers mental states from the relationship between an action and the alternatives available: a choice is only meaningful relative to what was*not*chosen, so reconstructing the decision context could help us extract the rationale behind an action\. *Semantic Structure*ToM decomposes user behavior into semantically meaningful primitives \(beliefs, desires, and intentions\) rather than a single opaque representation\. These primitives are compositional \(a user model is built up from many small, attributable statements\) and directly refer to mental states that could explain specific actions, giving downstream inference a structure that latent\-vector representations do not provide\. When serialized in natural language, as in our LLM instantiation, this representation additionally supports interpretable and auditable user profiles\. *Modality\-agnosticism\.*Because beliefs describe*why*a user acts rather than encoding interface\-specific patterns, they transfer across modalities without retraining\. A belief inferred from screen\-based browsing is equally actionable for a generative UI engine composing a personalized layout or a spatial XR interface arranging content in the user’s visual field\. *From beliefs to personas\.*While individual beliefs capture micro\-level decision rationales, they can be further synthesized into a structured*persona*, a portable cognitive profile of the user’s interests, values, and decision\-making style\. This synthesis performs a second layer of abductive inference, moving from “what did the user prefer?” to “what kind of person makes these choices?”\. The resulting persona could enable not only preference prediction but also explanation of past choices and adaptation to novel contexts where no interaction history exists\. Given these properties, we decompose user understanding into two explicit sub\-problems: \(i\)*percept reconstruction*of the decision context, and \(ii\)*abductive belief inference*from the observed choice within that context, followed by \(iii\)*persona synthesis*that integrates atomic beliefs into a coherent cognitive profile\. This inverse reasoning requires a flexible engine capable of processing unstructured interface content and performing causal, counterfactual judgments about human behavior, a form of everyday causal reasoning that LLMs have shown increasing competence in\([31](https://arxiv.org/html/2608.11354#bib.bib53);[65](https://arxiv.org/html/2608.11354#bib.bib27)\)\. We therefore use LLMs not as recommenders but as approximate inverse ToM reasoners, guided by structured prompts to produce evidence\-grounded and human\-readable belief statements\. LLM reasoning is nevertheless known to regress toward stereotypical priors and to vary across paraphrased prompts\([62](https://arxiv.org/html/2608.11354#bib.bib23);[72](https://arxiv.org/html/2608.11354#bib.bib25);[63](https://arxiv.org/html/2608.11354#bib.bib24);[65](https://arxiv.org/html/2608.11354#bib.bib27);[10](https://arxiv.org/html/2608.11354#bib.bib28)\); our pipeline mitigates these failure modes by two principles that recur across stages: 1\) grounding each inference in a reconstructed choice context rather than free\-form recall, and 2\) aggregating over multiple competing interpretations rather than committing to a single one\. ### 3\.2\.Problem Formulation LetTu=\{S1,…,SK\}T\_\{u\}=\\\{S\_\{1\},\\ldots,S\_\{K\}\\\}denote the interaction trace of useruuacrossKKsessions\. Each sessionSk=\(a1k,…,ankk\)S\_\{k\}=\(a\_\{1\}^\{k\},\\ldots,a\_\{n\_\{k\}\}^\{k\}\)is a time\-ordered sequence of interface actions, where each action aik=\(τi,𝑡𝑎𝑟𝑔𝑒𝑡i,𝑐𝑡𝑥i,ti\),a\_\{i\}^\{k\}=\(\\tau\_\{i\},\\;\\mathit\{target\}\_\{i\},\\;\\mathit\{ctx\}\_\{i\},\\;t\_\{i\}\),consists of an action typeτi∈\{click,input,scroll,nav,tab\}\\tau\_\{i\}\\in\\\{\\texttt\{click\},\\,\\texttt\{input\},\\,\\texttt\{scroll\},\\,\\texttt\{nav\},\\,\\texttt\{tab\}\\\}, a target element, contextual metadata, and a timestamp\. While we instantiate the pipeline on screen\-based web interactions, the formulation generalizes to any modality that produces event\-level action traces with associated interface context \(e\.g\., mouse clicks, finger taps, gaze selections and gesture inputs in XR, or component\-level interactions in generative UIs\)\. Our objective is to infer a belief setℬu=\{b1,…,bm\}\\mathcal\{B\}\_\{u\}=\\\{b\_\{1\},\\ldots,b\_\{m\}\\\}where eachbjb\_\{j\}is a natural language statement capturing a preference, trait, or intention, and to synthesize these beliefs into a structured personaΠu\\Pi\_\{u\}\. We state the*conceptual objective*as follows: \(1\)ℬu∗=argmaxℬP\(ℬ∣Tu\)\\mathcal\{B\}\_\{u\}^\{\*\}\\;=\\;\\argmax\_\{\\mathcal\{B\}\}\\;P\(\\mathcal\{B\}\\mid T\_\{u\}\)under a rational\-agent assumption: observed actions are explainable by the user’s beliefs given the decision context they perceived\. The persona is then obtained as \(2\)Πu=Synthesize\(ℬu∗\)\\Pi\_\{u\}\\;=\\;\\mathrm\{Synthesize\}\(\\mathcal\{B\}\_\{u\}^\{\*\}\)whereSynthesize\\mathrm\{Synthesize\}performs a second round of abductive inference, integrating atomic beliefs into a coherent cognitive profile of the user’s interests, values, and decision\-making style\. Given the personaΠu\\Pi\_\{u\}, downstream prediction reduces to conditional inference: for a task\-specific queryqq\(e\.g\., “rank these products by preference” or “predict Big Five trait scores”\), the system computes \(3\)y^=argmaxyP\(y∣q,Πu\)\\hat\{y\}\\;=\\;\\argmax\_\{y\}\\;P\(y\\mid q,\\,\\Pi\_\{u\}\)where the persona provides the contextual grounding that enables the model to reason about what the user would do, how they would think, and what they would prefer in a given situation, without requiring additional interaction data for each new task\. ##### Approximation strategy\. Equations 1–3 state inferential*objectives*; exact posterior computation over the space of natural\-language beliefs is intractable\. We instead adopt an*amortized approximate inference*strategy\([19](https://arxiv.org/html/2608.11354#bib.bib78);[67](https://arxiv.org/html/2608.11354#bib.bib79)\): an LLM pre\-trained on large\-scale text has internalized rich priors over human beliefs and decision\-making patterns\([6](https://arxiv.org/html/2608.11354#bib.bib80);[65](https://arxiv.org/html/2608.11354#bib.bib27)\); conditioned on a reconstructed decision context through structured prompts, it acts as an approximate inference engine that produces candidate beliefs without an explicit likelihood function or posterior computation\. Eq\. 1 can thus be approximated by conditioning the LLM on each decision context in the trace to generate candidate beliefs, which can then be refined for diversity and coverage\. Eq\. 2 can be approximated by prompting the LLM to synthesize the refined beliefs into a coherent persona, and Eq\. 3 can be realized by conditioning the LLM on the resulting persona for task\-specific queries\. The persona thus acts as an*approximate sufficient representation*: a lossy but task\-relevant compression of the full trace that decouples prediction from raw interaction data\. ### 3\.3\.Pipeline Overview The pipeline transforms raw interaction events into a structured user persona through five sequential stages: 1. \(1\)Summarize:Convert raw data into natural language sentences\. 2. \(2\)Perceive:Reconstruct the decision context, revealing what alternatives were visible on the page\. 3. \(3\)Infer:Perform backward belief inference at different levels\. 4. \(4\)Optimize:Deduplicate and select a diverse, compact belief set\. 5. \(5\)Synthesize:Compose beliefs into a structured persona\. ### 3\.4\.Stage 1: Action Summarization Raw interaction events contain type\-specific fields that are not directly interpretable\. This stage converts each action into a concise natural language summary, for example: Input:clickon “Cedar Wood \(Square Ceramic\)” color variant Output:“*User selected the ‘Cedar Wood \(Square Ceramic\)’ color option\.*” Structurally simple actions \(scroll, navigation, tab activation\) are summarized by deterministic rules, while complex actions \(click, input\) are summarized by an LLM that incorporates product details when present\. ### 3\.5\.Stage 2: Percept Reconstruction This stage addresses a key limitation of standard behavioral analysis: actions are recorded without the decision context in which they occurred\. A user’s selection is only informative relative to the alternatives they could perceive\. We reconstruct this context by analyzing the page content alongside the action summary\. For each action, we prompt an LLM with the action summary, a condensed version of the page HTML, and page metadata\. The LLM produces a structured*percept*containing: - •Main choices: Options highly relevant to the user’s action, representing the primary decision set\. - •Sub choices: Secondary alternatives that could have been picked\. - •Other choices: Available but irrelevant options on the page\. - •User choice: What the user actually did\. - •Perception description: A summary of the overall page environment and what the user likely encountered\. The three\-tier choice classification is central to our belief inference: main choices represent the “consideration set” from which the user selected, sub choices define the broader option space, and other choices provide contrast for what the user did*not*pursue\. Together, they form the decision context needed for inverse reasoning\. Example percept\(cart page\):Main:Air freshener variants, checkout\.Sub:Quantity adjustment, Subscribe & Save\.Other:Unrelated cart items\.User chose:Ocean Mist variant — “*view details for item in cart*\.” ### 3\.6\.Stage 3: Backward Belief Inference We consider this the core contribution of our work, which, to the best of our knowledge, little prior research has explored for personalization and recommendations\. Given the percept reconstruction from Stage 2 \(what the user saw, what they chose, what alternatives existed\), we perform*backward*reasoning to infer the beliefs that best explain the observed behavior\. We operate at two complementary levels\. #### 3\.6\.1\.Action\-Level Beliefs\. For each individual action, the LLM receives the complete percept, including action summary, user choice with rationale, all three tiers of available choices, and the perception description, and generates multiple candidate belief inferences \(1 sentence each\), representing different plausible interpretations of the same observed behavior\. Percept:Selected “Cashmere Vanilla \(Tassel Ceramic\)” among 8 scent/design variants\. Belief:“*Values subtle luxury and aesthetic harmony, choosing a decorative variant over simpler options\.*” Action\-level beliefs capture*micro\-signals*: specific product preferences, fine\-grained decision\-making traits, and individual action rationales\. #### 3\.6\.2\.Session\-Level Beliefs\. After processing all actions in a session, the LLM receives the full sequence of perceived items together with the action\-level belief hypotheses in temporal order and generates multiple candidate belief summaries \(each 1\-2 sentences\) covering the session as a whole\. Building upon the action\-level beliefs, the session\-level prompt treats them as competing candidate explanations and identifies which combination best fits the overall pattern\. Session:33 actions — searched for a specific bicycle tail light, compared handlebar tape colors/specs, read reviews\. Belief:“*Dedicated cyclist who prioritizes safety; research\-driven purchasing style with methodical comparison before selection\.*” Session\-level beliefs capture*macro\-patterns*: cross\-action consistency, temporal dynamics \(e\.g\., exploration narrowing into decision\), lifestyle signals \(e\.g\., product category mix\), and overall decision\-making style\. As session\-level inference processes dozens of actions at once and may dilute fine\-grained signals from individual decisions, action\-level beliefs preserve those micro\-signals which help capture the full picture\. #### 3\.6\.3\.Grounding and belief faithfulness\. Hallucination is constrained by construction that every belief is grounded in a reconstructed percept \(Stage 2\), must cite the chosen option and a rejected alternative from that percept \(Stage 3\), and is aggregated acrossMMcompeting hypotheses \(Stage 5\) so that single\-hypothesis fabrications are diluted rather than propagated\. ### 3\.7\.Stage 4: Belief Optimization Stages 1–3 produce a candidate belief set that is heavily redundant \(337–3,167 candidates in our evaluation\), with common, repetitive shopping\-action paraphrases\. We select a compact, diverse subset via Maximal Marginal Relevance \(MMR\)\([7](https://arxiv.org/html/2608.11354#bib.bib59)\)in two phases\. Phase 1: Deduplication and quality scoring\.Beliefs are embedded with a dense text encoder; near\-duplicate pairs \(cosine similarity\>θdedup\>\\theta\_\{\\mathrm\{dedup\}\}\) are collapsed, preferring session\-level beliefs\. Each survivor receives a quality scoreq\(b\)q\(b\)based primarily on its*outlier distance*from the embedding centroid, so that rare and distinctive beliefs score high and frequent shopping\-action paraphrases score low\. Phase 2: MMR iterative selection\.Starting from the highest\-scored belief, we iteratively select up toKKbeliefs by maximizing: \(4\)MMR\(b\)=λ⋅q\(b\)\+\(1−λ\)\(1−maxb′∈𝒮cos\(b,b′\)\)\\mathrm\{MMR\}\(b\)\\;=\\;\\lambda\\cdot q\(b\)\\;\+\\;\(1\-\\lambda\)\\Bigl\(1\-\\max\_\{b^\{\\prime\}\\in\\mathcal\{S\}\}\\;\\cos\(b,b^\{\\prime\}\)\\Bigr\)where𝒮\\mathcal\{S\}is the already\-selected set andλ=0\.3\\lambda=0\.3weights diversity at 70%, ensuring that once a topic is covered, remaining variants are penalized\. The output is a compact setℬu∗=\{b1,…,bK\}\\mathcal\{B\}\_\{u\}^\{\*\}=\\\{b\_\{1\},\\ldots,b\_\{K\}\\\}covering the user’s full behavioral range with minimal redundancy\. ### 3\.8\.Stage 5: Multi\-Hypothesis Persona Synthesis Atomic beliefs describe individual episodes; downstream tasks require a holistic view of the user\. However, the mapping from browsing behavior to personality is*under\-determined*, that the same pattern can arise from different personality types, and committing to a single interpretation risks defaulting to stereotypes\. Stage 5 therefore generatesMMdiverse*persona hypotheses*, each a distinct personality type that plausibly explains all observed behaviors\. The LLM receives the optimized belief set and is prompted to \(i\) separate observable facts from personality interpretations and \(ii\) consider whether the opposite trait extreme could equally explain the evidence\. Each hypothesis produces: - •Apersona profilewith interests, drives, values, and life context, all inferred abductively from the beliefs\. - •A structuredshopping profilelisting only product categories with direct evidence from the beliefs\. - •Per\-trait feature for personality, reflecting how well the behavioral evidence constrains each trait\. - •evidence confidence levels\(strong, moderate, or weak\), reflecting how well the behavioral evidence constrains each trait\. Hypotheses are ranked by quality and distinctiveness, and combined via confidence\-weighted aggregation\. For any scalar dimensiondd\(e\.g\., a Big Five trait or a Likert attitude item\), each hypothesishhindependently produces a scoresh,ds\_\{h,d\}; the final prediction is: \(5\)s^d=∑h=1Mwh⋅sh,d\+πd⋅αd∑h=1Mwh\+αd,\\hat\{s\}\_\{d\}=\\frac\{\\sum\_\{h=1\}^\{M\}w\_\{h\}\\cdot s\_\{h,d\}\+\\pi\_\{d\}\\cdot\\alpha\_\{d\}\}\{\\sum\_\{h=1\}^\{M\}w\_\{h\}\+\\alpha\_\{d\}\},wherewhw\_\{h\}combines hypothesis quality with per\-dimension evidence confidence,πd\\pi\_\{d\}is a published population prior for dimensiondd, andαd\\alpha\_\{d\}is an adaptive prior strength that scales inversely with mean evidence confidence across hypotheses\. When evidence is strong the prior vanishes and the hypotheses speak; when weak, predictions regress toward population means, mitigating the risk of overconfident stereotyping\. ## 4\.Experiments We evaluate the IToM pipeline on four complementary tasks, each posed as a research question \(RQ\) that isolates a different component of the pipeline: \(1\) next action prediction, testing whether inferred personas improve behavioral simulation compared to ground\-truth personas; \(2\) shopping category prediction, testing downstream predictive power on held\-out browsing sessions; \(3\) Big Five personality prediction, testing whether behavioral traces contain recoverable personality signal; and \(4\) shopping preference survey alignment, testing whether inferred personas capture self\-reported shopping attitudes\. RQ1 tests whether the synthesized persona \(Stage 5\) provides usable behavioral signal downstream; RQ2 tests generalization of the persona to unseen sessions; RQ3 \(with its §4\.5 ablation\) tests whether multi\-hypothesis aggregation matters; and RQ4 tests persona alignment with self\-reported attitudes\. ### 4\.1\.Dataset As our method essentially builds upon a quantitative\-to\-qualitative inference process, it imposes three simultaneous requirements on the evaluation data: \(i\)*fine\-grained interaction traces*\(clicks, scrolls, typed queries\), not just item\-level ratings; \(ii\)*rich decision context*\(page content, visible alternatives\) to reconstruct what the user perceived when acting; and \(iii\)*qualitative ground truth*\(personality assessments, attitudinal surveys, interview transcripts\) to verify the inferred qualitative output\. Most existing benchmarks satisfy at most one of these\. Widely used recommender datasets such as MIND\([79](https://arxiv.org/html/2608.11354#bib.bib73)\)and KuaiRec\([17](https://arxiv.org/html/2608.11354#bib.bib74)\)provide rich interaction logs but no psychological or attitudinal ground truth\. Conversely, personality\-oriented corpora such as PANDORA\([20](https://arxiv.org/html/2608.11354#bib.bib75)\)supply trait labels linked to text but not the atomic behavioral traces from which beliefs can be inferred\. To our knowledge, no benchmark prior to OPeRA jointly provides all three\. We therefore evaluate on the OPeRA dataset\([76](https://arxiv.org/html/2608.11354#bib.bib31)\), which jointly provides all three types of data: atomic\-level browser interaction traces with full page context \(HTML snapshots\) from Amazon shopping sessions, paired with per\-user personality assessments, shopping attitude surveys, and post\-session interview transcripts\. We use the OPeRA*train*split of 46 complete user profiles, personality and shopping surveys\. ### 4\.2\.Implementation Details All LLM calls use Claude Opus 4\.6 via AWS Bedrock\. Text embeddings use Amazon Titan Embed v2 \(1024 dimensions\)\. For belief optimization, we use MMR withλ=0\.3\\lambda=0\.3and deduplication thresholdθdedup=0\.85\\theta\_\{\\mathrm\{dedup\}\}=0\.85, selecting up toK=50K=50beliefs per user\. Multi\-hypothesis persona generation usesM=7M=7hypotheses with temperature 0\.85\. For personality and attitude inference, responses are predicted using the confidence\-weighted aggregation from Eq\.[5](https://arxiv.org/html/2608.11354#S3.E5)\(Section[3\.8](https://arxiv.org/html/2608.11354#S3.SS8)\), with population priors set to published Big Five norms\. Per\-user persona construction \(mean6\.36\.3sessions,∼\\sim275 actions\) requires∼\\sim622 LLM calls and∼\\sim14\.5M input /∼\\sim240K output tokens, amortizing to∼\\sim$79 per user on Claude Opus 4\.6 \(∼\\sim$47 on Sonnet 3\.7\) at AWS Bedrock pricing \(as of April 2026\)\. Construction is one\-time; the resulting natural\-language persona is reused across all downstream tasks with no per\-query re\-inference\. The pipeline is an unoptimized research implementation where Stage 2 \(percept reconstruction\) alone accounts for∼\\sim96% of input tokens, with no batching of same\-page actions, no cross\-user caching of layout templates, and no per\-action call consolidation\. ### 4\.3\.RQ1: Next Action Prediction ##### Setup\. We evaluate whether inferred personas can substitute for ground\-truth personas in the next action prediction task introduced by OPeRA\([76](https://arxiv.org/html/2608.11354#bib.bib31)\)\. Given the full sequence of session actions, we predict the next user action and evaluate along four dimensions following OPeRA: \(1\) action generation accuracy \(exact match of the predicted action\), \(2\) action type F1 over high\-level categories \(click, scroll, navigation, input, tab\), \(3\) click type F1 over specific click subtypes, and \(4\) session outcome prediction \(purchase vs\. terminate\)\. We compare three persona conditions: \(i\)*GT persona*, the ground\-truth persona assembled from OPeRA’s interview transcripts, demographics, personality profiles, and shopping rationale; \(ii\)*Multi\-hyp persona*, our IToM\-inferred persona \(best\-scored hypothesis from Stage 5\); and \(iii\)*No persona*, a control with no user context\. All conditions use the same session prefix and prompt template provided by the OPeRA paper\. We evaluate on two LLM backends: Claude Sonnet 3\.7 \(used in the original OPeRA evaluation\) and Claude Opus 4\.6\. Table 1\.Next action prediction \(15 users, 90 sessions, N=985 instances\)\. Act\. Gen\.: exact\-match accuracy of the full predicted action string; AT Wt / Mac\-F1: weighted and macro F1 over high\-level action categories \(click, scroll, input, etc\.\); Click Wt\-F1: weighted F1 over click subtypes; SO Acc / Wt\-F1: accuracy and weighted F1 for predicting session outcome \(purchase vs\. terminate\)\. Best results per\-model inbold\. ##### Results\. Table[1](https://arxiv.org/html/2608.11354#S4.T1)presents the results\. On Claude Opus 4\.6, our inferred persona substantially outperforms the ground\-truth persona on action generation accuracy \(25\.69% vs\. 17\.06%,\+\+50\.6% relative\), action type weighted F1 \(83\.90% vs\. 78\.20%\), and click type weighted F1 \(49\.78% vs\. 43\.16%\)\. Both persona conditions outperform the no\-persona baseline on action generation and action type F1, confirming that persona conditioning provides meaningful signal\. On Claude Sonnet 3\.7, our persona achieves higher action generation accuracy \(11\.78% vs\. 8\.83%\) and session outcome accuracy \(65\.56% vs\. 60\.00%\) while showing slightly lower action type F1\. Our Sonnet GT persona results are consistent with OPeRA’s published numbers, validating our reproduction\. OPeRA’s own analysis noted that persona conditioning does not consistently improve action generation accuracy and may introduce noise into step\-level reasoning, even if it helps action type and click type classification\([76](https://arxiv.org/html/2608.11354#bib.bib31)\)\. Our belief\-grounded personas partially mitigate this issue: on Claude Opus 4\.6, the inferred persona improves action generation \(\+\+50\.6% relative over GT\)*and*classification metrics simultaneously, suggesting that grounding personas in specific behavioral episodes rather than abstract trait summaries reduces the noise problem OPeRA identified\. ### 4\.4\.RQ2: Shopping Category Prediction ##### Setup\. To evaluate downstream predictive power, we test whether the persona can predict which product categories a user will shop for in held\-out sessions\. We use a 70/30 session holdout split: personas are constructed from 70% of each user’s sessions, and the remaining 30% provide ground truth\. Ground truth categories are extracted from held\-out search terms and product interactions, with LLM\-based reclassification into 11 canonical categories \(e\.g\., Health & Personal Care, Electronics & Technology, Home & Kitchen\)\. This yields 27 users with non\-empty holdout ground truth \(mean∼\{\\sim\}4 categories per user\)\. Table 2\.Shopping category prediction \(N=27\)\. Best inbold\. ##### Baselines\. We compare against two families of baselines \(Table[2](https://arxiv.org/html/2608.11354#S4.T2)\)\.*Heuristic*baselines operate on category co\-occurrence statistics from training sessions: Popularity predicts globally frequent categories, User History echoes per\-user training categories ranked by frequency, and Recency\-Weighted applies exponential decay to favor recent sessions\.*LLM\-based*baselines use the same backbone model \(Claude Opus 4\.6\) and identical raw session data, isolating the contribution of our belief\-inference and persona\-synthesis stages: 1\) Zero\-shot LLM directly prompts the model to predict categories from raw action logs\([27](https://arxiv.org/html/2608.11354#bib.bib12)\), 2\) Structured Summary first compresses sessions into browsing summaries before predicting\([11](https://arxiv.org/html/2608.11354#bib.bib81)\), and 3\) CoT Prompting adds explicit step\-by\-step reasoning over browsing patterns\([77](https://arxiv.org/html/2608.11354#bib.bib86)\)\. We omit neural sequential models\([32](https://arxiv.org/html/2608.11354#bib.bib7);[69](https://arxiv.org/html/2608.11354#bib.bib8);[26](https://arxiv.org/html/2608.11354#bib.bib6)\), as they require item\-ID interaction sequences and orders of magnitude more users for training\. OPeRA provides 27 users with atomic browsing traces \(clicks, scrolls, typed queries\) rather than item\-level interaction logs, making these architecturally inapplicable\. ##### Results\. Table[2](https://arxiv.org/html/2608.11354#S4.T2)presents the comparison\. Among heuristic baselines, Popularity achieves perfect recall by predicting all 11 categories but at low precision \(\.266\), while User History obtains the best heuristic F1 \(\.504\) through direct category overlap\. Among LLM baselines, adding prompt structure could possibly improve results: Zero\-shot LLM achieves the highest precision \(\.559\) but lowest recall \(\.500\), and CoT Prompting reaches the highest baseline F1 \(\.567\) and recall \(\.730\)\. Our multi\-hypothesis persona matches the best baseline F1 \(\.567\) and achieves NDCG@5 of \.701 \(\+\+6\.5% over CoT\) with Hit@3 of 100%\. ### 4\.5\.RQ3: Big Five Personality Prediction ##### Setup\. OPeRA provides self\-reported Big Five scores on a 1–5 scale \(Extremely Low to Extremely High\) for 46 users\. Each inference mode predicts Big Five trait scores from the persona; predictions are compared against ground truth via MAE and Pearsonrr\. ##### Baselines\. We compare against:*Random Uniform*\(randomly guess 1–5 per trait\),*Scale Midpoint*\(always predict 3\.0\),*Population Norms*\(published Big Five means: EX=3\.2, AG=3\.6, CO=3\.4, ES=3\.1, IN=3\.4\), and*GT Mean*\(per\-trait mean of all 46 users, an oracle baseline requiring access to the ground truth distribution\)\. ##### Results\. As shown in Table[3](https://arxiv.org/html/2608.11354#S4.T3)and Figure[1](https://arxiv.org/html/2608.11354#acmlabel1), our method achieves an overall MAE of 0\.762, outperforming all non\-oracle baselines including population norms \(0\.836,−\-8\.8% relative improvement\) and closing 88% of the gap from random guessing to the oracle mean\. Four of five traits show positive Pearson correlations with ground truth, with Extraversion approaching significance \(r=\+0\.280r\{=\}\+0\.280,p=0\.060p\{=\}0\.060\)\. Multi\-hypothesis aggregation shifts the aggregate correlation into the positive range on this fixed cohort \(bootstrap 95% CI\[−0\.05,\+0\.26\]\[\-0\.05,\\,\+0\.26\];N=46N\{=\}46, dataset\-given\), reversing the negative aggregate of single\-interpretation baselines\. We therefore scope RQ3 as a*population\-level*claim about the direction of LLM persona bias and its correction; per\-trait tests are underpowered at this sample size\. Table 3\.Big Five MAE comparison \(N=46\)\. Our multi\-hypothesis method outperforms all non\-oracle baselines\. ##### Ablation: Why multi\-hypothesis reasoning matters\. A key question is whether the multi\-hypothesis aggregation contributes beyond what simpler inference strategies achieve\. We compare against two established approaches from the LLM personality literature, applied to the*same*persona profiles: \(i\)*Direct inference*, where the LLM reads a single persona and directly estimates trait scores\([74](https://arxiv.org/html/2608.11354#bib.bib66);[29](https://arxiv.org/html/2608.11354#bib.bib68)\); and \(ii\)*Questionnaire administration*, where the LLM role\-plays as the persona and answers standardized personality items individually\([15](https://arxiv.org/html/2608.11354#bib.bib63);[52](https://arxiv.org/html/2608.11354#bib.bib65);[5](https://arxiv.org/html/2608.11354#bib.bib64)\)\. Both approaches have been shown to produce reasonable personality profiles when LLMs role\-play from explicit trait descriptions\([74](https://arxiv.org/html/2608.11354#bib.bib66);[50](https://arxiv.org/html/2608.11354#bib.bib67)\); here we test them on behaviorally\-inferred personas where trait levels are*not*given\. Table[4](https://arxiv.org/html/2608.11354#S4.T4)shows our results that single\-interpretation methods produce*negative*average Pearson correlations with ground truth \(−\-0\.103 for questionnaire,−\-0\.008 for direct inference\), meaning their predictions are*anti\-correlated*with actual personality\. Both methods achieve MAE==0\.945, worse than simply predicting published population norms for every user \(0\.836\)\. Our multi\-hypothesis method reverses the average correlation from−0\.103\-0\.103\(Direct Inference\) and−0\.008\-0\.008\(Questionnaire\) to\+0\.103\+0\.103, a qualitative shift from systematically wrong to directionally correct, and cuts MAE from0\.9450\.945\(both unaided\-LLM baselines\) to0\.7620\.762\. Population Norms \(0\.8360\.836\) is an informed prior of published Big Five means, not an unaided\-LLM comparison\. See Figure[1](https://arxiv.org/html/2608.11354#acmlabel1)for per\-trait statistics between our method and ground\-truth\. Table 4\.Ablation: inference method comparison \(N=46\)\. All methods use identical persona profiles\. Single\-interpretation baselines from the LLM personality literature produce anti\-correlated predictions; multi\-hypothesis aggregation reverses the sign\.We term this negative correlation as*persona bias*: the LLM maps ambiguous behavioral evidence to stereotypical personality profiles, producing overconfident predictions that are*worse than knowing nothing*\. We analyze this phenomenon further in the Discussion\. Figure 1\.Big Five personality prediction results \(N=46\)\. Mean trait scores comparing self\-reported ground truth \(survey\) against our multi\-hypothesis IToM predictions\. Per\-trait MAE, Pearson correlation \(rr\), andpp\-values are shown alongside each trait\.Grouped bar chart comparing self\-reported Big Five trait scores \(ground\-truth survey\) against our multi\-hypothesis IToM predictions across 46 users, for the five traits: Openness, Conscientiousness, Extraversion, Agreeableness, and Emotional Stability\. For each trait, two bars show the mean ground\-truth score and the mean predicted score on a 1\-to\-5 scale, with per\-trait mean absolute error, Pearson correlation $r$, and $p$\-value annotated next to the bar pair\. ### 4\.6\.RQ4: Shopping Preference Survey Alignment ##### Setup\. OPeRA includes 12 Likert shopping attitude items per user \(1=Strongly Disagree to 5=Strongly Agree\), covering research habits, price sensitivity, brand preference, and decision\-making style\. We treat these as a structured questionnaire: the LLM infers how the persona would respond to each item, and predicted responses are compared numerically against ground truth\. Per\-item accuracy is computed asacci=1−\|yi−y^i\|/4\\mathrm\{acc\}\_\{i\}=1\-\|y\_\{i\}\-\\hat\{y\}\_\{i\}\|/4, normalizing Likert distance to\[0,1\]\[0,1\]\. ##### Results\. Our method achieves 76\.6% normalized accuracy \(MAE = 0\.937 on a 1–5 Likert scale, N==46\), outperforming both single\-interpretation ablation baselines: direct inference \(71\.9%\) and LLM\-administered questionnaire \(72\.5%\)\.111Direct inference asks the LLM to predict all survey responses from the best persona hypothesis in a single call; the questionnaire mode administers items individually with the LLM role\-playing as the persona\([15](https://arxiv.org/html/2608.11354#bib.bib63);[52](https://arxiv.org/html/2608.11354#bib.bib65)\)\. Figure[2](https://arxiv.org/html/2608.11354#S4.F2)shows per\-item accuracy\. Several items \(e\.g\., “I usually do a lot of research before making a purchase”\) exceed 0\.85 accuracy, demonstrating that the persona captures genuine shopping attitude signal across diverse dimensions, from research habits to price sensitivity to decision confidence\. Figure 2\.Per\-item shopping attitude accuracy \(N=46\)\. Our multi\-hypothesis method achieves the highest accuracy on 10 of 12 items compared to single\-interpretation ablations\.Grouped horizontal bar chart showing per\-item shopping attitude accuracy for direct inference, questionnaire, and multi\-hypothesis modes\. ### 4\.7\.Discussion ##### Inferred personas match or exceed ground\-truth personas\. The action prediction results \(Table[1](https://arxiv.org/html/2608.11354#S4.T1)\) show that personas inferred purely from behavioral traces achieve competitive or higher scores than ground\-truth personas assembled from interviews, demographics, and personality assessments on most prediction metrics \(\+\+50\.6% relative action generation accuracy on Claude Opus 4\.6\)\. This advantage reflects a representational\-format difference as much as a user\-modeling depth difference: GT personas are abstract trait summaries that anchor the model to a fixed characterization\([33](https://arxiv.org/html/2608.11354#bib.bib76)\), while our belief\-grounded personas encode specific decision episodes that translate more directly into step\-level prediction without imposing a rigid role frame\. This result should be read as evidence that our episode\-encoding format is usable at inference time, not that inferred personas understand the user better than GT personas in an absolute sense: the\+\+50\.6% margin may partly reflect prompt\-format alignment with the action\-prediction task, and a format\-controlled comparison \(rewriting GT personas into episode style, ablating episodic content from inferred personas\) is left to future work\. The value of the inferred pipeline is not that it beats GT in absolute score, but that it \(a\) removes the qualitative\-data collection bottleneck \(interviews, demographics, personality assessments\) that makes GT personas impractical in production, and \(b\) yields an interpretable, auditable natural\-language artifact supporting downstream tasks that raw click\-stream data cannot\. ##### Persona bias and multi\-hypothesis reasoning\. The ablation \(Table[4](https://arxiv.org/html/2608.11354#S4.T4)\) reveals what we term*persona bias*: single\-interpretation methods map ambiguous behavioral evidence to stereotypical personality profiles \(e\.g\., interpreting every careful shopper as an anxious introvert\), producing predictions*anti\-correlated*with ground truth\([5](https://arxiv.org/html/2608.11354#bib.bib64);[29](https://arxiv.org/html/2608.11354#bib.bib68)\)\. This bias is especially severe for behaviorally inferred personas where trait levels are uncertain\. Multi\-hypothesis reasoning reverses the correlation sign \(negative→\\topositive\) by generatingMMdiverse hypotheses with per\-trait evidence confidence and adaptively weighting toward population priors when evidence is weak, providing a “floor guarantee” against persona bias\. The underlying mechanism is the*situational*nature of online shopping: users settle for “good enough” options under time pressure, get distracted by promotions, and make choices they might not replicate an hour later due to situational variability and mood swings\([64](https://arxiv.org/html/2608.11354#bib.bib77)\)\. A single interpretation forces one coherent story onto inherently noisy actions; multiple hypotheses allow the weight of evidence to point in roughly the right direction without requiring every single hypothesis to be entirely correct\. ##### The role and limits of personality in behavioral modeling\. Our results suggest that personality, as captured by standardized instruments like the Big Five, may be more useful for explaining broad attitudinal tendencies than for predicting specific actions\. The shopping preference survey \(76\.6% accuracy\) aligns well with inferred personas, likely because survey items ask about general dispositions that map naturally onto personality dimensions\. In contrast, traits like Emotional Stability are systematically misread from browsing cues, and even well\-calibrated traits \(e\.g\., Conscientiousness\) show compressed prediction variance, suggesting the pipeline captures population\-level tendencies better than individual extremes\. This is perhaps unsurprising: a user’s decision to compare three products before purchasing reflects not only trait\-level conscientiousness but also situational factors, domain expertise, price sensitivity, and personal values that personality inventories were never designed to capture\([73](https://arxiv.org/html/2608.11354#bib.bib62)\)\. Personality may thus serve better as a*soft prior*that anchors attitudinal inference than as a direct predictor of behavior, where the richer, episode\-grounded belief representation carries more of the explanatory weight\. ## 5\.Case Study: Persona\-Driven Spatial Interface The experiments above show that IToM\-inferred personas capture meaningful behavioral and attitudinal signal\. We now present a case study showing how the same persona expressed in natural language can drive a different modality\. We illustrate this transferability with a proof\-of\-concept spatial banking application built on Apple VisionOS due to the substantial discrepancy between traditional web interfaces and spatial user interfaces\. Application\.The prototype is a spatial banking app whose layout is fully persona\-driven: each user sees a structurally different interface \(Figure[3](https://arxiv.org/html/2608.11354#acmlabel3)\)\. The interface comprises three spatial panels, each defined by its*function*rather than fixed content: a*center stage*for primary tasks \(account management, shopping offers\); a*left panel*for financial health tools \(credit journey, budgeting, transfers\); and a*right panel*for product discovery \(credit cards, transaction history\)\. The persona determines*what*appears in each panel and*how*they are arranged \(e\.g\., a budget\-conscious user sees spending breakdowns and savings trackers prominently, while an investment\-oriented user sees portfolio summaries and market alerts\)\. Users can also rearrange, add, or dismiss widgets—interactions that feed back into belief inference, iteratively refining the persona and subsequent layout adaptations\. Persona as cross\-modal bridge\.Shopping category predictions \(RQ4\) map directly to center\-stage offer selection, while broader persona fields \(life context, values, motivational drives\) inform which financial tools and products to surface and how prominently to position them\. The persona is used as natural\-language context in a task\-specific prompt, following the same pattern validated in our experiments\. This case study implementation serves as initial evidence of two transfer axes that interaction\-based methods cannot easily address:*modality transfer*, where beliefs from 2D click streams inform 3D spatial layout; and*task transfer*, where shopping browsing behavior drives financial product suggestions and widget prioritization, a distinct application with no shared behavioral signal yet informed by the persona’s cognitive profile\. This opens opportunities to address cold\-start challenges in emerging application domains where data is scarce\. Figure 3\.Persona\-driven spatial banking prototype on VisionOS\. The left and right panels contain different widgets placed in different positions and order, while the center stage surfaces different offers, all determined by the user’s inferred persona constructed from 2D browsing data \(All logos and brand names shown are fictitious and for illustrative purposes only\. Any resemblance to real trademarks or companies is coincidental; no affiliation or endorsement is implied\.\)A screenshot of a persona\-driven spatial banking application on Apple VisionOS, showing a multi\-panel 3D interface\. The interface presents common banking widgets, credit score, spending details, savings, together with persona\-adapted content including merchant offers and recommended banking products\. ## 6\.Conclusion We presented an Inverse Theory of Mind pipeline that reasons backward from observed interaction traces to infer the beliefs, intentions, and decision\-making traits that explain user behavior, producing structured natural\-language personas that capture not only*what*a user prefers but*who*they are\. Evaluated on 46 OPeRA users, the pipeline achieves 76\.6% shopping attitude accuracy, reduces Big Five MAE below an informed population\-norms prior \(0\.7620\.762vs\.0\.8360\.836\), corrects the sign of the average trait correlation relative to unaided\-LLM baselines, and predicts held\-out shopping categories with Hit@3==100%\. Without our multi\-hypothesis reasoning, single\-interpretation baselines produce predictions*anti\-correlated*with ground truth, while aggregating across diverse persona hypotheses reverses the correlation sign\. Because the resulting personas are expressed in natural language rather than interface\-specific embeddings, they transfer directly to generative UI engines or spatial XR interfaces without retraining, supporting content*creation*, not just selection\. Limitations and future work\.Evaluation is bounded by a single domain \(Amazon shopping\) and moderate sample size \(N=46N\{=\}46for personality\)\. Prediction variance is compressed, indicating well\-calibrated means but limited differentiation at user extremes\. Emotional Stability is anti\-predicted due to systematic LLM bias that adaptive priors only partially mitigate\. The XR case study is illustrative; a controlled study comparing persona\-driven layouts against a non\-personalized baseline on task completion, subjective preference, and offer relevance is left to future work\. Future work will extend to multi\-domain traces, larger populations, end\-to\-end personalization in spatial and generative interfaces, and calibration methods for improved per\-user differentiation\. These limitations largely stem from the limited availability of public datasets that provide rich interaction traces, environmental context, and user traits\. Our work sheds light on user modeling through the IToM framework and opens new opportunities for future research on data\-efficient, generalizable, and personalized interactive systems\. ## Disclaimer This paper was prepared for informational purposes by the Global Technology Applied Research and Consumer & Community Banking of JPMorgan Chase & Co\. This paper is not a product of the Research Department of JPMorgan Chase & Co\. or its affiliates\. Neither JPMorgan Chase & Co\. nor any of its affiliates makes any explicit or implied representation or warranty and none of them accept any liability in connection with this paper, including, without limitation, with respect to the completeness, accuracy, or reliability of the information contained herein and the potential legal, compliance, tax, or accounting effects thereof\. This document is not intended as investment research or investment advice, or as a recommendation, offer, or solicitation for the purchase or sale of any security, financial instrument, financial product or service, or to be used in any way for evaluating the merits of participating in any transaction\. ## References - Bakeret al\.\(2017\)C\. L\. Baker, J\. Jara\-Ettinger, R\. Saxe, and J\. B\. TenenbaumRational quantitative attribution of beliefs, desires and percepts in human mentalizing\.Nature Human Behaviour1,pp\. 0064\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Bakeret al\.\(2009\)C\. L\. Baker, R\. Saxe, and J\. B\. TenenbaumAction understanding as inverse planning\.Cognition113\(3\),pp\. 329–349\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p2.1)\. - Baoet al\.\(2023\)K\. Bao, J\. Zhang, Y\. Zhang, W\. Wang, F\. Feng, and X\. HeTALLRec: an effective and efficient tuning framework to align large language model with recommendation\.InProceedings of the 17th ACM Conference on Recommender Systems,pp\. 1007–1014\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Baron\-Cohenet al\.\(1985\)S\. Baron\-Cohen, A\. M\. Leslie, and U\. FrithDoes the autistic child have a “theory of mind”?\.Cognition21\(1\),pp\. 37–46\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Bhandariet al\.\(2025\)P\. Bhandari, U\. Naseem, A\. Datta, N\. Fay, and M\. NasimEvaluating personality traits in large language models: insights from psychological questionnaires\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 868–872\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1),[§4\.7](https://arxiv.org/html/2608.11354#S4.SS7.SSS0.Px2.p1.1)\. - Binz and Schulz \(2023\)M\. Binz and E\. SchulzTurning large language models into cognitive models\.arXiv preprint arXiv:2306\.03917\.Cited by:[§3\.2](https://arxiv.org/html/2608.11354#S3.SS2.SSS0.Px1.p1.1)\. - Carbonell and Goldstein \(1998\)J\. Carbonell and J\. GoldsteinThe use of MMR, diversity\-based reranking for reordering documents and producing summaries\.InProceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval,pp\. 335–336\.Cited by:[§3\.7](https://arxiv.org/html/2608.11354#S3.SS7.p1.1)\. - Chenet al\.\(2025\)S\. Chen, J\. P\. Lalor, Y\. Yang, and A\. AbbasiPersonaTwin: a multi\-tier prompt conditioning framework for generating and evaluating personalized digital twins\.InProceedings of the Fourth Workshop on Generation, Evaluation, and Metrics,Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p4.1),[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Chenet al\.\(2020\)X\. Chen, L\. Yao, A\. Sun, X\. Wang, X\. Xu, and L\. ZhuGenerative inverse deep reinforcement learning for online recommendation\.arXiv preprint arXiv:2011\.02248\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p3.1)\. - Chenet al\.\(2024\)Z\. Chen, J\. Wu, J\. Zhou, B\. Wen, G\. Bi, G\. Jiang, Y\. Cao, M\. Hu, Y\. Lai, Z\. Xiong,et al\.ToMBench: benchmarking theory of mind in large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics,pp\. 14507–14532\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1)\. - Christakopoulouet al\.\(2023\)K\. Christakopoulou, A\. Lalama, C\. Adams, I\. Qu, T\. Aber, D\. Azzato, S\. Biber, S\. Buchner, K\. Bui, M\. Byon,et al\.Large language models for user interest journeys\.arXiv preprint arXiv:2305\.15498\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1),[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1),[Table 2](https://arxiv.org/html/2608.11354#S4.T2.4.1.6.1)\. - Chuklinet al\.\(2015\)A\. Chuklin, I\. Markov, and M\. de RijkeClick models for web search\.Synthesis Lectures on Information Concepts, Retrieval, and Services,Morgan & Claypool Publishers\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Clayet al\.\(2019\)V\. Clay, P\. König, and S\. U\. KönigEye tracking in virtual reality\.Journal of Eye Movement Research12\(1\)\.Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Crosset al\.\(2024\)L\. Cross, V\. Xiang, A\. Bhatia, D\. L\. K\. Yamins, and N\. HaberHypothetical minds: scaffolding theory of mind for multi\-agent tasks with large language models\.arXiv preprint arXiv:2407\.07086\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - de Winteret al\.\(2024\)J\. C\. F\. de Winter, T\. Driessen, and D\. DodouThe use of ChatGPT for personality research: administering questionnaires using generated personas\.Personality and Individual Differences225,pp\. 112669\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1),[Table 4](https://arxiv.org/html/2608.11354#S4.T4.2.2.1.1),[footnote 1](https://arxiv.org/html/2608.11354#footnote1)\. - Fenget al\.\(2020\)S\. Feng, L\. V\. Tran, G\. Cong, L\. Chen, J\. Li, and F\. LiHME: A hyperbolic metric embedding approach for next\-poi recommendation\.InProceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25\-30, 2020,pp\. 1429–1438\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Gaoet al\.\(2022\)C\. Gao, S\. Li, W\. Lei, J\. Chen, B\. Li, P\. Jiang, X\. He, J\. Mao, and T\. ChuaKuaiRec: a fully\-observed dataset and insights for evaluating recommender systems\.InProceedings of the 31st ACM International Conference on Information and Knowledge Management,pp\. 540–550\.Cited by:[§4\.1](https://arxiv.org/html/2608.11354#S4.SS1.p1.1)\. - Genget al\.\(2022\)S\. Geng, S\. Liu, Z\. Fu, Y\. Ge, and Y\. ZhangRecommendation as language processing \(RLP\): a unified pretrain, personalized prompt & predict paradigm \(P5\)\.InProceedings of the 16th ACM Conference on Recommender Systems,pp\. 299–315\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Gershman and Goodman \(2014\)S\. J\. Gershman and N\. D\. GoodmanAmortized inference in probabilistic reasoning\.Proceedings of the Annual Meeting of the Cognitive Science Society36\.Cited by:[§3\.2](https://arxiv.org/html/2608.11354#S3.SS2.SSS0.Px1.p1.1)\. - Gjurkovićet al\.\(2021\)M\. Gjurković, M\. Karan, I\. Vukojević, M\. Bošnjak, and J\. ŠnajderPANDORA talks: personality and demographics on Reddit\.InProceedings of the Ninth International Workshop on Natural Language Processing for Social Media,pp\. 138–152\.Cited by:[§4\.1](https://arxiv.org/html/2608.11354#S4.SS1.p1.1)\. - Grubertet al\.\(2017\)J\. Grubert, T\. Langlotz, S\. Zollmann, and H\. RegenbrechtTowards pervasive augmented reality: context\-awareness in augmented reality\.IEEE Transactions on Visualization and Computer Graphics23\(6\),pp\. 1706–1724\.Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Guoet al\.\(2019\)H\. Guo, J\. Yu, Q\. Liu, R\. Tang, and Y\. ZhangBuying or browsing?: predicting real\-time purchasing intent using attention\-based deep network with multiple behavior\.InProceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining,pp\. 1984–1992\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Guoet al\.\(2025\)W\. Guo, Y\. Lu, Y\. Li, J\. Yang, Y\. Tan, X\. Zhang, M\. Chen, J\. Zhang, Z\. Su, W\. Zhang, Y\. Chen, B\. Zheng, and R\. TangLONGER: scaling up long sequence modeling in industrial recommenders\.arXiv preprint arXiv:2504\.12561\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Heet al\.\(2017\)X\. He, L\. Liao, H\. Zhang, L\. Nie, X\. Hu, and T\. ChuaNeural collaborative filtering\.InProceedings of the 26th International Conference on World Wide Web,pp\. 173–182\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1)\. - Heet al\.\(2023\)Z\. He, Z\. Xie, R\. Jha, H\. Steck, D\. Liang, Y\. Feng, B\. P\. Majumder, N\. Kallus, and J\. McAuleyLarge language models as zero\-shot conversational recommenders\.InProceedings of the 32nd ACM International Conference on Information and Knowledge Management,pp\. 720–730\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Hidasiet al\.\(2016\)B\. Hidasi, A\. Karatzoglou, L\. Baltrunas, and D\. TikkSession\-based recommendations with recurrent neural networks\.InProceedings of the 4th International Conference on Learning Representations,Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1),[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1)\. - Houet al\.\(2024\)Y\. Hou, J\. Zhang, Z\. Lin, H\. Lu, R\. Xie, J\. McAuley, and W\. X\. ZhaoLarge language models are zero\-shot rankers for recommender systems\.InProceedings of the 46th European Conference on Information Retrieval,pp\. 364–381\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1),[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1),[Table 2](https://arxiv.org/html/2608.11354#S4.T2.4.1.5.1)\. - Huet al\.\(2008\)Y\. Hu, Y\. Koren, and C\. VolinskyCollaborative filtering for implicit feedback datasets\.InProceedings of the 8th IEEE International Conference on Data Mining,pp\. 263–272\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Huanget al\.\(2026\)M\. Huang, X\. Zhang, C\. Soto, and J\. EvansDesigning AI\-agents with personalities: a psychometric approach\.Personality Science\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1),[§4\.7](https://arxiv.org/html/2608.11354#S4.SS7.SSS0.Px2.p1.1)\. - Jara\-Ettinger \(2019\)J\. Jara\-EttingerTheory of mind as inverse reinforcement learning\.Current Opinion in Behavioral Sciences29,pp\. 105–110\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p2.1)\. - Joshiet al\.\(2024\)A\. Joshi, A\. Ahmad, and A\. ModiCOLD: causal reasOning in cLosed Daily activities\.InAdvances in Neural Information Processing Systems,Vol\.37\.Cited by:[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1)\. - Kang and McAuley \(2018\)W\. Kang and J\. McAuleySelf\-attentive sequential recommendation\.InProceedings of the IEEE International Conference on Data Mining,pp\. 197–206\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1),[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1)\. - Kimet al\.\(2025\)J\. Kim, N\. Yang, and K\. JungPersona is a double\-edged sword: rethinking the impact of role\-play prompts in zero\-shot reasoning tasks\.InFindings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia\-Pacific Chapter of the Association for Computational Linguistics,pp\. 848–862\.Cited by:[§4\.7](https://arxiv.org/html/2608.11354#S4.SS7.SSS0.Px1.p1.1)\. - Korenet al\.\(2009\)Y\. Koren, R\. Bell, and C\. VolinskyMatrix factorization techniques for recommender systems\.Computer42\(8\),pp\. 30–37\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Kosinski \(2024\)M\. KosinskiEvaluating large language models in theory of mind tasks\.Proceedings of the National Academy of Sciences121\(45\),pp\. e2405460121\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1)\. - Liet al\.\(2025a\)C\. Li, G\. Wu, G\. Y\. Chan, D\. Turakhia, S\. Castelo Quispe, and D\. LiSatori: towards proactive AR assistant with belief\-desire\-intention user modeling\.InProceedings of the 2025 CHI Conference on Human Factors in Computing Systems,pp\. 1–24\.External Links:[Document](https://dx.doi.org/10.1145/3706598.3714188)Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Liet al\.\(2023\)H\. Li, Y\. Chong, S\. Stepputtis, J\. Campbell, D\. Hughes, C\. Lewis, and S\. RamamoorthyTheory of mind for multi\-agent collaboration via large language models\.InProceedings of the 2023 Conference on Empirical Methods in Natural Language Processing,pp\. 180–192\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Liet al\.\(2017\)J\. Li, P\. Ren, Z\. Chen, Z\. Ren, T\. Lian, and J\. MaNeural attentive session\-based recommendation\.InProceedings of the 2017 ACM on Conference on Information and Knowledge Management,pp\. 1419–1428\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Liet al\.\(2025b\)R\. Li, H\. Xia, X\. Yuan, Q\. Dong, L\. Sha, Z\. Li, and Z\. LiuHow far are LLMs from being our digital twins? a benchmark for persona\-based behavior chain simulation\.InFindings of the Association for Computational Linguistics: ACL 2025,Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p4.1),[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Liet al\.\(2024\)Y\. Li, H\. Hao, Y\. Ge, H\. Yu, and Y\. LiuPersonal LLM agents: insights and survey about the capability, efficiency and security\.arXiv preprint arXiv:2401\.05459\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Lindlbaueret al\.\(2019\)D\. Lindlbauer, A\. M\. Feit, and O\. HilligesContext\-aware online adaptation of mixed reality interfaces\.InProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology,pp\. 147–160\.Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Liuet al\.\(2025\)T\. Liu, Y\. Xu, J\. Yang, and K\. LiMindful machines: understanding how AI’s theory of mind capabilities influence consumer response to product recommendations\.Psychology & Marketing\.External Links:[Document](https://dx.doi.org/10.1002/mar.70022)Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1)\. - Loet al\.\(2016\)C\. Lo, D\. Frankowski, and J\. LeskovecUnderstanding the relationship between browsing and purchasing in a large\-scale E\-commerce site\.InProceedings of the 25th ACM International on Conference on Information and Knowledge Management,pp\. 2421–2426\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Luet al\.\(2024\)F\. Lu, M\. Chen, H\. Hsu, P\. Deshpande, C\. Y\. Wang, and B\. MacIntyreAdaptive 3D UI placement in mixed reality using deep reinforcement learning\.InExtended Abstracts of the CHI Conference on Human Factors in Computing Systems,pp\. 1–7\.External Links:[Document](https://dx.doi.org/10.1145/3613905.3651059)Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Lyuet al\.\(2023\)H\. Lyu, S\. Jiang, H\. Zeng, Y\. Xia, Q\. Wang, S\. Zhang, R\. Chen, C\. Leung, J\. Tang, and J\. LuoLLM\-Rec: personalized recommendation via prompting large language models\.arXiv preprint arXiv:2307\.15780\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Maoet al\.\(2024\)Y\. Mao, S\. Liu, Q\. Ni, X\. Lin, and L\. HeA review on machine theory of mind\.IEEE Transactions on Neural Networks and Learning Systems\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Marchioriet al\.\(2018\)E\. Marchiori, E\. Niforatos, and L\. PretoAnalysis of users’ heart rate data and self\-reported perceptions to understand effective virtual reality characteristics\.Information Technology & Tourism18,pp\. 133–155\.Cited by:[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Mysoreet al\.\(2024\)S\. Mysore, Z\. Lu, M\. Wan, T\. Safavi, J\. Metzler, J\. McAuley, and H\. ZamaniPEARL: personalizing large language model writing assistants via extraction and retrieval of user profiles\.InFindings of the Association for Computational Linguistics: ACL 2024,Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Parket al\.\(2023\)J\. S\. Park, J\. C\. O’Brien, C\. J\. Cai, M\. R\. Morris, P\. Liang, and M\. S\. BernsteinGenerative agents: interactive simulacra of human behavior\.InProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology,pp\. 1–22\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p4.1),[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Parket al\.\(2024\)J\. S\. Park, C\. Q\. Zou, A\. Shaw, B\. M\. Hill, C\. Cai, M\. R\. Morris, and M\. S\. BernsteinGenerative agent simulations of 1,000 people\.arXiv preprint arXiv:2411\.10109\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1)\. - Pawaret al\.\(2025\)S\. V\. Pawar, B\. Pedapudi, and P\. KaushikEARL: early intent recognition in GUI tasks using theory of mind\.InICML 2025 Workshop on Foundation Models in the Wild,External Links:[Link](https://openreview.net/forum?id=nABg9kZ7JR)Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1)\. - Pellertet al\.\(2024\)M\. Pellert, C\. M\. Lechner, C\. Wagner, B\. Rammstedt, and M\. StrohmaierAI psychometrics: assessing the psychological profiles of large language models through psychometric inventories\.Perspectives on Psychological Science19\(5\),pp\. 808–826\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1),[footnote 1](https://arxiv.org/html/2608.11354#footnote1)\. - Peysakhovich \(2019\)A\. PeysakhovichReinforcement learning and inverse reinforcement learning with system 1 and system 2\.InProceedings of the AAAI/ACM Conference on AI, Ethics, and Society,pp\. 409–415\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p3.1)\. - Premack and Woodruff \(1978\)D\. Premack and G\. WoodruffDoes the chimpanzee have a theory of mind?\.Behavioral and Brain Sciences1\(4\),pp\. 515–526\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p3.1),[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Rabinowitzet al\.\(2018\)N\. C\. Rabinowitz, F\. Perbet, H\. F\. Song, C\. Zhang, S\. M\. A\. Eslami, and M\. BotvinickMachine theory of mind\.InProceedings of the 35th International Conference on Machine Learning,pp\. 4218–4227\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Radlinskiet al\.\(2022\)F\. Radlinski, K\. Balog, B\. Byrne, and K\. KrishnamoorthiOn natural language user profiles for transparent and scrutable recommendation\.InProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval \(SIGIR ’22\),pp\. 2863–2874\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Rajputet al\.\(2023\)S\. Rajput, N\. Mehta, A\. Singh, R\. H\. Keshavan, T\. Vu, L\. Heldt, L\. Hong, Y\. Tay, V\. Q\. Tran, J\. Saber, M\. Zaheer, E\. H\. Chi, and J\. ShlensRecommender systems with generative retrieval\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Ramírez and Geffner \(2010\)M\. Ramírez and H\. GeffnerProbabilistic plan recognition using off\-the\-shelf classical planners\.InProceedings of the AAAI Conference on Artificial Intelligence,pp\. 1121–1126\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Ramoset al\.\(2024\)J\. Ramos, H\. A\. Rahmani, X\. Wang, X\. Fu, and A\. LipaniTransparent and scrutable recommendations using natural language user profiles\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(ACL ’24\),Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Rendleet al\.\(2009\)S\. Rendle, C\. Freudenthaler, Z\. Gantner, and L\. Schmidt\-ThiemeBPR: Bayesian personalized ranking from implicit feedback\.InProceedings of the Twenty\-Fifth Conference on Uncertainty in Artificial Intelligence,pp\. 452–461\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Richardson and Srinivasan \(2024\)A\. Richardson and H\. SrinivasanUser\-LLM: efficient LLM contextualization with user embeddings\.arXiv preprint arXiv:2402\.13598\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Sapet al\.\(2022\)M\. Sap, R\. LeBras, D\. Fried, and Y\. ChoiNeural theory\-of\-mind? On the limits of social intelligence in large LMs\.InProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing,pp\. 3762–3780\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1)\. - Shapiraet al\.\(2024\)N\. Shapira, M\. Levy, S\. H\. Alavi, X\. Zhou, Y\. Choi, Y\. Goldberg, M\. Sap, and V\. ShwartzClever hans or neural theory of mind? Stress testing social reasoning in large language models\.InProceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics,pp\. 2257–2273\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1)\. - Simon \(1955\)H\. A\. SimonA behavioral model of rational choice\.The Quarterly Journal of Economics69\(1\),pp\. 99–118\.Cited by:[§4\.7](https://arxiv.org/html/2608.11354#S4.SS7.SSS0.Px2.p1.1)\. - Strachanet al\.\(2024\)J\. W\. A\. Strachan, D\. Parga Pelaéz, G\. W\. Humphreys, M\. Thiebaut de Schotten, and G\. BaggioTesting theory of mind in large language models and humans\.Nature Human Behaviour8,pp\. 1285–1295\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1),[§3\.2](https://arxiv.org/html/2608.11354#S3.SS2.SSS0.Px1.p1.1)\. - Streetet al\.\(2024\)W\. Street, J\. O\. Siy, G\. Keeling, A\. Baranes, B\. Barnett, M\. McKibben, T\. Kanyere, A\. Lentz, B\. Aguera y Arcas, and R\. MoranLLMs achieve adult human performance on higher\-order theory of mind tasks\.arXiv preprint arXiv:2405\.18870\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1)\. - Stuhlmülleret al\.\(2013\)A\. Stuhlmüller, J\. Taylor, and N\. D\. GoodmanLearning stochastic inverses\.InAdvances in Neural Information Processing Systems,Vol\.26\.Cited by:[§3\.2](https://arxiv.org/html/2608.11354#S3.SS2.SSS0.Px1.p1.1)\. - Sukthankaret al\.\(2014\)G\. Sukthankar, C\. Geib, H\. H\. Bui, D\. Pynadath, and R\. P\. GoldmanPlan, activity, and intent recognition: theory and practice\.Morgan Kaufmann\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Sunet al\.\(2019\)F\. Sun, J\. Liu, J\. Wu, C\. Pei, X\. Lin, W\. Ou, and P\. JiangBERT4Rec: sequential recommendation with bidirectional encoder representations from transformers\.InProceedings of the 28th ACM International Conference on Information and Knowledge Management,pp\. 1441–1450\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1),[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1)\. - Swearnginet al\.\(2018\)A\. Swearngin, M\. Dontcheva, W\. Li, J\. Brandt, M\. Dixon, and A\. J\. KoRewire: interface design assistance from examples\.InProceedings of the 2018 CHI Conference on Human Factors in Computing Systems,pp\. 1–12\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.3](https://arxiv.org/html/2608.11354#S2.SS3.p1.1)\. - Tranet al\.\(2020\)L\. V\. Tran, Y\. Tay, S\. Zhang, G\. Cong, and X\. LiHyperML: A boosting metric learning approach in hyperbolic space for recommender systems\.InWSDM ’20: The Thirteenth ACM International Conference on Web Search and Data Mining, Houston, TX, USA, February 3\-7, 2020,pp\. 609–617\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Ullman \(2023\)T\. UllmanLarge language models fail on trivial alterations to theory\-of\-mind tasks\.arXiv preprint arXiv:2302\.08399\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p2.1),[§3\.1](https://arxiv.org/html/2608.11354#S3.SS1.p7.1)\. - Vazire and Mehl \(2008\)S\. Vazire and M\. R\. MehlKnowing me, knowing you: the accuracy and unique predictive validity of self\-ratings and other\-ratings of daily behavior\.Journal of Personality and Social Psychology95\(5\),pp\. 1202–1216\.Cited by:[§4\.7](https://arxiv.org/html/2608.11354#S4.SS7.SSS0.Px3.p1.1)\. - Wanget al\.\(2025a\)Y\. Wang, J\. Zhao, D\. S\. Ones, L\. He, and X\. XuEvaluating the ability of large language models to emulate personality\.Scientific Reports15,pp\. 1–15\.Cited by:[§4\.5](https://arxiv.org/html/2608.11354#S4.SS5.SSS0.Px4.p1.1),[Table 4](https://arxiv.org/html/2608.11354#S4.T4.2.3.1.1)\. - Wanget al\.\(2023\)Z\. Wang, X\. Chen, R\. Zhou, Q\. Dai, Z\. Dong, and J\. WenSequential recommendation with causal behavior discovery\.InProceedings of the IEEE International Conference on Data Engineering \(ICDE\),pp\. 1849–1862\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p3.1)\. - Wanget al\.\(2025b\)Z\. Wang, Y\. Lu, W\. Li, A\. Amini, B\. Sun, Y\. Bart, W\. Lyu, J\. Gesi, T\. Wang, J\. Huang, Y\. Su, U\. Ehsan, M\. Alikhani, T\. J\. Li, L\. Chilton, and D\. WangOPeRA: a dataset of observation, persona, rationale, and action for evaluating LLMs on human online shopping behavior simulation\.arXiv preprint arXiv:2506\.05606\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.11354#S4.SS1.p2.1),[§4\.3](https://arxiv.org/html/2608.11354#S4.SS3.SSS0.Px1.p1.1),[§4\.3](https://arxiv.org/html/2608.11354#S4.SS3.SSS0.Px2.p2.1)\. - Weiet al\.\(2022\)J\. Wei, X\. Wang, D\. Schuurmans, M\. Bosma, B\. Ichter, F\. Xia, E\. Chi, Q\. V\. Le, and D\. ZhouChain\-of\-thought prompting elicits reasoning in large language models\.Advances in Neural Information Processing Systems35,pp\. 24824–24837\.Cited by:[§4\.4](https://arxiv.org/html/2608.11354#S4.SS4.SSS0.Px2.p1.1),[Table 2](https://arxiv.org/html/2608.11354#S4.T2.4.1.7.1)\. - Wellman \(2014\)H\. M\. WellmanMaking minds: how theory of mind develops\.Oxford University Press\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p3.1)\. - Wuet al\.\(2020\)F\. Wu, Y\. Qiao, J\. Chen, C\. Wu, T\. Qi, J\. Lian, D\. Liu, X\. Xie, J\. Gao, W\. Wu, and M\. ZhouMIND: a large\-scale dataset for news recommendation\.InProceedings of the 58th Annual Meeting of the Association for Computational Linguistics,pp\. 3597–3606\.Cited by:[§4\.1](https://arxiv.org/html/2608.11354#S4.SS1.p1.1)\. - Wuet al\.\(2023\)H\. Wu, P\. Sequeira, and D\. V\. PynadathMultiagent inverse reinforcement learning via theory of mind reasoning\.arXiv preprint arXiv:2302\.10238\.Cited by:[§2\.2](https://arxiv.org/html/2608.11354#S2.SS2.p1.1)\. - Wuet al\.\(2024\)L\. Wu, Z\. Zheng, Z\. Qiu, H\. Wang, H\. Gu, T\. Shen, C\. Qin, C\. Zhu, H\. Zhu, Q\. Liu, H\. Xiong, and E\. ChenA survey on large language models for recommendation\.World Wide Web27\(5\),pp\. 60\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p1.1)\. - Wuet al\.\(2019\)S\. Wu, Y\. Tang, Y\. Zhu, L\. Wang, X\. Xie, and T\. TanSession\-based recommendation with graph neural networks\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.33,pp\. 346–353\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Zhanget al\.\(2024\)A\. Zhang, Y\. Chen, L\. Sheng, X\. Wang, and T\. ChuaOn generative agents in recommendation\.InProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval,pp\. 1807–1817\.External Links:[Document](https://dx.doi.org/10.1145/3626772.3657844)Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§1](https://arxiv.org/html/2608.11354#S1.p4.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p4.1)\. - Zhanget al\.\(2023\)J\. Zhang, R\. Xie, Y\. Hou, W\. X\. Zhao, L\. Lin, and J\. WenRecommendation as instruction following: a large language model empowered recommendation approach\.arXiv preprint arXiv:2305\.07001\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Zhanget al\.\(2025\)Y\. Zhang, J\. Gesi, R\. Xue, T\. Wang, Z\. Wang, Y\. Lu, S\. Zhan, H\. Zeng, Q\. Cui, Y\. Guo, J\. Huang, M\. Shah, and D\. WangSee, think, act: online shopper behavior simulation with VLM agents\.arXiv preprint arXiv:2510\.19245\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p4.1)\. - Zhaoet al\.\(2025\)M\. Zhao, Y\. Gao, Y\. Hou, X\. Li, P\. Gu, Z\. Dong, R\. Tang, and Y\. CaiMTRec: learning to align with user preferences via mental reward models\.InAdvances in Neural Information Processing Systems,Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p3.1)\. - Zhenget al\.\(2024\)B\. Zheng, Y\. Hou, H\. Lu, Z\. Chen, W\. X\. Zhao, and J\. WenAdapting large language models by integrating collaborative semantics for recommendation\.InProceedings of the IEEE 40th International Conference on Data Engineering,pp\. 1–14\.Cited by:[§1](https://arxiv.org/html/2608.11354#S1.p2.1),[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\. - Zhuet al\.\(2024\)Y\. Zhu, L\. Wu, Q\. Guo, L\. Hong, and J\. LiCollaborative large language model for recommender systems\.InProceedings of the ACM Web Conference 2024,pp\. 3162–3172\.Cited by:[§2\.1](https://arxiv.org/html/2608.11354#S2.SS1.p1.1)\.
相似文章
行动中的心智理论:动态人-智能体协作中的指令推理任务
本文引入指令推理任务,用于评估LLM智能体在处理不完整或模糊指令的人-智能体协作中的心智理论能力。作者呈现了Tomcat(一个LLM智能体),在GPT-4o、DeepSeek-R1和Gemma-3-27B上进行测试,展现出与人类参与者相当的推理未言明意图的性能。
超越视觉思维链:内化视觉思维的主动视频推理
本文介绍了内化视觉思维(IVT),一个后训练框架,该框架训练多模态模型预测未来帧嵌入,从而无需合成中间图像即可直接生成答案,将主动视频推理的延迟降低5倍以上。
Agent-ToM: 通过心智理论推理学习监控自主LLM智能体
提出 Agent-ToM,一种基于心智理论推理的学习监控框架,通过推断信念和意图来检测自主LLM智能体中的隐蔽恶意行为,性能优于基线监控器。
OSCToM: RL引导的对抗生成用于高阶心智理论
本文提出OSCToM,一种RL引导的方法,用于生成对抗数据以测试LLM中的嵌套信念冲突,在FANToM等基准上改进了心智理论推理。
心智理论提升是否真的有益于人机交互?来自交互评估的实证发现
本文针对大语言模型的心智理论能力提出了一种新的交互评估范式,发现静态基准测试上的提升并不能转化为动态人机交互中的更好表现,凸显了基于交互评估的必要性。