Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation

arXiv cs.CL Papers

Summary

阿里提出 MARI 框架,通过决策记忆库(DMB)存储结构化决策记忆(SDM),将异构用户行为蒸馏为可解释的目标、约束和权衡记录,以增强 LLM 推荐系统的推理能力,显著优于现有基线,尤其在困难选择预测任务上表现突出。

arXiv:2610.11501v1 Announce Type: new Abstract: Despite the adoption of large language models (LLMs) in recommendation systems, prevailing approaches mostly model single-type behaviors (e.g., views or purchases). Even when incorporating multiple behaviors, existing methods flatten heterogeneous actions into homogeneous token sequences, ignoring their distinct decision-making roles. This flattening fails to capture semantic hierarchies and contextual nuances in complex decision-making, such as trade-offs between price and quality. Consequently, performance degrades in critical ``difficult-choice'' scenarios involving highly similar items. To bridge this gap, we propose MARI (Memory-Augmented Recommendation with Interpretability), which grounds predictions in explicit, structured decision evidence. MARI maintains a Decision Memory Bank (DMB) that archives users' past rationales as Structured Decision Memories (SDMs): concise records of goals, constraints, and trade-offs. These SDMs are generated offline via Post-Hoc Decision Distillation from heterogeneous behaviors and user-generated content. By retrieving relevant SDMs to augment LLM reasoning, MARI achieves interpretability and scalability without the prohibitive cost of processing long raw sequences. Extensive experiments show MARI significantly outperforms state-of-the-art baselines on standard next-item prediction and a newly introduced Difficult Choice Prediction task, incurring low latency overhead by decoupling memory construction from online inference. Qualitative analyses reveal actionable, human-readable insights into user decision-making, marking a concrete step toward reasoning-aware recommendation systems.
Original Article
View Cached Full Text

Cached at: 10/09/26, 06:59 AM

# Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation
Source: [https://arxiv.org/html/2610.11501](https://arxiv.org/html/2610.11501)
Leikun Liang\*, Guoshuai Wang\*, Xingsheng He†, Yushan Han, Yunyi Xuan, Xiaoxiao Xu, Lin Qu††thanks:\* Equal contribution, †Corresponding author\.Affiliation:Alibaba Group Hangzhou, China \{liangleikun\.llk, guoshui\.wgs, xingsheng\.hxs, hanyushan\.hys, xuanyunyi\.xyy, xiaoxiao\.xuxx\}@alibaba\-inc\.com \{xide\.ql\}@taobao\.com

###### Abstract

Despite the adoption of large language models \(LLMs\) in recommendation systems, prevailing approaches mostly model single\-type behaviors \(e\.g\., views or purchases\)\. Even when incorporating multiple behaviors, existing methods flatten heterogeneous actions into homogeneous token sequences, ignoring their distinct decision\-making roles\. This flattening fails to capture semantic hierarchies and contextual nuances in complex decision\-making, such as trade\-offs between price and quality\. Consequently, performance degrades in critical “difficult\-choice” scenarios involving highly similar items\. To bridge this gap, we propose MARI \(Memory\-Augmented Recommendation with Interpretability\), which grounds predictions in explicit, structured decision evidence\. MARI maintains a Decision Memory Bank \(DMB\) that archives users’ past rationales as Structured Decision Memories \(SDMs\): concise records of goals, constraints, and trade\-offs\. These SDMs are generated offline via Post\-Hoc Decision Distillation from heterogeneous behaviors and user\-generated content\. By retrieving relevant SDMs to augment LLM reasoning, MARI achieves interpretability and scalability without the prohibitive cost of processing long raw sequences\. Extensive experiments show MARI significantly outperforms state\-of\-the\-art baselines on standard next\-item prediction and a newly introduced Difficult Choice Prediction task, incurring low latency overhead by decoupling memory construction from online inference\. Qualitative analyses reveal actionable, human\-readable insights into user decision\-making, marking a concrete step toward reasoning\-aware recommendation systems\.

###### Index Terms:

LLM\-based Recommendation, Structured Decision Memory, Interpretable Recommendation, Multi\-behavior Modeling

## IIntroduction

![Refer to caption](https://arxiv.org/html/2610.11501v1/MARI_new_v6.png)Fig\. 1:Workflow comparison\.Top:Directly feeding long raw behavior sequences into an LLM introduces context limits, noise, and latent decision factors, hindering accurate reasoning\.Bottom:MARI retrieves Structured Decision Memories \(SDMs\) from a Decision Memory Bank \(DMB\) based on recent behaviors\. Augmenting the LLM with these explicit rationales \(goals, constraints, trade\-offs\) enables interpretable, grounded reasoning and improves recommendation accuracy\.Integrating Large Language Models \(LLMs\) into recommender systems enables semantic user modeling by treating interaction sequences as contextual inputs\. Current research predominantly serializes single\-type interactions \(e\.g\., ratings or purchases\) into long textual prompts\[[1](https://arxiv.org/html/2610.11501#bib.bib11),[2](https://arxiv.org/html/2610.11501#bib.bib12),[3](https://arxiv.org/html/2610.11501#bib.bib14),[4](https://arxiv.org/html/2610.11501#bib.bib13)\]\. However, these sequences are costly to process and contain substantial redundancy and behavioral noise\. While single\-behavior datasets \(e\.g\., Amazon\[[5](https://arxiv.org/html/2610.11501#bib.bib25)\]\) have advanced the field, they overlook a critical real\-world challenge: understanding the complex decision logic derived from heterogeneous, multi\-behavior interactions \(e\.g\., search, view, favorite, purchase\) fundamental to e\-commerce and streaming platforms\.

Traditional multi\-behavior models\[[6](https://arxiv.org/html/2610.11501#bib.bib20),[7](https://arxiv.org/html/2610.11501#bib.bib31),[8](https://arxiv.org/html/2610.11501#bib.bib33),[9](https://arxiv.org/html/2610.11501#bib.bib34),[10](https://arxiv.org/html/2610.11501#bib.bib35)\]rely on implicit, opaque embeddings that lack the reasoning and interpretability strengths of LLMs\. Consequently, the powerful inferential capabilities of LLMs remain underutilized for reconstructing user decision\-making processes\. Existing LLM\-based recommenders either restrict themselves to single\-behavior data or flatten multi\-behavior logs into homogeneous sequences, losing the distinct semantic roles and hierarchical structures of different actions\. Thus, the LLM revolution in recommendation has largely overlooked the rich decision signals woven across diverse behavioral contexts\.

To bridge this gap, we propose an LLM\-powered framework that explicitly reconstructs and leverages users’ historical decision logic through a Decision Memory Bank \(DMB\), an interpretable repository of structured decision rationales\. Our work is motivated by a key observation from industrial data: users’ final decisions, especially when choosing between highly similar items \(i\.e\., difficult\-choice scenarios at the SKU level\), reflect consistent patterns encoding their underlying criteria \(e\.g\., prioritizing “organic” over “budget”\)\. Because these latent patterns are distributed across multi\-behavior trajectories, directly feeding raw sequences to LLMs is inefficient; it introduces noise and forces on\-the\-fly decision reconstruction under tight context constraints, a limitation visually demonstrated in the top workflow of Figure[1](https://arxiv.org/html/2610.11501#S1.F1)\. In contrast, our two\-stage approach \(Figure[1](https://arxiv.org/html/2610.11501#S1.F1), bottom\) constructs the DMB, where each entry is a Structured Decision Memory \(SDM\), a concise textual record of a user’s goals, constraints, and trade\-offs\. We devise Post\-Hoc Decision Distillation \(PHDD\), which uses an LLM as a retrospective analyst to generate SDMs by examining final outcomes within heterogeneous behavioral contexts\. This transforms noisy logs into explicit decision evidence\. Second, we introduce MARI \(Memory\-Augmented Recommendation with Interpretability\), a plug\-and\-play framework that retrieves relevant SDMs to ground LLM reasoning in explicit historical logic\. This design cleanly separates offline knowledge construction from online recommendation, enabling robust, interpretable inference without significant latency overhead\.

Our contributions are threefold:

- •Fine\-Grained SKU\-Level Recommendation:We reformulate LLM\-based recommendation as a SKU\-level task, leveraging heterogeneous behaviors to reason over near\-identical items\. This effectively addresses difficult\-choice scenarios with nuanced attribute differences, which are typically overlooked by title\-level approaches\.
- •Decision Memory Bank via Retrospective Distillation:We introduce the DMB, a compact archive of human\-readable Structured Decision Memories \(SDMs\)\. Distilled via our Post\-Hoc Decision Distillation \(PHDD\) method, each SDM encodes a user’s goals, constraints, and trade\-offs from heterogeneous trajectories\.
- •Effective Memory\-Augmented Recommendation Architecture:We design a modular framework integrating the DMB via Retrieval\-Augmented Generation \(RAG\) to enable interpretable reasoning grounded in historical logic\. MARI achieves significant performance gains over state\-of\-the\-art baselines in offline evaluations on a real\-world e\-commerce platform, demonstrating practical efficacy and scalability\.

## IIRelated Work

### II\-ALLM\-based Recommendation

Large Language Models \(LLMs\) have enabled semantic user modeling in recommendation, moving beyond ID\-based collaborative filtering\[[11](https://arxiv.org/html/2610.11501#bib.bib4),[12](https://arxiv.org/html/2610.11501#bib.bib1),[13](https://arxiv.org/html/2610.11501#bib.bib2),[14](https://arxiv.org/html/2610.11501#bib.bib5),[15](https://arxiv.org/html/2610.11501#bib.bib7),[16](https://arxiv.org/html/2610.11501#bib.bib3)\]\. Existing approaches fall into three categories: \(1\) feature enhancement, where LLMs enrich embeddings with textual semantics\[[17](https://arxiv.org/html/2610.11501#bib.bib8),[18](https://arxiv.org/html/2610.11501#bib.bib9)\]; \(2\) end\-to\-end recommendation, where LLMs are prompted or tuned to predict preferences directly\[[1](https://arxiv.org/html/2610.11501#bib.bib11),[2](https://arxiv.org/html/2610.11501#bib.bib12),[3](https://arxiv.org/html/2610.11501#bib.bib14),[4](https://arxiv.org/html/2610.11501#bib.bib13)\]; and \(3\) behavior compression and summary, where lengthy user histories are compressed into compact representations or summarized into semantic profiles to address context\-length limitations\[[19](https://arxiv.org/html/2610.11501#bib.bib15),[20](https://arxiv.org/html/2610.11501#bib.bib16),[21](https://arxiv.org/html/2610.11501#bib.bib17)\]\. However, these methods either perform preference inference and summarization based on a single type of user behavior, or incorporate multiple behaviors only as semantically impoverished IDs, failing to account for their distinct roles in the decision\-making process\. A\-LLMRec\[[3](https://arxiv.org/html/2610.11501#bib.bib14)\]and LLM\-SRec\[[4](https://arxiv.org/html/2610.11501#bib.bib13)\]align collaborative filtering signals with the LLM’s token space to inject collaborative awareness but operate on a single type of interaction, thus lacking the capacity to model cross\-behavior decision dynamics; while User\-LLM\[[19](https://arxiv.org/html/2610.11501#bib.bib15)\]compresses multiple behaviors into fixed\-size vectors, obscuring transitions between action types\. While converting raw behavior streams into semantic summaries effectively mitigates context\-length and sparsity issues\[[20](https://arxiv.org/html/2610.11501#bib.bib16),[21](https://arxiv.org/html/2610.11501#bib.bib17)\], these remain shallow abstractions that reflect what users did, not why they decided\. More fundamentally, static global summaries aggregate cross\-category preferences, losing the context\-dependent trade\-offs essential for SKU\-level difficult choices\. We instead conditionally retrieve structured decision rationales to preserve this specificity without aggregation loss\.

### II\-BMulti\-Behavior Recommendation

Multi\-behavior recommendation leverages heterogeneous interactions to mitigate data sparsity\. While early work extends matrix factorization\[[22](https://arxiv.org/html/2610.11501#bib.bib26)\]or designs behavior\-aware sampling\[[23](https://arxiv.org/html/2610.11501#bib.bib27),[24](https://arxiv.org/html/2610.11501#bib.bib28)\], recent deep models use attention\[[25](https://arxiv.org/html/2610.11501#bib.bib29),[26](https://arxiv.org/html/2610.11501#bib.bib30)\]or graph convolutions to fuse multi\-behavior signals\[[6](https://arxiv.org/html/2610.11501#bib.bib20),[7](https://arxiv.org/html/2610.11501#bib.bib31),[8](https://arxiv.org/html/2610.11501#bib.bib33),[9](https://arxiv.org/html/2610.11501#bib.bib34),[10](https://arxiv.org/html/2610.11501#bib.bib35)\]\. Yet all produce opaque embeddings that capture statistical correlations without revealing the decision intent behind behavior transitions\. Moreover, they ignore rich item textual attributes—such as price, brand, and product descriptions—that could ground user choices in semantic evidence\. Recent LLM\-based approaches often concatenate heterogeneous actions into flat sequences\[[27](https://arxiv.org/html/2610.11501#bib.bib10)\], failing to capture the decision\-level meanings that different behavior types convey in the user’s choice process\. Critically, both lines predict next actions rather than modeling the decision logic behind behavior transitions—they capture statistical patterns \(e\.g\., “view X → purchase Y”\) but miss the underlying goals \(e\.g\., seeking premium brands\) or constraints \(e\.g\., limited budget\)\. We address this by using LLMs to retrospectively distill explicit decision rationales from trajectories, enabling recommendations grounded in interpretable evidence\.

### II\-CRetrieval\-Augmented Recommendation

Retrieval\-Augmented Generation \(RAG\)\[[28](https://arxiv.org/html/2610.11501#bib.bib36)\]reduces hallucination by grounding LLMs in external knowledge\. In recommendation, methods like CoRAL\[[29](https://arxiv.org/html/2610.11501#bib.bib18)\]and RETURN\[[30](https://arxiv.org/html/2610.11501#bib.bib32)\]retrieve collaborative signals \(e\.g\., co\-purchases\) to support long\-tail reasoning\. However, they retrieve only atomic interactions \(“what users did”\) without capturing the underlying decision logic \(“why they decided”\)\. Unlike these approaches—which aim to improve item prediction by retrieving behavioral or item\-level evidence—our framework targets the reconstruction of interpretable decision rationales from multi\-behavior trajectories\. We argue that effective multi\-behavior reasoning requires retrieving decision patterns, not just behavior logs\. Our Decision Memory Bank \(DMB\) stores Structured Decision Memories \(SDMs\)—concise records of context, rationale, and outcome—so that RAG can retrieve historically grounded, trade\-off\-aware decision evidence instead of surface\-level co\-occurrences\.

## IIIPreliminary

Let𝒰\\mathcal\{U\}andℐ\\mathcal\{I\}denote the sets of users and items, respectively\. For a useru∈𝒰u\\in\\mathcal\{U\}, we observe a historical heterogeneous interaction sequence:

ℋu=\{\(it,at,τt\)\}t=1Tu,\\mathcal\{H\}\_\{u\}=\\left\\\{\(i\_\{t\},a\_\{t\},\\tau\_\{t\}\)\\right\\\}\_\{t=1\}^\{T\_\{u\}\},\(1\)whereit∈ℐi\_\{t\}\\in\\mathcal\{I\}is the interacted item \(associated with rich attributes and metadata\),at∈𝒜a\_\{t\}\\in\\mathcal\{A\}is the associated behavior type \(e\.g\.,𝒜=\{view,search,favorite,purchase\}\\mathcal\{A\}=\\\{\\text\{view\},\\text\{search\},\\text\{favorite\},\\text\{purchase\}\\\}\) andτt\\tau\_\{t\}is the timestamp\. Interactions are chronologically ordered \(τ1<τ2<⋯<τTu\\tau\_\{1\}<\\tau\_\{2\}<\\cdots<\\tau\_\{T\_\{u\}\}\)\. Notably, items inℐ\\mathcal\{I\}are defined at the SKU level—distinct attribute combinations \(e\.g\., color or size\) yield distinct items, even with identical titles\. An example is given in Appendix[\-A](https://arxiv.org/html/2610.11501#A0.SS1)\.

In real\-world recommendation scenarios, users typically exhibit multiple types of behavior before making a final decision \(e\.g\., purchase\)\. Critically, these heterogeneous behaviors encode complementary signals about the user’s underlying intent—such as exploration \(search/view\), preference expression \(favorite\), and commitment \(purchase\)\. However, directly modelingℋu\\mathcal\{H\}\_\{u\}as a flat token sequence overlooks the semantic hierarchy among action types and fails to reconstruct the high\-level decision logic that governs user choices\. To systematically evaluate a model’s capacity to overcome this limitation and capture such latent decision logic, we formalize two complementary prediction tasks that reflect different levels of recommendation difficulty and intent granularity\.

### III\-ATask 1: Next\-Item Prediction \(NIP\)

Given the full historical sequenceℋu\\mathcal\{H\}\_\{u\}and a recent short\-term context𝒞u⊆ℋu\\mathcal\{C\}\_\{u\}\\subseteq\\mathcal\{H\}\_\{u\}\(e\.g\., the lastkkinteractions\), the goal is to predict the next item the user will purchase\. In practice, a purchased item always appears earlier in𝒞u\\mathcal\{C\}\_\{u\}through non\-purchase interactions \(e\.g\., view or search\)\. Thus, NIP requires the model to identify the specific item within𝒞u\\mathcal\{C\}\_\{u\}that will eventually be purchased\. This task assesses the model’s capacity to identify the next purchase from the full item set using the user’s heterogeneous interaction history\.

### III\-BTask 2: Difficult Choice Prediction \(DCP\)

This task simulates realistic “difficult\-choice” scenarios where users compare highly similar alternatives \(e\.g\., products with near\-identical specifications but differing in price, brand, or minor features\)\. Formally, givenℋu\\mathcal\{H\}\_\{u\}, a recent context𝒞u\\mathcal\{C\}\_\{u\}, and a candidate set𝒳⊂ℐ\\mathcal\{X\}\\subset\\mathcal\{I\}ofmmitems with high pairwise similarity, the goal is to predict which item in𝒳\\mathcal\{X\}the user will purchase next\. Unlike NIP, DCP isolates the ability to resolve fine\-grained user preferences by restricting candidate items to highly substitutable sets, thereby directly testing a model’s capacity to infer subtle trade\-offs—such as “willingness to pay more for organic certification”—from past decisions\.

### III\-CKey Challenge and Our Approach

Fig\. 2:Effect of input sequence length on Hit@1 for NIP and DCP tasks \(using DeepSeek\-R1\)\.Both NIP and DCP require distilling latent decision logic—such as goals, constraints, and attribute\-level trade\-offs—from the noisy heterogeneous sequenceℋu\\mathcal\{H\}\_\{u\}, rather than relying on surface\-level patterns\. However, as shown in Figure[2](https://arxiv.org/html/2610.11501#S3.F2), our experiments with DeepSeek\-R1\[[31](https://arxiv.org/html/2610.11501#bib.bib23)\]show that simply extending the input context yields diminishing returns: performance peaks at around 100 historical interactions and degrades with longer sequences, suggesting that raw behavior logs overwhelm LLMs with noise rather than useful signals\.

To address this, we propose a personalized Decision Memory Bank \(DMB\) that stores Structured Decision Memories \(SDMs\), generated via Post\-Hoc Decision Distillation \(PHDD\) as concise, interpretable summaries of past decisions\. Building on DMB, we design MARI \(Memory\-Augmented Recommendation with Interpretability\), which retrieves relevant SDMs during inference to ground the LLM’s reasoning about𝒞u\\mathcal\{C\}\_\{u\}in explicit decision logic\. Formal details follow\.

## IVMethodology

![Refer to caption](https://arxiv.org/html/2610.11501v1/MARI_FLOW_v5.png)Fig\. 3:Algorithmic framework of MARI\. The offline stage constructs DMB via PHDD; during online inference, MARI retrieves relevant SDMs and fuses them to prompt the LLM for interpretable recommendation\.We present MARI, a two\-stage framework that decouples decision knowledge construction from on\-the\-fly recommendation reasoning\. As illustrated in Figure[3](https://arxiv.org/html/2610.11501#S4.F3), MARI first builds a personalized DMB for each user via Post\-Hoc Decision Distillation \(PHDD\), then leverages retrieval\-augmented generation to inject relevant decision memories into an LLM\-based recommender during inference\. Below we detail the DMB construction pipeline and the MARI inference architecture for both NIP and DCP tasks\.

### IV\-ADecision Memory Bank \(DMB\)

#### IV\-A1Category\-Aware

While some decision tendencies \(e\.g\., cost\-effectiveness\) generalize across categories, purchase logic is largely category\-specific: “Organic certification” matters for baby food but not electronics, whereas “512GB storage” drives electronics choices but not food purchases\. Flattening cross\-category interactions dilutes these discriminative, category\-conditioned rules\. To preserve fidelity, we build the DMB in a category\-aware manner, with each entry encoding the structured rationale behind a user’s purchase in categoryc∈𝒞c\\in\\mathcal\{C\}\.

#### IV\-A2Formal definition

For useruu, the Decision Memory Bank is defined as a set of structured records:

DMBu=⋃c∈𝒞\{\(𝐞u,c\(j\),ℳu,c\(j\),τu,c\(j\)\)\}j=1Ju,c\\text\{DMB\}\_\{u\}=\\bigcup\_\{c\\in\\mathcal\{C\}\}\\left\\\{\\left\(\\mathbf\{e\}\_\{u,c\}^\{\(j\)\},\\mathcal\{M\}\_\{u,c\}^\{\(j\)\},\\tau\_\{u,c\}^\{\(j\)\}\\right\)\\right\\\}\_\{j=1\}^\{J\_\{u,c\}\}\(2\)whereJu,cJ\_\{u,c\}is the number of purchases useruumade in categorycc;τu,c\(j\)\\tau\_\{u,c\}^\{\(j\)\}is the timestamp of thejj\-th purchase;𝐞u,c\(j\)∈ℝd\\mathbf\{e\}\_\{u,c\}^\{\(j\)\}\\in\\mathbb\{R\}^\{d\}is the embedding vector of the pre\-purchase heterogeneous behavior sequence leading to this purchase \(used for similarity\-based retrieval\); andℳu,c\(j\)\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}is the structured decision memory \(SDM\) —a structured quintuple capturing five complementary facets of the user’s decision logic:

ℳu,c\(j\)=\(ℛu,c\(j\),𝒯u,c\(j\),ℰu,c\(j\),𝒫u,c\(j\),𝒜u,c\(j\)\)\.\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}=\\big\(\\mathcal\{R\}\_\{u,c\}^\{\(j\)\},\\mathcal\{T\}\_\{u,c\}^\{\(j\)\},\\mathcal\{E\}\_\{u,c\}^\{\(j\)\},\\mathcal\{P\}\_\{u,c\}^\{\(j\)\},\\mathcal\{A\}\_\{u,c\}^\{\(j\)\}\\big\)\.\(3\)Each component is formally defined as follows:

- •Decision Intent Reasoningℛu,c\(j\)\\mathcal\{R\}\_\{u,c\}^\{\(j\)\}: a natural language explanation of the purchase of itemi∗i^\{\*\}, grounded in the user’s historical heterogeneous behaviors\.
- •Decision Profile Tags𝒯u,c\(j\)\\mathcal\{T\}\_\{u,c\}^\{\(j\)\}: a set of categorical labels characterizing the user’s decision style in this context, drawn from a predefined taxonomyVtagV\_\{\\mathrm\{tag\}\}\. Examples of user decision profile tags include brand\-sensitive, price\-sensitive, and certification\-driven preferences\.
- •Decision Efficiencyℰu,c\(j\)\\mathcal\{E\}\_\{u,c\}^\{\(j\)\}: a discrete decision tempo type reflecting the user’s decision\-making speed, inferred from behavioral signals such as session duration, number of item comparisons, and backtracking frequency\. This yields four categories of decision efficiency: flash, rapid, considered, and prolonged\.
- •Decision Preference Factors𝒫u,c\(j\)\\mathcal\{P\}\_\{u,c\}^\{\(j\)\}: a set of key\-value pairs\{\(kp,vp\)\}\\\{\(k\_\{p\},\\allowbreak v\_\{p\}\)\\\}wherekpk\_\{p\}denotes a positively weighted decision attribute \(e\.g\., brand, price, style\) andvpv\_\{p\}specifies its concrete instantiation in the chosen item\. Example: \(brand, Nike\), \(price, 500–800\), \(style, minimalist\)\.
- •Decision Avoidance Factors𝒜u,c\(j\)\\mathcal\{A\}\_\{u,c\}^\{\(j\)\}: a set of key\-value pairs\{\(ka,va\)\}\\\{\(k\_\{a\},\\allowbreak v\_\{a\}\)\\\}capturing attributes explicitly rejected during exploration\. Herekak\_\{a\}denotes a decision dimension \(same category askpk\_\{p\}\), andvav\_\{a\}specifies the avoided value\. Example: \(material, polyester\), \(price,\>\>1200\), \(color, bright\-red\)\.

Both the profile tags𝒯u,c\(j\)\\mathcal\{T\}\_\{u,c\}^\{\(j\)\}and the keys in𝒫u,c\(j\)\\mathcal\{P\}\_\{u,c\}^\{\(j\)\}and𝒜u,c\(j\)\\mathcal\{A\}\_\{u,c\}^\{\(j\)\}are from closed vocabularies, derived via iterative LLM\-based clustering on large\-scale e\-commerce data\. The LLM also generates evidence\-backed rationales for each factor to ensure plausibility\. An example of an SDM is provided in Appendix[\-C](https://arxiv.org/html/2610.11501#A0.SS3)\.

### IV\-BPost\-Hoc Decision Distillation \(PHDD\)

To enable efficient inference, we design a two\-stage distillation pipeline that yields a lightweight student model for generating user SDMs: \(1\) a teacher LLM generates structured memories and Chain\-of\-Thought \(CoT\)\[[32](https://arxiv.org/html/2610.11501#bib.bib38)\]; \(2\) a small student model is trained via CoT distillation\[[33](https://arxiv.org/html/2610.11501#bib.bib37)\]to mimic this capability\.

#### IV\-B1Teacher Model: Category\-Conditioned Memory Generation

To construct high\-quality CoT training data for PHDD, we leverage the powerful reasoning capability of DeepSeek\-R1\[[31](https://arxiv.org/html/2610.11501#bib.bib23)\]to generate grounded, interpretable decision rationales from real user interaction logs\. Specifically, for each purchase event\(i∗,c,τ∗\)\(i^\{\*\},c,\\tau^\{\*\}\)by useruuin categorycc, we extract the category\-filtered pre\-purchase sequence:

ℋu,cpre=\{\(it,at,τt\)∣τt<τ∗,category\(it\)=c\}\.\\mathcal\{H\}\_\{u,c\}^\{\\text\{pre\}\}=\\left\\\{\(i\_\{t\},a\_\{t\},\\tau\_\{t\}\)\\mid\\tau\_\{t\}<\\tau^\{\*\},\\text\{category\}\(i\_\{t\}\)=c\\right\\\}\.\(4\)
We employ a teacher LLMϕteaPHDD\\phi^\{\\text\{PHDD\}\}\_\{\\text\{tea\}\}, prompted with a carefully designed template to enforce a consistent output format, generating structured decision memoriesℳu,c\(j\)\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}\. These outputs are subsequently verified to eliminate hallucinations and ensure high\-quality reasoning trajectories\. Critically, to enhance rationale accuracy, we provide the teacher with post\-purchase reviews as privileged calibration references exclusively during dataset construction\. Guided by the prompt, the teacher deduces decision logic solely from pre\-purchase behaviors, utilizing the reviews merely to validate the inferred rationale without directly leaking their text\. These signals are excluded during student training and inference, ensuring realistic deployment conditions\.

#### IV\-B2Student Model Training via CoT Distillation

To enable scalable DMB construction in real\-world production scenarios, we distill the teacher’s capability into a compact student LLMϕstuPHDD\\phi^\{\\text\{PHDD\}\}\_\{\\text\{stu\}\}\(Qwen3\-4B\[[34](https://arxiv.org/html/2610.11501#bib.bib21)\]\) using Chain\-of\-Thought distillation:

- •Dataset creation: For each purchase event, we collect the teacher’s CoT reasoning trace \(intermediate rationale steps\) and final structured memoryℳu,c\(j\)\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}as supervision signals\.
- •Input representation: The student receives onlyℋu,cpre\\mathcal\{H\}\_\{u,c\}^\{\\text\{pre\}\}and category contextcc\.
- •Training objective: Minimize the cross\-entropy loss between student\-generated tokens and the teacher’s CoT trace \+ final memory: ℒPHDD=−∑l=1LlogPϕstuP​H​D​D\(yltea∣ℋu,cpre,c,y<ltea\)\\mathcal\{L\}\_\{\\text\{PHDD\}\}=\-\\sum\_\{l=1\}^\{L\}\\log P\_\{\\phi^\{PHDD\}\_\{\\text\{stu\}\}\}\\left\(y\_\{l\}^\{\\text\{tea\}\}\\mid\\mathcal\{H\}\_\{u,c\}^\{\\text\{pre\}\},c,y\_\{<l\}^\{\\text\{tea\}\}\\right\)\(5\)wherey1:Lteay\_\{1:L\}^\{\\text\{tea\}\}is the concatenated CoT trace and SDM text\.

After training,ϕstuPHDD\\phi^\{\\text\{PHDD\}\}\_\{\{\\text\{stu\}\}\}generates SDMsℳu,c\(j\)\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}for all historical purchases\. For each SDM, we compute its retrieval embedding𝐞u,c\(j\)\\mathbf\{e\}\_\{u,c\}^\{\(j\)\}by encoding the corresponding pre\-purchase sequenceℋu,cpre\\mathcal\{H\}\_\{u,c\}^\{\\text\{pre\}\}with a lightweight, frozen text encoder \(e\.g\., Qwen3\-Embedding\-0\.6B\[[35](https://arxiv.org/html/2610.11501#bib.bib22)\]\)\. The resultingDMBu\\text\{DMB\}\_\{u\}is stored as a category\-indexed vector database supporting efficient similarity search\.

### IV\-CMemory\-Augmented Reasoning Framework

The MARI inference pipeline consists of two core stages: \(1\) context processing and adaptive memory retrieval, and \(2\) prompt construction and memory\-augmented LLM reasoning\.

#### IV\-C1Context Processing and Adaptive Memory Retrieval

Given a user’s recent interaction context𝒞u=\{\(it,at,τt\)\}t=Tu−k\+1Tu\\mathcal\{C\}\_\{u\}=\\\{\(i\_\{t\},a\_\{t\},\\tau\_\{t\}\)\\\}\_\{t=T\_\{u\}\-k\+1\}^\{T\_\{u\}\}, we first encode it into a dense vector𝐞ctx\\mathbf\{e\}\_\{\\text\{ctx\}\}using the frozen text encoder \(same as in DMB construction\)\. The retrieval strategy then adapts to the prediction task\.

For Next\-Item Prediction \(NIP\): The target category is unknown a priori\. We perform cross\-category similarity retrieval to find SDM with behaviorally similar exploration patterns:

𝒮uNIP=\{ℳu,c\(j\)\|\(c,j\)∈TopKc∈𝒞,j∈\[1,Ju,c\]​\(sim​\(𝐞ctx,𝐞u,c\(j\)\)\)\}\\mathcal\{S\}\_\{u\}^\{\\text\{NIP\}\}=\\left\\\{\\mathcal\{M\}\_\{u,c\}^\{\(j\)\}\\,\\middle\|\\,\(c,j\)\\in\\underset\{\\begin\{subarray\}\{c\}c\\in\\mathcal\{C\},j\\in\[1,J\_\{u,c\}\]\\end\{subarray\}\}\{\\operatorname\{TopK\}\}\\left\(\\text\{sim\}\\left\(\\mathbf\{e\}\_\{\\text\{ctx\}\},\\,\\mathbf\{e\}\_\{u,c\}^\{\(j\)\}\\right\)\\right\)\\right\\\}\(6\)wheresim​\(𝐚,𝐛\)=𝐚⊤​𝐛‖𝐚‖​‖𝐛‖\\text\{sim\}\(\\mathbf\{a\},\\mathbf\{b\}\)=\\frac\{\\mathbf\{a\}^\{\\top\}\\mathbf\{b\}\}\{\\\|\\mathbf\{a\}\\\|\\\|\\mathbf\{b\}\\\|\}\.

For Difficult Choice Prediction \(DCP\): The target categoryctargetc\_\{\\text\{target\}\}is known from session context\. We perform category\-constrained temporal retrieval:

𝒮uDCP=\{ℳu,ctarget\(j\)∣j∈TopKtime​\(\{τu,ctarget\(j\)\}\)\}\.\\mathcal\{S\}\_\{u\}^\{\\text\{DCP\}\}=\\left\\\{\\mathcal\{M\}\_\{u,c\_\{\\text\{target\}\}\}^\{\(j\)\}\\mid j\\in\\text\{TopK\}\_\{\\text\{time\}\}\\left\(\\\{\\tau\_\{u,c\_\{\\text\{target\}\}\}^\{\(j\)\}\\\}\\right\)\\right\\\}\.\(7\)Prioritizing recency over behavioral similarity is critical here: fine\-grained preference trade\-offs evolve rapidly within categories and are best captured by recent decisions\. If the user has no SDM records in the target categoryctargetc\_\{\\text\{target\}\}, we fall back to decision memory retrieval as defined in Equation[6](https://arxiv.org/html/2610.11501#S4.E6)\.

#### IV\-C2Prompt Construction and Memory\-Augmented Reasoning

We integrate retrieved memories𝒮u\\mathcal\{S\}\_\{u\}with the current context𝒞u\\mathcal\{C\}\_\{u\}to construct task\-specific prompts forϕrec\\phi^\{\\text\{rec\}\}, an LLM\-based recommender\.

- •For NIP, where the target category is unknown a priori, the prompt instructs the LLM to predict the next purchased item directly from the user’s recent interaction sequence, augmented with SDMs retrieved from the DMB based on the current behavioral context\.
- •For DCP, where the candidate set within a known category is provided, the prompt instructs the LLM to predict the next purchased item directly from the candidate set, augmented with SDMs retrieved from the DMB preferentially based on the target category\.

Both designs enforce structured reasoning grounded in explicit decision evidence, enablingϕrec\\phi^\{\\text\{rec\}\}to move beyond surface\-level sequential patterns—enhancing robustness under data sparsity while preserving interpretability through traceable memory references\. The prompt template is provided in Appendix[\-D](https://arxiv.org/html/2610.11501#A0.SS4)\.

### IV\-DDeployment Strategies

MARI supports two deployment paradigms that balance training overhead, interpretability, and integration flexibility\.

#### IV\-D1Plug\-and\-Play Augmentation Mode

MARI functions as a lightweight, training\-free augmentation module for existing LLM\-based recommenders\. Given context𝒞u\\mathcal\{C\}\_\{u\}, it retrieves relevant memories𝒮u\\mathcal\{S\}\_\{u\}and constructs the task\-appropriate prompt for any off\-the\-shelf recommendation LLMϕrec\\phi^\{\\text\{rec\}\}\. This training\-free compatibility enables:

- •Seamless integration into production pipelines\.
- •No additional training costs or architectural modifications\.
- •Preservation of existing model investments while enhancing decision transparency\.

#### IV\-D2CoT\-Distilled Mode

For maximum performance and full interpretability, we distill a specialized student modelϕsturec\\phi\_\{\\text\{stu\}\}^\{\\text\{rec\}\}that generates both predictions and justifications\. Training follows the MARI inference pipeline: \(1\) For each purchase\(i∗,τ∗\)\(i^\{\*\},\\tau^\{\*\}\), extract pre\-purchase context𝒞upre\\mathcal\{C\}\_\{u\}^\{\\text\{pre\}\}; \(2\) Retrieve relevant memories𝒮upre\\mathcal\{S\}\_\{u\}^\{\\text\{pre\}\}using task\-appropriate strategy; \(3\) Prompt the teacher LLM to generate CoT reasoning from\(𝒞upre,𝒮upre\)\(\\mathcal\{C\}\_\{u\}^\{\\text\{pre\}\},\\mathcal\{S\}\_\{u\}^\{\\text\{pre\}\}\), concluding withi∗i^\{\*\}; \(4\) Train student to autoregressively generate this CoT\+item sequence labelyr​e​cy^\{rec\}:

ℒrec=−∑l=1LlogPϕstur​e​c\(ylr​e​c∣𝒞upre⊕𝒮upre,y<lr​e​c\)\.\\mathcal\{L\}\_\{\\text\{rec\}\}=\-\\sum\_\{l=1\}^\{L\}\\log P\_\{\\phi^\{rec\}\_\{\\text\{stu\}\}\}\\left\(y^\{rec\}\_\{l\}\\mid\\mathcal\{C\}\_\{u\}^\{\\text\{pre\}\}\\oplus\\mathcal\{S\}\_\{u\}^\{\\text\{pre\}\},y^\{rec\}\_\{<l\}\\right\)\.\(8\)
At inference,ϕsturec\\phi\_\{\\text\{stu\}\}^\{\\text\{rec\}\}outputs human\-interpretable rationales alongside predictions\. This establishes a new paradigm for transparent recommendation where every prediction is grounded in explicit, retrievable decision evidence\.

Both deployment modes share the same DMB infrastructure, allowing practitioners to choose based on their system constraints and interpretability requirements\. This design enables MARI to scale efficiently to large\-scale systems while preserving detailed decision semantics critical for difficult\-choice recommendations\.

## VExperiments Setup

### V\-ADatasets

Existing public multi\-behavior datasets lack the rich textual item metadata \(e\.g\., titles, attributes\) essential for LLM\-based reasoning, as they mostly contain anonymized IDs\. To address this, we construct a new large\-scale dataset from six months of real\-world user logs on a major e\-commerce platform, capturing heterogeneous behaviors—search, view, favorite, and purchase—along with comprehensive item metadata\. We further split it into two task\-specific datasets: the Post\-Hoc Decision Distillation \(PHDD\) Dataset and the Multi\-Behavior Recommendation \(MBR\) Dataset\.

#### V\-A1PHDD Dataset

The PHDD Dataset captures fine\-grained, user\-level decision traces in their original form, preserving all observed interactions without behavioral filtering or deduplication\. It is partitioned into 200k, 10k, and 10k samples for training, validation, and testing, respectively\.

#### V\-A2MBR Dataset

We construct this dataset to evaluate tasks NIP and DCP, following the previous methods\[[36](https://arxiv.org/html/2610.11501#bib.bib19)\]with two preprocessing steps to ensure data quality: \(1\) we merge duplicated user\-item\-behavior interactions by keeping the earliest record; \(2\) we apply a k\-core filtering \(k=10\) to retain users and items with at least 10 interactions, mitigating data sparsity\. Each user’s filtered chronological sequence is then split via leave\-one\-out by timestamp: the last purchase for testing, the second\-last for validation, and earlier interactions for training\.

To evaluate the cross\-category generalization capability of our MARI framework under the Next Item Prediction \(NIP\) setting, we further partition the instances into two disjoint subsets: \(1\)NIP\-in\-category \(NIP\-in\), comprising users who have previously purchased at least one item in the same category as the target item; and \(2\)NIP\-out\-of\-category \(NIP\-out\), where the target purchase represents the user’s first interaction in that category\. This partition enables us to assess whether our method can effectively leverage decision memory to support recommendations in both familiar and novel category contexts\.

For the DCP task, where the target item category is assumed to be known, we construct the candidate set by using an LLM \(Qwen3\-Max\) to select 2–5 items within the same category that the user showed notable hesitation or comparison behavior toward in their recent interaction history, followed by manual validation of the selected candidates\. An example of a candidate set is provided in Appendix[\-B](https://arxiv.org/html/2610.11501#A0.SS2)\.

The resulting MBR dataset comprises three distinct tasks \(NIP\-in, NIP\-out, and DCP\) with non\-overlapping users across tasks, yielding a total of 150,000 unique users\. To ensure fair comparison, each task is identically sampled into 50k training, 10k validation, and 10k testing instances\.

### V\-BMetrics

#### V\-B1PHDD Task

For the PHDD task, Decision Profile Tags, Decision Efficiency, and the keys of Decision Preference/Avoidance Factors are closed\-set\. We evaluate them using precision, defined as the fraction of correctly predicted items among all predictions\. In contrast, Decision Intent Reasoning and the values of Preference/Avoidance Factors are open\-ended\. We assess them via an LLM\-as\-judge approach, measuring the following dimensions on a scale of 0–5: \(1\) structural correctness \(adherence to output format\), \(2\) reasoning quality \(logical coherence of the decision inference process\), and \(3\) value abstraction \(appropriateness and generalizability of extracted factor values\)\. Specifically, we employ DeepSeek\-R1 as the judge model and provide it with a human\-verified reference solution as the scoring benchmark to ensure evaluation reliability\.

#### V\-B2MBR Task

For the MBR task, we adopt a next\-item prediction setting where the user’s subsequent actual purchase serves as the ground\-truth target\. Model performance is evaluated using a widely used metric Hit Ratio@1 \(Hit@1\)\.

### V\-CExperimental Settings

#### V\-C1Baseline

We establish a comprehensive set of baseline models for our two core tasks\.

For the PHDD task, which focuses on generating a user’s decision memory, we adopt the off\-the\-shelf Qwen3\[[34](https://arxiv.org/html/2610.11501#bib.bib21)\]series of large language models as our primary baselines\. These models are used without any additional fine\-tuning\.

For the MBR task, we benchmark against two baseline categories\. First, we include ID\-based sequential recommenders:SASRecM​B\\text\{SASRec\}\_\{MB\}\[[37](https://arxiv.org/html/2610.11501#bib.bib6)\], SASRec’s\[[14](https://arxiv.org/html/2610.11501#bib.bib5)\]multi\-behavior extension that incorporates different interaction types; and three recent state\-of\-the\-art ID\-based multi\-behavior recommendation methods, namely MULE\[[8](https://arxiv.org/html/2610.11501#bib.bib33)\], COPF\[[9](https://arxiv.org/html/2610.11501#bib.bib34)\], and HGIB\[[10](https://arxiv.org/html/2610.11501#bib.bib35)\]\. Second, to fully leverage the rich textual semantics of items, we integrate several powerful open\-source LLMs into the recommendation pipeline\. Specifically, we employ Qwen3, DeepSeek\-R1 \(R1\)\[[31](https://arxiv.org/html/2610.11501#bib.bib23)\], and GPT\-OSS\[[38](https://arxiv.org/html/2610.11501#bib.bib24)\], which process item metadata such as titles, prices, and attributes using their native language understanding capabilities\. Similar to the PHDD task, these LLMs are also used in their original, unmodified form without any further training on recommendation data\. To ensure fair comparison, all baselines predict the target item from a unified candidate space: the recent historical sequence \(for NIP\) or the provided candidate set \(for DCP\)\.

#### V\-C2Implementation Details

For the PHDD task, we set the maximum length of the input behavior sequenceℋu,c\\mathcal\{H\}\_\{u,c\}to 200, considering only interactions that occurred within a two\-week window prior to the target decision\. To support retrieval in the DMB, we employ the Qwen3\-Embedding\-0\.6B model to extract dense representations of behavior sequences\. The PHDD ModelϕstuPHDD\\phi^\{\\text\{PHDD\}\}\_\{\\text\{stu\}\}is trained via full\-parameter fine\-tuning on the PHDD dataset, based on the Qwen3\-4B\.

For the MBR task, we set the maximum input sequence length𝒞u\\mathcal\{C\}\_\{u\}to 100, as our preliminary experiments \(Figure[2](https://arxiv.org/html/2610.11501#S3.F2)\) show that model performance peaks at this length\. During memory retrieval, we perform a top\-KKsearch withK=3K=3, retrieving the three most relevant decision memories from the DMB\. The MBR modelϕsturec\\phi^\{\\text\{rec\}\}\_\{\\text\{stu\}\}is fully fine\-tuned from Qwen3\-4B on the constructed MBR dataset\. We train the model on a mixture of the three tasks: NIP\-in\-category, NIP\-out\-of\-category, and DCP\.

## VIExperimental Results

### VI\-APerformance Comparison

We perform comprehensive performance comparisons across two distinct tasks: the PHDD task, designed to generate users’ structured decision memories, and the Multi\-Behavior Recommendation \(MBR\) task\.

#### VI\-A1PHDD

Results on the PHDD dataset \(Table[I](https://arxiv.org/html/2610.11501#S6.T1)\) show that our method enables the compact Qwen3\-4B to match the much larger R1 model in precision metrics, while surpassing it in Reasoning Quality and Value Abstraction under LLM\-as\-Judge evaluation\. This confirms that PHDD effectively distills the ability to understand user decision intent into a smaller model, ensuring the generation of high\-quality SDMs while achieving competitive performance at a fraction of the inference cost\.

TABLE I:Quality of Structured Decision Memory \(SDM\) generation on the PHDD dataset\.Models: Q4B \(Qwen3\-4B\), Q8B \(Qwen3\-8B\), Q14B, Q32B\.Bold: Best,Underlined: Second\-best\.MetricQ4BQ8BQ14BQ32BR1Q4B\-PHDD\(Ours\)Precision \(↑\\uparrow\)Factor Key0\.5770\.6540\.6360\.6310\.7790\.769Decision Prof\.0\.4670\.4700\.5250\.5560\.7250\.713Decision Effic\.0\.4830\.4730\.5290\.5130\.7070\.693LLM\-as\-Judge \(↑\\uparrow\)Struct\. Corr\.3\.563\.313\.583\.714\.134\.12Reason\. Qual\.3\.513\.403\.693\.753\.893\.93Value Abst\.3\.493\.503\.663\.814\.214\.22
#### VI\-A2MBR

Table[II](https://arxiv.org/html/2610.11501#S6.T2)details the Hit@1 performance, revealing three core findings:\(1\) Plug\-and\-play SDMs generalize across diverse model scales\.By simply injecting SDMs into off\-the\-shelf LLMs without weight updates, MARI†broadly enhances performance across diverse parameter sizes \(from 4B to 671B\)\. Crucially, when applied to sufficiently large models \(e\.g\., R1, Qwen3\-235B\-A22B\-Think\), this plug\-and\-play approach successfully surpasses strong fully\-trained ID\-based baselines \(e\.g\., HGIB, MULE\), explicitly confirming the generality and potency of our framework\.\(2\) SDMs significantly amplify reasoning on complex tasks\.The structured priors provide vital context that medium\-to\-large models \(≥\\geq14B\) can effectively leverage, yielding massive gains on the challenging NIP\-out task \(e\.g\., \+165% for GPT\-OSS\-20B, \+128% for Qwen3\-32B\)\. However, smaller models \(4B/8B\) degrade on NIP\-out, suggesting that out\-of\-category reasoning inherently requires a minimum intrinsic capacity\. Conversely, on the DCP task, MARI†empowers all model scales to consistently outperform ID\-based baselines, highlighting LLMs’ inherent advantage in difficult choice prediction that demands semantic comparison\.\(3\) SFT empowers compact models to achieve state\-of\-the\-art results\.Fine\-tuning the lightweight 4B model yields substantial improvements across all three tasks\. Notably, MARI \(4B\) achieves 0\.5561 on NIP\-out and 0\.8868 on DCP, significantly outperforming both fully\-trained ID\-based models and massive 671B untuned LLMs like R1\. This demonstrates that specializing compact models to reason over SDMs offers a practical pathway to superior accuracy, mitigating reliance on massive architectures\.

Figure[4](https://arxiv.org/html/2610.11501#S6.F4)presents an example of MARI’s interpretable recommendations, demonstrating that the model effectively uses the information of the SDMs \(marked in red\) during reasoning to produce the correct product recommendations\.

![Refer to caption](https://arxiv.org/html/2610.11501v1/example_result_v6.png)Fig\. 4:The role of structured decision memory: comparing recommendation rationales with and without decision memory augmentation\.TABLE II:Full comparison of Hit@1\. MARI†denotes an off\-the\-shelf open\-source general\-purpose model without any task\-specific fine\-tuning for recommendation\. Base denotes vanilla LLMs and ID\-based models\.Bold: Best,Underlined: Second\-best\.CategoryModelBaseMARI†\(Ours, w/o SFT\)NIP\-inNIP\-outDCPNIP\-inNIP\-outDCPID\-based\(w/ train\)SASRecMB0\.16660\.16970\.4077\-\-\-MULE0\.23630\.19680\.4206\-\-\-COPF0\.20130\.17950\.4037\-\-\-HGIB0\.24890\.22510\.4384\-\-\-LLMs\(w/o train\)Qwen3\-4B0\.07510\.02250\.46170\.12780\.01570\.4751Qwen3\-8B0\.11200\.06870\.42030\.15800\.06750\.4505Qwen3\-14B0\.09990\.03910\.45140\.15350\.06760\.4549GPT\-OSS\-20B0\.14770\.09340\.42070\.19630\.24800\.4533Qwen3\-32B0\.11360\.04960\.44790\.17420\.11350\.4697Qwen3\-235B\-A22B\-Ins0\.13040\.07980\.50690\.22240\.24220\.5251Qwen3\-235B\-A22B\-Thk0\.20680\.29920\.50100\.26870\.41890\.5249R10\.19570\.25030\.51580\.25310\.36410\.5336MARI \(Ours, w/ SFT\)\-\-\-0\.48690\.55610\.8868

### VI\-BAblation Study

To validate the core design of MARI, we conduct a series of ablation studies comparing MARI\-B, MARI†⋆, MARI†, and SFT variants\. Table[III](https://arxiv.org/html/2610.11501#S6.T3)details the configurations and results, revealing three core insights:

\(1\) Superiority of structured memories over raw behaviors\.Directly injecting raw sequences aligned with SDMs \(MARI\-B\) yields gains on simpler tasks \(e\.g\., NIP\-in\) but degrades performance on complex tasks like NIP\-out and DCP\. This indicates that the verbosity of raw behaviors dilutes contextual information, distracting the LLM from critical decision factors required for deep reasoning\. Conversely, using decision memories \(MARI†⋆and MARI†\) consistently outperforms MARI\-B across all scales\. This proves that enriching the input with explicit decision logic—rather than relying solely on implicit patterns in raw sequences—is crucial for guiding LLMs in challenging scenarios\.

\(2\) Critical impact of memory quality\.High\-quality memories distilled via PHDD \(MARI†\) always beat undistilled, lower\-quality ones \(MARI†⋆\), particularly in NIP\-out and DCP\. This direct correlation between memory quality and performance validates the necessity of PHDD for filtering noise and abstracting clear user intent\.

\(3\) SDMs enhance supervised fine\-tuning\.The baseline SFT and MARI share the same training objective, differing only in input augmentation\. Incorporating retrieved SDMs during SFT yields clear gains over standard SFT without SDMs\. This confirms a strong synergy between structured memory inputs and parameter updates for complex reasoning and generalization\.

TABLE III:Ablation study on Hit@1\.MARI\-B: Uses raw behavior sequences aligned with SDMs\.MARI†⋆: Uses undistilled SDMs generated by Qwen3\-4B \(w/o PHDD\)\.MARI†: Uses distilled SDMs generated by Qwen3\-4B \(w/ PHDD\)\.SFT variants: Compares standard SFT against SFT with SDMs\.Boldindicates the best \(MARI†\) and overall \(MARI\) results\.VariantQ4BQ14BQ32BGPT\-OSS\-20BR1NIP\-inBase0\.0750\.1000\.1140\.1480\.196MARI\-B \(Raw Behav\.\)0\.1050\.1250\.1270\.1320\.247MARI†⋆\(Undist\. SDM\)0\.1100\.1340\.1570\.1700\.249MARI†\(Dist\. SDM\)0\.1280\.1540\.1740\.1960\.253SFT w/o SDM0\.458\-\-\-\-MARI\(SFT \+ SDM\)0\.487\-\-\-\-NIP\-outBase0\.0230\.0390\.0500\.0930\.250MARI\-B0\.0120\.0150\.0140\.0610\.270MARI†⋆0\.0130\.0460\.0840\.1330\.317MARI†0\.0160\.0680\.1140\.2480\.364SFT w/o SDM0\.538\-\-\-\-MARI0\.556\-\-\-\-DCPBase0\.4620\.4510\.4480\.4210\.516MARI\-B0\.4360\.4370\.4410\.4090\.511MARI†⋆0\.4700\.4510\.4510\.4320\.520MARI†0\.4750\.4550\.4700\.4530\.534SFT w/o SDM0\.866\-\-\-\-MARI0\.887\-\-\-\-
### VI\-CEffect of the Number of Retrieved Memories \(KK\)

Fig\. 5:MARI†’s Hit@1 performance across different tasks asKKincreases\.We investigate the influence of the retrieved memory count \(KK\) on MARI†’s performance, using DeepSeek\-R1 as the underlying recommendation model\. Results in Figure[5](https://arxiv.org/html/2610.11501#S6.F5)show a consistent trend: performance initially improves withKK, peaks aroundK=3K=3or 4, and then declines\. Sensitivity toKKvaries by task\. The NIP\-out task is most sensitive, as largerKKintroduces noise that impairs cross\-category reasoning\. Conversely, NIP\-in and DCP performance remains stable across a broaderKKrange, demonstrating robustness to context volume\. We setK=3K=3as the default, achieving a balance of strong performance across tasks while minimizing noise from excessive context\.

### VI\-DMemory Error Analysis

To evaluate the performance lower bound of MARI under degraded SDM quality, we simulate two error scenarios: \(1\)error retrieval\(lowest\-similarity memories\) and \(2\)error memory\(random same\-category SDMs from other users\)\. Table[IV](https://arxiv.org/html/2610.11501#S6.T4)reveals three key insights:

\(1\) Structural priors defy noise\.On NIP\-in, error variants consistently outperform the Base LLM \(e\.g\., boosting 4B from 0\.075 to 0\.094\)\. This suggests even inaccurate SDMs provide valuable structural signals guiding attention better than raw behaviors\.

\(2\) Robustness scales with capacity\.On NIP\-out, small models \(4B/14B\) degrade slightly, whereas larger models \(≥\\geq20B\) remain robust and even improve \(e\.g\., R1 jumps to 0\.307\)\. This indicates larger LLMs possess sufficient intrinsic capacity to filter noise\.

\(3\) Factual sensitivity in DCP\.Performance dips modestly but stays competitive, as DCP inherently relies on precise preference matching, making it more sensitive to factual inaccuracies\.

Overall, while LLMs exhibit commendable robustness, high\-quality memories remain indispensable for maximizing complex reasoning performance\.

TABLE IV:Memory Error Analysis\.Err\. Ret\.: Lowest\-similarity memories\.Err\. Mem\.: Random same\-category SDMs from other users\.VariantQ4BQ14BQ32BGPT\-OSSR1NIP\-inBase0\.0750\.1000\.1140\.1480\.196Err\. Ret\.0\.0790\.1240\.1240\.1580\.230Err\. Mem\.0\.0940\.1200\.1170\.1510\.223MARI†0\.1280\.1540\.1740\.1960\.253NIP\-outBase0\.0230\.0390\.0500\.0930\.250Err\. Ret\.0\.0130\.0380\.0800\.1290\.307Err\. Mem\.0\.0120\.0320\.0620\.1180\.301MARI†0\.0160\.0680\.1140\.2480\.364DCPBase0\.4620\.4510\.4480\.4210\.516Err\. Ret\.0\.4370\.3980\.4320\.4280\.495Err\. Mem\.0\.4430\.4140\.4380\.4050\.494MARI†0\.4750\.4550\.4700\.4530\.534

## VIIConclusion

We propose MARI, a reasoning\-aware framework that explicitly models the decision logic behind heterogeneous user interactions\. Via Post\-Hoc Decision Distillation, MARI constructs a Decision Memory Bank of structured rationales capturing user goals and trade\-offs\. Retrieving these memories grounds LLM recommendations in explicit historical evidence, ensuring both interpretability and efficiency\. Extensive offline experiments confirm MARI’s superiority in accuracy and real\-world engagement, offering a practical path toward transparent, rationale\-driven recommender systems\. Future work will explore advanced SDM retrieval strategies and adaptive memory updates for dynamic environments, and quantify the specific contribution of individual SDM dimensions to recommendation quality and interpretability\.

## References

- \[1\]\(2023\)Tallrec: an effective and efficient tuning framework to align large language model with recommendation\.InProceedings of the 17th ACM conference on recommender systems,pp\. 1007–1014\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p1.1),[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[2\]S\. Kim, H\. Kang, S\. Choi, D\. Kim, M\. Yang, and C\. Park\(2024\)Large language models meet collaborative filtering: an efficient all\-round llm\-based recommender system\.InProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining,pp\. 1395–1406\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p1.1),[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[3\]Y\. Hou, J\. Zhang, Z\. Lin, H\. Lu, R\. Xie, J\. McAuley, and W\. X\. Zhao\(2024\)Large language models are zero\-shot rankers for recommender systems\.InEuropean Conference on Information Retrieval,pp\. 364–381\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p1.1),[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[4\]S\. Kim, H\. Kang, K\. Kim, J\. Kim, D\. Kim, M\. Yang, K\. Oh, J\. McAuley, and C\. Park\(2025\)Lost in sequence: do large language models understand sequential recommendation?\.InProceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V\. 2,pp\. 1160–1171\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p1.1),[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[5\]Y\. Hou, J\. Li, Z\. He, A\. Yan, X\. Chen, and J\. McAuley\(2024\)Bridging language and items for retrieval and recommendation\.arXiv preprint arXiv:2403\.03952\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p1.1)\.
- \[6\]S\. Gu, X\. Wang, C\. Shi, and D\. Xiao\(2022\)Self\-supervised graph neural networks for multi\-behavior recommendation\.\.InIJCAI,pp\. 2052–2058\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p2.1),[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[7\]Z\. Cheng, S\. Han, F\. Liu, L\. Zhu, Z\. Gao, and Y\. Peng\(2023\)Multi\-behavior recommendation with cascading graph convolution networks\.InProceedings of the ACM Web Conference 2023,pp\. 1181–1189\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p2.1),[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[8\]S\. Lee, G\. Ko, H\. Song, and J\. Jung\(2024\)Mule: multi\-grained graph learning for multi\-behavior recommendation\.InProceedings of the 33rd ACM international conference on information and knowledge management,pp\. 1163–1173\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p2.1),[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[9\]C\. Zhai, C\. Meng, Y\. Yang, K\. Zhang, X\. Zhao, and X\. Li\(2025\)Combinatorial optimization perspective based framework for multi\-behavior recommendation\.InProceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V\. 1,pp\. 1891–1902\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p2.1),[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[10\]H\. Zhang, C\. Shen, X\. Sun, J\. Tan, Y\. Tan, Y\. Rong, H\. Cheng, and L\. Yi\(2025\)Hierarchical graph information bottleneck for multi\-behavior recommendation\.InProceedings of the Nineteenth ACM Conference on Recommender Systems,pp\. 155–164\.Cited by:[§I](https://arxiv.org/html/2610.11501#S1.p2.1),[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[11\]A\. Mnih and R\. R\. Salakhutdinov\(2007\)Probabilistic matrix factorization\.Advances in neural information processing systems20\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[12\]A\. J\. Chaney, D\. M\. Blei, and T\. Eliassi\-Rad\(2015\)A probabilistic model for using social networks in personalized item recommendation\.InProceedings of the 9th ACM Conference on Recommender Systems,pp\. 43–50\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[13\]X\. He, L\. Liao, H\. Zhang, L\. Nie, X\. Hu, and T\. Chua\(2017\)Neural collaborative filtering\.InProceedings of the 26th international conference on world wide web,pp\. 173–182\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[14\]W\. Kang and J\. McAuley\(2018\)Self\-attentive sequential recommendation\.In2018 IEEE international conference on data mining \(ICDM\),pp\. 197–206\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[15\]F\. Sun, J\. Liu, J\. Wu, C\. Pei, X\. Lin, W\. Ou, and P\. Jiang\(2019\)BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer\.InProceedings of the 28th ACM international conference on information and knowledge management,pp\. 1441–1450\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[16\]S\. Kim, N\. Lee, D\. Kim, M\. Yang, and C\. Park\(2023\)Task relation\-aware continual user representation learning\.InProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining,pp\. 1107–1119\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[17\]X\. Ren, W\. Wei, L\. Xia, L\. Su, S\. Cheng, J\. Wang, D\. Yin, and C\. Huang\(2024\)Representation learning with large language models for recommendation\.InProceedings of the ACM web conference 2024,pp\. 3464–3475\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[18\]C\. Zhang, S\. Wu, H\. Zhang, T\. Xu, Y\. Gao, Y\. Hu, and E\. Chen\(2024\)Notellm: a retrievable large language model for note recommendation\.InCompanion Proceedings of the ACM Web Conference 2024,pp\. 170–179\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[19\]L\. Ning, L\. Liu, J\. Wu, N\. Wu, D\. Berlowitz, S\. Prakash, B\. Green, S\. O’Banion, and J\. Xie\(2025\)User\-llm: efficient llm contextualization with user embeddings\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 1219–1223\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[20\]Z\. Zheng, W\. Chao, Z\. Qiu, H\. Zhu, and H\. Xiong\(2024\)Harnessing large language models for text\-rich sequential recommendation\.InProceedings of the ACM Web Conference 2024,pp\. 3207–3216\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[21\]J\. Kim, H\. Kim, H\. Cho, S\. Kang, B\. Chang, J\. Yeo, and D\. Lee\(2024\)Review\-driven personalized preference reasoning with large language models for recommendation\. corr, abs/2408\.06276, 2024\. doi: 10\.48550\.arXiv preprint ARXIV\.2408\.06276\.Cited by:[§II\-A](https://arxiv.org/html/2610.11501#S2.SS1.p1.1)\.
- \[22\]Z\. Zhao, Z\. Cheng, L\. Hong, and E\. H\. Chi\(2015\)Improving user topic interest profiles by behavior factorization\.InProceedings of the 24th international conference on world wide web,pp\. 1406–1416\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[23\]J\. Ding, G\. Yu, X\. He, Y\. Quan, Y\. Li, T\. Chua, D\. Jin, and J\. Yu\(2018\)Improving implicit recommender systems with view data\.\.InIJCAI,pp\. 3343–3349\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[24\]G\. Guo, H\. Qiu, Z\. Tan, Y\. Liu, J\. Ma, and X\. Wang\(2017\)Resolving data sparsity by multi\-type auxiliary implicit feedback for recommender systems\.Knowledge\-Based Systems138,pp\. 202–207\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[25\]L\. Guo, L\. Hua, R\. Jia, B\. Zhao, X\. Wang, and B\. Cui\(2019\)Buying or browsing?: predicting real\-time purchasing intent using attention\-based deep network with multiple behavior\.InProceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining,pp\. 1984–1992\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[26\]L\. Xia, C\. Huang, Y\. Xu, P\. Dai, B\. Zhang, and L\. Bo\(2020\)Multiplex behavioral relation learning for recommendation via memory augmented transformer network\.InProceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval,pp\. 2397–2406\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[27\]B\. Geng, Z\. Huan, X\. Zhang, Y\. He, L\. Zhang, F\. Yuan, J\. Zhou, and L\. Mo\(2024\)Breaking the length barrier: llm\-enhanced ctr prediction in long textual user behaviors\.InProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval,pp\. 2311–2315\.Cited by:[§II\-B](https://arxiv.org/html/2610.11501#S2.SS2.p1.1)\.
- \[28\]P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel,et al\.\(2020\)Retrieval\-augmented generation for knowledge\-intensive nlp tasks\.Advances in neural information processing systems33,pp\. 9459–9474\.Cited by:[§II\-C](https://arxiv.org/html/2610.11501#S2.SS3.p1.1)\.
- \[29\]J\. Wu, C\. Chang, T\. Yu, Z\. He, J\. Wang, Y\. Hou, and J\. McAuley\(2024\)Coral: collaborative retrieval\-augmented large language models improve long\-tail recommendation\.InProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining,pp\. 3391–3401\.Cited by:[§II\-C](https://arxiv.org/html/2610.11501#S2.SS3.p1.1)\.
- \[30\]L\. Ning, W\. Fan, and Q\. Li\(2025\)Retrieval\-augmented purifier for robust llm\-empowered recommendation\.arXiv preprint arXiv:2504\.02458\.Cited by:[§II\-C](https://arxiv.org/html/2610.11501#S2.SS3.p1.1)\.
- \[31\]DeepSeek\-AI\(2025\)DeepSeek\-r1: incentivizing reasoning capability in llms via reinforcement learning\.External Links:2501\.12948,[Link](https://arxiv.org/abs/2501.12948)Cited by:[§III\-C](https://arxiv.org/html/2610.11501#S3.SS3.p1.1),[§IV\-B1](https://arxiv.org/html/2610.11501#S4.SS2.SSS1.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[32\]J\. Wei, X\. Wang, D\. Schuurmans, M\. Bosma, F\. Xia, E\. Chi, Q\. V\. Le, D\. Zhou,et al\.\(2022\)Chain\-of\-thought prompting elicits reasoning in large language models\.Advances in neural information processing systems35,pp\. 24824–24837\.Cited by:[§IV\-B](https://arxiv.org/html/2610.11501#S4.SS2.p1.1)\.
- \[33\]L\. C\. Magister, J\. Mallinson, J\. Adamek, E\. Malmi, and A\. Severyn\(2023\)Teaching small language models to reason\.InProceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 2: Short Papers\),pp\. 1773–1781\.Cited by:[§IV\-B](https://arxiv.org/html/2610.11501#S4.SS2.p1.1)\.
- \[34\]A\. Yang, A\. Li, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Gao, C\. Huang, C\. Lv, C\. Zheng, D\. Liu, F\. Zhou, F\. Huang, F\. Hu, H\. Ge, H\. Wei, H\. Lin, J\. Tang, J\. Yang, J\. Tu, J\. Zhang, J\. Yang, J\. Yang, J\. Zhou, J\. Zhou, J\. Lin, K\. Dang, K\. Bao, K\. Yang, L\. Yu, L\. Deng, M\. Li, M\. Xue, M\. Li, P\. Zhang, P\. Wang, Q\. Zhu, R\. Men, R\. Gao, S\. Liu, S\. Luo, T\. Li, T\. Tang, W\. Yin, X\. Ren, X\. Wang, X\. Zhang, X\. Ren, Y\. Fan, Y\. Su, Y\. Zhang, Y\. Zhang, Y\. Wan, Y\. Liu, Z\. Wang, Z\. Cui, Z\. Zhang, Z\. Zhou, and Z\. Qiu\(2025\)Qwen3 technical report\.arXiv preprint arXiv:2505\.09388\.Cited by:[§IV\-B2](https://arxiv.org/html/2610.11501#S4.SS2.SSS2.p1.1),[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p2.1)\.
- \[35\]Y\. Zhang, M\. Li, D\. Long, X\. Zhang, H\. Lin, B\. Yang, P\. Xie, A\. Yang, D\. Liu, J\. Lin, F\. Huang, and J\. Zhou\(2025\)Qwen3 embedding: advancing text embedding and reranking through foundation models\.arXiv preprint arXiv:2506\.05176\.Cited by:[§IV\-B2](https://arxiv.org/html/2610.11501#S4.SS2.SSS2.p2.1)\.
- \[36\]C\. Gao, X\. He, D\. Gan, X\. Chen, F\. Feng, Y\. Li, T\. Chua, L\. Yao, Y\. Song, and D\. Jin\(2019\)Learning to recommend with multiple cascading behaviors\.IEEE transactions on knowledge and data engineering33\(6\),pp\. 2588–2601\.Cited by:[§V\-A2](https://arxiv.org/html/2610.11501#S5.SS1.SSS2.p1.1)\.
- \[37\]Y\. Yang, C\. Huang, L\. Xia, Y\. Liang, Y\. Yu, and C\. Li\(2022\)Multi\-behavior hypergraph\-enhanced transformer for sequential recommendation\.InProceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining,pp\. 2263–2274\.Cited by:[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.
- \[38\]OpenAI\(2025\)Gpt\-oss\-120b & gpt\-oss\-20b model card\.External Links:2508\.10925,[Link](https://arxiv.org/abs/2508.10925)Cited by:[§V\-C1](https://arxiv.org/html/2610.11501#S5.SS3.SSS1.p3.1)\.

### \-AItem Metadata Example

Example: Raw Item Profile in the DatasetItem ID:12345678Category:Four\-Wheel Strollers Brand:PhoenixPrice:2000\.0 Title:Phoenix 0\-3 Years Reclining & Seating Baby Stroller Attributes:Color: Camel \[Premium Edition\] \- Upgraded polished aluminum frame, electroplated EVA silent wheels, includes bonus cartoon seat cushion\. Engagement Statistics: Stock: 8,600 Favorites: 1,900 Total Sales: 2,700

### \-BCandidate Set Example

Example: Candidate Set[⬇](data:text/plain;base64,WwogIHsiaXRlbV90aXRsZSI6ICJQaVAgU3R1ZGlvIFVuaXNleCBEdXRjaCBJbXBvcnRlZCBNdWciLCAiYXR0cmlidXRlIjogIkNvbG9yOiBPcmFuZ2UiLCAiYnJhbmQiOiAiUGlQIFN0dWRpbyIsICJwcmljZSI6ICIxMDUuMCIsICJzdG9jayI6IDYyMCwgImZhdm9yaXRlc19jb3VudCI6IDI0MTAsICJzYWxlc19jb3VudCI6IDg1MywgIml0ZW1faWQiOiAiNTc4NDYyMTI1eHh4eCJ9LAogIHsiaXRlbV90aXRsZSI6ICJQaVAgU3R1ZGlvIFVuaXNleCBEdXRjaCBJbXBvcnRlZCBNdWciLCAiYXR0cmlidXRlIjogIkNvbG9yOiBDaG9jb2xhdGUgQnJvd24iLCAiYnJhbmQiOiAiUGlQIFN0dWRpbyIsICJwcmljZSI6ICIxMTguMCIsICJzdG9jayI6IDU4MiwgImZhdm9yaXRlc19jb3VudCI6IDI0MTAsICJzYWxlc19jb3VudCI6IDg3OCwgIml0ZW1faWQiOiAiNTc4MTE0NjUxeHh4eCJ9LAogIHsiaXRlbV90aXRsZSI6ICJQaVAgU3R1ZGlvIFVuaXNleCBEdXRjaCBJbXBvcnRlZCBNdWciLCAiYXR0cmlidXRlIjogIkNvbG9yOiBTa3kgQmx1ZSIsICJicmFuZCI6ICJQaVAgU3R1ZGlvIiwgInByaWNlIjogIjEwNS4wIiwgInN0b2NrIjogNjIwLCAiZmF2b3JpdGVzX2NvdW50IjogMjQxMCwgInNhbGVzX2NvdW50IjogODUzLCAiaXRlbV9pZCI6ICI1NzgxMTQ2NTF4eHh4In0KXQ==)\[\{"item\_title":"PiPStudioUnisexDutchImportedMug","attribute":"Color:Orange","brand":"PiPStudio","price":"105\.0","stock":620,"favorites\_count":2410,"sales\_count":853,"item\_id":"578462125xxxx"\},\{"item\_title":"PiPStudioUnisexDutchImportedMug","attribute":"Color:ChocolateBrown","brand":"PiPStudio","price":"118\.0","stock":582,"favorites\_count":2410,"sales\_count":878,"item\_id":"578114651xxxx"\},\{"item\_title":"PiPStudioUnisexDutchImportedMug","attribute":"Color:SkyBlue","brand":"PiPStudio","price":"105\.0","stock":620,"favorites\_count":2410,"sales\_count":853,"item\_id":"578114651xxxx"\}\]

### \-CStructured Decision Memory Example

Example: Structured Decision MemoryProfile:Brand LoyalistEfficiency:ConsideredIntent Reasoning:User exhibited highly goal\-directed behavior for women’s comfort loungewear\. On Oct 1 \(15:50\), searched “Fenteng cotton loungewear”, inspected attributes \(XXL, beige\), added to cart, and repeatedly viewed media to validate comfort\. At 15:52, briefly explored an alternative \(“Hannaguo modal loungewear set”\) but returned to Fenteng within 1 min, reinforcing brand trust\. After a cooling\-off period, replayed video/images on Oct 7 \(09:38\) for final confirmation, purchasing at 125 \(orig\. 318\) at 09:40\. Core drivers: brand reliability and material safety; alternative exploration merely reinforced the initial choice\.Preference Factors:•Brand: Fenteng – Consistent focus from search to purchase with repeated interactions\.\(High\)•Material: Cotton – Explicitly required; no non\-cotton alternatives considered\.\(High\)•Price Range: 100\-200 – Final payment \(125\) falls in range; accepted discount\.\(Medium\)Avoidance Factors:•Material: Modal – Briefly viewed Hannaguo modal product but abandoned it in favor of cotton option\(Medium\)

### \-DPrompt Templates

Prompt Template for MARI\# Role & TaskYou are a senior e\-commerce shopping advisor\. Given the user’s \[Historical Decisions\], \[Recent Behaviors\], and \[Candidate Items\], predict the single item the user is most likely to purchase next\.\# Decision Logic \(in order of priority\)1\.Intent Recognition: Analyze commonalities across recent behaviors and decisions \(e\.g\., brand preference, price range, urgent needs\)\.2\.Logical Judgment:\- If\[Candidate Items\]is non\-empty: Select the single item from the pool that best aligns with the user’s recent behavior and exhibits the strongest purchase intent\.\- If\[Candidate Items\]is empty: Revisit \[Recent Behaviors\] and select the single item with the strongest recent purchase intent\.\# Output Format \(Strict JSON\)\{"reasoning": "A logical and coherent explanation","item\_title": "Full name of the predicted item","item\_id": "Unique ID of the predicted item"\}\# Runtime Input VariablesHistorical Decisions: \{Historical\_Decisions\}Recent Behaviors: \{Recent\_Behaviors\}Candidate Items: \{Candidate\_Items\}

Similar Articles

@mem0ai: https://x.com/mem0ai/status/2107873474517889201

X AI KOLs Following

Jev-Mem:一篇来自UT Dallas的论文提出用TypeSafe AI的Jev结构化输出模型替代LLM来处理智能体记忆系统中的大量小型决策(如记忆分类、关联判断、检索停止条件),仅在最终生成答案时才调用LLM,从而显著降低token开销。