Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment

# Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment
Source: [https://arxiv.org/html/2609.18249](https://arxiv.org/html/2609.18249)
Jian WangXiaoyan ZhaoAffiliation:The Chinese University of Hong Kongdongding88\.lin@connect\.polyu\.hkwangjian51@scu\.edu\.cnxzhao@se\.cuhk\.edu\.hkcswjli@comp\.polyu\.edu\.hkWenjie LiAffiliation:Department of Computing, The Hong Kong Polytechnic UniversityAffiliation:College of Computer Science, Sichuan University

###### Abstract

Real\-world recommendation scenarios are commonly grounded in shared physical environments during user–recommender interactions\. This motivates situated conversational recommendation \(SCR\), a complex task requiring recommender assistants to jointly reason over dialogue history, co\-observed scenes, and in\-scene item attributes\. However, current approaches struggle with this setting due to two intertwined challenges: accurately understanding situated user preferences throughout the conversation and generating responses that simultaneously satisfy user needs and grounded situations\. To this end, we proposeRe2A, a framework that formulates SCR as a structuredreason\-then\-alignprocess\. We introduce rubric\-based preference reasoning, which uses automated rubrics to guide the model toward producing explicit preference states\. Based on these states, we propose a preference\-conditioned optimization to align response generation with dual objectives: user preference satisfaction and situation consistency\. Extensive experiments on two SCR datasets demonstrate thatRe2Aconsistently outperforms state\-of\-the\-art methods, delivering more precise, context\-aware conversational recommendations\. Our code is available at[https://github\.com/DongdingLin/Re2A](https://github.com/DongdingLin/Re2A)\.

11footnotetext:Corresponding author\.## 1Introduction

Conversational recommendation[Li et al\. \(2018\)](https://arxiv.org/html/2609.18249#bib.bib1), which aims to deliver personalized recommendations through natural language interactions, has been a pivotal research area in recent years\. Most existing conversational recommendation systems primarily operate in a language\-only setting[Zhou et al\. \(2022\)](https://arxiv.org/html/2609.18249#bib.bib3);[Yang and Chen \(2024\)](https://arxiv.org/html/2609.18249#bib.bib17);[Yoon et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib18), ignoring the physical environment in which users are located\. However, real\-world recommendation scenarios, such as navigating live promotions in clothing or furniture stores, are inherentlysituated, where effective communication relies on a shared observation of the surrounding environment[Moon et al\. \(2020\)](https://arxiv.org/html/2609.18249#bib.bib6);[Kottur et al\. \(2021\)](https://arxiv.org/html/2609.18249#bib.bib2)\. This motivates the study of Situated Conversational Recommendation \(SCR\)[Lin et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib8);[Wang et al\. \(2025\)](https://arxiv.org/html/2609.18249#bib.bib12);[Lin et al\. \(2026\)](https://arxiv.org/html/2609.18249#bib.bib30)\. SCR focuses on multimodal interactions between users and conversational agents, which are required to recommend items by considering dialogue history, co\-observed visual scenes, and in\-scene item attributes\. Shifting from a “text\-only” to a “scene\-aware” formulation, SCR transforms conversational agents from isolated recommenders into situated assistants[Mukande et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib23);[Zhang et al\. \(2025\)](https://arxiv.org/html/2609.18249#bib.bib34);[VanderHoeven et al\. \(2025\)](https://arxiv.org/html/2609.18249#bib.bib35)\.

![Refer to caption](https://arxiv.org/html/2609.18249v1/intro_example.png)Figure 1:An illustrative example of situated conversational recommendation, where user preference reasoning and situation alignment are two key aspects\.Despite its potential, SCR poses two fundamental challenges that distinguish it from conventional conversational recommendation, yet this direction remains underexplored\. As illustrated in Figure[1](https://arxiv.org/html/2609.18249#S1.F1), the first challenge lies ininferring users’ situated preferences \(or needs\)\. Unlike text\-only settings, user preferences in SCR are tightly coupled with the located scene and may depend on implicit needs, visually similar items, or even shift dynamically with the environment\. The complexity of such multimodal contexts makes it difficult for models to accurately infer the user’s underlying intent\. The second challenge concerns how to effectivelyleverage situated preferences and scene information to generate appropriate responses\. In SCR, recommendation responses are subject to dual objectives, as they must satisfy user preferences while grounding in visible candidate items\. Addressing this challenge demands dual alignment with both the user and the environment, enabling agents to deliver recommendations that are not only relevant but also contextually appropriate\.

In this paper, we proposeRubric\-based PreferenceReasoning andAlignment \(Re2A\), a framework that formulates SCR as areason\-then\-alignprocess\. Rather than introducing a new optimization algorithm, our core insight is to derive a structured preference state that serves as a shared interface among situated reasoning and response generation\.Re2Aperforms rubric\-based preference reasoning, explicitly inferring intermediate user preference states from the dialogue history and co\-observed scenes\. Inspired by the Chain\-of\-Thought reasoning[Wei et al\. \(2022\)](https://arxiv.org/html/2609.18249#bib.bib19), these preference states are represented in a structured textual form, making the reasoning process inspectable\. Unlike free\-form CoT rationales, the preference state explicitly records the inferred user needs, attribute constraints, and visual target before any item is recommended\. As collecting verifiable supervision for such reasoning is costly, we employ context\-aware, multi\-dimensional rubrics to obtain rewards and optimize the model via policy optimization[Shao et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib20), encouraging robust preference reasoning under complex situational contexts\.

Building upon the reasoned preference states,Re2Aaddresses the second challenge through dual\-alignment response generation\. We formulate response generation as a contrastive learning problem[Rafailov et al\. \(2023\)](https://arxiv.org/html/2609.18249#bib.bib21)and introduce a user preference\-conditioned optimization objective\. By constructing heterogeneous negative responses that specifically violate either user preferences or scene constraints, the model learns to align its outputs with both situation consistency and user intent satisfaction\. As a result,Re2Aproduces recommendations that are contextually appropriate\.

Our contributions are summarized as follows:

- •We proposeRe2A, a novel framework for SCR that reformulates the task as a structuredreason\-then\-alignprocess, explicitly separating situated preference reasoning from response alignment\. The framework centers on a structured preference state that acts as a shared interface among preference reasoning, scene\-constrained item recommendation, and response generation\.
- •We leverage rubric\-guided policy optimization to derive explicit user preference states, while introducing user preference\-conditioned optimization with rubric\-based candidates to achieve dual alignment with both user intent and situational constraints\. This avoids manual annotation of reasoning traces by leveraging automated rubric induction and synthetic preference construction\.
- •Experiments across two SCR datasets demonstrate thatRe2Aconsistently outperforms competitive approaches, producing recommendations that better capture users’ situated needs while remaining factually aligned with situations\.

## 2Task Definition

We formulate SCR as a sequential decision\-making process within a shared multimodal environment\. The environment comprises a collection of visual scenes\{𝒮i\}i=1M\\\{\\mathcal\{S\}\_\{i\}\\\}\_\{i=1\}^\{M\}, where each scene𝒮i\\mathcal\{S\}\_\{i\}contains its own candidate item setℐi=\{oi,j\}j=1Ni\\mathcal\{I\}\_\{i\}=\\\{o\_\{i,j\}\\\}\_\{j=1\}^\{N\_\{i\}\}\. Crucially, each itemoi,jo\_\{i,j\}is a multimodal entity, characterized jointly by its visual appearance \(e\.g\., color\), spatial coordinates, and structured metadata \(e\.g\., price\)\. At thett\-th turn, the agent receives a situated contextXt=\(𝒮t,ℐt,𝒞t\)X\_\{t\}=\(\\mathcal\{S\}\_\{t\},\\mathcal\{I\}\_\{t\},\\mathcal\{C\}\_\{t\}\), composed of the co\-observed scene𝒮t\\mathcal\{S\}\_\{t\}, scene\-specific item setℐt\\mathcal\{I\}\_\{t\}, and the dialogue context𝒞t=\{u1,Y1,…,ut−1,Yt−1,ut\}\\mathcal\{C\}\_\{t\}=\\\{u\_\{1\},Y\_\{1\},\\ldots,u\_\{t\-1\},Y\_\{t\-1\},u\_\{t\}\\\}, which includes past conversations and the current user utteranceutu\_\{t\}\.

The objective of SCR is to learn a mapping function that utilizes this context to simultaneously: \(1\) identify the appropriate target itemot∗∈ℐto\_\{t\}^\{\*\}\\in\\mathcal\{I\}\_\{t\}that satisfies the user’s needs; and \(2\) generate a natural language responseYtY\_\{t\}that is aligned with the user’s preference while remaining grounded in the scene\.

## 3Method

![Refer to caption](https://arxiv.org/html/2609.18249v1/method.png)Figure 2:Overview of the proposedRe2Aframework for situated conversational recommendation\.In this section, we presentRubric\-based PreferenceReasoning andAlignment \(Re2A\) for situated conversational recommendation\. Figure[2](https://arxiv.org/html/2609.18249#S3.F2)shows the overview ofRe2A, which follows a three\-step pipeline: rubric\-guided preference reasoning \(see §[3\.1](https://arxiv.org/html/2609.18249#S3.SS1)\), dual alignment with user and situation \(see §[3\.2](https://arxiv.org/html/2609.18249#S3.SS2)\), and cascaded inference \(see §[3\.3](https://arxiv.org/html/2609.18249#S3.SS3)\)\.

### 3\.1Rubric\-Guided Preference Reasoning

Accurately inferring latent user needs presents a fundamental challenge in SCR\. Relying solely on item labels to supervise preference reasoning risks capturing superficial correlations while failing to grasp the rationale determining how specific spatial or visual cues motivated the choice\. To bridge this gap, we pivot the reasoning objective from predicting thewhatto explaining thewhy\. Given that this intermediate reasoning lacks natural supervision, we introduce a rubric\-based framework to provide verifiable and process\-oriented guidance\. This design differs from generic CoT and conventional state tracking in two respects\. First, the agent leverages its thinking ability to yield a structured preference state that records the possible user needs, attribute constraints, and visual targets\. Second, since the intermediate state has no direct annotation, the turn\-relevant rubrics evaluate each thinking process and its resulting state against evidence in the co\-observed scene, rather than supervising individual reasoning steps\.

#### Automated Rubric Induction\.

To derive scalable supervision without manually annotating preference\-reasoning traces, we construct a global rubric setℛ\\mathcal\{R\}via an induction process driven by a Multimodal Large Language Model \(MLLM\)\. Given a small curated seed dataset𝒟seed=\{\(𝒮k,𝒞k\)\}k=1K\\mathcal\{D\}\_\{\\text\{seed\}\}=\\\{\(\\mathcal\{S\}\_\{k\},\\mathcal\{C\}\_\{k\}\)\\\}\_\{k=1\}^\{K\}, and a constitutional meta\-instructionℐmeta\\mathcal\{I\}\_\{\\text\{meta\}\}\(see Appendix[A\.1](https://arxiv.org/html/2609.18249#A1.SS1)\), we prompt the MLLM to yield reasoning criteria, formulating a rubric set\. The rubric set is structured into the following four facets:

ℛ=ℛsit∪ℛrel∪ℛcon∪ℛaux,\\mathcal\{R\}=\\mathcal\{R\}\_\{\\text\{sit\}\}\\cup\\mathcal\{R\}\_\{\\text\{rel\}\}\\cup\\mathcal\{R\}\_\{\\text\{con\}\}\\cup\\mathcal\{R\}\_\{\\text\{aux\}\},\(1\)whereℛsit\\mathcal\{R\}\_\{\\text\{sit\}\}\(Situatedness\) evaluates visual grounding \(e\.g\., spatial references\),ℛrel\\mathcal\{R\}\_\{\\text\{rel\}\}\(Item Relevance\) assesses alignment with the constraint of item attributes,ℛcon\\mathcal\{R\}\_\{\\text\{con\}\}\(Consistency\) ensures logical coherence with dialogue history, andℛaux\\mathcal\{R\}\_\{\\text\{aux\}\}\(Auxiliary\) captures domain\-specific criteria beyond the prior three facets identified by the MLLM\. Crucially, each rubricr∈ℛr\\in\\mathcal\{R\}is formulated as a binary predicate functionr⁡\(⋅\)→\{0,1\}r\(\\cdot\)\\to\\\{0,1\\\}, enabling standardized binary evaluation by a frozen MLLM judge \(see Appendix[A\.2](https://arxiv.org/html/2609.18249#A1.SS2)for concrete examples\)\. These four facets follow SCR’s core requirements of visual grounding, constraint satisfaction, and multi\-turn coherence; a manual coverage check on 50 sampled dialogue turns finds that all turn\-level requirements map onto these facets \(Appendix[I\.1](https://arxiv.org/html/2609.18249#A9.SS1)\)\.

#### Dynamic Rubric Selection\.

Uniformly applying the global rubric setℛ\\mathcal\{R\}across dynamic dialogue turns introduces noisy supervision, as irrelevant constraints obscure the reasoning focus\. To this end, we employ a dynamic rubric selector, instantiated by a frozen MLLM \(πsel\\pi\_\{\\text\{sel\}\}\), to select a pertinent subsetℛact⊂ℛ\\mathcal\{R\}\_\{\\text\{act\}\}\\subset\\mathcal\{R\}conditioned on the situated contextXtX\_\{t\}\. By analyzing the primary communicative needs,πsel\\pi\_\{\\text\{sel\}\}gates inactive criteria\. For instance, a purely spatial query such as “the one on the left” primarily activates situatedness rubrics, whereas a mixed query such as “the red one on the left” activates both situatedness and item\-relevance rubrics\. This selective activation provides denser and less noisy supervision\. The prompting template is provided in Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px1)\.

#### Preference State Generation with Rubric\-based Rewards\.

To bridge raw multimodal context and structured preference inference, we train a preference reasoning modelπθ\\pi\_\{\\theta\}to generate user preference reasoning traces explicitly\. Given the situated contextXXand a structural instructionℐreason\\mathcal\{I\}\_\{\\text\{reason\}\}\(see Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px2)\),πθ\\pi\_\{\\theta\}produces a*preference thought*𝒯\\mathcal\{T\}, which captures intermediate reasoning over preference shifts and spatial constraints, followed by a structured*preference state*𝒫\\mathcal\{P\}that formalizes the inferred user needs, attribute constraints, and visual targets into a structured textual format for prompt\-based item recommendation and rubric verification\.

Since such preference states are latent and lack direct supervision, we adopt a group\-based learning strategy to provide relative training signals\. During each training step,πθ\\pi\_\{\\theta\}samples a group ofGGreasoning candidates\{𝒪1,…,𝒪G\}\\\{\\mathcal\{O\}\_\{1\},\\ldots,\\mathcal\{O\}\_\{G\}\\\}, where each𝒪g=\(𝒯g,𝒫g\)\\mathcal\{O\}\_\{g\}=\(\\mathcal\{T\}\_\{g\},\\mathcal\{P\}\_\{g\}\)\. Attt\-th turn, the dynamically selected rubric subsetℛact\\mathcal\{R\}\_\{\\text\{act\}\}serves as the evaluation standard\. We use MLLM\-as\-a\-Judge to assess whether each candidate satisfies the active rubrics, yielding a set of binary verification outcomes\. Formally, we instantiate this judge as a binary evaluatorfjudge:\(𝒪g,r,Xt\)→\{0,1\}f\_\{\\text\{judge\}\}:\(\\mathcal\{O\}\_\{g\},r,X\_\{t\}\)\\rightarrow\\\{0,1\\\}using a frozen Qwen3\-VL\-8B\-Instruct\([Bai et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib14)\)model\. For each active rubric, the evaluator receives the situated context, candidate preference thought, preference state, rubric question, and its evidence indicators, then it outputs a structured JSON verdict with supporting evidence; a deterministic parser mapsYESto 1 andNOto 0\. The exact judging prompt is provided in Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px3)\.

Concretely, each rubricr∈ℛactr\\in\\mathcal\{R\}\_\{\\text\{act\}\}functions as a binary criterion\. The scalar rewardRgR\_\{g\}for candidate𝒪g\\mathcal\{O\}\_\{g\}is computed as the satisfaction rate:

Rg=1\|ℛact\|​∑r∈ℛactfjudge​\(𝒪g,r,Xt\)\.R\_\{g\}=\\frac\{1\}\{\|\\mathcal\{R\}\_\{\\text\{act\}\}\|\}\\sum\_\{r\\in\\mathcal\{R\}\_\{\\text\{act\}\}\}f\_\{\\text\{judge\}\}\(\\mathcal\{O\}\_\{g\},r,X\_\{t\}\)\.\(2\)Rather than relying on absolute reward values, we compute the relative advantage to reduce variance:

Ag=Rg−μRσR\+ϵ,A\_\{g\}=\\frac\{R\_\{g\}\-\\mu\_\{R\}\}\{\\sigma\_\{R\}\+\\epsilon\},\(3\)whereμR\\mu\_\{R\}andσR\\sigma\_\{R\}denote the mean and standard deviation of rewards\{R1,…,RG\}\\\{R\_\{1\},\\ldots,R\_\{G\}\\\}within the group, andϵ\\epsilonensures numerical stability\.

We optimizeπθ\\pi\_\{\\theta\}using Group Relative Policy Optimization \(GRPO\)[Shao et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib20)\. By leveraging group\-normalized advantages, GRPO not only stabilizes optimization to favor reasoning traces that satisfy active situated constraints, but also eliminates the need for an explicit value network, thereby significantly reducing the memory overhead of training on high\-dimensional multimodal inputs\. The objective function is defined as:

𝒥\\displaystyle\\mathcal\{J\}\(θ\)=1G∑g=1G\(min\(ρg\(θ\)Ag,clip\(ρg\(θ\),\\displaystyle\(\\theta\)=\\frac\{1\}\{G\}\\sum\_\{g=1\}^\{G\}\\bigg\(\\min\\bigg\(\\rho\_\{g\}\(\\theta\)A\_\{g\},\\text\{clip\}\(\\rho\_\{g\}\(\\theta\),\(4\)1−ε,1\+ε\)Ag\)−β⋅𝔻KL\(πθ\|\|πref\)\),\\displaystyle 1\-\\varepsilon,1\+\\varepsilon\)A\_\{g\}\\bigg\)\\ \-\\beta\\cdot\\mathbb\{D\}\_\{\\text\{KL\}\}\(\\pi\_\{\\theta\}\|\|\\pi\_\{\\text\{ref\}\}\)\\bigg\),whereρg​\(θ\)=πθ​\(𝒪g∣X\)πold​\(𝒪g∣X\)\\rho\_\{g\}\(\\theta\)=\\frac\{\\pi\_\{\\theta\}\(\\mathcal\{O\}\_\{g\}\\mid X\)\}\{\\pi\_\{\\text\{old\}\}\(\\mathcal\{O\}\_\{g\}\\mid X\)\}is the probability ratio,πref\\pi\_\{\\text\{ref\}\}is the reference policy \(initialized from the supervised baseline\), andβ\\betacontrols the KL\-divergence penalty to prevent policy collapse\.

### 3\.2Dual Alignment with User and Situation

Building upon the preference state𝒫\\mathcal\{P\}inferred byπθ\\pi\_\{\\theta\}, we aim to generate responses simultaneously aligned with user preferences and grounded in the scene\. We note that responses satisfying user preferences risk violating physical constraints \(e\.g\., hallucinating absent items\), whereas strictly scene\-consistent responses may fail to capture the user’s actual needs\. Therefore, we formulate response generation as a conditional alignment problem\. Specifically, we propose a*user preference\-conditioned DPO*method for response generation, building on top of vanilla DPO\([Rafailov et al\., 2023](https://arxiv.org/html/2609.18249#bib.bib21)\), where the optimization trajectory is explicitly guided by the inferred preference state\.

#### Heterogeneous Preference Pair Construction\.

To provide fine\-grained supervision, we construct heterogeneous negative responses targeting distinct failure modes in SCR\. For each ground\-truth responseYwY\_\{w\}, we leverage an LLM to automatically synthesize two types of negative samples using specific instruction templates \(see Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px4)\):\(i\) Situation\-conflicting negatives \(Yl​1Y\_\{l1\}\)are constructed by injecting hallucinations that contradict the observed scene𝒮\\mathcal\{S\}, such as recommending absent items or referencing non\-existent spatial landmarks\. These pairs explicitly penalize violations of visual grounding\.\(ii\) Preference\-conflicting negatives \(Yl​2Y\_\{l2\}\)are generated by substituting the target item inYwY\_\{w\}with a distractor item that is present in the scene but contradicts the inferred preference state𝒫\\mathcal\{P\}\(e\.g\., violating price or attribute constraints\)\. These pairs penalize responses that are grounded yet misaligned with user needs\. A post\-hoc validation with both model and human evaluators confirms that the synthesized negatives satisfy the conflicts \(see Appendix[I\.1](https://arxiv.org/html/2609.18249#A9.SS1)\)\.

#### Alignment Training\.

We adopt two\-stage alignment training to optimize the response generation policyφθ\\varphi\_\{\\theta\}\. We condition the response generator during training on the ground\-truth target itemo∗o^\{\*\}as a teacher\-forced grounding anchor\. This use ofo∗o^\{\*\}supervises how the generator verbalizes a recommendation once the target item is specified, rather than supervising the preference\-reasoning stage described in §[3\.1](https://arxiv.org/html/2609.18249#S3.SS1)\. During inference, the oracle anchor is unavailable and is replaced by the retrieved item\. Thus, the training\-inference discrepancy is confined to the source of the grounding anchor, while the generator is consistently conditioned on an explicit item in both phases\.

Concretely, we first perform supervised fine\-tuning\. Given the fully grounded contextX~=\(𝒮,𝒞,𝒫,o∗\)\\tilde\{X\}=\(\\mathcal\{S\},\\mathcal\{C\},\\mathcal\{P\},o^\{\*\}\), we maximize the likelihood of the responseYwY\_\{w\}:

ℒSFT​\(θ\)=−𝔼\(X~,Yw\)∼𝒟​\[log⁡φθ​\(Yw∣X~\)\]\.\\mathcal\{L\}\_\{\\text\{SFT\}\}\(\\theta\)=\-\\mathbb\{E\}\_\{\(\\tilde\{X\},Y\_\{w\}\)\\sim\\mathcal\{D\}\}\\big\[\\log\\varphi\_\{\\theta\}\(Y\_\{w\}\\mid\\tilde\{X\}\)\\big\]\.\(5\)This yields a reference policyφref\\varphi\_\{\\text\{ref\}\}\. Subsequently, we employ DPO using the constructed heterogeneous pairs\. The objective is defined as:

ℒDPO\(θ\)=−𝔼\(X~,Yw,Yl\)∼𝒟mix\[logσ\(\\displaystyle\\mathcal\{L\}\_\{\\text\{DPO\}\}\(\\theta\)=\-\\mathbb\{E\}\_\{\(\\tilde\{X\},Y\_\{w\},Y\_\{l\}\)\\sim\\mathcal\{D\}\_\{\\text\{mix\}\}\}\\Big\[\\log\\sigma\\Big\(\(6\)βDPO\(logφθ​\(Yw∣X~\)φref​\(Yw∣X~\)−logφθ​\(Yl∣X~\)φref​\(Yl∣X~\)\)\)\],\\displaystyle\\beta\_\{\\text\{DPO\}\}\\big\(\\log\\frac\{\\varphi\_\{\\theta\}\(Y\_\{w\}\\mid\\tilde\{X\}\)\}\{\\varphi\_\{\\text\{ref\}\}\(Y\_\{w\}\\mid\\tilde\{X\}\)\}\-\\log\\frac\{\\varphi\_\{\\theta\}\(Y\_\{l\}\\mid\\tilde\{X\}\)\}\{\\varphi\_\{\\text\{ref\}\}\(Y\_\{l\}\\mid\\tilde\{X\}\)\}\\big\)\\Big\)\\Big\],whereβDPO\\beta\_\{\\text\{DPO\}\}controls the KL\-divergence penalty relative toφref\\varphi\_\{\\text\{ref\}\}\. Training on𝒟mix\\mathcal\{D\}\_\{\\text\{mix\}\}, a mixture of situation\-centric\(Yw,Yl​1\)\(Y\_\{w\},Y\_\{l1\}\)and preference\-centric\(Yw,Yl​2\)\(Y\_\{w\},Y\_\{l2\}\)pairs, enforces dual constraints:Yl​1Y\_\{l1\}penalizes referencing absent entities \(grounding\), whileYl​2Y\_\{l2\}ensures consistency with the preference state and its corresponding target anchor over scene\-valid distractors \(alignment\)\. Consequently,φθ\\varphi\_\{\\theta\}converges to a policy simultaneously grounded in the scene and aligned with the user preference\.

### 3\.3Cascaded Inference

To translate reasoning\-derived preferences into grounded recommendations at inference time,Re2Aadopts a cascaded strategy that decouples item retrieval from response generation\. In this design, the inferred preference state𝒫\\mathcal\{P\}serves as a pivot, transforming implicit user needs into explicit retrieval constraints before response generation\.

#### Item Recommendation\.

We identify target items through a constrained preference\-to\-item parser\. Given the generated preference state𝒫\\mathcal\{P\}, the parser ranks visible candidates inℐ\\mathcal\{I\}according to how well their visual attributes, spatial positions, and metadata satisfy the explicit constraints in𝒫\\mathcal\{P\}\. In practice, this parser is instantiated with the same backbone model under a deterministic ranking prompt \(see Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px5)\); it does not introduce an additional learned ranking objective, but operationalizes the reasoned preference state by mapping it onto the scene\-specific candidate item set\. This keeps item selection more transparent and restricts the search space to physically visible items\.

#### Aligned Response Generation\.

From the ranked candidates, we select the top\-ranked itemo^\\hat\{o\}to drive response generation\. Conditioned on the situated context\(𝒮,𝒞,𝒫,o^\)\(\\mathcal\{S\},\\mathcal\{C\},\\mathcal\{P\},\\hat\{o\}\), the modelφθ\\varphi\_\{\\theta\}generates an appropriate response at each turn\. This explicit conditioning anchors the narrative to the specific targeto^\\hat\{o\}, ensuring the response is simultaneously grounded in the surrounding scene and aligned with user preferences\.

## 4Experimental Setup

BackboneMethodSIMMC 2\.1SCREENHit@1Recall@5MRR@5NDCG@5Hit@1Recall@5MRR@5NDCG@5LLaVA\-NeXTVanilla Prompting11\.6312\.0811\.8011\.8714\.8115\.2914\.9915\.06ICL14\.0215\.7114\.6514\.9116\.3818\.0617\.0017\.27CoT13\.5914\.8414\.0514\.2515\.7718\.5216\.7917\.22SFT23\.1430\.6725\.9327\.1124\.9630\.1326\.8727\.68CRAG27\.9138\.0431\.8633\.4329\.4839\.1534\.0535\.38ReGeS32\.1856\.8939\.0943\.3435\.2961\.9441\.1045\.99Re2A\(Ours\)40\.3560\.3748\.8351\.7441\.0365\.8152\.0355\.53Qwen3\-VLVanilla Prompting15\.3717\.9116\.5216\.8819\.6221\.0320\.1420\.36ICL18\.2522\.0620\.1620\.6522\.1725\.9123\.5524\.14CoT17\.5519\.5318\.4218\.7021\.4125\.7623\.0223\.70SFT31\.2439\.1433\.2034\.6134\.5840\.7136\.5837\.58CRAG35\.6445\.3138\.6240\.2837\.0948\.3540\.1842\.13ReGeS39\.4558\.7443\.7847\.3041\.7264\.1950\.0353\.56Re2A\(Ours\)48\.1265\.0854\.2256\.8949\.6370\.4758\.4461\.52

Table 1:Evaluation results of different preference reasoning methods for situated conversational recommendation\. The best results are highlighted inbold\.#### Datasets\.

We evaluateRe2Aon two typical SCR datasets:SIMMC 2\.1\([Kottur and Moon, 2023](https://arxiv.org/html/2609.18249#bib.bib7)\)andSCREEN\([Lin et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib8)\)\. SIMMC 2\.1 features photorealistic 3D scenes in fashion and furniture domains, presenting significant challenges in visual grounding and coreference resolution within dense visual environments\. In contrast, SCREEN focuses on implicit preference reasoning, containing synthesized dialogues with evolving personas and complex attribute constraints that require multi\-turn logic tracking\. We unify these sources into standard tuples for consistent training\. Detailed statistics are provided in Appendix[C](https://arxiv.org/html/2609.18249#A3)\. The average dialogue contains roughly 10 turns, so the textual history itself can typically fit within modern 8K∼\\sim32K context windows\. The central difficulty instead comes from visual density, where each scene contains 19\.7 objects on average, forcing the model to distinguish fine\-grained spatial and attribute cues from many scene\-valid distractors\.

#### Backbone Models\.

To validate ourRe2Aframework across varying model architectures, we implementRe2Aon two state\-of\-the\-art open\-source MLLMs:LLaVA\-NeXT\([Liu et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib9)\)andQwen3\-VL\([Bai et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib14)\)\. We select LLaVA\-NeXT to exploit its dynamic high\-resolution image encoding, a critical feature for discerning fine\-grained visual attributes in dense SCR scenes \(e\.g\., distinguishing similar furniture\)\. Additionally, we employ Qwen3\-VL to harness its superior instruction\-following and logical reasoning capabilities, ensuring robust adherence to complex, multi\-turn attribute and spatial constraints\.

#### Baseline Methods\.

We compareRe2Aagainst three distinct types of methods\.\(1\) Inference\-Only Strategies:We employ Vanilla Prompting, In\-Context Learning \(ICL\), and Chain\-of\-Thought \(CoT\) to probe the intrinsic reasoning capabilities of the backbones without parameter updates\.\(2\) Multimodal Fine\-Tuning:We establish standard SFT on the target datasets as the foundational baseline for learnable methods\.\(3\) Adapted Conversational Recommendation Methods:We adapt two cutting\-edge conversational recommendation methods for the SCR setting: CRAG\([Zhu et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib16)\), which utilizes collaborative retrieval to bridge semantic gaps, and ReGeS\([Yang and Fang, 2025](https://arxiv.org/html/2609.18249#bib.bib15)\), which optimizes candidate selection through reciprocal retrieval\-generation synergy\. For a fair comparison, all learnable baselines are equipped with the same multimodal backbones\.

DataMethodJudge\-Avg↑\\uparrowSR↑\\uparrowVHR↓\\downarrowHuman\-Avg↑\\uparrowSIMMCVanilla5\.2915\.145\.70\.94ICL6\.0217\.739\.61\.11CoT6\.3216\.438\.41\.2SFT7\.8229\.625\.41\.47CRAG8\.1734\.319\.71\.57ReGeS8\.4938\.615\.21\.65Re2A9\.3146\.85\.21\.87SCREENVanilla5\.4916\.942\.10\.97ICL6\.1619\.736\.41\.15CoT6\.5118\.434\.91\.24SFT7\.9431\.724\.11\.51CRAG8\.336\.118\.61\.61ReGeS8\.5640\.914\.61\.7Re2A9\.1948\.65\.11\.86

Table 2:Response generation performance with the Qwen3\-VL backbone\. Full evaluation results are provided in Appendix[F](https://arxiv.org/html/2609.18249#A6)\.
#### Evaluation Protocols\.

We employ a multidimensional protocol to evaluate recommendation accuracy and response generation quality\. Forrecommendation, we report Hit@1, Recall@5, MRR@5, and NDCG@5 to measure ranking alignment with ground\-truth items\. All inference\-time results are obtained with the full cascaded pipeline: the response generator is conditioned on the retrieved itemo^\\hat\{o\}produced by preference\-to\-item parsing, rather than the oracle targeto∗o^\{\*\}used as a teacher\-forced grounding anchor during response\-generator training\. Since no manual correction is applied to predicted preference states or resolved items, errors propagated from upstream stages are already reflected in all reported results\.

Forresponse generation, we adopt a three\-tiered strategy: \(1\)LLM\-as\-a\-Judge \(turn\-level\):We employ GPT\-5\.2 to score generated responses \(1–10\) onvisual fidelity\(VF\) for hallucination detection,constraint compliance\(CC\) for preference satisfaction, andconversational helpfulness\(CH\)\. \(2\)User simulation \(dialogue\-level\):Through interaction with a simulator \(max 20 turns\), we reportsuccess rate\(SR\)\. Crucially, to diagnose the alignment dilemma, we measureweak\-match rate\(WMR\) andvisual hallucination rate\(VHR\)\. \(3\)Human evaluation:Annotators rate responses \(0∼\\sim2\) onsituational grounding\(Ground\.\),preference alignment\(Align\.\), andlogical coherence\(Coher\.\)\. Appendix[D](https://arxiv.org/html/2609.18249#A4)provides detailed definitions and prompts\. Appendix[I\.2](https://arxiv.org/html/2609.18249#A9.SS2)further verifies the robustness of these protocols with independent judges and alternative user simulators\.

#### Implementation Details\.

We instantiateRe2Awith LLaVA\-NeXT\([Liu et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib9)\)and Qwen3\-VL\([Bai et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib14)\), training only LoRA adapters while freezing visual modules\. GPT\-5\.2 supports offline rubric and negative construction, and a frozen Qwen3\-VL serves as the training\-time selector and judge\. Full optimization, decoding, and infrastructure settings are provided in Appendix[E](https://arxiv.org/html/2609.18249#A5)\.

## 5Results and Analyses

### 5\.1Main Results

#### Recommendation Performance\.

Table[1](https://arxiv.org/html/2609.18249#S4.T1)shows thatRe2Aachieves the best performance across metrics\. On SIMMC 2\.1, it surpasses the strongest baseline ReGeS by 8\.17 percentage points in Hit@1 \(40\.35% vs\. 32\.18%, LLaVA\-NeXT\)\. We attribute these gains to two factors: \(1\)Overcoming “Reasoning Deficit”:Standard CoT consistently underperforms ICL \(e\.g\., 17\.55% vs\. 18\.25% with Qwen3\-VL\) and often drifts into “hallucinated reasoning” by inventing visual details; rubric\-guided verification anchorsRe2Ato the scene\. \(2\)Logical Reasoning vs\. Retrieval:Retrieval baselines \(CRAG, ReGeS\) struggle with spatial negation or conditional attributes because implicit semantic similarity misses logical constraints\. The structuredreason\-then\-alignprocess models these constraints explicitly, improving grounding\. Thus, long\-context access alone is insufficient: despite short dialogue histories, dense scenes with visually plausible distractors still cause prompt\-based methods to drift toward hallucinated reasoning\.

We note that Table[1](https://arxiv.org/html/2609.18249#S4.T1)compares complete systems under their intended training objectives, and thus does not by itself isolate the contribution of our training objectives from the synthesized supervision used byRe2A\. As a call\-matched diagnostic, prompting each frozen baseline to first generate an intermediate representation improves both CRAG and ReGeS, with the structured preference state outperforming free\-form reasoning under the same call budget \(Appendix[I\.3](https://arxiv.org/html/2609.18249#A9.SS3)\), indicating that the structured interface itself contributes beyond synthesized training data\.

#### Response Generation Quality\.

Beyond recommendation accuracy,Re2Agenerates more grounded responses\. Table[2](https://arxiv.org/html/2609.18249#S4.T2)summarizes response\-quality results; full SIMMC 2\.1 and SCREEN breakdowns are provided in Appendix[F](https://arxiv.org/html/2609.18249#A6)\. On SIMMC 2\.1,Re2Aimproves visual fidelity over ReGeS under Qwen3\-VL \(see Appendix Table[11](https://arxiv.org/html/2609.18249#A6.T11)\)\. These metrics use the full cascaded setting with retrieved anchorso^\\hat\{o\}, so item\-resolution errors remain reflected in generation\. Moreover, preference\-conditioned DPO resolves thealignment dilemma: SFT exhibits high VHR by inventing attributes to force satisfaction, whereasRe2Areduces VHR by 20\.2% \(25\.4%→\\to5\.2%\) and Weak\-Match Rate by 15\.2% \(22\.6%→\\to7\.4%\)\. This confirms thatRe2Aaligns responses with user preference without compromising physical fidelity\.

\(a\)Reasoning Analysis

\(b\)Alignment Analysis

Figure 3:Ablation studies on SIMMC 2\.1\.\(a\)Our rubric\-guided reasoning yields higher accuracy \(Hit@1\) than baseline methods\.\(b\)Heterogeneous DPO achieves the lowest hallucination rates\.MethodPreference ReasoningSelector/JudgeRetrievalGenerationTotalHit@1↑\\uparrowVHR↓\\downarrow\(ms\)\(ms\)\(ms\)\(ms\)\(ms\)End\-to\-End SFT———814\.6814\.631\.24%25\.4%ReGeS——538\.2682\.71220\.939\.45%15\.2%Re2A\(Distilled 4B Reasoner\)—0\.0——1838\.446\.71%8\.2%Re2A\(Ours\)1423\.80\.0267\.5651\.42342\.748\.12%5\.2%

Table 3:Per\-turn inference latency statistics on SIMMC 2\.1 with Qwen3\-VL\. The runtime cost ofRe2Amainly comes from explicit preference reasoning, while the training\-time selector and judge are not invoked during inference\. The distilled variant replaces only the 8B preference reasoner with a distilled 4B student \(see Appendix[I\.4](https://arxiv.org/html/2609.18249#A9.SS4)\); we report its end\-to\-end latency measured under the same protocol\.

### 5\.2Ablation Studies

Figure[3](https://arxiv.org/html/2609.18249#S5.F3)shows the contribution of each component\. Appendix[G](https://arxiv.org/html/2609.18249#A7)reports full facet\-level rubric ablations\. Below, we discuss key findings\.

#### Impact of Rubric\-Guided Reasoning\.

The results in Figure[3](https://arxiv.org/html/2609.18249#S5.F3)\(a\) confirm the necessity of guided reasoning\. Removing the reasoning module entirely \(End\-to\-End SFT\) leads to a sharp 16\.9 percentage\-point drop in Hit@1 \(48\.1%→\\to31\.2%\), highlighting a severe “reasoning deficit” in black\-box models\. Moreover,Re2Aclearly outperformsFine\-tuned CoT\(40\.5%\)\. This gap indicates that the standard chain\-of\-thought is prone to semantic drift, deviating from subtle situational constraints\. Our dynamic rubrics act as logical anchors to prevent this and enforce strict visual grounding\.

#### Impact of Heterogeneous DPO\.

Figure[3](https://arxiv.org/html/2609.18249#S5.F3)\(b\) disentangles the generation quality by freezing the reasoning state\. Reverting to standard supervision \(SFT Only\) increases hallucinations by 20\.2% \(VHR: 5\.2%→\\to25\.4%\), exposing the limitation of likelihood\-based training\. Further, the suboptimal VHR of standardhomogeneous DPO\(trained with non\-targeted negatives\) indicates that generic negative sampling is insufficient\. Specifically, this variant pairs each ground\-truth response with a single generic dispreferred response produced without our situation\-conflicting and preference\-conflicting instructions, thereby removing the targetedYl​1Y\_\{l1\}andYl​2Y\_\{l2\}supervision signals\. Ourheterogeneous negativesare indispensable: they suppress hallucinations and reduce the weak\-match rate by 3\.8% \(WMR: 11\.2%→\\to7\.4%\)\. This ensures the model remains responsive to user intent while adhering to the scene, effectively balancing helpfulness and truthfulness\. Additional sensitivity and data\-efficiency analyses appear in Appendix[H](https://arxiv.org/html/2609.18249#A8)\.

### 5\.3Inference Latency Analysis

Table[3](https://arxiv.org/html/2609.18249#S5.T3)compares the runtime cost of ourRe2Aand other baseline methods\. Under Qwen3\-VL on 100 sampled SIMMC 2\.1 turns,Re2Aincreases total per\-turn latency from 1220\.9 ms for ReGeS to 2342\.7 ms\. This increase is primarily driven by the explicit preference reasoning step, which accounts for 1423\.8 ms\. Interestingly, despite the higher overall latency,Re2Aactually reduces the time spent on both retrieval \(from 538\.2 ms to 267\.5 ms\) and generation \(from 682\.7 ms to 651\.4 ms\) compared to ReGeS\. Crucially, this added computational cost yields significant performance gains, improving Hit@1 by 8\.67% \(39\.45%→\\to48\.12%\) and reducing VHR by 10\.0% \(15\.2%→\\to5\.2%\)\. As shown in Table[3](https://arxiv.org/html/2609.18249#S5.T3), the dynamic rubric selector and the judge model operate only during training and introduce zero inference\-time overhead\. Thus, the added latency reflects a deliberate accuracy\-faithfulness trade\-off anchored in preference reasoning, rather than runtime dependence on the selector or judge models\.

To further alleviate this overhead, we distill the 8B preference reasoner into a 4B student that reproduces its structured preference states, replacing only the reasoner checkpoint at evaluation time \(Appendix[I\.4](https://arxiv.org/html/2609.18249#A9.SS4)\)\. The distilled variant reduces total per\-turn latency by 504\.3 ms while retaining most of the recommendation gain \(46\.71% Hit@1\)\. In deployment, prefix or key\-value caching could reuse the unchanged scene and dialogue prefix to further improve responsiveness\.

### 5\.4Variant Analysis

We conduct a variant analysis across different judges and user simulators in Appendix[I](https://arxiv.org/html/2609.18249#A9)\. Two independent judges yield Judge\-Avg margins over ReGeS with 95% confidence intervals entirely above zero,Re2Astays ahead under an alternative user simulator, and it falls between zero\-shot and few\-shot GPT\-5\.2 \(Appendix[I\.2](https://arxiv.org/html/2609.18249#A9.SS2)\)\. The results further verify our findings: replacing the training\-time judge preserves all conclusions \(see Appendix[I\.5](https://arxiv.org/html/2609.18249#A9.SS5)\)\. Our method consistently outperforms ReGeS under zero\-shot transfer across fashion and furniture domains \(see Appendix[I\.6](https://arxiv.org/html/2609.18249#A9.SS6)\)\.

### 5\.5Qualitative Analysis

Appendix[J](https://arxiv.org/html/2609.18249#A10)shows some case studies\. The comparison against ReGeS highlights two advantages ofRe2A: \(1\)Reasoning robustness:Unlike baselines struggling with negation,Re2A’s explicit preference thought captures structural constraints \(e\.g\., processing the negation in “don’t wantlight wood finish”\)\. \(2\)Dual alignment:Our mechanism filters out visually salient distractors \(e\.g\., bright light wood furniture\) that mislead baselines\. It grounds responses in the correctly reasoned target \(the black metal shelving unit\), satisfying decor needs\.

## 6Related Work

#### Conversational Recommendation\.

Conversational Recommendation has largely followed a text\-oriented semantic\-matching paradigm\. Representative CRS methods such as CRAG\([Zhu et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib16)\)and ReGeS\([Yang and Fang, 2025](https://arxiv.org/html/2609.18249#bib.bib15)\)optimize retrieval\-generation synergy, but do not explicitly model shared physical scenes\.[Lin et al\. \(2024\)](https://arxiv.org/html/2609.18249#bib.bib8)pioneered SCR with the SCREEN benchmark, arguing that practical agents must ground recommendations within a co\-observed, multimodal environment\. Recent multimodal CRS studies address limited supervision or structured prompting, including sample\-efficient multimodal CRS training\([Su et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib37)\)and semantic graph prompt learning in MSCRS\([Wei et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib38)\)\. Other multimodal adaptations\([Wei and Yang, 2013](https://arxiv.org/html/2609.18249#bib.bib5);[Xue et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib22);[Mukande et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib23)\)add visual encoders but still rely on implicit cross\-modal alignment\. This black\-box fusion often struggles with thereasoning deficit\([Li et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib24);[Yan et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib25)\): without explicit logic, models are easily swayed by visual saliency\. Unlike these implicit paradigms, we treat SCR as structured reasoning and derive preference constraints as robust anchors, so responses remain physically grounded while still addressing user preferences\.

#### Reasoning and Alignment in MLLMs\.

Recent “System\-2 thinking” methods employ CoT\([Wei et al\., 2022](https://arxiv.org/html/2609.18249#bib.bib19)\)or GRPO\([Shao et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib20)\)to enforce verifiable logic chains\. However, SCR differs from math tasks\([Cobbe et al\., 2021](https://arxiv.org/html/2609.18249#bib.bib33)\): situated preferences are latent and ambiguous, lacking deterministic verifier signals\. In response generation, standard DPO\([Rafailov et al\., 2023](https://arxiv.org/html/2609.18249#bib.bib21)\)is also ill\-equipped for the alignment dilemma because it collapses multi\-dimensional constraints into a single scalar ranking\([Amini et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib26);[Lang et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib29)\)\. It often fails to distinguish factual grounding errors\([Li et al\., 2023](https://arxiv.org/html/2609.18249#bib.bib27);[Sahoo et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib28)\)from preference mismatches\. Our approach leverages automated rubrics\([Bai et al\., 2022](https://arxiv.org/html/2609.18249#bib.bib31);[Lee et al\., 2024](https://arxiv.org/html/2609.18249#bib.bib32)\)for dense verification and preference\-conditioned DPO with heterogeneous negatives, improving reasoning and alignment in a cascaded manner\.

## 7Conclusion

We introducedRe2A, a reason\-then\-align framework for situated conversational recommendation\. By integrating rubric\-guided reasoning with dual\-alignment preference optimization,Re2Aenables models to learn structured, verifiable reasoning traces and generate grounded responses without expensive annotation of intermediate preference states\. Our results demonstrate that shifting from implicit pattern matching to explicit reasoning substantially enhances recommendation faithfulness and situated conversation quality\. We hope this work encourages future research on verifier\-based rollback against cascaded errors, distilling these reasoning capabilities into efficient agents, and deploying situated recommendation assistants in real\-world environments\.

## Limitations

WhileRe2Ademonstrates promising results, we acknowledge several limitations\. First, the cascaded inference mechanism incurs additional latency over end\-to\-end baselines and risks error propagation, where an incorrect preference state can mislead downstream item resolution and generation\. A promising future work is to develop an independent verifier that checks the preference state and triggers a clarification request when necessary\. Second, automated rubric induction and negative sample synthesis rely on a powerful teacher LLM\. The teacher model is used only for offline data construction, yet its biases or reasoning flaws could still propagate to the induced rubrics and synthetic preference pairs\. Finally, our experiments focus on static visual scenes\. Extending the dual\-alignment constraints to dynamic environments, where objects may shift or change states during the interaction, remains an open challenge for future research\.

## Ethics Statement

We strictly follow the protocols governing the academic use of the datasets, open\-source backbones, and external LLM services\. The public datasets and open\-source backbones are used in accordance with their respective licenses\. We do not collect new personally identifying user data\. We acknowledge that the rubrics used for preference reasoning are induced by LLMs, which may carry inherent biases from their pre\-training data\. Our framework achieves better transparency by generating explicit reasoning traces\. While we use AI assistants \(e\.g\., ChatGPT\) to assist in coding and refining the writing of this manuscript, we ensure that all content and ideas originate from the authors\.

## Acknowledgements

This work was supported by the General Research Fund \(GRF\) of the Research Grants Council of Hong Kong \(PolyU 15207122 and PolyU 15205325\), and also in part by the PolyU Postdoc Matching Fund \(4\-W40Z\)\. The authors would like to thank the anonymous reviewers for their valuable feedback and constructive suggestions\.

## References

- Aminiet al\.\(2024\)A\. Amini, T\. Vieira, and R\. CotterellDirect preference optimization with an offset\.InFindings of the Association for Computational Linguistics: ACL 2024,L\. Ku, A\. Martins, and V\. Srikumar \(Eds\.\),Bangkok, Thailand,pp\. 9954–9972\.External Links:[Link](https://aclanthology.org/2024.findings-acl.592/),[Document](https://dx.doi.org/10.18653/v1/2024.findings-acl.592)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Baiet al\.\(2025\)S\. Bai, Y\. Cai, R\. Chen, K\. Chen, X\. Chen, Z\. Cheng, L\. Deng, W\. Ding, C\. Gao, C\. Ge, W\. Ge, Z\. Guo, Q\. Huang, J\. Huang, F\. Huang, B\. Hui, S\. Jiang, Z\. Li, M\. Li, M\. Li, K\. Li, Z\. Lin, J\. Lin, X\. Liu, J\. Liu, C\. Liu, Y\. Liu, D\. Liu, S\. Liu, D\. Lu, R\. Luo, C\. Lv, R\. Men, L\. Meng, X\. Ren, X\. Ren, S\. Song, Y\. Sun, J\. Tang, J\. Tu, J\. Wan, P\. Wang, P\. Wang, Q\. Wang, Y\. Wang, T\. Xie, Y\. Xu, H\. Xu, J\. Xu, Z\. Yang, M\. Yang, J\. Yang, A\. Yang, B\. Yu, F\. Zhang, H\. Zhang, X\. Zhang, B\. Zheng, H\. Zhong, J\. Zhou, F\. Zhou, J\. Zhou, Y\. Zhu, and K\. ZhuQwen3\-vl technical report\.External Links:2511\.21631,[Link](https://arxiv.org/abs/2511.21631)Cited by:[Appendix E](https://arxiv.org/html/2609.18249#A5.SS0.SSS0.Px1.p1.1),[§3\.1](https://arxiv.org/html/2609.18249#S3.SS1.SSS0.Px3.p2.1),[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px2.p1.1),[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px5.p1.1)\.
- Baiet al\.\(2022\)Y\. Bai, S\. Kadavath, S\. Kundu, A\. Askell, J\. Kernion, A\. Jones, A\. Chen, A\. Goldie, A\. Mirhoseini, C\. McKinnon, C\. Chen, C\. Olsson, C\. Olah, D\. Hernandez, D\. Drain, D\. Ganguli, D\. Li, E\. Tran\-Johnson, E\. Perez, J\. Kerr, J\. Mueller, J\. Ladish, J\. Landau, K\. Ndousse, K\. Lukosiute, L\. Lovitt, M\. Sellitto, N\. Elhage, N\. Schiefer, N\. Mercado, N\. DasSarma, R\. Lasenby, R\. Larson, S\. Ringer, S\. Johnston, S\. Kravec, S\. E\. Showk, S\. Fort, T\. Lanham, T\. Telleen\-Lawton, T\. Conerly, T\. Henighan, T\. Hume, S\. R\. Bowman, Z\. Hatfield\-Dodds, B\. Mann, D\. Amodei, N\. Joseph, S\. McCandlish, T\. Brown, and J\. KaplanConstitutional AI: harmlessness from AI feedback\.CoRRabs/2212\.08073\.External Links:[Link](https://doi.org/10.48550/arXiv.2212.08073),[Document](https://dx.doi.org/10.48550/ARXIV.2212.08073)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Cobbeet al\.\(2021\)K\. Cobbe, V\. Kosaraju, M\. Bavarian, M\. Chen, H\. Jun, L\. Kaiser, M\. Plappert, J\. Tworek, J\. Hilton, R\. Nakano, C\. Hesse, and J\. SchulmanTraining verifiers to solve math word problems\.CoRRabs/2110\.14168\.External Links:[Link](https://arxiv.org/abs/2110.14168)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Dao \(2024\)T\. DaoFlashAttention\-2: faster attention with better parallelism and work partitioning\.InThe Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7\-11, 2024,External Links:[Link](https://openreview.net/forum?id=mZn2Xyh9Ec)Cited by:[Appendix E](https://arxiv.org/html/2609.18249#A5.SS0.SSS0.Px3.p1.1)\.
- Dettmerset al\.\(2023\)T\. Dettmers, A\. Pagnoni, A\. Holtzman, and L\. ZettlemoyerQLoRA: efficient finetuning of quantized llms\.InAdvances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 \- 16, 2023,A\. Oh, T\. Naumann, A\. Globerson, K\. Saenko, M\. Hardt, and S\. Levine \(Eds\.\),External Links:[Link](http://papers.nips.cc/paper/_files/paper/2023/hash/1feb87871436031bdc0f2beaa62a049b-Abstract-Conference.html)Cited by:[Appendix E](https://arxiv.org/html/2609.18249#A5.SS0.SSS0.Px1.p1.1)\.
- Fleiss \(1971\)J\. L\. FleissMeasuring nominal scale agreement among many raters\.\.Psychological bulletin76\(5\),pp\. 378\.Cited by:[§D\.4](https://arxiv.org/html/2609.18249#A4.SS4.p1.1)\.
- Holtzmanet al\.\(2020\)A\. Holtzman, J\. Buys, L\. Du, M\. Forbes, and Y\. ChoiThe curious case of neural text degeneration\.In8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26\-30, 2020,External Links:[Link](https://openreview.net/forum?id=rygGQyrFvH)Cited by:[2nd item](https://arxiv.org/html/2609.18249#A5.I1.i2.p1.1)\.
- Kotturet al\.\(2021\)S\. Kottur, S\. Moon, A\. Geramifard, and B\. DamavandiSIMMC 2\.0: A task\-oriented dialog dataset for immersive multimodal conversations\.InProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7\-11 November, 2021,M\. Moens, X\. Huang, L\. Specia, and S\. W\. Yih \(Eds\.\),pp\. 4903–4912\.External Links:[Document](https://dx.doi.org/10.18653/V1/2021.EMNLP-MAIN.401)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Kottur and Moon \(2023\)S\. Kottur and S\. MoonOverview of situated and interactive multimodal conversations \(simmc\) 2\.1 track at dstc 11\.InProceedings of The Eleventh Dialog System Technology Challenge,pp\. 235–241\.Cited by:[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px1.p1.1)\.
- Langet al\.\(2024\)H\. Lang, F\. Huang, and Y\. LiFine\-tuning language models with reward learning on policy\.InProceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\), NAACL 2024, Mexico City, Mexico, June 16\-21, 2024,K\. Duh, H\. Gómez\-Adorno, and S\. Bethard \(Eds\.\),pp\. 1382–1392\.External Links:[Link](https://doi.org/10.18653/v1/2024.naacl-long.75),[Document](https://dx.doi.org/10.18653/V1/2024.NAACL-LONG.75)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Leeet al\.\(2024\)H\. Lee, S\. Phatale, H\. Mansoor, T\. Mesnard, J\. Ferret, K\. Lu, C\. Bishop, E\. Hall, V\. Carbune, A\. Rastogi, and S\. PrakashRLAIF vs\. RLHF: scaling reinforcement learning from human feedback with AI feedback\.InForty\-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21\-27, 2024,R\. Salakhutdinov, Z\. Kolter, K\. A\. Heller, A\. Weller, N\. Oliver, J\. Scarlett, and F\. Berkenkamp \(Eds\.\),Proceedings of Machine Learning Research, Vol\.235,pp\. 26874–26901\.External Links:[Link](https://proceedings.mlr.press/v235/lee24t.html)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Liet al\.\(2018\)R\. Li, S\. E\. Kahou, H\. Schulz, V\. Michalski, L\. Charlin, and C\. PalTowards deep conversational recommendations\.InAdvances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3\-8, 2018, Montréal, Canada,S\. Bengio, H\. M\. Wallach, H\. Larochelle, K\. Grauman, N\. Cesa\-Bianchi, and R\. Garnett \(Eds\.\),pp\. 9748–9758\.External Links:[Link](https://proceedings.neurips.cc/paper/2018/hash/800de15c79c8d840f4e78d3af937d4d4-Abstract.html)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Liet al\.\(2023\)Y\. Li, Y\. Du, K\. Zhou, J\. Wang, W\. X\. Zhao, and J\. WenEvaluating object hallucination in large vision\-language models\.InProceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6\-10, 2023,H\. Bouamor, J\. Pino, and K\. Bali \(Eds\.\),pp\. 292–305\.External Links:[Link](https://doi.org/10.18653/v1/2023.emnlp-main.20),[Document](https://dx.doi.org/10.18653/V1/2023.EMNLP-MAIN.20)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Liet al\.\(2025\)Y\. Li, Q\. Gao, T\. Zhao, B\. Wang, H\. Sun, H\. Lyu, R\. D\. Hawkins, N\. Vasconcelos, T\. Golan, D\. Luo, and H\. DengCore knowledge deficits in multi\-modal language models\.InForty\-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13\-19, 2025,External Links:[Link](https://openreview.net/forum?id=EIK6xxIoCB)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Linet al\.\(2024\)D\. Lin, J\. Wang, C\. T\. Leong, and W\. LiSCREEN: A benchmark for situated conversational recommendation\.InProceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024 \- 1 November 2024,pp\. 9591–9600\.External Links:[Link](https://doi.org/10.1145/3664647.3681651),[Document](https://dx.doi.org/10.1145/3664647.3681651)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1),[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px1.p1.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Linet al\.\(2026\)D\. Lin, J\. Wang, Y\. Li, and W\. LiWhere and what: reasoning dynamic and implicit preferences in situated conversational recommendation\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),San Diego, California, United States,pp\. 10463–10481\.External Links:[Link](https://aclanthology.org/2026.acl-long.477/),[Document](https://dx.doi.org/10.18653/v1/2026.acl-long.477),ISBN 979\-8\-89176\-390\-6Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Liuet al\.\(2024\)H\. Liu, C\. Li, Y\. Li, B\. Li, Y\. Zhang, S\. Shen, and Y\. J\. LeeLLaVA\-next: improved reasoning, ocr, and world knowledge\.External Links:[Link](https://llava-vl.github.io/blog/2024-01-30-llava-next/)Cited by:[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px2.p1.1),[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px5.p1.1)\.
- Loshchilov and Hutter \(2019\)I\. Loshchilov and F\. HutterDecoupled weight decay regularization\.In7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6\-9, 2019,External Links:[Link](https://openreview.net/forum?id=Bkg6RiCqY7)Cited by:[Appendix E](https://arxiv.org/html/2609.18249#A5.SS0.SSS0.Px3.p1.1)\.
- Moonet al\.\(2020\)S\. Moon, S\. Kottur, P\. A\. Crook, A\. De, S\. Poddar, T\. Levin, D\. Whitney, D\. Difranco, A\. Beirami, E\. Cho, R\. Subba, and A\. GeramifardSituated and interactive multimodal conversations\.InProceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain \(Online\), December 8\-13, 2020,D\. Scott, N\. Bel, and C\. Zong \(Eds\.\),pp\. 1103–1121\.External Links:[Link](https://doi.org/10.18653/v1/2020.coling-main.96),[Document](https://dx.doi.org/10.18653/V1/2020.COLING-MAIN.96)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Mukandeet al\.\(2024\)T\. Mukande, E\. Ali, A\. Caputo, R\. Dong, and N\. E\. O’ConnorMMCRec: towards multi\-modal generative AI in conversational recommendation\.InAdvances in Information Retrieval \- 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24\-28, 2024, Proceedings, Part III,N\. Goharian, N\. Tonellotto, Y\. He, A\. Lipani, G\. McDonald, C\. Macdonald, and I\. Ounis \(Eds\.\),Lecture Notes in Computer Science, Vol\.14610,pp\. 316–325\.External Links:[Link](https://doi.org/10.1007/978-3-031-56063-7/_23),[Document](https://dx.doi.org/10.1007/978-3-031-56063-7%5F23)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Rafailovet al\.\(2023\)R\. Rafailov, A\. Sharma, E\. Mitchell, C\. D\. Manning, S\. Ermon, and C\. FinnDirect preference optimization: your language model is secretly a reward model\.InAdvances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 \- 16, 2023,A\. Oh, T\. Naumann, A\. Globerson, K\. Saenko, M\. Hardt, and S\. Levine \(Eds\.\),External Links:[Link](http://papers.nips.cc/paper/_files/paper/2023/hash/a85b405ed65c6477a4fe8302b5e06ce7-Abstract-Conference.html)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p4.1),[§3\.2](https://arxiv.org/html/2609.18249#S3.SS2.p1.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Sahooet al\.\(2024\)P\. Sahoo, P\. Meharia, A\. Ghosh, S\. Saha, V\. Jain, and A\. ChadhaA comprehensive survey of hallucination in large language, image, video and audio foundation models\.InFindings of the Association for Computational Linguistics: EMNLP 2024,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 11709–11724\.External Links:[Link](https://aclanthology.org/2024.findings-emnlp.685/),[Document](https://dx.doi.org/10.18653/v1/2024.findings-emnlp.685)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Shaoet al\.\(2024\)Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, M\. Zhang, Y\. K\. Li, Y\. Wu, and D\. GuoDeepSeekMath: pushing the limits of mathematical reasoning in open language models\.CoRRabs/2402\.03300\.External Links:[Link](https://doi.org/10.48550/arXiv.2402.03300),[Document](https://dx.doi.org/10.48550/ARXIV.2402.03300),2402\.03300Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p3.1),[§3\.1](https://arxiv.org/html/2609.18249#S3.SS1.SSS0.Px3.p4.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Suet al\.\(2024\)H\. Su, W\. Du, X\. Wang, and C\. NguyenSample efficiency matters: training multimodal conversational recommendation systems in a small data setting\.InProceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024 \- 1 November 2024,pp\. 2223–2232\.External Links:[Link](https://doi.org/10.1145/3664647.3681217),[Document](https://dx.doi.org/10.1145/3664647.3681217)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- VanderHoevenet al\.\(2025\)H\. VanderHoeven, B\. Bhalla, I\. Khebour, A\. C\. Youngren, V\. Venkatesha, M\. Bradford, J\. Fitzgerald, C\. Mabrey, J\. Tu, Y\. Zhu, K\. Lai, C\. Jung, J\. Pustejovsky, and N\. KrishnaswamyTRACE: real\-time multimodal common ground tracking in situated collaborative dialogues\.InProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2025 \- System Demonstrations, Albuquerque, New Mexico, USA, April 29 \- May 4, 2025,N\. Dziri, S\. \(\. Ren, and S\. Diao \(Eds\.\),pp\. 40–50\.External Links:[Link](https://doi.org/10.18653/v1/2025.naacl-demo.5),[Document](https://dx.doi.org/10.18653/V1/2025.NAACL-DEMO.5)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Wanget al\.\(2025\)Z\. Wang, X\. Yang, Y\. Liu, S\. Feng, D\. Wang, and Y\. ZhangMUSE: A multimodal conversational recommendation dataset with scenario\-grounded user profiles\.InFindings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 \- August 1, 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Findings of ACL, Vol\.ACL 2025,pp\. 1027–1053\.External Links:[Link](https://doi.org/10.18653/v1/2025.findings-acl.58),[Document](https://dx.doi.org/10.18653/V1/2025.FINDINGS-ACL.58)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Weiet al\.\(2022\)J\. Wei, X\. Wang, D\. Schuurmans, M\. Bosma, B\. Ichter, F\. Xia, E\. H\. Chi, Q\. V\. Le, and D\. ZhouChain\-of\-thought prompting elicits reasoning in large language models\.InAdvances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 \- December 9, 2022,S\. Koyejo, S\. Mohamed, A\. Agarwal, D\. Belgrave, K\. Cho, and A\. Oh \(Eds\.\),External Links:[Link](http://papers.nips.cc/paper/_files/paper/2022/hash/9d5609613524ecf4f15af0f7b31abca4-Abstract-Conference.html)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p3.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px2.p1.1)\.
- Wei and Yang \(2013\)X\. Wei and Z\. YangCoaching the exploration and exploitation in active learning for interactive video retrieval\.IEEE Trans\. Image Process\.22\(3\),pp\. 955–968\.External Links:[Link](https://doi.org/10.1109/TIP.2012.2222902),[Document](https://dx.doi.org/10.1109/TIP.2012.2222902)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Weiet al\.\(2025\)Y\. Wei, J\. Zou, W\. Guo, G\. Wang, X\. Xu, and Y\. YangMSCRS: multi\-modal semantic graph prompt learning framework for conversational recommender systems\.InProceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13\-18, 2025,pp\. 42–52\.External Links:[Link](https://doi.org/10.1145/3726302.3730040),[Document](https://dx.doi.org/10.1145/3726302.3730040)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Xueet al\.\(2025\)H\. Xue, F\. Tang, M\. Hu, Y\. Liu, Q\. Huang, Y\. Li, C\. Liu, Z\. Xu, C\. Zhang, C\. Feng, Y\. Xie, I\. Razzak, Z\. Ge, J\. Su, J\. He, and Y\. QiaoMMRC: A large\-scale benchmark for understanding multimodal large language model in real\-world conversation\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\), ACL 2025, Vienna, Austria, July 27 \- August 1, 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),pp\. 22477–22503\.External Links:[Link](https://aclanthology.org/2025.acl-long.1096/)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Yanet al\.\(2025\)Q\. Yan, Y\. Fan, H\. Li, S\. Jiang, Y\. Zhao, X\. Guan, C\. Kuo, and X\. E\. WangMultimodal inconsistency reasoning \(MMIR\): A new benchmark for multimodal reasoning models\.InFindings of the Association for Computational Linguistics, ACL 2025, Vienna, Austria, July 27 \- August 1, 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Findings of ACL, Vol\.ACL 2025,pp\. 18829–18845\.External Links:[Link](https://doi.org/10.18653/v1/2025.findings-acl.964),[Document](https://dx.doi.org/10.18653/V1/2025.FINDINGS-ACL.964)Cited by:[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Yang and Fang \(2025\)D\. Yang and H\. FangReGeS: reciprocal retrieval\-generation synergy for conversational recommender systems\.InWeb Information Systems Engineering \- WISE 2025 \- 26th International Conference, Marrakech, Morocco, December 15\-17, 2025, Proceedings, Part II,I\. Awan, M\. Younas, Y\. Zhang, M\. Barhamgi, and H\. Wang \(Eds\.\),Lecture Notes in Computer Science, Vol\.16368,pp\. 72–87\.External Links:[Link](https://doi.org/10.1007/978-981-95-7251-9/_6),[Document](https://dx.doi.org/10.1007/978-981-95-7251-9%5F6)Cited by:[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px3.p1.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.
- Yang and Chen \(2024\)T\. Yang and L\. ChenUnleashing the retrieval potential of large language models in conversational recommender systems\.InProceedings of the 18th ACM Conference on Recommender Systems, RecSys 2024, Bari, Italy, October 14\-18, 2024,T\. D\. Noia, P\. Lops, T\. Joachims, K\. Verbert, P\. Castells, Z\. Dong, and B\. London \(Eds\.\),pp\. 43–52\.External Links:[Link](https://doi.org/10.1145/3640457.3688146),[Document](https://dx.doi.org/10.1145/3640457.3688146)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Yoonet al\.\(2024\)S\. Yoon, Z\. He, J\. M\. Echterhoff, and J\. J\. McAuleyEvaluating large language models as generative user simulators for conversational recommendation\.InProceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\), NAACL 2024, Mexico City, Mexico, June 16\-21, 2024,K\. Duh, H\. Gómez\-Adorno, and S\. Bethard \(Eds\.\),pp\. 1490–1504\.External Links:[Link](https://doi.org/10.18653/v1/2024.naacl-long.83),[Document](https://dx.doi.org/10.18653/V1/2024.NAACL-LONG.83)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Zhanget al\.\(2025\)Y\. Zhang, R\. Peng, Y\. Dai, L\. Wu, X\. Chen, Q\. Gao, and J\. ChaiBootstrapping visual assistant modeling with situated interaction simulation\.InSecond Conference on Language Modeling,External Links:[Link](https://openreview.net/forum?id=S4nTXotasR)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Zhouet al\.\(2022\)Y\. Zhou, K\. Zhou, W\. X\. Zhao, C\. Wang, P\. Jiang, and H\. HuC2\{\{\}^\{2\}\}\-crs: coarse\-to\-fine contrastive learning for conversational recommender system\.InWSDM ’22: The Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event / Tempe, AZ, USA, February 21 \- 25, 2022,K\. S\. Candan, H\. Liu, L\. Akoglu, X\. L\. Dong, and J\. Tang \(Eds\.\),pp\. 1488–1496\.External Links:[Link](https://doi.org/10.1145/3488560.3498514),[Document](https://dx.doi.org/10.1145/3488560.3498514)Cited by:[§1](https://arxiv.org/html/2609.18249#S1.p1.1)\.
- Zhuet al\.\(2025\)Y\. Zhu, C\. Wan, H\. Steck, D\. Liang, Y\. Feng, N\. Kallus, and J\. LiCollaborative retrieval for large language model\-based conversational recommender systems\.InProceedings of the ACM on Web Conference 2025, WWW 2025, Sydney, NSW, Australia, 28 April 2025\- 2 May 2025,G\. Long, M\. Blumestein, Y\. Chang, L\. Lewin\-Eytan, Z\. H\. Huang, and E\. Yom\-Tov \(Eds\.\),pp\. 3323–3334\.External Links:[Link](https://doi.org/10.1145/3696410.3714908),[Document](https://dx.doi.org/10.1145/3696410.3714908)Cited by:[§4](https://arxiv.org/html/2609.18249#S4.SS0.SSS0.Px3.p1.1),[§6](https://arxiv.org/html/2609.18249#S6.SS0.SSS0.Px1.p1.1)\.

## Appendix AImplementation Details on Rubrics

### A\.1Constitutional Meta\-Instruction

In this section, we present the constitutional meta\-instruction \(ℐmeta\\mathcal\{I\}\_\{\\text\{meta\}\}\) employed to induce the global rubric set\. As illustrated in Figure[4](https://arxiv.org/html/2609.18249#A1.F4), this instruction serves as the system prompt for the MLLM \(e\.g\., GPT\-5\.2\), guiding it to analyze the batched seed dataset of situated contexts𝒟seed\\mathcal\{D\}\_\{\\text\{seed\}\}\.

Constitutional Meta\-Instruction \(ImetaI\_\{\\text\{meta\}\}\)System Role
You are an expert in Situated Conversational Recommendation \(SCR\) and Multimodal Reasoning assessment\.Task Description
You will be provided with a set of representative situated contexts\. Your goal is to formulate a comprehensive set of Evaluation Rubrics to judge the quality of an AI agent’s "Preference Reasoning Process\."Reasoning Objective
The AI agent must analyze the scene and dialogue to infer the user’s latent needs\. Define criteria to verify if this reasoning isaccurate,grounded, andlogical\.Required Rubric Facets
Categorize rubrics into the following dimensions:•Situatedness \(ℛsit\\mathcal\{R\}\_\{\\text\{sit\}\}\):Grounding intent in the physical scene \(spatial/visual\)\.•Item Relevance \(ℛrel\\mathcal\{R\}\_\{\\text\{rel\}\}\):Alignment with item metadata and attributes\.•Consistency \(ℛcon\\mathcal\{R\}\_\{\\text\{con\}\}\):Logical coherence with dialogue history/persona\.•Auxiliary \(ℛaux\\mathcal\{R\}\_\{\\text\{aux\}\}\):Emergent criteria \(e\.g\., explainability, safety, tone\)\.Output Constraints1\.Binary Predicate:Must be answerable with a definitiveYESorNO\.2\.Evidence\-Based Indicators:For each rubric, provide explicit:\-Positive Indicators:Observable evidence that justifies a YES\.\-Negative Indicators:Common errors or hallucinations that justify a NO\.3\.Process\-Oriented:Focus on thereasoning process\(the "Why"\)\.Response Format
Return a structured JSON list:\[\{"Facet": "\.\.\.", "Rubric\_ID": "\.\.\.", "Question": "\.\.\.", "Positive\_Indicators": \["\.\.\."\], "Negative\_Indicators": \["\.\.\."\]\}, \.\.\.\]Input Seed Data Batch𝒟seed\\mathcal\{D\}\_\{\\text\{seed\}\}\):\>Sample 1:\{ "Scene": <IMAGE\_1\>, "Dialogue": <TEXT\_1\> \}\>…\>Sample K:\{ "Scene": <IMAGE\_K\>, "Dialogue": <TEXT\_K\> \}Figure 4:The full constitutional meta\-instruction used for automated rubric induction\.The instruction is designed to guide the MLLM toward generating rubrics that are practically verifiable for situated preference reasoning\. Beyond explicitly defining the four structural facets \(ℛsit\\mathcal\{R\}\_\{\\text\{sit\}\},ℛrel\\mathcal\{R\}\_\{\\text\{rel\}\},ℛcon\\mathcal\{R\}\_\{\\text\{con\}\},ℛaux\\mathcal\{R\}\_\{\\text\{aux\}\}\), the prompt asks for evidence\-based indicators, specifically observable positive and negative signals, for each criterion\. This constraint helps reduce ambiguity and encourages the induced binary predicates to rely on concrete visual and textual evidence rather than abstract intuition\.

### A\.2Generated Rubrics Examples

Table[4](https://arxiv.org/html/2609.18249#A1.T4)presents a representative subset of the global rubric setℛ\\mathcal\{R\}induced by the GPT\-5\.2\. The full rubric set comprises 18 fine\-grained criteria, providing coverage with at least 4 distinct rubrics per facet\.

#### Validation of Teacher Proficiency\.

To mitigate concerns regarding the reliability of automated supervision, we use GPT\-5\.2 as a strong teacher model, given its instruction\-following and logical reasoning capabilities\. We also conducted a human verification process on the induced rubric set\. Expert annotators reviewed the generated criteria for logical soundness, relevance, and potential bias\. This manual inspection suggests that the automated rubrics are sufficiently reliable to provide auxiliary supervision during the training of our smaller student models\.

#### Verifiable Rubric Formulation\.

Following the constitutional meta\-instruction \(ImetaI\_\{\\text\{meta\}\}\), each rubric is formulated as a binary predicate accompanied by verifiable evidence\-based indicators\. These indicators serve as grounding signals for the frozen multimodal judge\. Specifically,positive indicators \(\+\)describe observable evidence in the scene or dialogue that justifies a “YES”, whilenegative indicators \(\-\)highlight common hallucinations or logic errors that warrant a “NO”\. This structure is intended to make the reward signal more grounded in the situated context than a purely subjective scalar score\.

FacetIDBinary Question \(rir\_\{i\}\)Evidence\-Based IndicatorsSituatedness\(ℛsit\\mathcal\{R\}\_\{\\text\{sit\}\}\)SIT\-01Visual Grounding:Does the preference explanation refer only to items or attributes that are strictly present in the visual scene?\(\+\)Every specific item \(e\.g\., "red dress"\) exists in the image pixel space or metadata\. \(\-\)Hallucinates objects not in the scene \(e\.g\., mentions "shoes" when only "shirts" exist\)\.SIT\-02Spatial Accuracy:If spatial terms are used \(e\.g\., "on the left"\), do they correctly map to the object’s physical location in the image?\(\+\)Spatial terms match the bounding box coordinates relative to the scene layout\. \(\-\)Describes an item as "on the right" when it is visually located on the left or center\.………Item Relevance\(ℛrel\\mathcal\{R\}\_\{\\text\{rel\}\}\)REL\-01Constraint Adherence:Does the inferred preference strictly adhere to the hard constraints explicitly stated by the user?\(\+\)Filters out items violating explicit price, brand, or material constraints\. \(\-\)Recommends or reasons about an item that the user explicitly excluded \(e\.g\., "No Nike"\)\.REL\-02Attribute Mapping:Is the mapping from abstract user needs to concrete item attributes logical and domain\-appropriate?\(\+\)Maps "for a party" to plausible attributes like "sequins" or "bright colors"\. \(\-\)Maps abstract needs to irrelevant attributes \(e\.g\., "formal event"→\\to"pajamas"\)\.………Consistency\(ℛcon\\mathcal\{R\}\_\{\\text\{con\}\}\)CON\-01History Coherence:Is the reasoning consistent with the user’s feedback or rejections in previous turns?\(\+\)Acknowledges previously rejected items/attributes and avoids recommending them again\. \(\-\)Contradicts prior turns \(e\.g\., user said "I hate blue" in turn 1, reasoning praises "blue" in turn 3\)\.CON\-02State Update:Does the reasoning incorporate the latest user utterance to update the preference state?\(\+\)The preference shifts correctly after a new critique \(e\.g\., "actually, I want something cheaper"\)\. \(\-\)Clings to the initial instruction while ignoring the most recent refinement\.………Auxiliary\(ℛaux\\mathcal\{R\}\_\{\\text\{aux\}\}\)AUX\-01Explainability:Does the reasoning trace provide a clear causal link explainingwhya visual feature matches the need?\(\+\)Uses "because" or "since" to link visual evidence to user intent\. \(\-\)Provides a recommendation without any supporting rationale or feature connection\.AUX\-02Safety & Tone:Is the reasoning free from inferring sensitive user attributes based on the visual scene?\(\+\)Focuses solely on item attributes and explicit user text\. \(\-\)Makes assumptions about user gender, race, or status based on visual stereotypes\.………

Table 4:Examples of the automated rubric setℛ\\mathcal\{R\}generated by the GPT\-5\.2\. Due to space constraints, we display a subset of the full catalogue\. Each rubric includes verifiable positive \(\+\) and negative \(\-\) indicators\.

## Appendix BPrompting Templates

#### Dynamic Rubric Selection

To implement the Dynamic Rubric Selector \(πsel\\pi\_\{\\text\{sel\}\}\), we utilize a lightweight MLLM \(e\.g\., Qwen3\-VL\-8B\-Instruct\) prompted to act as a logic gatekeeper\. The prompt is designed to filter out irrelevant evaluation criteria based on the current communicative intent\. Figure[7](https://arxiv.org/html/2609.18249#A2.F7)illustrates the detailed system instruction\. The prompt operates on a “retrieval\-via\-reasoning” basis: it first requires the model to analyze theCurrent Intent\(e\.g\., asking for location vs\. asking for material\), and then select the corresponding Rubric IDs from the global set\. This two\-step process \(Intent Analysis→\\toID Selection\) is designed to improve the accuracy of the selection compared to direct classification\.

To assess the reliability of this gating mechanism, we manually inspected a randomly sampled subset of 50 dialogue turns against expert\-annotated ground truth\. The lightweight selector showed reasonable alignment with human judgments, achieving a Precision of 90\.0% and a Recall of 95\.0%\. This evidence suggests that the module can reduce supervision noise while retaining most relevant constraints during reasoning optimization\.

#### Preference Reasoning Instruction

In this section, we provide the structural instruction \(ℐreason\\mathcal\{I\}\_\{\\text\{reason\}\}\) used to condition the Preference Reasoning Modelπθ\\pi\_\{\\theta\}\. As shown in Figure[5](https://arxiv.org/html/2609.18249#A2.F5), this instruction acts as a rigid schema definition, enforcing the sequential generation of the*Preference Thought*\(𝒯\\mathcal\{T\}\) and the*Preference State*\(𝒫\\mathcal\{P\}\)\. The prompt explicitly defines the required fields and their expected data types, ensuring that the generated state𝒫\\mathcal\{P\}is structurally valid for downstream rubric verification\.

Structural Reasoning Instruction \(IreasonI\_\{\\text\{reason\}\}\)System Role
You are an intelligent Situated Preference Reasoner\. Your task is to analyze a user’s request within a multimodal environment and infer their precise needs\.Output Schema Definition
You must strictly follow the format below\.<think\>
\[Reasoning Trace: Analyze intent shift, link text to visual features, check history\.\]
</think\>‘‘‘json
\{
"Intent": \.\.\.,
"Constraints": \.\.\.,
"Visual Target": \.\.\.,
\}
‘‘‘Input Context
Scene:<IMAGE\_INPUT\>
Dialogue History:…
Figure 5:The prompt template forπθ\\pi\_\{\\theta\}\. It consists of three parts: the System Role, the Output Schema Definition, and the Input Context slots where the multimodal contextX=\(𝒮,𝒞\)X=\(\\mathcal\{S\},\\mathcal\{C\}\)is inserted\.
#### Multimodal Judge Prompt

The frozen Multimodal Judge used in GRPO is instantiated with Qwen3\-VL\-8B\-Instruct and applied as a binary evaluator under deterministic decoding during training\. For each reasoning candidate𝒪g\\mathcal\{O\}\_\{g\}, active rubricrr, and situated contextXtX\_\{t\}, the model receives the candidate Preference Thought, Preference State, rubric question, and the corresponding positive/negative evidence indicators\. The model must return a structured verdict, which is parsed into the binary reward used in Eq\.[2](https://arxiv.org/html/2609.18249#S3.E2)\.

Binary Multimodal Judge InstructionSystem Role
You are a strict binary evaluator for Situated Conversational Recommendation reasoning\. Your task is to decide whether the candidate reasoning satisfies one specific rubric using only the provided candidate reasoning, scene, dialogue, and rubric evidence indicators\.Input
Visual Scene:<IMAGE\_INPUT and item metadata\>
Dialogue History:<USER/SYSTEM turns\>
Candidate Preference Thought \(𝒯g\\mathcal\{T\}\_\{g\}\):<THOUGHT\>
Candidate Preference State \(𝒫g\\mathcal\{P\}\_\{g\}\):<JSON preference state\>
Rubric ID:<RUBRIC ID\>
Rubric Question:<BINARY QUESTION\>
Positive Evidence Indicators:<OBSERVABLE CONDITIONS FOR YES\>
Negative Evidence Indicators:<ERROR CONDITIONS FOR NO\>Decision Rules1\.AnswerYESonly if the reasoning is fully supported by observable scene facts, dialogue history, and the positive indicators\.2\.AnswerNOif the reasoning hallucinates visual facts, contradicts dialogue history, ignores the target rubric, or matches any negative indicator\.3\.Do not award partial credit\. When evidence is missing or ambiguous, chooseNO\.Output Format
Return only JSON:\{"verdict": "YES", "evidence": \["short grounded evidence"\]\}or\{"verdict": "NO", "evidence": \["short grounded evidence"\]\}\.Figure 6:Prompt template for the frozen Multimodal Judge used to instantiateJudge​\(𝒪g,r,Xt\)\\text\{Judge\}\(\\mathcal\{O\}\_\{g\},r,X\_\{t\}\)\. A deterministic parser mapsYESto 1 andNOto 0\.Dynamic Rubric Selection InstructionSystem Role
You are the Reasoning Supervisor for a Situated Conversational Recommendation system\. Your goal is to optimize the evaluation process by activating only the relevant judging criteria for the current turn\.Task Description
You will be provided with:1\.A shared visual scene \(Image\)\.2\.The dialogue history ending with the latest User Utterance\.3\.The Global Rubric Setℛ\\mathcal\{R\}\(a list of criteria definitions and their IDs\)\.Your task is to identify the Communicative Intent of the latest user utterance and select a subset of Rubric IDs \(ℛact\\mathcal\{R\}\_\{\\text\{act\}\}\) that arestrictly necessaryto evaluate the agent’s reasoning\.
Goal:Minimize supervision noise\. If a rubric is not relevant to the current specific question, do NOT select it\.Global Rubric Set Reference
\[SIT\-01: Visual Grounding\], \[SIT\-02: Spatial Accuracy\], \.\.\.
\[REL\-01: Constraint Adherence\], \[REL\-02: Attribute Mapping\], \.\.\.
\[CON\-01: History Coherence\], \.\.\.\(Note: The model is provided with the full definitions as shown in Table[4](https://arxiv.org/html/2609.18249#A1.T4)\.\)Selection Logic \(Examples\)•User:"Show me the red one on the left\."•Intent:Spatial Localization \+ Color Constraint\.•Selection:\["SIT\-01", "SIT\-02", "REL\-01"\]\(Activate Spatial & Visual, Ignore History/Auxiliary\)\.•User:"No, I want something cheaper\."•Intent:Feedback/Critique \+ Price Constraint\.•Selection:\["CON\-01", "CON\-02", "REL\-01"\]\(Activate Consistency & Attribute, Ignore Spatial\)\.Response Format
Return a JSON object containing the intent analysis and the list of selected IDs:
\{ "Current\_Intent": "\.\.\.", "Selected\_IDs": \["ID\_1", "ID\_2", \.\.\.\] \}Input Context
Scene:<IMAGE\_INPUT\>
Dialogue History:…
Figure 7:The prompt template used for the Dynamic Rubric Selector \(πsel\\pi\_\{\\text\{sel\}\}\)\. It guides the Qwen3\-VL\-8B\-Instruct to filter the global rubric set based on the specific communicative intent of the current turn\.
#### Negative Sampling Prompt

We leverage a frozen MLLM \(e\.g\., GPT\-5\.2\) to synthesize heterogeneous negative responses\. Table[5](https://arxiv.org/html/2609.18249#A2.T5)presents the specific prompts used to generate situation\-conflicting negatives \(Yl​1Y\_\{l1\}\) and preference\-conflicting negatives \(Yl​2Y\_\{l2\}\)\.

Negative TypePrompt TemplateInput ContextScene Items:\[List of items with attributes \(ID, Type, Color, Position, Price…\)\]
Dialogue History:\[User and System utterances\]
Inferred Preference State \(𝒫\\mathcal\{P\}\):\[Structured preference state generated byπθ\\pi\_\{\\theta\}, including inferred intent, constraints, and visual target\.\]
Ground Truth Response \(YwY\_\{w\}\):\[Original response text\]Situation\-conflicting \(Yl​1Y\_\{l1\}\)You are a data augmentation assistant for situated recommendations\. Your task is to rewrite the Ground Truth Response to create a hallucinated negative sample that violates the physical scene constraints\.
Instructions:
1\. Keep the user’s intent and tone unchanged\.
2\. Replace the recommended item or spatial reference with an object that DOES NOT exist in theScene Itemslist\.
3\. Make the hallucination sound plausible but factually incorrect regarding the scene \(e\.g\., "the red jacket on the left" when there is no red jacket\)\.
4\. Output only the rewritten response\.Preference\-conflicting \(Yl​2Y\_\{l2\}\)You are a data augmentation assistant\. Your task is to rewrite the Ground Truth Response to create a misaligned negative sample that contradicts the Inferred Preference State while remaining grounded in the scene\.
Instructions:
1\. Read the Inferred Preference State and identify one or more explicit constraints to violate \(e\.g\., color, price, style, material, spatial location, or previously rejected attributes\)\.
2\. Select a Distractor Item from theScene Itemslist that exists in the scene but violates those preference\-state constraints\.
3\. Rewrite the response to recommend this Distractor Item instead of the correct target\.
4\. Ensure the description of the Distractor Item is accurate based on its metadata \(do not hallucinate\), but the recommendation must clearly conflict with𝒫\\mathcal\{P\}and the user’s preference in the Dialogue History\.
5\. Output only the rewritten response\.Table 5:Prompt templates for synthesizing heterogeneous negative responses\. The placeholders in brackets are filled with the corresponding data from the dataset instance\.
#### Item Selection Prompt

In the cascaded inference stage, item selection is treated as a constrained preference\-to\-item resolution problem\. Given the inferred preference state𝒫\\mathcal\{P\}, the resolver maps the explicit constraints in𝒫\\mathcal\{P\}onto the visible scene candidate list and returns a ranked list of physical items\. In our implementation, this resolution step is instantiated with the same backbone and a deterministic ranking prompt, but its role is to operationalize the generated Preference State rather than to introduce an additional learned ranking module\. Table[6](https://arxiv.org/html/2609.18249#A2.T6)details the prompt template used for this top\-KKresolution process\.

ComponentContentInput ContextScene Candidate List:\[List of visible items with attributes \(ID, Type, Color, Price, Position…\)\]
Dialogue History:\[User and System utterances\]
Inferred Preference State \(𝒫\\mathcal\{P\}\):\[The structured preference output generated byπθ\\pi\_\{\\theta\}\.\]Selection InstructionYou are an expert preference\-to\-item resolver for situated recommendation\. Your task is to identify and order the Top\-5 most relevant items from the Scene Candidate List that best match the Inferred Preference State\.
Guidelines:
1\.Ranking Criteria:Prioritize items that strictly satisfy the constraints defined in the Preference State \(e\.g\., matches visual attributes, spatial location, and price\)\. The more constraints satisfied, the higher the rank\.
2\.Scene Grounding:You must only select items that explicitly exist in the Candidate List\.
3\.Ordering:The output must be ordered by relevance, with the best match appearing first\.
4\.Output Format:Output ONLY a comma\-separated list of the top\-5Item IDs\(e\.g\., "101, 205, 33, 412, 98"\)\. Do not explain\.Table 6:The deterministic instruction used for Step 1: Preference\-to\-Item Resolution\. The resolver utilizes the explicit Preference State𝒫\\mathcal\{P\}to rank visible scene candidates\.SettingHit@1↑\\uparrowVHR↓\\downarrowWMR↓\\downarrowFullℛ\\mathcal\{R\}48\.125\.27\.4w/oℛsit\\mathcal\{R\}\_\{\\text\{sit\}\}44\.158\.99\.5w/oℛrel\\mathcal\{R\}\_\{\\text\{rel\}\}42\.856\.116\.5w/oℛcon\\mathcal\{R\}\_\{\\text\{con\}\}45\.325\.811\.2Table 7:Facet\-level ablation of the core rubric dimensions on SIMMC 2\.1\. Removing situatedness mainly increases visual hallucinations, removing item relevance causes more scene\-valid but preference\-mismatched recommendations, and removing consistency weakens multi\-turn state tracking\.

## Appendix CDataset Details

We provide detailed statistics for the SIMMC 2\.1 and SCREEN datasets in Table[8](https://arxiv.org/html/2609.18249#A3.T8)\. Both datasets present large\-scale testbeds for situated conversational recommendation but differ in interaction patterns and visual complexity\.

#### Interaction Complexity\.

As shown in Table[8](https://arxiv.org/html/2609.18249#A3.T8), SCREEN exhibits a significantly higher linguistic complexity, with an average of 22\.46 and 33\.41 words per user and system turn, respectively\. This verbosity stems from its focus on implicit preference expression and detailed attribute reasoning\. Conversely, SIMMC 2\.1 features shorter, more pragmatic utterances \(avg\. 12\.6 words\), reflecting its emphasis on direct visual referencing and spatial navigation\.

#### Scene Density\.

Both datasets maintain a high scene density with an average of 19\.7 objects per scene\. This high density poses a substantial challenge for visual grounding, as the model must distinguish the target item from numerous visually similar distractors \(hard negatives\) based on subtle dialogue cues\.

StatisticSIMMC 2\.1SCREENTotal \# of Dialogues5,62220,081Total \# of Utterances58,717190,011Total \# of Scene Snapshots1,5661,566Avg\. \# Words / User Turn12\.6022\.46Avg\. \# Words / System Turn13\.4033\.41Avg\. \# Turns / Dialogue10\.449\.46Avg\. \# Objects Mentioned4\.704\.40Avg\. \# Objects in Scene19\.7019\.70

Table 8:Detailed statistics of the SIMMC 2\.1 and SCREEN datasets\.

## Appendix DEvaluation Details

### D\.1LLM\-as\-a\-Judge Prompts

We employ GPT\-5\.2 as the evaluator to assess the quality of generated responses\. The evaluator receives the dialogue history, visual scene description, and the system’s response\. It is instructed to score the response on a scale of 1 to 10 across three specific dimensions\. The exact system prompt and scoring criteria used in our experiments are visualized in Figure[8](https://arxiv.org/html/2609.18249#A4.F8)\.

System Prompt for LLM\-as\-a\-JudgeSystem Instruction:You are an expert evaluator for Situated Conversational Recommendation\. You will be provided with the currentDialogue History, theVisual Scene Description\(including item attributes\), and theSystem’s Response\. Your task is to rate the System’s Response on a scale of 1 to 10 for the following three dimensions\.1\. Visual Fidelity \(Hallucination Check\)•Definition:Does the response strictly adhere to the facts in the visual scene?•Score 1:Severe hallucinations \(e\.g\., mentioning objects not in the scene, inventing attributes\)\.•Score 3:Major visual errors are present, but some scene entities are correctly referenced\.•Score 5:The main item exists in the scene, but several attributes or spatial details are unsupported\.•Score 7:Mostly grounded, with only minor or non\-critical visual imprecision\.•Score 10:All visual descriptions \(color, material, position\) are factually accurate and supported by the scene data\.2\. Constraint Compliance \(Reasoning Check\)•Definition:Does the response satisfy the user’s Explicit Instructions \(e\.g\., “show me the red one”\) AND Implicit Needs \(e\.g\., “for a small apartment”→\\toimplies compact size\)?•Score 1:Ignores user constraints completely\.•Score 3:Satisfies only a superficial constraint while missing the main explicit or implicit need\.•Score 5:Partially satisfies the request but misses one important preference constraint\.•Score 7:Satisfies most constraints, with a minor omission or weak implicit\-preference inference\.•Score 10:Perfectly infers and adheres to all explicit and implicit constraints\.3\. Conversational Helpfulness•Definition:Is the response natural, coherent, and proactive in guiding the user?•Score 1:Repetitive, robotic, or irrelevant to the conversation flow\.•Score 3:Understandable but awkward, terse, or poorly connected to the dialogue\.•Score 5:Relevant and coherent, but generic or minimally helpful\.•Score 7:Helpful and natural, with minor verbosity or limited proactivity\.•Score 10:Natural, persuasive, and effectively advances the recommendation process\.Output Format:
Return the scores in JSON format:\{"Visual Fidelity": score, "Constraint Compliance": score, "Helpfulness": score\}Figure 8:The system prompt used for the GPT\-5\.2 based evaluator\. The model acts as an impartial judge to score responses based on visual grounding, preference reasoning, and conversational quality\.
### D\.2Interactive Evaluation Metrics

We establish a user simulator𝒰\\mathcal\{U\}to interact with the systemℳ\\mathcal\{M\}forNNtest sessions\. Each sessioniihas a ground\-truth target itemoi∗o^\{\*\}\_\{i\}and a visual scene𝒮i\\mathcal\{S\}\_\{i\}\.

#### Success Rate \(SR\)\.

A session is considered successful if the system recommends the correct target itemoi∗o^\{\*\}\_\{i\}and the simulator accepts it within the maximum turn limitTmax=20T\_\{\\max\}=20\.

SR=1N​∑i=1N𝕀⁡\(outcomei=Success\)\\text\{SR\}=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\mathbb\{I\}\(\\text\{outcome\}\_\{i\}=\\text\{Success\}\)\(7\)

#### Visual Hallucination Rate \(VHR\)\.

This metric measures the frequency of generated responses containing visual information that contradicts the scene𝒮i\\mathcal\{S\}\_\{i\}\(e\.g\., describing a blue chair as red, or mentioning an absent object\)\. LetRt​o​t​a​lR\_\{total\}be the total number of system turns across all sessions\.

VHR=1Rt​o​t​a​l​∑t=1Rt​o​t​a​l𝕀⁡\(hallucination in Turnt\)\\text\{VHR\}=\\frac\{1\}\{R\_\{total\}\}\\sum\_\{t=1\}^\{R\_\{total\}\}\\mathbb\{I\}\(\\text\{hallucination in Turn\}\_\{t\}\)\(8\)

#### Weak\-Match Rate \(WMR\)\.

This metric diagnoses theReasoning Deficit\. In the evaluated benchmarks, each session specifies a hidden target itemo∗o^\{\*\}as the canonical item satisfying the user’s goal\. WMR therefore measures the proportion of recommendation turns where the recommended itemo^\\hat\{o\}is scene\-valid but misses this canonical target\. LetRr​e​cR\_\{rec\}be the total number of turns where a specific item is recommended\.

WMR=1Rr​e​c​∑t=1Rr​e​c𝕀⁡\(o^t∈𝒮i∧o^t≠oi∗\)\\text\{WMR\}=\\frac\{1\}\{R\_\{rec\}\}\\sum\_\{t=1\}^\{R\_\{rec\}\}\\mathbb\{I\}\(\\hat\{o\}\_\{t\}\\in\\mathcal\{S\}\_\{i\}\\land\\hat\{o\}\_\{t\}\\neq o^\{\*\}\_\{i\}\)\(9\)A high WMR indicates that the model often avoids visual hallucination but still selects a scene\-valid distractor instead of the benchmark target \(e\.g\., recommending an expensive item when the hidden goal implies a budget constraint\)\. This metric should be interpreted as a dataset\-grounded proxy for preference mismatch, rather than as a claim that no alternative item could be acceptable in an open\-ended real\-world interaction\.

### D\.3User Simulator Details

For dialogue\-level evaluation, we use an LLM\-driven user simulator to create multi\-turn interactions with each evaluated system\. Each test session is initialized with a hidden target itemoi∗o^\{\*\}\_\{i\}, the corresponding visual scene𝒮i\\mathcal\{S\}\_\{i\}, item metadata, and the dialogue history observed so far\. The simulator does not observe the model’s internal preference state or ranking scores\. It only plays the role of a user who has a latent need grounded in the target item and the visible scene\.

#### Simulator Prompt\.

Figure[9](https://arxiv.org/html/2609.18249#A4.F9)shows the prompt at every turn to generate the next user action\. The simulator is instructed to keep the hidden target private, avoid introducing unsupported visual facts, and continue the interaction when the system recommends a scene\-valid but target\-mismatched item\.

User Simulator InstructionSystem Role
You are a realistic user simulator for Situated Conversational Recommendation\. You are shopping in a shared visual scene and have a hidden target item that satisfies your actual need\. Your task is to interact naturally with the assistant until it recommends the correct target item and gives a grounded response\.Input
Visual Scene:<IMAGE and item metadata with IDs, categories, attributes, and positions\>
Hidden Target Item:<TARGET ITEM ID and attributes; do not reveal the ID to the assistant\>
User Goal:<Natural\-language need derived from the target item and dialogue context\>
Dialogue History:<All previous user and assistant turns\>
Latest Assistant Response:<SYSTEM RESPONSE\>Decision Rules1\.If the assistant recommends the hidden target item and the response is consistent with the visual scene, outputACCEPTwith a brief acceptance utterance\.2\.If the assistant recommends a visible but incorrect item, outputCONTINUEand ask a follow\-up that restates the missing constraint without revealing the target ID\.3\.If the assistant gives no explicit item recommendation, or lists multiple ambiguous candidates without selecting one, outputCONTINUEand ask for a concrete recommendation\.4\.If the assistant hallucinates an absent object, wrong color/material, or impossible spatial relation, outputCONTINUE, correct the visual inconsistency naturally, and ask for another recommendation\.5\.Do not invent new preferences that are unsupported by the user goal or scene\. Do not mention hidden labels such as “target item” or internal item IDs\.Output Format
Return only JSON:\{"status": "ACCEPT\|CONTINUE", "user\_utterance": "\.\.\.", "error\_tag": "none\|weak\_match\|visual\_hallucination\|no\_recommendation"\}\.Figure 9:Prompt template for the LLM\-driven user simulator used in dialogue\-level evaluation\.
#### Termination Rules\.

Each session starts from the benchmark\-provided initial user request and runs for at mostTmax=20T\_\{\\max\}=20system turns\. A session terminates successfully when the simulator outputsACCEPT, which requires both conditions to hold: \(1\) the recommended item matches the ground\-truth targetoi∗o^\{\*\}\_\{i\}; and \(2\) the response contains no visual contradiction with𝒮i\\mathcal\{S\}\_\{i\}\. If the system recommends a visible item that differs from the session’s target, the turn is logged as a weak match, and the simulator continues with a corrective follow\-up\. If the system mentions an absent object or unsupported visual attribute, the turn is logged as a visual hallucination, and the simulator continues with a clarification\. If the response contains no explicit, extractable item recommendation, or gives multiple candidates without a final choice, the turn is labeledno\_recommendation; it is counted inRt​o​t​a​lR\_\{total\}but excluded fromRr​e​cR\_\{rec\}unless a specific item can be parsed\. If noACCEPTdecision is produced withinTmaxT\_\{\\max\}turns, the session is marked as unsuccessful, while all intermediate hallucination and weak\-match events are still counted for VHR and WMR\.

#### Example Transcript\.

Table[9](https://arxiv.org/html/2609.18249#A4.T9)shows a representative interaction from the SCREEN\-style furniture scenario used in our qualitative analysis\. The hidden goal is to find the black metal shelving unit near the desk while avoiding visually salient light\-wood distractors\. For readability, the table renders the simulator’s JSON output by placing thestatusfield in theSpeaker / Statuscolumn and theuser\_utterancefield in theContentcolumn\.

StepSpeaker / StatusContentSetupHidden stateTargeto∗o^\{\*\}is the black metal shelving unit beside the desk\. Distractors include light\-wood shelves and a light\-wood desk\. The user wants storage near the desk but dislikes light wood\.Turn 1UserI need something for storage around the desk area, but I do not want a light wood finish\.Turn 1SystemWould a light\-wood shelf next to the desk work for you? It has plenty of storage space\.Turn 1Simulator:CONTINUEI would rather avoid the light\-wood option\. Is there a darker storage piece near the desk?Turn 2SystemThe black metal shelving unit beside the desk fits that better\. It is a dark storage piece, is located near the desk area, and avoids the light\-wood finish you rejected\.Turn 2Simulator:ACCEPTYes, that is the kind of storage piece I was looking for\.Table 9:Example user\-simulator transcript\. The first system response is counted as a weak match because it recommends a visible but target\-mismatched distractor; the second response satisfies the hidden target and terminates the session successfully\.

### D\.4Human Evaluation Details

We recruited three well\-educated graduate students as annotators\. For each dataset, we randomly sampled 15 long and 15 short sessions, where a session with at least eight dialogue turns is considered long, yielding 30 sessions per dataset and 60 sessions in total\. All three annotators independently evaluated the same 60 sessions, yielding three independent ratings per session and enabling inter\-annotator agreement analysis\. Model names were hidden, and the response order was randomized independently for each annotator\. Responses were rated on a 3\-point scale \(0=Weak, 1=Moderate, 2=Excellent\) across three dimensions designed to mirror our automated metrics\. The final human score is averaged across annotators, and we compute Fleiss’κ\\kappa\([Fleiss, 1971](https://arxiv.org/html/2609.18249#bib.bib4)\)over the three annotators’ ratings for each dimension to quantify agreement beyond chance\. The resulting agreement is moderate to substantial, withκ=0\.68\\kappa=0\.68for Situational Grounding,κ=0\.58\\kappa=0\.58for Preference Alignment, andκ=0\.62\\kappa=0\.62for Response Coherence\.

#### Instructions to Annotators\.

Annotators were shown the visual scene, dialogue history, candidate/item metadata, and the anonymized system responses for each sampled session\. They received the following written instruction: “Please independently evaluate the system response according to the three criteria below\. Base your judgment only on the provided scene, dialogue, metadata, and response\. Do not infer unsupported facts beyond the visible scene or dialogue context\. Assign 0, 1, or 2 for each criterion, where 0 indicates weak performance, 1 indicates moderate performance, and 2 indicates excellent performance\. The task uses public benchmark examples and model outputs for academic evaluation; no personally identifying user data are collected\. You may skip an example if the content is unclear or uncomfortable\.” Before annotation, annotators were informed that their ratings would be used only in aggregate form for academic evaluation in this paper, that no personally identifying information would be reported, and that participation was voluntary\. They provided consent to participate under these conditions\.

1\. Situational Grounding:

- •*Definition:*Does the response strictly adhere to the visual scene without hallucinating attributes or objects?
- •*Criteria:*0 if any hallucination occurs; 2 if all visual descriptions are factually accurate and spatially correct\.

2\. Preference Alignment:

- •*Definition:*Does the recommendation satisfy both the user’s explicit constraints \(e\.g\., "red"\) and implicit needs \(e\.g\., "cheap" inferred from "student"\)?
- •*Criteria:*0 if the item contradicts preferences; 2 if the item perfectly matches the inferred intent\.

3\. Response Coherence:

- •*Definition:*Is the response natural, logically connected to context, and helpful in advancing the recommendation?
- •*Criteria:*0 for disjointed text; 2 for natural, proactive, and persuasive responses\.

#### Annotation Example\.

Table[10](https://arxiv.org/html/2609.18249#A4.T10)illustrates one complete annotation record from the furniture scenario used in our qualitative analysis \(§[5\.5](https://arxiv.org/html/2609.18249#S5.SS5)\)\. The annotators observed the scene, the dialogue history ending with the user’s request for a dark storage piece near the desk \(rejecting the light\-wood finish\), the candidate\-item metadata, and two anonymized system responses presented in randomized order\. Each annotator independently assigned a 0–2 rating per dimension\.

SystemResponse Shown to AnnotatorsGround\.Align\.Coher\.\(Annotator 1 / 2 / 3\)System A \(anonymized\)“How about this light wood cabinet? It offers extra storage and is near the desk\.”2 / 2 / 20 / 0 / 01 / 2 / 1System B \(anonymized\)“I found a black metal shelving unit next to the desk\. It matches the darker ambiance and avoids the light wood finish…”2 / 2 / 22 / 2 / 22 / 2 / 2Table 10:A complete human\-annotation example\. System A’s response is fully grounded \(the light\-wood cabinet exists in the scene and is near the desk\) but violates the user’s explicit negative constraint, receiving 0 on Preference Alignment from all annotators\. System B satisfies both the scene constraints and the stated preference\.

## Appendix EDetailed Implementation Settings

We provide the main configurations regarding training, inference, and model instantiation to facilitate reproducibility\.

#### Auxiliary Models\.

Our framework adopts a tiered supervision strategy leveraging off\-the\-shelf MLLMs to avoid manual annotation of intermediate preference\-reasoning traces\. We instantiateGPT\-5\.2\(versiongpt\-5\.2\-2025\-12\-11via OpenAI API\) for offline data processing, specifically: \(1\) Inducing the global rubric set from seed data; and \(2\) Synthesizing heterogeneous negative pairs \(Yl​1,Yl​2Y\_\{l1\},Y\_\{l2\}\) to encourage logical robustness\. During training, we deploy a frozenQwen3\-VL\-8B\-Instruct\([Bai et al\., 2025](https://arxiv.org/html/2609.18249#bib.bib14)\)to serve dual roles as the Dynamic Rubric Selector \(πsel\\pi\_\{\\text\{sel\}\}\) and the Multimodal Judge\. To optimize memory overhead, these frozen auxiliary models are quantized to 4\-bit precision via the BitsAndBytes library\([Dettmers et al\., 2023](https://arxiv.org/html/2609.18249#bib.bib10)\)\.

#### Model Initialization\.

#### Training Configuration\.

We train with a maximum context length of 16,000 tokens to accommodate dense multi\-turn visual histories\. To manage the computational footprint of such long contexts, we enable Flash Attention 2\([Dao, 2024](https://arxiv.org/html/2609.18249#bib.bib36)\)and gradient checkpointing\. We freeze the visual encoders and projectors, and apply Low\-Rank Adaptation \(LoRA\) specifically to the query and value projections of the attention mechanism, with rankr=64r=64, alphaα=128\\alpha=128, and a dropout rate of 0\.05\. Optimization is conducted using AdamW\([Loshchilov and Hutter, 2019](https://arxiv.org/html/2609.18249#bib.bib11)\)with a learning rate of2×10−52\\times 10^\{\-5\}, governed by a cosine annealing scheduler \(warm\-up ratio 0\.03\)\. For policy optimization, we setβgrpo=0\.04\\beta\_\{\\text\{grpo\}\}=0\.04,βdpo=0\.1\\beta\_\{\\text\{dpo\}\}=0\.1, and sampleG=8G=8candidates with temperatureτ=0\.9\\tau=0\.9for GRPO\. The global batch size is maintained at 16 via gradient accumulation\. Training proceeds for 3 epochs on 8 NVIDIA A100 \(80GB\) GPUs using bfloat16 precision\. Reproducibility is ensured by fixing the random seed to 42\.

#### Inference Configuration\.

During inference, we adopt a decoupled decoding strategy tailored to the distinct objectives of our two stages:

- •Preference Reasoning \(πθ\\pi\_\{\\theta\}\):We employgreedy decoding\(temperature=0\) to follow the most probable reasoning path when deriving the structured preference state𝒫\\mathcal\{P\}\.
- •Response Generation \(φθ\\varphi\_\{\\theta\}\):We transition to nucleus sampling\([Holtzman et al\., 2020](https://arxiv.org/html/2609.18249#bib.bib13)\)\(top\-p=0\.75p=0\.75, top\-k=40k=40, temperature=0\.7\) to enhance the linguistic diversity and naturalness of the final response\.

## Appendix FQuality Analysis of Responses

#### SIMMC 2\.1 Response\-Quality Analysis\.

Table[11](https://arxiv.org/html/2609.18249#A6.T11)reports the full response\-generation evaluation on SIMMC 2\.1\. The compact summary in the main text averages the judge and human\-evaluation dimensions under the Qwen3\-VL backbone, while this table preserves all metrics and both backbones\.

BackboneMethodLLM\-as\-a\-Judge \(1\-10\)User Simulation \(%\)Human Evaluation \(0\-2\)Vis\. Fid\.Compl\.Help\.SR↑\\uparrowVHR↓\\downarrowWMR↓\\downarrowGroundedAlignedCoherentLLaVA\-NeXTVanilla Prompting5\.144\.385\.1710\.648\.335\.70\.840\.710\.93ICL5\.815\.135\.9213\.742\.432\.30\.970\.891\.06CoT6\.075\.816\.1112\.440\.828\.21\.041\.031\.14SFT7\.426\.937\.8122\.328\.725\.11\.331\.271\.43CRAG7\.867\.218\.0726\.922\.221\.81\.441\.361\.51ReGeS8\.117\.648\.4230\.418\.718\.11\.561\.491\.62Re2A\(Ours\)8\.948\.719\.0838\.17\.610\.91\.771\.741\.81Qwen3\-VLVanilla Prompting5\.414\.885\.5715\.145\.732\.80\.910\.861\.04ICL6\.145\.636\.2917\.739\.629\.21\.091\.041\.19CoT6\.316\.186\.4716\.438\.425\.91\.161\.171\.27SFT7\.827\.398\.2429\.625\.422\.61\.491\.371\.54CRAG8\.237\.768\.5234\.319\.718\.41\.571\.511\.63ReGeS8\.558\.098\.8338\.615\.215\.71\.641\.611\.71Re2A\(Ours\)9\.359\.129\.4646\.85\.27\.41\.871\.831\.91

Table 11:Evaluation of response generation on the SIMMC 2\.1 dataset\.Re2Aconsistently achieves the best performance across all metrics\. The best results are highlighted inbold\.
#### SCREEN Response\-Quality Analysis\.

We report the same response\-quality protocol on SCREEN in Table[12](https://arxiv.org/html/2609.18249#A6.T12)\. SCREEN emphasizes implicit preference expression and multi\-turn attribute constraints, so this analysis provides an additional view of whether the aligned generator remains faithful when the user’s goal is less directly stated\.

BackboneMethodLLM\-as\-a\-Judge \(1\-10\)User Simulation \(%\)Human Evaluation \(0\-2\)Vis\. Fid\.Compl\.Help\.SR↑\\uparrowVHR↓\\downarrowWMR↓\\downarrowGroundedAlignedCoherentLLaVA\-NeXTVanilla Prompting5\.294\.465\.3511\.744\.336\.90\.890\.780\.97ICL5\.935\.276\.0614\.839\.733\.41\.040\.911\.09CoT6\.185\.826\.3413\.638\.429\.61\.121\.051\.16SFT7\.547\.077\.9124\.126\.925\.41\.391\.321\.47CRAG7\.917\.438\.1828\.721\.422\.31\.461\.371\.53ReGeS8\.217\.868\.5233\.117\.718\.81\.581\.541\.63Re2A\(Ours\)8\.978\.689\.0540\.47\.110\.61\.781\.761\.81Qwen3\-VLVanilla Prompting5\.734\.915\.8216\.942\.134\.20\.970\.891\.06ICL6\.295\.726\.4619\.736\.431\.31\.131\.081\.24CoT6\.586\.246\.7118\.434\.927\.21\.231\.181\.31SFT7\.947\.518\.3631\.724\.123\.61\.511\.441\.57CRAG8\.317\.968\.6236\.118\.619\.71\.611\.531\.68ReGeS8\.678\.188\.8440\.914\.616\.21\.721\.661\.73Re2A\(Ours\)9\.268\.979\.3548\.65\.17\.91\.891\.821\.88

Table 12:Response\-generation evaluation on the SCREEN dataset\. The same protocol as Table[11](https://arxiv.org/html/2609.18249#A6.T11)is used\.Re2Aachieves the strongest response quality across LLM\-as\-a\-judge, user\-simulation, and human\-evaluation metrics under SCREEN’s implicit\-preference setting\.

## Appendix GRubric Facet Ablation

To further justify the design of the induced rubric set, we conduct a facet\-level ablation by removing one core rubric facet at a time while keeping the same backbone, training data, dynamic selector, judge prompt, and optimization configuration\. Table[7](https://arxiv.org/html/2609.18249#A2.T7)reports the results on SIMMC 2\.1 with the Qwen3\-VL backbone\.

The results suggest that the rubric facets contribute complementary supervision signals\. Removingℛsit\\mathcal\{R\}\_\{\\text\{sit\}\}increases VHR by 3\.7 percentage points \(5\.2%→\\to8\.9%\), indicating that situatedness criteria help suppress visual contradictions\. Removingℛrel\\mathcal\{R\}\_\{\\text\{rel\}\}causes the largest WMR increase, by 9\.1 percentage points \(7\.4%→\\to16\.5%\), suggesting that explicit item\-relevance checks reduce the tendency to choose scene\-valid distractors that violate user constraints\. Removingℛcon\\mathcal\{R\}\_\{\\text\{con\}\}also degrades both Hit@1 and WMR, supporting its role in tracking previous feedback and intent shifts across turns\.

## Appendix HSensitivity and Efficiency Analysis

As shown in Figure[10](https://arxiv.org/html/2609.18249#A8.F10)\(a\), increasing the group sizeGGis critical for enhancing the reliability of policy advantage estimation in GRPO\. We observe a sharp performance boost asGGrises to 8, where the model effectively stabilizes its reasoning paths\. Beyond this point \(G\>8G\>8\), performance gains exhibit diminishing returns, indicating that a moderate group size is sufficient to capture diverse reasoning patterns without excessive computational overhead\. Consequently, we selectG=8G=8as the default setting to optimally balance accuracy with training throughput\.

Figure[10](https://arxiv.org/html/2609.18249#A8.F10)\(b\) illustrates a distinct contrast in learning dynamics\. While the SFT baseline exhibits gradual growth due to the difficulty of mapping raw inputs to constraints without massive data,Re2Ademonstrates rapid adaptation\. Remarkably,Re2Atrained on just 25% of the data reaches 43\.5% Hit@1, surpassing the fully\-trained SFT baseline by 12\.26 percentage points \(43\.5% vs\. 31\.24%\)\. This result validates that our rubric\-based reasoning acts as a strong structural prior, providing dense supervisory signals that enable robust generalization more efficiently than standard supervision\.

\(a\)Impact of Group Size

\(b\)Data Efficiency

Figure 10:Sensitivity and efficiency analysis ofRe2A\.\(a\)Reasoning performance improves with group size and stabilizes atG=8G=8\.\(b\)Re2Ademonstrates superior data efficiency, surpassing the fully\-trained SFT baseline \(100% data\) with only 25% of the training data\.
## Appendix IAdditional Analyses and Discussions

### I\.1Supervision Quality

#### Rubric Facet Coverage\.

The four facets in Eq\.[1](https://arxiv.org/html/2609.18249#S3.E1)follow SCR’s core requirements:Situatednesschecks visual and spatial grounding,Item Relevancechecks user constraints and item attributes,Consistencychecks dialogue history and intent shifts, andAuxiliarycovers remaining domain\-specific criteria\. To verify their coverage, we manually checked 50 randomly sampled dialogue turns against the induced rubric set\.

CoverageDialogue TurnsCovered by the three core facets alone18/50Also required the Auxiliary facet32/50Contained an unmapped requirement0/50Table 13:Manual coverage check of the induced rubric facets on 50 sampled dialogue turns\. All turn\-level requirements map onto the four facets\.
#### Selector and Judge Decision Quality\.

To audit whether the training\-time selector and reward judge make reliable decisions, we usegpt\-5\.6\-solto evaluate 200 sampled training turns, while three human annotators evaluate a 30\-turn subset using the same 0\-to\-10 criteria\. For both selector and judge decisions, 0 denotes an incorrect or unsupported decision, 5 a partially correct decision with missed or misapplied criteria, and 10 a fully correct decision supported by the scene and dialogue evidence\. Scores are averaged across sampled turns and, for the human audit, across the three annotators\.

EvaluatorSampleSizeSelectorQuality↑\\uparrowJudgeQuality↑\\uparrowgpt\-5\.6\-sol2009\.28\.8Three human annotators308\.87\.5Table 14:Decision\-quality audit of the training\-time rubric selector and reward judge on a 0\-to\-10 scale\.Both the model and human audits indicate generally high decision quality for the selector and the reward judge \(Table[14](https://arxiv.org/html/2609.18249#A9.T14)\)\. Since all reported end\-to\-end results use the model’s own predicted preference states and resolved items without manual correction, residual errors of these components are already reflected in the reported results\.

#### Negative\-Sample Quality\.

The negative\-synthesis prompts \(Appendix[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px4)\) require introducing the intended conflict without changing unrelated content; satisfying both requirements constitutes a joint pass\. With no separate filtering stage during construction, we audit quality post hoc usinggpt\-5\.6\-solon 100 pairs per negative type and three human annotators on 15 pairs per type\. The human annotators additionally vote on whether the gold responseYwY\_\{w\}is clearly preferable to the synthesized negative\.

EvaluationSituation\-ConflictingPreference\-Conflictinggpt\-5\.6\-soljoint\-pass \(100/type\)93\.0%88\.0%Human joint\-pass \(15/type\)86\.7%93\.3%Human majority:YwY\_\{w\}clearly preferred93\.3%86\.7%

Table 15:Post\-hoc quality audit of the synthesized heterogeneous negative samples\.Both audits show high pass rates for the intended conflicts, and a majority of the human annotators preferred the gold response for both negative types \(Table[15](https://arxiv.org/html/2609.18249#A9.T15)\)\.

### I\.2Robustness of Judge and User Simulator

#### Independent Response Judges\.

Since GPT\-5\.2 is used both for offline data construction and as the response evaluator, its judge scores may carry self\-preference bias\. We therefore rescore the same anonymized SIMMC 2\.1 outputs with Gemini 3\.1 Pro and Claude Opus 4\.8, neither of which is used to train the evaluatedRe2Aconfiguration\. Confidence intervals use a paired dialogue\-cluster bootstrap\.

Response JudgeΔ\\DeltaJudge\-Avg\(Re2A−\-ReGeS\)95% CIGPT\-5\.2 \(original\)\+0\.82 \[0\.65, 0\.99\]Gemini 3\.1 Pro\+0\.59 \[0\.44, 0\.76\]Claude Opus 4\.8\+0\.90 \[0\.85, 0\.97\]Table 16:Rescoring the same anonymized SIMMC 2\.1 outputs with independent response judges\. All three 95% confidence intervals remain above zero\.As shown in Table[16](https://arxiv.org/html/2609.18249#A9.T16), all three 95% confidence intervals remain entirely above zero, so each evaluator assignsRe2Aa positive Judge\-Avg margin over ReGeS\.

#### Alternative User Simulator\.

We further replace the original GPT\-5\.2 user simulator with Claude Opus 4\.8 and evaluate the same 100 initial SIMMC 2\.1 samples, with ten rollouts per sample and 1,000 simulated sessions per system, under the same interaction and termination rules described in Appendix[D\.3](https://arxiv.org/html/2609.18249#A4.SS3)\.

User SimulatorReGeSRe2ASR↑\\uparrowVHR↓\\downarrowSR↑\\uparrowVHR↓\\downarrowGPT\-5\.238\.615\.246\.85\.2Claude Opus 4\.841\.213\.547\.85\.2Table 17:Dialogue\-level evaluation on SIMMC 2\.1 under two different user simulators\.Re2Aremains better than ReGeS under both simulators\.
#### Direct Comparison with the Teacher\-Scale Model\.

To quantify the gap between our 8B system and a much larger model, we evaluate GPT\-5\.2 directly with the same inputs and output format as the other inference\-only methods on SIMMC 2\.1\. The few\-shot setting uses the same three fixed training examples for every test instance; Hit@1 uses the predicted item, and Claude Opus 4\.8 evaluates response quality to avoid self\-scoring\.

Method on SIMMC 2\.1Hit@1↑\\uparrowOpus 4\.8Judge\-Avg↑\\uparrowGPT\-5\.2 zero\-shot44\.378\.56GPT\-5\.2 few\-shot51\.858\.83Re2A\(Qwen3\-VL\-8B\)48\.128\.73Table 18:Direct comparison with prompted GPT\-5\.2 on SIMMC 2\.1\.Re2Afalls between zero\-shot and few\-shot GPT\-5\.2 on both measures\.As shown in Table[18](https://arxiv.org/html/2609.18249#A9.T18),Re2Afalls between zero\-shot and few\-shot GPT\-5\.2 on both measures despite using an 8B backbone\. We treat prompted GPT\-5\.2 as a large\-model reference rather than a formal upper bound, since prompting strategies and decoding configurations were not exhaustively tuned\.

### I\.3Matched\-Supervision Diagnostic

The main comparison in Table[1](https://arxiv.org/html/2609.18249#S4.T1)evaluates complete systems under their intended training objectives, and therefore does not by itself separate the contribution of our training objectives from the synthesized supervision used byRe2A\. Adding rubric supervision or heterogeneous negative training directly to CRAG or ReGeS would create hybrid systems rather than preserve the published baselines\. To test whether the structured interface itself helps without any additional training data, we instead use each trained baseline’s own frozen checkpoint to add a prompted first stage\. This stage produces either a free\-form rationale or a structured preference state, which is then provided to the same checkpoint for item recommendation and response generation\. The checkpoint, call count, decoding configuration, and evaluation protocol are matched; only the intermediate representation differs\.

Method on SIMMC 2\.1Hit@1↑\\uparrowVHR↓\\downarrowCRAG35\.6419\.7CRAG \+ free\-form reasoning37\.0218\.1CRAG \+ preference state38\.2116\.8ReGeS39\.4515\.2ReGeS \+ free\-form reasoning40\.7114\.1ReGeS \+ preference state42\.1412\.7Re2A48\.125\.2Table 19:Call\-matched diagnostic on SIMMC 2\.1 with the Qwen3\-VL backbone\. Each frozen baseline first generates an intermediate representation and then consumes it for recommendation and response generation\.As shown in Table[19](https://arxiv.org/html/2609.18249#A9.T19), both baselines improve with free\-form reasoning and improve further with the structured preference state under the same call budget, indicating that the structured interface contributes beyond synthesized training data\. WithinRe2A, Fine\-tuned CoT reaches 40\.5% Hit@1 versus 48\.1% for the full framework, while homogeneous DPO gives 13\.4% VHR and 11\.2% WMR versus 5\.2% and 7\.4% with heterogeneous negatives \(§[5\.2](https://arxiv.org/html/2609.18249#S5.SS2)\)\. These ablations show that rubric\-guided reasoning and augmented alignment supervision also matter, but they do not fully separate optimization from data content or volume; we therefore do not attribute the full gain to GRPO or DPO alone\.

### I\.4Preference Reasoner Distillation

To reduce the inference latency introduced by explicit preference reasoning, we distill only the 8B preference reasoner intoQwen/Qwen3\-VL\-4B\-Instruct\. We use the same SIMMC 2\.1 training contexts as for the 8B reasoner: the 8B model supplies structured preference\-state targets, and the 4B student is trained with the same reasoning inputs, structural instruction, and output schema\. At evaluation, only the reasoner checkpoint is replaced, while all other components remain unchanged; latency is measured with the same hardware and timing protocol as in Table[3](https://arxiv.org/html/2609.18249#S5.T3)\. The distilled reasoner reduces total per\-turn latency from 2342\.7 ms to 1838\.4 ms while retaining most of the recommendation gain \(46\.71% vs\. 48\.12% Hit@1\); its VHR increases from 5\.2% to 8\.2% but remains substantially below ReGeS at 15\.2%\. This provides a lower\-latency alternative to the 8B configuration, although the quality\-latency tradeoff remains\.

### I\.5Robustness to Teacher and Judge Replacement

To test whether our conclusions depend on specific external models, we conduct two model\-replacement experiments on SIMMC 2\.1\. First, Claude Opus 4\.8 replaces GPT\-5\.2 as the teacher for rubric induction and negative\-pair construction, while Qwen3\-VL\-8B\-Instruct remains the training\-time selector and reward judge\. Second, InternVL3\-8B replaces Qwen3\-VL\-8B\-Instruct as the selector and reward judge, while GPT\-5\.2 remains the teacher\. The source examples, number of negative pairs, prompt content \(identical to the templates in Appendices[A\.1](https://arxiv.org/html/2609.18249#A1.SS1)–[B](https://arxiv.org/html/2609.18249#A2.SS0.SSS0.Px4)\), training schedule, and evaluation protocol remain fixed\.

Rubric and Negative\-Pair TeacherTraining\-Time Selector and JudgeHit@1↑\\uparrowRecall@5↑\\uparrowSR↑\\uparrowVHR↓\\downarrowGPT\-5\.2 \(default\)Qwen3\-VL\-8B\-Instruct \(default\)48\.1265\.0846\.85\.2Claude Opus 4\.8Qwen3\-VL\-8B\-Instruct49\.5468\.6048\.24\.9GPT\-5\.2InternVL3\-8B44\.4661\.4242\.69\.8Table 20:Model\-replacement experiments on SIMMC 2\.1 with the Qwen3\-VL backbone\. Replacing the teacher or the selector/judge preserves the conclusions of the main experiments\.As reported in Table[20](https://arxiv.org/html/2609.18249#A9.T20), the Claude Opus 4\.8 teacher improves all four metrics over the GPT\-5\.2 teacher, and the InternVL3\-8B selector/judge lowers absolute performance but still clearly outperforms the strongest baseline ReGeS \(39\.45% Hit@1, 15\.2% VHR\)\. These results indicate thatRe2Aremains effective when a different teacher or judge model is used\.

### I\.6Cross\-Domain Transfer

To examine the generalizability of the learned rubrics and models, we evaluate bidirectional zero\-shot transfer between the Fashion and Furniture domains in SIMMC 2\.1\. In each direction, the complete system is trained on the source domain and evaluated on the target domain without any target\-domain training or development data\.

Train→\\rightarrowTestMethodHit@1↑\\uparrowVHR↓\\downarrowFurniture→\\rightarrowFashionReGeS25\.8422\.9Re2A32\.1710\.8Fashion→\\rightarrowFurnitureReGeS27\.3621\.7Re2A33\.9410\.2Table 21:Bidirectional zero\-shot cross\-domain transfer between the Fashion and Furniture domains of SIMMC 2\.1\. The relative ordering ofRe2Aand ReGeS is consistent in both directions\.As shown in Table[21](https://arxiv.org/html/2609.18249#A9.T21), the relative ordering ofRe2Aand ReGeS is consistent in both directions despite the absence of target\-domain data\. To distinguish which components transfer, we further examine the induced rubric criteria and the response generator separately in a distinct setting that permits 10% target\-domain adaptation data\. Reusing source\-induced rubric criteria is within 0\.57 and 0\.65 Hit@1 percentage points of inducing new target\-domain criteria on Fashion and Furniture, respectively\. Under identical target\-domain contexts, the source\-trained generators obtain Gemini 3\.1 Pro Judge\-Avg scores of 8\.12 on Fashion and 8\.34 on Furniture, compared with 9\.16 and 9\.20 for the corresponding target\-trained generators\. These patterns suggest that the core rubric facets capture SCR requirements that transfer across product domains, while the Auxiliary facet accommodates domain\-specific constraints; response generation is more domain\-sensitive because item attributes and their linguistic realization change across domains\. The current evidence is limited to the Fashion and Furniture domains; broader cross\-domain transfer remains future work\.

## Appendix JCase Study

To illustrate the behavior ofRe2A, we present a detailed qualitative comparison in Figure[11](https://arxiv.org/html/2609.18249#A10.F11)\. We select a challenging scenario from the SCREEN dataset that requires bothspatial grounding\(locating the desk area\) andnegative constraint reasoning\(excluding specific visual attributes\)\.

Situated Conversation for Recommendation![Refer to caption](https://arxiv.org/html/2609.18249v1/case_study.png)Scene:Furniture store with a desk area \(left\) and bedroom \(right\)\.User:Can you help me get a leather chair?Agent:I have two leather chairs: a brown one and a black\-and\-white one by the kitchen island\.User:I also need extra storage spaceto fit the ambiance of my new decor style\.Agent:I see several shelving units\. Do you have any color or placement in mind?User:I don’t want anything in that light wood finish\.Is there a darker one near the desk?

Baselines1\. Vanilla Prompting “The black\-and\-white leather chair is by the kitchen island…” ↪\\hookrightarrowFails to recognize the task shift from chairs to storage units\.2\. ICL “I have a leather chair and awhite storage binfor you…” ↪\\hookrightarrowHallucinates a non\-existent item \(white bin\) while ignoring the spatial constraint\.3\. CoT “I see a light wood shelf near the desk\. It should fit your decor style\.” ↪\\hookrightarrowCorrectly grounds the location but ignores the explicit negation \(“don’t want light wood”\)\.4\. SFT “Sure\! Here is alight wood shelving unitat the desk\. It fits your decor style\!” ↪\\hookrightarrowExhibits sycophancy: blindly agrees with the user \(’fits your style’\) while recommending an item that explicitly violates the negative constraint\.5\. ReGeS Pred:Light Wood Display Cabinet “How about this light wood cabinet? It offers extra storage and is near the desk\.” ↪\\hookrightarrowOverfits to the visually salient light\-colored furniture, failing to align with the negative preference\.

Re2A\(Ours\)Preference Thought \(𝒯\\mathcal\{T\}\): “The user explicitlyrejectsthe ‘light wood finish’, implying a need for a darker material\. The item must be a ‘storage unit’ located in the ‘desk area’ \(left side\)…”Preference State \(𝒫\\mathcal\{P\}\):Intent:Get Storage UnitConstraint:¬\\negLight Wood∧\\landNear DeskVisual Target:Black Metal ShelvingGenerated Response: “I found ablack metal shelving unitnext to the desk\. It matches the darker ambiance and avoids the light wood finish…”

Figure 11:Qualitative case study on a challenging scenario\. While baselines struggle with visual saliency \(ReGeS\) or fail to reason about negation \(CoT\), ourRe2Aleverages structured preference reasoning to identify the target and generate a more contextually\-appropriate response\.