Leveraging Turn-taking Dynamics for Intent Recognition in Multi-party Conversations

arXiv cs.CL Papers

Summary

This paper proposes a multi-task learning approach that leverages turn-taking dynamics to enhance intent recognition in multi-party conversations, outperforming existing methods that ignore interaction patterns.

arXiv:2608.28926v1 Announce Type: new Abstract: We propose a multi-task learning approach for multi-party dialogue intent recognition that leverages an auxiliary task that models turn-taking dynamics. Specifically, we introduce turn-transition entropy, a self-supervised target computed from the sequence of speaker transitions, which quantifies the predictability of interaction patterns. Experiments on multiple pre-trained models demonstrate that incorporating this auxiliary task improves intent recognition performance, outperforming existing approaches which ignore multi-party interaction dynamics. We find that our proposed continuous target can be learned as a single-task objective, suggesting that it is an actual signal carrying useful information.
Original Article
View Cached Full Text

Cached at: 09/01/26, 12:10 PM

# Leveraging Turn-taking Dynamics for Intent Recognition in Multi-party Conversations
Source: [https://arxiv.org/html/2608.28926](https://arxiv.org/html/2608.28926)
\\usetikzlibrary

shapes\.geometric, arrows, positioning\\tikzsetmodel/\.style = rectangle, draw, minimum width=2\.2cm, minimum height=0\.9cm, font=, question/\.style = rectangle, align=left, font=, text width=6\.5cm, arrow/\.style = \-\>, thick, shorten <=1pt, shorten \>=1pt, iterlabel/\.style = font=, anchor=north east, inner sep=1pt

Alexis LombardGaël de ChalendarNasredine SemmarAffiliation:Université Paris\-Saclay, CEA, List, Palaiseau, FranceAffiliation:\{galo\-daniel\.castillolopez, alexis\.lombard, gael\.de\-chalendar, nasredine\.semmar\}@cea\.fr

###### Abstract

We propose a multi\-task learning approach for multi\-party dialogue intent recognition that leverages an auxiliary task that models turn\-taking dynamics\. Specifically, we introduce turn\-transition entropy, a self\-supervised target computed from the sequence of speaker transitions, which quantifies the predictability of interaction patterns\. Experiments on multiple pre\-trained models demonstrate that incorporating this auxiliary task improves intent recognition performance, outperforming existing approaches which ignore multi\-party interaction dynamics\. We find that our proposed continuous target can be learned as a single\-task objective, suggesting that it is an actual signal carrying useful information\.

## 1Introduction

††This paper has been accepted for publication at EMNLP Industry Track 2026 and corresponds to the author’s version of the work\.Detection of users’ intents is a fundamental component of task\-oriented dialogue systems, enabling conversational agents to understand user needs and generate appropriate responses[Zhu et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib15)\. While intent recognition has been extensively studied in dyadic dialogues[Zawbaa et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib13);[Arora et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib24);[Sali and Toraman \(2025\)](https://arxiv.org/html/2608.28926#bib.bib25), the multi\-party scenario, where agents interact with multiple users simultaneously, has been overlooked\. Recent work has investigated intent recognition in multi\-party conversations \(MPCs\) using both small and large language models[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36);[Liu et al\. \(2026b\)](https://arxiv.org/html/2608.28926#bib.bib12)\. However, most approaches fail to leverage information from the inherent multi\-party interaction dynamics, such as turn\-taking behavior, conversation disentanglement, and others[Ganesh et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib1);[Sapkota et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib14)\.

Figure 1:Examples of low\- and high\-entropy turn transitions\. The top conversation follows a structured pattern of speaker transitions, presenting a lower turn\-transition entropy\. The bottom conversation exhibits more varied and less organized speaker transitions, leading to a higher entropy222We define the entropy computation in Section[3\.3](https://arxiv.org/html/2608.28926#S3.SS3)\.\. Note that both examples have the same number of speakers and turn shifts\.In this paper, we propose a multi\-task learning approach that incorporates an auxiliary task to capture turn\-taking dynamics for multi\-party dialogue intent recognition\. Unlike dyadic conversations, where turn\-taking is relatively simple to anticipate, MPCs involve multiple potential next speakers, making speaker interaction patterns more complex[Skantze \(2021\)](https://arxiv.org/html/2608.28926#bib.bib2);[Castillo\-López et al\. \(2025a\)](https://arxiv.org/html/2608.28926#bib.bib16)\. We argue that such patterns provide useful contextual cues to model MPCs and therefore improve intent recognition in these scenarios\. Although tasks such as next\-speaker prediction and addressee detection have been widely studied[Gu et al\. \(2022\)](https://arxiv.org/html/2608.28926#bib.bib6);[He et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib5);[Mori et al\. \(2026\)](https://arxiv.org/html/2608.28926#bib.bib3);[Inoue et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib4), they often require additional annotations or assumptions about the number of participants\.

To address these limitations, we introduce an auxiliary regression task that predicts the uncertainty of turn\-taking patterns in the dialogue context\. Given the turns preceding a target utterance, we extract speaker\-transition pairs \(e\.g\., Speaker A→\\rightarrowSpeaker B, Speaker B→\\rightarrowSpeaker C\) and compute their Shannon entropy[Shannon \(1948\)](https://arxiv.org/html/2608.28926#bib.bib11)\. Thisturn\-transition entropyquantifies the predictability of interaction dynamics: low entropy indicates more organized turn\-taking, whereas high entropy shows more unpredictable turn transitions \(Figure[2](https://arxiv.org/html/2608.28926#footnote2)\)\. By learning to predict this quantity, intent recognition models are encouraged to capture interaction dynamics inherent to MPCs without requiring additional annotations or a fixed number of participants\. Our main contributions are as follows:

- •We introduceturn\-transition entropy, a self\-supervised continuous target that captures turn\-taking dynamics in multi\-party dialogues\.
- •We evaluate the practical use of the turn\-transition entropy as an auxiliary task for fine\-tuning multi\-party intent recognition models\.

## 2Related Work

Intent detection has been widely studied in dyadic dialogues[Wang et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib17);[Gautam et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib18);[Benayas et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib19)\. More recently, the use of LLMs for intent recognition has gained attention in single\-turn[Sali and Toraman \(2025\)](https://arxiv.org/html/2608.28926#bib.bib25);[Castillo\-López et al\. \(2026\)](https://arxiv.org/html/2608.28926#bib.bib34);[Arora et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib24)and multi\-turn dialogue[Liu et al\. \(2026a\)](https://arxiv.org/html/2608.28926#bib.bib28)\. Multitask learning methods have proposed incorporating auxiliary tasks such as named entity recognition[Perdana et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib33);[Benayas et al\. \(2021\)](https://arxiv.org/html/2608.28926#bib.bib31), dialogue act classification[Firdaus et al\. \(2021\)](https://arxiv.org/html/2608.28926#bib.bib26), and slot filling[He et al\. \(2021b\)](https://arxiv.org/html/2608.28926#bib.bib30);[Firdaus et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib32)\. These multitask methods, however, require additional annotations that are not feasible in many real\-world applications\.[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36)presented a hybrid approach that combines small and large language models in few\-shot settings on MPCs\. Multimodal fusion methods in MPCs have also been investigated[Chen et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib20);[Shen et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib21)\. However, none of such works explicitly aim to capture inherent multi\-party behavior\.

Research in dialogue act classification, a similar dialogue multiclass classification task at utterance level, has explored modeling multi\-parity[Anwar et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib29)\. Most studies have investigated modeling speaker\-related dynamics for improving dialogue understanding[Fu et al\. \(2025\)](https://arxiv.org/html/2608.28926#bib.bib27)\.[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22)addressed the task by introducing speaker\-turn embeddings added to utterance representations before contextual encoding\. This mechanism efficiently signals speaker switch or continuation, but reducing speaker identities to a binary pattern comes at the expense of retaining speaker\-specific turn taking information\. This limitation, most consequential in MPCs, was addressed by[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23), who proposed a speaker\-specific graph model for multi\-party dialogue act classification\. Their approach learns graph\-structured speaker representations from speaker–utterance connections and concatenates them with contextual utterance representations to model local speaker behavior\. However, this makes speaker modeling dependent on an explicit speaker–utterance graph neural module for each dialogue\. Additionally, it primarily captures local speaker behavior rather than the global distributional structure of turn transitions\.

In contrast to prior research, we incorporate turn\-taking dynamics for multi\-party intent recognition through a self\-supervised multitask strategy\. That is, without requiring additional costly annotations\. In addition, our approach does not rely on a fixed number of speakers\. Rather than using speaker\-turn embeddings or graph\-derived speaker representations, we introduce turn\-transition entropy as an auxiliary regression signal, encouraging transformer\-based models to capture the structure of speaker transitions while optimizing the main intent classification objective\.

## 3Experimental Procedure

Let𝒟\\mathcal\{D\}be a dataset of multi\-party dialogues, where each dialoguedk=\{\(ui,pi,yi\)\}i=1nkd\_\{k\}=\\\{\(u\_\{i\},p\_\{i\},y\_\{i\}\)\\\}\_\{i=1\}^\{n\_\{k\}\}is a sequence ofnkn\_\{k\}utterances, withuiu\_\{i\}denoting theii\-th utterance,pi∈𝒫kp\_\{i\}\\in\\mathcal\{P\}\_\{k\}its speaker from a dialogue\-specific set of participants𝒫k\\mathcal\{P\}\_\{k\}, and\.yi∈𝒴y\_\{i\}\\in\\mathcal\{Y\}its intent label\.𝒴=\{1,…,m\}\\mathcal\{Y\}=\\\{1,\\dots,m\\\}denotes the predefined set ofmmintent labels\. Our aim is to build a multiclass classification system that assigns each utteranceuiu\_\{i\}to its corresponding intentyi∈𝒴y\_\{i\}\\in\\mathcal\{Y\}\. Our contribution is to leverage the conversational interactions between speakers in𝒫k\\mathcal\{P\}\_\{k\}\.

### 3\.1Utterance Modeling

We use three different encoders to represent the text from utterances: BERT[Devlin et al\. \(2019\)](https://arxiv.org/html/2608.28926#bib.bib43), RoBERTa[Liu et al\. \(2019\)](https://arxiv.org/html/2608.28926#bib.bib45), and DeBERTaV3[He et al\. \(2021a\)](https://arxiv.org/html/2608.28926#bib.bib46)\. We use the large versions of all pre\-trained models\. More details of the models we use are included in Appendix[B\.1](https://arxiv.org/html/2608.28926#A2.SS1)\. In addition to the utterance to classify and in line with previous work, we prepend the encoded representation of previous utterances to include context information\.

### 3\.2Context Information Modeling

We add additional learnable embeddings to our encoded text representation to incorporate context information\. Following[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37), we add segment embeddings to let the model discriminate between contextual utterances and the target utteranceutu\_\{t\}to classify\. In[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37), only utterances previously produced by the target speakerptp\_\{t\}are prepended as context\. However, we find that performance improves when incorporating all previous utterances as context, regardless of their speaker\. To compensate for the loss of speaker identity that comes with this broader context, we introduce an additional speaker embedding that distinguishes utterances produced by the target speakerptp\_\{t\}from those produced by other participants\. Experiments showing the advantages of this modification are described in Appendix[D](https://arxiv.org/html/2608.28926#A4)\. The final input representation and an overview of our architecture is illustrated in Figure[2](https://arxiv.org/html/2608.28926#S3.F2)\.

Figure 2:Overview of our multitask learning approach architecture\. Input representation includes model token embeddings; segment IDs to distinguish contextual from target utterances \(i\.e\. latest turn utterance, to classify into any intent\); and speaker embeddings to discriminate context uttered by the speaker producing the target utterance\.
### 3\.3Turn\-Transition Entropy Auxiliary Task

In multi\-party dialogues, the way participants alternate in taking turns may carry implicit structural information about the nature of the conversation\. To capture this, we introduce theturn\-transition entropy, a continuous measure that characterizes the distribution of speaker transitions in a dialogue\. Given a dialoguedk=\{\(ui,pi,yi\)\}i=1nkd\_\{k\}=\\\{\(u\_\{i\},p\_\{i\},y\_\{i\}\)\\\}\_\{i=1\}^\{n\_\{k\}\}, we define the set of observed turn\-transition pairs for a target utteranceutu\_\{t\}:

𝒜t=\{\(pi−1,pi\)∣i=1,…,t\}\\mathcal\{A\}\_\{t\}=\\\{\(p\_\{i\-1\},p\_\{i\}\)\\mid i=1,\\dots,t\\\}\(1\)
where each pair\(pi−1,pi\)\(p\_\{i\-1\},p\_\{i\}\)represents a transition from the speaker of utteranceui−1u\_\{i\-1\}to the speaker of utteranceuiu\_\{i\}\. Let𝒜t∗\\mathcal\{A\}\_\{t\}^\{\*\}denote the set of unique transition pairs observed in𝒜t\\mathcal\{A\}\_\{t\}, andc⁡\(a\)c\(a\)denote the number of times paira∈𝒜t∗a\\in\\mathcal\{A\}\_\{t\}^\{\*\}occurs in𝒜t\\mathcal\{A\}\_\{t\}\. The probability of each observed turn shift is estimated as:

P⁡\(a\)=c⁡\(a\)\|𝒜t\|P\(a\)=\\frac\{c\(a\)\}\{\|\\mathcal\{A\}\_\{t\}\|\}\(2\)The turn\-transition entropy for target utteranceutu\_\{t\}is then defined as the Shannon entropy[Shannon \(1948\)](https://arxiv.org/html/2608.28926#bib.bib11)over the observed transition pairs:

Ht=−∑a∈𝒜t∗P\(a\)logP\(a\)H\_\{t\}=\-\\sum\_\{a\\in\\mathcal\{A\}\_\{t\}^\{\*\}\}P\(a\)\\log P\(a\)\(3\)
As a result, we obtain a computed continuous value for each utterance\. Unlike speaker\-count or turn\-count statistics,HtH\_\{t\}reflects how evenly distributed the turn\-taking transitions are among the pairs observed until turntt\. A low entropy indicates an organized order of turn transitions \(i\.e\. a few transitions dominate\), while a high entropy reflects a more diverse set of turn transitions, i\.e\. more unpredictable speaker\-wise turn shifts\. We propose incorporating the defined entropy value as an auxiliary regression target in a multitask learning framework alongside the main intent classification task, to leverage the multi\-party nature of the conversation as an additional source of information, encouraging the model to capture turn\-taking dynamics to improve intent classification\. The distributions of the computed entropy values are shown in Figure[3](https://arxiv.org/html/2608.28926#S3.F3)\.

Finally, we argue that the proposed turn\-transition entropy variable may correlate with utterance properties such as turn index, context length, and speaker count\. This could make unclear whether the model captures turn taking predictability or simpler dialogue properties\. Therefore, we propose a normalized version of the auxiliary variable\. In particular, thenormalized turn\-transition entropyvariable is obtained by dividing the actual entropy values by the speaker counts observed in the context utterances\. Consequently, we conduct our multitask learning experiments on both: the turn\-transition entropy and the normalized turn\-transition entropy variables\. In Appendix[A](https://arxiv.org/html/2608.28926#A1), we perform a relationship analysis between the auxiliary targets and the utterance properties that we enumerated previously\.

Figure 3:Entropy distributions computed on the training sets of MIntRec2\.0 and MPGT\.
### 3\.4Intent Classification

We consider two learning approaches for the intent classification task: a single\-task \(our baseline\) and a multitask setting\.

#### Single\-Task\.

In the single\-task setting, a classification head consisting of a linear layer followed by a softmax activation is placed on top of the language model to predict the intent labelyt∈𝒴y\_\{t\}\\in\\mathcal\{Y\}\. The model is optimized using the Cross\-Entropy Lossℒcls\\mathcal\{L\}\_\{\\text\{cls\}\}\. Models are fine\-tuned across 60 epochs with an early stopping mechanism\. More details about model fine\-tuning are provided in Appendix[B\.4](https://arxiv.org/html/2608.28926#A2.SS4)\.

#### Multitask\.

In the multitask setting, we additionally incorporate the turn\-transition entropyHtH\_\{t\}as an auxiliary regression target\. A regression head is connected to an intermediate layer of the language model, specifically thell\-th transformer layer, wherellis a tunable hyperparameter\. The hidden states at layerllare pooled and fed into a regression head trained to predictHtH\_\{t\}, optimized using the Mean Squared Error Lossℒreg\\mathcal\{L\}\_\{\\text\{reg\}\}\. The two objectives are combined using a weighted geometric mean, which is invariant to the scale of the individual losses[Chennupati et al\. \(2019\)](https://arxiv.org/html/2608.28926#bib.bib38), controlled by a hyperparameterλ∈\[0,1\]\\lambda\\in\[0,1\]asℒ=ℒcls\(1−λ\)⋅ℒregλ\\mathcal\{L\}=\\mathcal\{L\}\_\{\\text\{cls\}\}^\{\(1\-\\lambda\)\}\\cdot\\mathcal\{L\}\_\{\\text\{reg\}\}^\{\\lambda\}\. The hyperparameterλ\\lambdacontrols the relative importance of the auxiliary regression task with respect to the main classification task\. These additional hyperparameters are optimized using the Tree\-structured Parzen Estimator approach[Bergstra et al\. \(2011\)](https://arxiv.org/html/2608.28926#bib.bib39);[Watanabe \(2023\)](https://arxiv.org/html/2608.28926#bib.bib40)on Optuna333https://optuna\.org/[Akiba et al\. \(2019\)](https://arxiv.org/html/2608.28926#bib.bib41)\. Models are fine\-tuned across 60 epochs with early stopping\. More details about model fine\-tuning are provided in Appendix[B\.5](https://arxiv.org/html/2608.28926#A2.SS5)\.

### 3\.5Large Language Model Baseline

In addition to the encoder models fine\-tuning, we conduct a baseline experiment usingDeepSeek\-R1\-Distill\-Llama\-8Bon zero\-shot settings for the intent classification task, following the zero\-shot classification described in[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36)\. Figure[5](https://arxiv.org/html/2608.28926#A2.F5)in Appendix[B\.2](https://arxiv.org/html/2608.28926#A2.SS2)depicts the prompt template we use for the task\.

### 3\.6Prior Work Baselines

We use the results reported in[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)as a baseline to compare with our work\. Moreover, we implement the Label Space Reduction method proposed by[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36)\. Their two\-stage approach consists in fine\-tuning BERT and routing uncertain \(i\.e\. hard\) inferences to a LLM\. We useDeepSeek\-R1\-Distill\-Llama\-70B, which provided the best results in their work\. Both baseline methods are implemented on BERTLARGE\.

Additionally, we implement the speaker\-aware graph\-based method of[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)from the paper’s methodological description\. Unlike the original study, our evaluation covers both RoBERTaBASEand RoBERTaLARGE\. Following the original setup, the RoBERTa embedding layer and all transformer layers except the final one are frozen; only the final transformer layer is fine\-tuned before training the graph component\. Each dialogue chunk is represented as a speaker\-utterance graph with one node per utterance and speaker; bidirectional utterance\-speaker links yield \(2​\|D\|2\|D\|\) directed edges with a single relation type\. Two RGAT layers, each with two attention heads and hidden size 400, compute utterance\-level speaker representations that are concatenated with contextual utterance representations before classification\. The complete hyperparameter configuration used for reproduction is reported in Appendix[B\.3](https://arxiv.org/html/2608.28926#A2.SS3)\.

We further implement the speaker\-turn embedding baseline of[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22)from the authors’ public implementation, only replacing dialogue\-act targets with intent labels and RoBERTaBASEwith RoBERTaLARGE\.

### 3\.7Datasets

We use two public multi\-party conversations corpora in this work\. The first corpus isMPGT, which is a set of 29 dialogues between hospital visitors and a receptionist robot[Addlesee et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib35)\. The second corpus isMIntRec2\.0, a multimodal dataset of 15K dialogue utterances from TV shows[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)\. In this work we are interested in systems working with text input data, hence we only use the dialogue transcripts data\. MPGT and MIntRec2\.0 define 8 and 30 intents, respectively\. Additionally, we useMEETInt, an internal corpus of 75 spoken MPCs from in\-person professional meetings, containing 100K utterances and 12 intents\. More information about the datasets is detailed in Appendix[C](https://arxiv.org/html/2608.28926#A3)\.

### 3\.8Evaluation

We evaluate our fine\-tuned intent classification models using the average macro F1 and accuracy over 5 runs with different seeds\. The evaluation of the regression task is performed using the Mean Absolute Error \(MAE\)\.

## 4Results

MPGTmMIntRec2\.0ModelMethodF1Acc\.F1Acc\.BERTCTX TEXT[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)444Performance metrics reported in the original paper\.\- \-\- \-53\.6159\.04Label Space Reduction[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36)71\.3891\.7341\.9241\.66baseline \(ours\)88\.8195\.1955\.0760\.33TT Entropy Aux\. Task \(ours\)92\.8096\.0955\.8760\.22Norm\. TT Entropy Aux\. Task \(ours\)92\.0596\.6956\.0160\.35RoBERTaTurn Modeling[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22)73\.6492\.9251\.4056\.40Turn Aware Speaker Graph[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)81\.2894\.2952\.8257\.92baseline \(ours\)86\.3296\.3955\.9661\.29TT Entropy Aux\. Task \(ours\)88\.4395\.9456\.9260\.59Norm\. TT Entropy Aux\. Task \(ours\)89\.4896\.3957\.0661\.49DeBERTabaseline \(ours\)80\.7394\.2955\.8860\.79TT Entropy Aux\. Task \(ours\)84\.5695\.4956\.5360\.37Norm\. TT Entropy Aux\. Task \(ours\)85\.1296\.9957\.2061\.71DeepSeek\-R1 8Bzero\-shot \(ours\)39\.5132\.3331\.5432\.12Table 1:Performance evaluation on the intent classification task\. Scores correspond to the average macro F1 and accuracy over 5 runs\. Scores inboldhighlightthe bestperformance on the same backbone model\.Table[1](https://arxiv.org/html/2608.28926#S4.T1)shows the main results of all baselines and our multitask learning approach on all pre\-trained models\. We observe that our baseline method presents higher macro\-F1 and accuracy scores than prior work baselines on both datasets\. We also observe that regardless of the backbone model, incorporating our proposed turn\-transition entropy auxiliary task –normalized or unnormalized– leads to a macro\-F1 score improvement with respect to our baseline on both MPGT and MIntRec2\.0\. BERT, in multitask settings, achieves the largest macro F1 on MPGT, while DeBERTa shows the highest F1 on MIntRec2\.0\. We find that in all cases, except for BERT on MPGT, the normalized version of the turn\-transition entropy variable provides the largest improvements over the baseline models\. The second best F1 scores are obtained on the unnormalized approach\. Furthermore, we see that performance improvements are not large on MIntRec2\.0, compared to MPGT\. Nonetheless, we note that macro\-F1 improvements are consistent across models\. Also, LLM performance is much lower than the ones obtained by our baseline and multitask methods\. To the best of our knowledge, recent studies have consistently shown that fine\-tuned BERT\-like models generally perform better than LLMs on in\-context learning settings for intent detection, as suggested by[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)

The Label Space Reduction \(LSR\) method[Castillo\-López et al\. \(2025b\)](https://arxiv.org/html/2608.28926#bib.bib36)shows the poorest performance among all models and corpora\. However, it is important to note that such a performance comparison is not fair, as the LSR method is conducted on few\-shot settings\. Moreover, we see that there are 3 to 5 point performance difference between our baseline and[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22);[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)on the two datasets\. Table[12](https://arxiv.org/html/2608.28926#A5.T12)in Appendix[E](https://arxiv.org/html/2608.28926#A5)shows that both methods implemented on RoBERTaBASEpresent a higher performance than the same implementation on RoBERTaLARGE\. Nevertheless, our multitask learning approach keeps outperforming both methods\. Finally, we observe that our baseline approach on BERT outperforms[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)on MIntRec2\.0\. We argue that such an enhancement is due to the incorporation of the speaker embedding we propose and describe in Section[3\.2](https://arxiv.org/html/2608.28926#S3.SS2)\. An analysis on the improvement over[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)is described in Appendix[D](https://arxiv.org/html/2608.28926#A4)\. Finally, in line with the results on public corpora, Table[2](https://arxiv.org/html/2608.28926#S4.T2)shows that our proposed approach outperforms all baseline methods on MEETInt\. We see that our improvements over works by[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22)and[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)are about 4 and 2 points on macro F1, respectively\.

Table 2:Evaluation on MEETInt with RoBERTaLARGE\. Scores correspond to the average macro F1 and accuracy over 5 runs\. Scores inboldhighlightthe bestperformance\.
## 5Turn\-Transition Entropy Learning as a Single Task

Table 3:Mean Absolute Error \(MAE\) on the regression target learned as a single task on real and random entropy values\. Scores correspond to the average MAE over 5 runs\. A lower MAE suggests an ease on the continuous variable learning\.To better understand whether turn\-transition entropy constitutes a learnable signal, we isolate it from the intent classification task and evaluate it as a standalone regression problem, i\.e\. as a single task\. We replace the classification head of our backbone models \(described in Section[3\.4](https://arxiv.org/html/2608.28926#S3.SS4)\) with a regression head and fine\-tune the models to predict turn\-transition entropy from the text features\. In addition, we compare this setting against a control condition in which entropy values are randomly shuffled across training instances\. By doing so, our aim is to assess whether the model learns meaningful patterns associated with turn\-transition entropy or merely fits arbitrary continuous targets\.

Table[3](https://arxiv.org/html/2608.28926#S5.T3)shows that models trained on real turn\-transition entropy values consistently achieve lower MAE than those trained on randomly shuffled targets, across all datasets and backbone models\. Figure[4](https://arxiv.org/html/2608.28926#S5.F4)illustrates this behavior through the learning curves over 25 epochs on MPGT\. Models trained on the true entropy signal converge after approximately six epochs and consistently outperform their shuffled\-target counterparts\. These results indicate that turn\-transition entropy is a meaningful and learnable property of the dialogue context rather than an arbitrary continuous target\. Therefore, we argue that its effectiveness in the multi\-task setting is not solely attributed to a regularization effect, but also to the contextual information captured by the entropy signal itself\.

Figure 4:Mean Absolute Error values along training epochs on MPGT validation set across all models\.
## 6Multitask Learning on Random Entropy Targets

We investigate the effect of using random targets as the auxiliary task in the multitask setting\. Similar to our analysis in Section[5](https://arxiv.org/html/2608.28926#S5), we compare the proposed multitask setting against a control condition in which the entropy values are randomly shuffled across training instances\. Table[4](https://arxiv.org/html/2608.28926#S6.T4)reports the difference in F1 score between the two settings \(F1random−F1real\\mathrm\{F1\}\_\{\\text\{random\}\}\-\\mathrm\{F1\}\_\{\\text\{real\}\}\)\. We observe that the differences are negative across all settings, showing that models trained with the true entropy values consistently outperform those trained with shuffled targets\. In addition, we argue that incorporating the auxiliary task with random targets negatively impacts the performance of the main task\. In particular, for both BERT and RoBERTa, the multitask models trained with shuffled targets achieve lower F1 scores than the baseline across all datasets\. Overall, these findings demonstrate that the effectiveness of the proposed auxiliary task depends on the quality of the supervisory signal and provide further evidence that turn\-transition entropy captures interaction patterns that can be leveraged for intent recognition\.

Table 4:Absolute difference in macro\-F1 score of the classification task when replacing the auxiliary regression targets with randomly shuffled values during multitask training \(F1random−F1real\\mathrm\{F1\}\_\{\\text\{random\}\}\-\\mathrm\{F1\}\_\{\\text\{real\}\}\)\. Negative values indicate a classification performance degradation when training with random regression targets\.
## 7Target Variables Relationship Analysis

In this section, we assess the relationship between the auxiliary entropy target and the intent labels by conducting a Kruskal–Wallis test[Kruskal and Wallis \(1952\)](https://arxiv.org/html/2608.28926#bib.bib47), which is appropriate for comparing a continuous non\-Gaussian variable across multiple classes\. The Kruskal–Wallis test is a non\-parametric statistical test for comparing a continuous variable acrosskkindependent groups, whose null hypothesis indicates no difference between groups\. We provide the definition and mathematical background of the test in Appendix[F](https://arxiv.org/html/2608.28926#A6)\. Since the test provides only app\-value indicating statistical significance, without measuring an interpretable magnitude of differences, we also report the effect sizeϵ2\\epsilon^\{2\}\(epsilon\-squared\), which ranges from 0 to 1\. Values ofϵ2\\epsilon^\{2\}closer to 1 indicate stronger associations between both variables\. Further details on the effect sizeϵ2\\epsilon^\{2\}are provided in Appendix[F](https://arxiv.org/html/2608.28926#A6)\. This approach ensures that our conclusions are not only statistically significant but also practically meaningful\. The results are summarized in Table[5](https://arxiv.org/html/2608.28926#S7.T5)\.

Table 5:Relationship analysis between the intent classes and the auxiliary variable\. Kruskal\-Wallis test results and effect sizes across datasets\.HHcorresponds to the Kruskal–Wallis statistic, andϵ2\\epsilon^\{2\}is the effect sizeWe observe that the Kruskal–Wallis test rejects the null hypothesis that the entropy distributions are identical across intents for both datasets \(p<0\.01p<0\.01\), indicating that the auxiliary variable is statistically associated with the intent labels\. The corresponding effect sizes \(ϵ2\\epsilon^\{2\}\) suggest a stronger association for MPGT \(ϵ2=0\.112\\epsilon^\{2\}=0\.112\) than for MIntRec2\.0 \(ϵ2=0\.021\\epsilon^\{2\}=0\.021\)\. Using the commonly adopted heuristic thresholds proposed by[Cohen \(1988\)](https://arxiv.org/html/2608.28926#bib.bib49)and reviewed in[Tomczak and Tomczak \(2014\)](https://arxiv.org/html/2608.28926#bib.bib50)for variance\-explained effect sizes \(small≈\\approx0\.01, medium≈\\approx0\.06, large≈\\approx0\.14\), the association for MPGT can be regarded as moderate, whereas MIntRec2\.0 exhibits a small association\. We see that around 11% and 2% of the variability in the ranked entropy values are associated with the intent classes for MPGT and MIntRec2\.0, respectively\. Although the relationship is weaker in MIntRec2\.0, both datasets show statistically significant dependence between the auxiliary target and the intent labels, supporting our intuition to conduct experiments on the use of the entropy regression task as an auxiliary objective\. Finally, Figure[6](https://arxiv.org/html/2608.28926#A6.F6)in Appendix[F](https://arxiv.org/html/2608.28926#A6)shows the distributions of the turn\-transition entropy values per class for MPGT, which illustrates the expected differences among intents\.

## 8Conclusions

We present a multitask learning method that captures turn taking dynamics as additional dialogue context for intent detection in multi\-party conversations\. Our auxiliary self\-supervised task models the entropy on turn\-taking patterns from speaker turn transitions to characterize dialogues\. Our method shows improvement on intent detection systems over previous work approaches, using three model backbones over one private and two public multi\-party dialogue corpora\. We find that, such a turn\-transition entropy can be modeled as a single task and thus does not only act as a regularizer in the multitask setting but is also a signal that provides information about the dialogue\. We argue that our work, while performed for intent recognition, provides relevant insights for future work in other classification tasks involving multi\-party conversations\.

## Limitations

While our approach does not impose constraints on the number of speakers, it assumes that speaker identities are available for each utterance, as is the case in the datasets used in our experiments\. This requirement is naturally satisfied in scenarios where speaker diarization is controlled or where each participant owns a dedicated audio channel, e\.g\., video conferencing platforms\. Furthermore, speaker identity is generally an easier label to obtain in real\-world applications compared to the additional annotations required by alternative approaches, such as dialogue act labels or addressee identity, which typically demand costly expert annotation\. Nevertheless, in scenarios where automatic diarization is applied, errors in speaker assignment may affect the quality of the turn\-transition entropy signal\. Studying the robustness of the turn\-transition entropy to such noise is a promising direction for future work\.

## Ethical Considerations

Our experiments use publicly available corpora, which have been curated prior to our work to prevent malicious actions\. The internal corpus that we use in this work, has also been comprehensively curated to prevent malicious actions\. Overall, the contributions presented in this paper are designed for constructive and ethical use, with no direct association with harmful social consequences\. We do not find any potential risk on the release to the public of this work and the findings that we report\.

The fine\-tuning of all models developed in this work were executed on private infrastructure using a single NVIDIA A100 Tensor Core GPU of 80GB\. The infrastructure has a carbon efficiency of 0\.432 kgCO2eq/kWh\. The total time required for training across all experiments and analyses, including runs over 5 seeds per setting and hyperparameter tuning, was approximately 80 hours\. Therefore, the total emissions are estimated at 13\.82 kgCO2eq\. These estimations are based on the Machine Learning Impact calculator555[https://mlco2\.github\.io/impact/](https://mlco2.github.io/impact/)[Lacoste et al\. \(2019\)](https://arxiv.org/html/2608.28926#bib.bib44)\.

## Acknowledgments

We warmly thank our anonymous reviewers for their time and valuable feedback\. This work has been partially funded by the European Union’s Horizon RIA research and innovation program under grant agreement No\. 101189679 \(ASTIR\)\. This work also benefited from the FactoryIA supercomputer, financially supported by the Ile\-de\-France Regional Council\.

## References

- Addleseeet al\.\(2023\)A\. Addlesee, W\. Sieińska, N\. Gunson, D\. Hernandez Garcia, C\. Dondrup, and O\. LemonMulti\-party goal tracking with LLMs: comparing pre\-training, fine\-tuning, and prompt engineering\.InProceedings of the 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue,S\. Stoyanchev, S\. Joty, D\. Schlangen, O\. Dusek, C\. Kennington, and M\. Alikhani \(Eds\.\),Prague, Czechia,pp\. 229–241\.External Links:[Link](https://aclanthology.org/2023.sigdial-1.22/),[Document](https://dx.doi.org/10.18653/v1/2023.sigdial-1.22)Cited by:[§3\.7](https://arxiv.org/html/2608.28926#S3.SS7.p1.1)\.
- Akibaet al\.\(2019\)T\. Akiba, S\. Sano, T\. Yanase, T\. Ohta, and M\. KoyamaOptuna: a next\-generation hyperparameter optimization framework\.InProceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining,pp\. 2623–2631\.Cited by:[§3\.4](https://arxiv.org/html/2608.28926#S3.SS4.SSS0.Px2.p1.1)\.
- Anwaret al\.\(2024\)S\. Anwar, N\. Wiratunga, and M\. SnaithDual\-task dialogue understanding\.\.InSICSA REALLM,pp\. 40–46\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p2.1)\.
- Aroraet al\.\(2024\)G\. Arora, S\. Jain, and S\. MeruguIntent detection in the age of LLMs\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track,F\. Dernoncourt, D\. Preoţiuc\-Pietro, and A\. Shimorina \(Eds\.\),Miami, Florida, US,pp\. 1559–1570\.External Links:[Link](https://aclanthology.org/2024.emnlp-industry.114/),[Document](https://dx.doi.org/10.18653/v1/2024.emnlp-industry.114)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1),[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Benayaset al\.\(2021\)A\. Benayas, R\. Hashempour, D\. Rumble, S\. Jameel, and R\. C\. De AmorimUnified transformer multi\-task learning for intent classification with entity recognition\.IEEE Access9,pp\. 147306–147314\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Benayaset al\.\(2025\)A\. Benayas, M\. A\. Sicilia, and M\. Mora\-CantallopsA comparative analysis of encoder only and decoder only models in intent classification and sentiment analysis: navigating the trade\-offs in model size and performance\.Language Resources and Evaluation59\(3\),pp\. 2007–2030\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Bergstraet al\.\(2011\)J\. Bergstra, R\. Bardenet, Y\. Bengio, and B\. KéglAlgorithms for hyper\-parameter optimization\.Advances in neural information processing systems24\.Cited by:[§3\.4](https://arxiv.org/html/2608.28926#S3.SS4.SSS0.Px2.p1.1)\.
- Castillo\-Lópezet al\.\(2025a\)G\. Castillo\-López, G\. de Chalendar, and N\. SemmarA survey of recent advances on turn\-taking modeling in spoken dialogue systems\.InProceedings of the 15th International Workshop on Spoken Dialogue Systems Technology,M\. I\. Torres, Y\. Matsuda, Z\. Callejas, A\. del Pozo, and L\. F\. D’Haro \(Eds\.\),Bilbao, Spain,pp\. 254–271\.External Links:[Link](https://aclanthology.org/2025.iwsds-1.27/),ISBN 979\-8\-89176\-248\-0Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Castillo\-Lópezet al\.\(2025b\)G\. Castillo\-López, G\. de Chalendar, and N\. SemmarIntent recognition and out\-of\-scope detection using LLMs in multi\-party conversations\.InProceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue,F\. Béchet, F\. Lefèvre, N\. Asher, S\. Kim, and T\. Merlin \(Eds\.\),Avignon, France,pp\. 504–512\.External Links:[Link](https://aclanthology.org/2025.sigdial-1.41/)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1),[§2](https://arxiv.org/html/2608.28926#S2.p1.1),[§3\.5](https://arxiv.org/html/2608.28926#S3.SS5.p1.1),[§3\.6](https://arxiv.org/html/2608.28926#S3.SS6.p1.1),[Table 1](https://arxiv.org/html/2608.28926#S4.T1.2.4.1),[§4](https://arxiv.org/html/2608.28926#S4.p2.1)\.
- Castillo\-Lópezet al\.\(2026\)G\. Castillo\-López, A\. Lombard, N\. Semmar, and G\. de ChalendarHow DDAIR you? disambiguated data augmentation for intent recognition\.InProceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics \(Volume 2: Short Papers\),V\. Demberg, K\. Inui, and L\. Marquez \(Eds\.\),Rabat, Morocco,pp\. 274–286\.External Links:[Link](https://aclanthology.org/2026.eacl-short.20/),[Document](https://dx.doi.org/10.18653/v1/2026.eacl-short.20),ISBN 979\-8\-89176\-381\-4Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Chenet al\.\(2024\)Z\. Chen, Z\. Zhu, X\. Zhuang, Z\. Huang, and Y\. ZouDual\-oriented disentangled network with counterfactual intervention for multimodal intent detection\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,pp\. 17554–17567\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Chennupatiet al\.\(2019\)S\. Chennupati, G\. Sistu, S\. Yogamani, and S\. A RawashdehMultinet\+\+: multi\-stream feature aggregation and geometric loss strategy for multi\-task learning\.InProceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops,pp\. 0–0\.Cited by:[§3\.4](https://arxiv.org/html/2608.28926#S3.SS4.SSS0.Px2.p1.1)\.
- Cohen \(1988\)J\. CohenStatistical power analysis for the behavioral sciences\.Routledge\.Cited by:[§7](https://arxiv.org/html/2608.28926#S7.p2.1)\.
- Devlinet al\.\(2019\)J\. Devlin, M\. Chang, K\. Lee, and K\. ToutanovaBert: pre\-training of deep bidirectional transformers for language understanding\.InProceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 \(long and short papers\),pp\. 4171–4186\.Cited by:[§3\.1](https://arxiv.org/html/2608.28926#S3.SS1.p1.1)\.
- Firdauset al\.\(2023\)M\. Firdaus, A\. Ekbal, and E\. CambriaMultitask learning for multilingual intent detection and slot filling in dialogue systems\.Information Fusion91,pp\. 299–315\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Firdauset al\.\(2021\)M\. Firdaus, H\. Golchha, A\. Ekbal, and P\. BhattacharyyaA deep multi\-task model for dialogue act classification, intent detection and slot filling\.Cognitive Computation13\(3\),pp\. 626–645\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Fisher \(1930\)S\. R\. A\. FisherStatistical Methods for Research Workers\.Oliver and Boyd\.Cited by:[Appendix F](https://arxiv.org/html/2608.28926#A6.p1.2)\.
- Fuet al\.\(2025\)C\. Fu, Y\. Su, K\. Su, Y\. Liu, J\. Shi, B\. Wu, C\. Liu, C\. T\. Ishi, and H\. IshiguroHAM\-gnn: a hierarchical attention\-based multi\-dimensional edge graph neural network for dialogue act classification\.Expert Systems with Applications261,pp\. 125459\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p2.1)\.
- Ganeshet al\.\(2023\)A\. Ganesh, M\. Palmer, and K\. KannA survey of challenges and methods in the computational modeling of multi\-party dialog\.InProceedings of the 5th Workshop on NLP for Conversational AI \(NLP4ConvAI 2023\),pp\. 140–154\.Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1)\.
- Gautamet al\.\(2024\)C\. Gautam, S\. Parameswaran, A\. Kane, Y\. Fang, S\. Ramasamy, S\. Sundaram, S\. K\. Sahu, and X\. LiClass name guided out\-of\-scope intent classification\.InFindings of the Association for Computational Linguistics: EMNLP 2024,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 9100–9112\.External Links:[Link](https://aclanthology.org/2024.findings-emnlp.531/),[Document](https://dx.doi.org/10.18653/v1/2024.findings-emnlp.531)Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Guet al\.\(2022\)J\. Gu, C\. Tao, and Z\. LingWho says what to whom: a survey of multi\-party conversations\.InProceedings of the Thirty\-First International Joint Conference on Artificial Intelligence, IJCAI\-22,L\. D\. Raedt \(Ed\.\),pp\. 5486–5493\.Note:Survey TrackExternal Links:[Document](https://dx.doi.org/10.24963/ijcai.2022/768),[Link](https://doi.org/10.24963/ijcai.2022/768)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Heet al\.\(2021a\)P\. He, J\. Gao, and W\. ChenDeBERTaV3: improving deberta using electra\-style pre\-training with gradient\-disentangled embedding sharing\.External Links:2111\.09543Cited by:[§3\.1](https://arxiv.org/html/2608.28926#S3.SS1.p1.1)\.
- Heet al\.\(2021b\)T\. He, X\. Xu, Y\. Wu, H\. Wang, and J\. ChenMultitask learning with knowledge base for joint intent detection and slot filling\.Applied Sciences11\(11\),pp\. 4887\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Heet al\.\(2024\)X\. He, Y\. Jiang, H\. Cui, and Y\. LiuAddressee selection for multi\-party conversations in cyber\-physical\-social systems\.In2024 IEEE Cyber Science and Technology Congress \(CyberSciTech\),Vol\.,pp\. 180–186\.External Links:[Document](https://dx.doi.org/10.1109/CyberSciTech64112.2024.00037)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Heet al\.\(2021c\)Z\. He, L\. Tavabi, K\. Lerman, and M\. SoleymaniSpeaker turn modeling for dialogue act classification\.InFindings of the Association for Computational Linguistics: EMNLP 2021,M\. Moens, X\. Huang, L\. Specia, and S\. W\. Yih \(Eds\.\),Punta Cana, Dominican Republic,pp\. 2150–2157\.External Links:[Link](https://aclanthology.org/2021.findings-emnlp.185/),[Document](https://dx.doi.org/10.18653/v1/2021.findings-emnlp.185)Cited by:[§B\.1](https://arxiv.org/html/2608.28926#A2.SS1.p2.1),[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p1.1),[Table 12](https://arxiv.org/html/2608.28926#A5.T12.2.3.2),[Table 12](https://arxiv.org/html/2608.28926#A5.T12.2.5.2),[Appendix E](https://arxiv.org/html/2608.28926#A5.p1.1),[§2](https://arxiv.org/html/2608.28926#S2.p2.1),[§3\.6](https://arxiv.org/html/2608.28926#S3.SS6.p3.1),[Table 1](https://arxiv.org/html/2608.28926#S4.T1.2.8.2),[Table 2](https://arxiv.org/html/2608.28926#S4.T2.2.2.1),[§4](https://arxiv.org/html/2608.28926#S4.p2.1)\.
- Inoueet al\.\(2025\)K\. Inoue, D\. Lala, M\. Elmers, K\. Ochi, and T\. KawaharaAn LLM benchmark for addressee recognition in multi\-modal multi\-party dialogue\.InProceedings of the 15th International Workshop on Spoken Dialogue Systems Technology,M\. I\. Torres, Y\. Matsuda, Z\. Callejas, A\. del Pozo, and L\. F\. D’Haro \(Eds\.\),Bilbao, Spain,pp\. 330–334\.External Links:[Link](https://aclanthology.org/2025.iwsds-1.36/),ISBN 979\-8\-89176\-248\-0Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Keskaret al\.\(2016\)N\. S\. Keskar, D\. Mudigere, J\. Nocedal, M\. Smelyanskiy, and P\. T\. P\. TangOn large\-batch training for deep learning: generalization gap and sharp minima\.arXiv preprint arXiv:1609\.04836\.Cited by:[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p2.1)\.
- Kruskal and Wallis \(1952\)W\. H\. Kruskal and W\. A\. WallisUse of ranks in one\-criterion variance analysis\.Journal of the American statistical Association47\(260\),pp\. 583–621\.Cited by:[§7](https://arxiv.org/html/2608.28926#S7.p1.1)\.
- Lacosteet al\.\(2019\)A\. Lacoste, A\. Luccioni, V\. Schmidt, and T\. DandresQuantifying the carbon emissions of machine learning\.arXiv preprint arXiv:1910\.09700\.Cited by:[Ethical Considerations](https://arxiv.org/html/2608.28926#Sx2.p2.1)\.
- Liuet al\.\(2026a\)J\. Liu, Y\. K\. Tan, B\. Fu, and K\. H\. LimBalancing accuracy and efficiency in multi\-turn intent classification for llm\-powered dialog systems in production\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.40,pp\. 40073–40082\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Liuet al\.\(2026b\)Y\. Liu, Q\. Yang, and L\. LuWho should i trust? explicit confidence\-focused multimodal intent recognition\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.40,pp\. 23891–23898\.Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1)\.
- Liuet al\.\(2019\)Y\. Liu, M\. Ott, N\. Goyal, J\. Du, M\. Joshi, D\. Chen, O\. Levy, M\. Lewis, L\. Zettlemoyer, and V\. StoyanovRoberta: a robustly optimized bert pretraining approach\.arXiv preprint arXiv:1907\.11692\.Cited by:[§3\.1](https://arxiv.org/html/2608.28926#S3.SS1.p1.1)\.
- Loshchilov and Hutter \(2017\)I\. Loshchilov and F\. HutterDecoupled weight decay regularization\.arXiv preprint arXiv:1711\.05101\.Cited by:[§B\.4](https://arxiv.org/html/2608.28926#A2.SS4.p1.1)\.
- McCandlishet al\.\(2018\)S\. McCandlish, J\. Kaplan, D\. Amodei, and O\. D\. TeamAn empirical model of large\-batch training\.arXiv preprint arXiv:1812\.06162\.Cited by:[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p2.1)\.
- Moriet al\.\(2026\)T\. Mori, K\. Inoue, D\. Lala, K\. Ochi, and T\. KawaharaAnalysing next speaker prediction in multi\-party conversation using multimodal large language models\.InProceedings of the 16th International Workshop on Spoken Dialogue System Technology,G\. Riccardi, S\. M\. Mousavi, M\. I\. Torres, K\. Yoshino, Z\. Callejas, S\. A\. Chowdhury, Y\. Chen, F\. Bechet, J\. Gustafson, G\. Damnati, A\. Papangelis, L\. F\. D’Haro, J\. Mendonça, R\. Bernardi, D\. Hakkani\-Tur, G\. ”\. Di Fabbrizio, T\. Kawahara, F\. Alam, G\. Tur, and M\. Johnston \(Eds\.\),Trento, Italy,pp\. 83–94\.External Links:[Link](https://aclanthology.org/2026.iwsds-1.8/)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Pascanuet al\.\(2013\)R\. Pascanu, T\. Mikolov, and Y\. BengioOn the difficulty of training recurrent neural networks\.InInternational conference on machine learning,pp\. 1310–1318\.Cited by:[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p3.1)\.
- Perdanaet al\.\(2025\)R\. S\. Perdana P\. P\. Adikaraet al\.Multi\-task learning for named entity recognition and intent classification in natural language understanding applications\.Journal of Information Systems Engineering and Business Intelligence11\(1\),pp\. 1–16\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Qamaret al\.\(2023\)A\. Qamar, A\. Pyarelal, and R\. HuangWho is speaking? speaker\-aware multiparty dialogue act classification\.InFindings of the Association for Computational Linguistics: EMNLP 2023,H\. Bouamor, J\. Pino, and K\. Bali \(Eds\.\),Singapore,pp\. 10122–10135\.External Links:[Link](https://aclanthology.org/2023.findings-emnlp.678/),[Document](https://dx.doi.org/10.18653/v1/2023.findings-emnlp.678)Cited by:[§B\.1](https://arxiv.org/html/2608.28926#A2.SS1.p2.1),[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p1.1),[Table 12](https://arxiv.org/html/2608.28926#A5.T12.2.4.1),[Table 12](https://arxiv.org/html/2608.28926#A5.T12.2.6.1),[Appendix E](https://arxiv.org/html/2608.28926#A5.p1.1),[§2](https://arxiv.org/html/2608.28926#S2.p2.1),[§3\.6](https://arxiv.org/html/2608.28926#S3.SS6.p2.1),[Table 1](https://arxiv.org/html/2608.28926#S4.T1.2.9.1),[Table 2](https://arxiv.org/html/2608.28926#S4.T2.2.3.1),[§4](https://arxiv.org/html/2608.28926#S4.p2.1)\.
- Sali and Toraman \(2025\)Y\. Sali and S\. C\. ToramanNavigating the unknown: intent classification and out\-of\-distribution detection using large language models\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 14652–14664\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.791/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.791),ISBN 979\-8\-89176\-335\-7Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1),[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Sapkotaet al\.\(2025\)S\. Sapkota, M\. S\. Hasan, M\. Shah, and S\. KarmakerMulti\-party conversational agents: a survey\.arXiv preprint arXiv:2505\.18845\.Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1)\.
- Shannon \(1948\)C\. E\. ShannonA mathematical theory of communication\.The Bell system technical journal27\(3\),pp\. 379–423\.Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p3.1),[§3\.3](https://arxiv.org/html/2608.28926#S3.SS3.p2.2)\.
- Shenet al\.\(2025\)Y\. Shen, X\. Lin, and W\. FanA\-mess: anchor\-based multimodal embedding with semantic synchronization for multimodal intent recognition\.In2025 IEEE International Conference on Multimedia and Expo \(ICME\),pp\. 1–6\.Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Skantze \(2021\)G\. SkantzeTurn\-taking in conversational systems and human\-robot interaction: a review\.Computer Speech & Language67,pp\. 101178\.Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p2.1)\.
- Tomczak and Tomczak \(2014\)M\. Tomczak and E\. TomczakThe need to report effect size estimates revisited\. An overview of some recommended measures of effect size\.Akademia Wychowania Fizycznego w Poznaniu\.Cited by:[§7](https://arxiv.org/html/2608.28926#S7.p2.1)\.
- Vaswaniet al\.\(2017\)A\. Vaswani, N\. Shazeer, N\. Parmar, J\. Uszkoreit, L\. Jones, A\. N\. Gomez, Ł\. Kaiser, and I\. PolosukhinAttention is all you need\.Advances in neural information processing systems30\.Cited by:[§B\.3](https://arxiv.org/html/2608.28926#A2.SS3.p3.1)\.
- Wanget al\.\(2023\)P\. Wang, K\. He, Y\. Mou, X\. Song, Y\. Wu, J\. Wang, Y\. Xian, X\. Cai, and W\. XuAPP: adaptive prototypical pseudo\-labeling for few\-shot OOD detection\.InFindings of the Association for Computational Linguistics: EMNLP 2023,H\. Bouamor, J\. Pino, and K\. Bali \(Eds\.\),Singapore,pp\. 3926–3939\.External Links:[Link](https://aclanthology.org/2023.findings-emnlp.258/),[Document](https://dx.doi.org/10.18653/v1/2023.findings-emnlp.258)Cited by:[§2](https://arxiv.org/html/2608.28926#S2.p1.1)\.
- Watanabe \(2023\)S\. WatanabeTree\-structured parzen estimator: understanding its algorithm components and their roles for better empirical performance\.arXiv preprint arXiv:2304\.11127\.Cited by:[§3\.4](https://arxiv.org/html/2608.28926#S3.SS4.SSS0.Px2.p1.1)\.
- Wolfet al\.\(2020\)T\. Wolf, L\. Debut, V\. Sanh, J\. Chaumond, C\. Delangue, A\. Moi, P\. Cistac, T\. Rault, R\. Louf, M\. Funtowicz,et al\.Transformers: state\-of\-the\-art natural language processing\.InProceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations,pp\. 38–45\.Cited by:[§B\.1](https://arxiv.org/html/2608.28926#A2.SS1.p1.1)\.
- Zawbaaet al\.\(2024\)H\. Zawbaa, W\. Rashwan, S\. Dutta, and H\. AssemImproved out\-of\-scope intent classification with dual encoding and threshold\-based re\-classification\.InProceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation \(LREC\-COLING 2024\),N\. Calzolari, M\. Kan, V\. Hoste, A\. Lenci, S\. Sakti, and N\. Xue \(Eds\.\),Torino, Italia,pp\. 8708–8718\.External Links:[Link](https://aclanthology.org/2024.lrec-main.763/)Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1)\.
- Zhanget al\.\(2024\)H\. Zhang, X\. Wang, H\. Xu, Q\. Zhou, K\. Gao, J\. Su, W\. Li, Y\. Chen,et al\.MIntRec2\. 0: a large\-scale benchmark dataset for multimodal intent recognition and out\-of\-scope detection in conversations\.arXiv preprint arXiv:2403\.10943\.Cited by:[item 2](https://arxiv.org/html/2608.28926#A4.I1.i2.p1.1),[Appendix D](https://arxiv.org/html/2608.28926#A4.p2.1),[§3\.2](https://arxiv.org/html/2608.28926#S3.SS2.p1.1),[§3\.6](https://arxiv.org/html/2608.28926#S3.SS6.p1.1),[§3\.7](https://arxiv.org/html/2608.28926#S3.SS7.p1.1),[Table 1](https://arxiv.org/html/2608.28926#S4.T1.2.3.2),[§4](https://arxiv.org/html/2608.28926#S4.p1.1),[§4](https://arxiv.org/html/2608.28926#S4.p2.1)\.
- Zhuet al\.\(2025\)Z\. Zhu, F\. Zhang, Y\. Zhang, J\. Sun, Z\. Huang, Q\. Long, B\. Xing, and X\. WuA survey on multi\-modal intent recognition: recent advances and new frontiers\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 15223–15236\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.823/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.823),ISBN 979\-8\-89176\-335\-7Cited by:[§1](https://arxiv.org/html/2608.28926#S1.p1.1)\.

## Appendix AUtterance Properties Correlation Analysis

We discussed in Section[3\.3](https://arxiv.org/html/2608.28926#S3.SS3)that there are utterance properties that might be correlated with the turn\-transition entropy, which motivated the proposal of a normalized version of this auxiliary target\. To investigate this relationship, we compute the Spearman correlation between the auxiliary variable \(both normalized and unnormalized versions\) and such utterance properties\. The Spearman rank correlation coefficient measures the strength and direction of the monotonic association between two variables\. Fornnpaired observations, it is defined as:

ρs=1−6​∑i=1ndi2n⁡\(n2−1\),\\rho\_\{s\}=1\-\\frac\{6\\sum\_\{i=1\}^\{n\}d\_\{i\}^\{2\}\}\{n\(n^\{2\}\-1\)\},\(4\)wheredid\_\{i\}is the difference between the ranks of theii\-th pair of observations\. The coefficient ranges from−1\-1to11, with values closer to11\(−1\-1\) indicating a stronger positive \(negative\) monotonic association\. Table[6](https://arxiv.org/html/2608.28926#A1.T6)reports the Spearman correlation coefficients among the variables, where an asterisk \(∗\*\) indicatesp<0\.01p<0\.01\.

Table 6:Spearman correlations between entropy measures and utterance properties\. An asterisk \(∗\*\) indicatesp<0\.01p<0\.01\.We observe moderate to high correlations between the entropy values and the turn index and speaker count, on both corpora\. However, we see that such relationship becomes weaker when the entropy values are normalized\. Given the findings from Table[6](https://arxiv.org/html/2608.28926#A1.T6)and the results reported in Table[1](https://arxiv.org/html/2608.28926#S4.T1), we argue that normalizing the entropy variable prevents the model from capturing noise and colinear information from simple utterance properties such as turn index or speaker count\. Hence, normalized entropy values better represent turn\-taking dynamics without capturing such spurious information, as originally expected\.

## Appendix BModel Implementation Details

In this appendix we provide model implementation details of our experiments\.

### B\.1Language Models

We use the large versions of uncased BERT,RoBERTa and DeBERTaV3 to build our baseline and multitask intent recognition models\. All our fine\-tuning runs were conducted on a single NVIDIA A100 Tensor Core GPU of 80GB\. We used theBertForSequenceClassification,RobertaForSequenceClassification,DebertaV2ForSequenceClassificationclass from Hugging Face’s Transformers library[Wolf et al\. \(2020\)](https://arxiv.org/html/2608.28926#bib.bib42)for sequence classification tasks\.

Work in[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23);[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22)was implemented on the base version of RoBERTa\. Thus, we reproduce their methods using RoBERTaLARGEfor better comparability with our work\. Additional experiments on prior research using RoBERTaBASEand their results are discussed in Appendix[E](https://arxiv.org/html/2608.28926#A5)\.

### B\.2Large Language Models

Figure[5](https://arxiv.org/html/2608.28926#A2.F5)shows the prompt template we use in our LLM baseline experiment on the intent recognition task\.

LLM Intent Classification Prompt\*\*Task description\*\*Your task as an annotator is to assign a supported intent to the last utterance of a dialogue of multiple participants\. Return the corresponding intent label\.
\*\*Authorized categories\*\*The supported intents and their definition are:\[INTENTS\_DEFINITIONS\]
\*\*Previous utterances in the dialogue\*\*You have the following utterance history from multiple participants to understand the context of the dialogue:\[PREVIOUS\_UTTERANCES\]
\*\*Expected output format\*\*Your response should contain the inferred intent between brackets as follows: \[intent\_label\]
Do not write anything else\.
\*\*Task\*\*The utterance to classify is shown below:\[UTTERANCE\_TO\_CLASSIFY\]
Predicted intent:Figure 5:Prompt template used on the LLM baseline for the intent classification task\. Highlighted text inbluevaries among dataset examples\.
### B\.3Prior Work Implementation

In our implementations of[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23);[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22), out\-of\-scope utterances are excluded from the training loss and evaluation metrics but retained as dialogue context\. To preserve faithfulness to the baseline based on\([Qamar et al\., 2023](https://arxiv.org/html/2608.28926#bib.bib23)\), hyperparameters are kept close to the original speaker\-graph setup when specified\. Unspecified hyperparameters are selected to follow relevant standards and support stability and memory usage\. They are held identical across datasets, seeds, and encoder variants\.

We use chunks of 128 utterances, dropout 0\.5, weight decay5×10−45\\times 10^\{\-4\}, learning rate10−410^\{\-4\}for the encoder and10−310^\{\-3\}for the graph head, training for up to 100 epochs with early stopping after 10 non\-improving validation epochs\. The learning rate is reduced by a factor of 0\.1 after four validation epochs without macro\-F1 improvement\. The batch size is fixed to 4 to balance optimization stability and memory usage: smaller batches would yield noisier gradient estimates, while larger batches increase the memory load of 128\-utterance chunks processed through the RoBERTa, BiGRU, and RGAT modules[Keskar et al\. \(2016\)](https://arxiv.org/html/2608.28926#bib.bib7);[McCandlish et al\. \(2018\)](https://arxiv.org/html/2608.28926#bib.bib9)\.

The maximum token length is set to 96 as a compromise between context preservation and transformer cost with shorter limits increasing the risk of truncating informative utterance content and longer limits the quadratic self\-attention cost across all utterances in a chunk[Vaswani et al\. \(2017\)](https://arxiv.org/html/2608.28926#bib.bib8)\. Gradient clipping is set to 1\.0 as a conservative stabilization threshold for the recurrent component, following the standard use of norm clipping to mitigate exploding gradients in recurrent neural networks[Pascanu et al\. \(2013\)](https://arxiv.org/html/2608.28926#bib.bib10)\.

### B\.4Our Baseline Implementation

Our baseline models implement an early stopping mechanism with a wait patience of 5\. We use the macro\-F1 score as the metric to monitor on the early stopping strategy\. We use AdamW optimizer[Loshchilov and Hutter \(2017\)](https://arxiv.org/html/2608.28926#bib.bib51)for optimizing the training objectives\. Table[7](https://arxiv.org/html/2608.28926#A2.T7)shows the hyperparameter configuration we employ in our baseline experiments for all the models\.

Table 7:Set of hyperparameters used on BERT, RoBERTa, and DeBERTa fine\-tuning baseline experiments\.
### B\.5Multi\-task Method Implementation

In addition to the early stopping mechanism applied on the main task \(i\.e\., intent classification\), we also set a less tolerant early stopping strategy on the auxiliary task \(i\.e\., entropy regression\)\. We argue that the auxiliary task acts in part as a regularizer during the model fine\-tuning, which negatively impacts the main task performance after some training iterations\. Hence, we define a patience of 2 epochs for the auxiliary task, which is disconnected from the total loss computation when the early stopping is activated\. To do so, we monitor the auxiliary task on the MAE\. For the main task, we keep a wait patience of 5\. By doing so, we force the model to solely optimize the intent classification loss in the last epochs of the model fine\-tuning\.

Our proposed multi\-task methods includes two additional hyperparameters to the set of hyperparameters used in our baseline experiments \(see Section[3\.4](https://arxiv.org/html/2608.28926#S3.SS4)and Appendix[B\.4](https://arxiv.org/html/2608.28926#A2.SS4)\)\. First, we add the hyperparameterλ\\lambda, which controls the weight of the auxiliary loss in the average loss computation on the multi\-task setting\. Moreover, we include the layer number in our architecture where we connect the regression head\. Both hyperparameters are optimized using Optuna\. Table[8](https://arxiv.org/html/2608.28926#A2.T8)shows the search spaces we define for both hyperparameters\. Table[9](https://arxiv.org/html/2608.28926#A2.T9)shows the final hyperparameter sets that we use in the multi\-task setting experiments, including the optimized hyperparametersλ\\lambdaandl\.

Table 8:Optuna hyperparameter search space for the average weightλ\\lambdaand layer numberlon the multi\-task architecture\.Table 9:Set of hyperparameters used on BERT, RoBERTa, and DeBERTa fine\-tuning multi\-task method experiments after Bayesian optimization\.

## Appendix CDataset Statistics

Table[10](https://arxiv.org/html/2608.28926#A3.T10)shows the number of examples per dataset split\. All corpora contain both in\-scope and out\-of\-scope \(OOS\) intents\. That means that there are many utterances that are not associated to any specific intent\. Our classification task is defined over in\-scope examples\. MPGT, MIntRec2\.0 and MEETInt contain 22%, 38% and 0\.5% of in\-scope examples to classify, respectively\. Despite we do not use OOS examples as target utterances to classify, we retain them when they are part of the previous utterances as they provide contextual information\.

Table 10:Number of examples per dataset split and number of labels on each corpus\.
## Appendix DSpeaker Embedding Experiments

We perform additional experiments in order to determine a strong baseline method for our work\. In particular, we study different input representations with a fixed architecture over the same backbone models that we describe in Section[3](https://arxiv.org/html/2608.28926#S3)\. The input representations are described as follows:

1. 1\.w/o context:Each example corresponds to the target utterance to classify without prepending previous utterances as context\.
2. 2\.only target speaker:Following[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37), each example corresponds to the target utterance to classify and the previous utterances produced by the speaker of the target utterance to classify \(i\.e\. targer speaker\) as context\.
3. 3\.all speakers w/o speaker emb\.:Each example is represented by the target utterance to classify and the utterances previously spoken by any speaker\.
4. 4\.all speakers w\. speaker emb\.:Each example is represented by the target utterance to classify and the utterances previously spoken by any speaker\. In addition, we add a speaker embedding representation that indicates what utterances have been spoken by the target speaker\.

Table 11:Performance evaluation on the intent classification task using different input representation strategies\. Scores correspond to the average macro F1 and accuracy over 5 runs\. Scores inboldhighlightthe bestperformance on the same backbone model\.For these experiments, we use the same hyperparameter values reported in Table[7](https://arxiv.org/html/2608.28926#A2.T7), except that the models are fine\-tuned over 40 epochs and we use early stopping with a patience of 3 epochs\. We observe in Table[11](https://arxiv.org/html/2608.28926#A4.T11)that the approach proposed by[Zhang et al\. \(2024\)](https://arxiv.org/html/2608.28926#bib.bib37)outperforms adding all speakers previous utterances without speaker embeddings on BERT and RoBERTa\. Nevertheless, our adding our proposed speaker embeddings shows performance gains\. Overall, we see that including utterances produced by all speakers with speaker embeddings provides better performance than any other strategy on both models\. On the other hand, we see that the best strategy on DeBERTa is the representation that includes all speaker context utterances without speaker embeddings\. Similar to the results on BERT and RoBERTa, solely providing target speaker context utterances is not the best strategy on DeBERTa\. For consistency and better comparability across models, we select theall speakers w\. speaker emb\.strategy as the input representation for both our baseline and our multi\-task learning method\.

## Appendix EComparison of RoBERTaBASEand RoBERTaLARGEon Prior Works

The experiments on prior works[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22);[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)that we reproduce and report in Section[4](https://arxiv.org/html/2608.28926#S4)are conducted on RoBERTaLARGE, since our methods and other baseline approaches are implemented on the large versions of pre\-trained models\. Our aim is to keep fair comparisons among methods\. Nevertheless, results reported in[He et al\. \(2021c\)](https://arxiv.org/html/2608.28926#bib.bib22);[Qamar et al\. \(2023\)](https://arxiv.org/html/2608.28926#bib.bib23)are obtained from experiments on the base versions of RoBERTa\. Therefore, we make additional experiments on prior work implemented with RoBERTaBASE\. Table[12](https://arxiv.org/html/2608.28926#A5.T12)shows the performance comparison between the two versions of RoBERTa\. Note that, while the results on the base version of RoBERTa are higher, such scores are still lower than our proposed method evaluation presented in Table[1](https://arxiv.org/html/2608.28926#S4.T1)from Section[4](https://arxiv.org/html/2608.28926#S4)\.

Table 12:Performance evaluation on the intent classification task\. Comparison between RoBERTaBASEand RoBERTaLARGEon prior work baselines\. Scores correspond to the average macro F1 and accuracy over 5 runs\.
## Appendix FTarget Variables Relationship Analysis Details

In this appendix, we provide further details of the statistical relationship analysis described in Section[7](https://arxiv.org/html/2608.28926#S7)\. The Kruskal–Wallis test is a non\-parametric statistical test for comparing a continuous variable acrosskkindependent groups, whose null hypothesis indicates no difference between groups\. Rather than operating on raw values, the test converts observations to their ranks\. LetNNdenote the total number of observations,nin\_\{i\}the sample size for groupii, andRiR\_\{i\}the sum of ranks assigned to observations in groupii\. The Kruskal–Wallis test statisticHHis computed as:

H=12N⁡\(N\+1\)​∑i=1kRi2ni−3​\(N\+1\),H=\\frac\{12\}\{N\(N\+1\)\}\\sum\_\{i=1\}^\{k\}\\frac\{R\_\{i\}^\{2\}\}\{n\_\{i\}\}\-3\(N\+1\),\(5\)whereHHapproximately follows a chi\-squared distribution withk−1k\-1degrees of freedom under the null hypothesis of no difference between groups\. Unlike parametric alternatives such as ANOVA[Fisher \(1930\)](https://arxiv.org/html/2608.28926#bib.bib48), this rank\-based approach does not assume normality of the data\. Thus, given the peaks around 0 and 1 as well as the tails observed in Figure[3](https://arxiv.org/html/2608.28926#S3.F3), the lack of normality assumption is essential for our analysis\. However, the Kruskal–Wallis test provides only app\-value indicating statistical significance, without directly measuring the practical magnitude of differences\. To address this limitation, we also report the effect sizeϵ2\\epsilon^\{2\}\(epsilon\-squared\), computed as:

ϵ2=H−k\+1N−k,\\epsilon^\{2\}=\\frac\{H\-k\+1\}\{N\-k\},\(6\)whereHHis the test statistic,kkis the number of groups being compared, andNNis the total sample size\. The effect sizeϵ2\\epsilon^\{2\}ranges from 0 to 1, with values closer to 1 indicating stronger associations between the grouping variable and the continuous outcome\. Finally, Figure[6](https://arxiv.org/html/2608.28926#A6.F6)shows the distributions of the turn\-transition entropy values per class for MPGT, which illustrates the expected differences among intents\.

Figure 6:Distribution of the turn\-transition entropy values across classes for MPGT\.

Similar Articles

Token Statistics Reveal Conversational Drift in Multi-turn LLM Interaction

arXiv cs.CL

This paper introduces Bipredictability (P) and the Information Digital Twin (IDT), a lightweight method to monitor conversational consistency in multi-turn LLM interactions using token frequency statistics without embeddings or model internals. The approach achieves 100% sensitivity in detecting contradictions and topic shifts while establishing a practical monitoring framework for extended LLM deployments.

Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction

arXiv cs.CL

This paper introduces Real-TurnTurk, a multimodal Turkish conversational dataset for turn-taking prediction, featuring synchronized video, audio, and transcriptions. It uses genetic algorithms to optimize interpretable decision rules for predicting turn transitions in natural dialogue.