Who Argues What? Joint Argument-Entity Detection and Classification in Political Debates
Summary
This paper introduces a joint argument and entity detection method for political debates, using a generative framework with decoder-only LLMs to improve performance over sequential pipelines.
View Cached Full Text
Cached at: 09/10/26, 08:20 AM
# Who Argues What? Joint Argument–Entity Detection and Classification in Political Debates
Source: [https://arxiv.org/html/2609.10192](https://arxiv.org/html/2609.10192)
Stefano Francesco MoneaAffiliation:v\. P\. Bucci 44Z, 87036 Rende, CS, ItalySergio GrecoAffiliation:\{lucio\.lacava, sf\.monea, greco\}@dimes\.unical\.it
###### Abstract
Political debates are often analyzed through Argument Mining \(AM\) to investigate the key arguments that drive them\. However, political arguments are rarely interpretable from argumentative spans alone, as claims and premises generally depend on the entities \(e\.g\., people, events, locations, parties\) they mention\. Existing AM resources and methods typically annotate argumentative spans and roles, but do not provide a paired debate\-entity layer for asking which Debate Named Entities \(DNE\), e\.g\., actors and events, are invoked within debates\. In this work, we address these data and methodological gaps by \(i\) introducing DNE\-ElecDeb, an entity\-enriched version of the USElecDeb dataset that adds DNEs in both argumentative and non\-argumentative spans and defines Debate Named Entity Recognition \(DNER\) as the task of detecting DNEs, and \(ii\) proposing Joint Argument and Entity Tagging \(JAET\), a generative framework that fine\-tunes decoder\-only LLMs to insert inline argument and entity tags into debate turns while preserving the original transcript\. Under BIO\-tagging evaluation, JAET improves relativeF1F\_\{1\}on the joint AM\+DNER task by \+27\.3%, resp\. \+41\.9%, under the untyped, resp\. typed setting over the strongest sequential AM\-DNER pipelines, demonstrating that such gains cannot be recovered by composing two independent modules\. Notably, similar margins replicate on Persuasive Essays \(\+26\.6%, resp\. \+52\.7%\), showing effective generalization to domains orthogonal to political debates\. By unifying argumentative and entity\-level representations within a single view, our contributions pave the way for richer political debates understanding\.
## 1Introduction
Argument Mining \(AM\) aims to identify and interpret argumentative structures in natural language, unstructured texts[Lawrence and Reed \(2019\)](https://arxiv.org/html/2609.10192#bib.bib22)\. By automatically extracting argument components such as premises and claims, and by identifying the relations between them, AM enables the structured representation and analysis of arguments using formal argumentation formalisms[Dung \(1995\)](https://arxiv.org/html/2609.10192#bib.bib10);[Bondarenko et al\. \(1997\)](https://arxiv.org/html/2609.10192#bib.bib1);[Prakken \(2010\)](https://arxiv.org/html/2609.10192#bib.bib33)\.
These representations support a wide range of downstream applications, including legal analysis[Palau and Moens \(2009\)](https://arxiv.org/html/2609.10192#bib.bib29), scientific debate[Sukpanichnant et al\. \(2024\)](https://arxiv.org/html/2609.10192#bib.bib38), online discourse analysis[Habernal and Gurevych \(2017\)](https://arxiv.org/html/2609.10192#bib.bib19), and political communication[Goffredo et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib15)\.
Political debates represent one of the most challenging settings for AM[Cabrio and Villata \(2018\)](https://arxiv.org/html/2609.10192#bib.bib4): they are not a mere collection of isolated and independent arguments, but interleaved turn\-based conversational interactions between speakers who repeatedly refer to opponents, parties, institutions, and organizations\. Notably, these entities not only occur inside non\-argumentative spans, e\.g\., mentioned by a moderator during the opening, but also permeate speakers’ arguments, e\.g\., when a claim targets a specific actor or event\.
Traditional AM annotation frameworks for political debates capture the argumentative spans and roles, but they typically do not explicitly model the entities that contribute to making an argument \(politically\) meaningful\. This is a key limitation: knowing that a textual span is a claim is informative, but knowing which entities are involved in a claim makes the annotation more useful for debate analysis\. Indeed, entities become explicit semantic anchors for interpreting political debate arguments\.
This point becomes even more relevant considering that debates would typically benefit from streaming\-compatible analysis\. Without an explicit entity layer, traditional AM annotation frameworks can detect that speakers are making claims or premises, but they cannot reliably identify whether these involve the same set of entities\. Consequently, they miss valuable parts of the debate structure needed to compare argumentative positions\.
Generic Named Entity Recognition \(NER\) alone cannot address this gap, as it recovers entities while completely missing the argumentative structure in which they appear\.
Similarly, running AM and NER as subsequent yet independent modules remains unsatisfactory: arguments and entities are intertwined, and separate processing can lose mutual dependencies or even produce incompatible boundaries\. This motivates a unified formulation in which argument and entity annotations are learned and predicted together rather than merged\.
Large Language Models \(LLMs\) are well\-suited to this setting, as they can be fine\-tuned to preserve the original discourse flow while inserting entity and argument markers in an autoregressive way\.
#### Contributions
To fill this gap, in this work, we make the following contributions:
- •We curate and release DNE\-ElecDeb, an entity\-enriched version of theUSElecDeb60To20dataset[Haddadan et al\. \(2019\)](https://arxiv.org/html/2609.10192#bib.bib20);[Goffredo et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib15), extending all 44 manually annotated debates with a paired debate\-relevant entity layer covering both argumentative and non\-argumentative spans;
- •We proposeJoint Argument and Entity Tagging\(JAET\), a single\-pass approach aimed at jointly predicting argument component boundaries, argument component labels, entity boundaries, and entity types\. JAET operates at a turn level, enabling streaming\-compatible mining of debate structures as soon as speakers’ turns arrive;
- •We evaluate a representative set of small, open\-weight LLMs, showing that JAET improves relativeF1F\_\{1\}by \+27\.3%, resp\. \+41\.9%, under the untyped, resp\. typed, setting for joint AM\+DNER tagging over the strongest sequential pipeline built on the same backbone and up to \+24%, resp\. \+36\.4%, for AM\-only tagging, resp\. DNER, over the strongest non\-JAET baseline available for each task\.
## 2Related Work
Argument Mining addresses various subtasks, including argument component segmentation \(ACS\) and classification \(ACC\), argument relation identification \(ARI\), and argument relation classification \(ARC\)[Cabrio and Villata \(2018\)](https://arxiv.org/html/2609.10192#bib.bib4)\.
Early AM approaches leveraged feature\-rich supervised methods such as maximum entropy classifiers[Palau and Moens \(2011\)](https://arxiv.org/html/2609.10192#bib.bib30), logistic regression[Levy et al\. \(2014\)](https://arxiv.org/html/2609.10192#bib.bib23), Support Vector Machines[Stab and Gurevych \(2014\)](https://arxiv.org/html/2609.10192#bib.bib36);[Niculae et al\. \(2017\)](https://arxiv.org/html/2609.10192#bib.bib28), and optimization techniques[Stab and Gurevych \(2017\)](https://arxiv.org/html/2609.10192#bib.bib37)\. Neural architectures such as RNNs[Eger et al\. \(2017\)](https://arxiv.org/html/2609.10192#bib.bib11);[Niculae et al\. \(2017\)](https://arxiv.org/html/2609.10192#bib.bib28), LSTMs[Potash et al\. \(2017\)](https://arxiv.org/html/2609.10192#bib.bib32), and Transformer\-based models[Mayer et al\. \(2020\)](https://arxiv.org/html/2609.10192#bib.bib26);[Kashefi et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib21);[Ding et al\. \(2022\)](https://arxiv.org/html/2609.10192#bib.bib8);[Dore et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib9)improved AM capabilities by capturing richer contextual representations from argumentative texts\.
Political debates have been widely recognized as a natural setting for AM[Cabrio and Villata \(2018\)](https://arxiv.org/html/2609.10192#bib.bib4)\. On the one hand, researchers introduced corpora of U\.S\. presidential campaign debates annotated with argument components and corresponding labels[Haddadan et al\. \(2019\)](https://arxiv.org/html/2609.10192#bib.bib20), as well as fallacy annotations[Goffredo et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib15);[Goffredo et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib16)and social reactions[Visser et al\. \(2020\)](https://arxiv.org/html/2609.10192#bib.bib39)\. On the other hand, a body of works assessed and applied AM techniques to political debates\. Among these,[Lippi and Torroni \(2016\)](https://arxiv.org/html/2609.10192#bib.bib24)detected claims in political debates,[Cano\-Basave and He \(2016\)](https://arxiv.org/html/2609.10192#bib.bib5)investigated the impact of argumentative style in influencing an audience in supporting candidates, and[Menini et al\. \(2018\)](https://arxiv.org/html/2609.10192#bib.bib27)predicted relations between arguments in political speeches\. However, all these resources and works focus on argument components and their relations, overlooking the entity layer\.
Table 1:Comparison with related AM/NER literature\.Debates= whether the work uses debate data,Release= whether the work introduces or extends an annotated dataset relevant to its task,ACS= Argument Component Segmentation,ACC= Argument Component Classification,ACS\+ACC= joint ACS and ACC,NER= \(Generic\) Named Entity Recognition,ACS\+ACC\+NER= joint prediction of argument and entity boundary and types\. Asterisks indicate RooseBERT requiring task\-specific fine\-tuning before usage\.The advent of LLMs brought new capabilities to AM by reformulating all subtasks under a generative perspective[Chen et al\. \(2024\)](https://arxiv.org/html/2609.10192#bib.bib7)\. Representative works include using LLMs for extracting arguments[Liu et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib25);[Cabessa et al\. \(2024\)](https://arxiv.org/html/2609.10192#bib.bib2);[Cabessa et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib3);[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6);[Elguendouze et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib13)and relations[Gorur et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib17)spanning multiple domains[Pojoni et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib31);[Favero et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib14)\. Despite showing the promise of LLMs in AM, these works are often not designed for political debates, and do not extend argument mining with entity extraction\.
Concerning the latter, LLMs have also been proven promising for Named Entity Recognition \(NER\) tasks\. GPT\-NER[Wang et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib40)transforms NER from a supervised task to a text\-generation one with self\-verification to improve performance, PROMPT\-NER[Shen et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib35)unifies entity locating and entity typing in prompt learning for NER with a multi\-prompt template, and Universal\-NER[Zhou et al\. \(2024\)](https://arxiv.org/html/2609.10192#bib.bib42)distills large LLMs into smaller ones for open NER\. However, NER\-oriented works do not model the argumentative layer required by AM scenarios\.
Table[1](https://arxiv.org/html/2609.10192#S2.T1)positions our work in the current body of works addressing AM or generic NER, highlighting data\- and task\-related novelties and contributions, which allow us to fill a key gap in the literature\.
## 3Problem Definition
LetD=\[u1,u2,…,un\]D=\[u\_\{1\},u\_\{2\},\\ldots,u\_\{n\}\]be a debate transcript represented as an ordered sequence of turns\. Each turnui=\(si,xi\)u\_\{i\}=\(s\_\{i\},x\_\{i\}\)is a pair wheresis\_\{i\}denotes the speaker metadata, whilexi=\[ti1,ti2,…,tmi\]x\_\{i\}=\[t\_\{i\_\{1\}\},t\_\{i\_\{2\}\},\\ldots,t\_\{m\_\{i\}\}\]is a textual sequence, with eachtijt\_\{i\_\{j\}\}being a token drawn from a vocabularyVV\.
We consider a turn\-based, streaming\-compatible annotation setting\. At time stepii, the model observes only the current turnuiu\_\{i\}and must produce its annotations without access to previous turnsu1,…,ui−1u\_\{1\},\\ldots,u\_\{i\-1\}or future turnsui\+1,…,unu\_\{i\+1\},\\ldots,u\_\{n\}\.
###### Definition 1\(Argument Component\)
Given a turnuiu\_\{i\}with textxi=\[ti1,…,tmi\]x\_\{i\}=\[t\_\{i\_\{1\}\},\\ldots,t\_\{m\_\{i\}\}\], anargument component\(AC\) is a contiguous, non\-overlapping span of tokens
AC=\[tb,…,te\],i1≤b≤e≤mi,AC=\[t\_\{b\},\\ldots,t\_\{e\}\],\\qquad i\_\{1\}\\leq b\\leq e\\leq m\_\{i\},that expresses a meaningful argumentative unit\. Each argument component is assigned an argumentative labelccfrom the set𝒞=\{Claim,Premise\}\.\\mathcal\{C\}=\\\{\\textsc\{Claim\},\\textsc\{Premise\}\\\}\.A tagged argument component is obtained by enclosing the component span within paired tags corresponding to its argumentative label, i\.e\.,
⟨c⟩AC⟨/c⟩,c∈𝒞\.\\langle c\\rangle AC\\langle/c\\rangle,\\qquad c\\in\\mathcal\{C\}\.
Example 1Given the turn“We must reduce taxes because families are struggling\.”, a possible argument\-component annotation is: “<claim\>We must reduce taxes</claim\> because <premise\>families are struggling</premise\>\.”□\\Box
###### Definition 2\(Debate Named Entity\)
Given a turnuiu\_\{i\}with textxi=\[ti1,…,tmi\]x\_\{i\}=\[t\_\{i\_\{1\}\},\\ldots,t\_\{m\_\{i\}\}\], adebate named entity\(DNE\) is a contiguous, non\-overlapping span of tokens
DNE=\[tb,…,te\],i1≤b≤e≤mi,DNE=\[t\_\{b\},\\ldots,t\_\{e\}\],\\qquad i\_\{1\}\\leq b\\leq e\\leq m\_\{i\},that refers to a debate\-relevant entity\. Each named entity is assigned a typeτ\\taufrom a predefined set𝒯\\mathcal\{T\}\. A tagged DNE is hence obtained by enclosing the entity span within paired tags with the corresponding entity type:<τ\\tau\>NE</τ\\tau\>\.
We hereinafter refer to detecting and tagging DNE spans asDebate Named Entity Recognition\(DNER\), i\.e\., a debate\-specific NER task over the DNE inventory\. Note that DNEs can also be found, and hence tagged, outside argumentative spans\.
Example 2Given the turn “President Biden spoke in Washington during the campaign\.”, a possible named\-entity annotation is:
“<person\>President Biden</person\> spoke in <location\>Washington</location\> during the <event\>campaign</event\>\.”□\\Box
###### Definition 3\(Joint Argument–Entity Tagging\)
Given a turnuiu\_\{i\},Joint Argument–Entity Tagging\(JAET\) is the task of learning a mapping function
f\(ui\)=ui∗,f\(u\_\{i\}\)=u\_\{i\}^\{\*\},whereui∗=\(si,xi∗\)u\_\{i\}^\{\*\}=\(s\_\{i\},x\_\{i\}^\{\*\}\), withxi∗x\_\{i\}^\{\*\}being the annotated version ofxix\_\{i\}that preserves the original token order and inserts paired inline tags for argument components and debate\-relevant named entities\.
## 4JAET Mapping Learning
We formulate JAET as a supervised text\-generation task, aimed at learning the transformation functionfffrom Definition[3](https://arxiv.org/html/2609.10192#Thmdefinition3)\. We implement this formulation using adecoder\-onlyLarge Language Model whose parametersθ\\thetaare optimized via fine\-tuning\.
Figure 1:Example of JAET annotation on debate turns\.### 4\.1Learning Paradigm
Each training instance corresponds to a debate turnui=\(si,xi\)u\_\{i\}=\(s\_\{i\},x\_\{i\}\)\. The model must produce an output that \(i\) preserves the verbatim input text, and \(ii\) adds inline argument and entity tags when appropriate, as shown in Figure[1](https://arxiv.org/html/2609.10192#S4.F1)\(cf\. Figure[5](https://arxiv.org/html/2609.10192#A4.F5)in Appendix[E](https://arxiv.org/html/2609.10192#A5)for a detailed example\)\. To make our approach suitable for turn\-based parsing of debates, no previous or future debate turns are included in the training units, forcing the model to produce annotations only relying on the turn’s content\.
### 4\.2Learning Objective
We start optimizing our model by creating a paired dataset\{\(Di,Diτ\)\}i=1L\\\{\(D\_\{i\},D^\{\\tau\}\_\{i\}\)\\\}\_\{i=1\}^\{L\}containingLLdebatesDi=\[ui,1,ui,2,…,ui,ni\]D\_\{i\}=\[u\_\{i,1\},u\_\{i,2\},\.\.\.,u\_\{i,n\_\{i\}\}\]and corresponding ground\-truth tagged versionsDiτ=\[ui,1τ,ui,2τ,…,ui,niτ\]D^\{\\tau\}\_\{i\}=\[u\_\{i,1\}^\{\\tau\},u\_\{i,2\}^\{\\tau\},\.\.\.,u\_\{i,n\_\{i\}\}^\{\\tau\}\], whereui,ju\_\{i,j\}indicates turnjjof debateiiandτ\\taumarks the tagged version\.
Since our formulation operates at a turn\-level, we unfold these debates into a supervised fine\-tuning set according to theAlpacaformat, which has proven to be suitable for instruct fine\-tuning of argument mining task\-specific LLMs[Liu et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib25);[Cabessa et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib3);[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6):
𝒮=\{\(I,Ck,Yk\)\}k=1N,\\mathcal\{S\}=\\\{\(I,C\_\{k\},Y\_\{k\}\)\\\}\_\{k=1\}^\{N\},whereN=∑i=1LniN=\\sum\_\{i=1\}^\{L\}n\_\{i\}is the total number of flattened turns across all debates,IIis the single instruction applied to all input turns \(cf\. Figure[3](https://arxiv.org/html/2609.10192#A1.F3)in Appendix[A](https://arxiv.org/html/2609.10192#A1)\),Ck=\(sk,xk\)C\_\{k\}=\(s\_\{k\},x\_\{k\}\)is the input context containing speaker information and the raw text of flattened turnkk, andYkY\_\{k\}is the corresponding gold tagged output for that turn\.
Accordingly, we optimize the set of parametersθ\\thetaof the underlying decoder\-only LLM by minimizing the negative log\-likelihood of the tagged output\. Specifically, we first consider a per\-turn loss:
ℓk\(θ\)=−1\|Yk\|∑t=1\|Yk\|logpθ\(yk,t∣yk,<t,I,Ck\)\\\!\\\!\\\!\\\!\\\!\\\!\\ell\_\{k\}\(\\theta\)\\\!=\\\!\-\\frac\{1\}\{\|Y\_\{k\}\|\}\\sum\_\{t=1\}^\{\|Y\_\{k\}\|\}\\log p\_\{\\theta\}\\\!\\left\(y\_\{k,t\}\\mid y\_\{k,<t\},I,C\_\{k\}\\right\)\(1\)whereyk,ty\_\{k,t\}is thett\-th token ofYkY\_\{k\}\. These values are hence aggregated over all turn\-level examples as:
ℒJAET\(θ\)=1N∑k=1Nℓk\(θ\)\.\\mathcal\{L\}\_\{\\text\{JAET\}\}\(\\theta\)=\\frac\{1\}\{N\}\\sum\_\{k=1\}^\{N\}\\ell\_\{k\}\(\\theta\)\.\(2\)
Note that the normalization factor in Eq\.[1](https://arxiv.org/html/2609.10192#S4.E1)prevents longer turns from dominating the optimization process, while Eq\.[2](https://arxiv.org/html/2609.10192#S4.E2)gives each turn\-level sample the same weight\. Furthermore, since eachYkY\_\{k\}contains the original turn tokens plus ground\-truth tags, the model is penalized in case it \(i\) changes the original text, \(ii\) misses or hallucinates any tag, and \(iii\) assigns the wrong argument or entity label\. Finally, sinceCkC\_\{k\}does not contain any previous or future turn, our training objective matches the desired turn\-based inference setting\.
### 4\.3Models
We considersmall,open\-weightLarge Language Models that are publicly accessible through the Hugging Face Hub\. We deliberately focus on such models to support JAET adoption in AM scenarios that \(i\) require accessible and scalable deployment[Favero et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib14); \(ii\) exhibit low\-resource constraints[Kashefi et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib21); and \(iii\) require fine\-tuning or deployment in privacy\-preserving settings, e\.g\., legal[Habernal et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib18)or medical[Mayer et al\. \(2020\)](https://arxiv.org/html/2609.10192#bib.bib26)domains\.
Following earlier work on AM[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6), we resort to 7\-8B parameters models, i\.e\.,Llama 3\.1 8B Instruct,Mistral v0\.3 7B Instruct, andQwen 2\.5 7B Instruct\. We report the full details on model deployment and fine\-tuning in Appendix[A](https://arxiv.org/html/2609.10192#A1)\.
## 5Data
To train our set of LLMs and learn the JAET mapping, we introduce the tagged DNE\-ElecDeb resource, which enriches the USElecDeb60to20 corpus, originally introduced by[Haddadan et al\. \(2019\)](https://arxiv.org/html/2609.10192#bib.bib20)and later updated by[Goffredo et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib15), with debate\-relevant entity annotations\. The original corpus consists of transcripts111Transcripts are publicly available from the Commission on Presidential Debates website at[debates\.org](https://debates.org/)from 44 television debates from the U\.S\. presidential and vice\-presidential campaigns between 1960 and 2020, with a particular focus on reciprocal discussion between Democrat and Republican candidates\. This captures the interactional structure of real\-world political debates, and is therefore a natural and ideal setting for studying how arguments unfold around debate\-relevant entities in turn\-based political discourse\. We next describe how the inherited argument annotations were converted into inline tags and how the new entity layer was created\.
### 5\.1Argument Annotations
We used the original human annotations from[Haddadan et al\. \(2019\)](https://arxiv.org/html/2609.10192#bib.bib20);[Goffredo et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib15)as a starting point\. To support generative inline tagging, we converted the inherited metadata annotations, which consist of a separate file containing only annotations, into paired typed tags surrounding the original text, i\.e\.,<claim\>\.\.\.</claim\>and<premise\>\.\.\.</premise\>\. This conversion also required a transcript\-alignment curation pass\. We fixed minor incorrect or duplicate span positions, and restored original punctuation or wording that had been altered or omitted, when the inherited human annotations did not exactly match the original transcript\. All these operations ensured the human\-annotated spans perfectly matched the original debate transcripts before adding entity tags\.
### 5\.2Entity Annotations
This layer is newly introduced in DNE\-ElecDeb, and covers mentions to debate\-relevant entities that are central to the interpretation of political debates, including entities inside argumentative spans as well as within contextual non\-argumentative spans\.
To define the debate entity inventory, we first combined manual inspection with LLM\-assisted exploration of key political entities within the full set of debates considered in this study\. We thus consolidated them into the following entity set:𝒯=\{Person,Role,Organization,Party,Location,Event,Date,Law\}\.\\mathcal\{T\}=\\begin\{aligned\} \\\{&\\textsc\{Person\},\\textsc\{Role\},\\textsc\{Organization\},\\\\ &\\textsc\{Party\},\\textsc\{Location\},\\textsc\{Event\},\\textsc\{Date\},\\textsc\{Law\}\\\}\.\\end\{aligned\}
We hence performed entity annotations and corresponding tag insertion within each debate through an LLM\-assisted, human\-validated workflow, which reduces the costs of human annotation, and follows prior work on LLM\-assisted annotation[Zhang et al\. \(2023\)](https://arxiv.org/html/2609.10192#bib.bib41);[Ehsan and Solorio \(2026\)](https://arxiv.org/html/2609.10192#bib.bib12)\. For each turn, we first annotated Debate Named Entities using the Gemini APIs, prompting the model three times to annotate the text verbatim with the corresponding DNE tags, based on the approach illustrated in Appendix[B](https://arxiv.org/html/2609.10192#A2)\. We then determined final entity tags through a consensus\-based strategy: a tag is kept in the final annotation whenever the majority of runs assigned the same entity type to the same text span\.
The resulting annotations were validated as follows\. First, we quantitatively checked the consistency of LLM annotations across turns using the Fleiss’κ\\kappa, which measures the degree of inter\-annotator agreement beyond chance across multiple raters, at the entity\-type level, obtainingκ=0\.724\\kappa=0\.724\. We treat this value only as a stability indicator of the repeated LLM\-assisted annotation process, not as an inter\-rater agreement measure\.
Second, we performed human validation by asking three domain experts to independently annotate a stratified sample of raw transcripts only, blind to LLM annotations\. We achieved an almost perfect human agreement over the token\-level BIO label sequences \(κ=0\.919\\kappa=0\.919\)\. Remarkably, adding the Gemini consensus that produced the released annotations to the three experts confirmed the high agreement \(κ=0\.900\\kappa=0\.900\), further strengthening our LLM\-assisted annotation process\.
Third, we also assessed the effect of introducing an additional frontier LLM\-annotator, i\.e\., GPT\-5\.5, still obtaining a high agreement \(κ=0\.862\\kappa=0\.862\)\. This suggests LLM\-annotators tend to annotate at essentially the level of agreement the experts find among themselves\. Interestingly, in Section[8](https://arxiv.org/html/2609.10192#S8)we show that substituting the human annotation as ground truth leaves every result unchanged\.
We report the full annotation protocol, together with the recurring qualitative patterns during annotation and the systematic tendencies we observed in the LLM\-assisted pipeline, in Appendix[B](https://arxiv.org/html/2609.10192#A2)\.
Table 2:DNE\-ElecDeb dataset statistics\. Tagged spans include argument components and debate\-relevant named entities\. The split follows an 80/20 train/test partitioning, and was designed to prevent unbalanced distribution of argumentative spans across splits\.Table 3:Distribution of DNE tags across splits for each entity category \(Org = Organizations, Loc = Locations\)\.
### 5\.3Data Overview
Table[2](https://arxiv.org/html/2609.10192#S5.T2)summarizes the resulting dataset\. The train/test split follows an 80/20 turn\-level partition intentionally designed to ensure an argument\-rich test set for properly evaluating AM and joint argument\-entity tagging\. This ensures a turn\-level evaluation design for real\-time debate analysis, rather than held\-out\-debate generalization\. Table[3](https://arxiv.org/html/2609.10192#S5.T3)reports the entity distribution across splits\.
## 6Experimental Setup
JAET is conceived as a joint generative tagging task\. Accordingly, a correct output must \(i\) preserve the original turns, \(ii\) correctly identify and classify argumentative spans, and \(iii\) properly recognize political entities and their roles within debates\.
Let us denote with𝒟=\{D1,D2,…,DL\}\\mathcal\{D\}=\\\{D\_\{1\},D\_\{2\},\.\.\.,D\_\{L\}\\\}a collection of documents corresponding toLLpolitical debates, such that each debateDi=\[ui,1,ui,2,…,ui,ni\]D\_\{i\}=\[u\_\{i,1\},u\_\{i,2\},\.\.\.,u\_\{i,n\_\{i\}\}\]consists of a list ofnin\_\{i\}turns\. We denote withDi∗D\_\{i\}^\{\*\}the corresponding tagged version obtained by applying our LLM\-based functionffto all turns inDiD\_\{i\}, such thatDi∗=\[ui,1∗,ui,2∗,…,ui,ni∗\]D\_\{i\}^\{\*\}=\[u\_\{i,1\}^\{\*\},u\_\{i,2\}^\{\*\},\.\.\.,u\_\{i,n\_\{i\}\}^\{\*\}\], where eachui,j∗=f\(ui,j\)u\_\{i,j\}^\{\*\}=f\(u\_\{i,j\}\)\.
Hereinafter, to keep the metric definition readable, we useuuto denote an arbitrary turn from the test setU=\{ui,j\|Di∈𝒟∧1≤j≤ni\}U=\\\{u\_\{i,j\}\\,\|\\,D\_\{i\}\\in\\mathcal\{D\}\\,\\wedge\\,1\\leq j\\leq n\_\{i\}\\\}, andu∗u^\{\*\}anduτu^\{\\tau\}, to refer to the predicted and gold\-tagged version ofuu, respectively\. Joint annotations are evaluated at the token level by pairing the argument and entity labels produced for the same token\.
### 6\.1Baselines and Competing Methods
We compare the tagging and corresponding classification performance of JAET against two families of approaches, namely \(i\) prompt\-based baselines, and \(ii\) task\-specific competing methods\. Specifically, the former allows us to quantify how far instruction\-following alone can handle joint AM and DNER without any parameter update, while the latter allows us to compare JAET with the closest architectural alternatives\. We report all details, prompts, and training settings for the baselines and competing methods presented next in Appendix[A](https://arxiv.org/html/2609.10192#A1)\.
#### Prompt\-based Baselines
We consider zero\-shot and few\-shot settings adopting the same decoder\-only LLMs used for JAET fine\-tuning, to isolate the impact of the latter on base models\. In the zero\-shot setting, we provide the model only with task instruction, the current turn, the argument and entity type inventories, and the constraint to preserve original text\. For few\-shot, we also provide a small set of tagged turns sampled from the training split\. In both cases, the LLM is asked to produce both argument and entity annotations\.
#### Decoder\-only Approaches
As a generative competing method, we apply the set of models released by[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)to DNE\-ElecDeb\. This approach uses the same family of 7\-8B models we adopt in this work, thus allowing us to assess the impact of our tagging and fine\-tuning strategy, but it is designed only for AM tasks and does not address DNER\. Nonetheless, it currently represents one of the most competitive approaches for AM, and therefore constitutes a strong comparison point for the AM component of our framework\.
#### Encoder\-only Approaches
We consider the recently released RooseBERT[Dore et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib9)\. This represents the closest approach w\.r\.t\. our work, as it is a political\-domain BERT\-based model, which has been tested under both AM and entity\-recognition scenarios, producing notable results\.
To keep the evaluation fair, we fine\-tuned this model to perform joint AM and DNER on the same DNE\-ElecDeb train split used for JAET, using the parameters recommended by[Dore et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib9)\.
### 6\.2Evaluation Criteria
To evaluate the tagging and classification quality of JAET and competing methods, we focus on token\-level segmentation quality, following standard evaluation practices in AM[Dore et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib9);[Favero et al\. \(2025\)](https://arxiv.org/html/2609.10192#bib.bib14);[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)\. We convert tagged turns into BIO sequences[Ramshaw and Marcus \(1995\)](https://arxiv.org/html/2609.10192#bib.bib34)under two variants\. In theboundary\-onlyvariant, tokens are labeled asB,I, orOdepending on whether they begin a span, continue a span, or occur outside any target span, regardless of the span type\. In thetypedvariant, boundary labels are paired with the corresponding class, e\.g\.,B\-Claim/I\-Claimfor argument components orB\-Person/I\-Personfor entities, whileOstill denotes tokens outside the target layer\. For the joint setting, each token receives a paired label from both AM and debate\-entity layers, and a prediction is considered correct iff both layers match the ground\-truth label for that token\.
For all scenarios, we report precision, recall, andF1F\_\{1\}computed over aligned BIO tags\. Note that, to account for the imbalance in the set of argument classes and political entities, all scores are reported as macro\-averaged\.
Since token\-level BIO evaluation requires predicted and gold sequences to be aligned, we enforce equal\-length BIO sequences by right\-padding the shorter sequence withOtags, enabling direct token\-wise comparison under a one to one alignment strategy that penalizes generated outputs that insert, delete, or reorder transcript tokens\.
Table 4:Boundary\-only token\-level BIO results on the test set of DNE\-ElecDeb\. Argument Mining \(i\.e\., joint Argument Component Segmentation and Classification\), Debate NER, and Joint report precision \(P\), recall \(R\), andF1F\_\{1\}\.TPRT\_\{PR\}/TWRT\_\{WR\}for the encoder\-only approach are obtained by reconstructing the text after annotation\. “–” indicates unavailable outputs from that method\. Bolded values correspond to the best performance\.Table 5:Typed token\-level BIO results for AM \(joint ACS and ACC\) on the test set of DNE\-ElecDeb\.[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)does not produce joint ACS\+ACC labels\. Bolded values correspond to the best performance\.
### 6\.3Sanity Check Criteria
Finally, since JAET performs generative inline tagging, a tagged debate can be semantically valid but practically unusable, e\.g\., if the source text is changed, the LLM hallucinates, or tags are malformed\. Therefore, we measure these as follows\.
Let us denote withstrip\(⋅\)strip\(\\cdot\)a cleaning function that removes all tags from an input sequence\.
To detect changes in tagged texts with respect to the original ones \(e\.g\., due to hallucinations\), we define theText Preservation Rateas:
TPR=1\|𝒰\|∑u∈𝒰𝟏\[strip\(u∗\)=strip\(uτ\)\]\.\\mathrm\{T\_\{PR\}\}=\\frac\{1\}\{\|\\mathcal\{U\}\|\}\\sum\_\{u\\in\\mathcal\{U\}\}\\mathbf\{1\}\\left\[\\text\{strip\}\(u^\{\*\}\)=\{\\text\{strip\}\(u^\{\\tau\}\)\}\\right\]\.\(3\)
Similarly, we quantify tag syntax quality by means of theTag Well\-formed Rateas:
TWR=1\|𝒰\|∑u∈𝒰𝟏\[wellformed\(u∗\)\],\\mathrm\{T\_\{WR\}\}=\\frac\{1\}\{\|\\mathcal\{U\}\|\}\\sum\_\{u\\in\\mathcal\{U\}\}\\mathbf\{1\}\\left\[\\text\{wellformed\}\(u^\{\*\}\)\\right\],\(4\)wherewellformed\(⋅\)\\text\{wellformed\}\(\\cdot\)checks whether tags are properly formatted, opened, closed, and nested\.
## 7Results
Table[4](https://arxiv.org/html/2609.10192#S6.T4)reports boundary\-only token\-level BIO results for argument mining, debate entity recognition, and the joint task\. Across all scenarios, JAET variants outperform the competing methods and prompt\-based baselines: Mistral 7B emerges as the strongest variant for AM \(F1=0\.745F\_\{1\}=0\.745\) and joint AM\+DNER \(F1=0\.644F\_\{1\}=0\.644\)—becoming our reference model, while Llama 3\.1 8B achieves the highest debate\-entity score \(F1=0\.918F\_\{1\}=0\.918\)\.
Specifically, comparing each task against the strongest non\-JAET baseline, JAET improves relativeF1F\_\{1\}by \+24% for AM over the best AM\-only model by[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)\(0\.745 vs\. 0\.601\), \+36\.4% for DNER over the best prompt\-only baseline \(0\.918 vs\. 0\.673\), and \+87\.2% for joint AM\-DNER over RooseBERT \(0\.644 vs\. 0\.344\)\. Note that the latter is conceived as an encoder\-only approach, and this is reflected in generative\-quality aspects, e\.g\., its low text preservation rate\. Therefore, while keeping it within our comparison, we consider models having the same generative backbone as direct competing approaches\.
Prompt\-only baselines clarify the role of fine\-tuning, showing that simple prompting is not sufficient for reliable joint tagging\. Indeed, while few\-shot prompting improves over zero\-shot for AM \(LlamaF1=0\.532F\_\{1\}=0\.532\), DNER \(QwenF1=0\.673F\_\{1\}=0\.673\), and joint tagging \(LlamaF1=0\.317F\_\{1\}=0\.317\), suggesting provided examples help models understanding the desired schema, all remain far below the best JAET scores of 0\.745, 0\.918, and 0\.644, respectively\.
The sanity metrics from Table[4](https://arxiv.org/html/2609.10192#S6.T4)further show these gains are not obtained at the cost of malformed or heavily altered outputs, since JAET consistently yields text preservation rate at least 0\.946 and tag well\-formed rate at least 0\.998\. By contrast, the best non\-JAET text preservation rate is 0\.834, and prompt\-only variants are even less reliable in preserving the original script\. Furthermore, repeating fine\-tuning and inference under three random seeds makes macro\-F1F\_\{1\}vary below10−310^\{\-3\}, thus the reported improvements are outside seed variance\.
Note thatTPRT\_\{PR\}andF1F\_\{1\}are not fully orthogonal, since our BIO alignment right\-pads the shorter sequence \(cf\. Section[6](https://arxiv.org/html/2609.10192#S6)\)\. Considering correctly\-preserved turns only \(cf\. Table[13](https://arxiv.org/html/2609.10192#A3.T13)in Appendix[C](https://arxiv.org/html/2609.10192#A3)\) still leaves a gap of 0\.19F1F\_\{1\}on AM and 0\.26 on the joint task in favor of JAET, which is hence due to tagging quality rather than text preservation\.
Given the high DNE capabilities of all considered approaches, we next focus on typed BIO AM results, unveiling where potential AM bottlenecks emerge\. As reported in Table[5](https://arxiv.org/html/2609.10192#S6.T5), the beginning of argumentative spans represents the major bottleneck for AM, withB\-\*labels being consistently harder than the correspondingI\-\*ones\.
To isolate the source of the JAET gains over competing methods, we compared the best\-performing JAET model \(i\.e\., Mistral\) with three ablated variants that share the same set of models and fine\-tuning hyperparameters than the full JAET one\. AM\-only removes the entity layer from the training data, and is meant to assess whether and to what extent joint tagging harms AM performance\. AM→\\toDNER and DNER→\\toAM represent sequential pipeline variants in which the two layers are predicted in a fixed order rather than jointly, by means of task\-specific models\.
Ablation results in Table[6](https://arxiv.org/html/2609.10192#S7.T6)confirm that the remarkable performance achieved by JAET are due to joint argument\-entity modeling\. Interestingly, compared with the AM\-only variant, JAET fully preserves the AM performance under both untyped and typed evaluation settings: recovering the entity layer and the joint structure comes at no cost on argument mining, which is a desiderata of the entity\-enriched formulation we propose\.
Most importantly, Table[6](https://arxiv.org/html/2609.10192#S7.T6)demonstrates that JAET performance cannot be achieved by simply leveraging a sequential AM\-DNER or DNER\-AM pipeline\. Indeed, JAET improves by \+27\.3% relativeF1F\_\{1\}over the best sequential pipeline \(AM→\\toDNER, 0\.644 vs\. 0\.506\) considering the untyped scenario, and by \+41\.9% over the typed one \(0\.464 vs\. 0\.327\)\. Against DNER→\\toAM the corresponding margins increase to \+55\.2% and \+122%, respectively\. The latter suggests that JAET learns better tag placement, while also improving type inference, compared to pipeline\-based variants\. Appendix[E](https://arxiv.org/html/2609.10192#A5)reports additional insights into the underlying error patterns of sequential composition that a single\-pass model cannot exhibit by construction\. Overall, our results support the central claim that predicting arguments and entities in a single pass better exploits their interdependency than composing two independent modules\.
Table 6:Ablation study comparing Mistral JAET against AM\-DNER pipelines and single\-task variants on Argument Mining \(AM\) under typed and untyped BIO settings\. Bolded values indicate the best performance\.
## 8Robustness and Generalization
We finally assess the robustness of our findings using our reference model Mistral, as detailed next\.
#### Annotation Provenance
First, we verify that our results do not depend on the LLM\-assisted entity layer annotations \(cf\. Section[5\.2](https://arxiv.org/html/2609.10192#S5.SS2)\) by replacing these annotations with those produced by three human experts and replicating our experiments\. Notably, we do not observe any concrete change inF1F\_\{1\}\(e\.g\., joint untypedF1F\_\{1\}moves from 0\.6436 to 0\.6448\), and the joint scores slightly increase\. This confirms JAET performance is invariant to whether the ground truth is model\- or human\-annotated\.
#### Generalization to Unseen Debates
By default, our data partition is turn\-level to target real\-time debate analysis rather than fully held\-out\-debates \(cf\. Section[5\.3](https://arxiv.org/html/2609.10192#S5.SS3)\)\. However, to discard any potential leakage and measure how well our approach generalized to unseen debates, we re\-partitioned our data at the debate level, i\.e\., 35 debates for training and 9 entirely held\-out ones for testing\. We hence re\-trained our reference model and repeated the evaluation\. Notably, this process only yielded a cost of 2\.4–5\.0% relativeF1F\_\{1\}\(cf\. Table[14](https://arxiv.org/html/2609.10192#A3.T14)in Appendix[D](https://arxiv.org/html/2609.10192#A4)\)\. In particular, typed AM precision increased on held\-out debates \(0\.5851 vs\. 0\.5945\) while recall decreases \(0\.5835 vs\. 0\.5576\), i\.e\., the model becomes more conservative on unfamiliar spans, which we ascribe to genuine generalization rather than memorization\.
#### Domain Transfer
We finally assess whether our findings are domain\-specific, by evaluating JAET on Persuasive Essays[Stab and Gurevych \(2017\)](https://arxiv.org/html/2609.10192#bib.bib37), a domain differing from political debates on every relevant axis: written rather than spoken, single\-author rather than adversarial, and edited rather than disfluent\. Our reference model achieves untypedF1=0\.8641F\_\{1\}=0\.8641on AM and0\.68440\.6844on the joint task, improving over the strongest prompt\-based baseline by \+104%, resp\. 235\.5% \(cf\. Table[15](https://arxiv.org/html/2609.10192#A3.T15)in Appendix[D](https://arxiv.org/html/2609.10192#A4)\)\. Most importantly, repeating the full ablation in this domain replicates our central finding \(cf\. Table[16](https://arxiv.org/html/2609.10192#A3.T16)\): JAET improves over the strongest sequential pipeline—DNER→\\toAM here—by \+26\.6% untyped and \+52\.7% typed, closely mirroring the debate margins \(\+27\.3%, resp\. \+41\.9%\)\. Exactly as in debates, joint tagging matches a dedicated AM\-only model on AM while additionally recovering the entity layer a pipeline cannot produce, and also properly generalizes across domains\.
## 9Conclusions
In this work, we made a two\-fold contribution to political debate analysis\. First, we curated DNE\-ElecDeb, an entity\-enriched extension of the USElecDeb dataset which addresses the need of unveiling key entities involved in political debates for improving argument mining\. Second, we proposed JAET, a single\-pass generative framework for joint argument mining and debate named entity recognition\. A thorough experimental evaluation showed that JAET enables effective online tag insertion, outperforming encoder\-only and decoder\-only methods as well as AM\-DNER sequential pipelines, with gains that cannot be recovered by composing independent modules and that hold even under strict robustness and generalization assessments\.
Future work will investigate extensions to argument and entity relations, and richer cross\-turn dependencies, key ingredients for enabling contextually\-rich, structured representations of political and debate argumentation\.
#### Acknowledgments\.
The paper was partially supported by the MUR PRIN 2022 project S\-PIC4CHU \(2022XERWK9\)\.
## Limitations
Language UseDNE\-ElecDeb is built from U\.S\. presidential and vice\-presidential debate transcripts, which correspond to English\-only texts\. We acknowledge certain discourse patterns may not transfer to other languages or cultures, and therefore broadening the set of languages remains an open direction\.
Entity InventoryThe entity inventory used in this work is extracted from U\.S\. presidential and vice\-presidential debate transcripts\. Certain roles, organizations, parties, and discourse patterns might not generalize to other political scenarios or cultures\. Enhancing generalizability to other settings \(e\.g\., non\-Western\) remains an open challenge\.
Turn\-level PerspectiveOur framework operates only on a turn\-level perspective for two main reasons\. First, aggregating whole, hour\-long debates goes beyond the context window of the small, deployable models we target\. Second, a preliminary evaluation of our reference model on inputs aggregating multiple consecutive turns was found to affect every metric and collapse text preservation \(cf\. Table[17](https://arxiv.org/html/2609.10192#A4.T17)in Appendix[D](https://arxiv.org/html/2609.10192#A4)\)\. Nonetheless, while turn\-level operation is an optimal operating setting for joint tagging, we acknowledge it limits the detection of cross\-talks and co\-references, which represent a natural direction for improvement\.
Annotation ProvenanceThe entity layer of DNE\-ElecDeb is produced through an LLM\-assisted, human\-validated workflow rather than by exhaustive human annotation\. While we emphasize that human experts report almost perfect agreement \(cf\. Section[5\.2](https://arxiv.org/html/2609.10192#S5.SS2)\) and using only the human annotations as ground truth leaves every result unchanged \(cf\. Section[8](https://arxiv.org/html/2609.10192#S8)\), we acknowledge the annotation pipeline might exhibit some systematic tendencies, which we report in Appendix[B](https://arxiv.org/html/2609.10192#A2)\.
## Ethical Considerations
The enriched dataset and novel framework we release in this work might be used for automated political debate analysis\. Notably, the latter might still affect how candidates, parties, and public debates are interpreted if used without any human supervision\. We therefore urge all stakeholders to use our, and similar tools as an analytical aid rather than a decision\-making tool, and we discard any misuse or decisions taken using our work\.
## References
- Bondarenko et al\. \(1997\)Andrei Bondarenko, Phan Minh Dung, Robert A\. Kowalski, and Francesca Toni\. 1997\.[An abstract, argumentation\-theoretic approach to default reasoning](https://doi.org/10.1016/S0004-3702(97)00015-5)\.*Artif\. Intell\.*, 93:63–101\.
- Cabessa et al\. \(2024\)Jérémie Cabessa, Hugo Hernault, and Umer Mushtaq\. 2024\.In\-context learning and fine\-tuning gpt for argument mining\.*arXiv preprint arXiv:2406\.06699*\.
- Cabessa et al\. \(2025\)Jérémie Cabessa, Hugo Hernault, and Umer Mushtaq\. 2025\.[Argument mining with fine\-tuned large language models](https://aclanthology.org/2025.coling-main.442/)\.In*Proceedings of the 31st International Conference on Computational Linguistics*, pages 6624–6635, Abu Dhabi, UAE\. Association for Computational Linguistics\.
- Cabrio and Villata \(2018\)Elena Cabrio and Serena Villata\. 2018\.[Five years of argument mining: a data\-driven analysis](https://api.semanticscholar.org/CorpusID:51609977)\.In*International Joint Conference on Artificial Intelligence*\.
- Cano\-Basave and He \(2016\)Amparo Elizabeth Cano\-Basave and Yulan He\. 2016\.[A study of the impact of persuasive argumentation in political debates](https://doi.org/10.18653/v1/N16-1166)\.In*Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*, pages 1405–1413, San Diego, California\. Association for Computational Linguistics\.
- Caputo et al\. \(2026\)Ettore Caputo, Sergio Greco, and Lucio La Cava\. 2026\.[Argument component segmentation with fine\-tuned large language models](https://doi.org/10.18653/v1/2026.findings-eacl.272)\.In*Findings of the Association for Computational Linguistics: EACL 2026*, pages 5154–5167, Rabat, Morocco\. Association for Computational Linguistics\.
- Chen et al\. \(2024\)Guizhen Chen, Liying Cheng, Anh Tuan Luu, and Lidong Bing\. 2024\.[Exploring the potential of large language models in computational argumentation](https://doi.org/10.18653/v1/2024.acl-long.126)\.In*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 2309–2330, Bangkok, Thailand\. Association for Computational Linguistics\.
- Ding et al\. \(2022\)Yuning Ding, Marie Bexte, and Andrea Horbach\. 2022\.[Don’t drop the topic \- the role of the prompt in argument identification in student writing](https://doi.org/10.18653/v1/2022.bea-1.17)\.In*Proceedings of the 17th Workshop on Innovative Use of NLP for Building Educational Applications \(BEA 2022\)*, pages 124–133, Seattle, Washington\. Association for Computational Linguistics\.
- Dore et al\. \(2025\)Deborah Dore, Elena Cabrio, and Serena Villata\. 2025\.[Roosebert: A new deal for political language modelling](https://doi.org/10.48550/ARXIV.2508.03250)\.*CoRR*, abs/2508\.03250\.
- Dung \(1995\)Phan Minh Dung\. 1995\.[On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n\-person games](https://doi.org/10.1016/0004-3702(94)00041-X)\.*Artif\. Intell\.*, 77\(2\):321–358\.
- Eger et al\. \(2017\)Steffen Eger, Johannes Daxenberger, and Iryna Gurevych\. 2017\.[Neural end\-to\-end learning for computational argumentation mining](https://doi.org/10.18653/v1/P17-1002)\.In*Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 11–22, Vancouver, Canada\. Association for Computational Linguistics\.
- Ehsan and Solorio \(2026\)Toqeer Ehsan and Thamar Solorio\. 2026\.[A scalable framework for automated NER annotation correction in low\-resource languages](https://doi.org/10.18653/v1/2026.findings-eacl.215)\.In*Findings of the Association for Computational Linguistics: EACL 2026*, pages 4138–4151, Rabat, Morocco\. Association for Computational Linguistics\.
- Elguendouze et al\. \(2026\)Sofiane Elguendouze, Erwan Hain, Elena Cabrio, and Serena Villata\. 2026\.[Compact prompting in instruction\-tuned llms for joint argumentative component detection](https://arxiv.org/abs/2603.03095)\.*Preprint*, arXiv:2603\.03095\.
- Favero et al\. \(2025\)Lucile Favero, Juan Antonio Pérez\-Ortiz, Tanja Käser, and Nuria Oliver\. 2025\.[Leveraging small llms for argument mining in education: Argument component identification, classification, and assessment](https://arxiv.org/abs/2502.14389)\.*Preprint*, arXiv:2502\.14389\.
- Goffredo et al\. \(2023\)Pierpaolo Goffredo, Mariana Chaves, Serena Villata, and Elena Cabrio\. 2023\.[Argument\-based detection and classification of fallacies in political debates](https://doi.org/10.18653/v1/2023.emnlp-main.684)\.In*Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing*, pages 11101–11112, Singapore\. Association for Computational Linguistics\.
- Goffredo et al\. \(2025\)Pierpaolo Goffredo, Deborah Dore, Elena Cabrio, and Serena Villata\. 2025\.[DISPUTool 3\.0: Fallacy detection and repairing in argumentative political debates](https://doi.org/10.18653/v1/2025.acl-demo.45)\.In*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 3: System Demonstrations\)*, pages 472–480, Vienna, Austria\. Association for Computational Linguistics\.
- Gorur et al\. \(2025\)Deniz Gorur, Antonio Rago, and Francesca Toni\. 2025\.[Can large language models perform relation\-based argument mining?](https://aclanthology.org/2025.coling-main.569/)In*Proceedings of the 31st International Conference on Computational Linguistics*, pages 8518–8534, Abu Dhabi, UAE\. Association for Computational Linguistics\.
- Habernal et al\. \(2023\)Ivan Habernal, Daniel Faber, Nicola Recchia, Sebastian Bretthauer, Iryna Gurevych, Indra Spiecker genannt Döhmann, and Christoph Burchard\. 2023\.[Mining legal arguments in court decisions](https://doi.org/10.1007/s10506-023-09361-y)\.*Artif\. Intell\. Law*\.
- Habernal and Gurevych \(2017\)Ivan Habernal and Iryna Gurevych\. 2017\.[Argumentation mining in user\-generated web discourse](https://doi.org/10.1162/COLI_a_00276)\.*Computational Linguistics*, 43\(1\):125–179\.
- Haddadan et al\. \(2019\)Shohreh Haddadan, Elena Cabrio, and Serena Villata\. 2019\.[Yes, we can\! mining arguments in 50 years of US presidential campaign debates](https://doi.org/10.18653/v1/P19-1463)\.In*Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*, pages 4684–4690, Florence, Italy\. Association for Computational Linguistics\.
- Kashefi et al\. \(2023\)Omid Kashefi, Sophia Chan, and Swapna Somasundaran\. 2023\.[Argument detection in student essays under resource constraints](https://doi.org/10.18653/v1/2023.argmining-1.7)\.In*Proceedings of the 10th Workshop on Argument Mining*, pages 64–75, Singapore\. Association for Computational Linguistics\.
- Lawrence and Reed \(2019\)John Lawrence and Chris Reed\. 2019\.[Argument mining: A survey](https://doi.org/10.1162/coli_a_00364)\.*Computational Linguistics*, 45\(4\):765–818\.
- Levy et al\. \(2014\)Ran Levy, Yonatan Bilu, Daniel Hershcovich, Ehud Aharoni, and Noam Slonim\. 2014\.[Context dependent claim detection](https://aclanthology.org/C14-1141/)\.In*Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers*, pages 1489–1500, Dublin, Ireland\. Dublin City University and Association for Computational Linguistics\.
- Lippi and Torroni \(2016\)Marco Lippi and Paolo Torroni\. 2016\.[Argument mining from speech: Detecting claims in political debates](https://doi.org/10.1609/AAAI.V30I1.10384)\.In*Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence*, pages 2979–2985\.
- Liu et al\. \(2023\)Boyang Liu, Viktor Schlegel, Riza Batista\-Navarro, and Sophia Ananiadou\. 2023\.[Argument mining as a multi\-hop generative machine reading comprehension task](https://doi.org/10.18653/v1/2023.findings-emnlp.724)\.In*Findings of the Association for Computational Linguistics: EMNLP 2023*, pages 10846–10858, Singapore\. Association for Computational Linguistics\.
- Mayer et al\. \(2020\)Tobias Mayer, Elena Cabrio, and Serena Villata\. 2020\.Transformer\-based argument mining for healthcare applications\.In*ECAI 2020 \- 24th European Conference on Artificial Intelligence*, volume 325, pages 2108–2115\. IOS Press\.
- Menini et al\. \(2018\)Stefano Menini, Elena Cabrio, Sara Tonelli, and Serena Villata\. 2018\.[Never retreat, never retract: Argumentation analysis for political speeches](https://doi.org/10.1609/AAAI.V32I1.11920)\.In*Proceedings of the Thirty\-Second AAAI Conference on Artificial Intelligence, \(AAAI\-18\)*, pages 4889–4896\.
- Niculae et al\. \(2017\)Vlad Niculae, Joonsuk Park, and Claire Cardie\. 2017\.[Argument mining with structured SVMs and RNNs](https://doi.org/10.18653/v1/P17-1091)\.In*Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 985–995, Vancouver, Canada\. Association for Computational Linguistics\.
- Palau and Moens \(2009\)Raquel Mochales Palau and Marie\-Francine Moens\. 2009\.[Argumentation mining: the detection, classification and structure of arguments in text](https://doi.org/10.1145/1568234.1568246)\.In*Proceedings of the 12th International Conference on Artificial Intelligence and Law*, ICAIL ’09\. Association for Computing Machinery\.
- Palau and Moens \(2011\)Raquel Mochales Palau and Marie\-Francine Moens\. 2011\.[Argumentation mining](https://doi.org/10.1007/S10506-010-9104-X)\.*Artif\. Intell\. Law*, 19\(1\):1–22\.
- Pojoni et al\. \(2023\)Mircea\-Luchian Pojoni, Lorik Dumani, and Ralf Schenkel\. 2023\.Argument\-mining from podcasts using chatgpt\.In*ICCBR Workshops*, pages 129–144\.
- Potash et al\. \(2017\)Peter Potash, Alexey Romanov, and Anna Rumshisky\. 2017\.[Here’s my point: Joint pointer architecture for argument mining](https://doi.org/10.18653/v1/D17-1143)\.In*Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing*, pages 1364–1373, Copenhagen, Denmark\. Association for Computational Linguistics\.
- Prakken \(2010\)Henry Prakken\. 2010\.[An abstract framework for argumentation with structured arguments](https://doi.org/10.1080/19462160903564592)\.*Argument Comput\.*, 1\(2\):93–124\.
- Ramshaw and Marcus \(1995\)Lance Ramshaw and Mitch Marcus\. 1995\.[Text chunking using transformation\-based learning](https://aclanthology.org/W95-0107/)\.In*Third Workshop on Very Large Corpora*\.
- Shen et al\. \(2023\)Yongliang Shen, Zeqi Tan, Shuhui Wu, Wenqi Zhang, Rongsheng Zhang, Yadong Xi, Weiming Lu, and Yueting Zhuang\. 2023\.[PromptNER: Prompt locating and typing for named entity recognition](https://doi.org/10.18653/v1/2023.acl-long.698)\.In*Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 12492–12507, Toronto, Canada\. Association for Computational Linguistics\.
- Stab and Gurevych \(2014\)Christian Stab and Iryna Gurevych\. 2014\.[Identifying argumentative discourse structures in persuasive essays](https://doi.org/10.3115/v1/D14-1006)\.In*Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing \(EMNLP\)*, pages 46–56, Doha, Qatar\. Association for Computational Linguistics\.
- Stab and Gurevych \(2017\)Christian Stab and Iryna Gurevych\. 2017\.[Parsing argumentation structures in persuasive essays](https://doi.org/10.1162/COLI_a_00295)\.*Computational Linguistics*, 43\(3\):619–659\.
- Sukpanichnant et al\. \(2024\)Purin Sukpanichnant, Anna Rapberger, and Francesca Toni\. 2024\.Peerarg: Argumentative peer review with llms\.*arXiv preprint arXiv:2409\.16813*\.
- Visser et al\. \(2020\)Jacky Visser, Barbara Konat, Rory Duthie, Marcin Koszowy, Katarzyna Budzynska, and Chris Reed\. 2020\.[Argumentation in the 2016 us presidential elections: annotated corpora of television debates and social media reaction](https://doi.org/10.1007/s10579-019-09446-8)\.*Language Resources and Evaluation*, 54\(1\):123–154\.
- Wang et al\. \(2025\)Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, Guoyin Wang, and Chen Guo\. 2025\.[GPT\-NER: Named entity recognition via large language models](https://doi.org/10.18653/v1/2025.findings-naacl.239)\.In*Findings of the Association for Computational Linguistics: NAACL 2025*, pages 4257–4275, Albuquerque, New Mexico\. Association for Computational Linguistics\.
- Zhang et al\. \(2023\)Ruoyu Zhang, Yanzeng Li, Yongliang Ma, Ming Zhou, and Lei Zou\. 2023\.[LLMaAA: Making large language models as active annotators](https://doi.org/10.18653/v1/2023.findings-emnlp.872)\.In*Findings of the Association for Computational Linguistics: EMNLP 2023*, pages 13088–13103, Singapore\. Association for Computational Linguistics\.
- Zhou et al\. \(2024\)Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, and Hoifung Poon\. 2024\.[UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition](https://openreview.net/forum?id=r65xfUb76p)\.In*The Twelfth International Conference on Learning Representations, ICLR 2024*\. OpenReview\.net\.
## Appendix AImplementation Details
All experiments were conducted on a fixed hardware setup consisting of 2×\\timesNVIDIA Tesla T4 GPUs, each equipped with 15 GB of VRAM\.
Table 7:Hugging Face model identifiers for the pre\-trained checkpoints used in our experiments\.CategoryParameterValueTraining SetupEpochs3Batch size2Grad\. accum\. steps4Effective batch size8Max\. seq\. length4096OptimizationLearning rate1×10−41\\times 10^\{\-4\}Weight decay1×10−31\\times 10^\{\-3\}LR schedulerLinearWarmup steps5OptimizerAdamW \(8\-bit\)LoRA ConfigFine\-tuning typeLoRATarget modulesAll linear layersRank \(rr\)16Scaling \(α\\alpha\)16Dropout0BiasNoneQuantizationPrecision4\-bit \(NF4\)Inference SetupMax\. new tokens2048Temperature0\.010\.01Do\-Sampletruetop\-pp0\.1Table 8:Hyperparameter configuration for supervised fine\-tuning \(SFT\) via Unsloth\. The inference hyperparameters were applied uniformly across all experimental conditions, including zero/few\-shot prompting settings\.Concerning decoder\-only models, Table[7](https://arxiv.org/html/2609.10192#A1.T7)lists the Hugging Face model identifiers used to load the pre\-trained checkpoints, while Table[8](https://arxiv.org/html/2609.10192#A1.T8)summarizes the full set of hyperparameters adopted during both training and inference phases\. To mitigate memory constraints while preserving robust model performance, all models were fine\-tuned using parameter\-efficient methods, specifically Low\-Rank Adaptation \(LoRA\) via the Unsloth framework, combined with 4\-bit quantization\. The optimization procedure was kept consistent across all architectures to ensure fair comparability of results\. Training data was formatted following the Alpaca\-style instruction format, as illustrated in Figure[2](https://arxiv.org/html/2609.10192#A1.F2)\. Theinstructionfield contains the full task prompt \(Figure[3](https://arxiv.org/html/2609.10192#A1.F3)\), which specifies the annotation schema and constraints the model must follow during generation\. The inference hyperparameters reported in Table[8](https://arxiv.org/html/2609.10192#A1.T8)were applied uniformly across all experimental conditions, including zero\-shot and few\-shot prompting settings\. Finally, concerning the RooseBERT encoder\-only approach, we trained it for 3 epochs, with batch size 16 and max sequence length of 512, using a learning rate of3×10−53\\times 10^\{\-5\}and weight decay of 0\.01\.
Alpaca Formatting\{\\\{"instruction": "You are given a transcript of a political debate\. Your task is to annotate the text by identifying … ",
"input": "MR\. McGEE: Senator Kennedy, would you …":
"output": "<person\>MR\. McGEE</person\>: <person\>Senator Kennedy</person\> …"\}\\\}Figure 2:Example of a training instance formatted according to the Alpaca\-style instruction template\.Full InstructionYou are given a transcript of a political debate\. Your task is to annotate the text by identifying both argumentative components and named entities\. You must preserve the original text exactly and insert XML\-style tags directly into it without altering, reordering, or paraphrasing any words\. For argumentative structure, identify claims and premises\. A claim is a statement that expresses a position, opinion, or conclusion\. A premise is a statement that provides evidence, justification, or reasoning supporting a claim\. Wrap claims with<claim\>\.\.\.</claim\>and premises with<premise\>\.\.\.</premise\>\. For named entities, identify and annotate all occurrences of persons, organizations, locations, and roles\. Use the following tags:<person\>\.\.\.</person\>,<role\>\.\.\.</role\>,<organization\>\.\.\.</organization\>,<party\>\.\.\.</party\>,<location\>\.\.\.</location\>,<event\>\.\.\.</event\>,<date\>\.\.\.</date\>, and<law\>\.\.\.</law\>\. Annotations must be applied directly to the text so that all tags are properly nested and do not overlap incorrectly\. If a named entity appears inside a claim or premise, the entity tag must be fully contained within the argument tag\. Do not create crossing or partially overlapping tags\. Do not annotate text that is not part of an argument as a claim or premise\. If a sentence does not contain argumentative content, leave it unchanged except for possible named entity annotations\. Return only the fully annotated text and nothing else\.Figure 3:Full instruction prompt used during supervised fine\-tuning and inference\.
## Appendix BDetails on Entity Annotation
#### LLM\-based Annotations
For entity annotation, we leveragedgemini\-3\.1\-pro\-previewthrough the Google AI Studio API interface222[https://aistudio\.google\.com/](https://aistudio.google.com/)with temperature 1\.0, top\-p set to 0\.95, and thinking level set to high\. These settings were selected to balance annotation consistency and contextual sensitivity during entity extraction from political debate transcripts\. Figure[4](https://arxiv.org/html/2609.10192#A2.F4)reports the exact prompt template used to instruct the model during the annotation process\.
Prompt for Entity AnnotationYou are an expert linguistic annotator\. Your task is to perform semantic segmentation and named entity recognition \(NER\) on the given text\.TAGGING SCHEME•<person\>: Names of individuals, including references with titles, honorifics, or descriptive modifiers\.•<organization\>: Institutions, agencies, committees, companies, media outlets, and political organizations\.•<party\>: Political parties, coalitions, or political movements\.•<location\>: Geographic entities such as countries, cities, states, or regions\.•<role\>: Institutional positions or occupations when used generically\.•<event\>: Political, historical, or public events, including elections, debates, and campaigns\.•<date\>: Explicit temporal expressions such as years, dates, or months\.•<law\>: Named laws, acts, constitutional amendments, or legal provisions\.ANNOTATION CONSTRAINTS1\.Do not modify the original text in any way\.2\.Only insert tags around existing text spans\.3\.Annotate the complete entity span whenever possible\.4\.Use<role\>for generic institutional references\.5\.Do not introduce nested tags\.6\.Do not remove or reorder any content\.7\.Return the original text with tags only\.EXAMPLE<person\>President Biden</person\> spoke in <location\>Washington</location\> during the <event\>campaign</event\>\.OUTPUT FORMATReturn only the annotated text, without explanations or additional commentary\.Figure 4:Prompt template used during the entity annotation process\.
#### Human Annotation Protocol
We randomly sampled 105 turns stratified across the 44 debates of DNE\-ElecDeb, so that every debate contributes to the sample proportionally to its number of turns\.
Three domain experts, familiar with political discourse and argument mining, independently annotated the sample working only from the raw transcripts, never accessing the LLM, nor each other’s annotations\. Annotators followed the same entity inventory𝒯\\mathcal\{T\}and the same tagging conventions given to the model \(cf\. Figure[4](https://arxiv.org/html/2609.10192#A2.F4)\)\.
#### Agreement Values
Table[9](https://arxiv.org/html/2609.10192#A2.T9)reports the inter\-annotator agreement over the debate\-stratified sample of 105 turns, for increasingly heterogeneous annotator pools by combining LLM\-based and human\-based annotations\. Agreement is computed as Fleiss’κ\\kappaover token\-level BIO label sequences\.
#### Effect of additional LLM annotators
We replied the same protocol by considering a second annotator model family, namely, GPT\-5\.5\. As shown in Table[9](https://arxiv.org/html/2609.10192#A2.T9), the introduction of these new annotations does not excessively move the agreement values, strengthening our annotation methodology\.
Table 9:Token\-level BIO inter\-annotator agreement over the debate\-stratified sample of 105 turns, for increasingly heterogeneous annotator pools\.
#### Recurring Ambiguity Classes
Inspecting where annotators disagree, we found the corrections to concentrate on a small set of well\-known hard cases\. First, compound and nested entities, e\.g\.,Clinton Foundation, whereClintonreads as a person andFoundationas an organization, admitting either a split annotation or a nested<organization\><person\>Clinton</person\> Foundation</organization\>; the same holds forObama’s Medicare\. Second, roles used to denote a specific person, e\.g\.,the President\. Third, event\-versus\-location readings of the same name, e\.g\.,Pearl Harbor\. Fourth, the segmentation of titled names, e\.g\.,Vice President Bidenas a single<person\>, or as<role\>Vice President</role\> <person\>Biden</person\>\. Notably, these cases were found to be ambiguous for the human experts too, which is why human\-human agreement is high but not perfect\.
#### Systematic Tendencies of the LLM Annotators
By comparing model families and by inspecting where the model diverges from the human annotation, we identified four systematic tendencies of the LLM\-assisted pipeline\. First, a bias toward finer segmentation: when compared with the GPT\-5\.5 annotations, Gemini systematically identifies more entities\. Second, a very rare generative reformulation, i\.e\., slight rephrasing rather than verbatim tagging, e\.g\.,governmentrendered asthe government\. Third, an occasional splitting of multi\-token references into two entities rather than one, e\.g\., in the case ofRoe v\. Wade\. Fourth, an occasional surface normalization, e\.g\., capitalizing speaker names given in lowercase, or correcting evident transcription typos, e\.g\.,MR\. SM1THbecomingMR\. SMITH\.
Crucially, each of these is controlled by our pipeline: reformulation and normalization diverge from the source and are caught and removed by the alignment to the original transcript, while segmentation differences are resolved through the consensus and the human validation pass\. As shown in Section[8](https://arxiv.org/html/2609.10192#S8), none of them affects the final evaluation\.
## Appendix CAdditional Results on DNE\-ElecDeb
Table 10:AM and DNER Pearson corr\. between ground\-truth and predicted tagged spans in the test set\.ρAM\\rho\_\{AM\}, resp\.ρDNER\\rho\_\{DNER\}columns are aggregated across all AM, resp\. DNER, tags\.ρjoint\\rho\_\{joint\}corresponds to the full AM\+DNER tags\.Table 11:Boundary\-only BIO AM performance on the test set of DNE\-ElecDeb\.[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)is not reported because it does not produce joint ACS\+ACC labels\. Bolded values correspond to the best performance\.Table 12:Typed BIO token\-level ablation study comparing JAET against AM\-DNER pipelines and single\-task variants on AM under typed and boundary\-only settings on the test set\. Bolded values indicate the best performance\.#### Component\- and entity\-count correlations
First, we investigate whether our proposed approach recovers the correct amount of components and entities from each turn, by computing the component\- and entity\-count correlations as:
ρA=corr\(\(\|A∗\(u\)\|\)u∈𝒰,\(\|Aτ\(u\)\|\)u∈𝒰\),\\rho\_\{\\text\{A\}\}=\\mathrm\{corr\}\\left\(\(\|A^\{\*\}\(u\)\|\)\_\{u\\in\\mathcal\{U\}\},\(\|A^\{\\tau\}\(u\)\|\)\_\{u\\in\\mathcal\{U\}\}\\right\),\(5\)ρE=corr\(\(\|E∗\(u\)\|\)u∈𝒰,\(\|Eτ\(u\)\|\)u∈𝒰\),\\rho\_\{\\text\{E\}\}=\\mathrm\{corr\}\\left\(\(\|E^\{\*\}\(u\)\|\)\_\{u\\in\\mathcal\{U\}\},\(\|E^\{\\tau\}\(u\)\|\)\_\{u\\in\\mathcal\{U\}\}\\right\),\(6\)whereAAandEEdenote the argument component spans and debate named entity spans, respectively, andcorr\\mathrm\{corr\}is the Pearson correlation coefficient, and provides quantitative insights into the annotation process\. As shown in Table[10](https://arxiv.org/html/2609.10192#A3.T10), all considered models achieve high correlation overall, with minor variations for certain debate entities\.
#### Detailed BIO evaluations
Table[11](https://arxiv.org/html/2609.10192#A3.T11)reports the untyped BIO evaluation on AM and DNER, complementing Table[5](https://arxiv.org/html/2609.10192#S6.T5)from the main text\. Moreover, Table[12](https://arxiv.org/html/2609.10192#A3.T12)provides token\-level BIO insights into the ablation study we performed on JAET \(cf\. Table[6](https://arxiv.org/html/2609.10192#S7.T6)in the main text\)\. Finally, Table[13](https://arxiv.org/html/2609.10192#A3.T13)compares JAET and competing methods by only considering turns that have been correctly preserved after tagging\.
Table 13:MacroF1F\_\{1\}recomputed over correctly\-preserved turns only \(cf\. Section[7](https://arxiv.org/html/2609.10192#S7)\)\. Bolded values indicate the best performance\.Table 14:Effect of a strict debate\-level split for DNE\-ElecDeb \(35 training / 9 held\-out debates\) on our reference model, w\.r\.t\. the turn\-level split of Table[2](https://arxiv.org/html/2609.10192#S5.T2)\.Table 15:Token\-level BIO results on the test set of Persuasive Essays[Stab and Gurevych \(2017\)](https://arxiv.org/html/2609.10192#bib.bib37), under both the boundary\-only \(untyped\) and the typed settings\. Bolded values correspond to the best performance\.Table 16:Ablation study on Persuasive Essays, replicating the setting of Table[6](https://arxiv.org/html/2609.10192#S7.T6)\. “–” indicates unavailable outputs from that method\. Bolded values indicate the best performance\.
## Appendix DAdditional Results on Robustness
#### Generalization to Unseen Debates
Table[14](https://arxiv.org/html/2609.10192#A3.T14)reports the debate\-level split discussed in Section[8](https://arxiv.org/html/2609.10192#S8), in which 35 debates from DNE\-ElecDeb are used for training and 9 entirely held\-out debates for testing, so that no turn from a test debate is ever seen during training\.
#### Domain Transfer
Table[15](https://arxiv.org/html/2609.10192#A3.T15)reports the complete evaluation on Persuasive Essays[Stab and Gurevych \(2017\)](https://arxiv.org/html/2609.10192#bib.bib37), as discussed in Section[8](https://arxiv.org/html/2609.10192#S8)\. We produced the entity layer for this corpus using the same annotation pipeline of Appendix[B](https://arxiv.org/html/2609.10192#A2), yielding the following inventory:Date,Event,Facility,Language,Law,Location,Norp,Organization, andPersonand we mappedMajorClaimsontoClaimsto match the argument inventory𝒞\\mathcal\{C\}of Definition[1](https://arxiv.org/html/2609.10192#Thmdefinition1)\. It should be noted that we deliberately do not include the AM\-only models of[Caputo et al\. \(2026\)](https://arxiv.org/html/2609.10192#bib.bib6)in this comparison, as their released models were originally trained on Persuasive Essays\. Finally, as in the case of DNE\-ElecDeb, Table[16](https://arxiv.org/html/2609.10192#A3.T16)confirms the gain of JAET cannot be achieved by concatenating sequential AM–DNER pipelines\.
#### Effect of the Turn\-level Window
Table[17](https://arxiv.org/html/2609.10192#A4.T17)reports the effect of evaluating our reference model on inputs aggregating an increasing number of consecutive turns \(cf\. Limitations\) from DNE\-ElecDeb\.
Both tagging quality and structural fidelity degrade monotonically with the window size, i\.e\., feeding the model more context at once does not help, and processing the whole debate at once would be ineffective\.
Table 17:MacroF1F\_\{1\}and structural fidelity of our reference model when the input aggregates an increasing number of consecutive turns\. Best values are bolded\.Table 18:Representative test\-set outputs of our reference model and of the two sequential pipelines, illustrating the two failure mechanisms of sequential composition\.Figure 5:Illustrative example of a debate held on October 13, 2004, with its corresponding JAET annotation\.
## Appendix EQualitative Insights
Table[6](https://arxiv.org/html/2609.10192#S7.T6)shows that the performance of JAET cannot be recovered by composing two independent modules\. In this regard, we isolated two structurally distinct reasons for which sequential pipelines fail:
∙\\bulletEach stage is blind to the layer the other predicts:An entity in subject position signals a predication, and hence a claim; conversely, a claim constrains which entity types are plausible inside it\. Neither module can exploit the other’s signal, since each is trained in isolation\.
∙\\bulletThe second stage rewrites already\-tagged text:The second stage of a pipeline must insert its own tags into a text that already carries the tags of the first one, a condition it is never supervised on\. This produces crossing, ill\-formed markup and, more insidiously, the silent deletion of tags the first stage had produced correctly\. A single\-pass model cannot make this class of error at all\.
Table[18](https://arxiv.org/html/2609.10192#A4.T18)reports four representative cases\. In Example 1, each pipeline recovers precisely the layer its final stage was trained to produce, while the joint model recovers both\. Example 2 shows that AM→\\toDNER emits</person\>before any<person\>opens, producing crossing markup and leaving both claims unclosed; DNER→\\toAM is even more revealing, as its entity stage tags both persons correctly, and its argument stage then keeps<person\>Barack Obama</person\>, which liesoutsidethe claim it failed to produce, and destroys<person\>Ahmadinejad</person\>, which liesinsidethe claim it did produce\. The same pattern appears in Example 1, where the two<location\>tags destroyed by the AM stage are exactly the two lying inside the claim it wrapped\. In other words, when the argument stage wraps a span, the entity tags nested within it are lost, and the pipeline discards its own correct predictions precisely at the nested argument\-entity configurations that motivate this work\. In Example 3 both pipelines tag<date\>,<role\>and<person\>correctly, yet emit zero argument components, whereas JAET recovers both the premise and the claim\. Finally, Example 4 illustrates the lack of comprehensive signal among the two stages: a statistic advanced as a position is a claim, not a premise, and both pipelines mislabel it, while the joint model does not\.
Finally, Figure[5](https://arxiv.org/html/2609.10192#A4.F5)provides a complete illustrative example of JAET annotation, showing how argument and entity tags are jointly inserted while preserving the original debate transcript\.Similar Articles
Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning
Proposes Mixture of Debaters (MoD), a framework using Mixture-of-Experts to enable dynamic self-debate within a single LLM, achieving superior accuracy with drastically lower latency and token consumption.
The Confident Liar: Diagnosing Multi-Agent Debate with Log-Probabilities and LLM-as-Judge
This paper studies the relationship between token-level log-probability distributions, LLM-as-judge rubric scores, and final task accuracy in multi-agent debate systems. It finds a consistent four-phase confidence trajectory and role asymmetry between Constructor and Auditor agents.
Logical Embeddings for Argument Analysis
This paper introduces logical embeddings for argument analysis, providing a mathematical framework that outperforms standard embedding methods by focusing on logical semantics and argumentation structures.
LLM-Assisted Stance Detection in Scientific Discourse: A Test Case in Bayesian Cognitive Science
This paper presents a method using LLMs for stance detection in scientific discourse, specifically identifying realism vs. instrumentalism in Bayesian cognitive science articles. The approach combines theory-driven coding, expert annotations, and prompt optimization to achieve high reliability.
Early-Token Confidence Predicts Reasoning Quality in Multi-Agent LLM Debate
This paper investigates whether early-token confidence signals from LLM decoding can predict reasoning quality in multi-agent debate systems, finding that confidence in the first few generated tokens is the strongest predictor of rubric-based essay scores.