Structure-Preserving Document-Level Data Augmentation via Discourse Parsing

arXiv cs.CL Papers

Summary

本文提出一种基于大语言模型和文档级话语结构解析的结构保持式数据增强框架,通过识别句子间修辞关系并替换关键短语,在保持话语结构的同时实现主题偏移,从而在文本摘要和问答任务上提升模型性能。

arXiv:2610.19497v1 Announce Type: new Abstract: Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse-level coherence and logical flow, which are essential for complex tasks dependent on inter-sentential relationships. In this paper, we propose a structure-preserving document-level data augmentation framework based on large language models (LLMs) and document-level discourse structure parsing. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined-data training across the evaluated tasks. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation.
Original Article
View Cached Full Text

Cached at: 10/15/26, 07:01 AM

# Structure-Preserving Document-Level Data Augmentation via Discourse Parsing
Source: [https://arxiv.org/html/2610.19497](https://arxiv.org/html/2610.19497)
###### Abstract

Data augmentation \(DA\) plays a vital role in improving model performance in low\-resource or limited\-supervision scenarios within Natural Language Processing \(NLP\)\. Existing DA methods, such as synonym replacement and back\-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse\-level coherence and logical flow, which are essential for complex tasks dependent on inter\-sentential relationships\. In this paper, we propose a structure\-preserving document\-level data augmentation framework based on large language models \(LLMs\) and document\-level discourse structure parsing\. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure\. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined\-data training across the evaluated tasks\. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation\.

Figure 1:Structure\-preserving document\-level data augmentation\.## 1Introduction

Data augmentation \(DA\) is a pivotal strategy in Natural Language Processing \(NLP\) for addressing data sparsity in low\-resource scenarios by synthetically expanding training sets to improve model robustness and generalization\([Shorten and Khoshgoftaar, 2019](https://arxiv.org/html/2610.19497#bib.bib12);[Shorten et al\., 2021](https://arxiv.org/html/2610.19497#bib.bib11);[Feng et al\., 2021a](https://arxiv.org/html/2610.19497#bib.bib4);[Chen et al\., 2023](https://arxiv.org/html/2610.19497#bib.bib5)\)\. While lexical\- and sentence\-level DA \(e\.g\., synonym replacement, back\-translation\) are effective for sentence\-level tasks, they may be less effective in document\-level contexts like text summarization and question answering \(QA\)\. Recent document\-level DA methods\([Huang et al\., 2023](https://arxiv.org/html/2610.19497#bib.bib14);[Wu et al\., 2024](https://arxiv.org/html/2610.19497#bib.bib13)\)frequently overlook higher\-level structures, such as inter\-sentential coherence and logical flow, leading to semantically inconsistent noise that undermines model training\.

To enhance document\-level coherence, some researchers incorporate discourse\-level information\. For instance,[Feng et al\. \(2021b\)](https://arxiv.org/html/2610.19497#bib.bib8)use dialogue\-aware strategies for meeting transcripts,[Li et al\. \(2025\)](https://arxiv.org/html/2610.19497#bib.bib10)apply content reordering, and[Jahangir et al\. \(2024\)](https://arxiv.org/html/2610.19497#bib.bib9)generate QA pairs guided by discourse relations\. However, these methods usually encode discourse information for a specific task or operation and do not provide a unified mechanism for representing cross\-sentence dependencies across tasks and domains\. More importantly, these methods implicitly prioritize content diversity while overlooking document structure and task\-level supervision\. We further argue that, in document\-level data augmentation, an important challenge is label invalidation caused by structural distortion\.

Preserving discourse structure during augmentation retains the sentence\-level units on which downstream labels are defined\. For summarization, labels can be transferred through sentence indices\. For extractive QA, the transformed answer can be located within the aligned sentence to reconstruct its new token span\. This avoids regenerating task labels with an LLM, which may introduce additional noise or bias\. Structural preservation therefore supports label reuse while allowing the document content to change\.

We propose a structure\-preserving DA framework based on document\-level discourse structure analysis\. Our method models rhetorical relations and key phrases between sentence pairs, replacing content while preserving sentence order, count, and discourse structure\. This ensures sentence\-level alignment between original and augmented documents, enabling consistent label transfer\. Experiments on summarization and QA tasks demonstrate the effectiveness of the proposed augmentation across multiple datasets and training settings\.

Our contributions are summarized as follows:

- •A document\-level discourse structure analysis framework that structurally models rhetorical relations and sentence\-level key semantics\.
- •A novel discourse\-level DA method that manipulates core content while preserving rhetorical structures to generate coherent, diverse instances\.
- •Extensive experiments across four languages, two tasks, multiple model architectures, and controlled discourse variants demonstrate the robustness of the proposed framework\.

## 2Related Work

Data augmentation \(DA\) expands training data through operations based on prior knowledge\([Wei and Zou, 2019](https://arxiv.org/html/2610.19497#bib.bib19)\)for supervised\([Wei and Zou, 2019](https://arxiv.org/html/2610.19497#bib.bib19)\)or semi\-supervised learning\([Xie et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib20)\)\. Current methods span token\([Niu and Bansal, 2018](https://arxiv.org/html/2610.19497#bib.bib22);[Kumar et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib21)\), sentence\([Sennrich et al\., 2016](https://arxiv.org/html/2610.19497#bib.bib31);[Chen et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib23)\), adversarial\([Cheng et al\., 2019](https://arxiv.org/html/2610.19497#bib.bib25);[Morris et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib24)\), and hidden\-space\([Malandrakis et al\., 2019](https://arxiv.org/html/2610.19497#bib.bib27);[Chen et al\., 2021](https://arxiv.org/html/2610.19497#bib.bib26)\)levels\. Recently, LLMs\([Ye et al\., 2022](https://arxiv.org/html/2610.19497#bib.bib18);[Chowdhury and Chadha, 2024](https://arxiv.org/html/2610.19497#bib.bib33);[Sahu et al\., 2025](https://arxiv.org/html/2610.19497#bib.bib32)\)have significantly advanced DA with their generative power\.

While effective at the sentence level, standard DA may disrupt coherence in document\-level tasks\([Huang et al\., 2023](https://arxiv.org/html/2610.19497#bib.bib14);[Wu et al\., 2024](https://arxiv.org/html/2610.19497#bib.bib13)\)because it does not explicitly preserve inter\-sentential dependencies\. Recent studies therefore incorporate discourse information into data augmentation\([Pasunuru et al\., 2021](https://arxiv.org/html/2610.19497#bib.bib15);[Jahangir et al\., 2024](https://arxiv.org/html/2610.19497#bib.bib9);[Li et al\., 2025](https://arxiv.org/html/2610.19497#bib.bib10)\)\. These approaches, however, are generally designed for particular tasks or use selected discourse cues without constructing a reusable document\-level representation\. In contrast, our document\-level discourse structure analysis framework jointly represents antecedent links, rhetorical relations, and sentence\-level key semantics, and uses this structure to constrain document generation and label transfer\.

Regarding discourse parsing, foundational frameworks like RST\([Mann and Thompson, 1988](https://arxiv.org/html/2610.19497#bib.bib1)\)and PDTB\([Miltsakaki et al\., 2004](https://arxiv.org/html/2610.19497#bib.bib2)\)provide structured representations via rhetorical trees or argument spans, with recent advances driven by neural parsers\([Morey et al\., 2017](https://arxiv.org/html/2610.19497#bib.bib3);[Shi et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib16);[Hu and Wan, 2023](https://arxiv.org/html/2610.19497#bib.bib17)\)\. Recent unified RST parsers support multiple languages and relation inventories\([Chistova, 2025](https://arxiv.org/html/2610.19497#bib.bib39)\)\. We adopt a simpler sentence\-level representation designed for aligned generation and compare it with UniRST in Section[6\.1](https://arxiv.org/html/2610.19497#S6.SS1)\.

Algorithm 1Structure\-Preserving Document\-Level Data Augmentation1:Document

𝐃=\{s1,…,sn\}\\mathbf\{D\}=\\\{s\_\{1\},\\ldots,s\_\{n\}\\\}
2:Augmented document

𝐃′=\{s1′,…,sn′\}\\mathbf\{D\}^\{\\prime\}=\\\{s^\{\\prime\}\_\{1\},\\ldots,s^\{\\prime\}\_\{n\}\\\}
3:

4:Stage 1: Discourse parsing and key phrase extraction

5:

OriList←\[\]\\mathrm\{OriList\}\\leftarrow\[\\,\]
6:for

j←2j\\leftarrow 2to

nndo

7:

si←FindValid​\(s1,…,sj−1\)s\_\{i\}\\leftarrow\\textsc\{FindValid\}\(s\_\{1\},\\ldots,s\_\{j\-1\}\)
8:

Ri,j←α⁡\(si,sj\)R\_\{i,j\}\\leftarrow\\alpha\(s\_\{i\},s\_\{j\}\)
9:

𝐊i←β⁡\(si\)\\mathbf\{K\}\_\{i\}\\leftarrow\\beta\(s\_\{i\}\)⊳\\triangleright𝐊i=\(ki1,…,kip\)\\mathbf\{K\}\_\{i\}=\(k\_\{i\}^\{1\},\\ldots,k\_\{i\}^\{p\}\)

10:

𝐊j←β⁡\(sj\)\\mathbf\{K\}\_\{j\}\\leftarrow\\beta\(s\_\{j\}\)⊳\\triangleright𝐊j=\(kj1,…,kjq\)\\mathbf\{K\}\_\{j\}=\(k\_\{j\}^\{1\},\\ldots,k\_\{j\}^\{q\}\)

11:

𝐀i,j←\(si,𝐊i,sj,𝐊j,Ri,j\)\\mathbf\{A\}\_\{i,j\}\\leftarrow\(s\_\{i\},\\mathbf\{K\}\_\{i\},s\_\{j\},\\mathbf\{K\}\_\{j\},R\_\{i,j\}\)
12:

OriList\.append​\(𝐀i,j\)\\mathrm\{OriList\}\.\\textsc\{append\}\(\\mathbf\{A\}\_\{i,j\}\)
13:endfor

14:

15:Stage 2: Key phrase replacement

16:

AugList←\[\]\\mathrm\{AugList\}\\leftarrow\[\\,\]
17:for all

𝐀i,j∈OriList\\mathbf\{A\}\_\{i,j\}\\in\\mathrm\{OriList\}do

18:

𝐊<i′←\(𝐊1′,…,𝐊i−1′\)\\mathbf\{K\}^\{\\prime\}\_\{<i\}\\leftarrow\(\\mathbf\{K\}^\{\\prime\}\_\{1\},\\ldots,\\mathbf\{K\}^\{\\prime\}\_\{i\-1\}\)
19:

𝐊i′←γ⁡\(𝐊i,𝐊<i′\)\\mathbf\{K\}^\{\\prime\}\_\{i\}\\leftarrow\\gamma\(\\mathbf\{K\}\_\{i\},\\mathbf\{K\}^\{\\prime\}\_\{<i\}\)⊳\\triangleright𝐊i′=\(ki′1,…,ki′p\)\\mathbf\{K\}^\{\\prime\}\_\{i\}=\(k\_\{i\}^\{\\prime 1\},\\ldots,k\_\{i\}^\{\\prime p\}\)

20:

𝐊<j′←\(𝐊1′,…,𝐊j−1′\)\\mathbf\{K\}^\{\\prime\}\_\{<j\}\\leftarrow\(\\mathbf\{K\}^\{\\prime\}\_\{1\},\\ldots,\\mathbf\{K\}^\{\\prime\}\_\{j\-1\}\)
21:

𝐊j′←γ⁡\(𝐊j,𝐊<j′\)\\mathbf\{K\}^\{\\prime\}\_\{j\}\\leftarrow\\gamma\(\\mathbf\{K\}\_\{j\},\\mathbf\{K\}^\{\\prime\}\_\{<j\}\)⊳\\triangleright𝐊j′=\(kj′1,…,kj′q\)\\mathbf\{K\}^\{\\prime\}\_\{j\}=\(k\_\{j\}^\{\\prime 1\},\\ldots,k\_\{j\}^\{\\prime q\}\)

22:

𝐀i,j′←\(si,𝐊i′,sj,𝐊j′,Ri,j\)\\mathbf\{A\}^\{\\prime\}\_\{i,j\}\\leftarrow\(s\_\{i\},\\mathbf\{K\}^\{\\prime\}\_\{i\},s\_\{j\},\\mathbf\{K\}^\{\\prime\}\_\{j\},R\_\{i,j\}\)
23:

AugList\.append​\(𝐀i,j′\)\\mathrm\{AugList\}\.\\textsc\{append\}\(\\mathbf\{A\}^\{\\prime\}\_\{i,j\}\)
24:endfor

25:

26:Stage 3: Document generation

27:

𝐃′←\[\]\\mathbf\{D\}^\{\\prime\}\\leftarrow\[\\,\]
28:for

i←1i\\leftarrow 1to

nndo

29:

si′←δ⁡\(𝐀i,∗′,𝐀∗,i′\)s^\{\\prime\}\_\{i\}\\leftarrow\\delta\(\\mathbf\{A\}^\{\\prime\}\_\{i,\*\},\\mathbf\{A\}^\{\\prime\}\_\{\*,i\}\)
30:

𝐃′\.append​\(si′\)\\mathbf\{D\}^\{\\prime\}\.\\textsc\{append\}\(s^\{\\prime\}\_\{i\}\)
31:endfor

32:return

𝐃′\\mathbf\{D\}^\{\\prime\}

## 3Methodology

As shown in Algorithm[1](https://arxiv.org/html/2610.19497#alg1)and Fig\.[1](https://arxiv.org/html/2610.19497#S0.F1), we propose a structure\-preserving data augmentation framework defined by three invariants: \(1\) unchanged document structure, \(2\) preserved rhetorical relations, and \(3\) identical sentence count and ordering\. These ensure that sentence\-level supervision remains aligned, i\.e\., theii\-th sentence in the augmented document𝐃′\\mathbf\{D\}^\{\\prime\}corresponds exactly to theii\-th sentence in the original𝐃\\mathbf\{D\}\.

### 3\.1Discourse Structure Analysis and Key Phrase Extraction

Given𝐃=s1,…,sn\\mathbf\{D\}=\{s\_\{1\},\\ldots,s\_\{n\}\}, we identify rhetorical structures and key semantics \(Algorithm[1](https://arxiv.org/html/2610.19497#alg1), Lines 1–9\), adopting a simplified alternative to standard RST tailored to sentence\-aligned generation\. Each sentencesjs\_\{j\}\(j≥2j\\geq 2\) is linked to a single antecedentsis\_\{i\}\(i<ji<j\) via a relationRi,jR\_\{i,j\}\. We define six relation categories: Causality & Condition, Contrast & Transition, Coordination & Sequence, Explanation & Clarification, Summary & Generalization, and Continuation & Expansion\. This design balances expressiveness and robustness, covering common inter\-sentential functions while reducing the sparsity associated with fine\-grained taxonomies\.111As a small\-scale sanity check, we manually annotated 100 sentence pairs sampled from Newsroom\. After mapping both systems to the same six\-relation inventory, our predictions matched the manual annotations in 78 cases, compared with 41 for DPLP\([Ji and Eisenstein, 2014](https://arxiv.org/html/2610.19497#bib.bib38)\)\. Given the limited sample size, we treat this result as supporting evidence rather than a complete discourse\-parsing benchmark\.

The functionFindValidfirst examines the immediately preceding sentencesj−1s\_\{j\-1\}\. If no valid relation is found, it scanss1,…,sj−2s\_\{1\},\\ldots,s\_\{j\-2\}\. When the scan also fails,sjs\_\{j\}is linked tosj−1s\_\{j\-1\}using Continuation & Expansion as the default relation\. This adjacent\-first heuristic does not change theO⁡\(n2\)O\(n^\{2\}\)worst\-case complexity, but it reduces the number of relation checks when a local antecedent is accepted\. Functionα⁡\(si,sj\)\\alpha\(s\_\{i\},s\_\{j\}\)predicts the rhetorical relationRi,jR\_\{i,j\}between two sentences\. Functionβ⁡\(si\)\\beta\(s\_\{i\}\)extracts salient semantic phrases𝐊​i\\mathbf\{K\}ithat capture the core content of a sentence, such as named entities, noun phrases, event triggers, and domain\-specific concepts\. The extracted information is represented as𝐀​i,j=\(si,𝐊i,sj,𝐊​j,R​i,j\)\\mathbf\{A\}\{i,j\}=\(s\_\{i\},\\mathbf\{K\}\_\{i\},s\_\{j\},\\mathbf\{K\}j,R\{i,j\}\)\.

### 3\.2Key Phrase Replacement

In Lines 10–18, we generate augmented key phrases𝐊i′,𝐊j′\\mathbf\{K\}^\{\\prime\}\_\{i\},\\mathbf\{K\}^\{\\prime\}\_\{j\}while preservingRi,jR\_\{i,j\}\. The functionγ\\gammareplaces eachk∈𝐊k\\in\\mathbf\{K\}with a semantically consistent but topically distinct alternative, referencing previously replaced phrases\(𝐊1′,⋯,𝐊i−1′\)\(\\mathbf\{K\}^\{\\prime\}\_\{1\},\\cdots,\\mathbf\{K\}^\{\\prime\}\_\{i\-1\}\)to maintain thematic consistency\. We enforce a globally consistent mapping such that identical source key phrases are consistently replaced with the same target phrase\. To further constrain semantic drift, a target topic is randomly sampled in advance, and all replacements are conditioned on this topic rather than generated freely\. This results in structure\-preserved augmented placeholders𝐀i,j′=\(si,𝐊i′,sj,𝐊j′,Ri,j\)\\mathbf\{A\}^\{\\prime\}\_\{i,j\}=\(s\_\{i\},\\mathbf\{K\}^\{\\prime\}\_\{i\},s\_\{j\},\\mathbf\{K\}^\{\\prime\}\_\{j\},R\_\{i,j\}\)\.

### 3\.3Document Generation

Finally,𝐃′\\mathbf\{D\}^\{\\prime\}is generated by assembling sentences\{s1′,…,sn′\}\\\{s^\{\\prime\}\_\{1\},\\ldots,s^\{\\prime\}\_\{n\}\\\}\(Lines 19–24\)\. For each sentence indexii, functionδ⁡\(Ai,∗′,A∗,i′\)\\delta\(A^\{\\prime\}\_\{i,\*\},A^\{\\prime\}\_\{\*,i\}\)synthesizes a new sentencesi′s^\{\\prime\}\_\{i\}that incorporates the modified key phrases while adhering to the original rhetorical relationsRi,jR\_\{i,j\}\. This stage maintains global structural consistency while introducing semantic diversity\.

### 3\.4Label Transfer

As the document layout is preserved, target\-side annotations can be derived via rule\-based mapping\. For text summarization, if a sentencesis\_\{i\}in the original document is selected as part of the summary, its augmented counterpartsi′s^\{\\prime\}\_\{i\}is assigned the same label, ensuring consistent supervision under sentence\-level alignment\.

For question answering, we perform token\-level label transfer via span reconstruction\. During key phrase replacement, the same transformationγ\\gammais applied to the context, question, and answer to maintain consistency\. Instead of reusing original token spans, we locate the corresponding transformed answer string in the augmented context to reconstruct the answer span\. As sentence order is preserved, the answer remains within the corresponding sentencesi′s\_\{i\}^\{\\prime\}aligned with the originalsis\_\{i\}, and key\-phrase\-level replacements ensure a consistent mapping between original and transformed answer tokens\.

Table 1:Performance of fine\-tuning and data augmentation methods on the Chinese Abstractive Corpus, Newsroom, and IndoSum\. B, R1, R2, and RL denote BLEU, ROUGE\-1, ROUGE\-2, and ROUGE\-L\.

## 4Experiment Settings

### 4\.1Datasets and Metrics

We evaluate the framework on text summarization and extractive QA\. For summarization, we use the Chinese Abstractive Corpus222[https://github\.com/wonderfulsuccess/chinese\_abstractive\_corpus](https://github.com/wonderfulsuccess/chinese_abstractive_corpus), Newsroom\([Grusky et al\., 2018](https://arxiv.org/html/2610.19497#bib.bib6)\), and IndoSum\([Kurniawan and Louvan, 2018](https://arxiv.org/html/2610.19497#bib.bib40)\)\. For QA, we use SQuAD 1\.1\([Rajpurkar et al\., 2016](https://arxiv.org/html/2610.19497#bib.bib7)\)and the Japanese dataset JaQuAD\([So et al\., 2022](https://arxiv.org/html/2610.19497#bib.bib41)\)\.

For summarization, we formulate supervision at the sentence level\. Reference summaries are aligned to source sentences by exact sentence matching during preprocessing, and the resulting sentence indices are used as supervision\. The same indices are then assigned to the aligned sentences in the augmented document\. To support sentence\-level label transfer on IndoSum, we retain documents whose reference summary forms a contiguous span in the source document\.

For each summarization dataset, we sample 2,000 instances for the input set, 2,000 for the control set, and 1,000 for testing\. For each QA dataset, we use 4,000 input instances, 4,000 control instances, and 1,000 test instances\. Within each dataset, input, control, and the test set are mutually exclusive, and the augmented set is generated only from the input set\.

Summarization performance is measured by BLEU\([Papineni et al\., 2002](https://arxiv.org/html/2610.19497#bib.bib30)\), ROUGE\-1, ROUGE\-2, and ROUGE\-L\([Lin, 2004](https://arxiv.org/html/2610.19497#bib.bib28)\)\. QA performance is evaluated using F1 score and Exact Match \(EM\)\([Rajpurkar et al\., 2016](https://arxiv.org/html/2610.19497#bib.bib7)\)\.

### 4\.2Training Configurations and Baselines

To systematically evaluate the proposed structure\-preserving DA approach, we fine\-tune a base LLM under six distinct training configurations: \(1\)Inp, which uses only the sampled input data; \(2\)Con, which uses only the control data; \(3\)Aug, which uses only the augmented data generated from Inp by the augmentation method being evaluated; \(4\)Inp\+Con, which combines the input and control data; \(5\)Inp\+Aug, which combines the input and augmented data; and \(6\)Inp\+Con\+Aug, which integrates the input, control, and augmented data\. For our method, each augmented document maintains one\-to\-one alignment with the original in sentence order and count, enabling direct transfer of sentence\-level supervision\.

We compare with several DA strategies\. For both tasks, we include Back\-Translation\([Sennrich et al\., 2016](https://arxiv.org/html/2610.19497#bib.bib31)\), which modifies only the source document or QA context while retaining the original supervision; in QA, the question and answer remain unchanged\. For summarization, we additionally include MixSumm\([Sahu et al\., 2025](https://arxiv.org/html/2610.19497#bib.bib32)\), while for QA we include Two\-Step QA Augmentation\([Chowdhury and Chadha, 2024](https://arxiv.org/html/2610.19497#bib.bib33)\)\.

To assess label reusability, we include LLM\-based Summary Relabeling and LLM\-based QA Relabeling, which replace transferred labels with labels regenerated by Qwen2\.5\-7B\-Instruct\([Qwen et al\., 2025](https://arxiv.org/html/2610.19497#bib.bib42)\)333[https://huggingface\.co/Qwen/Qwen2\.5\-7B\-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)\. Direct LLM Augmentation instead generates augmented instances and labels without our discourse constraints\. All LLM\-based augmentation baselines use Qwen2\.5\-7B\-Instruct\.

In Tables[1](https://arxiv.org/html/2610.19497#S3.T1)and[2](https://arxiv.org/html/2610.19497#S4.T2), Aug, Inp\+Aug, and Inp\+Con\+Aug denote the corresponding training configurations under each augmentation method\.

### 4\.3Implementation Details

For data augmentation, we use Qwen2\.5\-7B\-Instruct to perform discourse structure analysis, key\-phrase replacement, and document generation\. The augmentation process is decomposed into three independently prompted stages, each executed with a single prompt\.

For downstream tasks, Qwen2\.5\-3B\-Instruct444[https://huggingface\.co/Qwen/Qwen2\.5\-3B\-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct)is used for zero\-shot evaluation\. We fine\-tune Qwen2\.5\-3B\-Base555[https://huggingface\.co/Qwen/Qwen2\.5\-3B](https://huggingface.co/Qwen/Qwen2.5-3B)using LoRA\([Hu et al\., 2022](https://arxiv.org/html/2610.19497#bib.bib29)\)with rank 8\. The batch size is 1 per device with gradient accumulation of 32\. We train for 3 epochs with a learning rate of1×10−51\\times 10^\{\-5\}, using a cosine scheduler with 0\.1 warmup ratio\. All experiments are conducted in bfloat16 precision\.

Table 2:Performance of fine\-tuning and data augmentation methods on the English SQuAD and Japanese JaQuAD question answering tasks\.

## 5Results

### 5\.1Results on Text Summarization

#### Utility of augmented data\.

Table[1](https://arxiv.org/html/2610.19497#S3.T1)reports the results on three summarization datasets\. On the Chinese corpus, Inp\+Con\+Aug improves over Inp\+Con from 0\.269 to 0\.276 in BLEU and from 0\.376 to 0\.400 in ROUGE\-L\. Although MixSumm obtains the highest standalone BLEU score under the Aug configuration, its performance decreases when mixed with real data\. In contrast, the proposed augmentation remains effective in the combined\-data setting and achieves the best ROUGE\-1, ROUGE\-2, and ROUGE\-L scores\.

The complementary effect is stronger on Newsroom\. Adding Aug to Inp increases BLEU from 0\.634 to 0\.775, while adding Aug to Inp\+Con increases it from 0\.686 to 0\.780\. Inp\+Aug achieves the best ROUGE scores, and Inp\+Con\+Aug achieves the best BLEU score\. On IndoSum, Inp\+Con\+Aug obtains the best result on all four metrics, improving BLEU from 0\.757 to 0\.782 and ROUGE\-L from 0\.782 to 0\.799 over Inp\+Con\. These results show that the generated documents provide complementary training signals rather than merely duplicating the input set\.

#### Reliability of transferred labels\.

The comparison with LLM\-based Summary Relabeling separates the quality of augmented documents from the reliability of their supervision\. Under Inp\+Aug, the proposed method achieves BLEU scores of 0\.269, 0\.775, and 0\.779 on the Chinese corpus, Newsroom, and IndoSum, respectively\. Under the same Inp\+Aug configuration, LLM\-based Summary Relabeling obtains 0\.186, 0\.748, and 0\.572\. The gaps become particularly large on the Chinese corpus and IndoSum\.

These results indicate that regenerating summary labels introduces additional supervision noise\. Our framework instead transfers the original sentence indices to the aligned augmented sentences, avoiding additional label regeneration\. Back\-translation remains competitive on Newsroom, but its advantage is smaller in combined\-data settings\. Overall, the results suggest that both content diversity and label compatibility contribute to effective document\-level augmentation\.

Table 3:Comparison with UniRST and controlled discourse ablations under matched training configurations\.Table 4:Performance of BertSum and SimCLS on the text summarization task\. Inp, Con, and Aug denote the original input, control data, and our augmented data, respectively\. Aug\-MixSumm denotes the training configuration using MixSumm\-generated augmented data\([Sahu et al\., 2025](https://arxiv.org/html/2610.19497#bib.bib32)\)\.

### 5\.2Question Answering Results

#### Results on SQuAD\.

Table[2](https://arxiv.org/html/2610.19497#S4.T2)reports the results on SQuAD and JaQuAD\. On SQuAD, Aug alone reaches 0\.698 EM, close to the 0\.708 obtained by Inp, indicating that the augmented contexts retain substantial answer supervision\. Adding Aug to Inp\+Con improves EM from 0\.697 to 0\.731 and F1 from 0\.746 to 0\.779\. The resulting F1 is also close to the best fine\-tuned result of 0\.780 obtained by Inp\. Thus, the main improvement is not limited to token overlap but also appears in exact answer matching\.

The comparison with regenerated labels provides further evidence for the role of alignment\. Under Inp\+Aug, our method obtains 0\.701 EM and 0\.751 F1, whereas LLM\-based QA Relabeling obtains only 0\.370 and 0\.515\. Back\-Translation, Two\-Step QA Augmentation, and Direct LLM Augmentation are also weaker under the corresponding configurations\. These methods may alter the relationship among the context, question, and answer, while our method applies consistent transformations and reconstructs the answer span\.

#### Results on JaQuAD\.

JaQuAD shows a different balance between EM and F1\. Inp\+Aug obtains the highest EM score of 0\.688, whereas Inp\+Con\+Aug obtains the highest F1 score of 0\.811\. Compared with Inp\+Con, adding Aug increases F1 from 0\.729 to 0\.811, although EM decreases from 0\.681 to 0\.658\. This divergence suggests that augmented training improves answer\-token coverage but does not always produce the exact reference boundary or surface form\.

Nevertheless, under Inp\+Con\+Aug, our method obtains higher numerical EM and F1 scores than the corresponding augmentation baselines\. The results therefore support cross\-lingual applicability while also showing that exact matching remains sensitive to language\-specific answer realization\.

## 6Analysis

### 6\.1Analysis of Discourse Structure

#### Multilingual relation validation\.

To examine whether the six\-relation inventory transfers across languages, we manually annotate 100 sentence pairs from each of the Chinese, English, Indonesian, and Japanese datasets\. The predicted relations achieve accuracies of 81%, 78%, 71%, and 74%, respectively, supporting the cross\-lingual applicability of the coarse\-grained relation scheme\.

#### Comparison with UniRST\.

First, we replace the proposed discourse analysis with UniRST \(Chistova, 2025\)\. We use thetchewik/isanlp\_rst\_v3parser with thezho\.rst\.gcdtrelation inventory for Chinese andeng\.rst\.rstdtfor English\. To make its output compatible with our generator, we map the original fine\-grained relation labels into the six categories used by our framework\. The complete mapping is provided in Appendix A, while all other augmentation and training settings remain unchanged\.

Second, we evaluate two ablations\. Inw/o Relation, rhetorical relations are removed from the generation input\. InAdjacent\-only, each sentence can only select its immediately preceding sentence as the antecedent, thereby removing long\-distance antecedent search\. All other settings remain unchanged\.

#### Effect of rhetorical relations\.

Removing relation labels reduces performance on all three evaluated datasets\. Under Inp\+Con\+Aug, w/o Relation obtains 0\.240 BLEU and 0\.362 ROUGE\-L on the Chinese corpus, compared with 0\.276 and 0\.400 for the full method\. On Newsroom, its BLEU decreases from 0\.780 to 0\.618, while SQuAD EM decreases from 0\.731 to 0\.570\. These results indicate that sentence order alone is insufficient to preserve the intended logical connection during regeneration\.

#### Effect of antecedent selection\.

Adjacent\-only retains rhetorical labels but removes non\-adjacent antecedent links\. On SQuAD under Inp\+Con\+Aug, it obtains 0\.573 EM and 0\.591 F1, compared with 0\.570/0\.615 for w/o Relation and 0\.731/0\.779 for the full method\. It therefore slightly improves EM over w/o Relation but yields a lower F1 score\. The ordering is also inconsistent across summarization metrics, suggesting that restricting all antecedents to adjacent sentences does not provide a stable advantage\. Overall, rhetorical labels provide local guidance, while flexible antecedent selection captures dependencies beyond adjacent sentences\.

### 6\.2Generalization Across Architectures

Tables[4](https://arxiv.org/html/2610.19497#S5.T4)and[5](https://arxiv.org/html/2610.19497#S6.T5)examine whether the effect depends on LLM fine\-tuning using BertSum\([Liu and Lapata, 2019](https://arxiv.org/html/2610.19497#bib.bib34)\), SimCLS\([Liu and Liu, 2021](https://arxiv.org/html/2610.19497#bib.bib35)\), RoBERTa\([Liu et al\., 2019](https://arxiv.org/html/2610.19497#bib.bib36)\), and ELECTRA\([Clark et al\., 2020](https://arxiv.org/html/2610.19497#bib.bib37)\)\. On the Chinese corpus, adding Aug to Inp\+Con improves ROUGE\-L from 0\.492 to 0\.512 for BertSum and from 0\.493 to 0\.511 for SimCLS\. On Newsroom, the corresponding improvements are from 0\.851 to 0\.867 and from 0\.850 to 0\.874, respectively\. The gains also appear across BLEU and the other ROUGE metrics\.

The same pattern holds for discriminative QA models\. RoBERTa improves from 0\.633/0\.775 to 0\.653/0\.795 in EM/F1, while ELECTRA improves from 0\.624/0\.775 to 0\.659/0\.798\. Under the same architectures and combined\-data settings, MixSumm and Two\-Step QA Augmentation remain below the proposed method\.

These results indicate that the benefit is not specific to Qwen\. The augmented data also benefits extractive, contrastive, and discriminative architectures, demonstrating its generalization across downstream model families\.

### 6\.3Label Transfer Validity

To directly assess label\-transfer reliability, we manually inspect 100 randomly sampled augmented instances from the Chinese Abstractive Corpus for summarization and 100 from SQuAD for QA\. For summarization, a transfer is valid if the selected sentence still captures the main topic or an important aspect of the augmented document; 96 out of 100 instances satisfy this criterion\. For QA, a transfer is valid if the answer is supported by the augmented context and reasonably answers the transformed question; 89 out of 100 instances are judged valid\. These results provide direct evidence that the alignment\-based strategy preserves supervision for most augmented instances\.

To further assess the quality of the augmented documents, we manually evaluate 50 augmented samples for each of Chinese, English, Indonesian, and Japanese \(200 in total\) on fluency, coherence, and discourse\-structure preservation using a five\-point scale, and additionally assess whether the major rhetorical relations are preserved\. Averaged across the four languages, the scores are 4\.11 for fluency, 3\.93 for coherence, and 3\.86 for discourse\-structure preservation, with 81\.5% of the evaluated samples preserving the major relations\.

Table 5:Performance of RoBERTa and ELECTRA on SQuAD\. Inp, Con, and Aug denote the original input, control data, and our augmented data, respectively\. Aug\-Two\-Step denotes the training configuration using Two\-Step QA augmentation\([Chowdhury and Chadha, 2024](https://arxiv.org/html/2610.19497#bib.bib33)\)\.

## 7Conclusion

We propose a structure\-preserving document\-level data augmentation framework based on discourse structure parsing\. The framework changes document content while preserving sentence order, antecedent links, and rhetorical constraints, allowing downstream supervision to remain aligned\.

Experiments on three summarization datasets and two extractive QA datasets show that the augmented data provides useful and complementary training signals\. Comparisons with LLM\-based relabeling and Direct LLM Augmentation show that label validity materially affects downstream performance\. The UniRST comparison and controlled ablations further show that both rhetorical relations and flexible antecedent selection contribute to downstream performance\. Improvements with BertSum, SimCLS, RoBERTa, and ELECTRA indicate that the method is not limited to LLM fine\-tuning\.

Overall, the framework is intended to supplement rather than replace real training data by generating diverse documents whose supervision remains stable and reusable\.

## References

- Chenet al\.\(2023\)J\. Chen, D\. Tam, C\. Raffel, M\. Bansal, and D\. YangAn empirical survey of data augmentation for limited data learning in NLP\.Trans\. Assoc\. Comput\. Linguist\.11,pp\. 191–211\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1)\.
- Chenet al\.\(2021\)J\. Chen, D\. Shen, W\. Chen, and D\. YangHiddencut: simple data augmentation for natural language understanding with better generalizability\.InProceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing \(Volume 1: Long Papers\),pp\. 4380–4390\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Chenet al\.\(2020\)J\. Chen, Y\. Wu, and D\. YangSemi\-supervised models via data augmentation for classifying interactive affective responses\.InProceedings of the AAAI 2020 Workshop on Affective Content Analysis,pp\. 151–160\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Chenget al\.\(2019\)Y\. Cheng, L\. Jiang, and W\. MachereyRobust neural machine translation with doubly adversarial inputs\.InProc\. ACL,pp\. 4324–4333\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Chistova \(2025\)E\. ChistovaBridging discourse treebanks with a unified rhetorical structure parser\.InProceedings of the 6th Workshop on Computational Approaches to Discourse, Context and Document\-Level Inferences \(CODI 2025\),M\. Strube, C\. Braud, C\. Hardmeier, J\. J\. Li, S\. Loaiciga, A\. Zeldes, and C\. Li \(Eds\.\),Suzhou, China,pp\. 197–208\.External Links:[Link](https://aclanthology.org/2025.codi-1.17/),[Document](https://dx.doi.org/10.18653/v1/2025.codi-1.17),ISBN 979\-8\-89176\-343\-2Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Chowdhury and Chadha \(2024\)A\. Chowdhury and A\. ChadhaGenerative data augmentation using llms improves distributional robustness in question answering\.InProc\. EACL \(SRW\),pp\. 258–265\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1),[§4\.2](https://arxiv.org/html/2610.19497#S4.SS2.p2.1),[Table 2](https://arxiv.org/html/2610.19497#S4.T2.2.13.1.1.1),[Table 5](https://arxiv.org/html/2610.19497#S6.T5)\.
- Clarket al\.\(2020\)K\. Clark, T\. Luong, Q\. V\. Le, and C\. ManningELECTRA: pre\-training text encoders as discriminators rather than generators\.InICLR,External Links:[Link](https://openreview.net/pdf?id=r1xMH1BtvB)Cited by:[§6\.2](https://arxiv.org/html/2610.19497#S6.SS2.p1.1)\.
- Fenget al\.\(2021a\)S\. Y\. Feng, V\. Gangal, J\. Wei, S\. Chandar, S\. Vosoughi, T\. Mitamura, and E\. HovyA survey of data augmentation approaches for nlp\.InFindings of the association for computational linguistics: ACL\-IJCNLP 2021,pp\. 968–988\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1)\.
- Fenget al\.\(2021b\)X\. Feng, X\. Feng, B\. Qin, and X\. GengDialogue discourse\-aware graph model and data augmentation for meeting summarization\.InProceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI\-21,Z\. Zhou \(Ed\.\),pp\. 3808–3814\.Note:Main TrackExternal Links:[Document](https://dx.doi.org/10.24963/ijcai.2021/524),[Link](https://doi.org/10.24963/ijcai.2021/524)Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p2.1)\.
- Gruskyet al\.\(2018\)M\. Grusky, M\. Naaman, and Y\. ArtziNEWSROOM: a dataset of 1\.3 million summaries with diverse extractive strategies\.InProc\. NAACL\-HLT,pp\. 708–719\.Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p1.1)\.
- Huet al\.\(2022\)E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, and W\. ChenLoRA: Low\-Rank Adaptation of Large Language Models\.InInternational Conference on Learning Representations,External Links:[Link](https://mlanthology.org/iclr/2022/hu2022iclr-lora/)Cited by:[§4\.3](https://arxiv.org/html/2610.19497#S4.SS3.p2.1)\.
- Hu and Wan \(2023\)X\. Hu and X\. WanRST discourse parsing as text\-to\-text generation\.IEEE/ACM Trans\. Audio Speech Lang\. Process\.31,pp\. 3278–3289\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Huanget al\.\(2023\)X\. Huang, J\. Li, J\. Wu, J\. Chang, and D\. LiuTransfer learning with document\-level data augmentation for aspect\-level sentiment classification\.IEEE Trans\. Big Data9\(6\),pp\. 1643–1657\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1),[§2](https://arxiv.org/html/2610.19497#S2.p2.1)\.
- Jahangiret al\.\(2024\)K\. Jahangir, P\. Muller, and C\. BraudComplex question generation using discourse\-based data augmentation\.InProceedings of the 5th Workshop on Computational Approaches to Discourse \(CODI 2024\),pp\. 105–119\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p2.1),[§2](https://arxiv.org/html/2610.19497#S2.p2.1)\.
- Ji and Eisenstein \(2014\)Y\. Ji and J\. EisensteinRepresentation learning for text\-level discourse parsing\.InProceedings of the 52nd annual meeting of the association for computational linguistics \(volume 1: Long papers\),pp\. 13–24\.Cited by:[footnote 1](https://arxiv.org/html/2610.19497#footnote1)\.
- Kumaret al\.\(2020\)V\. Kumar, A\. Choudhary, and E\. ChoData augmentation using pre\-trained transformer models\.InProc\. LifeLongNLP,pp\. 18–26\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Kurniawan and Louvan \(2018\)K\. Kurniawan and S\. LouvanIndoSum: a new benchmark dataset for indonesian text summarization\.In2018 International Conference on Asian Language Processing,pp\. 215–220\.External Links:[Document](https://dx.doi.org/10.1109/IALP.2018.8629109)Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p1.1)\.
- Liet al\.\(2025\)W\. Li, D\. Jiang, H\. Zhang, K\. Xiao, and S\. CaoAn adaptive fusion\-based data augmentation method for abstract dialogue summarization\.PeerJ Comput\. Sci\.11,pp\. e2845\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p2.1),[§2](https://arxiv.org/html/2610.19497#S2.p2.1)\.
- Lin \(2004\)C\. LinROUGE: a package for automatic evaluation of summaries\.InText Summarization Branches Out,pp\. 74–81\.Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p4.1)\.
- Liu and Lapata \(2019\)Y\. Liu and M\. LapataText summarization with pretrained encoders\.InProceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing \(EMNLP\-IJCNLP\),pp\. 3730–3740\.Cited by:[§6\.2](https://arxiv.org/html/2610.19497#S6.SS2.p1.1)\.
- Liuet al\.\(2019\)Y\. Liu, M\. Ott, N\. Goyal, J\. Du, M\. Joshi, D\. Chen, O\. Levy, M\. Lewis, L\. Zettlemoyer, and V\. StoyanovRoBERTa: a robustly optimized bert pretraining approach\.arXiv preprint arXiv:1907\.11692\.Cited by:[§6\.2](https://arxiv.org/html/2610.19497#S6.SS2.p1.1)\.
- Liu and Liu \(2021\)Y\. Liu and P\. LiuSimCLS: a simple framework for contrastive learning of abstractive summarization\.InProceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing \(Volume 2: Short Papers\),pp\. 1065–1072\.Cited by:[§6\.2](https://arxiv.org/html/2610.19497#S6.SS2.p1.1)\.
- Malandrakiset al\.\(2019\)N\. Malandrakis, M\. Shen, A\. Goyal, S\. Gao, A\. Sethi, and A\. MetallinouControlled text generation for data augmentation in intelligent artificial agents\.InProc\. WNGT,pp\. 90–98\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Mann and Thompson \(1988\)W\. C\. Mann and S\. A\. ThompsonRhetorical structure theory: toward a functional theory of text organization\.Text8\(3\),pp\. 243–281\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Miltsakakiet al\.\(2004\)E\. Miltsakaki, A\. Joshi, R\. Prasad, and B\. WebberAnnotating discourse connectives and their arguments\.InProceedings of the workshop frontiers in corpus annotation at HLT\-NAACL 2004,pp\. 9–16\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Moreyet al\.\(2017\)M\. Morey, P\. Muller, and N\. AsherHow much progress have we made on rst discourse parsing? a replication study of recent results on the rst\-dt\.InProceedings of the 2017 Conference on Empirical Methods in Natural Language Processing,pp\. 1319–1324\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Morriset al\.\(2020\)J\. Morris, E\. Lifland, J\. Y\. Yoo, J\. Grigsby, D\. Jin, and Y\. QiTextAttack: a framework for adversarial attacks, data augmentation, and adversarial training in nlp\.InProc\. EMNLP,pp\. 119–126\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Niu and Bansal \(2018\)T\. Niu and M\. BansalAdversarial over\-sensitivity and over\-stability strategies for dialogue models\.InProc\. CoNLL,pp\. 486–496\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Papineniet al\.\(2002\)K\. Papineni, S\. Roukos, T\. Ward, and W\. ZhuBLEU: a method for automatic evaluation of machine translation\.InProc\. ACL,pp\. 311–318\.Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p4.1)\.
- Pasunuruet al\.\(2021\)R\. Pasunuru, A\. Celikyilmaz, M\. Galley, C\. Xiong, Y\. Zhang, M\. Bansal, and J\. GaoData augmentation for abstractive query\-focused multi\-document summarization\.InProc\. AAAI,pp\. 13666–13674\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p2.1)\.
- Qwenet al\.\(2025\)Qwen, A\. Yang, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Li, D\. Liu, F\. Huang, H\. Wei, H\. Lin, J\. Yang, J\. Tu, J\. Zhang, J\. Yang, J\. Yang, J\. Zhou, J\. Lin, K\. Dang, K\. Lu, K\. Bao, K\. Yang, L\. Yu, M\. Li, M\. Xue, P\. Zhang, Q\. Zhu, R\. Men, R\. Lin, T\. Li, T\. Tang, T\. Xia, X\. Ren, X\. Ren, Y\. Fan, Y\. Su, Y\. Zhang, Y\. Wan, Y\. Liu, Z\. Cui, Z\. Zhang, and Z\. QiuQwen2\.5 technical report\.External Links:2412\.15115,[Link](https://arxiv.org/abs/2412.15115)Cited by:[§4\.2](https://arxiv.org/html/2610.19497#S4.SS2.p3.1)\.
- Rajpurkaret al\.\(2016\)P\. Rajpurkar, J\. Zhang, K\. Lopyrev, and P\. LiangSquad: 100,000\+ questions for machine comprehension of text\.InProceedings of the 2016 conference on empirical methods in natural language processing,pp\. 2383–2392\.Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p1.1),[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p4.1)\.
- Sahuet al\.\(2025\)G\. Sahu, O\. Vechtomova, and I\. H\. LaradjiA guide to effectively leveraging llms for low\-resource text summarization: data augmentation and semi\-supervised approaches\.InProc\. NAACL,pp\. 1584–1603\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1),[Table 1](https://arxiv.org/html/2610.19497#S3.T1.2.12.1),[§4\.2](https://arxiv.org/html/2610.19497#S4.SS2.p2.1),[Table 4](https://arxiv.org/html/2610.19497#S5.T4)\.
- Sennrichet al\.\(2016\)R\. Sennrich, B\. Haddow, and A\. BirchImproving neural machine translation models with monolingual data\.InProc\. ACL,pp\. 86–96\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1),[Table 1](https://arxiv.org/html/2610.19497#S3.T1.2.8.1),[§4\.2](https://arxiv.org/html/2610.19497#S4.SS2.p2.1),[Table 2](https://arxiv.org/html/2610.19497#S4.T2.2.9.1.1.1)\.
- Shiet al\.\(2020\)K\. Shi, Z\. Liu, and N\. F\. ChenAn end\-to\-end document\-level neural discourse parser exploiting multi\-granularity representations\.arXiv preprint arXiv:2012\.11169\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p3.1)\.
- Shortenet al\.\(2021\)C\. Shorten, T\. M\. Khoshgoftaar, and B\. FurhtText data augmentation for deep learning\.J\. Big Data8\(1\),pp\. 101\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1)\.
- Shorten and Khoshgoftaar \(2019\)C\. Shorten and T\. M\. KhoshgoftaarA survey on image data augmentation for deep learning\.J\. Big Data6\(1\),pp\. 1–48\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1)\.
- Soet al\.\(2022\)B\. So, K\. Byun, K\. Kang, and S\. ChoJaQuAD: japanese question answering dataset for machine reading comprehension\.arXiv preprint arXiv:2202\.01764\.Cited by:[§4\.1](https://arxiv.org/html/2610.19497#S4.SS1.p1.1)\.
- Wei and Zou \(2019\)J\. Wei and K\. ZouEDA: easy data augmentation techniques for boosting performance on text classification tasks\.InProc\. EMNLP\-IJCNLP,pp\. 6382–6388\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Wuet al\.\(2024\)M\. Wu, Y\. Wang, G\. Foster, L\. Qu, and G\. HaffariImportance\-aware data augmentation for document\-level neural machine translation\.InProc\. EACL,pp\. 740–752\.Cited by:[§1](https://arxiv.org/html/2610.19497#S1.p1.1),[§2](https://arxiv.org/html/2610.19497#S2.p2.1)\.
- Xieet al\.\(2020\)Q\. Xie, Z\. Dai, E\. Hovy, T\. Luong, and Q\. LeUnsupervised data augmentation for consistency training\.Adv\. Neural Inf\. Process\. Syst\.33,pp\. 6256–6268\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.
- Yeet al\.\(2022\)J\. Ye, J\. Gao, Q\. Li, H\. Xu, J\. Feng, Z\. Wu, T\. Yu, and L\. KongZerogen: efficient zero\-shot learning via dataset generation\.InProceedings of the 2022 conference on empirical methods in natural language processing,pp\. 11653–11669\.Cited by:[§2](https://arxiv.org/html/2610.19497#S2.p1.1)\.

## Appendix AMapping UniRST Relations to the Proposed Relation Categories

UniRST does not define a single universal relation inventory\. Instead, its output labels depend on the discourse treebank used for training\. To make these outputs compatible with our document generator, we map the source relation labels predicted by UniRST to the six categories used in our framework\.

In Table[6](https://arxiv.org/html/2610.19497#A1.T6),coarse relation familiesdescribe the general semantic functions of the source relations, such as cause, condition, and elaboration\. They are included only to explain the mapping criterion\.Source relation labelsrefer to the concrete fine\-grained labels processed by our mapping procedure\. The mapping is designed specifically for our augmentation framework and is not intended as an official equivalence between the original discourse inventories\.

Table 6:Relation label mapping used in our framework, where fine\-grained discourse relation labels predicted by UniRST are grouped into six target categories\. The grouping is designed for document augmentation purposes and follows semantic correspondence between relations rather than modifying the original UniRST relation definitions\.The mapping follows the dominant semantic function of each source relation\. Causal, conditional, and purposive relations are grouped together; adversative relations form the contrast category; multinuclear joint and temporal relations form the coordination category; relations that provide background, evidence, attributes, or manner information form the explanation category; evaluative and restatement relations form the summary category\. Purely organizational relations are assigned to Continuation & Expansion because they do not express one of the five more specific semantic functions\.

Similar Articles

ARCS: Towards Precise Text-to-SQL via Structured Disambiguation

arXiv cs.CL

论文提出 ARCS(Ambiguity Resolution Corpus for SQL),首个包含真实数据库上自然歧义的 text-to-SQL 基准,并提出“结构化消歧”范式取代自由对话澄清。实验表明歧义下 text-to-SQL 仍具挑战:GPT-6 SOTA 仅 51% 端到端执行准确率,开源模型均不超过 27%。

Tracing Morphology, Semantics, and Divergence in Language Acquisition

arXiv cs.LG

该论文利用 Pythia 和 OLMo 等开源模型的中间检查点,系统研究了大语言模型在训练过程中形态结构、嵌入漂移、重复主导与共现效应的演化规律,发现模型在语义嵌入稳定之前就已习得形态结构,且训练数据规模有助于发散识别,而共现和重复则有负面影响。

From Copying to Composition: How Language Models Develop In-Context Learning

arXiv cs.CL

本文提出一种受控诊断任务,区分语言模型在上下文学习中的“复制示例”与“组合应用规则”两种行为,发现提示控制、答案偏好、无候选构造和迁移能力在训练中沿不同时间线发展,且合成定义文档训练能提升组合式响应。