DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection
Summary
DetectRL-X is a comprehensive multilingual benchmark for evaluating LLM-generated text detectors across 8 languages and 6 domains, including stress testing with AI-assisted writing operations and perturbations. It reveals strengths and limitations of current detectors in multilingual scenarios.
View Cached Full Text
Cached at: 05/18/26, 06:32 AM
# DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection Source: [https://arxiv.org/abs/2605.15518](https://arxiv.org/abs/2605.15518) Authors:[Junchao Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+J),[Yefeng Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+Y),[Chenyu Zhu](https://arxiv.org/search/cs?searchtype=author&query=Zhu,+C),[Hao Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+H),[Zeyu Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+Z),[Tianqi Shi](https://arxiv.org/search/cs?searchtype=author&query=Shi,+T),[Yichao Du](https://arxiv.org/search/cs?searchtype=author&query=Du,+Y),[Longyue Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+L),[Weihua Luo](https://arxiv.org/search/cs?searchtype=author&query=Luo,+W),[Jinsong Su](https://arxiv.org/search/cs?searchtype=author&query=Su,+J),[Derek F\. Wong](https://arxiv.org/search/cs?searchtype=author&query=Wong,+D+F) [View PDF](https://arxiv.org/pdf/2605.15518) > Abstract:The effective detection and governance of Large Language Model \(LLM\) generated content has become increasingly critical due to the growing risk of misuse\. Despite the impressive performance of existing detectors, their reliability and potential in multilingual, real\-world scenarios remain largely underexplored\. In this study, we introduce DetectRL\-X, a comprehensive multilingual benchmark designed to evaluate advanced detectors across 8 dimensions\. The benchmark encompasses 8 languages commonly used in commercial contexts and collects human\-written texts from 6 domains highly susceptible to LLM misuse\. To better aligned with real\-world applications, We create LLM\-generated texts using 4 popular commercial LLMs, and include typical AI\-assisted writing operations such as polishing, expanding, and condensing to capture authentic usage patterns\. Furthermore, we develop a multilingual framework for paraphrasing and perturbation attacks to simulate diverse human modifications and writing noise, enabling stress testing of detectors across languages\. Experimental results on DetectRL\-X reveal the strengths and limitations of current state\-of\-the\-art detectors when applied to diverse linguistic resources\. We further analyze how domains, generators, attack strategies, text length, and refinement operations influence performance in different languages, underscoring DetectRL\-X as an effective benchmark for strengthening multilingual and language\-specific detectors\. ## Submission history From: Junchao Wu \[[view email](https://arxiv.org/show-email/1dff1eb9/2605.15518)\] **\[v1\]**Fri, 15 May 2026 01:29:26 UTC \(10,065 KB\)
Similar Articles
A Systematic Analysis of Linguistic Features in AI-Generated Text Detection Across Domains and Models
A large-scale empirical study analyzes 284 linguistic features across 27 LLMs and 10 text domains to assess which features reliably detect AI-generated text. The study finds that lexical richness measures are the most robust cross-domain and cross-model signals, while many other proposed indicators are strongly context-dependent.
MD-ProTector: Positioning Multiple Data-Driven Prototypes for LLM-Generated Text Detection
MD-ProTector is a research paper proposing a prototype-based method for LLM-generated text detection, using multiple trainable reference vectors per class to capture within-class variation and improve robustness across domains, generators, languages, and adversarial edits.
MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text
This paper introduces MELD, a detector for AI-generated text that uses multi-task learning with auxiliary heads for generator family, attack type, and source domain to improve robustness. MELD achieves strong performance on the RAID benchmark and maintains low false-positive rates under adversarial attacks.
Self-Generated Text Recognition: Quality Heuristics, Cross-Task Transfer, and Downstream Bias in LLM Evaluation
This paper examines Self-Generated Text Recognition (SGTR) in large language models, revealing that evaluation design choices affect accuracy and that training for SGTR can induce self-preference biases, highlighting key implications for AI safety.
MultiGhostBench: A Multilingual Benchmark for Long-Form LLM-Generated Text Attribution under Distribution Shifts
MultiGhostBench is a multilingual benchmark for long-form LLM-generated text attribution under distribution shifts, featuring 928 books in six languages and highlighting performance degrades and no single method consistently best across settings.