DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection
Summary
DetectRL-X is a comprehensive multilingual benchmark for evaluating LLM-generated text detectors across 8 languages and 6 domains, including stress testing with AI-assisted writing operations and perturbations. It reveals strengths and limitations of current detectors in multilingual scenarios.
View Cached Full Text
Cached at: 05/18/26, 06:32 AM
# DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection Source: [https://arxiv.org/abs/2605.15518](https://arxiv.org/abs/2605.15518) Authors:[Junchao Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+J),[Yefeng Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+Y),[Chenyu Zhu](https://arxiv.org/search/cs?searchtype=author&query=Zhu,+C),[Hao Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+H),[Zeyu Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+Z),[Tianqi Shi](https://arxiv.org/search/cs?searchtype=author&query=Shi,+T),[Yichao Du](https://arxiv.org/search/cs?searchtype=author&query=Du,+Y),[Longyue Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+L),[Weihua Luo](https://arxiv.org/search/cs?searchtype=author&query=Luo,+W),[Jinsong Su](https://arxiv.org/search/cs?searchtype=author&query=Su,+J),[Derek F\. Wong](https://arxiv.org/search/cs?searchtype=author&query=Wong,+D+F) [View PDF](https://arxiv.org/pdf/2605.15518) > Abstract:The effective detection and governance of Large Language Model \(LLM\) generated content has become increasingly critical due to the growing risk of misuse\. Despite the impressive performance of existing detectors, their reliability and potential in multilingual, real\-world scenarios remain largely underexplored\. In this study, we introduce DetectRL\-X, a comprehensive multilingual benchmark designed to evaluate advanced detectors across 8 dimensions\. The benchmark encompasses 8 languages commonly used in commercial contexts and collects human\-written texts from 6 domains highly susceptible to LLM misuse\. To better aligned with real\-world applications, We create LLM\-generated texts using 4 popular commercial LLMs, and include typical AI\-assisted writing operations such as polishing, expanding, and condensing to capture authentic usage patterns\. Furthermore, we develop a multilingual framework for paraphrasing and perturbation attacks to simulate diverse human modifications and writing noise, enabling stress testing of detectors across languages\. Experimental results on DetectRL\-X reveal the strengths and limitations of current state\-of\-the\-art detectors when applied to diverse linguistic resources\. We further analyze how domains, generators, attack strategies, text length, and refinement operations influence performance in different languages, underscoring DetectRL\-X as an effective benchmark for strengthening multilingual and language\-specific detectors\. ## Submission history From: Junchao Wu \[[view email](https://arxiv.org/show-email/1dff1eb9/2605.15518)\] **\[v1\]**Fri, 15 May 2026 01:29:26 UTC \(10,065 KB\)
Similar Articles
A Systematic Analysis of Linguistic Features in AI-Generated Text Detection Across Domains and Models
A large-scale empirical study analyzes 284 linguistic features across 27 LLMs and 10 text domains to assess which features reliably detect AI-generated text. The study finds that lexical richness measures are the most robust cross-domain and cross-model signals, while many other proposed indicators are strongly context-dependent.
MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text
This paper introduces MELD, a detector for AI-generated text that uses multi-task learning with auxiliary heads for generator family, attack type, and source domain to improve robustness. MELD achieves strong performance on the RAID benchmark and maintains low false-positive rates under adversarial attacks.
Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection
This paper proposes a multi-level contextual token relation modeling framework for machine-generated text detection, integrating local Markov-informed calibration and global rule-support reasoning to improve detection across cross-LLM and cross-domain settings with low computational overhead.
Lightweight Stylistic Consistency Profiling: Robust Detection of LLM-Generated Textual Content for Multimedia Moderation
Proposes LiSCP, a lightweight stylistic consistency profiling method for robust detection of LLM-generated textual content, focusing on feature stability under adversarial manipulation. Achieves superior performance on in-domain and cross-domain detection with notable robustness.
Detecting LLM-Generated Texts with "Classical" Machine Learning
A developer explores using classical machine learning to detect LLM-generated web fiction, creating an open-source demo and model with ~85% single-sentence accuracy.