Tag
The Last Translation Benchmark introduces a live dataset of peer-reviewed, multimodal examples designed to evaluate and break leading machine translation models, with handcrafted verification rules for reliable assessment. It addresses the saturation of current benchmarks and the unreliability of automatic metrics.
The paper proposes the interlingua hypothesis, suggesting that large language models perform translation by encoding source text into a latent task-agnostic feature space and decoding from it, supported by empirical evidence on variance, causal influence, and monolingual fine-tuning.
This study evaluates multilingual sentence embeddings for distinguishing correct English–Greek translations from erroneous ones, finding that embeddings provide useful semantic signals but are better integrated into broader translation evaluation frameworks.
This paper introduces Entropy-Valley, a training-free length selector for masked diffusion machine translation that uses predictive entropy to improve adequacy, showing that length choice matters more than unmasking order.
The paper introduces TranslatePsy-AfriSLM, an open-source collection of machine translation resources for 19 Sub-Saharan African languages, demonstrating that fine-tuned small language models with filtered synthetic data outperform much larger models like TranslateGemma-27B and Qwen3.5-122B-A10B.
SuTRA is a morphology-aware tokenization algorithm that preserves akshara indivisibility for Indic languages, reducing morphological shattering and achieving improvements in machine translation metrics over standard BPE methods.
This paper proposes a compression scheme for byte-level tokenization using an autocomplete model to remove predictable bytes from input sequences, reducing sequence length while maintaining machine translation performance across diverse languages.
This paper presents a unified poly-dialectal neural machine translation system for 12 Bangla regional dialects, introducing the largest multi-dialect parallel corpus to date and achieving state-of-the-art BLEU scores with a fine-tuned BanglaT5 model using DoRA.
This paper measures the self-referential evaluation loop when a knowledge base is used as the gold standard for entity-level machine translation in low-resource historical domains, showing that gains from KB injection are confined to overlapping segments and do not reflect true translation quality.
This paper introduces OmnilingualGAIA2, a multilingual expansion of the GAIA2 agentic benchmark across ten languages, revealing a universal cross-lingual performance gap of 8.8–18.4 pass@3 points that is model-driven and persists with scale. The authors argue that multilingual agentic evaluation should become standard for globally deployed agents.
This paper proposes a hybrid pipeline combining fine-tuned LLaMA-based gender classification with tag-aware neural machine translation to mitigate gender bias in English-to-Romanian MT, introducing new datasets and improving gender accuracy by over 40 points on benchmarks.
This paper investigates whether automatic evaluation metrics for machine translation are reliable for Classical Chinese to English translation, using a diagnostic framework based on minimal pairs. It finds all metrics have blind spots, with MetricX24 performing best overall.
This paper introduces APEX-VW, a new document-level English-Spanish post-editing dataset built from NHS virtual-ward documents and professional post-editing in Trados Studio. The corpus is designed to support research on terminology normalisation, correction propagation, and human-in-the-loop translation support.
This paper presents an embedding initialization method for adding unseen low-resource languages to multilingual NMT models, evaluated on Limbum-English translation. The averaged multi-language embedding matches the best single proxy and drastically outperforms zero-shot and from-scratch baselines.
This paper analyses the capability of five large language models to localise times, numbers, and dates when translating between English and German, and tests strategies to improve accuracy—finding that embedding localisation principles into the prompt context yields statistically significant improvements.
This paper explores three LLM-based approaches for translating puns from English to French, combining contrastive learning and phonetic-semantic embeddings. Their multi-agent and guided chain-of-thought systems ranked first and second in the CLEF JOKER 2025 Task 2 competition under expert human evaluation.
A PhD proposal outlining a unified end-to-end framework for multilingual metaphor processing, integrating metaphor detection, translation evaluation, and joint modeling using linguistic theory and large language models.
The paper compares 27 cross-lingual alignment (CLA) score variants for predicting LLM performance on multilingual classification and translation tasks, and proposes a PMI-based translation metric. It finds that CLA with English predicts translation quality comparably to or better than source-target CLA, supporting the view that LLMs use English as an internal pivot language.
This paper proposes PAMT, a process-aligned reinforcement learning framework for multi-domain machine translation that combines domain-aware long chain-of-thought supervision with step-level process rewards to improve domain-sensitive translation decisions.
Introduces TQLite, a distillation framework that uses a multi-LRM jury to train small language models for real-time MQM-based translation quality evaluation, achieving performance far exceeding off-the-shelf SLMs while remaining cost-effective.