language-fairness

Tag

Cards List
#language-fairness

The Invisible Language Tax: Token Premiums of French and Regional Languages in 2026 LLM Tokenizers, and a French-Optimized Prototype

arXiv cs.CL ↗ · 2026-10-01 Cached

该论文测量了2026年主流LLM分词器对法语及法国地方语言的token溢价(法语比英语多31%–58%,地方语言高达1.6–3.3倍),并提出法语优化的字节级BPE原型Baracoda FR v1.2,在法语上比Tekken少用11.5%的token。

0 favorites 0 likes
#language-fairness

On the Limitations of Cross-Lingual Consistency in Multilingual Text-to-image Generation

arXiv cs.CL ↗ · 2026-08-12 Cached

This paper introduces LingT2I, a 10-language, 33K-prompt benchmark for evaluating cross-lingual consistency in text-to-image generation, revealing linguistic inequality and language-dependent trade-offs across content generation and text rendering.

0 favorites 0 likes
← Back to home

Submit Feedback