Luth-2 releases two French small language models (0.8B and 2B) that achieve state-of-the-art results on French benchmarks for their size, with open-weights and data on Hugging Face.
Hey everyone, Today we release Luth-2-0.8B and Luth2-2-2B, two non-reasoning models that set a new state of the art for French across a wide variety of tasks for their size 🚀 A few notable scores on French benchmarks compared to models 〜3 times their size: - Luth-2-2B scores 69.67 vs Gemma-4-E2B-it at 65.17 on Multi-IF. - Luth-2-0.8B scores 72.92 vs granite-4.0-h-micro at 55.60 on MGSM-Rev2. - Luth-2-2B scores 81.52 vs Gemma-4-E2B-it at 81.24 on Math-500. Luth-2 builds on our previous work with several substantial improvements. We introduce a new 3B-token SFT mixture covering a broader range of domains, including mathematics, knowledge, code, tool calling, instruction following, multi-turn dialogue, and science. We also use reinforcement learning through expert specialisations and multi-domain on-policy distillation (MOPD) to further extend the models’ capabilities. Finally, we move to Qwen3.5 as the backbone, as we found it to be substantially more receptive to post-training. The resulting models outperform every model in their size class across the selected French benchmarks, while staying competitive with much bigger models. Both are light enough to run locally for on-device use. More broadly, these results suggest that current multilingual SLMs still leave substantial capability on the table outside English, even for high-resource languages like French. Luth-2-2B and Luth-2-0.8B are available now on Hugging Face: 🤗 Models: Luth-2-0.8B | Luth2-2-2B | Luth-2-0.8B-GGUF | Luth2-2-2B-GGUF | 📚 Data: Luth-2-Post-Training-SFT | Luth-2-Post-Training-RL 💻 Code: https://github.com/kurakurai/Luth-2 ✏️ Blog: https://huggingface.co/blog/MaxLSB/luth-2 🏆 FR Leaderboard: https://huggingface.co/spaces/kurakurai/llm_leaderboard_fr We’d love to hear your feedback, so don’t hesitate to give it a try! 🙂
OpenLLM-France releases Luciole-23B-Instruct-1.1, an open-source multilingual instruction-tuned language model under Apache 2.0, with smaller 8B and 1B variants also available.
LiquidAI releases LFM2.5-ColBERT-350M, a late-interaction multilingual retrieval model, along with a dense bi-encoder variant, both built on LFM2.5-350M-Base, supporting 11 languages and designed as drop-in replacements for RAG pipelines.
The author demonstrates that small vertical language models (6B-15B) can outperform top LLMs on niche benchmarks through cost-effective fine-tuning using open-source models and Codex orchestration, achieving results with a $300 dataset.
This paper benchmarks 17 compact language models (1B-8B parameters) as generators in Russian-language RAG systems under CPU-only inference, finding that Qwen-family models offer strong quality-latency tradeoffs for private, GPU-free deployment.