Tag
A tweet highlighting the top 5 moments in open source AI, naming Llama 3, Qwen 2.5, DeepSeek R1, GLM 4.5, and Kimi K3 as transformative releases.
The official Hugging Face team fully open-sourced and reproduced the entire training pipeline of DeepSeek-R1 (Open-R1 project), including data, training, and evaluation. It has received 26.4k stars on GitHub, providing a reproducible textbook for training reasoning models for the industry.
This paper investigates knowledge distillation from the DeepSeek-R1 reasoning model to a compact Qwen2.5-7B student model using a Chain-of-Thought corpus built from John O'Bryan Mathematics Competition problems. The fine-tuned student achieves a 4.76 percentage-point improvement on the competition dataset and generalizes to MATH-500, while also analyzing the impact of response length on reasoning quality.
Hugging Face's Open R1 project provides a fully open reproduction pipeline for DeepSeek-R1, including distilled datasets, training scripts, and evaluation tools, with the goal of enabling anyone to replicate and build on top of R1's reasoning capabilities.
N-GRPO introduces semantic neighbor mixing in the GRPO framework to enhance mathematical reasoning diversity while preserving semantic consistency, achieving improvements on math benchmarks and out-of-distribution tasks.
This research paper investigates position bias in reasoning models, finding that bias scales with the length of the reasoning trajectory rather than being eliminated by 'more thinking.' The study provides causal evidence and a diagnostic toolkit for auditing this length-driven bias in multiple-choice QA evaluations.
该文章探讨了模型蒸馏的难度和成本，以DeepSeek R1蒸馏到Llama 3 8b和Qwen 2.5 7b为例，询问为何蒸馏模型不常见。
At the AI Engineer World Congress, Daniel Han delivered an in-depth talk on the practical experiences of reinforcement learning, model fine-tuning, quantization, and agents. He reviewed the evolution of open-source models from Llama to DeepSeek R1 and analyzed the five key stages of modern model training.