Tag
A tweet suggests that small specialized classifiers can be deployed without hosting and trained directly on mobile devices, highlighting advancements in lightweight AI models.
A study or model with only 4 million parameters, fine-tuned on 10,000 examples, achieves performance surpassing opus and kimi in certain benchmarks.
Release of SmolDataEnvs, a collection of 5,000 verifiable RL environment tasks for training small models in code and data science, fully open source.
This paper tests Reinforcement Learning with Verifiable Rewards (RLVR) on small language models using retrieval-augmented generation, achieving a 3.8-fold gain without distillation and emphasizing the need for reward design tailored to small models.
The author discusses the need for AI models with better world knowledge, leveraging N-gram technology to fit more knowledge into smaller models, and questions why development focuses more on coding capabilities than broader world knowledge.
Kev is a family of small decision models built on Qwen3.5, offering open-source training code and pretrained weights for local deployment with support for various question types.
This article provides a complete guide on fine-tuning small models with your own data, covering data collection, cleaning, training, evaluation, and deployment, with emphasis on data rights and evaluation discipline.
The article questions whether smaller quantized models are becoming the preferred choice for local AI applications, emphasizing their balance of VRAM usage, performance, and capability like tool calling.
The article asks if there are better small AI models than Qwen3.5 4B for building a fast local assistant, focusing on improving capabilities like conversation, reasoning, multilingual support, and tool calling while maintaining speed.
A user inquires about the best open-weight large language models with fewer than 3 billion parameters that can run efficiently in browser environments or as extensions.
smolbenchmark is a new resource that benchmarks small AI models on consumer hardware devices, providing metrics like speed, efficiency, and thermals to help users choose the best model for their specific hardware.
This paper introduces Looped GPT-BERT, which uses depth-wise parameter sharing to train a small language model with fewer parameters, achieving comparable performance to baselines in the BabyLM 2026 Strict-small setting.
This paper investigates failures in a 2B model for dialogue games and introduces a diagnosis-guided post-training recipe using SFT, DPO, and LoRA to boost performance while maintaining general capabilities.
Introduces Scaffold CoT, a ~4M example CoT dataset with a structured framework designed to enhance reasoning in small language models by providing consistent, categorized examples for training.
The author proposes using small, fast AI sub-agents for context engineering to improve efficiency and reduce costs in AI systems, questioning why this approach isn't widely adopted and seeking community feedback.
A developer discusses challenges and seeks advice on enhancing reasoning and memory handling in a local AI companion, focusing on context selection and dealing with small models.
The article argues that enterprises should optimize AI intelligence spend by using appropriate-sized models and hybrid systems for different tasks, rather than defaulting to expensive frontier models for all applications.
The paper introduces SocialRL, a reinforcement learning approach to enhance social reasoning in small language models, enabling them to negotiate effectively and match or exceed the performance of larger models like GPT-5 in various interaction domains.
A new Meta paper reveals that small models can accurately predict scaling laws but require more extensive hyperparameter tuning. The study finds scaling laws emerge around 4M parameters and become clearer with proper tuning.
A user reflects on Microsoft's Phi small model family, noting the last major release was in December 2024 and speculating whether Phi 5 will ever be released.