specialization

TinyRouter is a tiny 10K-parameter LLM router that learns to route each question to the best specialist model from a pool of open-source LLMs, using evolutionary training. It achieves performance matching or exceeding individual models on MMLU and math benchmarks.

This article argues that specialization is inevitable for AI systems, drawing on evidence from optimization theory, evolutionary biology, competitive markets, and machine learning. It interprets a 2026 paper by Goldfeder, Wyder, LeCun, and Shwartz-Ziv to challenge the assumption that greater capability leads to greater generality.

This paper introduces 'Rosetta Neurons'—universal neurons across diverse neural networks—and shows they scale as a sublinear power law, becoming more selective and monosemantic with scale, enabling data filtering that nearly matches oracle performance.

The article argues that Cerebras chips are optimized for LLM inference and training, not general AI workloads, and cautions against overhyping their ability to challenge NVIDIA across all AI domains.

This article argues that specialized small models can outperform larger frontier models in specific enterprise domains at a fraction of the cost, using the DharmaOCR model as a case study. It highlights how training history alignment with deployment tasks can make parameter count less decisive.

Describes a specialized multi-agent system for code review with distinct roles and persistent state, open-sourced as agile-team-skill, which separates reviewer and decision-maker roles to improve code quality and process memory.

The article argues that serious AI companies are moving from wrapping general models to training their own specialized models using proprietary interaction data, as specialisation now routinely matches or beats frontier models for in-distribution agentic tasks, driving better unit economics.