Kardashev-0.7: Banbury trains 32 distinct models together with reinforcement learning

Reddit r/ArtificialInteligence Models

Summary

Banbury Road unveils Kardashev-0.7, a population of 32 distinct models trained jointly with reinforcement learning to pursue Population Scaling, treating model count and collaboration as a new scaling axis toward complementary specializations.

Banbury Road’s announcement describes Kardashev-0.7, a population of 32 distinct models trained together with RL for Population Scaling. The idea is to learn complementary specializations across models, making model count and collaboration another scaling axis. For evaluating this direction, an interesting question is how much joint training improves over an ensemble of independently trained models at the same total compute. https://x.com/MLCatttt/status/2107147690450817259
Original Article

Similar Articles

Training Reasoning Models to Generate Diverse Scientific Ideas

Hugging Face Daily Papers

Researchers propose a set-level reinforcement learning objective that trains language models to generate diverse, high-quality, document-grounded scientific ideas, with an 8B model outperforming Claude Opus 4.8 and GPT-6 Astra on creative utility.