A preprint says smaller models with evolved skills can beat larger models without them. What should persist?
Summary
WikiSkill uses a persistent wiki to evolve and transfer skills, showing that smaller models with such skills can outperform larger models without them in benchmarks, raising questions about what knowledge should persist in AI agents.
Similar Articles
WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
WikiSkill introduces a framework that co-evolves agent skills with a persistent knowledge base to systematically accumulate experience and improve performance across models, demonstrating benefits over state-of-the-art skill-evolution methods.
WikiSkill let a 9B model beat a 27B rival, but one transferred skill cut Gemini from 50.5% to 18.1%
Google Research's WikiSkill preprint demonstrates that compiling execution history into skill files allows a 9B AI model to outperform a 27B model in benchmarks, highlighting the role of procedural memory and skill transfer in agent performance.
Google Introduces WikiSkill for Persistent Agent Learning (22 minute read)
WikiSkill is a framework that co-evolves agent skills with a persistent knowledge base, consistently outperforming state-of-the-art methods and enabling effective skill transfer across models.
@datologyai: Why do larger models hold onto rare skills that smaller ones can lose? Jing Huang (Stanford NLP) points to interference…
The article discusses a talk by Jing Huang from Stanford NLP at the Summer of Data event, explaining that larger AI models retain rare skills better due to task interference and greater capacity.
Update: First Manual Results from Testing Procedural Skill Transfer in Small Models
The article reports initial manual results from experiments testing procedural skill transfer in small AI models, providing insights into how skills can be transferred across models.