@rohanpaul_ai: Stronger agents will not come only from larger models, but from better systems around them. The problem is that many AI…
Summary
This tweet discusses the paper 'From Model Scaling to System Scaling' which argues that stronger AI agents require better system design (harness) including context control, memory, and routing, not just larger models.
View Cached Full Text
Cached at: 07/09/26, 03:38 PM
Stronger agents will not come only from larger models, but from better systems around them.
The problem is that many AI agents are judged as if the model alone did the work, even though the real behavior also depends on memory, tools, context, routing, checks, and permissions.
This surrounding setup around the agent is called harness, meaning the system that decides what the model sees, what tools it can use, what it remembers, and what actions get checked.
Progress should come from scaling this harness, especially 3 parts: better context control, more trustworthy memory, and better routing to tools or helper agents.
Long context is not the same as usable context, memory is not the same as trustworthy memory, and having many tools is not the same as knowing when to use them.
A stale note can be more dangerous than no note, because it gives the agent confidence exactly when it should re-check the world.
A specialized subagent can also fail quietly if its output sounds plausible but no later layer verifies whether it is true.
This is why one-shot benchmark scores feel increasingly thin.
Two agents can reach the same final answer, while one burns far more tokens, makes riskier tool calls, carries corrupted memory, or succeeds only by accident.
The next frontier is not just scaling the mind inside the machine.
It is scaling the discipline around it.
– arxiv. org/abs/2605.26112
Title: “From Model Scaling to System Scaling: Scaling the Harness in Agentic AI”
Similar Articles
@dair_ai: System scaling is the next real bottleneck in agentic AI. If you build agent orchestration layers, this is a clean map …
This paper argues that agentic AI's next bottleneck is system scaling (designing the 'harness' around foundation models), not just model scaling, and introduces CheetahClaws, a Python-native reference harness, along with an analysis of three core bottlenecks: context governance, trustworthy memory, and dynamic skill routing.
Has anyone else found that context matters more than model size for AI agents?
The author shares their experience building AI agents, finding that providing clear context and guidance (defining job, rules, tools) matters more than model size for reducing mistakes and improving performance.
@rohanpaul_ai: Better self-improving agents need better solvers, not bigger update-writing models. This challenges the common habit of…
This paper disentangles the roles of evolver and agent in self-improving LLM agents, showing that a small evolver can write sufficiently good updates, while a mid-tier agent benefits most from using them. It recommends using the strongest model as the task executor, not the update writer.
@rohanpaul_ai: Great Stanford + MIT + Harvard + Anthropic paper. Gives a clear training-based reason for why larger models learn abili…
A Stanford, MIT, Harvard, and Anthropic paper explains that larger AI models learn rare skills better because they forget them less during training; their extra capacity protects weak learning signals from being overwritten by common tasks.
Position: Agentic AI System Is a Foreseeable Pathway to AGI
This paper argues that monolithic scaling of a single model is insufficient for achieving AGI and proposes Agentic AI with multi-agent collaboration as a necessary paradigm, demonstrating theoretically that agentic systems achieve exponentially superior generalization and sample efficiency.