@rohanpaul_ai: New Salesforce AI research finds, once you tune an agent’s prompts, tools, and workflow around a weaker model, copying …
Summary
Salesforce AI research shows that when tuning an agent around a weaker model, copying a stronger model can degrade performance; instead, targeted corrections to the weaker model's failures improve results without disrupting the existing setup.
View Cached Full Text
Cached at: 09/22/26, 10:00 PM
New Salesforce AI research finds, once you tune an agent’s prompts, tools, and workflow around a weaker model, copying a stronger model can make it worse; targeted fixes to its own failures work better.
The weaker model did not need to think like Gemini; it needed Gemini to correct the places where its own approach failed.
Salesforce tested this across 7 enterprise tasks with Qwen3-Coder-30B-A3B.
Tuning the agent setup around Qwen raised average success from 29.2% to 78.0%.
A stronger Gemini model reached 93.6% in that same setup, so teaching Qwen to copy Gemini looked like the obvious next move.
Instead, fine-tuning Qwen with complete Gemini runs dropped success to 63.1%, with performance falling on all 7 tasks.
Qwen learned useful knowledge, but it also copied Gemini’s way of planning, which no longer fit the setup built around Qwen’s original behavior.
The fix was to keep Qwen’s own failed runs and let Gemini correct only the step where Qwen went wrong.
That pushed success to 79.7% without losing the earlier gains.
the lesson: tune the model without breaking the agent setup already working around it.
Similar Articles
Did you see it when Salesforce's run their own AI Agents benchmark
Discussion of Salesforce's CRMArena-Pro benchmark showing agent success drops from 58% on single-turn to 35% on multi-turn tasks, plus practical advice for splitting agent workflows into narrow stages to reduce error compounding.
Salesforce Finds Better Ways to Co-Evolve Agents and Their Harnesses (9 minute read)
This research explores combining harness evolution with model adaptation for AI agents, discovering that direct imitation from experts harms weaker models' performance and proposing an on-policy correction method to improve performance without breaking harness fit for enterprise tasks.
@rohanpaul_ai: Stronger agents will not come only from larger models, but from better systems around them. The problem is that many AI…
This tweet discusses the paper 'From Model Scaling to System Scaling' which argues that stronger AI agents require better system design (harness) including context control, memory, and routing, not just larger models.
@rohanpaul_ai: New Salesforce paper finds that agents acting for different parties never verify each other's claims unprompted, so tea…
Salesforce 的新论文通过 2,500 多次跨方 agent 会话发现,代表不同利益方的智能体从不主动核实彼此的说法,导致团队继承最弱 agent 的错误,并归纳了 20 种失败模式。
@MSFTResearch: AI agents often fail because their instructions, or skills, are manually modified with no guarantee of improvement. Lea…
SkillOpt turns AI agent skill editing from manual modification into a training process, improving agent reliability without changing model weights, achieving consistent gains across benchmarks.