@no_stp_on_snek: counterintuitive result buried in here worth pulling out: adding a weak model to your voting panel makes it worse, not …
Summary
The article highlights a counterintuitive finding: adding a weak model to a voting panel can degrade performance by adding noise, whereas a single independent uncorrelated model (e.g., a 32B) can outperform multiple same-vendor models. It emphasizes the value of uncorrelated voters over mere quantity.
View Cached Full Text
Cached at: 07/07/26, 03:23 AM
counterintuitive result buried in here worth pulling out: adding a weak model to your voting panel makes it worse, not better. its dissent doesn’t break a wrong consensus, it just adds noise and more work downstream. one genuinely independent 32B broke a ceiling three same-vendor families couldn’t touch. you don’t want more voters, you want uncorrelated ones.
hugh madden (@dangerm00se): The main thing I had fable doing was routing moa and rlm experiments spanning local api and cerebras. Get your agent to summarise I think some of it was interesting. https://t.co/ZSEJFpfrW3 @DJLougen @no_stp_on_snek @Teknium
Similar Articles
more models more better. one expensive model is losing to three cheap ones, and there's a paper on it
A mixture-of-agents paper (arxiv 2406.04692) shows that a committee of cheap open models can outperform GPT-4o on AlpacaEval 2.0 by leveraging decorrelated errors, and the author shares similar real-world findings where multiple cheap models catch more bugs than a single expensive model.
the more i use multiple models, the more i think "AI consensus" is a trap — the disagreement is the only part worth paying attention to
A reflection arguing that in multi-model setups, the consensus output is less valuable than the disagreements, which reveal genuinely contested parts of a problem. The post questions whether consensus should be the goal and how to distinguish productive disagreement from noise.
@no_stp_on_snek: if you build multi-agent or mixture-of-agents systems, read @dangerm00se's writeup. the finding that stuck with me: eve…
A user highlights a finding from Hugh Madden's writeup on multi-agent systems: even a strong arbiter (GPT-5.5) can be biased by seeing weaker agents' outputs first, collapsing from ~98% solo accuracy to 7/9.
Your best model probably isn't your best tool caller
The article argues that tool-calling reliability often does not scale with model capability; smaller models can outperform larger ones in schema adherence and format discipline, suggesting that raw capability is not the sole factor in choosing a model for tool use.
@ChrisGPotts: We take for granted that larger models are better than smaller ones, but why is this so? Our new paper, led by Jing Hua…
This paper investigates why larger models outperform smaller ones, attributing it to data-induced competition for neural resources through formal analysis and experiments.