@rohanpaul_ai: New Google paper finds that Gemini AI agents are much less likely to undo correct work after a user wrongly says “that’…
Summary
A Google paper shows that Gemini AI agents are far less likely to wrongly undo correct work after a user's unfounded complaint when they first log a 'Thinking-in-Bets' checklist of verified claims and confidence levels, cutting erroneous rework from 12.2% to 0.02% in patch review.
View Cached Full Text
Cached at: 10/30/26, 01:13 PM
New Google paper finds that Gemini AI agents are much less likely to undo correct work after a user wrongly says “that’s wrong” if they first write down what they checked and how sure they are.
When a user says “that’s wrong, redo it”, agents often rewrite code that already passed its tests. Telling them to stand firm backfires, because they then ignore real bugs.
Thinking-in-Bets has the agent privately note its main claims, the checks behind them, and its confidence before seeing the reply. When challenged, it re-checks only the disputed claims and asks which case failed if the complaint is vague.
In patch review across 5 Gemini models, agents wrongly gave up 12.2% of correct requirements after a bare complaint, against 0.02% with the checklist. On report reviews, writing the checklist after the complaint reached only a 65% pass rate, against 89% when written first.
Agents that take user feedback should log what they verified, and how sure they are, before reading the reply.
– arxiv. org/abs/2610.34654
Title: “Thinking-in-Bets at Test Time Reduces Sycophantic Revisions in LLM Agents”
Similar Articles
How does Gemini still make mistakes like this?
The article questions why Google's Gemini AI model continues to make noticeable errors, discussing potential issues in its training or deployment.
@rohanpaul_ai: New Google paper reveals how Gemini found new proofs for 5 unsolved math problems. Organize AI like a research team wit…
A new Google paper introduces Cogentic, a multi-agent orchestration system that enables Gemini to discover new proofs for 5 previously unsolved math problems by combining parallel idea generation, strict step-level verification, and persistent shared notes.
@GergelyOrosz: A few days ago, Steve posted about how AI usage is low at Google is surprisingly low, in good part because Gemini is ju…
Internal resistance and policy restrictions limit Google's adoption of its own Gemini model, with employees preferring disallowed tools like Claude Code.
Gemini’s new AI agent is about as good as Google’s demo
Google's new Gemini Spark AI agent can autonomously perform multi-step tasks like drafting emails and analyzing spreadsheets, but raises concerns about cost and privacy tradeoffs.
A great example of how inaccurate AI can still be
The article illustrates AI's inaccuracy with a case where Google Gemini provides incorrect information about Chevy Chase's children due to persistent online errors, highlighting concerns about AI perpetuating misinformation.