@rohanpaul_ai: New Google paper finds that Gemini AI agents are much less likely to undo correct work after a user wrongly says “that’…

X AI KOLs Timeline Papers

Summary

A Google paper shows that Gemini AI agents are far less likely to wrongly undo correct work after a user's unfounded complaint when they first log a 'Thinking-in-Bets' checklist of verified claims and confidence levels, cutting erroneous rework from 12.2% to 0.02% in patch review.

New Google paper finds that Gemini AI agents are much less likely to undo correct work after a user wrongly says “that’s wrong” if they first write down what they checked and how sure they are. When a user says "that's wrong, redo it", agents often rewrite code that already passed its tests. Telling them to stand firm backfires, because they then ignore real bugs. Thinking-in-Bets has the agent privately note its main claims, the checks behind them, and its confidence before seeing the reply. When challenged, it re-checks only the disputed claims and asks which case failed if the complaint is vague. In patch review across 5 Gemini models, agents wrongly gave up 12.2% of correct requirements after a bare complaint, against 0.02% with the checklist. On report reviews, writing the checklist after the complaint reached only a 65% pass rate, against 89% when written first. Agents that take user feedback should log what they verified, and how sure they are, before reading the reply. – arxiv. org/abs/2610.34654 Title: "Thinking-in-Bets at Test Time Reduces Sycophantic Revisions in LLM Agents"
Original Article
View Cached Full Text

Cached at: 10/30/26, 01:13 PM

New Google paper finds that Gemini AI agents are much less likely to undo correct work after a user wrongly says “that’s wrong” if they first write down what they checked and how sure they are.

When a user says “that’s wrong, redo it”, agents often rewrite code that already passed its tests. Telling them to stand firm backfires, because they then ignore real bugs.

Thinking-in-Bets has the agent privately note its main claims, the checks behind them, and its confidence before seeing the reply. When challenged, it re-checks only the disputed claims and asks which case failed if the complaint is vague.

In patch review across 5 Gemini models, agents wrongly gave up 12.2% of correct requirements after a bare complaint, against 0.02% with the checklist. On report reviews, writing the checklist after the complaint reached only a 65% pass rate, against 89% when written first.

Agents that take user feedback should log what they verified, and how sure they are, before reading the reply.

– arxiv. org/abs/2610.34654

Title: “Thinking-in-Bets at Test Time Reduces Sycophantic Revisions in LLM Agents”

Similar Articles

A great example of how inaccurate AI can still be

Reddit r/artificial

The article illustrates AI's inaccuracy with a case where Google Gemini provides incorrect information about Chevy Chase's children due to persistent online errors, highlighting concerns about AI perpetuating misinformation.