gpgqa-diamond

Tag

Cards List
#gpgqa-diamond

When Self-Consistency Backfires: Majority Vote Hurts the Majority of Hard Science Problems for Small LLMs

arXiv cs.AI ↗ · 2026-08-13 Cached

This paper shows that majority-vote self-consistency backfires on a majority of hard science problems in GPQA Diamond for small instruction-tuned LLMs, and that verifier-free gates like plurality agreement or token entropy cannot prevent this. Pre-registered confirmatory experiments quantify the accuracy drop and suggest confidence does not track correctness.

0 favorites 0 likes
← Back to home

Submit Feedback