gpq

Tag

Cards List
#gpq

[PAPER] Major benchmarks are found to be polluted, with up to 12% of questions broken

Reddit r/singularity · 3d ago Cached

This paper audits major LLM benchmarks (GPQA, MMLU-Pro, MMMU-Pro) and finds 4.5–11.8% of items have wrong answer keys or are malformed, releasing corrected 'Clean' versions for drop-in use.

0 favorites 0 likes
← Back to home

Submit Feedback