misleading-reporting

Tag

Cards List
#misleading-reporting

The prevalent problem of misleading benchmark reporting (re: Astra)

Reddit r/singularity · 2d ago

OpenAI's benchmark reporting for Astra on ARC-AGI-3 is misleading due to using different harnesses, and the performance gap is less dramatic under standard conditions.

0 favorites 0 likes
← Back to home

Submit Feedback