GPT-5.5 Scores 10.6% on ActiveVision, Humans Hit 96.1% [R]
Summary
A new arXiv paper introduces the ActiveVision benchmark designed to test repeated visual perception, finding that frontier vision models like GPT-5.5 and Claude Fable 5 score only 10.6% and 3.5% respectively, while humans achieve 96.1%.
Similar Articles
GPT-5.5 with tools now surpasses the 10-year-old level on the BabyVision benchmark
GPT-5.5, when equipped with tools, has surpassed the performance of a 10-year-old child on the BabyVision benchmark, marking a notable advancement in AI visual reasoning.
Claude Fable has caught up with GPT on ZeroBench (hard vision benchmark)
Claude Fable has matched GPT's performance on the challenging ZeroBench vision benchmark, with comparable pass@5 and pass^5 scores.
Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision
This paper evaluates GPT-6 Astra across 34 computer vision capabilities, revealing strong performance in semantic interpretation and reasoning, but persistent gaps in metric geometric accuracy and specialized fine-grained knowledge.
GPT 5.6 Sol is the best "vision" model OpenAI ever released
OpenAI's GPT-5.6 Sol is benchmarked as their best vision model yet, showing significant improvements in object detection and other visual tasks compared to previous models like GPT-5.5.
GPT-6 Astra makes a massive leap on ZeroBench (an extremely difficult vision benchmark), surpassing the human baseline across all three metrics
GPT-6 Astra achieves a massive leap on ZeroBench, an extremely difficult vision benchmark, surpassing the human baseline across all three metrics.