Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

Hugging Face Daily Papers Papers
multimodal benchmark visual-reasoning mllm intuitive-reasoning evaluation ai-safety

Summary

This paper introduces Humanity's Sixth Sense (HSS), a benchmark for intuitive visual reasoning in multimodal large language models, showing humans reach 93.1% accuracy while the strongest model, GPT-6-astra, achieves only 53.6%, highlighting a significant capability gap in implicit visual understanding.

Humans perceive far more in a scene than what is explicitly depicted: a single glance captures past causes and future trajectories; a quick peek determines if a vehicle can fit between two parked cars; a few seconds of video reveals who holds authority in a room; and a fleeting clip highlights subtle abstract patterns like unwritten rules or hidden labels. This capacity reflects a form of humanity's sixth sense: an intuitive reasoning mechanism that recovers implicit information beyond raw sensory perception. Crucially, this rapid, zero-shot visual intuition underpins everyday navigation and social interaction, making it a vital capability for Multimodal Large Language Models (MLLMs) deployed alongside people. Existing visual benchmarks, however, target either deliberate expert-level analysis in academic and mathematical domains or low-level perception, leaving the intuitive reasoning that people perform largely untested. To bridge this gap, we introduce Humanity's Sixth Sense (HSS), a benchmark for intuitive visual reasoning. HSS spans diverse image and video inputs, organizes items under a structured taxonomy, and pairs each with human-written prompts probing the implicit temporal, spatial, social, and abstract structure that people infer at a glance. Frontier MLLMs fall short of human performance: participants reach 93.1% accuracy, while the strongest model, GPT-6-astra, reaches only 53.6% even at maximum reasoning effort. Despite excelling in many complex tasks that require advanced perception and knowledge, current models still struggle significantly on these visual tasks that are intuitive for humans. We further explore agentic setup that apply dynamic visual manipulation to HSS, which narrows but does not close the gap. HSS establishes intuitive visual reasoning as a measurable axis and directs attention to a capability that scaling on current benchmarks has so far left behind.
Original Article
View Cached Full Text

Cached at: 10/12/26, 10:41 PM

Paper page - Humanity’s Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

Source: https://huggingface.co/papers/2610.08966 Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Humansperceivefarmoreinascenethanwhatisexplicitlydepicted:asingleglancecapturespastcausesandfuturetrajectories;aquickpeekdeterminesifavehiclecanfitbetweentwoparkedcars;afewsecondsofvideorevealswhoholdsauthorityinaroom;andafleetingcliphighlightssubtleabstractpatternslikeunwrittenrulesorhiddenlabels.Thiscapacityreflectsaformofhumanity’ssixthsense:anintuitivereasoningmechanismthatrecoversimplicitinformationbeyondrawsensoryperception.Crucially,thisrapid,zero-shotvisualintuitionunderpinseverydaynavigationandsocialinteraction,makingitavitalcapabilityforMultimodalLargeLanguageModels(MLLMs)deployedalongsidepeople.Existingvisualbenchmarks,however,targeteitherdeliberateexpert-levelanalysisinacademicandmathematicaldomainsorlow-levelperception,leavingtheintuitivereasoningthatpeopleperformlargelyuntested.Tobridgethisgap,weintroduceHumanity’sSixthSense(HSS),abenchmarkforintuitivevisualreasoning.HSSspansdiverseimageandvideoinputs,organizesitemsunderastructuredtaxonomy,andpairseachwithhuman-writtenpromptsprobingtheimplicittemporal,spatial,social,andabstractstructurethatpeopleinferataglance.FrontierMLLMsfallshortofhumanperformance:participantsreach93.1%accuracy,whilethestrongestmodel,GPT-6-astra,reachesonly53.6%evenatmaximumreasoningeffort.Despiteexcellinginmanycomplextasksthatrequireadvancedperceptionandknowledge,currentmodelsstillstrugglesignificantlyonthesevisualtasksthatareintuitiveforhumans.WefurtherexploreagenticsetupthatapplydynamicvisualmanipulationtoHSS,whichnarrowsbutdoesnotclosethegap.HSSestablishesintuitivevisualreasoningasameasurableaxisanddirectsattentiontoacapabilitythatscalingoncurrentbenchmarkshassofarleftbehind.

View arXiv pageView PDFProject pageAdd to collection

Get this paper in your agent:

hf papers read 2610\.08966

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.08966 in a model README.md to link it from this page.

Datasets citing this paper1

#### ScaleAI/HSS Updated2 minutes ago • 2.07k • 11

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.08966 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Introducing Humanity’s Sixth Sense, a new benchmark testing intuitive visual reasoning from spatial and causal reasoning to social understanding. The gap is significant. Humans score 93.1%, while the strongest model, GPT-6-astra, reaches 53.6%. The median model scores just 30.9%.

Reddit r/singularity

Introducing Humanity's Sixth Sense, a new benchmark testing intuitive visual reasoning across spatial, causal, and social understanding. Humans achieve 93.1% while the strongest model, GPT-6-astra, reaches 53.6% and the median model only 30.9%.