Human-Centric Intelligence in the Era of Foundation Models: A Survey
Summary
This survey proposes a unified taxonomy and framework for human-centric intelligence across visual, dynamic, and embodied levels in the foundation model era, aiming to bridge fragmented research and provide a coherent reference.
View Cached Full Text
Cached at: 08/24/26, 12:29 PM
Paper page - Human-Centric Intelligence in the Era of Foundation Models: A Survey
Source: https://huggingface.co/papers/2608.18184 Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
This survey proposes a unified taxonomy and methodological framework for human-centric intelligence across visual, dynamic, and embodied levels within the foundation-model era.
Human-centric intelligence is evolving in the foundation-model era, with growing emphasis on scale, transferability, and general-purpose modeling. Yet it has not fully integrated withfoundation modelsto achieve the comparable progress seen in them. More importantly, recent advances across this broad landscape remain fragmented across tasks, modalities, and research communities, leaving their intrinsic conceptual and methodological connections unclear. To bridge these divides and rethink human-centric intelligence in the foundation-model era, we introduce a full-spectrum human context taxonomy that integrates six interconnected levels by viewing humans as observable subjects through visual appearance and spatial geometry, as dynamic actors throughkinematic dynamicsandinteraction modeling, and as situated agents throughworld simulationandembodied agency. We next present the methodological foundations of the field, covering human-centric data families,computational architecture paradigms, and representative training andinference optimizationstrategies. We then systematically review representative methods across these levels and organize the associated datasets, benchmarks, and evaluation metrics. We further discuss open challenges and promising research directions toward human-centric intelligence that is scalable, trustworthy, physically grounded, and deployable, aiming to provide a coherent framework and practical reference for advancing the field. Finally, we provide a systematically organized and continuously updated collection of human-centric AI literature and resources on our project page.
View arXiv pageView PDFProject pageGitHub12Add to collection
Get this paper in your agent:
hf papers read 2608\.18184
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2608.18184 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2608.18184 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2608.18184 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
@rohanpaul_ai: Human-centric AI is getting better at isolated tasks, but this survey argues the next leap is connecting them into foun…
A survey argues that human-centric AI needs to connect isolated tasks into foundation models with shared human representations and better data for physical grounding.
Audio-Visual Intelligence in Large Foundation Models
This survey paper provides a comprehensive review of audio-visual intelligence within large foundation models, establishing a unified taxonomy, synthesizing core methodologies, and outlining key datasets, benchmarks, and open research challenges.
Collective Intelligence with Foundation Models
This paper presents a multi-agent reasoning framework where multiple foundation models collaborate through structured critique and aggregation, demonstrating that model heterogeneity significantly improves step-wise reasoning accuracy and reduces variance across domains.
Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models
This paper introduces Humanity's Sixth Sense (HSS), a benchmark for intuitive visual reasoning in multimodal large language models, showing humans reach 93.1% accuracy while the strongest model, GPT-6-astra, achieves only 53.6%, highlighting a significant capability gap in implicit visual understanding.
Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models (1 minute read)
A new paper introducing a benchmark for intuitive visual reasoning ("humanity's sixth sense") to evaluate the perceptual intuition capabilities of multimodal AI models.