GroupAffect-4: A Multimodal Dataset of Four-Person Collaborative Interaction

arXiv cs.AI Papers

Summary

This paper introduces GroupAffect-4, a multimodal dataset of 40 participants in 10 four-person groups performing collaborative tasks. It includes aligned physiology, eye-tracking, audio, self-report, and personality data, along with benchmark targets for within-person, between-person, and group-level analysis.

arXiv:2605.19765v1 Announce Type: new Abstract: Existing affective-computing, social-signal-processing, and meeting corpora capture important parts of human interaction, but they rarely support analysis of affect in co-located groups as a coupled individual, interpersonal, and group-level process. The required signals (per-participant physiology, eye movement, audio, self-report, task outcomes, and personality) are usually fragmented across separate dataset traditions. We introduce GroupAffect-4, a multimodal corpus of 40 participants in 10 four-person groups, each completing four ecologically varied collaborative tasks spanning information pooling, negotiation, idea generation, and a public-goods game. Each participant is instrumented with a wrist-worn physiology sensor, eye-tracking glasses, and a close-talk microphone; sessions include continuous affect self-reports, post-task questionnaires, task outcomes, and Big-Five personality scores, all time-aligned to a shared clock. The dataset covers over 91% of expected physiology windows and 98% of eye-tracking windows, with strong task validity confirmed by a clear affective manipulation check across the negotiation block. We define fifteen benchmarkable targets spanning three analysis levels -- within-person state, between-person traits, and group dynamics -- and report leave-one-group-out feasibility baselines establishing the dataset's evaluative scope. GroupAffect-4 is released with a BIDS-inspired structure, Croissant metadata, a datasheet, per-session quality reports, and open processing scripts. Code and processing scripts are available at https://github.com/meisamjam/GroupAffect-4; the dataset is publicly archived at https://zenodo.org/records/20037847.
Original Article

Similar Articles

Early methods for studying affective use and emotional well-being on ChatGPT

OpenAI Blog

OpenAI and MIT Media Lab researchers conducted two parallel studies analyzing how emotional engagement with ChatGPT affects user well-being, combining analysis of 40 million conversations with a randomized controlled trial of 1,000 participants to understand impacts on loneliness, social interaction, and problematic AI use.

Evaluating multimodal emotion recognition in proactive conversational agents: A user study

arXiv cs.AI

This paper presents a multimodal emotion recognition module for proactive conversational agents, using facial recognition and linguistic analysis. A user study with 20 participants reveals a 'poker face' effect where visual cues are unreliable, while linguistic analysis proves more accurate; the study also shows agents can elicit emotions through conversational adaptation.

DraDDP: A Multimodal Multi-Party Dialogue Discourse Parsing Dataset

arXiv cs.CL

This paper introduces DraDDP, the first publicly available English multimodal dataset for multi-party dialogue discourse parsing, built from American TV dramas with 495 segments, 6,374 utterances, and 9.1 hours of video. Benchmarks show multimodal information improves parsing of dialogue structures and relation types.