基于EEG-fNIRS的跨被试连续情感回归中共享与个体结构建模

arXiv cs.AI 论文

摘要

本文研究基于同步EEG-fNIRS数据的零样本跨被试连续效价-唤醒度回归问题,将情感分解为刺激共享成分与个体成分,其中个体成分通过无标签的α频带跨通道同步性进行校准;该方法在性能上超越EEGNet和ASAC-Net等基线模型,并对多种替代架构与特征进行了系统的负面结果搜索。

arXiv:2610.02796v1 Announce Type: new Abstract: Continuous, second-by-second valence-arousal estimation from physiological signals is typically studied in a subject-dependent setting, where the model sees labeled data from the same person it is later evaluated on. We study the harder zero-shot cross-subject variant on a synchronized EEG-fNIRS dataset: predict raw-scale ([1, 255]) valence and arousal trajectories for subjects whose labels the model never observes, given only their unlabeled EEG/fNIRS recordings while watching the same video stimuli as a disjoint set of training subjects. We decompose the affect trajectory into a structure shared across subjects who watch the same stimuli and an individual structure estimated for each test subject from a label-free EEG marker (alpha-band cross-channel synchrony), which rescales the shared trajectory around the scale midpoint. We validate the per-subject calibration mechanism on four independent axes: leave-one-subject-out correlation between the marker and each subject's true optimal gain, a functional-form comparison against non-linear alternatives, a repeated leave-4-out component ablation isolating each part of the pipeline's contribution, and a ceiling analysis bounding the remaining headroom for per-subject scaling. On held-out subjects, the model reaches an overall MAE of 25.96 / 22.80 across two evaluation batches (valence 21.94 / 19.6, arousal 29.98 / 26.0), well below EEGNet and ASAC-Net baselines reported for the same subject-independent split (raw scale score 60.6 and 55.0 respectively). We further report a systematic negative-result search across model architectures, feature representations, and prediction targets that found no signal able to improve on the single alpha-synchrony marker.
查看原文
查看缓存全文

缓存时间: 2026/10/05 09:59

# Modeling Shared and Individual Structure for Cross-Subject Continuous Affect Regression from EEG-fNIRS
Source: [https://arxiv.org/abs/2610.02796](https://arxiv.org/abs/2610.02796)
[View PDF](https://arxiv.org/pdf/2610.02796)

> Abstract:Continuous, second\-by\-second valence\-arousal estimation from physiological signals is typically studied in a subject\-dependent setting, where the model sees labeled data from the same person it is later evaluated on\. We study the harder zero\-shot cross\-subject variant on a synchronized EEG\-fNIRS dataset: predict raw\-scale \(\[1, 255\]\) valence and arousal trajectories for subjects whose labels the model never observes, given only their unlabeled EEG/fNIRS recordings while watching the same video stimuli as a disjoint set of training subjects\. We decompose the affect trajectory into a structure shared across subjects who watch the same stimuli and an individual structure estimated for each test subject from a label\-free EEG marker \(alpha\-band cross\-channel synchrony\), which rescales the shared trajectory around the scale midpoint\. We validate the per\-subject calibration mechanism on four independent axes: leave\-one\-subject\-out correlation between the marker and each subject's true optimal gain, a functional\-form comparison against non\-linear alternatives, a repeated leave\-4\-out component ablation isolating each part of the pipeline's contribution, and a ceiling analysis bounding the remaining headroom for per\-subject scaling\. On held\-out subjects, the model reaches an overall MAE of 25\.96 / 22\.80 across two evaluation batches \(valence 21\.94 / 19\.6, arousal 29\.98 / 26\.0\), well below EEGNet and ASAC\-Net baselines reported for the same subject\-independent split \(raw scale score 60\.6 and 55\.0 respectively\)\. We further report a systematic negative\-result search across model architectures, feature representations, and prediction targets that found no signal able to improve on the single alpha\-synchrony marker\.

## Submission history

From: Xuan Wang \[[view email](https://arxiv.org/show-email/150f3d03/2610.02796)\] **\[v1\]**Fri, 2 Oct 2026 04:37:59 UTC \(333 KB\)

相似文章

EEG情绪识别中的评估协议与跨受试者泛化

arXiv cs.LG

本文以SEED和SEED-IV数据集上的DGCNN为例,研究了评估协议如何影响EEG情绪识别中报告的准确率。研究表明,受试者相关(subject-dependent)、跨受试者(subject-disjoint)和跨会话(cross-session)评估回答的是不同问题,而检查点选择(checkpoint selection)和测试集重用可能会虚增准确率。

REGARD:大型语言模型中的区域情感差异

arXiv cs.CL

本文介绍REGARD,一项使用Valence-Arousal-Dominance画像法测量LLM对后苏联实体情感框架差异的研究,揭示模型按情感强度和通用回答率聚类,而非按来源或规模聚类。

能力-残差解耦建模用于情感认知诊断

arXiv cs.AI

本文提出一种能力-残差解耦框架,用于情感认知诊断,通过建模认知残差以减轻情感污染,实验表明该方法提升了性能并改进了情感对齐。