FOCUS:一种用于基于脑电信号的认知负荷分类的轻量级 Mamba-2 模型
摘要
论文提出 FOCUS——一个基于 Mamba-2 的超轻量 EEG 认知负荷分类模型,采用固定 FFT 频带分解与权值共享编码,在仅 0.04M 参数下于 11 人试点实验中达到 74.75% 准确率与 0.08ms 前向延迟。
arXiv:2610.32361v1 Announce Type: new
Abstract: Cognitive workload estimation from physiological signals is increasingly relevant in high-risk environments, where continuous and unobtrusive monitoring can inform adaptive systems and safety interventions. This paper presents FOCUS (Frequency-band Optimized Cognitive-load Ultralight SSM), a compact Mamba-2-based model for EEG-based binary workload classification under constrained data conditions. Rather than learning frequency sensitivity from data, FOCUS encodes preprocessed multi-channel EEG using a fixed FFT decomposition that covers the five canonical EEG bands. The proposed model combines depthwise-separable convolution and a weight-shared encoder-bottleneck Mamba-2 pair, with 0.04 million parameters and 0.11 GFLOPs. Evaluated in a pilot study with 11 participants under leave-one-subject-out cross-validation across three cognitively distinct tasks, FOCUS achieves 74.75% accuracy on the full dataset at 0.08 ms GPU model-forward latency. In the weight-sharing ablation, the shared configuration achieves 4.55 percentage points higher accuracy on the full dataset than the non-shared variant while reducing the SSM parameter budget; however, this difference does not reach statistical significance under a two-sided Wilcoxon signed-rank test ($p=0.083$). Overall, the selected FOCUS configuration provides a favorable trade-off between classification performance and computational cost within this controlled pilot setting.
相似文章
BridgeRouter:跨模态桥接组合上的增益感知实例路由
BridgeRouter 将多桥跨模态迁移建模为实例级算法选择问题,通过增益感知的轻量路由器在冻结的 EEG 基础模型桥路径间进行推理时路由,在 FOG 和 ISRUC 数据集上显著优于单一最佳桥路径。
EEG基础模型的受控评估:随机初始化、频带功率与基于验证集选择的探针
对五个公开的 EEG 基础模型和一个内部开发的 JEPA 风格模型进行的受控评估表明,随机初始化、频带功率基线以及通过验证集选择的探测层,会显著改变在睡眠、情绪和运动想象基准测试中报告的预训练增益。
PreView:通过预处理视图与线索增强 GUI Grounding
PreView 引入了一个辅助预处理器,向 grounding 模型输入与任务相关的裁剪/放大视图以及关于候选目标的视觉和文本线索,在五个基准和三个冻结的 grounding 模型上均提升了 GUI grounding 的性能。
基于脑电图的音乐愉悦度预测:采用深度学习与可解释的时序分析
这篇论文将音乐愉悦度预测构建为回归问题,利用MUSIN-G数据集的128通道EEG数据,比较了六种深度学习模型(DeepConvNet、CNN-LSTM、GNN-CNN、TCN等),并通过可解释性分析识别影响预测的关键时间片段。
脑电信号与文本的语义对齐:用于解码想象言语的对比学习框架
该论文提出一个对比学习框架,将EEG信号与冻结的预训练文本编码器的嵌入空间对齐,用于解码想象言语,并在Chisco数据集上验证了其在固定意图解码、相似度检索和语义结构探针方面的能力。