FOCUS:一种用于基于脑电信号的认知负荷分类的轻量级 Mamba-2 模型
摘要
论文提出 FOCUS——一个基于 Mamba-2 的超轻量 EEG 认知负荷分类模型,采用固定 FFT 频带分解与权值共享编码,在仅 0.04M 参数下于 11 人试点实验中达到 74.75% 准确率与 0.08ms 前向延迟。
arXiv:2610.32361v1 Announce Type: new
Abstract: Cognitive workload estimation from physiological signals is increasingly relevant in high-risk environments, where continuous and unobtrusive monitoring can inform adaptive systems and safety interventions. This paper presents FOCUS (Frequency-band Optimized Cognitive-load Ultralight SSM), a compact Mamba-2-based model for EEG-based binary workload classification under constrained data conditions. Rather than learning frequency sensitivity from data, FOCUS encodes preprocessed multi-channel EEG using a fixed FFT decomposition that covers the five canonical EEG bands. The proposed model combines depthwise-separable convolution and a weight-shared encoder-bottleneck Mamba-2 pair, with 0.04 million parameters and 0.11 GFLOPs. Evaluated in a pilot study with 11 participants under leave-one-subject-out cross-validation across three cognitively distinct tasks, FOCUS achieves 74.75% accuracy on the full dataset at 0.08 ms GPU model-forward latency. In the weight-sharing ablation, the shared configuration achieves 4.55 percentage points higher accuracy on the full dataset than the non-shared variant while reducing the SSM parameter budget; however, this difference does not reach statistical significance under a two-sided Wilcoxon signed-rank test ($p=0.083$). Overall, the selected FOCUS configuration provides a favorable trade-off between classification performance and computational cost within this controlled pilot setting.
相似文章
EEG基础模型的受控评估:随机初始化、频带功率与基于验证集选择的探针
对五个公开的 EEG 基础模型和一个内部开发的 JEPA 风格模型进行的受控评估表明,随机初始化、频带功率基线以及通过验证集选择的探测层,会显著改变在睡眠、情绪和运动想象基准测试中报告的预训练增益。
基于脑电图的音乐愉悦度预测:采用深度学习与可解释的时序分析
这篇论文将音乐愉悦度预测构建为回归问题,利用MUSIN-G数据集的128通道EEG数据,比较了六种深度学习模型(DeepConvNet、CNN-LSTM、GNN-CNN、TCN等),并通过可解释性分析识别影响预测的关键时间片段。
脑电信号与文本的语义对齐:用于解码想象言语的对比学习框架
该论文提出一个对比学习框架,将EEG信号与冻结的预训练文本编码器的嵌入空间对齐,用于解码想象言语,并在Chisco数据集上验证了其在固定意图解码、相似度检索和语义结构探针方面的能力。
nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B 模型家族发布(base、NVFP4、BF16 以及 LiLiCorr 投机解码)
NVIDIA 发布了 Nemotron 3.5 Super VL 120B-A12B 模型家族——一个总参数 120B、激活参数 12B 的视觉语言模型,采用 Mamba-2/MoE 混合架构,配备 C-RADIO 视觉编码器,支持 100 万 token 上下文,并通过 MTP 实现原生投机解码——提供 BF16、NVFP4 等多种变体,采用 OpenMDW-1.1 许可证。
MontageFlow:符合物理规律的高保真脑电信号生成
MontageFlow 是一个流匹配模型,通过将输出限制在满足 EEG 导联(montage)线性约束的子空间内,生成物理上有效的高保真临床 EEG 信号,在三个大规模基准上将 TS-FID 提升了 1.6–3.6 倍。