自闭症与非自闭症个体自发双人互动中感知对话成功度的多模态预测
摘要
该研究利用跨三个自发双人互动数据集的多模态特征(发音、面部、声学韵律和话轮转换),预测自闭症与非自闭症互动中的感知对话成功度,表明对话成功本质上是多维的,需要多模态分析框架来提升预测效果。
arXiv:2610.31682v1 Announce Type: new
Abstract: Conversation success is important for communication, social bonds, and well-being and is often reduced in autistic-neurotypical conversations. Previous studies have predicted perceived conversation success using acoustic and lexical features in pediatric autism-enriched samples, or using nonverbal behavior in non-autistic group interactions. Other work has characterized prosodic, facial, motor, and turn-taking synchrony in autistic interactions, but has primarily targeted diagnostic classification or group differences. The present study instead predicts participant perceived conversation success from complementary articulatory, facial, acoustic-prosodic, and turn-taking measures across three spontaneous dyadic-interaction datasets including autistic and non autistic individuals. By leveraging multimodal features, we demonstrate that conversational success is inherently multidimensional and requires a multi-faceted analytical framework. Combining these complementary modalities offers the potential to improve prediction of perceived conversation success by capturing information unavailable from any single modality.
相似文章
80亿参数模型(EVLF-FM)在多模态理解方面超越临床医生
《自然》上的一篇论文介绍了 EVLF-FM,这是一款拥有 80 亿参数、具备细粒度可解释性的临床多模态视觉语言基础模型,在放射学、皮肤病学及其他医疗任务中的表现优于临床医生,表明前沿水平的医疗智能无需数据中心级别的算力即可运行。
Astra 在机器人智能领域超越所有模型
据报告,Astra 在机器人智能基准测试中超越了所有其他模型,标志着具身 AI 能力的显著进步。
@_akhaliq:A-RSI:用于零数据多模态自我改进的自适应任务刷新,论文:https://huggingface.co/papers/2610.38568…
一篇论文介绍了 A-RSI(用于自我改进的自适应任务刷新),这是一种通过在训练过程中自适应地刷新任务,实现零数据多模态自我改进的方法,无需新增人工标注数据。
sensenova/SenseNova-Loop-9B-Preview · Hugging Face
SenseNova 发布了 SenseNova-Loop-9B-Preview,这是一款基于共享循环块和 mHC 残差流架构构建的循环多模态模型,面向长上下文和智能体工作流,支持动态设计、PPT 生成和数据分析等多种能力。
inclusionAI/ZwZ2 27B/9B/4B(Qwen 微调模型)
inclusionAI 发布了 ZwZ2 系列(27B/9B/4B),基于 Qwen3.6 微调的视觉语言模型,通过 EvidenceConnect 构建的多区域验证数据与 GRPO 训练,在六大领域 25 个基准上均超越基座模型,总体准确率从 55.52 提升至 60.51(+4.99)。