speech-processing

Tag

Cards List
#speech-processing

MOSAIC: Addressing Disproportionate Task-Modality Dependencies via Modality-Partitioned Gradient Routing

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper proposes MOSAIC, a modality-separated architecture with inter-modal cross-attention and modality-partitioned gradient routing, which improves average macro-F1 by 7.4 points across four tasks on the CEJC corpus while reducing backbone parameters by 72% versus fusion-based baselines.

0 favorites 0 likes
#speech-processing

ETC-Bench: A Multilingual Benchmark for Evaluation-Side Transcript Canonicalization

arXiv cs.CL ↗ · 2026-10-28 Cached

ETC-Bench is the first comprehensive multilingual benchmark for evaluation-side transcript canonicalization, covering 181 phenomenon types across 12 languages, along with a new SENA metric and a taxonomy-guided agent method (TACS) that outperforms baseline systems.

0 favorites 0 likes
#speech-processing

Acoustic and Lexical Signals for Native Language Identification of Language Learners

arXiv cs.CL ↗ · 2026-10-26

该论文对比了基于WavLM的音频分类器与基于GPT-4o零样本的转录文本分类器在母语识别任务上的表现,发现音频在低水平(A1)更优,而文本在A2至C1阶段配合完整转录时表现更好。

0 favorites 0 likes
#speech-processing

Noise-Robust Forced Alignment for Spontaneous Speech

arXiv cs.LG ↗ · 2026-10-19 Cached

该论文提出一种噪声鲁棒的强制对齐方法,用上采样WLM特征替代MFCC的GMM-HMM对齐器,并显式建模填充词和非词汇语音事件,在Buckeye和FluencyBank上将词边界误差降低19%和17%,大幅减少灾难性错配。

0 favorites 0 likes
#speech-processing

Task-Centric Multimodal Learning for Cognitive Impairment Detection

arXiv cs.LG ↗ · 2026-10-16 Cached

该论文提出了一种接触式多模态筛查框架,利用与 Amazon Alexa 交互过程中采集的视频、音频和文本信号来检测轻度认知障碍(MCI),实验表明多模态融合模型在 Command-Reading 和 Question-Answering 任务上均达到 0.76 的准确率,优于单一模态模型。

0 favorites 0 likes
#speech-processing

AegisVox: Factorized Privacy and Clinical Preservation for Long-Form Speech

arXiv cs.AI ↗ · 2026-10-15 Cached

AegisVox 提出一种因子化的临床语音隐私框架,为每位说话者分配一致的代理声音并编辑含标识符的语音轮次,在 63.6 小时模拟对话上比较了 TTS 与编解码语音编辑器在替换实现、说话者关联与临床信息保留之间的权衡。

0 favorites 0 likes
#speech-processing

CircuitTree: Composing Circuits into A Syllable Transcriber

arXiv cs.LG ↗ · 2026-10-12 Cached

The paper introduces CircuitTree, a tree-compose data structure and greedy density-scaled algorithm for composing many pruned circuits from HuBERT into a syllable transcriber, achieving 64.8% open-syllable accuracy with 99.5% shared circuitry versus a 66.0% non-sharing ceiling.

0 favorites 0 likes
#speech-processing

Clarify, Then Focus: Statement Normalization for Conversation Analytics at Scale

arXiv cs.CL ↗ · 2026-10-09 Cached

该论文提出「先澄清、再聚焦」的声明归一化方法,将对话转化为带来源引用和语义标签的简短陈述,使仅由小模型构成的推理管线能以约100倍更低的成本处理数百万条企业客服对话的分析任务。

0 favorites 0 likes
#speech-processing

@shinjiw_at_cmu: My Google Scholar h-index just reached 100! My first paper was in 1999, and behind these 100 are students and collabora…

X AI KOLs Following ↗ · 2026-10-03 Cached

Shinji Watanabe announces his Google Scholar h-index has reached 100, crediting decades of work on speech processing research and open-source tooling to his students and collaborators. The post highlights landmark works like ESPnet, Deep Clustering, and SUPERB that underpin modern speech recognition.

0 favorites 0 likes
#speech-processing

FD-VAD: Semantic Endpoint Detection for Streaming Full-Duplex Speech

arXiv cs.CL ↗ · 2026-09-30 Cached

FD-VAD proposes an ASR-free, streaming semantic endpointer that maps causal audio windows directly to Continue/Stop decisions for full-duplex voice agents, combining a frozen speech encoder with a parameter-efficiently adapted language model and achieving state-of-the-art EOT recall on TurnBench.

0 favorites 0 likes
#speech-processing

Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring

arXiv cs.CL ↗ · 2026-09-28 Cached

This paper proposes a training-free pipeline for pronunciation transcription that integrates lexical resources and acoustic models to achieve low error rates and high efficiency, outperforming baselines including commercial multimodal LLMs.

0 favorites 0 likes
#speech-processing

Rethinking Automated Voice Similarity by Shifting from EER to Embedding Geometry

Hugging Face Daily Papers ↗ · 2026-09-27 Cached

This paper challenges the assumption that EER is a reliable proxy for human voice similarity in speech generation, demonstrating that perceptual alignment depends more on training objectives than model performance. It proposes embedding geometry with effective dimensionality as a principled metric for evaluating voice similarity.

0 favorites 0 likes
#speech-processing

@shinjiw_at_cmu: Interspeech 2026 in Sydney starts this Sunday, Sept. 27! We present 2 tutorials and 19 papers Sunday tutorials: - On th…

X AI KOLs Following ↗ · 2026-09-25 Cached

The tweet announces the start of Interspeech 2026 in Sydney, highlighting the presentation of 2 tutorials and 19 papers on spoken language models and conversational speech recognition.

0 favorites 0 likes
#speech-processing

BanglaTurn: A Benchmark and Whisper-Based Model for End-of-Turn Detection in Bangla Speech

arXiv cs.CL ↗ · 2026-09-25 Cached

The paper introduces BanglaTurn, a benchmark corpus and Whisper-based model for end-of-turn detection in Bangla speech, achieving 84.33% accuracy compared to a 69.28% baseline.

0 favorites 0 likes
#speech-processing

Training Intelligent Voice Assistant Wakeup with Controllable Synthetic Conversations

arXiv cs.AI ↗ · 2026-09-24 Cached

This paper introduces an intelligent wake-up system for virtual assistants that uses contextual trigger detection and synthetic conversational data to improve natural interactions. The authors release code, a dataset, and trained models to promote reproducibility.

0 favorites 0 likes
#speech-processing

Before the Warning Comes Too Late: Incremental Phone-Scam Detection from Speech

arXiv cs.CL ↗ · 2026-09-18 Cached

This paper introduces StreamFraudNet, a weakly supervised incremental model for detecting phone scams from raw speech, achieving a ROC-AUC of 0.9953 and operating in real-time to provide early warnings during calls.

0 favorites 0 likes
#speech-processing

A Phonemically Comprehensive, ASCII-Only Romanization Scheme for Thai and Lao: Systematic Cross-Lingual Correspondence and Chinese-User-Friendly Design

arXiv cs.CL ↗ · 2026-09-18 Cached

This paper proposes a phonemically comprehensive, ASCII-only romanization scheme for Thai and Lao, designed for cross-lingual correspondence and machine processing to aid language learning and speech processing.

0 favorites 0 likes
#speech-processing

Continue, Adapt, or Yield: In-Turn Adaptation to Overlapping Speech in Full-Duplex Agents

arXiv cs.CL ↗ · 2026-09-14 Cached

The paper introduces Duplex Cue, an evaluation framework for assessing in-turn adaptation in full-duplex voice agents, comparing human and model responses to overlapping speech.

0 favorites 0 likes
#speech-processing

StepAudio 3 Realtime Technical Report

Hugging Face Daily Papers ↗ · 2026-09-12 Cached

The paper presents StepAudio3Realtime, an audio-language foundation model for real-time spoken interaction, using a continuous listen-converse-think-act loop with Think-While-Speaking to achieve deep reasoning and low latency, with top-tier performance on benchmarks like MMSU and Full-Duplex Bench.

0 favorites 0 likes
#speech-processing

SEAR: Segment-Evidence-Aware Routing for Weak-to-Strong Multilingual Speech MCQ

arXiv cs.CL ↗ · 2026-09-11 Cached

This paper presents the SEAR system for multilingual speech MCQ, achieving 90.92% accuracy on the MLC-SLM Challenge through segment-evidence-aware routing, supervised fine-tuning, and reinforcement learning.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback