speech-models

Tag

Cards List
#speech-models

TontaubeV1-Verbalizer: A super fast open-source Verbalization model for small speech models

Reddit r/LocalLLaMA ↗ · yesterday

TontaubeAI released TontaubeV1-Verbalizer, an Apache 2.0 open-source LLM-based verbalization model fine-tuned from a Qwen3 1.7B backbone that converts written English text into spoken-form text for small TTS models, processing a 20,000-character document in under 2 seconds on an RTX 3090.

0 favorites 0 likes
#speech-models

Pete warden on local AI, open models, voice interfaces, the future of hardware

Hacker News Top ↗ · yesterday Cached

Podcast episode featuring Pete Warden, co-creator of Moonshine Voice, discussing why AI is shifting to on-device execution, progress in open-weight and quantized models, low-latency voice interfaces, and hardware alternatives to GPU-centric infrastructure.

0 favorites 0 likes
#speech-models

@omarsar0: The next breakthrough in voice AI might not be another model taking the #1 spot. It might be a better understanding of …

X AI KOLs Timeline ↗ · 2026-10-30 Cached

The next breakthrough in voice AI may come from rethinking how we evaluate models rather than crowning a new top performer, with Voice Arena's Turing TTS benchmark measuring how often human listeners mistake AI voices for real ones.

0 favorites 0 likes
#speech-models

@rohanpaul_ai: A cascaded voice agent just won a blind human-preference ranking against native speech-to-speech models. Today, Cartesi…

X AI KOLs Following ↗ · 2026-10-30 Cached

Cartesia launched Managed Agents, an end-to-end enterprise voice agent platform that topped Artificial Analysis' Speech Agent Arena and ServiceNow's EVA-Bench in blind human preference rankings by co-designing its cascaded voice models and agent harness as one system.

0 favorites 0 likes
#speech-models

@svpino: Really cool voice dataset from @voicearena_ai for training conversational models! This is for anyone who's researching …

X AI KOLs Following ↗ · 2026-10-29 Cached

SVPino highlights Voice Arena AI's Joy, a 100,000-hour dual-channel conversational voice dataset with separate per-speaker tracks, overlapping speech, interruptions, pauses, and backchannels, designed to teach voice models conversational timing.

0 favorites 0 likes
#speech-models

Why Full-Duplex Speech Models Collapse in Long Conversations

arXiv cs.CL ↗ · 2026-10-26

提出 Full-Duplex Long-Horizon Benchmark(FD-LHB),发现现有全双工语音模型在长时间对话中会因上下文耗尽或重复、静音、乱码而崩溃,并通过 Initialization-Anchor Pinning 和 Duplex Repetition Penalty 两种免重训练修复方法显著缓解对话退化。

0 favorites 0 likes
#speech-models

You Are the Trigger: Speaker-Activated Backdoors

arXiv cs.LG ↗ · 2026-10-21 Cached

这篇论文提出「说话人激活后门」(SAB)设置,攻击者在微调阶段仅用目标说话人约两分钟的自然语音即可植入后门,使该说话人的声音本身成为触发器,在Whisper-medium和Parakeet上分别达到90.2%和97.0%的后门成功率,且触发在转写层不可见,还能向GPT-4o和Claude等下游LLM代理注入恶意指令。

0 favorites 0 likes
#speech-models

@AdinaYakup: Ant Group just dropped its new speech and audio models! https://huggingface.co/collections/inclusionAI/ming-30…

X AI KOLs Timeline ↗ · 2026-10-19 Cached

蚂蚁集团(inclusionAI/Ant Ling)发布 Ming-3.0 系列语音与音频模型,涵盖 TTS、ASR 及音频模型,已在 Hugging Face 和 ModelScope 上线,参数规模从 0.5B 到 128B 不等。

1 favorites 1 likes
#speech-models

PEDBench: Can Speech Models Detect Phonetic Errors?

arXiv cs.CL ↗ · 2026-10-16 Cached

PEDBench is the first phonetic error detection benchmark spanning natural, acted, and synthetic speech, evaluating 13 speech models and finding they fail to reliably detect phonetic errors. Fine-tuned speech-language models on synthetic data outperform baselines on word-level detection, though a sim-to-real gap remains.

0 favorites 0 likes
#speech-models

People Making Conversation: Evaluating How Naturally Speech Models Converse

arXiv cs.CL ↗ · 2026-10-12 Cached

该论文提出 PeopleMakingConversation 基准,通过 176 段非脚本对话中的 427 个停顿点和 482 个话轮结束点,评估六个实时语音系统在何时开口、延迟、回复长度与对话记忆等方面的自然对话表现,并公开数据与评测框架。

0 favorites 0 likes
#speech-models

Phonological Interference in Multilingual Speech Models

arXiv cs.CL ↗ · 2026-10-09 Cached

The paper identifies 'phonological interference' as a systematic failure mode in multilingual phoneme-level speech models, where models impose the phonology of a single assumed language and override phoneme decisions on code-switched or unseen-language input. It proposes windowed language estimation (WLE), an inference-time fix that reduces 34%–69% of interference without harming monolingual performance.

0 favorites 0 likes
#speech-models

Towards Model as a Library: Offline, Community-Sourced AI for Low-Resource African Languages

arXiv cs.AI ↗ · 2026-10-01 Cached

A position paper introducing 'Model as a Library' (MaaL), a software architecture that packages small, community-enrolled speech models as versioned on-device dependencies for offline, hallucination-free data collection in low-resource African languages. It proposes keyword spotting to turn closed-vocabulary digital forms into voice-based, on-device data collection for low-literacy populations, and transpiling existing form tools into MaaL schemas.

0 favorites 0 likes
#speech-models

Duplex-MPE: Benchmarking Multi-Party Interaction in Full-Duplex Dialogue

Hugging Face Daily Papers ↗ · 2026-09-25 Cached

The paper introduces Duplex-MPE, a benchmark for evaluating AI assistants in multi-party, full-duplex dialogues with 2,000 scenarios, assessing models on response initiation, accuracy, and silence preservation.

0 favorites 0 likes
#speech-models

A frontend-backend architecture for tool calls in full-duplex speech models

arXiv cs.CL ↗ · 2026-09-18 Cached

The paper proposes a frontend-backend architecture for enabling tool calls in full-duplex speech models, where a speech frontend delegates to a text-based LLM backend for tool invocation, maintaining low-latency and natural interaction.

0 favorites 0 likes
#speech-models

What Did I Just Say? Self-Listening for Full-Duplex Speech Models

Hugging Face Daily Papers ↗ · 2026-09-04 Cached

This paper proposes Self-Listening, a method for full-duplex spoken language models that feeds realized speech back as input to improve interruption recovery and consistency with actually spoken responses.

0 favorites 0 likes
#speech-models

@tryaircaps: Today, we’re publicly launching the AirCaps Audio Research Lab. Real-world audio is 10x harder to understand than the d…

X AI KOLs Following ↗ · 2026-09-02 Cached

AirCaps Audio Research Lab launches with streaming speech and audio models designed for complex real-world environments, claiming superior performance on edge hardware compared to leading cloud models.

0 favorites 0 likes
#speech-models

@nrol_ling: Seven languages, 4,421 utterances: is emotion represented the same way in all of them? Mostly yes. The geometry lines u…

X AI KOLs Timeline ↗ · 2026-08-24 Cached

The research finds that emotion representation is mostly universal across seven languages in speech models, with a measurable 'accent' that mirrors human cross-cultural studies and affects cross-lingual transfer.

0 favorites 0 likes
#speech-models

@OrukLabs: None of these models was ever told what emotion is. They were trained to transcribe words, or to fill in masked audio. …

X AI KOLs Following ↗ · 2026-07-04 Cached

A study from OrukLabs shows that speech models trained solely on transcription or masked audio tasks spontaneously learn to represent emotions in their deeper layers, as revealed by mapping with real voice clips.

0 favorites 0 likes
#speech-models

RedVox: Safety and Fairness Gaps in Speech Models Across Languages

arXiv cs.CL ↗ · 2026-06-26 Cached

This paper introduces RedVox, a multilingual safety and fairness benchmark for speech models. Evaluating eight state-of-the-art models across five languages, it finds persistent vulnerabilities that worsen in non-English settings and with spoken input.

0 favorites 0 likes
#speech-models

SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models

arXiv cs.CL ↗ · 2026-06-25 Cached

SpeechEQ introduces a benchmark and dataset for evaluating emotional intelligence in speech-language models, covering 15 EQ subscales across 2,265 dialogues. Experiments reveal current models struggle with paralinguistic cues, exhibiting text-reliant shortcuts and other limitations.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback