Tag
一条中文社交媒体帖子,分享利用AI工具(据称的Opus 5.5与Gemini 3.8Flash TTS)在抖音上快速起号、做科普内容和变现的技巧,包括推理强度设置、话题标签和配乐建议。
开源 TTS 服务器发布:基于 OmniVoice,提供 OpenAI 兼容 API,RTX 3080 上一句话生成仅需约 0.3 秒,并支持从短参考音频克隆声音,可流式逐段处理长文本。
提出一种通过LLM生成方言文本并用标准语TTS合成伪方言语音的零真实方言数据增强方法,并引入中间标准文本预测以缩小语义差距,提升语音语言模型在日语、德语和中文方言上的翻译表现。
Speakrail is an open-source, fully-local full-duplex voice assistant that runs on a single RTX 4090, combining Voxtral Mini 4B for streaming speech with a turn-taking head, a Gemma 4 12B LoRA for interruptible dialogue decisions, and Breeze TTS 2 for speech output, achieving ~0.7-0.8s median reply latency and the top open-weights score on Full-Duplex-Bench conversational dynamics.
kyutai_labs released a technical blog on training PocketTTS, a 100M parameter on-device text-to-speech model using the drifting one-step generative objective from Deng et al., achieving under 1% WER with high quality and voice cloning — reportedly the first speech and autoregressive model trained this way.
EMA Lightning is a tiny, fast Turkish text-to-speech model with 8.6M total parameters (~34 MB) that claims the lowest WER (0.92%) on Freya-TR-Eval, beating ElevenLabs v4 and Gemini 3.8, with streaming generation and fully offline operation under Apache 2.0.
Inworld has acquired the real-time voice-agent platform Ultravox and migrated its built-in voices to Realtime TTS-2, which supports natural-language inline instructions for controlling pace, tone, and emotion during a conversation.
开发者 Matt Pocock 分享了使用 Opus 5.5 制作视频分镜(animatics)的用例:模型能梳理课程内容、生成画面静帧并通过 TTS 配音,极大提升了视频拍摄前的规划效率。
The paper introduces EmoRES-TTS, a training-free method for emotional speech generation that enhances controllability by decomposing emotion vectors into shared and residual components, achieving superior performance over existing methods on benchmarks.
The author describes experimenting with AI-generated stills and text-to-speech to create animatics for course videos, which helps in planning and identifying issues before filming.
NotebookLM has integrated Gemini 3.8 TTS, enabling flawless Chinese reading and rapid video production for knowledge creators, with various AI video content schemes discussed.
NVAlign is a direct-gradient optimization method for fine-tuning text-to-speech models to reliably produce non-verbal sounds like laughs and sighs, improving performance over standard fine-tuning and flow-GRPO while maintaining naturalness.
The article introduces sanoTTS, a compact 294,279-parameter TTS system, and presents an interactive site to explore its internal mechanisms.
Launch of Voice Acting Arena, a platform for evaluating voice acting AI models through user comparisons to assess performance in acting, direction, and genuineness.
Nari Labs introduces Qwen3-TTS and Qwen3-ASR models, providing high accuracy, low latency, and cost-effectiveness in a free public beta, alongside optimized APIs and services for production deployment.
A solo developer has open-sourced a free, local AI tool that serves as an ElevenLabs replacement, enabling voice cloning, video dubbing in 646 languages, and more without any data leaving the user's machine.
LoudKit is an open-source local TTS tool with voice cloning, supporting 10 languages, and available as SDKs for Python, Swift, Go, Rust, and TypeScript, designed to run efficiently on edge devices.
Tencent has open-sourced a 1.5B parameter AI model called AuK that can replace multiple audio tools, handling tasks like TTS, voice cloning, and denoising via natural language instructions.
X2-NativeCursor is a lightweight observer for tracking text progress in incremental-text streaming TTS systems using native speech tokens, achieving lower error and faster alignment compared to waveform-based baselines.
An open-source website, voicebenchmarks.com, has been built to centralize Voice AI benchmarks for TTS, LLM, STT, and more, featuring a user-friendly interface and inviting community contributions.