Tag
The author shares the complete process of integrating the Fish Audio speech service into Muse, with support for Chinese dubbing, multiple voice timbre options, voice cloning, and the ability to call the free s2.1-pro-free model.
开源 TTS 服务器发布:基于 OmniVoice,提供 OpenAI 兼容 API,RTX 3080 上一句话生成仅需约 0.3 秒,并支持从短参考音频克隆声音,可流式逐段处理长文本。
Italy's PM Giorgia Meloni has filed to trademark her voice with the EU Intellectual Property Office as a sound mark to curb AI deepfakes, with legal experts predicting law firms will soon sell "identity portfolios" bundling trademarks on a client's voice, face and catchphrases.
A reflective post on the growing ability to recreate a deceased person's voice, writing style, and mannerisms with AI, questioning the ethics of letting families keep a simulated version of a loved one and who should have the right to approve such a digital afterlife.
Sopro V2 Turbo is a 120M-parameter open-source TTS model with zero-shot voice cloning that streams with ~300ms time-to-first-audio on laptop CPU and runs in-browser via ONNX, reaching SOTA-level intelligibility despite its small size.
kyutai_labs released a technical blog on training PocketTTS, a 100M parameter on-device text-to-speech model using the drifting one-step generative objective from Deng et al., achieving under 1% WER with high quality and voice cloning — reportedly the first speech and autoregressive model trained this way.
Fish Audio 发布新一代文本转语音模型 Drama 3,采用 35B 参数 MoE 架构(每 token 激活 3B),支持最多 16 个说话人的多角色长文本生成、语音克隆与自然语言控制,并可在 SGLang-Omni 上流式部署。
Hugging Face introduces the Open TTS Leaderboard, an objective, scalable evaluation framework for multilingual TTS and voice cloning using ASR-based intelligibility (WER/CER), speed (RTFx/TTFA), and WavLM speaker-similarity metrics, reducing model evaluation time from weeks to hours.
Tacit-TTS 将 IndexTTS2 的自回归文本到语义解码替换为掩码非自回归生成,并结合免训练声学长度估计与 ReFlow 蒸馏,实现无需参考文本的零样本语音克隆,在超过 5 秒的语音上比 IndexTTS2 快 10 倍以上,同时支持跨语言及非语音(如婴儿咿呀学语、合成乱码)的参考音频克隆。
Qwen3.8-LiveTranslate is an AI model that reduces translation lag and improves quality using an interleaved audio-text architecture, featuring real-time speaker separation and voice cloning in 60 languages.
The tweet showcases ten trending open-source GitHub repositories focused on AI agents, browser automation, voice cloning, and local model execution, indicating a growing infrastructure for AI agent development.
A solo developer has open-sourced a free, local AI tool that serves as an ElevenLabs replacement, enabling voice cloning, video dubbing in 646 languages, and more without any data leaving the user's machine.
OpenVoice is an open-source AI tool for voice cloning that uses a short reference audio clip to replicate timbre, enabling multilingual and emotional adjustments, and has gained significant traction on GitHub.
Steven Johnson of Google Labs explains how AI can clone a writer's voice without permission, highlighting challenges for copyright protection and the freelance economy.
LoudKit is an open-source local TTS tool with voice cloning, supporting 10 languages, and available as SDKs for Python, Swift, Go, Rust, and TypeScript, designed to run efficiently on edge devices.
Tencent has open-sourced a 1.5B parameter AI model called AuK that can replace multiple audio tools, handling tasks like TTS, voice cloning, and denoising via natural language instructions.
The article discusses three converging toolchains in neural voice synthesis—vocal identity, signal manipulation, and performance realism—focusing on voice cloning and timbre transfer to transform vocal performances while preserving original phrasing and dynamics.
This paper presents a method to build a compact fixed-voice Thai TTS system using synthetic speech from a larger model, evaluating its performance and introducing an 82M-parameter model for on-device deployment.
This paper presents Wayu-Paxa-TTS-Edge, an 82M-parameter Thai TTS model trained on synthetic speech from a voice-cloning teacher, achieving high accuracy and prosody for on-device use without reference audio.
VoiceStudio is an open-source local voice studio tool offering voice cloning, dubbing, transcription, and more in 646 languages, providing an alternative to ElevenLabs.