I built an open-source dubber that keeps each actor’s own voice, fully local (OmniVoice + Whisper, 6 GB+ NVIDIA)

Reddit r/LocalLLaMA Tools
open-source voice-cloning dubbing tts whisper local-ai github

Summary

一位开发者开源了本地运行的影视配音工具 dub-anything，利用 OmniVoice、IndexTTS、Chatterbox 和 Whisper 克隆并保留每位演员的原声进行多语言配音，让此前未被翻译的内容变得可看。

I've used this to watch shows and movies that have never been translated to English. There's so much great content out there, that is now accessible thanks to AI. Basically you clone the repo and tell your local model (or non-local model) to direct the dubbing process; the rest of the tools are all local as well (OmniVoice, IndexTTS, Chatterbox, Whisper). The repo contains all the scripts and guidance for the model to do a successful dub in the actors' own voices. It's also instructed to improve its own scripts so feel free to push back improvements so everyone benefits. Thanks. Anime sample: https://www.youtube.com/watch?v=qXosYS-cTXk Movie sample: https://www.youtube.com/watch?v=2DsFAoTbQ8E Repo: https://github.com/swax/dub-anything
Original Article

Similar Articles

@GitTrend0x: Holy cow, guys! Run voice cloning and cinematic video dubbing locally, supporting 646 languages, fully offline, no API key, no internet needed. ElevenLabs is crushed! https://github.com/debpalash/OmniVoice-Studio… This open-source marvel is insane...

X AI KOLs Timeline

OmniVoice Studio is an open-source desktop app that enables local voice cloning and cinematic video dubbing across 646 languages, fully offline with no API keys, positioning itself as a privacy-focused alternative to ElevenLabs.

@IndieDevHailey: VoiceStudio: local version of ElevenLabs, voice cloning, sound design, video dubbing, dictation, audiobooks, all included, supporting 646 languages. 16 TTS engines switchable at will, completely local, no account needed, no API, no subscription, all data on your machine. Just renamed from OmniVoice, already has 1…

X AI KOLs Timeline

VoiceStudio is a locally running AI voice tool, offering features such as voice cloning, sound design, video dubbing, etc., supporting 646 languages, with no need for network connection or subscription, and all data processed locally.

@mogician301: https://x.com/mogician301/status/2072250774332285073

X AI KOLs Timeline

Introduces an open-source tool called audio-to-text that uses AI and local tools (like faster-whisper and ffmpeg) to help users automatically generate, proofread, and burn subtitles, solving problems such as high costs, frequent errors, and cumbersome workflows in software like CapCut.

@noahduck283: A tool that can download any YouTube video, cleanly remove vocals, transcribe, translate into 100+ languages, clone the original voice, and perform fully automatic dubbing. It takes less than 2 minutes. 100% runs locally. Free. Sews six top open-source models into a web page for "one-click download, vocal removal, transcription, translation, dubbing"...

X AI KOLs Timeline

Voice-Pro is a web tool that integrates six top open-source models (Whisper, Demucs, CosyVoice, F5-TTS, etc.), supporting YouTube video downloading, vocal removal, transcription, translation, voice cloning, and fully automatic dubbing. It takes less than 2 minutes, runs 100% locally, and is free.

ElevenLabs Dubbing v2

Reddit r/singularity

ElevenLabs launched Dubbing v2, an AI dubbing model that preserves the original speaker's emotion, tone, and performance across 90+ languages by conditioning on the original audio directly, offering broadcast-quality dubbing at a fraction of the cost.