@yhslgg: Old Yang shares another gem open-source tool—KrillinAI, 10,000 stars on GitHub, a must-see for multilingual audio/video content! In a nutshell: from video download to subtitle translation, AI dubbing, video compositing, the entire pipeline is covered, and it can even auto-generate platform covers, supporting Bilibili, Douyin, Xiaohongshu, YouTube…
Summary
KrillinAI is an open-source tool that integrates the entire workflow of video downloading, subtitle translation, AI dubbing, and video compositing. It supports context-aware translation, voice cloning, auto layout, and cover generation, and is compatible with multiple AI models, suitable for multilingual audio/video content creation and distribution.
View Cached Full Text
Cached at: 06/03/26, 09:56 PM
Old Yang shares another treasure open-source tool - KrillinAI, 10,000 stars on GitHub. Definitely worth a look for anyone working with multilingual audio/video content!
In a nutshell: From video downloading to subtitle translation, AI voiceover, and video compositing, it covers the entire workflow. It even auto-generates platform cover images. Full support for Bilibili, Douyin, Xiaohongshu, YouTube, and TikTok.
Similar to pyVideoTrans but with key differentiators: context-aware translation, automatic vertical layout, auto cover generation, CLI + AI Agent workflow support.
Key highlights:
(1) Context-aware translation — Not a rigid sentence-by-sentence translation. The LLM understands the context of the entire passage before translating, resulting in a more natural spoken feel, avoiding awkward contradictions.
(2) Voice cloning — Integrates CosyVoice, allowing you to clone a specific voice for dubbing. Also supports custom cloning for voices with recognition.
(3) Automatic landscape/portrait layout — No need to manually crop for short vertical videos. Automatically handles layout to produce formats suitable for Douyin and TikTok.
(4) Auto cover generation — Automatically generates platform cover images based on prompt templates. One less headache when publishing videos.
(5) CLI + structured JSON output — Supports staged command line calls, outputs structured data, easily integrated into AI Agent automation workflows. Designed not just for humans, but for agents too.
(6) Compatible with all OpenAI API compliant models — OpenAI, Gemini, DeepSeek, Tongyi Qianwen, local open-source models. Works with anything, no lock-in.
Supports Windows / macOS / Linux, with a desktop client and server deployment options. Translation output supports 101 languages.
For those doing cross-platform content distribution, multilingual repurposing, or AI-driven automated video production, this tool is worth a serious look.
#KrillinAI #VideoTranslation #AIVoiceover
Similar Articles
@yhslgg: Bro, sharing another open-source video translation tool—pyVideoTrans, with 17,700 stars on GitHub, a must-have for video repurposing and localization! In a nutshell: drop a video in, and it automatically runs through the entire pipeline of speech recognition → subtitle translation → AI dubbing → video synthesis, outputting a complete video in another language. Core...
pyVideoTrans is an open-source video translation tool that supports automatic speech recognition, subtitle translation, AI dubbing, and video synthesis. It integrates multiple ASR, translation, and TTS engines, making it suitable for cross-language video production and localization.
@XAMTO_AI: If you don't bookmark this open-source tool now, you'll regret it later — automatic video dubbing and translation, supports 33 languages at once, and can even answer questions about video content. Found a gem on GitHub called Violin, fully open-source, what it does is a bit unbelievable: you drop a video in, it automatically recognizes speech, …
Violin is an open-source automatic video dubbing and translation tool that supports 33 languages, integrates models like Whisper and DeepSeek, and provides one-click speech recognition, translation, dubbing synthesis, and in-video Q&A functionality.
@Smartpigai: Every time someone asks me 'What tools do you use for content / video / material management?', I can't be bothered to explain again. Here's a one-time comprehensive list — save it yourself: 1. Video editing (make videos with code) https://github.com/remotion-dev/remotion… 2. Speech-to-text / meeting minutes…
A post compiling multiple open-source tools for content creation, including video editing, speech-to-text, AI drawing, media processing, etc., emphasizing free and open-source and the ability to build your own system.
@GenhuiP78950: Open-sourced my AI tools from the past six months. Not a big project, just scripts I use daily – transcribing Douyin/Bilibili videos, podcast-to-text, WeChat public account articles, industry news scanning… 11 in total. Used them privately, now unified with install scripts and docs.
Open-sourced a collection of 11 AI tool scripts for collecting and transcribing content from multiple channels like Douyin, Bilibili, and WeChat public accounts, making it easy to build a personal knowledge base. Supports direct installation by agents such as Claude Code, Codex, etc.
@laowangbabababa: Shocked! Dr. Qi on Douyin sells a 500k digital human agent per day, and I built it in 2 minutes. Using the Pixelle-Video project, which already has 22k stars. It supports digital human lip-syncing, motion transfer, and image-to-video. Supports ComfyUI, input a topic, from script writing to adding...
Introducing the open-source project Pixelle-Video: a fully automated AI short video engine. Input a topic and it automatically generates a video with script, images, voiceover, and background music. Supports local and cloud models, modular design allows flexible replacement of each component model.