Tag
Shizuku AI's technology division announced proprietary lip-sync technology for the virtual singer Shizuku, claiming improved quality over the existing uLipSync approach using techniques like 1D CNN.
开源了「神佬知识大赏」Agent Skill（Digital Human Koubo），只需一张照片加一句话即可全自动生成带口播、配音、字幕和包装的数字人短视频，已在 GitHub 上发布。
Kling 4.0 是一款面向创作者、营销人员和工作室的 AI 视频模型，支持最多 10 个关键帧、15 个参考素材和 8,000 token 提示词，单次生成 30 秒片段，并内置多语言唇形同步与立体声音频，同时提供 Flash 快速版本及 MCP + CLI 接入能力。
Audio Lip Sync Pro is a Blender tool that generates high-quality lip-sync facial animations directly from audio clips, running fully locally with no account or network access required. Unity and Maya releases are planned.
开发者发布 Amisoria——一款 iPhone 应用，可为运行在自家 Mac 上的 OpenClaw 网关智能体添加 3D 角色形象、神经语音、口型同步、免提对话与插话功能，支持 20 种语言，基础功能免费且部分开源。
The paper introduces Align Then Reason (ATR), a multilingual, reference-free lip-sync judge that first aligns frame-level lip representations with phonetic units of a candidate line, then uses an LLM to reason over local alignment evidence and a global score for dubbing quality control, delivering large AUC gains over Qwen3.5, LLaMA-3.1, and Mistral SFT baselines across seven languages and two downstream dubbing tasks.
Seedance 2.5 launched, enabling 30-second single-pass video generation, audio-reference lip-sync, and API features like async jobs and webhooks. Its standout is billing for failed generations isn't charged and reference videos get lower token rates, though output max is 720p.
Google highlights PhD intern Khoi's research on synchronizing lip movements with dubbed audio to create natural-looking multi-language videos for YouTube.
Duix.Avatar is a local AI avatar toolkit that generates lip-synced avatar videos from video, voice, and script inputs without sending data to the cloud. It supports eight languages and is available under a community license on GitHub.
NVIDIA Audio2Face-3D generates high-fidelity 3D facial animations from audio, providing accurate lip-sync and emotional expression. It is released as an open-source SDK with pre-trained models and plugins for Maya and Unreal Engine 5.
A discussion about the evolution of AI social apps from text chat to real-time video interfaces, highlighting Mel's multimodal interaction stack and the technical challenges of latency, lip sync, and orchestration.
Vaani is a lip-synced AI dubbing tool for creators, brands, and studios.
Meituan open-sourced the LongCat-Video-Avatar-1.5 model, which supports generating realistic talking videos from a single photo and voice, supports multiple languages and long videos, and outperforms commercial closed-source solutions.
LongCat-Video-Avatar 1.5 is an upgraded open-source framework for audio-driven human video generation with improved lip synchronization, production-ready stability, and efficient 8-step inference.
AI lip-sync tools like sync.so can redraw mouth movements to match dubbed audio, potentially neutralizing the long-standing argument that dubs break immersion due to mismatched mouth movements.