Tag
SyncReward 提出了一套面向音视频生成的人体对齐同步奖励框架，包括 80K 专业同步评分数据集 SyncReward-Data-80K、1K 挑战基准 SyncReward-Bench，以及通过语义-时间对比预训练与人类监督训练的奖励模型，可作为评估指标并用于推理时 best-of-N 选择和强化学习后训练以提升音视频同步质量。
A survey paper that unifies joint audio-visual generation, cross-modal generation, and coupled editing into a single formulation over distributions of audio-video pairs, and proposes a taxonomy with five design axes plus nine edit categories covering 28 edit types.
JoyAI-Echo is an open-source GitHub repository that provides long-horizon audio-visual generation and omnimodal world models for creating persistent stories and interactive worlds.
This paper presents JoyAI-Echo-1.5, a unified audio-visual generation system for long-form video and interactive worlds, using cross-shot memory and geometry-aware control to maintain coherence and persistence.
EchoWM introduces an open omnimodal world model that generates synchronized video, sound, music, and speech with continuous 6-DoF navigation for enterable generative media.
LongAV-Compass is a comprehensive benchmark for evaluating minute-long audio-visual generation across text, image, and video conditioning modalities, assessing quality, consistency, and alignment over extended temporal sequences.