AcrossVAM2.0:用于参数高效视频扩散适配的冲突感知点监督
摘要
AcrossVAM2.0 提出一种冲突感知的点对应监督方法,用于参数高效的视频扩散模型适配,通过置信度加权跟踪头、零初始化残差反馈和非对称 PCGrad,在保持预训练外观先验的同时提升对应一致性,但并不均匀改善视频质量。
arXiv:2610.14693v1 Announce Type: new
Abstract: Explicit point correspondence is attractive for adapting video generators: it describes how visible surfaces move, but can overwrite the appearance prior learned by a large pretrained model. We study this tension in a 5.01B-parameter text-to-video diffusion transformer. ACROSSVAM2.0 combines a confidence-weighted track-and-visibility head, zero-initialized residual feedback, and asymmetric PCGrad that removes only the auxiliary component opposing the primary flow-matching gradient on shared LoRA parameters. The design preserves the generator exactly at initialization and protects its primary update during adaptation. In a four-way ablation trained for 1,000 steps with three independent seeds, the full method lowers KLT forward-backward cycle error in all three seeds relative to a matched flow-only continuation (mean seed-level difference -0.00711, SD 0.00505), while robust sharpness remains positive in all three. An expanded 24-prompt evaluation (216 videos) yields 9.7% lower aggregate CoTracker3 cycle error than the matched control and near-matched performance on six VBench dimensions; however, the seed-level tracking effect is heterogeneous and I3D-FVD regresses from 0.1824 to 0.2022. These results support a bounded claim: conflict-aware adaptation improves correspondence consistency without broad perceptual degradation, but does not uniformly improve video quality. We release equations, pseudocode, matched outputs, source tables, and artifact provenance.
查看缓存全文
缓存时间: 2026/10/15 06:55
# AcrossVAM2.0: Conflict-Aware Point Supervision for Parameter-Efficient Video Diffusion Adaptation Source: [https://arxiv.org/abs/2610.14693](https://arxiv.org/abs/2610.14693) [View PDF](https://arxiv.org/pdf/2610.14693) > Abstract:Explicit point correspondence is attractive for adapting video generators: it describes how visible surfaces move, but can overwrite the appearance prior learned by a large pretrained model\. We study this tension in a 5\.01B\-parameter text\-to\-video diffusion transformer\. ACROSSVAM2\.0 combines a confidence\-weighted track\-and\-visibility head, zero\-initialized residual feedback, and asymmetric PCGrad that removes only the auxiliary component opposing the primary flow\-matching gradient on shared LoRA parameters\. The design preserves the generator exactly at initialization and protects its primary update during adaptation\. In a four\-way ablation trained for 1,000 steps with three independent seeds, the full method lowers KLT forward\-backward cycle error in all three seeds relative to a matched flow\-only continuation \(mean seed\-level difference \-0\.00711, SD 0\.00505\), while robust sharpness remains positive in all three\. An expanded 24\-prompt evaluation \(216 videos\) yields 9\.7% lower aggregate CoTracker3 cycle error than the matched control and near\-matched performance on six VBench dimensions; however, the seed\-level tracking effect is heterogeneous and I3D\-FVD regresses from 0\.1824 to 0\.2022\. These results support a bounded claim: conflict\-aware adaptation improves correspondence consistency without broad perceptual degradation, but does not uniformly improve video quality\. We release equations, pseudocode, matched outputs, source tables, and artifact provenance\. ## Submission history From: Nan Wu \[[view email](https://arxiv.org/show-email/8edcfecf/2610.14693)\] **\[v1\]**Sat, 10 Oct 2026 08:12:08 UTC \(4,164 KB\)
相似文章
ForcingBooster:用于快速自回归视频扩散的自适应分块去噪
ForcingBooster 提出一种自适应逐 patch 去噪框架,根据视频块难度动态分配去噪步数,在保持画质的同时将总去噪步数减少约 50%,加速自回归视频扩散模型的生成。
RepForcing:面向自回归视频蒸馏的表示空间初始化
论文提出 RepForcing,通过表示空间监督(而非中间教师的轨迹回归)来初始化少步自回归视频生成器,并结合非对称 DMD,在 4 步采样下 VBench 总分从 84.04 提升至 84.66,VisionReward 提升约 59%。
OPSD-V: 面向后训练少步自回归视频生成器的在线策略自蒸馏
OPSD-V 通过使用真实长视频数据作为训练时的时间上下文,提供密集的轨迹级监督,从而增强视觉质量和运动动态,同时不改变推理机制,改进了少步自回归视频扩散模型。
LVSA: 用于长视频扩散的无训练稀疏注意力
LVSA 为视频扩散模型引入了一种无训练稀疏注意力机制,将计算量减少高达 3.17 倍,同时能够在训练时长之外进行生成,且无质量损失。
Forcing-KV:面向高效自回归视频扩散模型的混合KV缓存压缩策略
本文介绍了Forcing-KV,这是一种针对自回归视频扩散模型的混合KV缓存压缩策略,它将注意力头分为静态和动态两类,在1080P分辨率下实现了高达2.82倍的加速,同时保持了输出质量。