architectural-modification

Tag

Cards List
#architectural-modification

Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms

Hugging Face Daily Papers · 3d ago Cached

This paper presents an interpretability study on video diffusion models, revealing that Rotary Position Embedding (RoPE) induces excessive spatial attention decay, causing physics violations, and proposes a lightweight architectural modification to enhance physical coherence in generated videos.

0 favorites 0 likes
← Back to home

Submit Feedback