Tag
VIBE is an AI system that generates background music for videos by aligning with text instructions, using continuous latent modeling and reinforcement learning for better synchronization with video mood, timing, and genre.
The paper identifies why deterministic few-step generation fails for text while succeeding for images: the sharp categorical readout in text decoders amplifies small errors, causing token flips, whereas continuous image decoders are smooth. It proposes diagnostics (DABI, CCI) and escape mechanisms such as categorical commitment and stochastic re-injection.