Tag
This paper proposes modeling the CLIP latent space using Mixtures of von Mises–Fisher distributions on the unit hypersphere, capturing its directional and multimodal structure better than Gaussian assumptions. The model improves long-tailed and out-of-distribution detection and provides a semantic decomposition of CLIP embeddings.
This paper introduces MMOT, an online mixture model learning framework based on optimal transport theory that addresses incremental learning with distributional shifts through dynamic centroid updates and improved class similarity estimation. The approach includes a Dynamic Preservation strategy to mitigate catastrophic forgetting and maintain class separability in latent space.