Tag
This paper proposes representing multimodal data (image, video, text) as bags of atomic propositions (e.g., 'person holding cup'), unified via a global semantic codebook, enabling interpretable, compositional, and cross-modal understanding. The framework is demonstrated on autonomous driving and open-world data.