multimodal-representation

MKGR is a multimodal framework that combines protein sequence encoding with four biomedical knowledge graphs to improve cold-start protein-protein interaction prediction, outperforming baselines on benchmark datasets.

Alibaba researchers propose AFMRL, a two-stage framework that uses MLLMs to extract product attributes and enhance fine-grained multimodal representation learning for e-commerce retrieval tasks.