WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report

Hugging Face Daily Papers Papers
multimodal-embedding wechat tencent ai-research retrieval-models open-source state-of-the-art

Summary

WeMM-Embedding is a family of universal multimodal embedding models developed by Tencent, achieving state-of-the-art performance in retrieval and recommendation tasks for WeChat applications, with variants in 2B, 4B, and 9B parameters released publicly.

Universal multimodal embeddings are becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space for applications such as retrieval, recommendation, classification, and agentic systems. In this report, we present WeMM-Embedding, a family of universal multimodal embedding models supporting text, images, videos, visual documents, and arbitrarily interleaved multimodal inputs with flexible output dimensions. The family comprises 2B, 4B, and 9B variants and is trained in two stages: a large-scale multimodal alignment stage, followed by a refinement stage using curated data, fine-grained relevance supervision, and cross-scale knowledge transfer. Across extensive evaluations, WeMM-Embedding achieves leading performance on multiple public benchmarks. Notably, the 2B variant already surpasses the previously leading 8B open-source baseline on MMEB-v2, while the 9B variant further achieves a new state-of-the-art overall score of 80.6. WeMM-Embedding also demonstrates strong practical performance across WeChat applications, with substantial gains on a 26-task in-house benchmark and consistent improvements across 14 online A/B tests. It has been deployed at scale across recommendation and search applications, including WeChat Channels, Official Accounts, Moments, and e-commerce services. We have released the model weights and code to facilitate future research at https://github.com/Tencent/WeMM-Embedding.
Original Article
View Cached Full Text

Cached at: 08/26/26, 07:14 AM

Paper page - WeMM-Embedding: WeChat Multi-Modal Embedding Technical Report

Source: https://huggingface.co/papers/2608.24053

Abstract

WeMM-Embedding is a family of universal multimodal embedding models that align text, images, videos, and interleaved inputs in a shared space, achieving state-of-the-art retrieval and recommendation performance across public benchmarks and large-scale WeChat applications.

Universalmultimodal embeddingsare becoming a core component of modern AI systems, enabling heterogeneous content to be represented in a shared space for applications such as retrieval, recommendation, classification, and agentic systems. In this report, we present WeMM-Embedding, a family ofuniversal multimodal embedding modelssupporting text, images, videos, visual documents, and arbitrarily interleaved multimodal inputs with flexible output dimensions. The family comprises 2B, 4B, and 9B variants and is trained in two stages: a large-scale multimodal alignment stage, followed by a refinement stage using curated data,fine-grained relevance supervision, andcross-scale knowledge transfer. Across extensive evaluations, WeMM-Embedding achieves leading performance on multiple public benchmarks. Notably, the 2B variant already surpasses the previously leading 8B open-source baseline onMMEB-v2, while the 9B variant further achieves a new state-of-the-art overall score of 80.6. WeMM-Embedding also demonstrates strong practical performance across WeChat applications, with substantial gains on a 26-task in-house benchmark and consistent improvements across 14 online A/B tests. It has been deployed at scale across recommendation and search applications, including WeChat Channels, Official Accounts, Moments, and e-commerce services. We have released the model weights and code to facilitate future research at https://github.com/Tencent/WeMM-Embedding.

View arXiv pageView PDFGitHub31Add to collection

Get this paper in your agent:

hf papers read 2608\.24053

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper3

#### tencent/WeMM-Embedding-9B Feature Extraction• 9B• Updatedabout 4 hours ago • 40 #### tencent/WeMM-Embedding-2B Feature Extraction• 3B• Updatedabout 4 hours ago • 24 #### tencent/WeMM-Embedding-4B Feature Extraction• 5B• Updatedabout 4 hours ago • 18

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2608.24053 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2608.24053 in a Space README.md to link it from this page.

Collections including this paper1

Similar Articles

tencent/WeMM-Embedding 9B/4B/2B

Reddit r/LocalLLaMA

Tencent introduces WeMM-Embedding, a series of universal multimodal embedding models in 9B, 4B, and 2B sizes, built on Qwen3.5, supporting text, images, videos, and visual documents for embedding generation.

Douyin Multimodal Embedding Model Technical Report

Hugging Face Daily Papers

This technical report introduces Douyin Multimodal Embedding (DME), a two-stage trained model that combines contrastive pre-training with evidence-grounded latent reasoning and cross-conditional reconstruction, achieving state-of-the-art results on MMEB-v2 and deployment in Douyin search.

UEmbed: Unified Sparse and Dense Multimodal Embeddings

Hugging Face Daily Papers

UEmbed is a decoder-only multimodal embedding model that produces both sparse and dense representations in a single forward pass, released at 2B, 4B, and 9B scales. It outperforms existing public-data-trained multimodal embedding models on MMEB-v2 and remains competitive on BEIR.

MVEB: Massive Video Embedding Benchmark

Hugging Face Daily Papers

This paper introduces MVEB, a large-scale benchmark for evaluating video embeddings across 23 tasks, finding that no single model dominates and that audio's contribution depends on dataset annotation provenance. It integrates into the MTEB ecosystem for unified multimodal evaluation.