EmbeddingGemma 2: Unified and Efficient Multimodal Representations

Hugging Face Daily Papers Papers

Summary

Google 推出 EmbeddingGemma 2,一个统一文本、图像、音频与视频表示的开源多模态嵌入模型,采用简化逐层嵌入与多阶段训练课程,在各模态基准上建立新的帕累托前沿,性能超越大 2 至 12 倍的模型。

We present EmbeddingGemma 2, an open multimodal embedding model which natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplified per-layer embeddings and a multi-stage curriculum with modality and objective progression which ensure strong quality across unimodal, cross-modal, and mixed-modal evaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a new Pareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supporting selective modality encoder loading, adjustable vision token budgets, truncatable embedding dimensions, and quantized weights. We present ablations analyzing key decisions and release EmbeddingGemma 2 to promote further research.
Original Article
View Cached Full Text

Cached at: 10/28/26, 05:28 PM

Paper page - EmbeddingGemma 2: Unified and Efficient Multimodal Representations

Source: https://huggingface.co/papers/2610.37364 Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

EmbeddingGemma 2 is an open multimodal embedding model that unifies text, images, audio, and video representations with efficient resource-flexible design and state-of-the-art benchmark performance.

We present EmbeddingGemma 2, an openmultimodal embedding modelwhich natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplifiedper-layer embeddingsand amulti-stage curriculumwith modality and objective progression which ensure strong quality across unimodal,cross-modal, andmixed-modalevaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a newPareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supportingselective modality encoder loading, adjustablevision token budgets,truncatable embedding dimensions, andquantized weights. We present ablations analyzing key decisions and release EmbeddingGemma 2 to promote further research.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2610\.37364

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper1

#### google/embeddinggemma-2 Feature Extraction• 0.7B• Updatedabout 10 hours ago • 283k • 2.99k

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.37364 in a dataset README.md to link it from this page.

Spaces citing this paper46

Browse 46 spaces citing this paper## Collections including this paper1

Similar Articles

EmbeddingGemma 2: an open, lightweight multimodal embedding model

Google DeepMind Blog

Google DeepMind launches EmbeddingGemma 2, a 740M-parameter open (Apache 2.0) multimodal embedding model that unifies text, code, images, video, and audio into a shared embedding space optimized for on-device inference, built on the Gemma 4 architecture with 8K context and Matryoshka truncation for storage efficiency.

Google EmbeddingGemma 2

Product Hunt

Google DeepMind发布了EmbeddingGemma 2,这是一个开源的轻量级多模态嵌入模型,可将文本、代码、图像、视频和音频映射到同一共享空间,740M参数可在设备端运行,并采用Apache 2.0许可。

google/embeddinggemma-2 · Hugging Face

Reddit r/LocalLLaMA

Google DeepMind released EmbeddingGemma 2, an open multimodal embedding model (740M params) that maps text, images, video, and audio into a unified 768-d vector space, designed for on-device search, RAG, and classification with Matryoshka truncation for reduced storage costs.

unsloth/embeddinggemma-2-GGUF

Hugging Face Models Trending

Google DeepMind 发布 EmbeddingGemma 2,一个 740M 参数的开源多模态嵌入模型,支持文本、图像、视频和音频统一到 768 维向量空间,专为消费级硬件上的搜索、RAG、分类等任务设计;Unsloth 同时提供了 GGUF 量化版本。