multimodal-retrieval

Tag

Cards List
#multimodal-retrieval

DEO: Training-Free Direct Embedding Optimization for Negation-Aware Retrieval

arXiv cs.CL ↗ · 5h ago Cached

The paper proposes Direct Embedding Optimization (DEO), a training-free method that decomposes queries into positive and negative components and optimizes query embeddings with a contrastive objective for negation-aware text and multimodal retrieval, outperforming baselines on NegConstraint and improving Recall@5 over OpenAI CLIP.

0 favorites 0 likes
#multimodal-retrieval

Searching the Pareto Front: Multi-Objective Retrieval for Heterogeneous Scientific Modalities

arXiv cs.AI ↗ · 5h ago Cached

This paper compares multimodal foundation model embeddings with late fusion of separately trained modality embeddings via Pareto-based multi-objective optimization for cross-modal galaxy retrieval, finding that the multi-objective approach preserves modality-specific structure and retrieves neighbors 8% closer in raw-data space.

0 favorites 0 likes
#multimodal-retrieval

Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

The paper introduces SABER, a controlled benchmark exposing widespread attribute-object binding failures in multimodal retrievers, and shows that fine-tuning an MLLM-based embedder solely on synthetic attribute-binding text achieves SOTA on SABER while improving cross-modal and image-image retrieval without image supervision.

0 favorites 0 likes
#multimodal-retrieval

Chaos in the Text: Revealing the Modality Preference in Mixed-Modality Retrievers

Hugging Face Daily Papers ↗ · 2026-10-08 Cached

该论文系统研究了混合模态检索器的模态偏好问题,发现无关文本比无关图像对检索性能的干扰更严重(称为 "Chaos in the Text"),并提出 Trident 方法,通过 Multi-Positive View InfoNCE 联合优化文本、图像和融合视图来缓解该偏差。

0 favorites 0 likes
#multimodal-retrieval

SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions

Hugging Face Daily Papers ↗ · 2026-08-30 Cached

SnapBench introduces a paired corruption benchmark for robust snap-and-ask multimodal retrieval on mobile, revealing image noise as a key degradation factor and proposing an adaptive fusion method for modality reliability.

0 favorites 0 likes
#multimodal-retrieval

A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers

arXiv cs.CL ↗ · 2026-08-28 Cached

This paper proposes STeReO, a reranker for orchestrating heterogeneous speech and text retrievers to enhance Retrieval-Augmented Generation systems by improving evidence selection in multi-modality scenarios.

0 favorites 0 likes
#multimodal-retrieval

UMER: Unifying Embedding and Ranking via Pair-Aware Discriminative Reasoning for Universal Multimodal Retrieval

arXiv cs.AI ↗ · 2026-08-20 Cached

UMER introduces a unified framework for multimodal retrieval that combines embedding and ranking via pair-aware discriminative reasoning, achieving state-of-the-art performance on the MMEB-V2 benchmark.

0 favorites 0 likes
#multimodal-retrieval

Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval

Hugging Face Daily Papers ↗ · 2026-08-06 Cached

This paper introduces UniME-R1, an embedder-adviser framework for unified multimodal retrieval that generates Retrieval-Centric Chain-of-Thought (RC-CoT) conditioned on retrieval feedback, improving retrieval performance by learning from hard negatives.

0 favorites 0 likes
#multimodal-retrieval

Bayesian Data Reweighting Improves Multimodal Retrieval for Knowledge-Based Visual Question Answering

arXiv cs.LG ↗ · 2026-08-05 Cached

This paper introduces Bayesian Data Reweighting, a probabilistic framework that adaptively weights query-document pairs to mitigate false negatives in contrastive training, improving multimodal retrieval across multiple knowledge-based VQA benchmarks.

0 favorites 0 likes
#multimodal-retrieval

Evidence Attribution in Visual Document Understanding without Coordinates or Region Labels

Hugging Face Daily Papers ↗ · 2026-07-27 Cached

Introduces a language interface for visual evidence attribution in document understanding, using verbatim quotes instead of coordinate-based bounding boxes, achieving significantly higher evidence recall and lower attribution hallucination on CiteVQA.

0 favorites 0 likes
#multimodal-retrieval

Semantics-Enhanced Retrieval-Augmented Time Series Forecasting

arXiv cs.AI ↗ · 2026-06-16 Cached

Proposes SERAF, a multimodal retrieval-augmented framework for time series forecasting that uses both numerical similarity and self-generated textual descriptions to retrieve historical patterns, improving forecasting under non-stationarity. Experiments on seven real-world datasets show effectiveness over state-of-the-art baselines.

0 favorites 0 likes
#multimodal-retrieval

Fine-grained Fragment Retrieval in Multi-modal Long-form Dialogues

arXiv cs.CL ↗ · 2026-06-04 Cached

This paper introduces Fine-grained Fragment Retrieval (FFR), a new task for locating semantically coherent multi-modal fragments (text and images) within long-form dialogues. The authors propose F2RVLM, a generation-based retrieval model trained with reinforcement learning, and FFRS, a two-stage retrieval system, along with a new dataset MLDR for evaluation.

0 favorites 0 likes
#multimodal-retrieval

Your Embedding Model is SMARTer Than You Think

Hugging Face Daily Papers ↗ · 2026-05-24 Cached

SMART is a framework that unlocks latent multi-vector capabilities in single-vector models for multimodal retrieval, improving state-of-the-art performance with reduced computational costs via contrastive training and late-interaction inference.

0 favorites 0 likes
← Back to home

Submit Feedback