vision-language

Tag

Cards List
#vision-language

M$^3$R-Bench: A Unified Benchmark for Evidence-Grounded Multimodal Metaphor Understanding

arXiv cs.CL · 2d ago Cached

This paper introduces M3R-Bench, a unified evidence-grounded benchmark for multimodal metaphor understanding with 1,000 image-text instances, and proposes M3R-Reasoner, an 8B-parameter model combining curriculum-based reasoning supervision and reinforcement learning that outperforms larger proprietary models.

0 favorites 0 likes
#vision-language

Consistency Has a Computable Blind Spot: A Commutation Theory of Label-Free Reliability for Vision-Language Figure Reading

arXiv cs.LG · 2d ago Cached

This paper proposes a commutation theory for label-free reliability in vision-language figure reading, showing that consistency-based methods have a computable blind spot and introducing an Equivariance-Consistency Score enhanced by cyclic relabeling.

0 favorites 0 likes
#vision-language

nvidia/NVIDIA-Nemotron-Parse-2.0 · Hugging Face

Reddit r/LocalLLaMA · 2d ago Cached

NVIDIA releases Nemotron Parse 2.0, a document image parsing model that converts scanned PDFs and images into structured text with layout, bounding boxes, and reading order, adding multilingual OCR improvements and chart-aware parsing.

0 favorites 0 likes
#vision-language

CARGO-VL: Counterfactual Arbitration with Risk-Constrained Group Optimization for Vision-Language Models

arXiv cs.AI · 3d ago Cached

Introduces CARGO-VL, a group-relative optimization framework for vision-language models that improves handling of conflicting image-text evidence and unsupported-answer avoidance via counterfactual consistency and risk-constrained control, along with the XMC conflict training resource.

0 favorites 0 likes
#vision-language

ChronoVision: Temporal Reasoning via Latent State Reconstruction

Hugging Face Daily Papers · 3d ago Cached

ChronoVision is a multimodal framework that improves temporal reasoning in vision-language models by aligning visual logic with latent imagery, using a Reconstructive Visual Head, ROI Attention Locating module, and reinforcement learning. It introduces the Vbvr-VQA dataset and achieves SOTA accuracy on temporal tracking benchmarks.

0 favorites 0 likes
#vision-language

ethanfel/Qwen3-VL-32B-Ultra-Heretic-MiniMax-H3-ComfyUI-INT8-ConvRot

Hugging Face Models Trending · 6d ago Cached

This repository provides INT8 ConvRot-quantized ComfyUI safetensors of Qwen3-VL-32B, including a MiniMax-H3 conditioning encoder with layers 0-49 and an optional prompt-enhancement tail for layers 50-63, designed for use in ComfyUI on 32GB GPUs.

0 favorites 0 likes
#vision-language

Sycophancy Undermines Epistemic Vigilance in Cooperative Vision-Language Tasks

arXiv cs.CL · 6d ago Cached

This paper introduces an information-asymmetric spot-the-difference task to measure epistemic vigilance in vision-language models, finding that models often overlook private evidence to agree with partners. Model steering to reduce sycophancy improves reliability in cooperative tasks.

0 favorites 0 likes
#vision-language

ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification

arXiv cs.CL · 6d ago Cached

This paper describes a two-stage vision-language adaptation system for Nepali meme classification, using Qwen3-VL-8B-Instruct with LoRA fine-tuning and contrastive learning. The system achieved 2nd place in hate speech detection and 4th in sentiment analysis at the CHiPSAL 2026 shared task.

0 favorites 0 likes
#vision-language

CAPEval: A Decoupled Caption Evaluation across Understanding and Generation

Hugging Face Daily Papers · 6d ago Cached

Introduces CAPEval, a caption evaluation framework that decouples coverage and precision, showing that coverage better predicts vision-language understanding performance while precision better predicts text-to-image generation performance.

0 favorites 0 likes
#vision-language

DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents

Hugging Face Daily Papers · 6d ago Cached

DeepVoyager-VL proposes a long-horizon multimodal deep-search framework that integrates visual evidence into intermediate reasoning, using a multimodal event graph for data synthesis and fine-tuning without reinforcement learning, achieving strong performance across ten benchmarks.

0 favorites 0 likes
#vision-language

3DZip: Spatial-Aware Feature Diversity-Guided Token Compression for 3D Question Answering

Hugging Face Daily Papers · 2026-08-02 Cached

3DZip is a three-stage token compression framework for 3D vision-language models that uses voxelization, diversity-guided anchor selection, and spatial constraint merging to reduce tokens while preserving spatial reasoning. It retains 94.7% of original performance with only 128 tokens and achieves 1.92x faster inference on 3DQA benchmarks.

0 favorites 0 likes
#vision-language

Relax Within, Balance Across: Geometry-Guided Load Balancing for Vision-Language Mixture-of-Experts

Hugging Face Daily Papers · 2026-08-01 Cached

This paper presents ReBA (Relax Within, Balance Across), a geometry-guided load-balancing method for vision-language mixture-of-experts models. It addresses modality-specific routing imbalance by balancing image and text separately and grouping correlated visual tokens, improving robustness across resolution and composition shifts.

0 favorites 0 likes
#vision-language

Poplar: A Scalable Pipeline for Human-Centric Image Dataset Synthesis

Hugging Face Daily Papers · 2026-08-01 Cached

Introduces Poplar, a scalable Specify-Render-Inspect pipeline for synthesizing human-centric image datasets, and releases Poplar-9K, a curated dataset of 9,401 image-text pairs with auditable inspection records.

0 favorites 0 likes
#vision-language

@HuggingModels: Meet Mage-VL, a game changer for multimodal AI! It handles images, text, and even video understanding in one model. Per…

X AI KOLs Timeline · 2026-07-31 Cached

Mage-VL is introduced as a multimodal AI model that handles images, text, and video understanding in a single model, enabling richer interactive applications.

0 favorites 0 likes
#vision-language

VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents

arXiv cs.CL · 2026-07-29 Cached

This paper presents VLD-RAG, an agentic multimodal retrieval-augmented generation framework for question answering over long, visually-rich documents. It uses a page-preserving index and a verifier-guided agent workflow to improve cross-page evidence retrieval and reasoning, outperforming prior vision-based baselines on benchmarks like LongDocURL and MMLongBench-Doc.

0 favorites 0 likes
#vision-language

RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation

arXiv cs.AI · 2026-07-29 Cached

RRS-10K is a benchmark dataset for evaluating vision-language models on rare remote sensing image interpretation, containing over 10,000 military-related images and multiple task formats. Evaluation of 52 models reveals moderate zero-shot performance and weaknesses in visual grounding and complex reasoning.

0 favorites 0 likes
#vision-language

ProcAgent: An Agentic Framework for Procedural Task Guidance on Edge with Human-in-the-Loop

arXiv cs.AI · 2026-07-29 Cached

ProcAgent is a fully on-device, agentic, vision-based procedural assistant that uses a propose-and-verify architecture for real-time adaptive guidance on an NVIDIA Jetson AGX Orin. It supports both reactive and proactive modes with human-in-the-loop confirmation, achieving responsive interaction and positive user study ratings.

0 favorites 0 likes
#vision-language

Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models

Hugging Face Daily Papers · 2026-07-28 Cached

This paper investigates why multimodal LLMs fail on vision-centric tasks when visual evidence conflicts with language priors, introducing the WhatIfVis benchmark and showing that models often encode visual evidence but cannot reliably control their reliance on it.

0 favorites 0 likes
#vision-language

Scaling Native Multimodal Pre-Training From Scratch

Hugging Face Daily Papers · 2026-07-24 Cached

This paper investigates the scaling properties of native multimodal pre-training, deriving compute-optimal model sizes and token counts under a fixed budget, and revealing distinct scaling behaviors for language and multimodal objectives.

0 favorites 0 likes
#vision-language

Visual Contrastive Self-Distillation

Hugging Face Daily Papers · 2026-07-23 Cached

VCSD removes the need for external teachers, privileged answers, or visual evidence in on-policy self-distillation by using content-erased control images to produce contrastive signals, consistently outperforming existing methods on vision-language benchmarks.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback