vlms

Tag

Cards List
#vlms

How Robust Is Multimodal Claim Verification to LLM Rewriting?

arXiv cs.CL ↗ · 2026-10-05 Cached

This paper studies how multimodal claim verification models respond to stylistic text changes induced by LLM rewriting. Evaluating 11 open-weight VLMs (2B–38B), the authors find accuracy is largely robust to natural rewriting and controlled LLM-word injection, though hedging-oriented modifications cause consistent probability shifts across nearly all models.

0 favorites 0 likes
#vlms

MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents

Hugging Face Daily Papers ↗ · 2026-10-05 Cached

MemPilot is a framework that uses reinforcement learning to dynamically curate multimodal memory for LLM agents on demand, balancing performance, cost, and latency via adaptive retrieval and heterogeneous model selection. Experiments across five benchmarks show it achieves better performance-cost-latency trade-offs than existing trade-off-aware baselines.

0 favorites 0 likes
#vlms

OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

Hugging Face Daily Papers ↗ · 2026-09-30 Cached

OSWorld-Science introduces a benchmark and evaluation environment for computer-using VLM agents on scientific software, covering 146 expert-designed tasks across domains like molecular drawing, pathology imaging, statistics, and physical simulation with artifact-based evaluators and a special agent harness.

0 favorites 0 likes
#vlms

@beingamanFF: Our system paper is accepted at @emnlpmeeting @SHROOM_ST 2026, the shared task on hallucination detection in VLMs, host…

X AI KOLs Timeline ↗ · 2026-09-11 Cached

A system paper on hallucination detection in Vision-Language Models has been accepted at EMNLP 2026 for the SHROOM shared task, hosted at the UncertaiNLP workshop, focusing on marking and labeling hallucinated character spans in VLM outputs.

0 favorites 0 likes
#vlms

Feature Recovery for Object Understanding After Irreversible Fire Damage

Hugging Face Daily Papers ↗ · 2026-09-10 Cached

This paper introduces TRACE, a benchmark for post-fire object understanding, and proposes a Feature Recovery Module (FRM) to restore degraded features and improve detection and vision-language tasks under severe physical damage.

0 favorites 0 likes
#vlms

Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning

Hugging Face Daily Papers ↗ · 2026-08-27 Cached

This paper introduces an agentic framework combining LLMs and VLMs for consistent multi-instruction video editing across multiple shots, and proposes the MMLVE task and benchmark to evaluate performance.

0 favorites 0 likes
#vlms

Beyond Tokens: A Survey on Decoding Methods for Large Language and Vision-Language Models

arXiv cs.CL ↗ · 2026-08-18 Cached

This survey paper reviews decoding methods for large language models and vision-language models, focusing on inference-time approaches to enhance efficiency and control generation. It identifies paradigms, highlights challenges, and discusses future research directions.

0 favorites 0 likes
#vlms

Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence

Hugging Face Daily Papers ↗ · 2026-08-13 Cached

This paper introduces Spatial Memory Agent (SMA), a runtime framework that improves frozen vision-language models' spatial reasoning through verifier-guided reflection and reusable memory without parameter updates or external tools, achieving strong results across five benchmarks and four base VLMs.

0 favorites 0 likes
#vlms

@MSFTResearch: A path, a fence, a knot. MindTopo sets a new benchmark for testing how AI understands topological relationships and hig…

X AI KOLs Timeline ↗ · 2026-08-12 Cached

Microsoft Research introduces MindTopo, a benchmark that tests whether multimodal AI models understand topological relationships like connectivity, enclosure, and knots. Current models perform well on static recognition but struggle with interactive planning tasks, revealing a key gap for robotics and interactive environments.

0 favorites 0 likes
#vlms

I compared even more parsers on 14 PDF-parsing capabilities using different types

Reddit r/LocalLLaMA ↗ · 2026-08-06

A benchmark comparing 8 PDF parsers across 14 capabilities, finding Chandra the most accurate while noting trade-offs like speed; LightOnOCR-1B impresses for its size but hallucinates on illegible text.

0 favorites 0 likes
#vlms

GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?

Hugging Face Daily Papers ↗ · 2026-08-06 Cached

GST-Bench is a new VQA benchmark for evaluating global spatial awareness in video understanding, testing whether VLMs can build coherent global scene representations from long-horizon egocentric video. Evaluation of 22 state-of-the-art VLMs shows a large gap versus humans, with the best model scoring 42.68 vs 79.08.

0 favorites 0 likes
#vlms

OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models

Hugging Face Daily Papers ↗ · 2026-07-30 Cached

OSReward introduces a standardized benchmark for evaluating VLM judges on computer-use agent trajectories, revealing that even state-of-the-art models have systematic leniency bias. The authors release OS-Shepherd-9B and 35B reward models that provide reliable, low-cost rewards for CUA tasks.

0 favorites 0 likes
#vlms

@jerryjliu0: You don't need heavyweight VLMs to OCR simple text-only PDFs. Doing that is like bringing a bazooka to a knife-fight, a…

X AI KOLs Following ↗ · 2026-07-08 Cached

LlamaIndex announces improved routing in LlamaParse that selects lightweight parsing for simple text-heavy PDFs and heavier VLM-based parsing for complex pages with tables or charts, optimizing cost and accuracy.

0 favorites 0 likes
#vlms

Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions

Hugging Face Daily Papers ↗ · 2026-06-08 Cached

Z-Reward is a teacher-student framework that decouples complex reasoning from efficient reward deployment for text-to-image training. It achieves 89.6% human preference accuracy with a 27B teacher and 88.6% with a 9B student, outperforming prior methods.

0 favorites 0 likes
#vlms

@jerryjliu0: Our team is at CVPR 2026 if you want to come say hi :)

X AI KOLs Following ↗ · 2026-06-04 Cached

Jerry Liu's team is presenting ParseBench, a comprehensive document understanding benchmark for VLMs, at CVPR 2026. The benchmark includes 2,000 pages of real-world enterprise documents with evaluation metrics for tables, charts, and visual grounding.

0 favorites 0 likes
#vlms

Decomposing how prompting steers behavior

arXiv cs.AI ↗ · 2026-06-03 Cached

This paper introduces a nested geometric decomposition framework to analyze how prompting reorganizes internal representations in large language and vision-language models. The authors show that affine transformations, particularly cross-dimensional linear mixing, are key to explaining prompt-induced behavioral changes.

0 favorites 0 likes
#vlms

Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving

arXiv cs.CL ↗ · 2026-05-25 Cached

Fast-dDrive is a block-diffusion VLA model for end-to-end autonomous driving that achieves state-of-the-art trajectory accuracy while delivering over 12x throughput speedup over autoregressive baselines, addressing the trade-off between high-fidelity planning and efficient inference for edge deployment.

0 favorites 0 likes
#vlms

SPACENUM: Revisiting Spatial Numerical Understanding in VLMs

arXiv cs.AI ↗ · 2026-05-25 Cached

This paper presents SpaceNum, a unified framework to evaluate how vision-language models (VLMs) understand numerical values in spatial contexts, finding that current models largely fail to ground numbers spatially and often perform close to random guessing.

0 favorites 0 likes
#vlms

GridProbe: Posterior-Probing for Adaptive Test-Time Compute in Long-Video VLMs

Hugging Face Daily Papers ↗ · 2026-05-11 Cached

GridProbe is a training-free inference paradigm for Long-Video VLMs that adaptively selects relevant frames using posterior probing, achieving sub-quadratic attention costs with minimal accuracy loss.

0 favorites 0 likes
#vlms

GeoStack: A Framework for Quasi-Abelian Knowledge Composition in VLMs

Hugging Face Daily Papers ↗ · 2026-05-07 Cached

GeoStack introduces a geometric framework to compose independently trained domain experts in Vision-Language Models without catastrophic forgetting, achieving constant-time inference and a 10x reduction in geometric error.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback