video-understanding

Tag

Cards List
#video-understanding

Lab2Sim: Turning Real-World Experiment Videos into Interactive Virtual Experiments

Hugging Face Daily Papers ↗ · 2026-11-02 Cached

Lab2Sim introduces a benchmark of 218 science experiment videos with evidence-grounded specifications, along with EduVideo2Code, which encodes procedures as state machines to guide verified code generation for interactive virtual experiments, improving apparatus fidelity by 24.15 points.

0 favorites 0 likes
#video-understanding

Proactive Video Agents (22 minute read)

TLDR AI ↗ · 2026-10-28 Cached

Google 等机构提出 StreamVibe 框架,包含 StreamVibe-Bench 基准、StreamVibe-VL 流式主动模型与 StreamVibe-Harness 分层记忆机制,使视觉语言模型能从连续视频观测中推断隐式且动态变化的用户意图,并在响应时机与主动交互上分别提升 10.7% 和 12.3%。

0 favorites 0 likes
#video-understanding

@_akhaliq: StreamVibe Proactive Video Agents for Evolving User Intent paper: https://huggingface.co/papers/2610.34662…

X AI KOLs Timeline ↗ · 2026-10-27 Cached

StreamVibe introduces a benchmark (StreamVibe-Bench), a streaming proactive vision-language model (StreamVibe-VL), and a hierarchical memory harness to enable intent-aware interaction with implicit and evolving user goals, improving response quality by 10.7% over baselines and proactive interaction by 12.3%.

0 favorites 0 likes
#video-understanding

CodeCap-Bench: Can Code Serve as a Good Video Caption?

Hugging Face Daily Papers ↗ · 2026-10-27 Cached

CodeCap-Bench 提出用可执行代码作为视频字幕的新范式,构建了包含 323 个视频的基准来评估多模态大模型生成代码字幕的能力,结果显示代码字幕在推理和重建任务上优于自然语言,但现有模型在捕捉复杂时间动态方面仍存在不足。

0 favorites 0 likes
#video-understanding

HiP3R: Hierarchical Pose Graphs for Long-Horizon 3D Reconstruction

Papers with Code Trending ↗ · 2026-10-22 Cached

HiP3R 提出一种层级式位姿图方法,通过先优化块级 Sim(3) 图建立全局布局,再固定该布局估计每帧共享的 SE(3) 相机位姿,将局部视频重建合并为全局一致的相机轨迹和 3D 几何,无需重新训练。

0 favorites 0 likes
#video-understanding

LiquidAI/LFM3-VL-2B

Hugging Face Models Trending ↗ · 2026-10-19 Cached

Liquid AI 发布 LFM3-VL-2B,一款面向端侧视觉理解的 1.92B 视觉语言模型,支持文本、图像和视频输入,并引入视频理解、逐步思考以及空间与具身推理能力。

0 favorites 0 likes
#video-understanding

@HuggingPapers: Top AI Papers of The Week (October 12-18): - Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Di…

X AI KOLs Following ↗ · 2026-10-18 Cached

HuggingPapers 汇总了 10 月 12-18 日的热门 AI 论文,涵盖策略蒸馏、全模态视频理解、系统一模型、扩散模型强化及通用计算机使用开放栈等方向。

0 favorites 0 likes
#video-understanding

@leaf_sanren: OMG! The next big thing after Jev!! The Glimpse LLM!! It claims to focus on visual understanding and reasoning, natively grasping the positions and spatial relationships of elements in images and videos. As is not widely known, GPT and Claude models cannot understand videos at a fundamental level. They can only brute-force sample frames to understand content, but they are blind to temporal continuity. I…

X AI KOLs Following ↗ · 2026-10-18 Cached

The tweet introduces Glimpse, a new large model focused on visual understanding and reasoning, which claims to natively understand the positions and spatial relationships of elements in images and videos—unlike GPT and Claude, which rely on frame sampling—and expresses anticipation for more real-world evaluations.

0 favorites 0 likes
#video-understanding

@LinusEkenstam: Elorian’s first model, Glimpse, is built for Visual Thinking. Ask it questions about images and video, and it reasons t…

X AI KOLs Following ↗ · 2026-10-16 Cached

Elorian 发布首个视觉思考模型 Glimpse,能够对图像和视频进行推理,理解动作与变化,并有望自动化机器人遥操作数据的标注流程。

0 favorites 0 likes
#video-understanding

@rohanpaul_ai: Understanding a video means comparing moments, and models are getting much better at it. Glimpse from @ElorianAI checks…

X AI KOLs Timeline ↗ · 2026-10-16 Cached

ElorianAI 发布 Glimpse,其首个视觉思考模型,通过在视频中比较时间点之间的变化、可回溯源帧、裁剪区域、提取帧或运行代码来进行推理(visual scratch space),在关键视觉推理基准上具备与前沿模型 Astra 竞争的性能。

0 favorites 0 likes
#video-understanding

@svpino: You can show this model an image or a video, and it will answer any questions about it. It goes way beyond what frontie…

X AI KOLs Following ↗ · 2026-10-16 Cached

Andrew M. Dai 引用介绍了 Glimpse——首个视觉思考模型,能够理解图像与视频中的物体关系及随时间变化的动作,性能可与前沿模型 Astra 相媲美。

0 favorites 0 likes
#video-understanding

@Saccc_c: After Jev, I strongly recommend everyone to pay close attention to this newly released large model Glimpse—it successfu…

X AI KOLs Following ↗ · 2026-10-16 Cached

Elorian AI 发布首个视觉思考大模型 Glimpse,主打视频/图像的空间结构与动态理解,作者实测其在游戏验收与 bug 检测中的表现显著优于 Astra,并已开放 API 可集成进 Codex 等开发流程。

0 favorites 0 likes
#video-understanding

Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

Event-STVG 提出一个面向长视频事件推理的时空视频定位基准,包含跨足球等8个领域的4,016个标注事件;现有最强MLLM在10分钟时长上仅取得5.4% m-vIoU,凸显长上下文事件推理与多目标定位的显著挑战。

0 favorites 0 likes
#video-understanding

EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

EVA-Cap 提出一种事件中心的音视频视频描述框架,将描述分解为原子事件并通过 SFT 与 GRPO 优化对齐,在 ChronusAV 上平均提升 9.0%,在 WorldSense 上提升 3.3%。

0 favorites 0 likes
#video-understanding

Memory as Weights: Internalizing Long-Term History for Streaming Videos

Hugging Face Daily Papers ↗ · 2026-10-15 Cached

这篇论文提出 MaLoW(Memory as LoRA Weights),将流式视频的长期历史增量编码进固定大小的 LoRA 权重中,冻结主干模型并把当前观测保留在输入里,从而分离长期记忆与实时感知。该方法在 OVO-Bench 和 StreamingBench 上取得领先表现,并在机器人任务上也提升了成功率。

0 favorites 0 likes
#video-understanding

Google's Gemini 4 Argon takes #1 in understanding the physical world beyond what it sees. It can reconstruct past events, predict what happens next, and infer hidden objects and human intentions. Argon scored 59.1% on long videos, versus under 41% for rivals, while its spatial reasoning jumped 21 po

Reddit r/singularity ↗ · 2026-10-14

Google's Gemini 4 Argon reportedly takes the top spot in physical-world understanding, able to reconstruct past events, predict future outcomes, and infer hidden objects and human intentions. It scored 59.1% on long-video benchmarks versus under 41% for rivals, with a 21-point jump in spatial reasoning.

0 favorites 0 likes
#video-understanding

DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding

Hugging Face Daily Papers ↗ · 2026-10-14 Cached

DeltaStreamer是一个开源智能体,通过观察帧间变化、构建结构化文本记忆并在需要时回溯视觉证据,实现类人化的连续流式视频理解,在OVO-Bench和StreamingBench上超越多种现有方法。

0 favorites 0 likes
#video-understanding

OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

OmniCompass 提出了一个面向全模态视频定位与理解的整体基准,涵盖视觉-语言与音视频两条评测轨道,包含时间定位、空间定位与问答三类任务,并对50个多模态大模型进行了系统评估。研究发现开源模型在音视频理解上仍落后于闭源模型,精确的时间与空间定位对领先模型而言仍具挑战性。

0 favorites 0 likes
#video-understanding

VideoJev: System One Model for Video Understanding and Interaction

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

VideoJev提出System One范式的视频理解与交互模型家族,通过共享打分头替代自回归解码,统一时序定位与视频问答,并利用缓存和联合推理大幅提升效率。VideoJev-4B和VideoJev-35B-A3B在时序定位基准上显著超越骨干模型,视频问答推理加速超过100倍。

0 favorites 0 likes
#video-understanding

Decision 3.0: open, multimodal decision models from 0.6B to 27B. Ranks #1 on both Jev Decision Index boards

Reddit r/LocalLLaMA ↗ · 2026-10-12

The vLLM Semantic Router team released Decision 3.0 (d3), an open-source (Apache-2.0) multimodal decision model family from 0.6B to 27B that handles text, images, and video, ranking #1 on both Jev Decision Index boards with zero-shot video performance.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback