video-captioning

Tag

Cards List
#video-captioning

EgoCaptioner: Towards Comprehensive and Fine-Grained Egocentric Video Captioning

Hugging Face Daily Papers ↗ · 3d ago Cached

The paper presents EgoCaptioner, a coarse-to-fine egocentric video captioning framework that combines video-level overviews with timestamped, perception-adaptive step narration, trained with GRPO using factual and temporal rewards, achieving leading results on five egocentric benchmarks and surpassing proprietary baselines like Gemini 3.1 Pro on PhysCapBench.

0 favorites 0 likes
#video-captioning

whisper base and an 11M param BERT i distilled from a 2B model, both running in the browser to caption videos

Reddit r/LocalLLaMA ↗ · 5d ago

The creator built CueCaps Studio, a browser-based video captioning tool running Whisper base via transformers.js with WebGPU/WASM fallback, plus an 11M-param BERT tagger distilled from LFM3-Omni-2B that handles emphasis, line breaks, and punctuation.

0 favorites 0 likes
#video-captioning

Reviso: Not All Visual Evidence Deserves Equal Attention in Video Captioning

Hugging Face Daily Papers ↗ · 2026-11-02 Cached

Reviso is an agentic video captioning framework that uses hierarchical Context-Focus-Points planning and active perception to prioritize key visual evidence, trained with GRPO and specialized rewards, outperforming open-source baselines on four video captioning benchmarks.

0 favorites 0 likes
#video-captioning

Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPU

Reddit r/LocalLLaMA ↗ · 2026-10-27

LFM3-VL-2B 视觉语言模型可在浏览器中通过 WebGPU 本地实时进行视频字幕生成,LiquidAI 还发布了对应的 Hugging Face 模型集合与在线演示。

0 favorites 0 likes
#video-captioning

CodeCap-Bench: Can Code Serve as a Good Video Caption?

Hugging Face Daily Papers ↗ · 2026-10-27 Cached

CodeCap-Bench 提出用可执行代码作为视频字幕的新范式,构建了包含 323 个视频的基准来评估多模态大模型生成代码字幕的能力,结果显示代码字幕在推理和重建任务上优于自然语言,但现有模型在捕捉复杂时间动态方面仍存在不足。

0 favorites 0 likes
#video-captioning

Reading Less While Writing: A Closed-Form Bandwidth Dial for Streaming Multimodal Decoders

arXiv cs.CL ↗ · 2026-09-21 Cached

The paper introduces ZENDAYA, a closed-form bandwidth dial for streaming multimodal decoders that dynamically adjusts input reading to improve real-time text generation performance. It demonstrates that reducing input consumption can enhance quality and efficiency in streaming settings across video and audio benchmarks.

0 favorites 0 likes
#video-captioning

RefCaptioner: Multi-Reference Image-Grounded Video Captioning

Hugging Face Daily Papers ↗ · 2026-07-30 Cached

Introduces multi-reference image-grounded video captioning and proposes RefCaptioner, a two-stage post-training framework with mixed-data SFT and hierarchical coverage-discounted GRPO. The paper also presents MRVBench, a benchmark for evaluating caption factuality and multi-reference grounding.

0 favorites 0 likes
#video-captioning

PEEK: Picking Essential frames via Efficient Knowledge distillation

Hugging Face Daily Papers ↗ · 2026-05-29 Cached

Introduces PEEK, an efficient dynamic frame sampling method that distills caption-conditioned frame relevance rankings from a teacher model into a lightweight temporal model, outperforming state-of-the-art methods in video captioning while maintaining computational efficiency.

0 favorites 0 likes
#video-captioning

NemoStation/Marlin-2B

Hugging Face Models Trending ↗ · 2026-05-13

NemoStation/Marlin-2B is a fine-tuned model based on Qwen3.5-2B for video-text-to-text tasks, supporting video captioning and temporal grounding.

0 favorites 0 likes
← Back to home

Submit Feedback