Tag
The paper presents EgoCaptioner, a coarse-to-fine egocentric video captioning framework that combines video-level overviews with timestamped, perception-adaptive step narration, trained with GRPO using factual and temporal rewards, achieving leading results on five egocentric benchmarks and surpassing proprietary baselines like Gemini 3.1 Pro on PhysCapBench.
The creator built CueCaps Studio, a browser-based video captioning tool running Whisper base via transformers.js with WebGPU/WASM fallback, plus an 11M-param BERT tagger distilled from LFM3-Omni-2B that handles emphasis, line breaks, and punctuation.
Reviso is an agentic video captioning framework that uses hierarchical Context-Focus-Points planning and active perception to prioritize key visual evidence, trained with GRPO and specialized rewards, outperforming open-source baselines on four video captioning benchmarks.
LFM3-VL-2B 视觉语言模型可在浏览器中通过 WebGPU 本地实时进行视频字幕生成,LiquidAI 还发布了对应的 Hugging Face 模型集合与在线演示。
CodeCap-Bench 提出用可执行代码作为视频字幕的新范式,构建了包含 323 个视频的基准来评估多模态大模型生成代码字幕的能力,结果显示代码字幕在推理和重建任务上优于自然语言,但现有模型在捕捉复杂时间动态方面仍存在不足。
The paper introduces ZENDAYA, a closed-form bandwidth dial for streaming multimodal decoders that dynamically adjusts input reading to improve real-time text generation performance. It demonstrates that reducing input consumption can enhance quality and efficiency in streaming settings across video and audio benchmarks.
Introduces multi-reference image-grounded video captioning and proposes RefCaptioner, a two-stage post-training framework with mixed-data SFT and hierarchical coverage-discounted GRPO. The paper also presents MRVBench, a benchmark for evaluating caption factuality and multi-reference grounding.
Introduces PEEK, an efficient dynamic frame sampling method that distills caption-conditioned frame relevance rankings from a teacher model into a lightweight temporal model, outperforming state-of-the-art methods in video captioning while maintaining computational efficiency.
NemoStation/Marlin-2B is a fine-tuned model based on Qwen3.5-2B for video-text-to-text tasks, supporting video captioning and temporal grounding.