@_philschmid: Gemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick…
Summary
Gemini now offers agentic video understanding, enabling iterative navigation and adaptive processing to reduce token usage and costs while boosting accuracy in video analysis.
View Cached Full Text
Cached at: 09/02/26, 09:53 AM
Gemini video understanding is now agentic. Gemini can now iteratively navigate video timelines, decide watch what, pick frame rates, or chooses whether it needs speech transcripts, audio, or visual frames to answer your prompt.
Result: Long videos get up to 88% fewer tokens and 66% lower costs, with ~7% higher accuracy on benchmarks.
How it works:
- Receives a lightweight URI reference (Files API or YouTube) and loads content via tool.
- Scans speech transcripts to pinpoint relevant moments before fetching visual frames.
- Navigates key timestamps and picks its own frame rate (0.1 or 10 FPS).
- Pulls audio tracks directly when acoustic cues matter.
Set processing="agentic"on video to enable. Keep static (none) for videos under 2 minutes. Available today in the Gemini API and Google AI Studio across Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash Lite. http://ai.dev/learn/agentic-video-understanding-with-gemini…
Similar Articles
Introducing agentic video understanding with Gemini
Google DeepMind introduces agentic video understanding for Gemini models, reducing token consumption by up to 88% and improving accuracy in video analysis.
@Saboo_Shubham_: Agentic video understanding with Gemini 3.7 Flash is HUGE. Just reduced cost, less tokens, and higher accuracy. No bigg…
The tweet highlights that agentic video understanding with Gemini 3.7 Flash significantly reduces costs, lowers token usage, and improves accuracy.
Adding Gemini Omni edit calls as a deterministic step in agent video pipelines
The article discusses using Gemini Omni's edit mode as a deterministic transformation step in agent video pipelines, enabling reproducible state changes without full video regeneration, improving cost and speed.
@_philschmid: "Make it day time." The lighting shift, the shadows move, the sky changes. Gemini Omni Flash can edit your videos throu…
Google's Gemini Omni Flash model can edit videos through conversational prompts, using the Interactions API to generate new clips based on user descriptions.
Gemini api showing agentic gemini models
Google's Gemini API now exposes agentic models, enabling developers to build autonomous AI agents with enhanced reasoning and action capabilities.