What is Gemini Omni?

**TL;DR:** Gemini Omni is a Google AI tool that lets you transform video clips through natural language commands, changing scenes, objects, styles, and more — even using sketches as instructions. ## What Is Gemini Omni? Gemini Omni is a new video-editing capability that works with your own footage. As Sami from the Gemini Omni team explains, you can "shoot your own video and change the world however you want." The tool understands how to reinterpret and modify video content based on simple text prompts, multi-turn conversations, or even hand-drawn sketches. ## How It Works At its core, Gemini Omni takes a raw video clip and reimagines it. One example: a person is just drawing circles in the air. With Omni, that same footage becomes something entirely different — you can edit specific parts or change everything. "Your video can become something out of your imagination," Sami says. Another demonstration shows someone touching a mirror. Using Omni, they can "reimagine what happens next" — edit the action, change the style, or transform themselves into a completely new character. Multiple rounds of language-based instructions allow for fine-grained control. ## Examples in Action ### Violinist Transformation Take a video of a violinist playing. You can: - Change the background environment - Make the violin invisible - Alter the camera angle ### Sketch-Based Editing You can give Omni a sketch with visual instructions, and "it knows how to incorporate them into the full video." Because Omni is built on Gemini's world knowledge, it does things previous models struggled with — for example, generating an object for every letter of the alphabet from a single video clip. ## Capabilities - **Modify specific parts** – change just one element while keeping the rest intact. - **Change everything** – completely transform the scene and subject. - **Edit actions** – replace a motion or gesture. - **Alter style** – shift the visual aesthetic (e.g., realistic to cartoon). - **Multi-turn instructions** – refine the video through successive commands. - **Sketch input** – use a drawing as a guide for the transformation. ## Try It Yourself These examples only scratch the surface. Sami invites users to experiment: "Try it out today. What will you use it for? Let us know in the comments below." **Source:** [What is Gemini Omni? - YouTube](https://www.youtube.com/watch?v=uW4B6ziQqvY)