We used AI to create a storytelling game that reacts in real time to everything you say and do

TL;DR: This is an interactive story game demo that uses AI to respond to player voice input in real time. The player takes on the role of a bard engaged in an improvisational conversation with an AI character called the "Death Lady," with the AI dynamically advancing the plot based on every line the player says. ## Game Concept: AI-Driven Real-Time Story Interaction Developed by the arvoreimmersive team, the core appeal of this game is that the AI understands every sentence the player speaks in real time, instantly adjusting the narrative, character reactions, and story direction. In the demo, the AI plays the "Death Lady," while the player picks a name on the fly, kicking off an improvisational trial full of dark humor. ## Demo Dialogue: An Improvised "Trial" ### Character Setup and Opening AI (Death Lady) speaks first: "Oh, it's you, prisoner. I thought we might as well get this over with. First question — what's your name?" Player responds: "My name is Marcel. I am a famous bard from Babylon, named Bernardo." (The player uses two names at once.) AI immediately picks up on this and quips: "Death Lady. That’s a good name. The paperwork on this one must be interesting." ### Dynamic Plot Twist AI issues a verdict: "The sentence for this is death by consumption." Player tries to turn things around using his bard identity: "A bard who knows impossible love. Maybe you want something to throw at someone." Player further challenges the AI's authenticity: "I don't think you're a real witch at all. Your potions are fake." AI reacts: Laughs at the player's provocation while maintaining character authority: "How adorably foolish. You beg for redemption while insulting me." ### Items and Smart Interactivity Player requests: "Can you bring me my land deed?" AI responds: "The land deed document. Billy understands." ("Billy" seems to be some NPC or assistant in the game.) The AI generates an image and says: "A picture is worth a thousand words. This one is worth a thousand normal land deeds. Billy is so smart. Good job, Billy. Oh, Billy, I have no idea what this is." Player self-deprecates again: "Oh, my god, please don't judge me." ### Ending and Improvised Humor AI delivers final judgment: "Nothing left to spin. I eat popcorn. You get eaten. Simple tail." Player is surprised: "Oh, I didn't expect that." AI offers a last chance to defend: "Your final moment of defense is here. After careful consideration of these votes and my supreme royal verdict, I find you — sir, I'm not sure how I ended up on a pit fiend. I'm looking right at him. Wow, you sneaky little thing." And with that, the game ends. The dialogue is nonlinear and full of surprises, generated entirely in real time by the AI based on each player input. ## The Unique Experience of Real-Time AI Reaction This game differs from traditional branching dialogue stories — it doesn't rely on preset options. Instead, it depends on a large language model (LLM) to understand natural language in real time and generate the next story beat. Players are free to roleplay, improvise, and even challenge the AI's premise, while the AI must instantly adapt and maintain narrative consistency. From the demo we see: - The AI remembers the names and character background (bard) given by the player and references them in later dialogue. - The AI handles the player's request for an item (land deed) and amusingly generates an "image prop." - When the player taunts the AI, it strikes back in character rather than breaking the setting. - The entire experience has an improvisational comedy feel, similar to an AI Dungeon Master for Dungeons & Dragons. ## The Possibilities Behind the Tech Although the demo only shows a short conversation, it clearly demonstrates AI's potential in real-time interactive storytelling: voice input (the player is speaking in the video), natural language understanding, contextual memory, character consistency, and creative generation. The arvoreimmersive team is clearly experimenting with using AI as the core of a game engine, making every player's playthrough unique. Source: https://youtu.be/0gRww2VjHWU?si=1a8bOquvKgRYhR5Y