Skip to content

Model Card: Google DeepMind Genie 4

Nov 3, 20261 min
TL;DRGenie 4 launched 2026-10-27 as a real-time interactive world model (not a text LLM). It is the first in the Genie line to natively generate ambient sound, music, and interactive dialogue, and the biggest leap is how characters move and react. Gemini 3.8 Flash runs in the generation loop as a director, breaking goals into steps and checking progress frame by frame. Access is trusted-tester-only for now, with Project Genie and Gemini API early access still coming soon; there is no public pricing, no API model ID, and no official benchmark scores. Object permanence and legible text remain known weak points.

Look up & save

Loading dictionary…

🌏 中文版

Model Info

ItemValue
Model IDNot disclosed (no public API identifier)
VendorGoogle DeepMind
ParametersNot disclosed
Context WindowNot applicable (a real-time interactive world model, not a text-generation model; the underlying architecture is undisclosed)
Input Price (USD/1M tokens)Not disclosed (no API, no published pricing)
Output Price (USD/1M tokens)Not disclosed (no API, no published pricing)
Open sourceNo (research preview, no open weights)
Release date2026-10-27
Official announcementGoogle DeepMind Blog, Google Blog
FamilyGenie (Genie 1 → 2 → 3 → 4)

Key Capabilities

  • First in the Genie line to natively generate audio: ambient sound, music, and interactive dialogue are produced in sync with the visuals, with no separate audio model
  • People are the biggest leap this generation: characters move naturally, react to their surroundings, and can be steered interactively while a scene is running
  • Gemini 3.8 Flash runs in the loop as a "director": it breaks a user's goal into multiple steps, keeps reviewing incoming frames to confirm each step succeeded, and replans the moment the scene shifts or the user intervenes
  • Integrated with Gemini 4 Argon and Gemini Robotics for robot scenario generation — the published demo is Apptronik's Apollo humanoid playing a game of checkers

The "director" role Gemini 3.8 Flash plays inside the generation loop is, concretely, a cycle of decomposing steps, checking frames, and replanning when needed:

Gemini-in-the-loop: the step-decomposition and verification cycle behind a world model
Gemini-in-the-loop: the step-decomposition and verification cycle behind a world modelGemini 3.8 Flash breaks a user's goal into steps and drives Genie 4's rendering; it checks each step against the frames it sees, replans and re-renders when a step fails or the scene changes, and only calls the task done once every step has succeeded. Gemini 3.8 Flash decomposes the plan Genie 4 renders video + audio, live Step succeeded? frame-checked Replan scene/user change Next step left? multi-step task Task done next prompt no re-render yes step left none (done)
  1. Gemini 3.8 Flash breaks down the steps and drives Genie 4 to render frames and audio
  2. Gemini keeps watching the frames to check whether this step succeeded
  3. If it didn't succeed, or the scene changed, or the user stepped in — replan and go back to Genie 4 to re-render
  4. If it succeeded, check whether there is a next step
  5. If there is, go back to decomposing; only once every step succeeds is the task done

Simplified from Google DeepMind's and DataCamp's description of Genie 4's "multi-step events planned by Gemini" mechanism; the actual loop internals are undisclosed.

Benchmarks

⚠️ The official announcement includes no benchmark scores or quantitative comparison against other world models, and as of 2026-10-28 no independent third-party evaluation or score reproduction had surfaced either (source: DataCamp's writeup on Genie 4). The table below lists verifiable capability and limitation differences instead — it is not a quantitative benchmark:

DimensionGenie 3 (released 2025-08)Genie 4 (released 2026-10-27)
AudioNo native audioFirst to natively generate ambient sound, music, and interactive dialogue
Visual specs24 fps, 720p, coherent for a few minutesNo published fps/resolution figures
Multi-step reasoningNo built-in reasoning loopGemini 3.8 Flash runs in the loop, decomposing and verifying steps
AccessLimited preview for academics and creatorsTrusted testers first; Project Genie and Gemini API partners "coming soon"
Known weaknessesLimited action space, multi-agent interaction, real-world location accuracy, text legibility, interaction capped at a few minutesObject permanence and visual detail still drift over long sessions; complex physical interactions, real-time audio accuracy, legible text, spatial accuracy

Versus the Predecessor / Competitors

The qualitative shift from Genie 3 is that people now move and talk. Genie 3's demos were mostly about environments and ecosystems — water, lighting, plants and animals — with character interaction never the focus. DeepMind explicitly calls people "the most dramatic leap" in Genie 4: characters react naturally and can be steered into live dialogue, something none of the earlier generations did. The other difference is the reasoning layer: Genie 4 wires Gemini 3.8 Flash into the generation loop, so for the first time a world model has a "director" checking whether the task is actually progressing through its steps, instead of relying on pixel generation alone to stay coherent.

No other lab has shipped a comparable real-time, natively-audio interactive world model to compare it against directly, and both the official announcement and third-party coverage (DataCamp, dev.to) are explicit that Genie 4 has no public benchmarks, pricing, or API model ID; as of 2026-10-28 it is also absent from both OpenRouter and models.dev. In other words, Genie 4 is still a research preview, not a product that can be directly scored against alternatives — any claim about how much stronger it is than its predecessor can only be judged from the official demos, and DeepMind itself cautions that those demos are curated takes and should be read as a ceiling, not an average.

What It Means for Agent Development

Genie 4 pushes "world model" a step further, from pure scene generation toward a "training environment with a built-in reasoning loop." Having Gemini 3.8 Flash decompose tasks and verify progress inside the loop effectively moves the plan-and-verify pattern agent builders already use into the world model itself, without needing a separate orchestrator to check simulation progress.

  • If you're training robots or embodied agents: the Genie 4 + Gemini Robotics combination is worth watching — it demonstrates decomposing a humanoid robot task (like playing chess) into multi-step scenes to rehearse in an imagined environment before touching real hardware. DeepMind hasn't quantified how well behavior learned in a Genie 4 scene transfers to physical robots, though, so this isn't yet something to base a decision on
  • If you're building agent evaluation or sandbox environments: the Genie line has long been positioned as a safe practice ground for agents (Genie 3 was tested with the SIMA agent). If Genie 4's multi-step consistency holds up, it could eventually replace some hand-built simulation environments — but for now only trusted testers have access, and everyone else is stuck on the Project Genie / Gemini API waitlist
  • Not a fit for: anything that needs to run stably for a long time (object permanence drifts over time), applications that need precise real-world locations, or scenes that need legible text — DeepMind is explicit these are open research problems, not nearly-fixed bugs

Today's Takeaway

I used to assume "world models" and "conversational models" were two parallel technical tracks, each filling in the other's gaps. Wiring Gemini 3.8 Flash directly into the generation loop as a "director" shows those two tracks are starting to converge: the world model handles real-time video and audio generation, while the language model plans the narrative and verifies progress behind the scenes. That division of labor arrived earlier than I expected, and it matches DeepMind's own stated direction toward "hybrid world models."

References