nv-tlabs / Gamma-World
PublicImplementation of Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players
Gamma-World is a research project from NVIDIA and the University of Toronto that creates AI systems capable of generating interactive video simulations where multiple agents (players, robots, or characters) can act independently within a shared world. The system takes inputs from multiple agents and predicts what happens next, maintaining consistency across all perspectives. It can scale from two to four or more agents without retraining, and is designed to work in real-time for gaming and robotics applications.
How It Works
You come across a research project from NVIDIA and University of Toronto that generates interactive video games where multiple players or robots can act together in the same shared world.
You picture yourself controlling multiple characters or robots that all exist in the same evolving environment, each moving independently while the world stays consistent around them.
The system takes actions from multiple agents and generates smooth, coherent future frames showing what happens next in the shared world - like watching a movie where you control all the characters.
Create multiplayer games where AI characters respond to player actions in real-time
Test robot coordination scenarios in simulated environments before real-world deployment
You dive into the academic paper to understand how the system works under the hood, learning about the clever techniques that make multi-agent world modeling possible.
The team has announced that training scripts, dataset tools, and the streaming version will be released soon, so you bookmark the page and check back later.
Once the code is released, you'll be able to create your own multi-agent simulations where multiple characters or robots interact in a consistent, evolving world.
Star Growth
Repurpose is a Pro feature
Generate ready-to-use prompts for X threads, LinkedIn posts, blog posts, YouTube scripts, and more -- with full repo context baked in.
Unlock RepurposeSimilar repos coming soon.