Matrix-Game 2.0

Matrix-Game 2.0 is a 1.8-billion-parameter generative world model built on a Multimodal Diffusion Transformer (DiT) architecture, released by Skywork AI on August 12, 2025, as the second iteration of its Matrix-Game series. The model architecture moves away from text-prompt dependency and instead operates on visual content and user action inputs. A 3D Causal VAE compresses spatial and temporal dimensions for efficient modeling; the DiT backbone combines vision encoding with keyboard and mouse action commands to generate frame-by-frame dynamic video sequences; and a Self-Forcing autoregressive training strategy enables real-time streaming output at 25 FPS while minimizing latency and error accumulation across long sequences. The model was trained on approximately 1,200 hours of gameplay footage from Unreal Engine and GTA 5, enabling generalization across general-purpose 3D environments. Users provide a starting image and a sequence of action inputs—movement, interaction, and camera control—and the model predicts successive frames in real time, producing a navigable virtual environment without a traditional game engine. A streaming inference mode supports continuous long-form generation with stable scene coherence extending to several minutes. Browse alternatives. The full inference pipeline, YAML-configurable scripts, FlashAttention support, and pre-trained model weights are available on GitHub and Hugging Face under the project's open-source license. AI and game development researchers use Matrix-Game 2.0 as a baseline for studying interactive world model behavior, physics-aware generalization, and real-time autoregressive generation. Game developers use the model to prototype exploreable environments from a single concept image without requiring an engine, level assets, or physics scripting. Embodied AI and robotics teams use it to generate diverse training environments for autonomous agent navigation research. Virtual humans and metaverse content teams reference the model as a technical foundation for interactive spatial content generation. Skywork AI positions the release as an open-source counterpart to Google DeepMind's Genie 3, which demonstrated similar capabilities but has not been released publicly See top alternatives.