Google and DeepMind's GameNGen AI Engine Simulates DOOM at 20 FPS in Real-Time

Aug 28, 2024, 12:37 PM

Google, in collaboration with DeepMind, has unveiled GameNGen, a groundbreaking game engine powered entirely by a neural model, marking a significant advancement in AI-generated gaming. GameNGen utilizes diffusion models to enable real-time interaction with complex environments, allowing it to simulate the classic game DOOM at over 20 frames per second on a single TPU. This innovation eliminates the need for traditional game engines, as the AI predicts the next frame based on previous ones and player actions. The model was trained using reinforcement learning gameplay videos and Stable Diffusion 1.4, showcasing impressive consistency in generating playable game sequences. Users can explore a 3D interactive world crafted by AI in real time.