Google DeepMind's GameNGen Simulates DOOM at 20 FPS with AI

Aug 28, 2024, 07:05 AM

Google, through its DeepMind division, has unveiled GameNGen, a pioneering game engine powered entirely by a neural model, allowing for real-time interaction with complex environments. This innovative engine can simulate the classic game DOOM at over 20 frames per second on a single TPU. GameNGen utilizes diffusion models, typically used in AI image generation, to predict the next frame, effectively enabling the creation of a playable game without a traditional game engine. The engine is trained using reinforcement learning models to play existing games, and diffusion models to generate frames based on past sequences and actions. This development marks a significant advancement in AI-driven gaming technology, showcasing the potential for creating dynamic and interactive 3D worlds.