-
Notifications
You must be signed in to change notification settings - Fork 9
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
2 changed files
with
39 additions
and
11 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,16 +1,36 @@ | ||
# GameNGen | ||
|
||
We present GameNGen, the first game engine powered entirely by a neural model | ||
**Diffusion Models Are Real-Time Game Engines**\ | ||
Dani Valevski, Yaniv Leviathan, Moab Arar, Shlomi Fruchter\ | ||
Paper: [https://arxiv.org/abs/2408.14837](https://arxiv.org/abs/2408.14837) | ||
|
||
## Abstract | ||
|
||
We present _GameNGen_, the first game engine powered entirely by a neural model | ||
that enables real-time interaction with a complex environment over long trajectories at high quality. | ||
GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single | ||
TPU. GameNGen simulations do not suffer from accumulated deterioration even after long play sessions, | ||
_GameNGen_ can interactively simulate the classic game DOOM at over 20 frames per second on a single | ||
TPU. _GameNGen_ simulations do not suffer from accumulated deterioration even after long play sessions, | ||
achieving a PSNR of 29.4, comparable to lossy JPEG compression. | ||
Human raters are only slightly better than random chance at distinguishing short clips of the game | ||
from clips of the simulation. | ||
GameNGen is trained in two phases: | ||
_GameNGen_ is trained in two phases: | ||
(1) an RL-agent learns to play the game and the training sessions are recorded, and | ||
(2) a diffusion model is trained to produce the next frame, conditioned on the sequence of past frames and | ||
actions. Conditioning augmentations enable stable auto-regressive generation over long trajectories. | ||
|
||
## Acknowledgments | ||
## Citation | ||
|
||
```bibtex | ||
@misc{valevski2024diffusionmodelsrealtimegame, | ||
title={Diffusion Models Are Real-Time Game Engines}, | ||
author={Dani Valevski and Yaniv Leviathan and Moab Arar and Shlomi Fruchter}, | ||
year={2024}, | ||
eprint={2408.14837}, | ||
archivePrefix={arXiv}, | ||
primaryClass={cs.LG}, | ||
url={https://arxiv.org/abs/2408.14837}, | ||
} | ||
``` | ||
|
||
### Acknowledgments | ||
This page was built using the [Academic Project Page Template](https://github.com/eliahuhorwitz/Academic-project-page-template) which was adopted from the [Nerfies](https://nerfies.github.io) project page. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters