README.md

GAN Prior Embedded Network for Blind Face Restoration in the Wild

Paper | Supplementary | Demo

Tao Yang¹, Peiran Ren¹, Xuansong Xie¹, Lei Zhang^1,2
1DAMO Academy, Alibaba Group, Hangzhou, China
²Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China

Face Restoration

Face Colorization

Face Inpainting

Conditional Image Synthesis (Seg2Face)

News

(2021-07-06) The training code will be released soon. Stay tuned.

Usage

• Clone this repository:

git clone https://github.com/yangxy/GPEN.git
cd GPEN

• Download RetinaFace model and our pre-trained model (not our best model due to commercial issues) and put them into weights/.

  RetinaFace-R50 | GPEN-BFR-512 | GPEN-BFR-512-D | GPEN-BFR-256 | GPEN-Colorization-1024 | GPEN-Inpainting-1024 | GPEN-Seg2face-512

• Restore face images:

python face_enhancement.py

• Colorize faces:

python face_colorization.py

• Complete faces:

python face_inpainting.py

• Synthesize faces:

python segmentation2face.py

Main idea

Citation

If our work is useful for your research, please consider citing:

@inproceedings{Yang2021GPEN,
    title={GAN Prior Embedded Network for Blind Face Restoration in the Wild},
    author={Tao Yang, Peiran Ren, Xuansong Xie, and Lei Zhang},
    booktitle={IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
    year={2021}
}

License

© Alibaba, 2021. For academic and non-commercial use only.

Acknowledgments

We borrow some codes from Pytorch_Retinaface and stylegan2-pytorch.

Contact

If you have any questions or suggestions about this paper, feel free to reach me at [email protected].