Skip to content

Latest commit

 

History

History
43 lines (29 loc) · 3.73 KB

README.md

File metadata and controls

43 lines (29 loc) · 3.73 KB
Raw

DeepFillv1 (CVPR'2018)

Generative Image Inpainting with Contextual Attention

Abstract

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create distorted structures or blurry textures inconsistent with surrounding areas. This is mainly due to ineffectiveness of convolutional neural networks in explicitly borrowing or copying information from distant spatial locations. On the other hand, traditional texture and patch synthesis approaches are particularly suitable when it needs to borrow textures from the surrounding regions. Motivated by these observations, we propose a new deep generative model-based approach which can not only synthesize novel image structures but also explicitly utilize surrounding image features as references during network training to make better predictions. The model is a feed-forward, fully convolutional neural network which can process images with multiple holes at arbitrary locations and with variable sizes during the test time. Experiments on multiple datasets including faces (CelebA, CelebA-HQ), textures (DTD) and natural images (ImageNet, Places2) demonstrate that our proposed approach generates higher-quality inpainting results than existing ones.

Results and models

Places365-Challenge

Method Mask Type Resolution Train Iters Test Set l1 error PSNR SSIM Download
DeepFillv1 square bbox 256x256 3500k Places365-val 11.019 23.429 0.862 model | log

CelebA-HQ

Method Mask Type Resolution Train Iters Test Set l1 error PSNR SSIM Download
DeepFillv1 square bbox 256x256 1500k CelebA-val 6.677 26.878 0.911 model | log

Citation

@inproceedings{yu2018generative,
  title={Generative image inpainting with contextual attention},
  author={Yu, Jiahui and Lin, Zhe and Yang, Jimei and Shen, Xiaohui and Lu, Xin and Huang, Thomas S},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={5505--5514},
  year={2018}
}