Introduction

This is the official PyTorch implementation of ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer in CVPRW 2024. Our ShadowRefiner won the first place in the NTIRE 2024 Challenge on Shadow Removal Perceptual Track and won the second place in the NTIRE 2024 Challenge on Shadow Removal Fidelity Track. If you find this repo useful, please give it a star ⭐ and consider citing our paper in your research. Thank you.

NTIRE 2024 Award

 

 

Overall Framework

Results

Performance on ISTD, ISTD+, and WSRD+:

Performance on NTIRE 2024 Shadow Removal Challenge---Perceptual Track:

Performance on NTIRE 2024 Shadow Removal Challenge---Fidelity Track:

Create Environment

Dependencies and Installation

• Python 3.8
• Pytorch 1.11

1. Create Conda Environment

conda create --name shadowrefiner python=3.8
conda activate shadowrefiner

2. Install Dependencies

conda install pytorch=1.11 torchvision cudatoolkit=11.3 -c pytorch

pip install numpy matplotlib scikit-learn scikit-image opencv-python timm kornia einops pytorch_lightning

Datasets

ISTD Google Drive

ISTD+ Google Drive

WSRD+ Train_input, Train_gt, Validation_input, Validation_gt.

Pre-trained Model

• Our model for NTIRE 2024 Image Shadow Removal Challenge --- Fidelity Track & Perceptual Track.

Testing

Download above saved models and unzip it into the folder ./weights. To test the model, you need to specify the test dictionary (Line 15) and model path ( Line 34 and 41) in test.py. Then run

python test.py 

You can check the output in ../results.

Citation

If you find our work useful for your research, please consider citing our paper

@article{shadowrefiner_2024_cvprw,
    author    = {Dong, Wei and Zhou, Han and Tian, Yuqiong and Sun, Jingke and Liu, Xiaohong and Zhai, Guangtao and Chen, Jun},
    title     = {ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer},
    journal   = {arXiv preprint arXiv:2406.02559},
}

Contact

If you have any question, please feel free to contact us via [email protected].