The paper is currently under review in IEEE Transactions on Image Processing and available on arXiv:
https://arxiv.org/abs/2406.11284
If you use any of the code or data, please cite
@article{sippel2024,
title={Multispectral Snapshot Image Registration Using Learned Cross Spectral Disparity Estimation and a Deep Guided Occlusion Reconstruction Network},
author={Sippel, Frank and Seiler, Jürgen and Kaup, André},
journal={arXiv preprint arXiv:2406.11284},
year={2024}
}
conda create -n msir python=3.11
conda activate msir
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
conda install imageio
conda install matplotlib
conda install scipy
pip install opencv-python-headless
pip install timm==0.5.4
An environment file is provided as well.
To run the code, simply acivate the anaconda environment and execute
python run.py
Then, the three real-world scenes of the paper are registered.