Inference Time

[AnasAlsharo]

Hi.

I am running the inference using app.py. The inference would take 30 seconds in the first run for the image I provide. However, it starts to take longer and sometimes up to 4 minutes for the same image when I run the inference again. I clear the GPU memory and keep facing the same issue of increased run time.

[haodong2000]

Hi @AnasAlsharo , thanks for interests!

The inference time comparison in Fig. 3 (https://arxiv.org/html/2409.18124v4/x4.png) is conducted w/o any I/O process including the loading of the model.

At the first run, the app will download all the diffusion ckpts, which may take some time.

And in the following runs, the inference should be faster than the first run~