[Usage] Error during evaluation for image.../image.png: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

[ChathurangiShyalika]

Issue: I’m evaluating a set of images using LLAVA. I'm encountering this error and it happens intermittently. The evaluation works fine for the first image but fails for the second. I'm running this on an V100 GPU. The current output is as follows. Please provide a solution for this issue. Thank you

Output:

----------------------------
image_path /../image_1.png
Response: Classification is No.
----------------------------
image_path /../image_2.png
Error during evaluation for image /../image_2.png: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)
----------------------------
image_path /../image_3.png
Response: Classification is No.
----------------------------
image_path /../image_4.png
Error during evaluation for image /../image_2.png: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)