This repository has been archived by the owner on Jan 24, 2024. It is now read-only.

Loading basaran on multiple gpus leads to error #280

Open

tanmaylaud opened this issue Nov 30, 2023 · 0 comments

Labels

question

tanmaylaud commented Nov 30, 2023

Getting error:
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!

I am running basaran with default params and llama 2 model.

peakji added the question label

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.