Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inference is taking too much time. #34

Open
sanjay-nit opened this issue Sep 11, 2023 · 0 comments
Open

Inference is taking too much time. #34

sanjay-nit opened this issue Sep 11, 2023 · 0 comments

Comments

@sanjay-nit
Copy link

I tested the same piece of code on google colab on A100 GPU and there it is taking only 0.5 sec to 1 sec. But when I try the exactly same code on banana's GPU it is taking around 6 to 7 seconds. I kept all packages use the same version as colab. But still taking that much time.

Is there anything else I should consider specific to banana?
I'm expecting a quick response. Thanks!!
Also I increased minimum-replicas but it didn't help.
I can share the code if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant