Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why should we even use adapter in image vit? #36

Open
jafarinia opened this issue Dec 24, 2023 · 0 comments
Open

Why should we even use adapter in image vit? #36

jafarinia opened this issue Dec 24, 2023 · 0 comments

Comments

@jafarinia
Copy link

The average running time for each epoch in full-tuning is 2 minutes and for adaptformer 2:30 on a single gpu device with RTX 3090 and the results (as we can see in your paper tables isn't that significantly better and even most of the times full-tuning is working better). This rises the question of why even care about using adapter and "small" number of tunable parameters in image vit? (even the ram difference isn't that significant (10GB adapter and 15GB full-tuning ))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant