-
Notifications
You must be signed in to change notification settings - Fork 463
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Declare optional packages to reduce package size #459
Comments
That's a great idea. @RunningLeon could you help support this feature? |
@gabrielfu hi, thanks for your suggestion. We'll consider your suggestion and try to come up with a good solution. |
@gabrielfu could you help check if PR #580 meets your request |
@lvhan028 Looks great to me. Will be even better if there's more documentations on which optional package provides which functionalities. Thanks a lot for the update! |
@gabrielfu hi, the installation infomation is updated in README.md. Any comment would be appreciated. |
Motivation
Currently running
pip install lmdeploy
installs everything like torch, triton, gradio, etc., which makes it very slow and occupies a lot of storage (especially if I'm building a docker image on top of it).In reality, I often only need the torch functionality and don't need triton.
It will be nice if I can choose what functionality I want to install:
Related resources
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: