Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ludwig Installation Not Working #4025

Open
abedkhooli opened this issue Aug 27, 2024 · 8 comments
Open

Ludwig Installation Not Working #4025

abedkhooli opened this issue Aug 27, 2024 · 8 comments
Labels
bug Something isn't working dependency llm Large Language Model related

Comments

@abedkhooli
Copy link

Tried !pip install ludwig[llm] on both Colab and Kaggle. Then, could not import from the api:
from ludwig.api import LudwigModel
[OSError: /opt/conda/lib/python3.10/site-packages/torchtext/lib/libtorchtext.so: undefined symbol: _ZN5torch6detail10class_baseC2ERKSsS3_SsRKSt9type_infoS6_](https://download.pytorch.org/models/text/%3C/span%3E%3Cspan)
Issue seems related to `torchtext' (0.18.0 gets installed). Tried with 0.17.0 and got

AttributeError: module 'torch.library' has no attribute 'register_fake'

Basically, torch and related libraries issues.

@iterniter
Copy link

pip uninstall ludwig torch torchtext
pip install torch==2.0.1 torchtext==0.15.2

@abedkhooli
Copy link
Author

@iterniter Did you test it on Colab? Do you mean w/out ludwig in first line?
Still error with torch._custom_ops missing.

@alexsherstinsky alexsherstinsky added the llm Large Language Model related label Sep 6, 2024
@amansinghlegitt3110
Copy link

is this issue resolved i am still getting it on collab

@amansinghlegitt3110
Copy link

Tried !pip install ludwig[llm] on both Colab and Kaggle. Then, could not import from the api: from ludwig.api import LudwigModel [OSError: /opt/conda/lib/python3.10/site-packages/torchtext/lib/libtorchtext.so: undefined symbol: _ZN5torch6detail10class_baseC2ERKSsS3_SsRKSt9type_infoS6_](https://download.pytorch.org/models/text/%3C/span%3E%3Cspan) Issue seems related to `torchtext' (0.18.0 gets installed). Tried with 0.17.0 and got

AttributeError: module 'torch.library' has no attribute 'register_fake'

Basically, torch and related libraries issues.

have yo resolved this

@mhabedank
Copy link
Collaborator

Hi @amansinghlegitt3110 thanks for your report. Can you share the notebook on kaggle or colab?

We are currently undergoing an organizational transition with this project and Unfortunately, there was hardly any time to take care of the code base in the last few month. We hope that we will be able to resume work in the next few weeks.

@mhabedank mhabedank self-assigned this Oct 16, 2024
@mhabedank
Copy link
Collaborator

@ethanreidel @skanjila looks like it's related to the whole dependency topic. Furthermore torchtext development is stoped. Looks like we have to find an alternative somewhen.

@mhabedank mhabedank removed their assignment Oct 21, 2024
@mhabedank mhabedank added bug Something isn't working dependency labels Oct 21, 2024
@mhabedank
Copy link
Collaborator

@amansinghlegitt3110 could you please try to use torchtext 0.17.2? In our setup that worked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dependency llm Large Language Model related
Projects
None yet
Development

No branches or pull requests

6 participants