New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create vocabulary from pretrained models #91

Open

torymur opened this issue Nov 18, 2024 · 0 comments · May be fixed by #88

Assignees

Labels

documentation enhancement testing

Contributor

torymur commented Nov 18, 2024

Extend vocabulary with the ability to self-create from pre-trained models from Hugging Face.

torymur added the enhancement label

torymur self-assigned this

torymur mentioned this issue

Change vocabulary interface #92

Open

torymur added documentation testing labels

torymur linked a pull request

that will close this issue

Extend Vocabulary #88

Open

4 tasks

rlouf mentioned this issue

Move TransformersTokenizer back to the Python package #81

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment