-
Notifications
You must be signed in to change notification settings - Fork 695
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use external deps for safetensors and tokenizers in Transformers-4.29.2 #20868
base: develop
Are you sure you want to change the base?
Use external deps for safetensors and tokenizers in Transformers-4.29.2 #20868
Conversation
I'll try to get the safetensors 0.3.1 version working instead, but it might be difficult if it's already broken. |
I need to verify that this works correctly before i mark this non-draft |
Test report by @Micket |
AS far as i can tell, these all look fine, safetensors should support all the backends, numpy, torch, tensorflow, jax |
@boegelbot please test @ generoso |
@Micket: Request for testing this PR well received on login1 PR test command '
Test results coming soon (I hope)... - notification for comment with ID 2181560553 processed Message to humans: this is just bookkeeping information for me, |
Test report by @boegelbot |
@boegelbot please test @ jsc-zen3 |
@Micket: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de PR test command '
Test results coming soon (I hope)... - notification for comment with ID 2181615101 processed Message to humans: this is just bookkeeping information for me, |
Test report by @boegelbot |
(created using
eb --new-pr
)see #20718