Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pin hf transformers and accelerate to latest release, don't reinstall pytorch #859

Closed
wants to merge 7 commits into from
+11 −18
Closed

pin hf transformers and accelerate to latest release, don't reinstall pytorch #859

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
aabb54f
pin hf transformers and accelerate to latest release, don't reinstall…
winglian Nov 15, 2023
83517c6
remove peft manual install, remove xformers fix
winglian Nov 15, 2023
c9bd5c4
bump flash-attn to 2.3.3
winglian Nov 15, 2023
2b55458
reinstall flash-attn on each e2e test
winglian Nov 15, 2023
4df258b
try building flash-attn from source for e2e tests
winglian Nov 15, 2023
69b0239
uninstall flash-attn first
winglian Nov 15, 2023
f3674de
lazy load optimum bettertransformers
winglian Nov 15, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
bump flash-attn to 2.3.3
@winglian
winglian committed Nov 15, 2023
commit c9bd5c40ff3933b5edf6c8976d31f4dbb136a95d
2 changes: 1 addition & 1 deletion requirements.txt
View file
Original file line number Diff line number Diff line change
@@ -10,7 +10,7 @@ addict
fire
PyYAML>=6.0
datasets
flash-attn>=2.3.0
flash-attn>=2.3.3
sentencepiece
wandb
einops