lora finutune QWen2.5 0.5B use CPU lora微调QWen2.5 0.5B训练使用了cpu，怎么修改为使用cuda #5794
Unanswered
a-drop-in-the-ocean456
asked this question in
Q&A
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Reminder
System Info
python 3.9 , llamafactory 0.9.1.dev0
CUDA_VISIBLE_DEVICES=0 llamafactory-cli train examples/train_lora/qwen2_5_0_5b_lora_sft.yaml
Reproduction
python3.9/site-packages/transformers/trainer.py:3276: FutureWarning: torch.cpu.amp.autocast(args...) is desprecated
Expected behavior
solve the question
Others
No response
Beta Was this translation helpful? Give feedback.
All reactions