-
Notifications
You must be signed in to change notification settings - Fork 188
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
update merge weights , suit for DB-GPT
- Loading branch information
1 parent
b8a2a98
commit def504d
Showing
3 changed files
with
19 additions
and
8 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,8 +1,19 @@ | ||
# llama2 series | ||
python dbgpt_hub/train/export_model.py \ | ||
--model_name_or_path Your_base_model_path_like_Baichuan2-13B-Chat \ | ||
--template Your_template_like_baichuan2_eval \ | ||
--model_name_or_path /home/LLM/CodeLlama-13b-Instruct-hf \ | ||
--template llama2 \ | ||
--finetuning_type lora \ | ||
--checkpoint_dir Your_ckpt_path_checkpoint-100 \ | ||
--output_dir Your_export_model_like_output_merge_model_baichuan2-13b-qlora_merge \ | ||
--checkpoint_dir dbgpt_hub/output/adapter/CodeLlama-13b-sql-lora \ | ||
--output_dir dbgpt_hub/output/codellama-13b-sql-sft \ | ||
--fp16 | ||
# --bf16 | ||
|
||
|
||
## Baichuan2 | ||
# python dbgpt_hub/train/export_model.py \ | ||
# --model_name_or_path Your_base_model_path_like_Baichuan2-13B-Chat \ | ||
# --template Your_template_like_baichuan2_eval \ | ||
# --finetuning_type lora \ | ||
# --checkpoint_dir Your_ckpt_path_checkpoint-100 \ | ||
# --output_dir Your_export_model_like_output_merge_model_baichuan2-13b-qlora_merge \ | ||
# --fp16 | ||
# # --bf16 |