Finetuning a codegen model with python instruction set using QLORA technique for better efficacy
you can read more about this project in my blog series
- Fine Tuning LLM: Parameter Efficient Fine Tuning (PEFT) — LoRA & QLoRA — Part 1
- Fine Tuning LLM: Parameter Efficient Fine Tuning (PEFT) — LoRA & QLoRA — Part 2