add gptqmodel support

[jiqing-feng]

Support gptqmodel, we plan to replace autogptq by gptqmodel in the future.

[BenjaminBossan]

Thanks for this PR to add support for gptqmodel. Let's wait for the transformers PR to be merged before proceeding with this one.

[jiqing-feng]

Thanks for this PR to add support for gptqmodel. Let's wait for the transformers PR to be merged before proceeding with this one.

Hi @BenjaminBossan , there is a weird pytest error I never met,

(idp) root@sprocean:/home/jiqingfe/peft# pytest
ERROR: usage: pytest [options] [file_or_dir] [file_or_dir] [...]
pytest: error: unrecognized arguments: --cov=src/peft --cov-report=term-missing
  inifile: /home/jiqingfe/peft/pyproject.toml
  rootdir: /home/jiqingfe/peft

(idp) root@sprocean:/home/jiqingfe/peft# pip list | grep peft
peft                        0.13.3.dev0            /home/jiqingfe/peft

The pytest works only when I removed this code
Do you know why it happens?

[jiqing-feng]

Testing changes contain:

1. Remove gpu limitation for gptq tests.
2. GPTQ lib: @require_gptq means we can run these tests with gptqmodel or auto-gptq

For gptq testing:

pytest tests/test_gpu_examples.py::PeftGPTQGPUTests
pytest tests/test_common_gpu.py::PeftCommonTests::test_lora_gptq_quantization_from_pretrained_safetensors

[BenjaminBossan]

there is a weird pytest error I never met,

This comes from a pytest plugin we use to monitor code coverage. Running python -m pip install pytest-cov should fix that for you.

(btw. code coverage is great to check if the new code you added is covered by unit tests)

[Qubitium]

@BenjaminBossan This PR is ready and tested under cpu, intel/xpu, and nvidia/cuda. However, please note this PR is 1 of 3 in a cumulative set of 3 prs where the primary PR is in Optimum PR huggingface/optimum#2064 (awaiting review/approval) while this and Transformer PR huggingface/transformers#35012 are dependent on getting the Optimum PR merged first.

[BenjaminBossan]

Thanks for the update. Let's wait for the optimum and the transformers PRs to be merged first, since changes there could affect this PR. Feel free to ping me as soon as those PRs were merged.