NotImplementedError: Cannot copy out of meta tensor; no data!

[Steindox]

I use Autoawq to quantize Llama3.2 and Llama 3.1, and it appears problem
NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

and I try change self._model.to(device) to self._model.to_empty(device),but it does not work

Traceback (most recent call last):
。...
  File "anaconda3/envs/lmeval/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1333, in convert
    raise NotImplementedError(
NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

[baberabb]

Hi! Can you load the model through transformers, separate from this library?