issues installing aimet version 1.34 when installing with downloaded whl files

[mylifeasazucchini]

I have previously been using AIMET 1.31 and wanted to upgrade to the latest v1.34 but after making sure I have the right version of torch-gpu and appropriate cuda version when I try to install the wheel file I get the error:

pip3 install --no-index --no-deps aimet_torch-1.34.0.cu117-cp310-cp310-manylinux_2_34_x86_64.whl

and then I get the error:

ERROR: Invalid requirement: 'aimet-torch==1.34.0.cu117': Expected end or semicolon (after version specifier)
    aimet-torch==1.34.0.cu117
               ~~~~~~~~~~^

This was with pip v 24.2

I also tried a lower version of pip 24.0 and 23.2, 23.0.1 (this last one was what I used with AIMET 1.31) but then I get the error:

ERROR: aimet_torch-1.34.0.cu117-cp310-cp310-manylinux_2_34_x86_64.whl is not a supported wheel on this platform.

My OS is Ubuntu 20.04.6 LTS. Can you please help me solve this or point me in a direction so that I can resolve it ?

[quic-hitameht]

Hi @mylifeasazucchini Thanks for reporting this issue. The compatible version of pip is pip==24.0. It looks like -f <URL> is missing from the install instructions. Can you please add -f https://download.pytorch.org/whl/torch_stable.html to pip install command.

[hundunaning]

My method is to rename the whl file to aimet_torch-1.34.0+cu117-cp310-cp310-manylinux_2_34_x86_64.whl

[ZakeyShi]

I encountered the same issue while installing aimet today and successfully installed it through some effort.

Let me share below to help those who encounter the same issue to resolve it.

Check your pip version

As mentioned by @quic-hitameht , the currently compatible pip version for aimet is pip<=24.0.

So if you see a version greater than 24.0 by executing pip list | grep pip, you need to downgrade pip in your Python environment using pip install pip==23.0.

I believe this can solve the following issue.

ERROR: Invalid requirement: 'aimet-torch==1.34.0.cu117': Expected end or semicolon (after version specifier)
    aimet-torch==1.34.0.cu117

Check your OS and Python version

Currently, AIMET supports two versions: Ubuntu 22.04 LTS and Ubuntu 20.04 LTS. The former requires the installation of Python 3.10, while the latter requires Python 3.8. You need to check whether the system and the installed Python version are compatible.

cat /etc/os-release  # check OS
python --version     # check Python

[Optional] Check your CUDA Driver version

You should use nvida-smi to check your CUDA Driver version, then install an aimet version that is lower than the driver version, if you want to use GPU.

I think the following error is most likely due to incompatibility between the OS version, Python version, and CUDA version.

ERROR: aimet_torch-1.34.0.cu117-cp310-cp310-manylinux_2_34_x86_64.whl is not a supported wheel on this platform.

My case

OS version:                         Ubuntu 20.04.6 LTS
Python version:                                 3.8.20
CUDA Driver Version:                              11.7

I found that the aimet version that supports my case is 1.31.0.

When installing aimet using pip, I found that it first checks whether PyTorch is installed, which might result in an error.

To resolve this issue, you need to first install the version of PyTorch that is compatible with version 1.31.0 in your environment manually.

pip install torch==1.13.1+cu116 torchvision==0.14.1+cu116 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu116

After that, execute the following aimet installation command, and everything works fine.

pip install https://github.com/quic/aimet/releases/download/1.31.0/aimet_torch-torch_gpu_1.31.0-cp38-cp38-linux_x86_64.whl