[Feature] Support for arm64 for CUDA (immich-machine-learning)

[gowthamravichandran]

I have searched the existing feature requests to make sure this is not a duplicate request.

• Yes

The feature

Docker Image for immich-machine-learning-cuda does not support arm64 processors at the moment.

Get the following message when trying to pull ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-cuda

no matching manifest for linux/arm64/v8 in the manifest list entries

Running immich in arm64 processor with cuda enabled gpus like Nvidia Jetson devices isnt possible and is currently forced to use the cpu instead of gpu.

Can we support a docker image for cuda enabled arm64 processors?

Platform

• Server
• Web
• Mobile

[mertalev]

Good point! We can add arm64 as a target for the CUDA image.

[mertalev]

Can you all clarify which Jetson model you have? It seems the older models like the Jetson Nano are using outdated kernels and only support old CUDA versions. Jetsons compatible with JetPack 5 (CUDA 11.4) are okay, but even that is a bit problematic in the long-term.

[daco-tech]

Hello @mertalev, yes, I have the old (but cheapest) Jetson Nano 4Gb.
Distro: Ubuntu 18.04 bionic
CPUs: 4 (aarch64)
RAM: 4.0GB
Kernel: 4.9.337-tegra
Jetpack: 4.6.5 (L4T 32.7.5)

Thank you!

Daniel

[gowthamravichandran]

I use Jetson Orin

CPU(s): 12 (aarch64)
RAM: 64GB
Kernel: 5.10.104-tegra
Jetpack: 5.1

[mattias-pp]

Hello @mertalev , wondering if you made any progress on this? Thanks!

[mertalev]

Sorry, I haven't had the time. The PR is #12456 if anyone wants to rebase and test it.

[bogdanr]

I would also like to use this on Jetson. I have the newer one (Jetson Orin Nano). 5.15.148-tegra kernel with Jetpack 6.1.

[mpalitto]

I have too the old (but cheapest) Jetson Nano 4Gb.
Distro: Ubuntu 18.04 bionic
CPUs: 4 (aarch64)
RAM: 4.0GB
Kernel: 4.9.337-tegra
Jetpack: 4.6.5 (L4T 32.7.5)

[afsy-d]

Also looking forward to this being an option!

Jetson Orin NX
Distro Ubuntu 20.04
CPUs: 8
RAM: 16GB
Kernel: 5.10.192-tegra
Jetpack: Jetpack 5.1.3

[mattias-pp]

Any update on this?

Jetson Xavier AGX
Linux version 5.10.216-tegra