Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated TensorRT to v8.2.1 #4603

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

stemann
Copy link
Contributor

@stemann stemann commented Mar 12, 2022

Awaiting #4347 and #4602

@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch 2 times, most recently from d9eebee to b2f11bf Compare March 14, 2022 15:25
@stemann
Copy link
Contributor Author

stemann commented Mar 14, 2022

This (and #4604 and #4605) fails due to CUDNN_jll v8.2.1 not having a mapping for CUDA 11.5. @maleadt Should CUDNN v8.2.1 actually have such a mapping?

TensorRT v8.2.1 - v8.2.3 is tested with CUDNN v8.2.1 - and is said to support CUDA 11.5: https://docs.nvidia.com/deeplearning/tensorrt/release-notes/tensorrt-8.html#rel-8-2-1

CUDNN v8.3.2 (and CUDA 11.6) is used for testing TensorRT starting from v8.4.0.

@maleadt
Copy link
Contributor

maleadt commented Mar 14, 2022

CUDNN 8.2.1 only supports up to CUDA 11.3, I think. Or at least that was the supported release back when that version of CUDNN was released.

@stemann
Copy link
Contributor Author

stemann commented Mar 14, 2022

CUDNN 8.2.1 only supports up to CUDA 11.3, I think. Or at least that was the supported release back when that version of CUDNN was released.

Right: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-824/support-matrix/index.html
v8.2.1 - CUDA 11.3: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-821/support-matrix/index.html
v8.2.2 added CUDA 11.4: https://docs.nvidia.com/deeplearning/cudnn/archives/cudnn-822/support-matrix/index.html
v8.2.3: No archived support matrix.

So really our CUDNN v8.2.1 should not have built an 11.4, but only 11.3 and then TensorRT v8.2+ must use a newer CUDNN for build when building for CUDA 11.4+ platforms.

@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch from bdc673f to d43bb3c Compare March 16, 2022 07:59
@stemann stemann force-pushed the feature/tensorrt_8_2_1 branch from d43bb3c to a76bb31 Compare March 18, 2022 01:57
@stemann stemann marked this pull request as ready for review March 18, 2022 01:57
@stemann stemann marked this pull request as draft March 18, 2022 08:27
@ViralBShah ViralBShah closed this Apr 19, 2022
@ViralBShah
Copy link
Member

Superseded by #4604 I suppose.

@stemann
Copy link
Contributor Author

stemann commented Apr 19, 2022

@ViralBShah I know that this and #4604 seemed like stale PR's, but this PR in particular is the only version to support CUDA 10.2 on aarch64-linux-gnu, so can we please reopen this?

I will just check that #4386 can work with this packaging of TensorRT and then get this, #4604 and #4605 merged.

@giordano giordano reopened this Apr 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants