Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update tensorrt requirement from ==8.5.3.* to ==10.6.0.* in /docker/tensorrt #15127

Open
wants to merge 1 commit into
base: dev
Choose a base branch
from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Nov 22, 2024

Updates the requirements on tensorrt to permit the latest version.

Changelog

Sourced from tensorrt's changelog.

TensorRT OSS Release Changelog

10.6.0 GA - 2024-11-05

Key Feature and Updates:

  • Demo Changes

    • demoBERT: The use of fcPlugin in demoBERT has been removed.
    • demoBERT: All TensorRT plugins now used in demoBERT (CustomEmbLayerNormDynamic, CustomSkipLayerNormDynamic, and CustomQKVToContextDynamic) now have versions that inherit from IPluginV3 interface classes. The user can opt-in to use these V3 plugins by specifying --use-v3-plugins to the builder scripts.
      • Opting-in to use V3 plugins does not affect performance, I/O, or plugin attributes.
      • There is a known issue in the V3 (version 4) of CustomQKVToContextDynamic plugin from TensorRT 10.6.0, causing an internal assertion error if either the batch or sequence dimensions differ at runtime from the ones used to serialize the engine. See the “known issues” section of the TensorRT-10.6.0 release notes.
      • For smoother migration, the default behavior is still using the deprecated IPluginV2DynamicExt-derived plugins, when the flag: --use-v3-plugins isn't specified in the builder scripts. The flag --use-deprecated-plugins was added as an explicit way to enforce the default behavior, and is mutually exclusive with --use-v3-plugins.
    • demoDiffusion
      • Introduced BF16 and FP8 support for the Flux.1-dev pipeline.
      • Expanded FP8 support on Ada platforms.
      • Enabled LoRA adapter compatibility for SDv1.5, SDv2.1, and SDXL pipelines using Diffusers version 0.30.3.
  • Sample Changes

    • Added the Python sample quickly_deployable_plugins, which demonstrates quickly deployable Python-based plugin definitions (QDPs) in TensorRT. QDPs are a simple and intuitive decorator-based approach to defining TensorRT plugins, requiring drastically less code.
  • Plugin Changes

    • The fcPlugin has been deprecated. Its functionality has been superseded by the IMatrixMultiplyLayer that is natively provided by TensorRT.
    • Migrated IPluginV2-descendent version 1 of CustomEmbLayerNormDynamic, to version 6, which implements IPluginV3.
      • The newer versions preserve the attributes and I/O of the corresponding older plugin version.
      • The older plugin versions are deprecated and will be removed in a future release.
  • Parser Changes

    • Updated ONNX submodule version to 1.17.0.
    • Fixed issue where conditional layers were incorrectly being added.
    • Updated local function metadata to contain more information.
    • Added support for parsing nodes with Quickly Deployable Plugins.
    • Fixed handling of optional outputs.
  • Tool Updates

    • ONNX-Graphsurgeon updated to version 0.5.3
    • Polygraphy updated to 0.49.14.

10.5.0 GA - 2024-09-30

Key Features and Updates:

  • Demo changes
  • Sample changes
    • None
  • Plugin changes
    • Migrated IPluginV2-descendent versions of bertQKVToContextPlugin (1, 2, 3) to newer versions (4, 5, 6 respectively) which implement IPluginV3.
    • Note:
      • The newer versions preserve the attributes and I/O of the corresponding older plugin version
      • The older plugin versions are deprecated and will be removed in a future release
  • Quickstart guide
    • None
  • Parser changes

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [tensorrt](https://github.com/nvidia/tensorrt) to permit the latest version.
- [Release notes](https://github.com/nvidia/tensorrt/releases)
- [Changelog](https://github.com/NVIDIA/TensorRT/blob/release/10.6/CHANGELOG.md)
- [Commits](https://github.com/nvidia/tensorrt/commits)

---
updated-dependencies:
- dependency-name: tensorrt
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Nov 22, 2024
Copy link

netlify bot commented Nov 22, 2024

Deploy Preview for frigate-docs ready!

Name Link
🔨 Latest commit 638d595
🔍 Latest deploy log https://app.netlify.com/sites/frigate-docs/deploys/67406ede11e29c0008e858dd
😎 Deploy Preview https://deploy-preview-15127--frigate-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file python Pull requests that update Python code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants