Discussions

• 2 You must be logged in to vote

  #️⃣

  TorchTRT Compilation Memory Consumption Management

  narendasan started Sep 25, 2025 in RFCs

  

  

  

  

  8
• 1 You must be logged in to vote

  #️⃣

  Autocast and Weak Typing

  narendasan started Oct 16, 2025 in RFCs

  

  

  1
• 1 You must be logged in to vote

  💡

  LLM optimizations of Torch TensorRT

  cehongwang started Jul 31, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamically Allocated Engines

  narendasan started Jul 24, 2025 in RFCs

  

  

  0
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v2.7.0

  narendasan started May 7, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Complex number handling in Torch-TensorRT

  apbose started Apr 1, 2025 in RFCs

  

  

  8
• 1 You must be logged in to vote

  🙏

  torch.autograd.grad

  kudoryutaro asked Jun 13, 2023 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Automatic plugin generation using custom kernels and host code

  bowang007 started Oct 1, 2024 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Multi node support in Torch-TRT

  apbose started Aug 7, 2024 in RFCs

  

  

  4
• 1 You must be logged in to vote

  🙏

  Unable to use kwarg_inputs in torch_tensorrt.compile

  derMart asked Jan 23, 2025 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Support AOTInductor compilation and packaging with Torch-TensorRT modules

  peri044 started Nov 19, 2024 in RFCs

  

  

  3
• 1 You must be logged in to vote

  🙏

  Confuse about fast_partition and global_partition, what's diff between them?

  gavin838 asked Dec 16, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  Support data dependent shapes (no fallback)

  bowang007 started Feb 28, 2023 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Building Refittable Engines by Default

  narendasan started Oct 2, 2024 in RFCs

  

  

  

  

  7
• 3 You must be logged in to vote

  🙏

  ❓ [Question] How do you convert part of the model to TRT?

  question Further information is requested

  MarekPokropinski asked Feb 18, 2022 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Support for loading multiple LORA adapters at runtime

  naiveen asked Feb 26, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  CUDAGraphs in Torch-TRT

  gs-olive started Apr 9, 2024 in RFCs

  

  

  

  

  2
• 1 You must be logged in to vote

  💬

  torch_tensorrt.dynamo.compile creates flawed output

  AIManifest started Aug 6, 2024 in General

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Engine Caching

  zewenli98 started Jun 26, 2024 in RFCs

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Model Weight Refit

  cehongwang started Jun 7, 2024 in RFCs

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I use bfloat16 with tensorrt?

  vedantroy asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to save results of using torch.compile with tensorrt backend?

  ved-genmo asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to enable fp16 with torch-tensorrt backend?

  vedantroy asked Jun 17, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v2.3.0

  narendasan started Jun 7, 2024 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  #️⃣

  Model Weight Refit in FX

  RFC: Under Review This RFC is under review

  gs-olive started Feb 17, 2023 in RFCs

  

  

  1