❓ [Question] How do you convert part of the model to TRT? #885
Replies: 4 comments 2 replies
-
You have a few options. 1. You can do what you did, but not sure how this how this would effect serialization since you have non PyTorch code in your torchscript. I would like to know what exactly produced this error in PyTorch, but can't look at that right now. 2. You pass the full module ( |
Beta Was this translation helpful? Give feedback.
-
Did you manage with this problem? I had the same issue :( |
Beta Was this translation helpful? Give feedback.
-
same issue :( |
Beta Was this translation helpful? Give feedback.
-
Did you manage with this problem? I had the same issue :( |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
❓ Question
Is it possible to convert only part of the model to TRT. I have model that cannot be directly converted to trt because it uses custom classes. I wanted to convert only modules that can be converted but as I tried it torch cannot save it.
What you have already tried
I tried the following:
But it raises exception:
RuntimeError: method.qualname() == QualifiedName(selfClass->name()->qualifiedName(), methodName)INTERNAL ASSERT FAILED at "../torch/csrc/jit/serialization/python_print.cpp":1105, please report a bug to PyTorch.
Environment
conda
,pip
,libtorch
, source): pipBeta Was this translation helpful? Give feedback.
All reactions