Which Frigate+ model to use with Nvidia tensorrt 0.14?

[thinkloop]

Is it the case that we can't/shouldn't use frigate+ models with with nvidia detectors until 0.15?

I have not been able to get any of the models I generated to work:

I simply changed my config like this:

detectors:
  tensorrt:
    type: tensorrt
    device: 0
  
# model:
  # path: /config/model_cache/tensorrt/yolov7-320.trt
  # input_tensor: nchw
  # input_pixel_format: rgb
  # width: 320
  # height: 320

model:
  path: plus://b86c9dadcb61892485fc96188c181495

Error:

frigate    | 2024-11-27 01:31:25.382234835  Process detector:tensorrt:
frigate    | 2024-11-27 01:31:25.382266362  [2024-11-27 01:31:25] frigate.detectors.plugins.tensorrt ERROR   : 4: [runtime.cpp::deserializeCudaEngine::66] Error Code 4: Internal Error (Engine deserialization failed.)
frigate    | 2024-11-27 01:31:25.383027564  Traceback (most recent call last):
frigate    | 2024-11-27 01:31:25.383054639    File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
frigate    | 2024-11-27 01:31:25.383056641      self.run()
frigate    | 2024-11-27 01:31:25.383058620    File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run
frigate    | 2024-11-27 01:31:25.383060524      self._target(*self._args, **self._kwargs)
frigate    | 2024-11-27 01:31:25.383073011    File "/opt/frigate/frigate/object_detection.py", line 102, in run_detector
frigate    | 2024-11-27 01:31:25.383074281      object_detector = LocalObjectDetector(detector_config=detector_config)
frigate    | 2024-11-27 01:31:25.383075585    File "/opt/frigate/frigate/object_detection.py", line 53, in __init__
frigate    | 2024-11-27 01:31:25.383076842      self.detect_api = create_detector(detector_config)
frigate    | 2024-11-27 01:31:25.383078953    File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
frigate    | 2024-11-27 01:31:25.383080703      return api(detector_config)
frigate    | 2024-11-27 01:31:25.383082041    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 247, in __init__
frigate    | 2024-11-27 01:31:25.383140915      self.input_shape = self._get_input_shape()
frigate    | 2024-11-27 01:31:25.383142702    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 121, in _get_input_shape
frigate    | 2024-11-27 01:31:25.383156802      binding = self.engine[0]
frigate    | 2024-11-27 01:31:25.383166626  TypeError: 'NoneType' object is not subscriptable
frigate    | 2024-11-27 01:31:25.383167723  Exception ignored in: <function TensorRtDetector.__del__ at 0x7fb3c29cc280>
frigate    | 2024-11-27 01:31:25.383168778  Traceback (most recent call last):
frigate    | 2024-11-27 01:31:25.383169934    File "/opt/frigate/frigate/detectors/plugins/tensorrt.py", line 265, in __del__
frigate    | 2024-11-27 01:31:25.383244317      if self.outputs is not None:
frigate    | 2024-11-27 01:31:25.383254053  AttributeError: 'TensorRtDetector' object has no attribute 'outputs'

Thanks

[blakeblackshear]

Yes. That's what the note means. Frigate+ models can only be used with Nvidia GPUs in 0.15.