support for NPU with openvino

[JoshuaSeidel]

does frigate yet, or will it in 0.16 using NPU with openvino?

my new setup is using a intel ultra 7, and i want to see the power/speed of the NPU compared to the coral or cpu.

https://docs.openvino.ai/2024/openvino-workflow/running-inference/inference-devices-and-modes/npu-device.html

[NickM-27]

Some users have reported it working in 0.15

[Arol450]

I cannot get it to work

Process detector:ov:
Traceback (most recent call last):
File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrapself.run()
File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper return run(*args, **kwargs)
File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs)
File "/opt/frigate/frigate/object_detection.py", line 121, in run_detector object_detector = LocalObjectDetector(detector_config=detector_config)
File "/opt/frigate/frigate/object_detection.py", line 68, in init self.detect_api = create_detector(detector_config)
File "/opt/frigate/frigate/detectors/init.py", line 18, in create_detector return api(detector_config)
File "/opt/frigate/frigate/detectors/plugins/openvino.py", line 40, in __init__self.interpreter = self.ov_core.compile_model(
File "/usr/local/lib/python3.9/dist-packages/openvino/runtime/ie_api.py", line 543, in compile_model super().compile_model(model, device_name, {} if config is None else config),
RuntimeError: Exception from src/inference/src/cpp/core.cpp:121:
Exception from src/plugins/intel_npu/src/plugin/src/metrics.cpp:165: No available devices

detectors:
ov:
type: openvino
device: NPU #(AUTO works)

ghcr.io/blakeblackshear/frigate:0.15.0-beta4

[NickM-27]

additional drivers may need to be installed into the container, and a device likely needs to be mapped in to the container. We don't have devices to directly test

[Arol450]

Hey, thanks for the reply!
/dev/accel is definitely mapped into the container.

How would I go about installing the drivers within the container?

Testing: I would gladly set aside a box for testing if this were to be helpful.