You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
For some models (most notably, CNNs), OpenVino EP for ONNX Runtime produces significant memory leaks due to issues with memory de-allocation: openvinotoolkit/openvino#12307.
Describe the solution you'd like
OpenVino team has proposed to use enable_dynamic_shapes to resolve the issue: openvinotoolkit/openvino#12307. However, it is not currently supported by onnxruntime_backend. I'd like to be able to use this option in model config.
did not help for OpenVino EP-based inference for onnxruntime_backend.
The text was updated successfully, but these errors were encountered:
narolski
changed the title
Add enable_dynamic_shapes To Configuration Options
Add enable_dynamic_shapes To Model Config To Resolve CNN Memory Leaks With OpenVino EP
Jun 2, 2023
Is your feature request related to a problem? Please describe.
For some models (most notably, CNNs), OpenVino EP for ONNX Runtime produces significant memory leaks due to issues with memory de-allocation: openvinotoolkit/openvino#12307.
Describe the solution you'd like
OpenVino team has proposed to use
enable_dynamic_shapes
to resolve the issue: openvinotoolkit/openvino#12307. However, it is not currently supported byonnxruntime_backend
. I'd like to be able to use this option in model config.Describe alternatives you've considered
Usage of:
did not help for OpenVino EP-based inference for
onnxruntime_backend
.The text was updated successfully, but these errors were encountered: