You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I followed the README instructions on compilation and at the end I faced the
UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: 1.16 does not support 'onnxruntime' TRITONBACKEND API version: 1.19
error when trying to run Triton Inference Server with the backend swapped. I think you forgot to mention in the README that it is absolutely necessary to specify correct -DTRITON_CORE_REPO_TAG, otherwise it fails on API version check in TRITONBACKEND_Initialize in onnxruntime.cc.
I followed the README instructions on compilation and at the end I faced the
UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: 1.16 does not support 'onnxruntime' TRITONBACKEND API version: 1.19
error when trying to run Triton Inference Server with the backend swapped. I think you forgot to mention in the README that it is absolutely necessary to specify correct -DTRITON_CORE_REPO_TAG, otherwise it fails on API version check in TRITONBACKEND_Initialize in onnxruntime.cc.
For example, you say to run
cmake -DCMAKE_INSTALL_PREFIX:PATH=`pwd`/install -DTRITON_BUILD_ONNXRUNTIME_VERSION=1.14.1 -DTRITON_BUILD_CONTAINER_VERSION=23.04 ..
"to build the ONNX Runtime backend for Triton 23.04" which is simply wrong and the correct command would be
cmake -DCMAKE_INSTALL_PREFIX:PATH=`pwd`/install -DTRITON_BUILD_ONNXRUNTIME_VERSION=1.14.1 -DTRITON_BUILD_CONTAINER_VERSION=23.04 -DTRITON_CORE_REPO_TAG=r23.04 ..
The text was updated successfully, but these errors were encountered: