-
Notifications
You must be signed in to change notification settings - Fork 40
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix usage of custom ServingRuntimes #47
Conversation
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: disrupted The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
hi @disrupted, when I deployed the paddle inferecenservice with KServe, the kubeflow models-web-app had the display problem and had the error as following figure, I think there is not the paddle servingruntime, and return None to cause the error. When I add the 'paddle' PredictType, patch and rebuild the models-web-app image, the problem can be fixed and the display become correctly, there is my changes, https://github.com/harperjuanl/models-web-app I also test your method, it does work too. I see it returns the predictor.model and remove the judgement. Does it have the problem that some frameworks are returned, which do not be supported by KServe? |
hi @harperjuanl, thanks for your feedback, as well as verifying the issue & potential fix. Perhaps you're right, that this could lead to some issues with other frameworks, however I thought that ServingRuntimes are always specific to KServe and not used in other scenarios. Adding custom ServingRuntimes (such as paddle in your case) to the known list of predictor types seems like a reasonable approach as well. But this would be better if it could be done through the KServe configuration, rather than having to patch the code, as it is the case in your example. |
@disrupted Please rebase to master |
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: disrupted The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
done |
@disrupted you also have to sign the DCO to pass all tests. |
Signed-off-by: Salomon Popp <[email protected]>
e551e42
to
3a8c824
Compare
done |
Signed-off-by: Salomon Popp <[email protected]>
/assign @juliusvonkohout |
@disrupted the frontend test is not passing. Maybe it is broken. |
it appears to me that the error is unrelated to the changes made in this PR |
You might be right, but we still have to fix the tests either way. |
merged in #92 |
Fixes #46