v0.10.0

🌈 What's New?

• TorchServe support (#250, kserve/modelmesh-runtime-adapter#34)
• ClusterServingRuntime support (#241, #252, #257)
• Enable pod anti-affinity for controller (#272)
• Support passing labels and annotations from ServingRuntimePodSpec to runtime Pod (#271)
• Support for image pull secrets in ServingRuntime spec (#276)
• Update to use latest OVMS 2022.2 image (#258)
• Add V2 Inference API support for OVMS runtime (kserve/modelmesh-runtime-adapter#31)
• Support BYTES/string type tensors in REST proxy (kserve/rest-proxy#17)
• Reworked second-copy scaling logic (kserve/modelmesh#49)

🐞 Fixes

• Ensure modelmesh container comes last in list (#202)
• Ensure delete.sh script works properly with implicit namespace (#217)
• Fix namespace-scoped install (#212)
• Tolerate kustomize version 3.2 (#233)
• Correct config-defaults mount path (#289)
• Support request/response parameters in REST proxy (kserve/rest-proxy#15)
• Propagate context to puller download tasks (kserve/modelmesh-runtime-adapter#32)
• Ensure intra-cluster InternalExceptions are propagated properly (kserve/modelmesh#58)
• Fix failure expiry race condition (kserve/modelmesh#67)
• Fix cache accounting in loading failures case (kserve/modelmesh#74)

📄 Documentation

• Sync updated model-runtime.proto file from modelmesh repo (#203)
• Update FVT prerequisites (#235)
• Update cluster sizing link in quickstart.md (#236)
• Fix port-forward command in run-inference.md (#232)
• Ensure CRD inline code consistency (#265)
• Fix TLS secret name ConfigMap update example (#260)
• Relax kustomize version prerequisite for Quickstart (#245)
• Update Custom Runtime Docs (#277)
• Update quickstart to include ovms (#270)

🦦 Other

• Pass ServingRuntime inference endpoint to built-in adapter (#227)
• Make list of supported built-in runtime server types overridable (#220)
• Add script to identify broken doc links (#237)
• Automatically set kube context in development container (#246)
• Fix error in verify_doc_links.py script (#244)
• Preserve command history of make develop interactive sessions (#234)
• Update makefile to support building with podman (#266)
• Fix FVT runtime count issue (#285)
• Update Dockerfile packages (#291)
• Clean up various adapter/puller logic (kserve/modelmesh-runtime-adapter#33)
• Many dependencies updated (various)

New Contributors

• @ckadner made his first contribution in #236
• @rafvasq made his first contribution in #265
• @anishasthana made his first contribution in #266
• @lizzzcai made their first contribution in #271
• @JasmondL made his first contribution in #291

Full Changelog: v0.9.0...v0.10.0
All File Changes: https://github.com/kserve/modelmesh-serving/compare/v0.9.0..v0.10.0