Kvrouter that will increase the kv-cache hits in case of multiple routing strategy · huggingface/text-generation-inference@50c8ebd

Triggered via pull request January 31, 2025 12:16

Narsil

synchronize #2965

kvrouter

Status Success

Total duration 35s

Artifacts 1

build_pr_documentation.yaml

on: pull_request

Produced during runtime

Name	Size
doc-build-artifact	362 KB