You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
replicate kv for some models when tp is divisble by kv_head_num#2874
Open
irexyc wants to merge 4 commits intoInternLM:mainInternLM/lmdeploy:mainfrom irexyc:replicate-kvirexyc/lmdeploy:replicate-kvCopy head branch name to clipboard
