[Hardware][Gaudi]add get_name method for HPUAttentionBackend (vllm-pr…

…oject#10667) Signed-off-by: Kunshang Ji <[email protected]> Signed-off-by: Andrew Feldman <[email protected]>
neuralmagic · Dec 2, 2024 · 89c4f78 · 89c4f78
1 parent 429d17e
commit 89c4f78
Showing 1 changed file with 4 additions and 0 deletions.
diff --git a/vllm/attention/backends/hpu_attn.py b/vllm/attention/backends/hpu_attn.py
@@ -22,6 +22,10 @@
 
 class HPUAttentionBackend(AttentionBackend):
 
+    @staticmethod
+    def get_name() -> str:
+        return "HPU_ATTN"
+
     @staticmethod
     def get_impl_cls() -> Type["HPUAttentionImpl"]:
         return HPUAttentionImpl