DEBUG

predibase · Jun 3, 2024 · bfac3b8 · bfac3b8
1 parent ccc6c06
commit bfac3b8
Show file tree

Hide file tree

Showing 2 changed files with 12 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -100,6 +100,17 @@ curl 127.0.0.1:8080/generate \
     -H 'Content-Type: application/json'
 ```
 
+Embed:
+
+```shell
+curl 127.0.0.1:8080/embed \
+-X POST \
+-d '{
+"inputs": "[INST] Natalia sold clips to 48 of her friends in April, and then she sold half as many clips in May. How many clips did Natalia sell altogether in April and May? [/INST]"
+}' \
+-H 'Content-Type: application/json'
+```
+
 Prompt a LoRA adapter:
 
 ```shell

diff --git a/server/lorax_server/server.py b/server/lorax_server/server.py
@@ -96,6 +96,7 @@ async def Prefill(self, request: generate_pb2.PrefillRequest, context):
         )
 
     async def Embed(self, request: generate_pb2.EmbedRequest, context):
+        print("!!! EMBED")
         if not self.model.supports_embeddings:
             raise ValueError("Model does not support embeddings")