Skip to content

Commit

Permalink
Merge pull request #804 from jeffmaury/GH-802
Browse files Browse the repository at this point in the history
fix: update summarizer app to use correct url for token count
  • Loading branch information
rhatdan authored Oct 28, 2024
2 parents e19f5f2 + 4d15f1b commit dcb2bc8
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ def chunk_text(text):
for chunk in text_chunks:
chunk = chunk.page_content
chunk_kwargs = request_kwargs | {"json": {"input": chunk}}
count = requests.post(f"{model_service[:-2]}/v1/extras/tokenize/count", **chunk_kwargs).content
count = requests.post(f"{model_service[:-2]}extras/tokenize/count", **chunk_kwargs).content
count = json.loads(count)["count"]
if count >= 2048:
split_append_chunk(chunk, chunks)
Expand Down

0 comments on commit dcb2bc8

Please sign in to comment.