Skip to content

Commit

Permalink
remove the comment too
Browse files Browse the repository at this point in the history
  • Loading branch information
olegklimov committed Dec 27, 2024
1 parent 92eea7b commit 332bd89
Showing 1 changed file with 0 additions and 7 deletions.
7 changes: 0 additions & 7 deletions src/scratchpads/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -91,13 +91,6 @@ pub async fn create_chat_scratchpad(
tokenizer_arc.clone(), post, messages, allow_at
));
} else if scratchpad_name == "PASSTHROUGH" {
// warning! line below added by sergey. He says that it might be a workaround for something
// yet sergey cannot recall for what and I could not find "holes" it might cover, as:
// create_chat_scratchpad is used only in subchat and _chat, and:
// - subchat does not support stream=true at all
// - _chat is used in handlers: v1/chat, v1/chat/completion
// therefore, I deduct, that it is safe to comment line bellow and re-enable streaming
// post.stream = Some(true); // this should be passed from the request
result = Box::new(chat_passthrough::ChatPassthrough::new(
tokenizer_arc.clone(), post, messages, allow_at, supports_tools, supports_clicks
));
Expand Down

0 comments on commit 332bd89

Please sign in to comment.