You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Worker platform already supports EventSource but it's not exposed in the Rust API.
Most LLM APIs provide a way to stream responses using SSE, so having support for this would make it simpler to manage those streams in Rust. Currently we need to implement our own stream handling to go from bytes to SSE events.
The text was updated successfully, but these errors were encountered:
Is there an existing issue for this?
Description
The Worker platform already supports EventSource but it's not exposed in the Rust API.
Most LLM APIs provide a way to stream responses using SSE, so having support for this would make it simpler to manage those streams in Rust. Currently we need to implement our own stream handling to go from bytes to SSE events.
The text was updated successfully, but these errors were encountered: