Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support for EventSource #703

Open
1 task done
ochrons opened this issue Feb 6, 2025 · 1 comment
Open
1 task done

[Feature] Support for EventSource #703

ochrons opened this issue Feb 6, 2025 · 1 comment

Comments

@ochrons
Copy link

ochrons commented Feb 6, 2025

Is there an existing issue for this?

  • I have searched the existing issues

Description

The Worker platform already supports EventSource but it's not exposed in the Rust API.

Most LLM APIs provide a way to stream responses using SSE, so having support for this would make it simpler to manage those streams in Rust. Currently we need to implement our own stream handling to go from bytes to SSE events.

@danzlarkin
Copy link

Have you checked whether this package works? (I haven't personally)

https://docs.rs/eventsource/latest/eventsource/

If not, let me know and I'll start having a look into it more as I need it myself for a project myself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants