Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

buffer feature for conduit. #429

Open
clojurians-org opened this issue Jan 13, 2020 · 1 comment
Open

buffer feature for conduit. #429

clojurians-org opened this issue Jan 13, 2020 · 1 comment

Comments

@clojurians-org
Copy link

i use many streaming library, and they both have rate-limit buffer control function.
such as: buffer (1000 records <> 1s unit timer <> 10 Mb/s), any condition will emit record to downstream.
i don't know whether the function can be implemented in conduit,
or there's any exist similar library meet those requirement?

@snoyberg
Copy link
Owner

This kind of buffering is usually handled outside of the conduit pipeline itself, since a conduit pipeline is half duplex, not full duplex. Depending on the exact functionality you're looking for, it may be possible to achieve what you want directly in the pipeline. The stm-conduit library (which I'm not the author of) provides a lot of these higher-level combining features.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants