Skip to content
This repository has been archived by the owner on Apr 27, 2020. It is now read-only.

Add rate limiter to all sources where bulk load is used #75

Open
wrathagom opened this issue Nov 13, 2017 · 0 comments
Open

Add rate limiter to all sources where bulk load is used #75

wrathagom opened this issue Nov 13, 2017 · 0 comments
Assignees

Comments

@wrathagom
Copy link
Contributor

ES has a queue limit for bulk operations so either I need to insert more rows/request or I need to put a rate limiter so that each request has a chance to finish before the next one starts. Ideally I'd add a loop of some sorts that only releases one more for each one finishing...

As it is right now inserts will fail if there are too many bulk requests.

@wrathagom wrathagom added the bug label Nov 13, 2017
@wrathagom wrathagom self-assigned this Nov 13, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant