You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
many cloud providers have exact rate limits usually denoted in calls/seconds, e.g. https://docs.infura.io/infura/networks/ipfs/how-to/request-rate-limits "You can retrieve IPFS data using the API with a limit of 100 requests per second for the remaining read-only methods such as:"
But don't confuse this with extraction-worker's concurrency which just says: independent of time, there should always been 100 connections open (we call this concurrency).
While concurrency is important and we should keep it, another useful option would be to allow users to define rate limit quotas, e.g. "1/s" (1 call per second) or "10/ms" (10 calls per millisecond).
and then extraction-worker would queue those calls respectively such that they never go over the defined quota, e.g. extraction-worker would guarantee that many messages with a quota: "1/s" would never exceed 1 call per second etc.
The text was updated successfully, but these errors were encountered:
The text was updated successfully, but these errors were encountered: