Rate-limiting question

[jsale]

Thanks for this great package. I am running your process_commit.py with some modifications to save, etc., but I am concerned about going above the Bluesky rate limits. It appears that I am getting roughly 50-100 posts per second during busy times. I believe the limit is 50 but the code does not appear to have rate limiting built-in. I am not a skilled python programmer so I have been working with some of the AI models to address this but with little to no success. Am I misunderstanding something? Can you offer any suggestions? Thanks for any help you can provide.

[MarshalX]

Hi! My pleasure!

Here is how to get the rate limit: #167 (comment)
Here is to learn more about bsky rate limits: https://docs.bsky.app/docs/advanced-guides/rate-limits

But I am worried that you mention firehose (process_commit). It is hundreds of events per second and you should not perform huge amount of requests here

[jsale]

Thank you. You are correct, that is far too much data, even though I would love to gather it, and I am aware there are ways to do that, but that's not my goal. Thanks so much.