You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Actual system with one queue and beat task that refresh periodic task is problematic.
Every 25min, a task is triggered by beat.
This task scan all source that last ending date / time is greater than defined refresh period.
But, if a task is longer, beat tasks are stacked. When the longer task finished, beat tasks are executed N times and triggered N refresh of all concerned sources
Improve beat refresh_source task to not add a source refresh that is already
If not sufficient, split in two celery queues, one for source refresh, other for beat tasks
No description provided.
The text was updated successfully, but these errors were encountered: