-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Perf: Profile backfill script #289
Comments
@bmtcril can this be closed? |
I'm not sure where it got left, honestly. I think we had some plan to bring the times down by like 1/3, but you were the one doing the testing. :) |
This work is complete, below are the cumulative profile times. Based on this I think we can really speed things up by reducing the queries for actors and course ids by doing some aggressive caching. This is the wrong repo for that, I've added a ticket here for the work: openedx/event-routing-backends#354
|
We know that data backfill is slow using the
event-routing-backends
management command. We're not sure where and should profile it to see where improvements can be made. To get the most out of the testing we should:tutor local
would be next bestcProfile
like changing this line:tutor-contrib-aspects/tutoraspects/commands_v1.py
Line 113 in 5e0f970
return [("lms", f"python -m cProfile -s time ./manage.py lms transform_tracking_logs {options}")]
The text was updated successfully, but these errors were encountered: