You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We profiled this in #289 and found that a huge amount of transform time is being taken up querying for user ids and course names, which we should be able to cache or find existing caches for.
We should also investigate fanning out multiple processes to ingest multiple files at a time and an option to create lookup tables of learner and course data that the process can work on outside of an LMS worker for extreme cases.
The text was updated successfully, but these errors were encountered:
We profiled this in #289 and found that a huge amount of transform time is being taken up querying for user ids and course names, which we should be able to cache or find existing caches for.
We should also investigate fanning out multiple processes to ingest multiple files at a time and an option to create lookup tables of learner and course data that the process can work on outside of an LMS worker for extreme cases.
The text was updated successfully, but these errors were encountered: