Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EASY] Parallelize post processing in run loop #3013

Merged
merged 2 commits into from
Sep 25, 2024

Conversation

MartinquaXD
Copy link
Contributor

Description

When we briefly stored all fee policies for a given auction in the post processing it increased the time for that critical section quite significantly.
That change was removed since then but the learning still stands that these operations might as well happen in parallel.

Changes

Run the 3 DB inserts futures of the run loop post processing in parallel.

How to test

It's a very small change so the e2e tests should be sufficient

@MartinquaXD MartinquaXD requested a review from a team as a code owner September 25, 2024 11:55
@MartinquaXD MartinquaXD added the E:6.1 One auction per block See https://github.com/cowprotocol/pm/issues/35 for details label Sep 25, 2024
Copy link
Contributor

@sunce86 sunce86 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Truly an improvement although long term I would like to move to idea of saving the whole auction data and saving it in parallel with competition since no auction data in that case would depend on the competition result:

#3010

@MartinquaXD MartinquaXD changed the title Parallelize post processing in run loop [EASY] Parallelize post processing in run loop Sep 25, 2024
@MartinquaXD MartinquaXD enabled auto-merge (squash) September 25, 2024 14:02
@MartinquaXD MartinquaXD merged commit 399903a into main Sep 25, 2024
11 checks passed
@MartinquaXD MartinquaXD deleted the parallelize-post-processing branch September 25, 2024 14:08
@github-actions github-actions bot locked and limited conversation to collaborators Sep 25, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
E:6.1 One auction per block See https://github.com/cowprotocol/pm/issues/35 for details
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants