Skip running cleanup on pull requests

[aktech]

Reference Issues or PRs

Fixes #2252
Partially addresses #2413

Adding cleanup in the CI adds more problems than value, by skipping it in the pull requests, we will make out CI at least 2x faster, which means faster iteration cycle without loosing much as we're running it in the main anyways. This is a small trade-off and I feel its worth it.

What does this implement/fix?

Put a x in the boxes that apply

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds a feature)
• Breaking change (fix or feature that would cause existing features not to work as expected)
• Documentation Update
• Code style update (formatting, renaming)
• Refactoring (no functional changes, no API changes)
• Build related changes
• Other (please describe):

Testing

• Did you test the pull request locally?
• Did you add new tests?

Any other comments?