[BUILD] Remove the extension spark jars before build to avoid include unspecified version

[zwangsheng]

🔍 Description

Issue References 🔗

This pull request fixes #5836 (comment)

Describe Your Solution 🔧

Remove the remain extension spark jars in related target dir before start to package.

Aims to avoid include unspecified version.

Types of changes 🔖

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request ⚰️

Before this PR:

./build/dist -Pspark-3.1 ...
# your will get expected package, then you run the following command
./build/dist -Pspark-3.3
# you will find the final package include the spark 3.1 extension jar, which is un-expected.

Behavior With This Pull Request 🎉

After this PR, will clean up those extension spark jars before build to ensure we won't package the unspecified extension jar.

Related Unit Tests

None

Checklist 📝

• This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 61.15%. Comparing base (49456bb) to head (d824491).
Report is 1 commits behind head on master.

❗ Current head d824491 differs from pull request most recent head 3e5f434. Consider uploading reports for the commit 3e5f434 to get more accurate results

Additional details and impacted files

@@             Coverage Diff              @@
##             master    #6129      +/-   ##
============================================
- Coverage     61.17%   61.15%   -0.02%     
  Complexity       23       23              
============================================
  Files           624      624              
  Lines         37260    37260              
  Branches       5046     5046              
============================================
- Hits          22793    22788       -5     
- Misses        12011    12021      +10     
+ Partials       2456     2451       -5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[zwangsheng]

Made some changes, using maven clean plugin to help clean up those jars instead of script, please review again @ulysses-you @wForget thanks

After second thought, we should still do this in script to avoid trigger the clean logic multi times.

[pan3793]

Thanks, merged to master