enhance: simplify compaction tasks to reduce their memory overhead

[tedxu]

See #39080

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69.64%. Comparing base (4355b48) to head (fd38263).
Report is 2 commits behind head on master.

Additional details and impacted files

@@           Coverage Diff           @@
##           master   #39121   +/-   ##
=======================================
  Coverage   69.64%   69.64%           
=======================================
  Files         296      296           
  Lines       26633    26633           
=======================================
  Hits        18548    18548           
  Misses       8085     8085           

Components	Coverage Δ
Client	∅ <ø> (∅)
Core	69.64% <ø> (ø)
Go	∅ <ø> (∅)

[XuanYang-cn]

/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tedxu, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/datacoord/OWNERS [tedxu]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[sre-ci-robot]

New changes are detected. LGTM label has been removed.

[mergify]

@tedxu E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.