enhance: broadcast with event-based notification

[chyezh]

issue: #38399
pr: #39522

• broadcast message can carry multi resource key now.
• implement event-based notification for broadcast messages
• broadcast message use broadcast id as a unique identifier in message
• broadcasted message on vchannels keep the broadcasted vchannel now.
• broadcasted message and broadcast message have a common broadcast header now.

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: chyezh
To complete the pull request process, please assign congqixia after the PR has been reviewed.
You can assign the PR to them by writing /assign @congqixia in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[mergify]

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@chyezh cpp-unit-test check failed, comment rerun cpp-unit-test can trigger the job again.

[chyezh]

rerun cpp-unit-test

[chyezh]

rerun go-sdk

[mergify]

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 87.05502% with 120 lines in your changes missing coverage. Please review.

Project coverage is 81.07%. Comparing base (6cdabd9) to head (c8502dd).
Report is 6 commits behind head on 2.5.

Files with missing lines	Patch %	Lines
...nternal/streamingcoord/server/service/broadcast.go	23.33%	21 Missing and 2 partials ⚠️
pkg/streaming/util/message/message_impl.go	44.44%	11 Missing and 9 partials ⚠️
...al/streamingcoord/client/broadcast/grpc_watcher.go	85.03%	16 Missing and 3 partials ⚠️
...treamingcoord/client/broadcast/watcher_resuming.go	90.19%	9 Missing and 1 partial ⚠️
...amingcoord/server/broadcaster/broadcast_manager.go	92.50%	6 Missing and 3 partials ⚠️
...server/service/broadcast/broadcast_watch_server.go	88.05%	6 Missing and 2 partials ⚠️
pkg/streaming/util/message/broadcast.go	88.52%	6 Missing and 1 partial ⚠️
...ernal/streamingcoord/server/broadcaster/watcher.go	90.32%	6 Missing ⚠️
pkg/log/with_logger.go	44.44%	3 Missing and 2 partials ⚠️
pkg/streaming/util/message/builder.go	66.66%	1 Missing and 3 partials ⚠️
... and 4 more

Additional details and impacted files

@@            Coverage Diff             @@
##              2.5   #39550      +/-   ##
==========================================
+ Coverage   80.97%   81.07%   +0.10%     
==========================================
  Files        1404     1415      +11     
  Lines      198032   198827     +795     
==========================================
+ Hits       160347   161197     +850     
+ Misses      32037    31978      -59     
- Partials     5648     5652       +4     

Components	Coverage Δ
Client	78.26% <ø> (ø)
Core	69.48% <ø> (ø)
Go	83.04% <86.82%> (+0.11%)	⬆️

Files with missing lines	Coverage Δ
internal/coordinator/coordclient/registry.go	91.17% <ø> (-1.04%)	⬇️
internal/distributed/streaming/append.go	74.19% <ø> (-2.95%)	⬇️
internal/distributed/streaming/broadcast.go	100.00% <100.00%> (ø)
internal/distributed/streaming/streaming.go	100.00% <ø> (ø)
internal/distributed/streaming/wal.go	64.22% <100.00%> (-1.87%)	⬇️
internal/metastore/catalog.go	100.00% <ø> (ø)
internal/metastore/kv/streamingcoord/kv_catalog.go	79.31% <100.00%> (ø)
internal/rootcoord/broadcast_task.go	9.61% <ø> (+0.84%)	⬆️
internal/streamingcoord/client/client.go	97.01% <100.00%> (ø)
internal/streamingcoord/client/client_impl.go	81.81% <100.00%> (+1.81%)	⬆️
... and 24 more

... and 51 files with indirect coverage changes

[chyezh]

rerun ut

[chyezh]

rerun go-sdk

[mergify]

@chyezh go-sdk check failed, comment rerun go-sdk can trigger the job again.

[chyezh]

rerun ut

[mergify]

@chyezh E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[chyezh]

/run-cpu-e2e