Skip to content

Commit

Permalink
[feat][doc] add conceptual docs (bundle assignment/splitting/algorith…
Browse files Browse the repository at this point in the history
…ms...) for broker load balancing
  • Loading branch information
Anonymitaet committed Jul 18, 2023
1 parent d584d88 commit 412c7a9
Show file tree
Hide file tree
Showing 9 changed files with 553 additions and 3 deletions.
552 changes: 551 additions & 1 deletion docs/concepts-broker-load-balancing-concepts.md

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion docs/concepts-broker-load-balancing-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Due to the unpredictable topic volume and physical distance among distributed br

- When topics are redistributed to other brokers, the cluster ensures the topics are instantaneously available to clients. The topics continue to guarantee the system performance, such as persistence, [ordering](./concepts-messaging.md#ordering-guarantee), [deduplication](./concepts-messaging.md#message-deduplication), [subscription type](./concepts-messaging.md#subscription-types), etc.

## Load balancing in Pulsar
## Broker load balancing in Pulsar

Because Pulsar uses a [segment-centric architecture](./concepts-architecture-overview.md) and separates the message serving and storage layer, it is designed to benefit load balancing.

Expand Down
2 changes: 1 addition & 1 deletion docs/concepts-messaging.md
Original file line number Diff line number Diff line change
Expand Up @@ -521,7 +521,7 @@ A master consumer is picked for a non-partitioned topic or each partition of a p
When the master consumer disconnects, all (non-acknowledged and subsequent) messages are delivered to the next consumer in line.
::: note
:::note
In some cases, a partition may have an older active consumer processing messages while a newly switched over active consumer starts receiving new messages. This may lead to message duplication or out-of-order.
Expand Down
Binary file added static/assets/broker-load-balancing-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/assets/broker-load-balancing-2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/assets/broker-load-balancing-3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/assets/broker-load-balancing-4.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/assets/broker-load-balancing-5.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added static/assets/broker-load-balancing-6.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 412c7a9

Please sign in to comment.