Administration/Clustering: Reference articles about scaling clusters #46
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
amotl
added
the
cross linking
amotl
force-pushed
the
amo/more-content
branch
from
591443c
to
66f95aa
Compare
This comment was marked as resolved.
This comment was marked as resolved.
amotl
force-pushed
the
amo/more-content
branch
from
66f95aa
to
672e483
Compare
amotl
force-pushed
the
amo/add-nodes-to-cluster
branch
from
789bc58
to
d1fe6a0
Compare
amotl
changed the title
amotl
commented
Feb 27, 2024
Comment on lines
+15
to
+20
| (scaling-expand)= | ||
| ## Expand Cluster | ||
|
|
||
| The article about [how to add new nodes to an existing cluster] walks you | ||
| through the process of scaling up your database cluster, and educates you | ||
| about the corresponding details to consider. |
There was a problem hiding this comment.
We haven't been able to discover a meaningful/representative code snippet/example on https://community.cratedb.com/t/how-to-add-new-nodes-to-an-existing-cluster/1546, so we just omitted it in this case.
The whole section is a bit thin now, and could be expanded if you have any ideas/suggestions. Otherwise, let's just merge to make progress.
Comment on lines
+23
to
+57
| (scaling-ondemand)= | ||
| ## On-Demand Scaling | ||
|
|
||
| The article about [scaling CrateDB clusters up and down to cope with peaks in | ||
| demand] shares knowledge about the [shard allocation filtering] feature of | ||
| CrateDB. | ||
|
|
||
| Along the lines, it demonstrates how this functionality is applied in a real- | ||
| world data management scenario, which is about tuning your database cluster to | ||
| cope with high-demand situations. | ||
|
|
||
| Prepare adding extra nodes to the database cluster. | ||
| ```sql | ||
| /* Apply routing setting to all existing partitions and new partitions. */ | ||
| ALTER TABLE test SET ("routing.allocation.exclude.storage" = 'temporarynodes'); | ||
|
|
||
| /* Configure the setting to be excluded / not applied to _new_ partitions. */ | ||
| ALTER TABLE ONLY test RESET ("routing.allocation.exclude.storage"); | ||
| ``` | ||
|
|
||
| Before the high-demand event, properly configure table routing accordingly. | ||
| ```sql | ||
| ALTER TABLE ONLY test SET ("routing.allocation.total_shards_per_node" = 2); | ||
| ``` | ||
|
|
||
| To decommission extra database nodes, we need to move the data collected during | ||
| the days of the event. | ||
| ```sql | ||
| -- Move the collected data off the extra nodes. | ||
| ALTER TABLE test SET ("routing.allocation.exclude.storage" = 'temporarynodes'); | ||
| ALTER TABLE test RESET ("routing.allocation.total_shards_per_node"); | ||
|
|
||
| -- Invoke the decommissioning. | ||
| ALTER CLUSTER DECOMMISSION 'nodename'; | ||
| ``` |
There was a problem hiding this comment.
Please don't hesitate to submit suggestions to improve the wording on both guiding comments, and inline comments. Thanks!
hlcianfagna
approved these changes
Feb 27, 2024
|
Thanks for approving. In order to bring it in, GH-41 also needs approval, because this patch is stacked upon it. |
amotl
force-pushed
the
amo/more-content
branch
from
714c0b2
to
c4439f4
Compare
... linking to community forum article "How to add new nodes to an existing cluster". -- https://community.cratedb.com/t/how-to-add-new-nodes-to-an-existing-cluster/1546
amotl
force-pushed
the
amo/add-nodes-to-cluster
branch
from
56f9a83
to
8198f08
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
About
The dedicated "Expand Cluster" page now cross links to two community forum articles by @hlcianfagna. Thank you again. 🌻
Preview
https://cratedb-guide--46.org.readthedocs.build/admin/clustering/scale-up-down.html
/cc @karynzv, @marijaselakovic, @seut, @surister, @wierdvanderhaar, @matkuliak, @msbt