Document manual procedure of storage resizing #1053
Conversation
docs/source/storage_resizing.md
Outdated
| @@ -0,0 +1,76 @@ | |||
| # Resizing storage in Scylla Cluster | |||
|
|
|||
| Unfortunately changes in storage are currently not supported - it has to be done manually. | |||
There was a problem hiding this comment.
| Unfortunately changes in storage are currently not supported - it has to be done manually. | |
| Due to limitations of the underlying StatefulSets, ScyllaClusters don't allow storage changes. The following procedure describes how to adjust the storage manually. |
docs/source/storage_resizing.md
Outdated
|
|
||
| 1. List Scylla Cluster | ||
| ``` | ||
| k get pods -n scylla |
There was a problem hiding this comment.
don't use k but kubectl (applies globally)
There was a problem hiding this comment.
the namespace name will differ, it's easier to copy&paste if you leave it out
docs/source/storage_resizing.md
Outdated
| ``` | ||
| 2. Orphan delete Scylla Cluster | ||
| ``` | ||
| kubectl delete -n scylla scyllacluster simple-cluster --cascade='orphan' |
There was a problem hiding this comment.
kubectl prefers resource/name
docs/source/storage_resizing.md
Outdated
| k get pods -n scylla | ||
|
|
||
| NAME READY STATUS RESTARTS AGE | ||
| simple-cluster-us-east-1-us-east-1a-0 2/2 Running 0 12m |
There was a problem hiding this comment.
nit: might be better to use a single work for the cluster name, like basic
docs/source/storage_resizing.md
Outdated
|
|
||
| Unfortunately changes in storage are currently not supported - it has to be done manually. | ||
|
|
||
| 1. List Scylla Cluster |
There was a problem hiding this comment.
this needs to say why as it doesn't do anything
docs/source/storage_resizing.md
Outdated
| ``` | ||
| 4. Orphan delete Statefulsets | ||
| ``` | ||
| k delete -n scylla statefulset/simple-cluster-us-east-1-us-east-1a --cascade='orphan' |
docs/source/storage_resizing.md
Outdated
| ``` | ||
| 6. Change storage request | ||
| ``` | ||
| k -n scylla patch pvc data-simple-cluster-us-east-1-us-east-1a-0 -p '{"spec":{"resources":{"requests":{"storage":"2Gi"}}}}' |
There was a problem hiding this comment.
I'm afraid, patch does not have selecting by label option.
docs/source/storage_resizing.md
Outdated
| persistentvolumeclaim/data-simple-cluster-us-east-1-us-east-1a-2 patched | ||
| ``` | ||
|
|
||
| If the following error occurred: |
There was a problem hiding this comment.
| If the following error occurred: | |
| If the PVC change is denied because the PVC doesn't support volume expansion you need replace every node following the procedure described in ... |
docs/source/storage_resizing.md
Outdated
| You should continue with [replacing nodes](nodeoperations/replace_node.md). | ||
|
|
||
|
|
||
| 7. Reapply Scylla Cluster |
There was a problem hiding this comment.
| 7. Reapply Scylla Cluster | |
| 7. Apply updated ScyllaCluster definition |
docs/source/storage_resizing.md
Outdated
|
|
||
| 7. Reapply Scylla Cluster | ||
| ``` | ||
| kubectl apply -f clusterDefinition.yaml |
There was a problem hiding this comment.
always use server side apply
|
This PR is being closed because of inactivity. Feel free to reopen if you plan to work on it. |
|
We ran into the same issues in prod and following these steps. Is it okay if I reopen the PR with instructions in k9s? Or is |
Description of your changes:
At this moment we can't easily handle storage resizing it the operator. This PR documents a manual procedure.
Which issue is resolved by this Pull Request:
Resolves #825