Skip to content

POS — add steps to backup and restore clickhouse #4101

@jdhayhurst

Description

@jdhayhurst

We need a way to transfer data from one instance of clickhouse i.e. the one running in POS to the single production instance.

We can use BACKUP|RESTORE TO|FROM S3() for this. However, this is limited to mergeTree family table engines. For other table engines, this will backup/restore the table structure but not the data, so that will require another step. For that we can use and INSERT INTO FUNCTION s3() and store the data in a compressed file format (Native will not work).

POS should have a step for backup and another for restore, where we can tunnel the destination instance.

Metadata

Metadata

Assignees

Labels

BackendRelates to Open Targets backend teamPOSRelates to Backend platform output supportPlatformIssues related to Open Targets Platform

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions