-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Copy link
Labels
BackendRelates to Open Targets backend teamRelates to Open Targets backend teamPOSRelates to Backend platform output supportRelates to Backend platform output supportPlatformIssues related to Open Targets PlatformIssues related to Open Targets Platform
Milestone
Description
We need a way to transfer data from one instance of clickhouse i.e. the one running in POS to the single production instance.
We can use BACKUP|RESTORE TO|FROM S3()
for this. However, this is limited to mergeTree family table engines. For other table engines, this will backup/restore the table structure but not the data, so that will require another step. For that we can use and INSERT INTO FUNCTION s3()
and store the data in a compressed file format (Native will not work).
POS should have a step for backup and another for restore, where we can tunnel the destination instance.
Metadata
Metadata
Assignees
Labels
BackendRelates to Open Targets backend teamRelates to Open Targets backend teamPOSRelates to Backend platform output supportRelates to Backend platform output supportPlatformIssues related to Open Targets PlatformIssues related to Open Targets Platform