You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[Feature][Whole database synchronization] Dinky whole database synchronizes mysql to doris, how to automatically create doris tables based on the configured table name suffix and suffix to achieve data synchronization
#3807
github-actionsbot
changed the title
[Feature][整库同步] dinky整库同步mysql到doris,如何根据配置的表名前后缀自动创建doris表,实现数据同步
[Feature][Whole database synchronization] Dinky whole database synchronizes mysql to doris, how to automatically create doris tables based on the configured table name suffix and suffix to achieve data synchronization
Sep 13, 2024
Search before asking
Description
当前现状:
org.apache.doris.flink.sink.DorisSink(594): Doris FE's response cannot map to schema. res: "errCode=7,detailMessage=unknowntable,tableName=test" org.apache.doris.shaded.com.fasterxml.jackson.databind.exc.InvalidFormatException: Cannot deserialize value of type int from String "errCode=7,detailMessage=unknowntable,tableName=test": not a valid int value #3667
Use case
实现类似flink-doris-connector整库同步效果
https://doris.apache.org/zh-CN/docs/2.0/ecosystem/flink-doris-connector/#mysql-%E5%A4%9A%E8%A1%A8%E5%90%8C%E6%AD%A5%E7%A4%BA%E4%BE%8B
<FLINK_HOME>bin/flink run
-Dexecution.checkpointing.interval=10s
-Dparallelism.default=1
-c org.apache.doris.flink.tools.cdc.CdcTools
lib/flink-doris-connector-1.16-1.6.1.jar
mysql-sync-database
--database test_db
--mysql-conf hostname=127.0.0.1
--mysql-conf port=3306
--mysql-conf username=root
--mysql-conf password=123456
--mysql-conf database-name=mysql_db
--including-tables "tbl1|test.*"
--sink-conf fenodes=127.0.0.1:8030
--sink-conf username=root
--sink-conf password=123456
--sink-conf jdbc-url=jdbc:mysql://127.0.0.1:9030
--sink-conf sink.label-prefix=label
--table-conf replication_num=1
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: