 sync clickhouse with mysql mongodbSync Clickhouse with MySQL/MongoDB Company: Xiaoxin Tech. Industry: Education Team: Big Data Leader: wangchao@xiaoheiban.cn About 100 billion data this year till now 30 million users We use use Clickhouse in our daily tasks Chanllenges Complex Datasource Chanllenges Frequent Updates Chanllenges Possible Solutions 1. Replay binlog/oplog CRUD directly Can’t update/delete table frequently frequently in Clickhouse Possible Solutions 2. MySQL Engine Not suitable for big tables Not suitable for MongoDB Possible Solutions 3. Reinit whole table every day…… Possible Solutions 4. CollapsingMergeTree0 码力 | 38 页 | 2.25 MB | 1 年前3 sync clickhouse with mysql mongodbSync Clickhouse with MySQL/MongoDB Company: Xiaoxin Tech. Industry: Education Team: Big Data Leader: wangchao@xiaoheiban.cn About 100 billion data this year till now 30 million users We use use Clickhouse in our daily tasks Chanllenges Complex Datasource Chanllenges Frequent Updates Chanllenges Possible Solutions 1. Replay binlog/oplog CRUD directly Can’t update/delete table frequently frequently in Clickhouse Possible Solutions 2. MySQL Engine Not suitable for big tables Not suitable for MongoDB Possible Solutions 3. Reinit whole table every day…… Possible Solutions 4. CollapsingMergeTree0 码力 | 38 页 | 2.25 MB | 1 年前3
共 1 条
- 1













