海量数据迁移方案

海量数据迁移方案徐进挺新浪围脖： tb 丁原 Mail:dingyuan@taobao.com 日期： 201104

[object Object],[object Object],[object Object],[object Object],大纲

[object Object],[object Object],[object Object],场景是什么 enq: HW - contention enq: TX - row lock contention enq: TX - index contention 需求：表需要从 1 个库迁移到另外的库中迁移对应关系可能是 1->1, 1->N, N->1,N->M 源，目标端环境可能是： Oracle <-> oracle ， Oracle <-> mysql ， Oracle <-> nosql

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],目标是什么

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],全量迁移

使用过哪些方案选择简单，高效，高可靠性的方案

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],全量迁移的风险点全量迁移：建议化整为零分片迁移

[object Object],[object Object],[object Object],[object Object],[object Object],化整为零之 extent 方案 File# Block# Row# data_object_id# File# Block# Row# 1 Segment N extent N*N Block N*N*N rowid

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],化整为零之 extent 方案

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],化整为零之 extent 方案

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],增量迁移备注：每个表必须要有创建时间和修改时间两个字段问题：如果迁移过程中，需要加上业务处理逻辑，哪种方式更容易满足呢？

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Oracle-my(no)sql

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Sqluldr/load data

[object Object],[object Object],[object Object],[object Object],小结

海量数据迁移方案

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to 海量数据迁移方案

Similar to 海量数据迁移方案 (20)

More from orczhou

More from orczhou (8)

海量数据迁移方案