1. Flexible Heterogenous
Replication
Je! Mace
©Continuent 2012.
Thursday, June 28, 12

2. Overview
• Introducing Tungsten Replicator
• Installation
• Demo
• Next Steps
©Continuent 2012 2
Thursday, June 28, 12

3. Introducing Tungsten Replicator
• Alternative to MySQL replication
• Still requires binary logs
• Crash-safe with ACID storage engines
• Compatible across branches and versions
• Provides heterogenous replication
• 100% GPL v2
©Continuent 2012 3
Thursday, June 28, 12

4. Break speed limits
©Continuent 2012 4
Thursday, June 28, 12

5. Break speed limits
©Continuent 2012
✗ 4
Thursday, June 28, 12

6. Replicate from many masters
©Continuent 2012 5
Thursday, June 28, 12

7. Replication Pipeline
Pipeline
Stage Stage Stage
Extract Filter Apply Extract Filter Apply Extract Filter Apply
Master Transaction In-Memory Slave
DBMS History Log Queue DBMS
©Continuent 2012 6
Thursday, June 28, 12

8. Heterogenous Replication
• Row replication
• DDL must be compatible
• Create schema ahead of time on the slave
• Primary Keys on every table
©Continuent 2012 7
Thursday, June 28, 12

9. Installing Tungsten
• tungsten-installer
• Written in Ruby
• Simple installation using SSH between
database servers
• Validates prior to installation
©Continuent 2012 8
Thursday, June 28, 12

10. Installing a MySQL Master
tools/tungsten-installer --master-slave -a
--cluster-hosts=my1
--home-directory=/opt/continuent
--datasource-type=mysql
--master-host=my1
--datasource-user=tungsten
--datasource-password=secret
--service-name=mongodb
--mysql-use-bytes-for-string=false
--svc-extractor-filters=colnames,pkey
--datasource-log-directory=/var/lib/mysql
--datasource-log-pattern=mysql-bin
--datasource-mysql-conf=/etc/mysql/my.cnf
--start-and-report
©Continuent 2012 9
Thursday, June 28, 12

11. Installing a MongoDB Slave
tools/tungsten-installer --master-slave -a
--cluster-hosts=mon2
--home-directory=/opt/continuent
--datasource-type=mongodb
--master-host=my1
--datasource-user=tungsten
--datasource-password=secret
--service-name=mongodb
--property=replicator.pipeline.slave.services=""
--skip-validation-check=InstallerMasterSlaveCheck
--start-and-report
©Continuent 2012 10
Thursday, June 28, 12

12. Installing a PostgreSQL Slave
tools/tungsten-installer --master-slave -a
--cluster-hosts=pg3
--home-directory=/var/lib/postgresql/continuent
--datasource-type=postgresql
--master-host=my1
--datasource-user=postgres
--datasource-password=secret
--service-name=mongodb
--skip-validation-check=InstallerMasterSlaveCheck
--user=postgres
--postgresql-dbname=postgres
--start-and-report
©Continuent 2012 11
Thursday, June 28, 12

13. Demo
©Continuent 2012 12
Thursday, June 28, 12

14. Supported slave databases
• MySQL
• PostgreSQL
• Oracle
• MongoDB
• Vertica
©Continuent 2012 13
Thursday, June 28, 12

15. Supported master databases
• MySQL
• PostgreSQL (Experimental)
• Oracle (Commercial)
©Continuent 2012 14
Thursday, June 28, 12

16. Next Steps
• Test in your environment
• Sponsor support for new database types
• Looking for sponsorship to build out a
provisioning framework
• Contact us with questions
©Continuent 2012 15
Thursday, June 28, 12

17. We’re Hiring
• Cluster Implementation Engineer
• QA Engineer
• Technical Writer
©Continuent 2012 16
Thursday, June 28, 12

18. Jeff Mace
jeff.mace@continuent.com
sales@continuent.com
560 S. Winchester Blvd. Suite 500
San Jose, CA 95128
Tel (866) 998-3642
Fax (408) 668-1009
http://www.continuent.com
http://code.google.com/p/tungsten-replicator
©Continuent 2012 17
Thursday, June 28, 12