1. Cassandra
NoSQL
17-E-5 2011/02/17
@ryu_kobayashi

2. •
•
✴ ...
• ...
Hadoop
• http://beter-max.blogspot.com( ...)
• Twitter @ryu_kobayashi
•
✴ Cassndra GUI
‣ http://code.google.com/p/cassandra-gui/
✴ Amazon Elastic MapReduce
6

4. Cassndra The Definitive Guide
• 0.7
•
• ...

5. NoSQL

6. No! SQL!
(SQL )

10. NoSQL
=
Not Only SQL

11. SQL

12. NoSQL

13. 1998 Carlo Stozzi
2009 Eric Evans Cassnadra
ACID
ML SQL
NoSQL = Not Only SQL

14. ACID

15. CAP

16. 17-C-1
Bit Data

17. KVS

18. KVS NoSQL

19. KVS
=
Key Value Store

21. KVS
...
DB(Cassandra)
...
= =
Excel

22. Cassandra GUI
RDBMS DB
RDBMS

23. Cassandra
...
= =

25. NoSQL
Cassandra(Facebook) HBase(Yahoo!)
BigTable(Google) Dynamo(Amazon)
SimpleDB(Amazon) Windows Azure Table(Microsoft)
Roma( ) Flare(gree)
Tokyo Tyrant(mixi) Kyoto Cabinet
MongoDB Kumofs
...

26. NoSQL
http://nosql-database.org

27. RDBMS NoSQL
•RDBMS
•NoSQL
•RDBMS SQL
•NoSQL API SQL
•

29. RDBMS

30. RDBMS

31. NoSQL

32. NoSQL
•

33. NoSQL
•
•

34. NoSQL
•
•
★Web 2.0
✴AJAX
✴FLASH
✴
✴etc...

35. NoSQL
•
•
★Web 2.0
✴AJAX
✴FLASH
✴
✴etc...

36. NoSQL
...

37. NoSQL
...
NoSQL DDL

38. Cassandra

39. Cassandra

40. Cassandra
Cassandra
=
Bigtable + Dynamo

41. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11

42. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11

43. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11
• Facebook

44. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11
• Facebook
HBase

45. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11
• Facebook
HBase
• Twitter

46. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11
• Facebook
HBase
• Twitter
•

47. Cassandra
Facebook NoSQL DB
0.7.2 0.6.x 0.6.11
• Facebook
HBase
• Twitter
•
•

48. Cassandra
0.6 0.7
0.7 0.8

49. Cassandra
Use Case Twitter
Cassandra
Cassandra

50. Cassandra
•
•
•
• SPOF
• Thrift Java C++
• APP
• 0.7 I/O Hadoop MapReduce

51. Cassandra
2
1 3
4

52. Cassandra
2
1 3
4

53. Cassandra
Random Partitioner
MD5
Ordering Preserved Partitioner
Collating Order-Preserving Partitioner
Byte-Order Partitioner 0.7

54. Cassandra
2
1 3
4

55. Cassandra
2
1 3
Consistency Level
4

56. Cassandra
2
1 3
Consistency Level
4 Consistency Level APP
•ONE 1 OK
•ALL
OK
•QUORUM (N/2 + 1)
OK

57. Cassandra
2
1 3
4
SPOF

58. Cassandra
2
1 3
Consistency Level
4

59. Cassandra
2
1 3
4
DC

60. Cassandra
Consistency Level
•ONE
•QUORUM
✴
✴ Consistency Level
✴
✴ Read
Repair
✴ Read Repair
★Cassandra

61. Cassandra
Gossip Protocol
•
•
•
•
•
•
•
Consistency Level

62. Cassandra
Cassandra
•Bloom Filter
•Commit Log
•Memtable
•SSTable
•Compaction
✴Major Compaction
✴Minor Compaction
•etc...

64. Hadoop MapReduce
!!

65. Hadoop MR + Cassandra

66. Hadoop MR + Cassandra

67. Hadoop MR + Cassandra

68. Hadoop MR + Cassandra
=

69. Hadoop MR + Cassandra
=
Hassandra!!

71. Cassandra
Twitter
OSS
0.7 0.8
Distributed Counters
trunk 0.8

72. NoSQL RDBMS
Cassandra

73. NoSQL

75. RDBMS NoSQL

76. RDBMS NoSQL

78. PARTAKE

79. PARTAKE
!?

81. ACID
RDBMS
commit rollback
MVCC

82. ACID
RDBMS
commit rollback
MVCC

83. API
Cassandra Thrift
Amazon SimpleDB Google Bigtable(GQL)
SQL
SQL

84. Cassandra
Cassandra 0.7
Distributed counters
select count(*) from
counter

85. RDBMS
Java Hibernate O/R
KVS Cassandra DB

86. join
RDBMS join
Java Hibernate
KVS Cassandra

87. join
RDBMS join
Java Hibernate
KVS Cassandra
RDBMS
NoSQL
RDBMS

88. NoSQL

90. RDBMS
NoSQL

92. 1 PV
...

93. RDBMS
Cassandra

95. Cassandra
Join

97. m(_ _)m

98. Facebook
MySQL
Cassandra

99. Cassandra
HBase
(-_- )
Cassandra

100. NoSQL

101. NoSQL

102. 1 NoSQL

104. •NoSQL RDBMS

105. •NoSQL RDBMS
•

106. •NoSQL RDBMS
•
•

107. •NoSQL RDBMS
•
•
•

108. 17-E-5 2011/02/17
@ryu_kobayashi