Apache HBaseはHadoopドメインにおいてメジャーなNoSQLのひとつです。しかし、多くのユーザがその運用性、安定性、パフォーマンスにおいて様々な問題を抱えています。MapR M7エディションはエンタープライズ向けHadoopディストリビューションという価値に加え、HBaseアプリケーションをより容易に安定的かつ高速に実行するプラットフォームを提供します。2014年6月18〜20日に開催されたdb tech showcase 大阪 2014での講演資料です。

1. © MapR Technologies
®
© MapR Technologies, confidential
®
© MapR Technologies

2. ®
© MapR Technologies

3. ®
© MapR Technologies

4. ®
© MapR Technologies
!
!
!
!
!

5. ®
© MapR Technologies
JVM
Data'Node
JVM
RegionServer
JVM
Name'Node
JVM
ZooKeeper
JVM
ZooKeeper
JVM
ZooKeeper
JVM
HBaseMaster
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer

6. ®
© MapR Technologies
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
JVM
Data'Node
JVM
RegionServer
HDFS

7. ®
© MapR Technologies

8. ®
© MapR Technologies

9. ®
© MapR Technologies
!
!
!
!
!

10. ®
© MapR Technologies
File'File'
JVM
File'File'File'
File'File'File'

11. ®
© MapR Technologies
•
•
•
•
•
•
•
•
•
•
•
•

12. ®
© MapR Technologies

13. ®
© MapR Technologies
0'
2000'
4000'
6000'
8000'
10000'
12000'
14000'
16000'
18000'
0' 1000' 2000' 3000' 4000' 5000' 6000'
/'
'
0'''''''''''''100''''''''''''200''''''''''''400''''''''''''600''''''''''''800'''''''''''1000'''''''''''
MapR'
'
Benchmark:'File'creates'(100B)'
Hardware:'10'nodes,'2'x'4'cores,'24'GB'
RAM,'12'x'1'TB'7200'RPM'
'
0'
50'
100'
150'
200'
250'
300'
350'
400'
0' 0.5' 1' 1.5'
/'
'
'MapR%
%
Advantage%
Rate'(creates/s)' 14T16K' 335T360' 40x%
Scale'(files)' 6B' 1.3M' 4615x%

14. ®
© MapR Technologies

15. ®
© MapR Technologies
"
"
"
"
"
''
''
''
''
''
''
''
''
''
''
''
''
''
''
''
''

16. ®
© MapR Technologies
!
!
!
!
!
File'File'File'

17. ®
© MapR Technologies
$"mount"maprnode:/mapr"/mapr"
$"cd"/mapr/default/user/dave"
$"pwd"
/mapr/default/user/dave"
"
$"ls"
file1""file2""table1""table2"
"
$"hbase"shell"
hbase(main):003:0>"create"'/user/dave/table3',"'cf1',"'cf2',"'cf3'"
0"row(s)"in"0.1570"seconds"
"
$"ls"
file1""file2""table1""table2""table3"
"
$"hadoop"fs"Dls"/user/dave"
Found"5"items"
DrwDrDDrDD"""3"mapr"mapr"""""""""16"2012D09D28"08:34"/user/dave/file1"
DrwDrDDrDD"""3"mapr"mapr"""""""""22"2012D09D28"08:34"/user/dave/file2"
trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:32"/user/dave/table1"
trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:33"/user/dave/table2"
trwxrDxrDx"""3"mapr"mapr""""""""""2"2012D09D28"08:38"/user/dave/table3"
NFS'
Hadoop'API

18. ®
© MapR Technologies
MapR%Data%Pla*orm%(MDP)
MapR%Control%System%(MCS)
HBase&API
HDFS%API
NFS%interface
MapReduce
Apache%
HBase
Pig
Hive
Cascading
Flume
Oozie
Sqoop
HCatalog
Mahout
Whirr
MapR%Distribu-on%for
Apache%Hadoop

19. ®
© MapR Technologies

20. ®
© MapR Technologies

21. ®
© MapR Technologies
"
"
'
'

22. ®
© MapR Technologies
"
–
'
'

23. ®
© MapR Technologies
"
–
–
–

24. ®
© MapR Technologies
"
–
–
–
"
–
–
–

25. ®
© MapR Technologies
!
!
!
!
!

26. © MapR Technologies
®

27. © MapR Technologies
®

28. ®
© MapR Technologies
"
–
–
–
–
–
"
–
–
–
"
–
–

29. © MapR Technologies
®
•
•
•
•
•
•

30. © MapR Technologies
®
•
SELECT cf1.month, cf1.year, FROM hbase.table1!
• !
!SELECT!
!c.name, c.address, COUNT(c.children) !
!FROM!
! !SELECT!
! ! !CONVERT_FROM(cf1.user-json-blob, JSON) AS c!
FROM!
!hbase.table1!

31. © MapR Technologies
®
•
SELECT table_name, table_type FROM
information_schema.tables WHERE
table_schema=‘MyDatabase’ ORDER BY table_name
DESC'
•
• SELECT, GROUP BY, ORDER BY, LIMIT, JOIN,
HAVING, UNION, UNION ALL,WITH, IN,
EXISTS,DISTINCT, BETWEEN
•
•
•
– CREATE DATABASE, CREATE TABLE/VIEW AS SELET,
INSERT INTO!

32. ®
© 2014 MapR Technologies 32
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•

33. ®
© MapR Technologies
!
!
!
!
!

34. ®
© MapR Technologies

35. ®
© MapR Technologies

36. ®
© MapR Technologies
CDH
MapR'

37. © MapR Technologies
®

38. ®
© MapR Technologies

39. ®
© MapR Technologies

40. © MapR Technologies
®
© MapR Technologies ®