Weitere ähnliche Inhalte Ähnlich wie HBaseConAsia2018 Track1-4: HBase at Didi (20) Mehr von Michael Stack (20) Kürzlich hochgeladen (16) HBaseConAsia2018 Track1-4: HBase at Didi5. hosted by
HBase Improvements & Applications
◇ 1.HBase Applications at DiDi
◇ 2.ACL Improvements
◇ 3.Replication Improvements
◇ 4.Reduce User Connection
9. hosted by
HBase Improvements & Applications
1.HBase Applications
◇ Message Queue
◇ GeoGraphic Feature data
◇ Heat Map
◇ User Profile
◇ Log Analysis
11. hosted by
HBase Improvements & Applications
2.Replication Improvements
◇ (1).Replication in RS Group
◇ (2).Table Metric
◇ (3).RS Group ratio
21. hosted by
Phoenix Improvements & Applications
◇ SLA 99.95%
◇ Secondary indexes
◇ Java-jdbc client P99 35 ms
◇ column default
◇ QueryServer
5.Order History
22. hosted by
Phoenix Improvements & Applications
◇ Secondary indexes :
◇ INDEX Type: Global Index => Covered Index
◇ ASYNC INDEX
◇ SALT_BUCKETS => reverse(ID) & pre split
◇ coprocessor :reduce connection
◇ QueryServer metrics
29. hosted by
GeoMesa Applications
◇ Z2 : latitude and longitude
◇ Z3 : latitude, longitude, and time
◇ XZ2 : line strings or polygons
◇ XZ3 : non-Point geometry and has a time attribute
◇ Record/ID
◇ Attribute
Index
35. hosted by
Monitor & Operations
◇ (1).HBase
◇ (2).Zookeeper
◇ (3).HDFS
◇ (4).ThriftServer
◇ (5).Queryserver
1.Monitor
37. hosted by
◇ echo mntr | nc $zookeeper 2181
◇ zk_num_alive_connections
◇ zk_open_file_descriptor_count
◇ zk_outstanding_requests
◇ zk_min_latency
◇ zk_followers
Monitor & Operations
38. hosted by
◇ [Put | Get | Scan …]_99th_percentile
◇ Slow Read/Write …
ThriftServer
QueryServer
◇ print slow prepareStatement
◇ print slow query
◇ ExecuteQueryTime_99th_percentile
Monitor & Operations
40. hosted by
◇ DHS(Didi HBase Service):
◇ Visualizing Information: Region hot-spots from Region Metric
◇ Read、Write、StoreSize
Monitor & Operations
42. hosted by
◇ Automatic computation:input/Output Size per sec.Store Size..
◇ Recommended values:Region Count
Monitor & Operations
43. hosted by
◇ (1).read request、write request、Mutate_99th_percentile、Get_99th_percentile、
ScanTime_99th_percentile、receivedBytes、sentBytes
◇ (2).compactionQueueLength、flushQueueLength、splitQueueLength
◇ (3).jvm metrics…
◇ slow request: Rpc p99、gc、compaction queue 、slow log
Monitor & Operations
HBase Metric