Arcus is data caching cloud developed on Memcached which is a memory-based Key-Value repository. It was developed meeting requirements from various NHN services. Arcus is capable of having up-to-date cache server list of clients using ZooKeeper and also able to possess cloud architecture flexible to add or delete caching servers while eliminating extra network latency between client and server. Furthermore, to support save/ computation function of data collection which is becoming a requirement among many services, it provides list, set, b+tree structures. http://sdec.kr/

1. Arcus:NHNMemcachedCloud
박준현/NHN

2. ARCUS
2 / SDEC 2011 발표자료

3. ARCUS개발배경
•
•
•
•
•
•
3 / SDEC 2011 발표자료

4. ARCUS개발배경
•
•
4 / SDEC 2011 발표자료

5. ARCUSCacheCloud
•
•
•
•
•
•
5 / SDEC 2011 발표자료

6. Memcached
•
•
•
•
•
6 / SDEC 2011 발표자료

7. MemcachedOperations
• Commands
•
•
• , )
• ,
( ),
7 / SDEC 2011 발표자료

8. MemcachedOperationExamples
•
set
key
flags
exptime
bytes
[noreply]rn
valuern
[jhpark@XXXX]$
telnet
localhost
11211
get
keyrn Trying
127.0.0.1...
Connected
to
localhost.localdomain
(127.0.0.1).
Escape
character
is
'^]'.
set
sample_key
0
0
12
sample_value
STORED
get
sample_key
VALUE
sample_key
0
12
sample_value
END
8 / SDEC 2011 발표자료

9. MemcachedPerformance
•
Throughput (TPS) Response Time
250000 (microsec)
800
200000 700
600
150000
500
400
100000
300
200
50000
100
0 0
9 / SDEC 2011 발표자료

10. ConsistentHashing
•
•
•
Key z Node 3
Node 2
Remapped to
Join
Node 3
Key y
Node 1 Remapped to
Node 1
Node 0
Key x
Leave (Failure)
10 / SDEC 2011 발표자료

11. ConsistentHashing
•
Node 0 Node 2 •
Node 2 Node 0 •
Node 0 •
Node 1
•
Node 1 Node 2
Node 1
Node 1
Node 2
Node 2
Node 0
Node 0
Node 1
11 / SDEC 2011 발표자료

12. Arcus1.5Architecture
Clients Cache Nodes
Consistent hashing
Java C Smart Client
+ Local caching (Java) Unified Cloud Admin
(Zookeeper ensemble)
12 / SDEC 2011 발표자료

13. ZookeeperIntegration
•
•
•
•
•
•
•
•
13 / SDEC 2011 발표자료

14. ZookeeperIntegration
Clients Cache Nodes
Cache Node List M
aintenance
Zookeeper Ensemble
Cache Node List
------------------
Node 1 IP:Port
Node 2 IP:Port
Node 3 IP:Port
Node 4 IP:Port
Cache Node 구동
Zookeeper 세션 연결
Ephemeral Node 수동 생성
14 / SDEC 2011 발표자료

15. Arcus1.5Memcached
•
•
Memcached Core
ZK
Community Engine Client
Default Arcus
Engine Engine
15 / SDEC 2011 발표자료

16. Collection개발배경
•
• ­–
• ­–
• ­–
•
•
•
•
•
16 / SDEC 2011 발표자료

17. Collection개요
•
• ­–
•
•
• ­–
• 64bitintegerkey(bkey),value
•
•
•
•
•
17 / SDEC 2011 발표자료

18. Collection저장구조
Hash Table For Uniqueness Checking
header key value
value2
..
.
header key setinfo
item Forward/Backward Range Scan
header key b+treeinfo
..
.
bkey1 .. ..
.
.
value
18 / SDEC 2011 발표자료

19. NAVERMeCollection활용사례
정보콘텐츠on네이버
카페 블로그
뉴스 웹툰
책 뮤직
etc...
지식인
19 / SDEC 2011 발표자료

20. NAVERMeCollection활용사례
• ­–
SELECT
*
FROM
messages
WHERE
feedid
in
(feedID1,
feedID2,
…,
feedIDn)
AND
create_time
sysdate()
ORDER
BY
create_time
DESC
LIMIT
20;
•
•
•
•
20 / SDEC 2011 발표자료

21. NAVERMeCollection활용사례
•
•
• ­–
Push Delivery
User Inbox 1
Feed 1
User Inbox 2
Feed M
User Inbox N
21 / SDEC 2011 발표자료

22. NAVERMeCollection활용사례
구독관계Cache
(SETtype)
사용자별
구독글목록Cache
(B+Treetype)
구독글내용Cache
(K/Vtype)
22 / SDEC 2011 발표자료

23. BulkInsert
•
•
•
•
•
•
23 / SDEC 2011 발표자료

24. SequentialCommandExecution
• Client Server
0 ms
•
• 40 usec
1 ms
•
40 usec
•
2 ms
•
40 usec
• 3 ms
24 / SDEC 2011 발표자료

25. Server-sideCommandPipelining
• ­– Client Server
•
0 ms
120 usec
•
1.x ms
•
•
25 / SDEC 2011 발표자료

26. OtherFeatures
•
•
•
•
•
•
New Technology
Requirements New Idea Features
New Products
26 / SDEC 2011 발표자료

27. ArcusandMembase
기술 협조,
공동 개발
Memcached 기반
Elastic data cloud
27 / SDEC 2011 발표자료

28. 28 / SDEC 2011 발표자료