pharos is a management tool to control and monitor 'Containers' of Docker(https://www.docker.com/) on a distributed cluster.

1. https://github.com/DockerKorea/pharos
https://github.com/DockerKorea/pharos-web
gopass2002@gmail.com

2. Pharos
 Docker Cluster Monitoring tool
 container resource monitoring
 container event monitoring
 lifecycle, resource alert, …

3. Daemons
 LightKeeper
 노드 당 한개 씩 존재하며, 해당 노드에서 동작 중인 컨테이너의
메트릭스 정보, 이벤트 정보를 수집
 LightTower
 클러스터에 한 개가 존재하며, 클러스터의 정보를 클라이언트에게
제공
 이벤트 boradcast

4. /proc
|-- 1
|-- 10
|-- 1001
|-- 1004
|-- 1019
|-- 10331
|-- 1025
|-- 10289
|-- 1029
|-- 10290
|-- 1030
|-- 1031
|-- 10676
|-- 10729
|-- 10730
|-- 10742
`-- ...
docker top ab555b981
UID PID PPID C STIME TTY TIME CMD
root 10331 16849 0 06:31 ? 00:00:00 ping 8.8.8.8
/proc/10331/
|-- cmdline
|-- cpuset
|-- environ
|-- io
|-- mem
|-- mountinfo
|-- mounts
|-- mountstats
|-- net
| |-- dev
| |-- stat
| |-- tcp
| |-- udp
| |-- unix
| `-- ...
|-- stack
|-- stat
|-- status
|-- task
| `-- 10331
`-- ...
Light Keeper Light Tower
Pharos
collect
lookup
lookup
Mount host:/proc -> container:/pharos/proc

5. Docker Node
Metric
Collector
Event
Monitor
LightKeeper
Other Containers
(File, mongoDB)
Storage
collect
Command Line
Interface
Web
Interface
event
query
Docker Node
Metric
Collector
Event
Monitor
LightKeeper
Other Containers
collect event
events events
Broadcast
Event
metrics metrics
LightTower
Event Collector REST API

13. pharos
|-- __init__.py
|-- cli
| |-- __init__.py
| |-- cluster.py
| `-- main.py
|-- common
| |-- __init__.py
| |-- data.py
| `-- util.py
|-- config.py
|-- display
| |-- __init__.py
| `-- window.py
|-- lightkeeper
| |-- __init__.py
| |-- main.py
| `-- node.py
|-- lighttower
| |-- __init__.py
| |-- container.py
| |-- event.py
| |-- main.py
| `-- node.py
`-- storage
`-- mongodb.py
python(2.7.x)를 기준으로 구현 (go로 전환할 수 있는 여지
있음)
주요 외부 package
• psutil: process 단위 metrics 수집
• pymongo: mongoDB python client
• docker-py: docker remote api python client
• requests: http 호출
• pyyaml: configuration

14. Create
Export
Destroy
Kill
Restart
Unpause
Die
Pause
Start Stop

15. • event의 예
• 생명주기
• 생명주기 관련 이벤트 컨테이너의 non-zero return code
life_cycle#ubuntu-dev#d2n9j29f1#{Id: d2n9j29f1…, status: stop, exit_code: -1}
• 분산 노드에서 동작 중인 컨테이너를 control 할 수 있게 구현 필요(docker remote API)
(run, stop, kill, inspect, …
• 자원 *
• 컨테이너의 의도치 않은 자원의 과도한 점유
(할당한 자원보다 더 많은 자원 점유)
res_alert#ubuntu-dev#d2n9j29f1#{resource metrics…}
• event message 구조 정의
• 다양한 언어의 listener를 지원 (python, java, javascript …)

16. Broadcast Event
Event Listener API
Subscribe

17. class EventListener(object):
def __init__(self, host, containerId):
# connect to publisher
...
def subscribe(self, kindOfEvent, handler):
registerSubsctibeTopic(kindOfEvent, handler)
...
def listen(self):
# support asynchronize(non-blocking) listener
while True:
event = subscriber.recvEvents()
getHandler(event.kindOfEvent).call(event, contoller)
...
def lifeCycleHandler(event, controller):
# do something
if event.status == 'stop' and event.exitCode != 0:
controller.restart(event.containerId)

18. interface EventListener{
void onContainerStarted(Event event, ContainerController controller);
void onContainerStopped(Event event, ContainerController controller);
void onContainerKilled(Event event, ContainerController controller);
void onContainerPaused(Event event, ContainerController controller);
void onContainerUnpaused(Event event, ContainerController controller);
}
class LifeCycleEventHandler implements EventListener{
@Override
public void onContainerStarted(Event event, ContainerController controller) {
//do something
}
@Override
public void onContainerStopped(Event event, ContainerController controller) {
//do something
}
@Override
public void onContainerKilled(Event event, ContainerController controller) {
//do something
}
@Override
public void onContainerPaused(Event event, ContainerController controller) {
//do something
}
@Override
public void onContainerUnpaused(Event event, ContainerController controller) {
//do something
}
...
}

19. https://github.com/imatix/zguide/tree/master/examples/
Ada Replace old XREP and XREQ examples with ROUTER and DEALER 3 years ago
Basic Improved code blocks throughout text. 4 years ago
C# fixed C# rrbroker bug 11 months ago
C++ Simplify C++ version of hwserver 3 months ago
C Include time.h and sys/time.h on Linux systems 2 months ago
CL Edited Chapter 4 2 years ago
Clojure add caveat for interop between jzmq/jeromq. 27 days ago
Delphi Rebuilt whole Guide a year ago
Erlang Edited Chapter 4 2 years ago
F# Edited Chapter 4 2 years ago
Felix Added Felix README file 3 years ago
Go Add three examples in Go for Chapter 3, including peering1/2/3.go 9 months ago
Haskell Merge branch 'master' of git://github.com/imatix/zguide a month ago
Haxe Edited Chapter 4 2 years ago
Java Handle state when broker doesn't respond 3 months ago
Lua Edited Chapter 4 2 years ago
Node.js Add Node.js version of `identity` example 11 months ago
OCaml Adding tasksink2 and taskwork2 to OCaml examples. a month ago
Objective-C Fix examples in CL, Closure, Haskell, Objective-C 3 years ago
PHP Fix unknown variable $request 2 months ago
Perl lpclient.pl: move main code loop into a main() sub. 6 months ago
Python Fix that when a variable with ttl=0 was created it was deleted direct… 8 months ago
Q Rewrote most of Chapter 3 2 years ago
Racket Updating examples for Planet 2 package system 2 years ago
Ruby Correct 'ZMQ::Device.new' wrt. method signature 6 months ago
Scala added example for lazy pirate server in Scala 2 months ago
Tcl Fixed comments in examples 9 months ago
listings Work on Clone Server 4 4 years ago
models mdp_worker.md changed because of the fix in specs.gsl a month ago
ooc Improved code blocks throughout text. 4 years ago

20. Language/Framework Name Repository Status
C# Docker.DotNet https://github.com/ahmetalpbalkan/Docker.DotNet Active
Erlang erldocker https://github.com/proger/erldocker Active
Go go-dockerclient https://github.com/fsouza/go-dockerclient Active
Go dockerclient https://github.com/samalba/dockerclient Active
Groovy docker-client https://github.com/gesellix-docker/docker-client Active
Java docker-java https://github.com/docker-java/docker-java Active
Java docker-client https://github.com/spotify/docker-client Active
Java jclouds-docker https://github.com/jclouds/jclouds-labs/tree/master/docker Active
JavaScript (NodeJS) dockerode https://github.com/apocas/dockerode Install via NPM: npm install dockerode Active
JavaScript (NodeJS) docker.io https://github.com/appersonlabs/docker.io Install via NPM: npm install docker.io Active
JavaScript docker-js https://github.com/dgoujard/docker-js Outdated
JavaScript (Angular)WebUI docker-cp https://github.com/13W/docker-cp Active
JavaScript (Angular)WebUI dockerui https://github.com/crosbymichael/dockerui Active
Perl Net::Docker https://metacpan.org/pod/Net::Docker Active
Perl Eixo::Docker https://github.com/alambike/eixo-docker Active
PHP Alvine http://pear.alvine.io/ (alpha) Active
PHP Docker-PHP http://stage1.github.io/docker-php/ Active
Python docker-py https://github.com/docker/docker-py Active
Ruby docker-api https://github.com/swipely/docker-api Active
Ruby docker-client https://github.com/geku/docker-client Outdated
Rust docker-rust https://github.com/abh1nav/docker-rust Active
Scala tugboat https://github.com/softprops/tugboat Active
Scala reactive-docker https://github.com/almoehi/reactive-docker Active
https://docs.docker.com/reference/api/remote_api_client_libraries/

21. • Storage의 경량화(dockerize), 다양화
• Pharos 설치 용의성 향상, 경량화
• MongoDB(현재) -> Redis, statsD …
• 다양한 언어의 Event Listener 지원 필요
• python, java, nodejs …
• Visualize
• D3, Graphite …
• License
• 코드 개작을 제외한 모든 것 허용
• 테스트 서버 공유
• AWS …
앞으로..