my talk in the phpXperts seminar 2011, Dhaka.

1. Supervisor, Gearman and PHP - Job
management with sanity!
ABU ASHRAF MASNUN

2. What is it all about?
 PHP
 Gearman
Supervisor
 Job Management

3. Let’s get REAL!
Deploy Ninja – A case study
PROPOSED FEATURES
 Deployment Solution (SVN to s/FTP)
 Trigger URL – Web Hooks
 Deploy Now – Deploy the latest right now
 Full Deploy – Upload the entire repo again

4. How to train our Ninja?
What did we have to do?
REQUIREMENTS
 Tasks Involved:
 Fetch the repo
 Upload to the server
 Instant processing
 Process separation for the three deployment
types

5. And cometh the tragedy!
The day my life sucked !^@# 
ARCHITECTURAL CHALLENGES
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

6. Gearman, the super hero!
He came and saved my a$$ 
GEARMAN FEATURES
 Distributed workload management
 Client – Worker Architecture
 Multiple workers
 Multi-lingual workers

7. Gearman: How it works?
Understanding Gearman

8. Gearman: Installation
Are you ready? QR Code
Install Gearman:
sudo apt-get install gearman
Install Libgearman:
sudo apt-get install libgearman-dev
Install the PHP Extension:
sudo pecl install
channel://pecl.php.net/gearman-0.8.0

9. Gearman: Daemonizing!
Starting Gearman QR Code
Running Gearman
Daemon: sudo gearman –d –u root
Debugging Gearman (Verbose mode) :
sudo gearman –d -vvv –u root

10. QR Code
Gearman: Workers
PHP Worker

11. QR Code
Gearman: Workers
Breaking it down!

12. QR Code
Gearman: Workers
Breaking it down!

13. QR Code
Gearman: Clients
Requesting a job!

14. Gearman: Alternatives!
Who else is there?
 RabbitMQ
 ZeroMQ
 Apache MQ
 Dropr
 Microsoft MQ

15. Whew! Almost done!
Life is getting better
CHALLENGES STATUS
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

16. Meet Supervisor!
Here comes the tough guy!
SUPERVISOR FEATURES
 Simple & Centralized
 Efficient & Extensible
 Compatible & Proven
It monitors your processes and restarts as
instructed!

17. Supervisor: Installation!
Let’s go! QR Code
sudo apt-get install python-setuptools
sudo easy_install supervisor

18. Supervisor: Getting Started!
Config, debug and run! QR Code
sudo echo_supervisord_conf >
/etc/supervisord.conf
sudo supervisord -n
sudo supervisord

19. Hurray! We’re done!
Life is so good :D
CHALLENGES STATUS
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

20. What’s your Story?
You can do it too!
USE CASES
 Image Processing?
 Cache Regeneration?
 Mass emails?

21. That was Simple! Eh?
Got anything to ask?

22. The Leevian!
Who am I?
ABU ASHRAF MASNUN
Software Engineer @ Leevio
http://masnun.com
masnun@leevio.com