In this tutorial, I will introduce RabbitMQ as a solution to scalable, interoperable, flexible applications. This tutorial is perfect for those who want to dive deep into RabbitMQ with little or no pre-existing knowledge about message queuing systems. Once you have finished the tutorial, you will know how to set up basic publish/subscribe message queues, control the flow of messages using various exchanges, and understand various features of RabbitMQ, such as RPC, TTL, and DLX.

1. this slide is intentionally left blank

2. Before we begin...
Copy folder from USB to your local machine.
$ cd /path/to/the/folder/you/copied/from/usb/
$ vagrant box add asgrim/rmq-vm rmq-vm.box
$ vagrant up --no-provision
Test it in your browser...
http://192.168.33.99:15672/
@asgrim

3. Introducing
Practical RabbitMQ
James Titcumb
@asgrim

6. James Titcumb
www.jamestitcumb.com
www.roave.com
www.phphants.co.uk
www.phpsouthcoast.co.uk
@asgrim
Who is this guy?

7. What is a message?
@asgrim

8. What is message
queueing?
@asgrim

9. Photo: http://spitalfieldslife.com/2011/08/27/a-fox-in-hoxton-2/

10. Separation of Concerns
@asgrim

11. Scaling with Rabbit
RabbitMQApplication
Background processing
@asgrim

12. Scaling with Rabbit
RabbitMQApplication
Background processing
Background processing
@asgrim

13. Scaling with Rabbit
RabbitMQApplication
Background processing
Background processing
Background processing
@asgrim

14. Scaling with Rabbit
RabbitMQApplication
Background processing
Background processing
Background processing
Background processing
@asgrim

15. Scaling with Rabbit
RabbitMQApplication
Background processing
Background processing
Background processing
Background processing
Background processing
@asgrim

16. Real world uses?
@asgrim

17. SOA
@asgrim

18. Why RabbitMQ?
@asgrim

19. (you need Vagrant+VirtualBox already)
Installing RabbitMQ
@asgrim

20. vagrant up
Copy folder from USB to your local machine.
$ cd /path/to/the/folder/you/copied/from/usb/
$ vagrant box add asgrim/rmq-vm rmq-vm.box
$ vagrant up --no-provision
Test it in your browser...
http://192.168.33.99:15672/
@asgrim

21. Library with Composer
composer require videlalvaro/php-amqplib
@asgrim

22. The Management Console
http://192.168.33.99:15672/
@asgrim

23. Practical
@asgrim

24. Objective: Basic Queuing
Producer Consumer
test_queue
1 2 3 4 5
@asgrim

25. Exchanges: Fanout
@asgrim

26. Objective: Fanout Exchange
test_exchange
amq.KfgPZ3PE
amq.cK5Cp3FC
Consumer
Consumer
Producer
1
1
2
2
3
3
4
4
5
5
@asgrim

27. A word on Temporary Queues
test_exchangeProducer
Messages
go nowhere
@asgrim

28. Exchanges: Direct
@asgrim

29. Objective: Direct Exchange
test_direct
BK = apple
BK = banana, apple
Consumer
Consumer
Producer
BK = orange, banana,
apple
Consumer
@asgrim

30. Objective: Direct Exchange
test_direct
BK = apple
BK = banana, apple
Consumer
Consumer
Producer
MESSAGE
ROUTING KEY
= ORANGE
BK = orange, banana,
apple
Consumer
@asgrim

31. Objective: Direct Exchange
test_direct
BK = apple
BK = banana, apple
Consumer
Consumer
Producer
MESSAGE
ROUTING KEY
= BANANA
BK = orange, banana,
apple
Consumer
@asgrim

32. Objective: Direct Exchange
test_direct
BK = apple
BK = banana, apple
Consumer
Consumer
Producer
MESSAGE
ROUTING KEY
= APPLE
BK = orange, banana,
apple
Consumer
@asgrim

33. Exchanges: Topic
@asgrim

34. Objective:
Topic Exchange
test_topic
BK = *.vegetable
BK = #
Consumer
Consumer
Producer
BK = green.#
Consumer
BK = *.grass.* / *.*.long
Consumer
@asgrim

35. Objective:
Topic Exchange
test_topic
BK = *.vegetable
BK = #
Consumer
Consumer
Producer
RED.VEGETABLE
BK = green.#
Consumer
BK = *.grass.* / *.*.long
Consumer
@asgrim

36. Objective:
Topic Exchange
test_topic
BK = *.vegetable
BK = #
Consumer
Consumer
Producer
GREEN.VEGETABLE
BK = green.#
Consumer
BK = *.grass.* / *.*.long
Consumer
@asgrim

37. Objective:
Topic Exchange
test_topic
BK = *.vegetable
BK = #
Consumer
Consumer
Producer
GREEN.GRASS.LONG
BK = green.#
Consumer
BK = *.grass.* / *.*.long
Consumer
@asgrim

38. Message
Acknowledgement
@asgrim

39. Real World Example
@asgrim

41. Fetch message
Logging Sequence
ApplicationBrowser Log Server
HTTP request
JSON via AMQP
Error!
HTTP response
RabbitMQ
@asgrim

42. Flexibility!
@asgrim

43. Parallel Processing
@asgrim

44. test_exchange
amq.KfgPZ3PE
amq.cK5Cp3FC
Consumer
Producer
1
1
2
2
3
3
4
4
5
5
Consumer
Consumer
Consumer
Consumer
Consumer
Consumer
Consumer
Parallel Processing
@asgrim

45. Photo: © Rob Allen (akrabat) https://flic.kr/p/6wp9iz
@asgrim

46. RPC
@asgrim

47. RPC example
Producer Consumer
test_queue
1
reply_to: amq.gen-Xa2
1’
@asgrim

48. TTL
@asgrim

49. TTL - per queue message
Producer Consumer
test_queue
1 2 3 4 5
}
10s@asgrim

50. TTL - per message
Producer Consumer
test_queue
1 2 3 4 5
5s 3s 7s 1s 9s@asgrim

51. TTL - queue
Producer
test_queue
}
5s (if no consumers)
@asgrim

52. DLX
@asgrim

53. DLX
test_exchange
amq.KfgPZ3PE
Producer 1
dlx_exchange
dlx_queue
1
@asgrim

54. Scheduling / Delayed messages
@asgrim

55. Shovel
@asgrim

56. Priority
@asgrim

57. Management HTTP API
@asgrim

58. Infrastructure
@asgrim

59. Problem: SPOF
@asgrim

60. Solution 1: Clustering
@asgrim

61. Clustering
RabbitMQ
Node 1
RabbitMQ
Node 3
RabbitMQ
Node 2
RabbitMQ
Node 4
RabbitMQ
Node 5
RabbitMQ
Node 6
Load Balance / Floating IP / Low TTL DNS etc.
@asgrim

62. Everything Replicates
(except queues…)
@asgrim

63. Disk / RAM
@asgrim

64. Configuration...
@asgrim

65. /etc/rabbitmq/rabbitmq.config
[
{rabbit, [
{loopback_users, []},
{vm_memory_high_watermark, 0.8}
]}
].
@asgrim

66. /etc/rabbitmq/rabbitmq.config
[{{{[{{[{{}}{][[[{[{{}[[}{[[{}[][}{}}}{}}{{,},]{
[[{rabbit, [{{}[[}{,,{}[][}{[][][{}{{{{}}}}[[}{{
{{}}{loopback_users, []},[][][]{}{}{}<}{[}[][][}
[{{[{vm_memory_high_watermark, 0.8}]]{}{[[[]]{}]
{{]}[{[{{}[[}{]]{}[][,{}[][}{[][][{}.[]}{]][][]}
]...{}[][,]{.}[][}{}[[[{}{][]}{}{}[}{}{}{]{}{}}[
@asgrim

67. node1$ rabbitmqctl cluster_status
Cluster status of node rabbit@node1 ...
[{nodes,[{disc,[rabbit@node1]}]},{running_nodes,[rabbit@node1]}]
...done.
Creating a cluster
@asgrim

68. node2$ rabbitmqctl join_cluster --ram rabbit@node1
node3$ rabbitmqctl join_cluster rabbit@node2
node3$ rabbitmqctl cluster_status
Cluster status of node rabbit@node3 ...
[{nodes,[{disc,[rabbit@node3,rabbit@node1]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node1,rabbit@node3]}]
...done.
Creating a cluster
@asgrim

69. Starting/Stopping Nodes
@asgrim

70. node1$ rabbitmqctl stop_app
node2$ rabbitmqctl forget_cluster_node rabbit@node1
node1$ rabbitmqctl reset
node1$ rabbitmqctl start_app
node2$ rabbitmqctl cluster_status
Cluster status of node rabbit@node2 ...
[{nodes,[{disc,[rabbit@node3]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node3]}]
...done.
Removing Nodes
@asgrim

71. Solution 2: HA
@asgrim

72. HA + Queue Mirroring
RabbitMQ
Node 1
RabbitMQ
Node 2
Load Balance / Floating IP / Low TTL DNS etc.
@asgrim

73. One more thing...
@asgrim

74. Challenge!
@asgrim

75. Any questions? :)
https://joind.in/talk/8a46c
James Titcumb @asgrim