Microservices with Node.js and RabbitMQ. Case study of real world infrastructure scalability using data-layer-rabbitmq library. https://github.com/bdswiss/data-layer-rabbitmq Presented at Node.js Athens Meetup, Dec 17 2015

1. Microservices with
Node.js and RabbitMQ
Paulius Uza, CTO @ BDSwiss
17 December 2015

2. - Financial Institution
- 500K+ retail customers worldwide
- Financial product for retail customers
- Customer facing web services handle 50M+ requests per month

3. Infrastructure
Postgres Mongo Redis
AWSHeroku
ProductCRM

4. - Financial Institution
- 500K+ retail customers worldwide
- Financial product for retail customers
- Customer facing web services handle 50M+ requests per month
- Multiple financial products, multiple regions

6. Infrastructure
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2

8. 5 minutes later…
From: sales@problem.com
To: developers@problem.com
Hey, good work on the new product launch. How can we lookup the customer’s
information for all products from one CRM?

9. 5 minutes later…
From: sales@problem.com
To: developers@problem.com
Hey, good work on the new product launch. How can we lookup the customer’s
information for all products from one CRM?

10. Infrastructure
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2

11. Infrastructure
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2

12. Infrastructure
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2
CRM
#
Product
#

13. Requirements
- Enable new business capabilities
- Keep products de-coupled
- Horizontal scalability everywhere
- Plug & Play, self-healing infrastructure
- Keep the maintenance of the infrastructure to bare minimum

14. Solution: Data Layer
message queue based communication layer for microservices

15. Before
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2

16. After
Postgres Mongo Redis
AWSHerokuProduct
1
CRM
1
CRM
2
Product
2
RABBIT MQ
Master
CRM

17. Demo Time

18. How to use it?
- Use message queues as a transport between micro-services (e.g. RabbitMQ)
- Include Data Layer into your micro-services as add-on to create interconnections
BONUS: ETCD
- Use ETCD for dynamic and distributed configuration of the microservices infrastructure
- Use ETCD configuration to publish on and subscribe to message queues and exchanges
- Cloud ETCD available at www.compose.io/etcd

19. Data Layer is now Open Source
github.com/bdswiss/data-layer-rabbitmq
License MIT

20. Thanks!
Paulius Uza, CTO @ BDSwiss
Special thanks to Christos Alatzidis and Jonathan Panagiotidis
https://github.com/bdswiss
https://angel.co/pauliusuza
https://twitter.com/pauliusuza