Slides from JustEat's Andrew Brown and Alberto Blanco at the 1st London HashiCorp Meetup Andrew - Core Platform using Consul & Packer Alberto - Acquired Platforms using Terraform & Vagrant

1. HashiCorp at JUST EAT
ANDREW BROWN - Senior Platform Engineer

2. Overview
Core Platform - Using Consul & Packer
Acquired Platforms - Terraform & Vagrant

3. • The world’s leading digital marketplace for takeaway food delivery
• Operate in 13 markets around the globe
• Platform peak ~ 2,500 orders per minute
JUST EAT

4. TECHNOLOGY
• Migrated to AWS (Amazon Web Services) 4 years ago
• Run hundreds of Instances at peak - daily scaling to match demand
• Heavily utilise CloudFormation

5. AWS - Setup
• Multiple AWS Accounts
• QA Daily Launch and Teardown
• On average an instance less than 3 days old

6. Before Consul…..
CONFIGURATION
• JSON file bundled with application package
• Deployment step to “Generate Config”
SETTINGS
• Feature settingsapi
• key/values stored in DynamoDB

7. Before Consul…..
SERVICE DISCOVERY?
• DNS -> Endpoint of the Elastic Load Balancer
• Hard-coded Ips

8. Consul Setup
● Consul Cluster per environment
● JSON config stored in GitHub in templated format
● Generator run via TeamCity
● Config committed to “Generated Repository”

11. After Consul….
• Instance joins the Consul Cluster during Deployment
• Service registered on consul cluster
• Consul-Template generates config files

12. Benefits of Consul
• No need to cycle instances (seconds vs minutes)
• PR to Github to change and validate Config
• Consistent Config
• UI - Platform and Health Overview

13. Consul MetaData
• Recently launched a “Platform Consul Cluster”
• MetaData Generated using same mechanism as Features
• Powering other tools used in Just Eat

14. Finally…. Packer
BAKED AMI (Amazon Machine Image)
• All Dependencies Pre-installed
• CloudFormation reduced (removed 500 lines of json)
• Significantly reduced deployment time (Linux and Windows)
• AMI ID pushed to Consul - Config now stores “AMI Name”

15. HashiCorp at
Acquired Platforms
ALBERTO BLANCO - Platform Developer

16. What we do?

17. Yes, correct! we acquire platforms

18. And we look after them too...

19. So we do...

22. What we value the most of Terraform
● Abstraction
● Infrastructure versioning
● A common language
● Lifecycle
● Dependency resolution

23. Starting for scratch

24. The three S’s
Stability
Scalability
Security
And also we want to keep releasing!
And monitor it properly!
to the cloud!

25. A reproducible deployment pipeline
As much as cloud agnostic as we can
Using Terraform as the base

26. How we deal with it
Consul for config
...and tfstate files

27. How we deal with it
On top of the base we put the rest

28. How we deal with it
On top of the base we put the rest

29. How we deal with it
On top of the base we put the rest

30. Here our tools...
● Terraform, the base
● Ansible for provisioning
● Capistrano for some deployments
● Consul for configs and tfstate
● Vagrant for local development
● Jenkins for orchestration

31. More HashiCorp to come for us...
● Packer for sharing artifacts and images
between providers
● Vault for secrets

32. Any questions?

33. We are hiring!
Come talk to us.

34. Thank you