Kubernetes has many ways to scale your workloads, most of what we hear about is scaling our cluster up with either with vm sets or autoscaling groups. There is another way, in this talk we will look at virtual kubelet. Virual Kubelet will allow us to talk to a cloud providers container as a service platform like ACI, fargate or ECI. We will deep dive into how you can scale your applications across virtual kubelet. One issue is the kubernetes service type has is scaling to zero due to the way routing to the pod happens if there is no pod for the service to route too. Scaling our applications to zero is just as important and scaling up. We will look at projects that integrate with the horizontal pod autoscaler that fix this issue. Allowing us to not only scale our applications up but as easily down to make our cluster truly elastic.

2. @chanezon
1994-2005
Software Engineer
2005-2019
Developer Relations

3. @scottcoulton
scotty-c
Scott Coulton
Developer Advocate
Spent the last 4 years on
container related
development
Golang fan
CNCF Ambassador
Docker Captain

4. @scottcoulton

5. @scottcoulton

6. What is the horizontal pod autoscaler ?
@scottcoulton

7. What is the horizontal pod autoscaler ?
@scottcoulton

8. Does everyone understand what the HPA is?
@scottcoulton

9. @scottcoulton

10. We have two options
• Virtual machines (traditional compute nodes)
• Virtual Kubelet
Scaling your compute
@scottcoulton

11. No matter your cloud of choice there are similar
implementations to scale compute.
Scaling your compute – Virtual machines
@scottcoulton

12. Scaling your compute – Virtual machines
@scottcoulton

13. Most clouds allow you to
• Scale machines up under load
• Scale machines back down to a specified number
Scaling your compute – Virtual machines
@scottcoulton

14. What is different about virtual kubelet to traditional compute
 Remove dependencies on servers for worker nodes
 Allow burstable workloads
 Save consumers money on hosting
Scaling compute - Virtual kubelet
@scottcoulton

15. Scaling compute - Virtual kubelet
@scottcoulton

16. Scaling compute - Virtual kubelet
@scottcoulton

17. Scaling compute - Virtual kubelet
@scottcoulton

18.  Alibaba ECI
 AWS Fargate
 Azure ACI
 Service mesh
 Hashicorp nomad
 Openstack
 HTTP
Scaling compute - Virtual kubelet
@scottcoulton

19.  Linux
 Windows
 GPU's
Scaling compute - Virtual kubelet
@scottcoulton

20. nodeSelector:
kubernetes.io/role: agent
beta.kubernetes.io/os: linux
type: virtual-kubelet
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- key: azure.com/aci
effect: NoSchedule
Deploying an application on to virtual kubelet
@scottcoulton

21. Scaling to zero
@scottcoulton

22. @scottcoulton

23. @scottcoulton

24. @scottcoulton

25. Kubernetes metrics server
@scottcoulton

26. @scottcoulton

27. @scottcoulton @chanezon

28. @scottcoulton

29. https://kedacore.azureedge.net/helm
@scottcoulton

30. @scottcoulton

31. nodeSelector:
kubernetes.io/role: agent
beta.kubernetes.io/os: linux
type: virtual-kubelet
tolerations:
- key: virtual-kubelet.io/provider
operator: Exists
- key: azure.com/aci
effect: NoSchedule
@scottcoulton

32. @scottcoulton

33. @scottcoulton

34. @scottcoulton

35. https://github.com/scotty-c/kubecon
@scottcoulton

36. Further learnings on virtual kubelet
@scottcoulton
https://www.youtube.com/watch?v=v9cwYvuzROs&list=PLj6h78yzYM2P
pmMAnvpvsnR4c27wJePh3&index=169

37. Questions
@scottcoulton