Learn how contributors to the Go build system modified build.golang.org to perform all Linux 386 and x64 builds on Kubernetes and Google Container Engine. From cluster discovery and authentication to optimizing Kubernetes API calls and using the watch API, learn about the ins and outs of using Kubernetes from a Go client to coordinate a large distributed build system. To Go build system (https://build.golang.org), like the Go programming language itself, is an open source project. Written in Go, the build system is responsible for building, testing, and validating every commit made to the Go programming language across every platform and architecture the language supports (almost 40!). Many contributors commit many changes, resulting in hundreds of builds and thousands of tests running each day. Linux 386 and x64 builds previously ran on Google Compute Engine. Each build required a VM boot, then the build and tests ran for several minutes, and the VM was terminated. Although GCE is much better than EC2 for this type of workload (with ~40s boot times, 10-minute minimum billing, and per-minute billing thereafter), Kubernetes offered the possibility of even faster build times and the ability to optimize for scale and cost (especially as the popularity of Go grows). KubeCon schedule link: http://sched.co/4V8W

1. Photo by Bureau of Land Management
https://flic.kr/p/sZF6fa
https://creativecommons.org/licenses/by/2.0/legalcode
Go, Build it on a Cluster

2. @evandbrown

3. json gif

4. json > yaml

6. ank youTh
90

7. endan Burns
HeDawn C n
2
Br
35
Alex Ro nsonBi
83
m HockinTi
81

8. Photo by Roman Boed
https://flic.kr/p/fCgL2a
https://creativecommons.org/licenses/by/2.0/legalcode

9. Photo by Andrew E. Larsen
https://flic.kr/p/5DaGbH
https://creativecommons.org/licenses/by/2.0/legalcode

10. @ adfitzBr
35

11. Photo by David Bergin
https://flic.kr/p/fTNgVn
https://creativecommons.org/licenses/by/2.0/legalcode

12. CONTAINERS?

13. Photo by David Bergin
https://flic.kr/p/fTNgVn
https://creativecommons.org/licenses/by/2.0/legalcode

14. DEV/OPS

15. Photo by David Bergin
https://flic.kr/p/fTNgVn
https://creativecommons.org/licenses/by/2.0/legalcode

16. CONTINUOUS
INTEGRATION

17. golang.org/x/build

20. GCE instance
Runs coordinator bin
Polls source repo for changes
the
farmer

21. the farmer
buildlet

22. the farmer
go.googlesource.com
GCE instance
Runs buildlet bin
Receives commands to execute from farmer
Responds with results
Instance terminated
buildlet

23. the farmer buildlet
buildletbuildlet
buildlet
buildlet buildlet
bui
bui
bui

24. buildlet
buildletbuildlet
buildlet
buildlet buildlet
bui
bui
bui
Google
Compute
Engine

25. Path
to Kubernetes

26. Using the
Kubernetes API
from a Go Client

27. Discovery Operations
Efficiency Hygiene

28. Two Takeaways
google.DefaultClient
cluster.MasterAuth

29. Photo by Tambako the Jaguar
https://flic.kr/p/iGCKUS
https://creativecommons.org/licenses/by/2.0/legalcode

30. Bur DoganCu
29
Andrew rrandGe
32

31. Discovery Operations
Efficiency Hygiene

32. One Takeaway
Nurture your cattle

33. $ kubectl exec

34. elsey HightowerK
19

35. $ kubectl proxy

36. Discovery Operations
Efficiency Hygiene

37. One Takeaway
Monitor pod state with the
watch API

38. Discovery Operations
Efficiency Hygiene

39. One Takeaway
Use context and ctxhttp,
especially with watch api

40. Fatih slanAr
18

41. golang.org/x/build
@evandbrown