How to scale the creation and maintenance of pipelines when dealing with thousands of jobs

1. Jenkins World Tour 2015
London, UK, June 2015
1

2. #jenkinsconf
Scaling of Jenkins Pipelines
Damien Coraboeuf
Clear2Pay

3. #jenkinsconf
Footer
Jungle of jobs

4. #jenkinsconf
Footer
Jungle of jobs
4

5. #jenkinsconf
Footer
Goals
• Self service
• Security
• Simplicity
• Extensibility
5

6. #jenkinsconf
Footer
First steps
• Self service
• Security
• Simplicity
• Extensibility
6
Job DSL plug-in

7. #jenkinsconf
Footer
Going forward
• Self service
• Security
• Simplicity
• Extensibility
7
Most of the pipelines are the same

8. #jenkinsconf
Footer
Pipeline DSL library
8

9. #jenkinsconf
Footer
The Shopping List
• No code – properties
• Pipeline library
• Pipeline version
• Configuration
• Extensions
9
# Which pipeline/version to use
seed.dsl.libraries =
com.clear2pay.build:opf-pipeline:1.2.0
# Configuration of the pipeline
pipeline.notification.ci = my-dev-list
pipeline.notification.qa = my-qa-list
pipeline.ci.platforms = wps70,wps85
pipeline.qa = yes

10. #jenkinsconf
Footer
Pipeline as code
• The shopping list lives with your branch
• Traceability + pipeline history
10

11. #jenkinsconf
Footer
How does it look like?
11

12. #jenkinsconf
Footer
Branches
12

13. #jenkinsconf
Footer
Branch pipeline
13

14. #jenkinsconf
Footer
Overview

15. #jenkinsconf
Footer
Responsibilities
15

16. #jenkinsconf
Footer16
Out of the jungle…

17. #jenkinsconf
Footer17
Thanks you!
@DamienCoraboeuf
https://wiki.jenkins-ci.org/display/JENKINS/Seed+Plugin