A lightning talk about the use of Jenkins, Docker and CoreOS for the creation of native Linux packages (debs).

1. Building native Linux
packages with Docker &
Jenkins

2. Whoami
Daniel Paulus
Open Source Consultant @ inuits.eu
Twitter/Github @dpnl87
Should start writing again @ danielpaulus.com

3. Background
Started with a nice Python application
Just `git clone` and have fun
Works fine on my machine!

4. Questions
What version of python?
Did you build your own or used system package?!
Any extra packages? Virtualenv?
How about a settings file?

5. Why not push
Docker to production?

6. I need Native packages!
There is a book on writing RPMs! An effing book!
If you don’t have the time to read it use FPM!
If you do read the book:
http://www.rpm.org/max-rpm/

7. From push to package
We are Jenkins power users
Use the pipeline plugin
Separate jobs as much as possible
Add a package job and push to repo

8. Wait a DEB?! We run
everything on CentOS..

9. Docker to the rescue

10. CoreOS build slaves
Modern, minimal base.
Consumes 50% less RAM than an average Linux.

11. Jenkins slave needs Java
mkdir /home/core/java
wget -O java.tar.gz http://
javadl.sun.com/latest
tar xzvf java.tar.gz
rm /home/core/.bashrc
echo 'export PATH=$PATH:/home/core/java/
jre1.7.0_51/bin/' > /home/core/.bashrc

12. Building the container
FROM ubuntu:14.04
RUN
apt-get update &&
apt-get -y upgrade &&
apt-get install -y build-essential &&

13. We need FPM
RUN
apt-get install -y ruby1.9.3
ruby-dev libssl-dev &&
gem install fpm --no-ri --no-rdoc

14. Actual build script
#!/bin/bash
cd /root
fpm
-s python
--python-pip /usr/local/bin/pip
--depends python-hell
-t deb
awesome-python-application

15. cat source/requirements.txt | xargs -L1 -
n1 fpm -s python --python-pip /usr/local/
bin/pip -t deb
ls python-* | xargs -L1 -n1 dpkg --info |
grep Depends | awk '{for(i=1;i<=NF;i++)
{ tmp=match($i,"python-"); if(tmp)
{ sub("python-","",$i); sub(",", "",
$i) ; print $i }}}'| sort | uniq | xargs
-L1 -n1 fpm -s python --python-pip /usr/
local/bin/pip -t deb
Dependencies? | Bash hell?

16. Artifact
eb548833ba525bd4f8c296759f8894c8
python-awesome-python-application-1-1.x86_64.rpm
pulp-admin rpm repo uploads rpm --repo-id private-
builds --file /home/dpaulus/python-awesome-python-
application-1-1.x86_64.rpm
pulp-admin rpm repo publish run --repo-id= private-
builds

17. The power of Chef
yum_repository ‘private-yum-repo‘ do
description “private-yum-repo“
baseurl “http://www.inuits.eu/yum/stable/“
action :create
end
package 'python-awesome-python-application' do
action :upgrade
end

18. Meetup!
http://www.meetup.com/
Benelux-Chef-Meetup
Friday, September 18, 2015
9:30 AM to 5:00 PM
Schuberg Philis
Boeing Avenue 271, Schiphol-Rijk