Code testing and Continuous Integration are just the first step in a source code to production process. Combined with infrastructure-as-code tools such as Puppet the whole process can be automated, and tested!

1. CONTINUOUS
DELIVERY, THE
NEXT FRONTIER
Carlos Sanchez
@csanchez
http://csanchez.org
http://maestrodev.com

2. @csanchez
Apache
Maven
ASF
Member
Eclipse
Foundation
csanchez.org

3. How we got here

4. Agile
planning
iterative development
continuous integration
release soon, release often

7. Fear of change
Risky deployments
It works on my machine!
Siloisation
Dev Change vs. Ops stability

8. Continuous
Delivery

9. Continuous
delivery

10. Infrastructure as
Code
it’s all been invented, now it’s
standardized

11. package { 'openssh-server':
ensure => present,
}
infrastructure
IS code

12. service { 'ntp':
name => 'ntpd',
ensure => running,
}
declarative model
state vs process
no scripting

13. Follow
development
best
practices
tagging
branching
releasing
dev, QA, production
new
solutions
new
challenges

14. Containers
& Micro
Services

15. Scale
high availability
distributed apps
Google starts 20billion
containers per week

16. But it is not
trivial

17. Service
oriented
think about services,
not machines

18. Docker
Linux containers AUFS
File System Users
Processes Network

19. Docker
Linux required
but
Boot2Docker to the rescue
OS X
Windows

21. Docker
Runs anywhere!
Bare metal
Virtual Machines
Cloud
Docker

22. Docker delivery
App System
Docker image
Docker infrastructure

24. Docker Registry
Huge repository with pre-made images
PostgreSQL
Tomcat
Java
NodeJS
Jenkins
…
Multiple versions and configurations
tags

25. Docker for CD
Developer environments
CI dynamic build and test slaves

26. Docker
docker run -t -i ubuntu /bin/bash
docker ps -a
docker build -t csanchez/test .

27. Vagrant

28. Vagrant
Virtual and cloud automation
VirtualBox
VMWare Fusion
AWS
Rackspace
Easy Puppet and Chef provisioning
Keep VM configuration for different projects
Share boxes and configuration files across teams
base box + configuration files

29. Vagrant base boxes
www.vagrantbox.es
puppet-vagrant-boxes.puppetlabs.com
anywhere! just (big) files

30. using Vagrant
$ gem install vagrant
$ vagrant box add centos-6.0-x86_64
http://dl.dropbox.com/u/1627760/centos-6.0-x86_64.box
$ vagrant init myproject
$ vagrant up
$ vagrant ssh
$ vagrant suspend
$ vagrant resume
$ vagrant destroy

31. Vagrant
Vagrant.configure("2") do |config|
# Every Vagrant virtual environment requires a box to build off of.
config.vm.box = "CentOS-6.4-x86_64-minimal"
config.vm.box_url = "https://.../CentOS-6.4-x86_64-minimal.box"
# web server
config.vm.define :www do |config|
config.vm.hostname = "www.acme.local"
config.vm.network "forwarded_port", guest: 80, host: 10080
config.vm.network "private_network", ip: "192.168.33.12"
end
config.vm.provision :puppet do |puppet|
puppet.module_path = "modules"
puppet.manifest_file = "site.pp"
end
end

32. Packer

33. Packer
Immutable infrastructure
http://packer.io

34. Packer
One definition
multiple outputs
VirtualBox VM
Vagrant BOX
EC2 AMI
GCE image
Docker image
…

35. using Packer
{ "builders": [
{
"type": "virtualbox-ovf",
"source_path": "{{user `home`}}/.vagrant.d/boxes/centos-65-x64-virtualbox-nocm/
virtualbox/box.ovf",
"ssh_username": "vagrant",
"ssh_password": "vagrant",
"shutdown_command": "echo 'packer' | sudo -S shutdown -P now"
}, {
"type": "googlecompute",
"bucket_name": "maestrodev-images",
"source_image": "centos-6-v20140718",
"zone": "us-central1-a",
"image_name": "centos-6-v20140718-2-puppet",
"ssh_username": "support"
}
],
"provisioners": [ {
"type": "shell",
"inline": [
"sudo rpm -ivh https://yum.puppetlabs.com/el/6/products/x86_64/puppetlabs-release-
6-10.noarch.rpm",
"sudo yum install puppet-3.6.2 facter-1.7.6 -y" ] }
],
"post-processors": [{
"type": "vagrant",
"only": [ "virtualbox-ovf" ]}]
}

36. Examples

37. Docker
Infrastructure
Jenkins
Archiva
www
nginx
tomcat1
tomcat
db
postgres

38. Docker
images
jwilder/nginx-proxy
csanchez/appfuse-tomcat
postgres

39. Building the
application
is not
enough
war
Dockerfile
docker image

40. appfuse-tomcat
appfuse war jdbc driver
tutum/tomcat:8.0
sql

41. appfuse-tomcat Dockerfile
FROM tutum/tomcat:8.0
ENV WEBAPP_HOME $CATALINA_HOME/webapps/ROOT
RUN apt-get update && apt-get install -y unzip curl postgresql
RUN rm -rf $CATALINA_HOME/webapps/ROOT
ENV REPO http://192.168.192.46:8000/repository/snapshots/
ENV VERSION 2.2.2-SNAPSHOT
# Get the war
RUN curl -sSL -o /tomcat/webapps/ROOT.war $REPO/org/appfuse/appfuse-spring/$VERSION/appfuse-spring-$
VERSION.war
&& mkdir -p $CATALINA_HOME/webapps/ROOT
&& cd $CATALINA_HOME/webapps/ROOT
&& unzip ../ROOT.war
&& rm ../ROOT.war
# get the postgresql jdbc jar
RUN curl -sSL -o $WEBAPP_HOME/WEB-INF/lib/postgresql-9.1-901.jdbc4.jar http://repo1.maven.org/
maven2/postgresql/postgresql/9.1-901.jdbc4/postgresql-9.1-901.jdbc4.jar
# configure the db connection and copy sql init file
COPY jdbc.properties $WEBAPP_HOME/WEB-INF/classes/
COPY dump.sql /
COPY run.sh /

42. run.sh
#!/bin/bash
if [ ! -f /.tomcat_admin_created ]; then
/create_tomcat_admin_user.sh
fi
psql -U postgres -h db postgres < /
dump.sql
exec ${CATALINA_HOME}/bin/catalina.sh run

43. Docker build
docker build -t csanchez/appfuse-tomcat
docker/tomcat

44. Continuous Delivery
commit git repo
developer
post commit hook
jenkins
build war &
docker image
binary
repository
integration
testing
db
tomcat*
www

45. Running Docker
docker run -d
--name db -p 5432:5432
postgres:8.4.22
docker run -d
--name nginx -p 80:80
-v /var/run/docker.sock:/tmp/docker.sock
jwilder/nginx-proxy
sleep 10 # wait for postgres to be up
docker run -d
--name tomcat -p 8081:8080 --link db:db -e TOMCAT_PASS=admin
-e VIRTUAL_HOST=docker.local -e VIRTUAL_PORT=8080
csanchez/appfuse-tomcat

46. Infrastructure testing
with Beaker

47. Puppet Labs Beaker
Test deployments on real VMs, Docker containers,
Cloud providers
Use serverspec for assertions

48. Serverspec
describe package('httpd') do
it { should be_installed }
end
describe service('httpd') do
it { should be_enabled }
it { should be_running }
end
describe port(80) do
it { should be_listening }
end
describe file('/etc/httpd/conf/httpd.conf') do
it { should be_file }
its(:content) { should match /ServerName www.example.jp/ }
end

49. spec/acceptance/nodesets/default.yml
HOSTS:
centos-65-x64:
roles:
- master
platform: el-6-x86_64
image: devopsil/puppet:3.5.1
hypervisor : docker
docker_image_commands:
- yum -y install tar
- useradd vagrant
CONFIG:
log_level: debug
type: git

50. spec/acceptance/nodesets/default.yml
require 'spec_helper_acceptance'
describe 'webapp' do
describe port(80),
:node => only_host_with_role(:webapp) do
it { should be_listening }
end
end

51. End to End testing with
Cucumber & Capybara

52. Cucumber
Allows defining natural language

53. Capybara
Runs Web tests using lower level APIs
Webdriver/Selenium
Poltergeist
supports JavaScript
headless

54. features/smoke_tests.feature
@smoke_tests
Feature: Smoke tests
Smoke testing scenarios to make sure all system
components are up and running.
Scenario: Services should be up and listening to
their assigned port
* services should be listening on ports:
| 80 | apache |
| 8080 | tomcat |
| 5432 | postgresql |
Scenario: Appfuse is up and listening on port 80
Given I am at the "/login" page
Then I should see the text "Sign In"

55. Example code and slides
Available at
http://slideshare.csanchez.org
https://github.com/carlossg/continuous-delivery
http://blog.csanchez.org

56. Danke!
http://csanchez.org
carlos@apache.org
@csanchez

57. Photo Credits
Brick wall - Luis Argerich
http://www.flickr.com/photos/lrargerich/4353397797/
Agile vs. Iterative flow - Christopher Little
http://en.wikipedia.org/wiki/File:Agile-vs-iterative-flow.jpg
DevOps - Rajiv.Pant
http://en.wikipedia.org/wiki/File:Devops.png
Pimientos de Padron - Howard Walfish
http://www.flickr.com/photos/h-bomb/4868400647/
Compiling - XKCD
http://xkcd.com/303/
Printer in 1568 - Meggs, Philip B
http://en.wikipedia.org/wiki/File:Printer_in_1568-ce.png
Relativity - M. C. Escher
http://en.wikipedia.org/wiki/File:Escher%27s_Relativity.jpg
Teacher and class - Herald Post
http://www.flickr.com/photos/heraldpost/5169295832/
Containers - Global Logistics Media
http://www.globallogisticsmedia.com/articles/view/primitive-container-transportation-you-wont-believe
Docker build ship run
http://blog.docker.com/2014/06/announcing-docker-hub-and-official-repositories/