1. Nise BOSH In Action
Iwasaki Yudai @i_yudai
NTT Software Innovation Center
2013-04-26

2. Installing cf-release jobs with Nise BOSH
– What’s cf-release?
– What’s Nise BOSH?
– How to use
DEA/NG and CCv1 compatibility
– How to revert BuildPack support
Agenda

3. Installing cf-release jobs with Nise BOSH

4.  Preconfigured CF source code set
– For installation with BOSH
– Well-tested by many users
– Portable
• Minimum dependencies on apt packages
• Including mysqlclient, imagemagick and so on...
What’s cf-release?

5. Tool chain for distributed systems
– Release engineering
– Lifecycle management
– Works with IaaS layers (CPI)
• AWS, vSphere, vCloud and OpenStack
What’s BOSH?
(c) EMC & VMware
http://docs.cloudfoundry.com/docs/running/bosh/

6. Photo by yeowatzup from http://www.flickr.com/photos/yeowatzup/173818958/
Heavybut worth trying

7. A lightweight BOSH (nearly) emulator
– Works on a local machine
– Without any CPI
What’s Nise BOSH
https://github.com/nttlabs/nise_bosh

8. ./bin/init
– Stemcell-like environment builder
./bin/nise-bosh
– Package installer
./bin/run-job
– Job launcher
Main Three Scripts
VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent

9. Sets up Stemcell-like environment
– Installs apt packages, create users and so on...
Ported from Stemcell Builder stages
– https://github.com/cloudfoundry/bosh/tree/master/stemcell_builder/
./bin/init
Stemcell ≈ OS + bosh_agent + α
= Basic VM image
VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent

10. Installs packages and job templates
– Automatically resolving dependencies
– Running packaging scripts
– Filling templates with deploy manifest
./bin/nise-bosh
Packages:
• References to source code
• Packaging(installer) scripts
Job templates:
• Package list
• Configuration file/Control script/monitrc templates VM
Stemcell
dea_next (Job template)
common
(Package)
dea_next
(Package)
ruby
(Package)
Agent

11. Job launcher
– Reads monitrc file from job templates
• Resolving task dependencies
– start/stop/status
./bin/run-job

12. Entry on Cloud Foundry.com
– http://blog.cloudfoundry.com/2013/04/15/ntt-contributes-nise-bosh-a-tool-to-speed-up-bosh-development/
README.md
How To Use

13. Ubuntu 10.04 64bit
– Recommended for cf-release
Example: Installing dea_next (1)
sudo apt-get install git-core
# Clone Nise BOSH and initialize the environment
git clone https://github.com/nttlabs/nise_bosh.git
cd nise_bosh
sudo ./bin/init
sudo reboot
# Install ruby with rbenv
cd ~
git clone git://github.com/sstephenson/rbenv.git ~/.rbenv
echo 'export PATH="$HOME/.rbenv/bin:$PATH"' >> ~/.bash_profile
echo 'eval "$(rbenv init -)"' >> ~/.bash_profile
exec $SHELL –l
git clone https://github.com/sstephenson/ruby-build.git ~/.rbenv/plugins/ruby-build
rbenv install 1.9.3-p327
rbenv global 1.9.3-p327
# Install required gems
gem install bundler
gem install bosh_cli
rbenv rehash
Ubuntu 10.04 64bit is recommended for cf-release

14. Generating package archives
– `bosh craete release` creates pre-
packaged tar files in .dev_builds
Example: Installing dea_next (2)
# Clone cf-release
git clone https://github.com/cloudfoundry/cf-release.git
cd cf-release
./update # check out submodules
# Create release packages
bosh create release –force # give ‘appcloud’ for the prompt

15. Deployment manifest
– Compatible with BOSH
Example: Install dea_next (3)
vi ~/deploy.conf
---
properties:
domain: vcap.me
networks:
apps: default
management: default
nats:
user: nats
password: nats
address: 127.0.0.1
port: 4222
dea_next:
streaming_timeout: 60
memory_mb: 4096
memory_overcommit_factor: 1
disk_mb: 32000
disk_overcommit_factor: 1
num_instances: 30

16. Installing dea_next job template
Example: Installing dea_next (4)
cd ~/nise_bosh
sudo env PATH=$PATH bundle install
sudo env PATH=$PATH bundle exec ./bin/nise-bosh ~/cf-release ~/deploy.conf
dea_next

17. Launching processes
Example: Installing dea_next (5)
sudo env PATH=$PATH bundle exec ./bin/run-job start

18. ./bin/nise-bosh has some options
– See README.md

19. DEA/NG and CCv1 compatibility

20. 2013-04-26
Photo from http://pdphoto.org/PictureDetail.php?mat=pdef&pg=8344
CCv1
DEA/NG
Stager
Impact of Buildpack

21. The Commitment
https://github.com/cloudfoundry/dea_ng/commit/169f2c7b9137196f3f6e2dac291417395aeba310

22. Rest In Peace CCv1

23. Reverted and works
– https://github.com/yudai/dea_ng/commit/ccce77553deff7cfc9b5
a6191e12046207a42ced
– Copy runtimes from CCv1
• ~/cloudfoundry/.deployments
• Removed from cf-release
• https://github.com/cloudfoundry/cf-release/commit/82984735556f931caacf010cf7b52a59032c401f
– Disable integrated Stager
– Add runtimes in config file
The Return of CCv1