"Building on Puppet and Puppet Forge" by Pedro Pessoa of Server Density at Puppet Camp London 2014. Find the video here: http://puppetlabs.com/community/puppet-camp

1. Building on
Puppet
http://www.rankpop.com/you-need-to-start-structuring-your-blog-posts-asap/

3. HTTP Load Balancer
from Pound to nginx
Server Density v2:
New version : new load balancer
nginx :
- WebSockets
- SPDY standard
keep :
- modules pulled from our Gihub repo by the
puppet master
- use of Puppet Console and Live Management
to trigger transient changes

4. Reinventing the wheel
(don't)
Writing our nginx module?
- add yet another one to the collection of
in-house developed modules
community reach?
- whether our problem had already been solved
- or a kick start where we could stand on
http://www.flickr.com/photos/conskeptical/

5. Going to the Forge

6. Going to the Forge

7. Integration
A) get the actual code into the master
puppet module install puppetlabs/nginx
(or)
git submodule add https://github.com/puppetlabs/puppetlabs­nginx.git
B) run it on existing nodes
no parameterized classes on PE Console (2.8.x)
(or)
merge our site.pp (which is empty) and the console,
it being an ENC and all - (how-merging-works)

8. Integration
Our solution
class serverdensity­nginx
{
class { 'nginx': }
nginx::resource::upstream {
'socky_rack':
ensure => present,
members => split( $lbTargetHostsSocky, ',' ),
}
(...)

9. nginx 'on-the-fly' update
class serverdensity­nginx
{
class { 'nginx': }
nginx::resource::upstream {
'socky_rack':
ensure => present,
members => split( $lbTargetHostsSocky, ',' ),
}
(...)

10. nginx 'on-the-fly' update

11. nginx 'on-the-fly' update

12. nginx 'on-the-fly' update

13. nginx 'on-the-fly' update

14. Alternatives
Puppet Labs nginx module:
https://github.com/serverdensity/puppetlabs-nginx
forked James Fryman's module:
https://github.com/jfryman/puppet-nginx
pick the later? Puppet Labs last update - 30th June
2011.
https://github.com/serverdensity/puppetlabs-nginx

15. Extending Server Density
Server Density collects server data from an open
source agent deployed on each device
Create a device on Server Density UI
Copy the device ID (agent key)
The agent reads the device ID from a config file:
[Main]
sd_url: http://mydomain.serverdensity.com
agent_key: 8160b409de9d8a612ec8d964c5b26bf
(...)

16. Extending Server Density
Server Density v1:

17. Extending Server Density
Server Density v1:
'sd­agent':
ensure => installed,
file
{
'config.cfg':
path => '/etc/sd­agent/config.cfg',
ensure => file,
require => Package['sd­agent'],
content => template('sd­agent/config.erb'),
}
[Main]
sd_url: http://boxedice.serverdensity.com
agent_key: <%= sdAgentKey %>
(...)

18. Extending Server Density
Server Density v2:

19. Extending Server Density
Server Density v2 – in action:

20. Extending Server Density
Server Density v2 – in action:

21. Extending Server Density
Server Density v2 - implementation:
Manages the life cycle of Rackspace and Amazon
cloud instances
A custom fact will return the cloud instance agent key
or use Server Density API to create a device on the
fly and return the resulting agent key
https://github.com/serverdensity/puppet-serverdensity

22. Extending Server Density
Custom fact:
Facter.add(:agent_key, :timeout => 10) do
if File::exist?('/etc/sd­agent­key')
result = Facter::Util::Resolution.exec("cat /etc/sd­agent­key")
elsif Facter.value('ec2_instance_id')
uri = URI("http://ec2meta.serverdensity.com/latest/user­data")
req = Net::HTTP::Get.new(uri.request_uri)
res = Net::HTTP.start(uri.host, uri.port) {|http|
http.request(req)
}
result = res.body.split(':').last if res.code == 200
end
setcode { result }
end

23. Extending Server Density
Custom function:
(...)
agent_key = lookupvar("agent_key")
# lookupvar returns undef if no value
# test against nil just in case
unless agent_key.nil? or agent_key == :undef
notice ["Agent Key Provided via Facter: #{ agent_key }"]
return agent_key
End
(...)

24. Extending Server Density
Custom function:
(...)
base_url = "https://api.serverdensity.io"
filter = {
'type' => 'device',
'hostname' => hostname,
}
filter_json = URI.escape(PSON.dump(filter))
uri =
URI("#{base_url}/inventory/devices?filter=#{filter_json}&token=#{token}")
req = Net::HTTP::Get.new(uri.request_uri)
https = Net::HTTP.new(uri.host, uri.port)
https.use_ssl = true
res = https.start { |cx| cx.request(req) }
(...)

25. Extending Server Density
Custom function:
(...)
device = PSON.parse(res.body)
if device['status'] == 2
notice ["Device not found, creating a new one"]
uri = URI("#{ base_url }devices/add?account=#{ sd_url }")
req = Net::HTTP::Post.new(uri.request_uri)
req.basic_auth sd_username, sd_password
params = {
'name' => server_name,
'hostName' => hostname,
'notes' => 'Created automatically by puppet­serverdensity',
}
(...)

26. Extending Server Density
Server Density v2:
Next: Publishing to the Forge
https://github.com/serverdensity/puppet-serverdensity

27. Pedro Pessoa
pessoa@serverdensity.com
http://serverdensity.com/puppetcamp/