SaltConf14 - Anita Kuno, HP & OpenStack - Using SaltStack for event-driven orchestration of OpenStack infrastructure components

•

1 like•1,630 views

This talk will highlight how the OpenStack Infrastructure team uses SaltStack for event-driven orchestration of its various cloud infrastructure components. The speakers will review the flexibility of Salt in a complex automation environment. Salt plays very well with other tools, including Puppet, which is especially critical in the OpenStack Infrastructure environment which requires the event-driven orchestration functions of Salt to synchronize workflow timing of OpenStack Infrastructure components and events. To learn when and where the next SaltConf will be, subscribe to our newsletter here: http://www.saltstack.com/salt-ink-newsletter or follow us on Twitter: http://www.twitter.com/saltstackinc

Technology

Using SaltStack for event-driven
orchestration of OpenStack
infrastructure components

Anita Kuno – hp
and
Dave Boucha - SaltStack

Anita Kuno
works on upstream OpenStack
a member of the infra team
receives paycheques from hp

Dave Boucha
does all the Salt things
more great stuff
even more great stuff

What is the purpose of the
OpenStack Infrastructure team?

Provide automated services for
OpenStack development

Creation and hosting of git repos
Automating check and gate
testing
Communication tools
Etherpad, Mailing Lists, Asterisk

Gerrit
Zuul
Jenkins(es)
Nodepool
some glue from Gearman

Salt-master running on the same
server as the Puppet master

Salt-minions running on:
Puppet master server
Jenkins slaves
Salt trigger server

Reactor tells puppetmaster to
update git clone

Historically OpenStack has used
Puppet for automated
configuration

At the time, the choice was Chef
or Puppet and Monty got Puppet
to work

Puppet has been triggering off of
cron jobs

Time based orchestration no
longer fits our use case in all
situations

Event Based Orchestration
Separation of Concerns
Avoid Programming the
Orchestration

Let's take a look at OpenStack's
manage-projects script

New repos are created by
submitting a patch to gerrit

After an infra core ran manage-
projects by hand

Right now time based
orchestration doesn't get us the
results we need for creating new
repos

How does Salt enable this?
Salt Event Bus
Salt Reactor

Salt Event Bus
Communication bus between
minions and master
salt-call event.fire_master

Salt Reactor
Salt Master system that
“watches” the event bus
Matches event “tags” to sls files

Benefits of Salt in Openstack
Infrastructure

Anita: anteaya
anteaya@anteaya.info
Dave: UtahDave
dave@saltstack.com
Questions?

What's hot

Experiences from Running Masterless Puppet - PuppetConf 2014

Puppet

Real-time Cloud Management with SaltStack

SaltStack

SaltConf14 - Ben Cane - Using SaltStack in High Availability Environments

SaltStack

SaltConf 2014 keynote - Thomas Jackson, LinkedIn Safety with Power tools As infrastructure scales, simple tasks become increasingly difficult. For large infrastructures to be manageable, we use automation. But automation, like any power tool, comes with its own set of risks and challenges. Automation should be handled like production code, and great care should be exercised with power tools. This talk will cover how SaltStack is used at LinkedIn and offer tips and tricks for automating management with SaltStack at massive scale including a look at LinkedIn-inspired Salt features such as blacklist and pre-req states. It will also cover Salt master and minion instrumentation and a compilation of how not to use Salt.

SaltConf 2014: Safety with powertools

Thomas Jackson

TechTalks is BlazeClan Technologies' platform provided to all engineers and technology enthusiasts where they can learn and explore new technologies,connect with peers, network with industry experts and discover new opportunities to grow. The Agenda for this TechTalks is as below: Overview of Basics & some Debugging Techniques Peer Communication in Salt Events, Orchestration & Reactors Mine Beacons Multi-master & Syndic Basic Salt Cloud

[TechTalks] Learning Configuration Management with SaltStack (Advanced Concepts)

Blazeclan Technologies Private Limited

This presentation was originally given by Joseph Hall, SaltStack senior engineer, at the combined Montreal Python and DevOps Montreal meet up on April 14, 2014. Here is the talk abstract: In ye olde days of web, a company might manage a handful of servers, each manually and frequently tuned and re-tuned to the company's needs. Those days are gone. Server farms now dominate, and it is no longer reasonable to manage individual servers by hand. Various configuration management tools have stepped in to help the modern engineer, but which to choose? It is not an easy question, and canned pitches from sales people are unlikely to take into account all of your variables. This talk will attempt to discuss The Big Four objectively, and from what angles they approach the task at hand.

Configuration Management - Finding the tool to fit your needs

SaltStack

Performance Tuning Your Puppet Infrastructure - PuppetConf 2014

Puppet

"Running at Scale: Practical Performance Tuning with Puppet" by Sam Kottler Engineer, Red Hat. Presentation Overview: This session will talk about some production issues I've seen running Puppet in large environments. From how to manage a single master with hundreds of hosts to real-life patterns for building high availability clusters that scale to 10's of thousands of agents. Another important topic that will be covered is how to deploy networked filesystems that perform well under high load and streaming files to many hosts simultaneously. Speaker Bio: Sam Kottler is a software engineer in the Virtualization R&D group at Red Hat. He's helped build infrastructure for leading startups, including Digg.com, Acquia, and Venmo and is a contributor to Puppet, the Fedora Project, Drupal, and the Rubygems.org. Sam speaks around the world on the topics of internet security, systems automation, and software architecture.

Running at Scale: Practical Performance Tuning with Puppet - PuppetConf 2013

Puppet

Deployment is often omitted from configuration management and orchestration, which typically focuses on the infrastructure and not the core application that the infrastructure supports. This presentation will give an overview of a deployment system I wrote using SaltStack to provide immediately consistent deployment for software. The deployment system has the ability for manual deploys or for continuous deployments using a Heroku-like workflow. It has support for multiple deployment schemes, with a default of Git deployment. The deployment system uses a combination of Salt peer runner calls, runners, modules, returners, pillars and grains as well as a deployment host running Apache, Sartoris (a git-deploy frontend), and Redis (for reporting).

SaltConf14 - Ryan Lane, Wikimedia - Immediate consistency with Trebuchet Depl...

SaltStack

Salt conf 2014 - Using SaltStack in high availability environments

Benjamin Cane

PuppetCamp Sydney 2012 - Building a Multimaster Environment

Greg Cockburn

Real-time Infrastructure Management with SaltStack - OpenWest 2013

SaltStack

This session will expand your knowledge of cutting-edge techniques for creating Salt states and formulas. Users will obtain a thorough understanding of how states interact with pillars, as well as map.jinja files. We'll discuss how to make formulas OS agnostic and show how the usage of external pillars combined with a map file can result in formulas that are easy to explain, easy to learn, and easy to update.

SaltConf14 - Forrest Alvarez, Choice Hotels - Salt Formulas and States

SaltStack

Chef Provisioning a Chef Server Cluster - ChefConf 2015

Chef

Configuration management and orchestration with Salt

Anirban Saha

Cookbook testing with KitcenCI and Serverrspec

Daniel Paulus

Monitoring and tuning your chef server - chef conf talk

Andrew DuFour

Steve Singer - Managing PostgreSQL with Puppet @ Postgres Open

PostgresOpen

De-centralise and Conquer: Masterless Puppet in a Dynamic Environment

Puppet

Red Hat Satellite 6 - Automation with Puppet

Michael Lessard

What's hot (20)

Experiences from Running Masterless Puppet - PuppetConf 2014

Real-time Cloud Management with SaltStack

SaltConf14 - Ben Cane - Using SaltStack in High Availability Environments

SaltConf 2014: Safety with powertools

[TechTalks] Learning Configuration Management with SaltStack (Advanced Concepts)

Configuration Management - Finding the tool to fit your needs

Performance Tuning Your Puppet Infrastructure - PuppetConf 2014

Running at Scale: Practical Performance Tuning with Puppet - PuppetConf 2013

SaltConf14 - Ryan Lane, Wikimedia - Immediate consistency with Trebuchet Depl...

Salt conf 2014 - Using SaltStack in high availability environments

PuppetCamp Sydney 2012 - Building a Multimaster Environment

Real-time Infrastructure Management with SaltStack - OpenWest 2013

SaltConf14 - Forrest Alvarez, Choice Hotels - Salt Formulas and States

Chef Provisioning a Chef Server Cluster - ChefConf 2015

Configuration management and orchestration with Salt

Cookbook testing with KitcenCI and Serverrspec

Monitoring and tuning your chef server - chef conf talk

Steve Singer - Managing PostgreSQL with Puppet @ Postgres Open

De-centralise and Conquer: Masterless Puppet in a Dynamic Environment

Red Hat Satellite 6 - Automation with Puppet

Similar to SaltConf14 - Anita Kuno, HP & OpenStack - Using SaltStack for event-driven orchestration of OpenStack infrastructure components

SaltStack's NetAPI at Photobucket - Denver SaltStack Meetup

Jon Henry

Salting new ground one man ops from scratch

Jay Harrison

Baylisa - Dive Into OpenStack

Jesse Andrews

Building Docker images with Puppet

Nick Jones

Kubecon 2017 Resumo

Felipe Freire

PRESENTED AT OPENSTACK SUMMIT - BARCELONA 2016 With test driven development, continuous integration/continuous deployment and devops practices now the norm, most organizations understand the importance of testing their applications. But what about the cloud those applications are going to live on? Too many companies miss this critical step, leading to gaps in their operations, which can lead to production issues, API outages, inability to upgrade, and general instability of the cloud. It all begs the question: “Do you even test?" During this session, attendees will learn how Rackspace leverages Red Hat’s Distributed Continuous Integration (DCI) to build a better OpenStack experience for their customers while reducing the time required to not only roll out the latest version of OpenStack to new customers, but also begin upgrading customers within weeks of announcement. In addition to this, the automated testing in DCI raises bugs directly with Red Hat QEs team to shorten the feedback cycle and improve the final product.

Leveraging CI/CD to improve open stack operation

María Angélica Bracho

Monitoring Uptime on the NeCTAR Research Cloud - Andy Botting, University of ...

OpenStack

These days time to value is critical. We all need to develop better software and to get it to customers faster. The quicker the software gets to customers, the more iterations and feedback then the more value we create. Continuous Delivery of Containerized Microservices is the best approach today for developing better software by iterating fast, capturing user feedback and iterating again, continuously. In this talk, we'll introduce the Fabric8 Microservices Platform which is open source, Apache licensed and built on top of Docker, Kubernetes, OpenShift and Jenkins. We'll demonstrate how to create microservices easily, have them automatically built, tested and staged with Continuous Delivery and deal with the issues of supporting microservices architectures like service discovery, high availability, auto scaling, rolling upgrades, canary deployments, circuit breakers, tracing, logging and metrics.

Fabric8: Better Software Faster with Docker, Kubernetes, Jenkins

Burr Sutter

In a joint meetup with the Sydney Puppet User Group, Michael will demonstrate how to build an OpenStack distro from scratch using the community OpenStack Puppet modules. In an interactive session with the audience, we’re going to pick a Linux distro, use the roles + profiles pattern, use Hiera to populate data, and build up a complete OpenStack cluster inside VMs running the OpenStack Identity, Image, Compute and Networking services. Although there are vendor tools available that can assist with this process, such as Fuel, Cisco OpenStack Installer and Aptira's own Stacktira, understanding how the modules fit together will allow an operator to easily add their own customisations to the any of these systems. Michael has been working in the cloud computing space, both in a research and enterprise context for several years, with OpenStack production experience stretching all the way back to the third release, 'Cactus'. He leads the Aptira software engineering team in developing deployment and operations tools for OpenStack. Michael is a maintainer of and a driving force behind the most widely used OpenStack deployment tool set, Puppet-OpenStack. He holds a Bachelor of Software Engineering with Honours from Australian National University and is regularly invited back to his alma mater to guest lecture.

How to build your own OpenStack distro using Puppet OpenStack

OpenStack

Intro to OpenStack

donnieh1

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

Animesh Singh

Presentation at the OpenStack Summit in Tokyo, Japan on October 29, 2015. http://sched.co/49vI This talk will cover the pros and cons of four different OpenStack deployment mechanisms. Puppet, Chef, Ansible, and Salt for OpenStack all claim to make it much easier to configure and maintain hundreds of OpenStack deployment resources. With the advent of large-scale, highly available OpenStack deployments spread across multiple global regions, the choice of which deployment methodology to use has become more and more relevant. Beyond the initial day-one deployment, when it comes to the day-two and beyond questions of updating and upgrading existing OpenStack deployments, it becomes all the more important choose the right tool. Come join the Bluebox and IBM team to discuss the pros and cons of these approaches. We look at each of these four tools in depth, explore their design and function, and determine which scores higher than others to address your particular deployment needs. Daniel Krook - Senior Software Engineer, Cloud and Open Source Technologies, IBM Paul Czarkowski - Cloud Engineer at Blue Box, an IBM company Daniel Krook - Senior Software Engineer, Cloud and Open Source Technologies, IBM

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

Daniel Krook

NetflixOSS on OpenStack

Everett Toews

Continuous Kernel Integration

Major Hayden

Couch to OpenStack: Nova - July, 30, 2013

Trevor Roberts Jr.

Scalable Systems Management with Puppet

Puppet

Scalable systems management with puppet

Puppet

Google is making the power of its datacenter, network, and technology innovations available to the world through its Cloud services. This presentation will provide an overview of the Google Cloud Platform and a deeper dive on Google Compute Engine. Google recently made an open source contribution to SaltStack and now you can now use Salt Cloud to manage your Compute Engine resources (IaaS virtual machine services). Come find out more about Google's Cloud Platform and how you can leverage Google scale with SaltStack.

SaltConf14 - Eric johnson, Google - Orchestrating Google Compute Engine with ...

SaltStack

Extend and build on Kubernetes

Stefan Schimanski

OpenStack Architecture: Past and Future

Ken Pepple

Similar to SaltConf14 - Anita Kuno, HP & OpenStack - Using SaltStack for event-driven orchestration of OpenStack infrastructure components (20)

SaltStack's NetAPI at Photobucket - Denver SaltStack Meetup

Salting new ground one man ops from scratch

Baylisa - Dive Into OpenStack

Building Docker images with Puppet

Kubecon 2017 Resumo

Leveraging CI/CD to improve open stack operation

Monitoring Uptime on the NeCTAR Research Cloud - Andy Botting, University of ...

Fabric8: Better Software Faster with Docker, Kubernetes, Jenkins

How to build your own OpenStack distro using Puppet OpenStack

Intro to OpenStack

CAPS: What's best for deploying and managing OpenStack? Chef vs. Ansible vs. ...

NetflixOSS on OpenStack

Continuous Kernel Integration

Couch to OpenStack: Nova - July, 30, 2013

Scalable Systems Management with Puppet

Scalable systems management with puppet

SaltConf14 - Eric johnson, Google - Orchestrating Google Compute Engine with ...

Extend and build on Kubernetes

OpenStack Architecture: Past and Future

More from SaltStack

A SaltConf16 use case talk by Steven Braverman of Dun & Bradstreet. Testing configuration changes for multiple server roles can be time consuming when real instances or legacy container systems are used. Applying configuration changes to each role in parallel can be difficult. So what's the best way to test configuration changes efficiently, quickly, and securely prior to applying them? See how an integrated test setup using AWS EC2 Container Service (ECS), AWS AutoScaling Group, and SaltStack simplifies the application of configuration changes and allows you to test configuration changes in parallel to reduce the time spent testing.

Integration testing for salt states using aws ec2 container service

SaltStack

This talk will focus on the unique challenges of managing Web scale and an application stack that lives on tens of thousands of servers spread across multiple data centers. Learn more about LinkedIn's unique topology, about the development of an efficient build environment, and hear more about LinkedIn plans for a deployment system based on Salt. Also, all of the software that runs LinkedIn sends a LOT of data. In order to stay ahead of this tidal wave of data, the team must address scale challenges seen in very few environments through efficient use of monitoring and metrics systems. This talk will highlight best practices and user training necessary for the use of SaltStack in large environments.

SaltConf14 - Craig Sebenik, LinkedIn - SaltStack at Web Scale

SaltStack

Thomas Hatch, SaltStack CTO, and Sam Smith, SaltStack director of product development, introduce SaltStack RAET as a new alternative transport medium developed specifically with SaltStack infrastructure automation and configuration management in mind. SaltStack built RAET for customers needing substantial speed and scale to automate management of massive data center infrastructure environments. SaltStack RAET is primarily an async communication layer over truly async connections, defaulting to UDP. The SaltStack RAET system uses CurveCP encryption by default. SaltStack users can now leverage substantial flexibility via either Salt SSH, ØMQ, or RAET to best address numerous use cases.

Salt Air 19 - Intro to SaltStack RAET (reliable asyncronous event transport)

SaltStack

SaltConf14 - Matthew Williams, Flowroute - Salt Virt for Linux contatiners an...

SaltStack

OpenStack is an open source implementation of cloud computing, potentially at very large scale. However, it has many moving parts and is complex to operate. SaltStack appears to provide scalable and secure orchestration for OpenStack. But like all powerful solutions to complex problems, a great deal of the useful know-how has to be discovered by actual practice and hard-won experience. This session will share the inside knowledge gained through practical experience.

SaltConf14 - Yazz Atlas, HP Cloud - Installing OpenStack using SaltStack

SaltStack

Using SaltStack to automate enterprise IT operations and support capabilities is not as well documented as the more traditional SaltStack use cases. This session will show how the HP Cloud team runs a secure and reliable SaltStack automation environment by writing Salt states and modules to simplify day-to-day operations and support while extending SaltStack capabilities through dynamic states and modules. The talk will also show how to protect sensitive information and safe guard against user errors.

SaltConf14 - Saurabh Surana, HP Cloud - Automating operations and support wit...

SaltStack

As a leading developer of highly scalable, large-scale Web services, Google was forced early on to develop systems to support the deployment and management of diverse workloads at an immense scale. As the broader developer community embraces cloud technologies we see significant parallels between the internal management infrastructure which Google has built over the last decade, and open source management technologies of today. This talk will describe Google's experience in managing large-scale compute services, draw parallels to open source efforts underway today, and sketch out how our past experience shapes our future development of the Google Cloud Platform.

SaltConf14 - Brendan Burns, Google - Management at Google Scale

SaltStack

Let's set aside the buzzwords for a moment and have an honest discussion about DevOps. There is the idea of putting more Dev into Ops, but just as crucial (if not more crucial) is getting your Devs to think more like Ops. Most developers have little to no experience dealing with production environments, and helping them add value to DevOps efforts can be difficult. This talk will cover practical ways of mentoring Devs into more DevOps skills and responsibilities. Ultimately, the goal is to help your Devs gain the skills leading to better production health, application performance and uptime. Of course, we'll also consider how SaltStack can help.

SaltConf14 - Justin Carmony, Deseret Digital Media - Teaching Devs About DevOps

SaltStack

As infrastructure scales, simple tasks become increasingly difficult. For large infrastructures to be manageable, we use automation. But automation, like any power tool, comes with its own set of risks and challenges. Automation should be handled like production code, and great care should be exercised with power tools. This talk will cover how SaltStack is used at LinkedIn and offer tips and tricks for automating management with SaltStack at massive scale including a look at LinkedIn-inspired Salt features such as blacklist and prereq states. It will also cover Salt master and minion instrumentation and a compilation of how not to use Salt.

SaltConf14 - Thomas Jackson, LinkedIn - Safety with Power Tools

SaltStack

SaltStack - An open source software story

SaltStack

Adding to your Python Armory - OpenWest 2013

SaltStack

Writing SaltStack Modules - OpenWest 2013

SaltStack

More from SaltStack (12)