SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
Doug Hellmann
                      aka doughellmann/dhellmann (twitter/irc)
                         doug.hellmann@dreamhost.com
                                         Nick Barcet
                                      aka nijaba (twitter/irc)
                            nick.barcet@canonical.com




Ceilometer
The OpenStack Metering Project



                          15 Oct 2012 @ ODS Grizzly
What About Billing?
● Billing has been left out of OpenStack core so far as it
  was not the primary problem and is not a trivial one...

● Yet almost every OpenStack deployment needs a way
  to track usage information
Billing: 3 Step Process

Metering   Collect usage data

Rating     Transform usage data into billable
           items and calculate costs

Billing    Create invoice, collect payment
Ceilometer is Metering


Usage data collection is the ONLY thing
common to all clouds
Uses for Metering
● Billing

● Auditing

● Capacity Planning
Problems to Solve
● Collecting per user/tenant usage data
  ○ For every resource
  ○ From every OpenStack component
  ○ In a single place


● Retrieving usage data
  ○ From a single place


● Doing this with an open source project
  ○ Everyone did this in their own corner in the past :-(
Ceilometer Begins
● Started in May 2012
Ceilometer Rises
● Developed in StackForge
   ○   Same process as OpenStack

● Minimal set of meters defined

● Targeting OpenStack core
   ○   incubation pending
Design Requirements
● Scalable
  ○ …if your database is too
Design Requirements
● Scalable
  ○ …if your database is too
● Message signature
  ○ Non-repudiation built in
Design Requirements
● Scalable
  ○ …if your database is too
● Message signature
  ○ Non-repudiation built in
● Only one entry point to get data
Design Requirements
● Scalable
  ○ …if your database is too
● Message signature
  ○ Non-repudiation built in
● Only one entry point to get data
● Extensible, add your own:
  ○ Agent
  ○ Agent plugin
  ○ Storage engine
  ○ Meters
Design Requirements
● Scalable
  ○ …if your database is too
● Message signature
  ○ Non-repudiation built in
● Only one entry point to get data
● Extensible, add your own:
  ○ Agent
  ○ Agent plugin
  ○ Storage engine
  ○ Meters
● Use openstack-common components
Design Requirements
● Scalable
  ○ …if your database is too
● Message signature
  ○ Non-repudiation built in
● Only one entry point to get data
● Extensible, add your own:
  ○ Agent
  ○ Agent plugin
  ○ Storage engine
  ○ Meters
● Use openstack-common components
● Accept data from many sources
Data Triggers
Ceilometer inputs are generated three ways

User Action Creating, modifying, or deleting a
            resource
Audit        Regular audit events stating usage
             generated by the service
Polling      The ceilometer agent asks the service
             for data periodically
Meter Categories
Ceilometer handles 3 types of meters

Cumulative    Increasing over time (instance hours)
Gauge         Discrete items (floating IPs, image
              uploads) and fluctuating values (disk
              I/O)
Delta         Changing over time (bandwidth)
Ceilometer presentation ODS Grizzly.pdf
Ceilometer presentation ODS Grizzly.pdf
Ceilometer presentation ODS Grizzly.pdf
Ceilometer presentation ODS Grizzly.pdf
Ceilometer presentation ODS Grizzly.pdf
Ceilometer presentation ODS Grizzly.pdf
Simple REST API
Sum                              GET /v1/resources/(resource)/meters/(meter)/volume/sum



Maximum                          GET /v1/resources/(resource)/meters/(meter)/volume/max



Duration                         GET /v1/resources/(resource)/meters/(meter)/duration



Raw Events                       GET /v1/resources/(resource)/meters/(meter)




http://ceilometer.readthedocs.org/en/latest/api.html
Roadmap
         Folsom                        Grizzly                          H

●   Delivered last week      ●   Incubated Project          ●   Core Project
●   Collects base metering   ●   User accessible API?       ●   TBD
     ○ nova                  ●   Integration example with
     ○ glance                    Horizon
     ○ cinder                ●   New agents for other
     ○ quantum                   openstack components
●   Basic API access               ○ Swift
                                   ○ Heat?
                             ●   New uses of collector?
                             ●   SQLAlchemy storage
                                 driver
DreamHost Use Case
● New Public Cloud Service

● Existing Billing System

● Existing Users and Accounts
Configuring Ceilometer
● Measure exactly what we want to bill for

  ○ instance hours

  ○ block storage

  ○ image uploads

  ○ bandwidth
Customizing Ceilometer
● Custom Bandwidth Meter

  ○ No charge for traffic "inside" DreamHost

  ○ Don't expose infrastructure details to customers

  ○ Measure at the router, not the VIF
Consuming Meter Data
Questions?
http://launchpad.net/ceilometer
http://ceilometer.readthedocs.org

freenode: #openstack-metering
email: openstack-dev [ceilometer]

Doug Hellmann                                   Nick Barcet
aka doughellmann/dhellmann (twitter/irc)        aka nijaba (twitter/irc)
doug.hellmann@dreamhost.com                nick.barcet@canonical.com

Weitere ähnliche Inhalte

Was ist angesagt?

Ceilo componentization diagrams
Ceilo componentization diagramsCeilo componentization diagrams
Ceilo componentization diagramsFabio Giannetti
 
OpenStack Orchestration with Heat
OpenStack Orchestration with HeatOpenStack Orchestration with Heat
OpenStack Orchestration with Heatopenstackstl
 
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013Nick Galbreath
 
Enforcing Application SLA with Congress and Monasca
Enforcing Application SLA with Congress and MonascaEnforcing Application SLA with Congress and Monasca
Enforcing Application SLA with Congress and MonascaFabio Giannetti
 
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenContainer Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenInfluxData
 
Scaling Graphite At Yelp
Scaling Graphite At YelpScaling Graphite At Yelp
Scaling Graphite At YelpPaul O'Connor
 
Fall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using GrafanaFall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using Grafanatorkelo
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxData
 
Monitoring as Software Validation
Monitoring as Software ValidationMonitoring as Software Validation
Monitoring as Software ValidationBioDec
 
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016Container Management - Federico Simoncelli - ManageIQ Design Summit 2016
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016ManageIQ
 
Searchlight Updates - Liberty Edition
Searchlight Updates - Liberty EditionSearchlight Updates - Liberty Edition
Searchlight Updates - Liberty EditionOpenStack Foundation
 
Business Dashboards using Bonobo ETL, Grafana and Apache Airflow
Business Dashboards using Bonobo ETL, Grafana and Apache AirflowBusiness Dashboards using Bonobo ETL, Grafana and Apache Airflow
Business Dashboards using Bonobo ETL, Grafana and Apache AirflowRomain Dorgueil
 
Crash Course in Cloud Computing
Crash Course in Cloud ComputingCrash Course in Cloud Computing
Crash Course in Cloud ComputingAll Things Open
 
Setting up InfluxData for IoT
Setting up InfluxData for IoTSetting up InfluxData for IoT
Setting up InfluxData for IoTInfluxData
 
InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020 InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020 InfluxData
 
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...Caner Ünal
 
Scalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureMaxim Ivannikov
 

Was ist angesagt? (20)

Ceilo componentization diagrams
Ceilo componentization diagramsCeilo componentization diagrams
Ceilo componentization diagrams
 
OpenStack Orchestration with Heat
OpenStack Orchestration with HeatOpenStack Orchestration with Heat
OpenStack Orchestration with Heat
 
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013
Care and Feeding of Large Scale Graphite Installations - DevOpsDays Austin 2013
 
Enforcing Application SLA with Congress and Monasca
Enforcing Application SLA with Congress and MonascaEnforcing Application SLA with Congress and Monasca
Enforcing Application SLA with Congress and Monasca
 
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar AasenContainer Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
Container Monitoring Best Practices Using AWS and InfluxData by Gunnar Aasen
 
Scaling Graphite At Yelp
Scaling Graphite At YelpScaling Graphite At Yelp
Scaling Graphite At Yelp
 
Fall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using GrafanaFall in Love with Graphs and Metrics using Grafana
Fall in Love with Graphs and Metrics using Grafana
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product Training
 
Monitoring as Software Validation
Monitoring as Software ValidationMonitoring as Software Validation
Monitoring as Software Validation
 
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016Container Management - Federico Simoncelli - ManageIQ Design Summit 2016
Container Management - Federico Simoncelli - ManageIQ Design Summit 2016
 
Searchlight Updates - Liberty Edition
Searchlight Updates - Liberty EditionSearchlight Updates - Liberty Edition
Searchlight Updates - Liberty Edition
 
Business Dashboards using Bonobo ETL, Grafana and Apache Airflow
Business Dashboards using Bonobo ETL, Grafana and Apache AirflowBusiness Dashboards using Bonobo ETL, Grafana and Apache Airflow
Business Dashboards using Bonobo ETL, Grafana and Apache Airflow
 
Heat Updates - Liberty Edition
Heat Updates - Liberty EditionHeat Updates - Liberty Edition
Heat Updates - Liberty Edition
 
Crash Course in Cloud Computing
Crash Course in Cloud ComputingCrash Course in Cloud Computing
Crash Course in Cloud Computing
 
Highly Available Graphite
Highly Available GraphiteHighly Available Graphite
Highly Available Graphite
 
Setting up InfluxData for IoT
Setting up InfluxData for IoTSetting up InfluxData for IoT
Setting up InfluxData for IoT
 
InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020 InfluxDB Community Office Hours September 2020
InfluxDB Community Office Hours September 2020
 
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
InfluxDB and Grafana: An Introduction to Time-Based Data Storage and Visualiz...
 
Scalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft AzureScalable Open-Source IoT Solutions on Microsoft Azure
Scalable Open-Source IoT Solutions on Microsoft Azure
 
Sahara Updates - Liberty Edition
Sahara Updates - Liberty EditionSahara Updates - Liberty Edition
Sahara Updates - Liberty Edition
 

Andere mochten auch

Whats new in Havana--Heat and Ceilometer
Whats new in Havana--Heat and CeilometerWhats new in Havana--Heat and Ceilometer
Whats new in Havana--Heat and CeilometerMirantis
 
Topdown Cloud Monitoring & Analytics Cloud Solutions Overview
Topdown Cloud Monitoring & Analytics Cloud Solutions OverviewTopdown Cloud Monitoring & Analytics Cloud Solutions Overview
Topdown Cloud Monitoring & Analytics Cloud Solutions OverviewTopDown Conservation LLC
 
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaSAutoscaling OpenStack Natively with Heat, Ceilometer and LBaaS
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaSShixiong Shang
 
Monitoring at Cloud Scale
Monitoring at Cloud ScaleMonitoring at Cloud Scale
Monitoring at Cloud ScaleJulien Pivotto
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack ArchitectureMirantis
 

Andere mochten auch (6)

Whats new in Havana--Heat and Ceilometer
Whats new in Havana--Heat and CeilometerWhats new in Havana--Heat and Ceilometer
Whats new in Havana--Heat and Ceilometer
 
Topdown Cloud Monitoring & Analytics Cloud Solutions Overview
Topdown Cloud Monitoring & Analytics Cloud Solutions OverviewTopdown Cloud Monitoring & Analytics Cloud Solutions Overview
Topdown Cloud Monitoring & Analytics Cloud Solutions Overview
 
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaSAutoscaling OpenStack Natively with Heat, Ceilometer and LBaaS
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS
 
Ceilometer Updates - Kilo Edition
Ceilometer Updates - Kilo EditionCeilometer Updates - Kilo Edition
Ceilometer Updates - Kilo Edition
 
Monitoring at Cloud Scale
Monitoring at Cloud ScaleMonitoring at Cloud Scale
Monitoring at Cloud Scale
 
OpenStack Architecture
OpenStack ArchitectureOpenStack Architecture
OpenStack Architecture
 

Ähnlich wie Ceilometer presentation ODS Grizzly.pdf

[scala.by] Launching new application fast
[scala.by] Launching new application fast[scala.by] Launching new application fast
[scala.by] Launching new application fastDenis Karpenko
 
Data Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixData Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixC4Media
 
Building a Distributed & Automated Open Source Program at Netflix
Building a Distributed & Automated Open Source Program at NetflixBuilding a Distributed & Automated Open Source Program at Netflix
Building a Distributed & Automated Open Source Program at NetflixAll Things Open
 
Netflix Open Source: Building a Distributed and Automated Open Source Program
Netflix Open Source:  Building a Distributed and Automated Open Source ProgramNetflix Open Source:  Building a Distributed and Automated Open Source Program
Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker
 
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB Atlas
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB AtlasMongoDB World 2019: Packing Up Your Data and Moving to MongoDB Atlas
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB AtlasMongoDB
 
Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...LibbySchulze
 
Meteor Day Athens (2014-11-07)
Meteor Day Athens (2014-11-07)Meteor Day Athens (2014-11-07)
Meteor Day Athens (2014-11-07)svub
 
Data Platform in the Cloud
Data Platform in the CloudData Platform in the Cloud
Data Platform in the CloudAmihay Zer-Kavod
 
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...Building a data pipeline to ingest data into Hadoop in minutes using Streamse...
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...Guglielmo Iozzia
 
NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1Ruslan Meshenberg
 
Scalable Clusters On Demand
Scalable Clusters On DemandScalable Clusters On Demand
Scalable Clusters On DemandBogdan Kyryliuk
 
Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015aspyker
 
Softshake 2013: Introduction to NoSQL with Couchbase
Softshake 2013: Introduction to NoSQL with CouchbaseSoftshake 2013: Introduction to NoSQL with Couchbase
Softshake 2013: Introduction to NoSQL with CouchbaseTugdual Grall
 
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned AWS Big Data Demystified #1.2 | Big Data architecture lessons learned
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned Omid Vahdaty
 
Clearing Airflow Obstructions
Clearing Airflow ObstructionsClearing Airflow Obstructions
Clearing Airflow ObstructionsTatiana Al-Chueyr
 
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014Jaroslav Gergic
 
OpenTelemetry For Architects
OpenTelemetry For ArchitectsOpenTelemetry For Architects
OpenTelemetry For ArchitectsKevin Brockhoff
 
PyConIE 2017 Writing and deploying serverless python applications
PyConIE 2017 Writing and deploying serverless python applicationsPyConIE 2017 Writing and deploying serverless python applications
PyConIE 2017 Writing and deploying serverless python applicationsCesar Cardenas Desales
 
Netflix Architecture and Open Source
Netflix Architecture and Open SourceNetflix Architecture and Open Source
Netflix Architecture and Open SourceAll Things Open
 

Ähnlich wie Ceilometer presentation ODS Grizzly.pdf (20)

[scala.by] Launching new application fast
[scala.by] Launching new application fast[scala.by] Launching new application fast
[scala.by] Launching new application fast
 
Data Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFixData Science in the Cloud @StitchFix
Data Science in the Cloud @StitchFix
 
Building a Distributed & Automated Open Source Program at Netflix
Building a Distributed & Automated Open Source Program at NetflixBuilding a Distributed & Automated Open Source Program at Netflix
Building a Distributed & Automated Open Source Program at Netflix
 
Netflix Open Source: Building a Distributed and Automated Open Source Program
Netflix Open Source:  Building a Distributed and Automated Open Source ProgramNetflix Open Source:  Building a Distributed and Automated Open Source Program
Netflix Open Source: Building a Distributed and Automated Open Source Program
 
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB Atlas
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB AtlasMongoDB World 2019: Packing Up Your Data and Moving to MongoDB Atlas
MongoDB World 2019: Packing Up Your Data and Moving to MongoDB Atlas
 
Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...Intro to open source observability with grafana, prometheus, loki, and tempo(...
Intro to open source observability with grafana, prometheus, loki, and tempo(...
 
Meteor Day Athens (2014-11-07)
Meteor Day Athens (2014-11-07)Meteor Day Athens (2014-11-07)
Meteor Day Athens (2014-11-07)
 
Data Platform in the Cloud
Data Platform in the CloudData Platform in the Cloud
Data Platform in the Cloud
 
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...Building a data pipeline to ingest data into Hadoop in minutes using Streamse...
Building a data pipeline to ingest data into Hadoop in minutes using Streamse...
 
NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1
 
Scalable Clusters On Demand
Scalable Clusters On DemandScalable Clusters On Demand
Scalable Clusters On Demand
 
TYPO3 v8 LTS in the cloud
TYPO3 v8 LTS in the cloudTYPO3 v8 LTS in the cloud
TYPO3 v8 LTS in the cloud
 
Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015Triangle Devops Meetup 10/2015
Triangle Devops Meetup 10/2015
 
Softshake 2013: Introduction to NoSQL with Couchbase
Softshake 2013: Introduction to NoSQL with CouchbaseSoftshake 2013: Introduction to NoSQL with Couchbase
Softshake 2013: Introduction to NoSQL with Couchbase
 
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned AWS Big Data Demystified #1.2 | Big Data architecture lessons learned
AWS Big Data Demystified #1.2 | Big Data architecture lessons learned
 
Clearing Airflow Obstructions
Clearing Airflow ObstructionsClearing Airflow Obstructions
Clearing Airflow Obstructions
 
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014
Big Data Pipeline for Analytics at Scale @ FIT CVUT 2014
 
OpenTelemetry For Architects
OpenTelemetry For ArchitectsOpenTelemetry For Architects
OpenTelemetry For Architects
 
PyConIE 2017 Writing and deploying serverless python applications
PyConIE 2017 Writing and deploying serverless python applicationsPyConIE 2017 Writing and deploying serverless python applications
PyConIE 2017 Writing and deploying serverless python applications
 
Netflix Architecture and Open Source
Netflix Architecture and Open SourceNetflix Architecture and Open Source
Netflix Architecture and Open Source
 

Mehr von OpenStack Foundation

Sponsor Webinar - OpenStack Summit Vancouver 2018
Sponsor Webinar  - OpenStack Summit Vancouver 2018Sponsor Webinar  - OpenStack Summit Vancouver 2018
Sponsor Webinar - OpenStack Summit Vancouver 2018OpenStack Foundation
 
OpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For AttendeesOpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For AttendeesOpenStack Foundation
 
OpenStack Marketing Plan - Community Presentation
OpenStack Marketing Plan - Community PresentationOpenStack Marketing Plan - Community Presentation
OpenStack Marketing Plan - Community PresentationOpenStack Foundation
 
OpenStack 5th Birthday - User Group Parties
OpenStack 5th Birthday - User Group PartiesOpenStack 5th Birthday - User Group Parties
OpenStack 5th Birthday - User Group PartiesOpenStack Foundation
 
Liberty release: Preliminary marketing materials & messages
Liberty release: Preliminary marketing materials & messagesLiberty release: Preliminary marketing materials & messages
Liberty release: Preliminary marketing materials & messagesOpenStack Foundation
 
OpenStack Foundation 2H 2015 Marketing Plan
OpenStack Foundation 2H 2015 Marketing PlanOpenStack Foundation 2H 2015 Marketing Plan
OpenStack Foundation 2H 2015 Marketing PlanOpenStack Foundation
 
OpenStack Summit Tokyo Sponsor Webinar
OpenStack Summit Tokyo Sponsor Webinar OpenStack Summit Tokyo Sponsor Webinar
OpenStack Summit Tokyo Sponsor Webinar OpenStack Foundation
 
Neutron Updates - Liberty Edition
Neutron Updates - Liberty Edition Neutron Updates - Liberty Edition
Neutron Updates - Liberty Edition OpenStack Foundation
 
Congress Updates - Liberty Edition
Congress Updates - Liberty EditionCongress Updates - Liberty Edition
Congress Updates - Liberty EditionOpenStack Foundation
 
Release Cycle Management Updates - Liberty Edition
Release Cycle Management Updates - Liberty EditionRelease Cycle Management Updates - Liberty Edition
Release Cycle Management Updates - Liberty EditionOpenStack Foundation
 
OpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use CasesOpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use CasesOpenStack Foundation
 
April 2015 Marketing Meeting: OpenStack Powered
April 2015 Marketing Meeting: OpenStack PoweredApril 2015 Marketing Meeting: OpenStack Powered
April 2015 Marketing Meeting: OpenStack PoweredOpenStack Foundation
 

Mehr von OpenStack Foundation (20)

Sponsor Webinar - OpenStack Summit Vancouver 2018
Sponsor Webinar  - OpenStack Summit Vancouver 2018Sponsor Webinar  - OpenStack Summit Vancouver 2018
Sponsor Webinar - OpenStack Summit Vancouver 2018
 
OpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For AttendeesOpenStack Summits 101: A Guide For Attendees
OpenStack Summits 101: A Guide For Attendees
 
OpenStack Marketing Plan - Community Presentation
OpenStack Marketing Plan - Community PresentationOpenStack Marketing Plan - Community Presentation
OpenStack Marketing Plan - Community Presentation
 
OpenStack 5th Birthday - User Group Parties
OpenStack 5th Birthday - User Group PartiesOpenStack 5th Birthday - User Group Parties
OpenStack 5th Birthday - User Group Parties
 
Liberty release: Preliminary marketing materials & messages
Liberty release: Preliminary marketing materials & messagesLiberty release: Preliminary marketing materials & messages
Liberty release: Preliminary marketing materials & messages
 
OpenStack Foundation 2H 2015 Marketing Plan
OpenStack Foundation 2H 2015 Marketing PlanOpenStack Foundation 2H 2015 Marketing Plan
OpenStack Foundation 2H 2015 Marketing Plan
 
OpenStack Summit Tokyo Sponsor Webinar
OpenStack Summit Tokyo Sponsor Webinar OpenStack Summit Tokyo Sponsor Webinar
OpenStack Summit Tokyo Sponsor Webinar
 
Cinder Updates - Liberty Edition
Cinder Updates - Liberty Edition Cinder Updates - Liberty Edition
Cinder Updates - Liberty Edition
 
Glance Updates - Liberty Edition
Glance Updates - Liberty EditionGlance Updates - Liberty Edition
Glance Updates - Liberty Edition
 
Neutron Updates - Liberty Edition
Neutron Updates - Liberty Edition Neutron Updates - Liberty Edition
Neutron Updates - Liberty Edition
 
Nova Updates - Liberty Edition
Nova Updates - Liberty EditionNova Updates - Liberty Edition
Nova Updates - Liberty Edition
 
Trove Updates - Liberty Edition
Trove Updates - Liberty EditionTrove Updates - Liberty Edition
Trove Updates - Liberty Edition
 
OpenStack: five years in
OpenStack: five years inOpenStack: five years in
OpenStack: five years in
 
Swift Updates - Liberty Edition
Swift Updates - Liberty EditionSwift Updates - Liberty Edition
Swift Updates - Liberty Edition
 
Congress Updates - Liberty Edition
Congress Updates - Liberty EditionCongress Updates - Liberty Edition
Congress Updates - Liberty Edition
 
Release Cycle Management Updates - Liberty Edition
Release Cycle Management Updates - Liberty EditionRelease Cycle Management Updates - Liberty Edition
Release Cycle Management Updates - Liberty Edition
 
OpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use CasesOpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use Cases
 
OpenStack Kilo - April 2015
OpenStack Kilo - April 2015OpenStack Kilo - April 2015
OpenStack Kilo - April 2015
 
April 2015 Marketing Meeting: OpenStack Powered
April 2015 Marketing Meeting: OpenStack PoweredApril 2015 Marketing Meeting: OpenStack Powered
April 2015 Marketing Meeting: OpenStack Powered
 
OpenStack 2015 Marketing Plan
OpenStack 2015 Marketing PlanOpenStack 2015 Marketing Plan
OpenStack 2015 Marketing Plan
 

Ceilometer presentation ODS Grizzly.pdf

  • 1. Doug Hellmann aka doughellmann/dhellmann (twitter/irc) doug.hellmann@dreamhost.com Nick Barcet aka nijaba (twitter/irc) nick.barcet@canonical.com Ceilometer The OpenStack Metering Project 15 Oct 2012 @ ODS Grizzly
  • 2. What About Billing? ● Billing has been left out of OpenStack core so far as it was not the primary problem and is not a trivial one... ● Yet almost every OpenStack deployment needs a way to track usage information
  • 3. Billing: 3 Step Process Metering Collect usage data Rating Transform usage data into billable items and calculate costs Billing Create invoice, collect payment
  • 4. Ceilometer is Metering Usage data collection is the ONLY thing common to all clouds
  • 5. Uses for Metering ● Billing ● Auditing ● Capacity Planning
  • 6. Problems to Solve ● Collecting per user/tenant usage data ○ For every resource ○ From every OpenStack component ○ In a single place ● Retrieving usage data ○ From a single place ● Doing this with an open source project ○ Everyone did this in their own corner in the past :-(
  • 8. Ceilometer Rises ● Developed in StackForge ○ Same process as OpenStack ● Minimal set of meters defined ● Targeting OpenStack core ○ incubation pending
  • 9. Design Requirements ● Scalable ○ …if your database is too
  • 10. Design Requirements ● Scalable ○ …if your database is too ● Message signature ○ Non-repudiation built in
  • 11. Design Requirements ● Scalable ○ …if your database is too ● Message signature ○ Non-repudiation built in ● Only one entry point to get data
  • 12. Design Requirements ● Scalable ○ …if your database is too ● Message signature ○ Non-repudiation built in ● Only one entry point to get data ● Extensible, add your own: ○ Agent ○ Agent plugin ○ Storage engine ○ Meters
  • 13. Design Requirements ● Scalable ○ …if your database is too ● Message signature ○ Non-repudiation built in ● Only one entry point to get data ● Extensible, add your own: ○ Agent ○ Agent plugin ○ Storage engine ○ Meters ● Use openstack-common components
  • 14. Design Requirements ● Scalable ○ …if your database is too ● Message signature ○ Non-repudiation built in ● Only one entry point to get data ● Extensible, add your own: ○ Agent ○ Agent plugin ○ Storage engine ○ Meters ● Use openstack-common components ● Accept data from many sources
  • 15. Data Triggers Ceilometer inputs are generated three ways User Action Creating, modifying, or deleting a resource Audit Regular audit events stating usage generated by the service Polling The ceilometer agent asks the service for data periodically
  • 16. Meter Categories Ceilometer handles 3 types of meters Cumulative Increasing over time (instance hours) Gauge Discrete items (floating IPs, image uploads) and fluctuating values (disk I/O) Delta Changing over time (bandwidth)
  • 23. Simple REST API Sum GET /v1/resources/(resource)/meters/(meter)/volume/sum Maximum GET /v1/resources/(resource)/meters/(meter)/volume/max Duration GET /v1/resources/(resource)/meters/(meter)/duration Raw Events GET /v1/resources/(resource)/meters/(meter) http://ceilometer.readthedocs.org/en/latest/api.html
  • 24. Roadmap Folsom Grizzly H ● Delivered last week ● Incubated Project ● Core Project ● Collects base metering ● User accessible API? ● TBD ○ nova ● Integration example with ○ glance Horizon ○ cinder ● New agents for other ○ quantum openstack components ● Basic API access ○ Swift ○ Heat? ● New uses of collector? ● SQLAlchemy storage driver
  • 25. DreamHost Use Case ● New Public Cloud Service ● Existing Billing System ● Existing Users and Accounts
  • 26. Configuring Ceilometer ● Measure exactly what we want to bill for ○ instance hours ○ block storage ○ image uploads ○ bandwidth
  • 27. Customizing Ceilometer ● Custom Bandwidth Meter ○ No charge for traffic "inside" DreamHost ○ Don't expose infrastructure details to customers ○ Measure at the router, not the VIF
  • 29. Questions? http://launchpad.net/ceilometer http://ceilometer.readthedocs.org freenode: #openstack-metering email: openstack-dev [ceilometer] Doug Hellmann Nick Barcet aka doughellmann/dhellmann (twitter/irc) aka nijaba (twitter/irc) doug.hellmann@dreamhost.com nick.barcet@canonical.com