SlideShare ist ein Scribd-Unternehmen logo
1 von 10
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Extending Gnocchi for
Batching Support
Fabio Giannetti
January 2015
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2
Introduction
• Review of current Gnocchi API and Storage Model
• Understanding of Archival Policy Granularity Requirements
• Batching Enabling Solution Prosed: Domain Level Archival Policies
• Next Steps
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
Current Gnocchi API and Storage Model
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
Current Gnocchi API and Storage Model
POST /v1/metric
{
"user_id": "525CDB19-633B-4BCB-B928-9597BFED389F",
"project_id": "26B1BC1F-B981-46F4-ADBF-FAD65336F1BA",
"archive_policy": "medium"
}
Metric
Resources
POST /v1/resource/instance
{
"user_id": "BD3A1E52-1C62-44CB-BF04-660BD88CD74D",
"project_id": "BD3A1E52-1C62-44CB-BF04-660BD88CD74D",
"flavor_id": 2,
"image_ref": "http://image",
"host": "compute1",
"display_name": "myvm",
"metrics": {"cpu.util": "ID"}
}
Metric
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5
Current Gnocchi API and Storage Model
POST /v1/metric
{
"user_id": "525CDB19-633B-4BCB-B928-9597BFED389F",
"project_id": "26B1BC1F-B981-46F4-ADBF-FAD65336F1BA",
"archive_policy": "medium"
}
Metric
POST /v1/metric/<ID>/measures
[
{
"timestamp": "2014-10-06T14:33:57",
"value": 43.1
},
…
{
"timestamp": "2014-10-06T14:34:20",
"value": 2
}
]
Measures
Archive policies are unique on a per project_id/user_id combination
Measures
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6
Current Gnocchi API and Storage Model
Metric
Measure
Metrics are only
connecting
measures to
retention policies
Measure
Metric
Resource
Measure Measure
Policy
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7
Batching Solution: Domain Level Policies
POST /v1/measures
[
{
”properties”: {
”resource_id”:
“metric_name”:
}
"timestamp": "2014-10-06T14:33:57",
"value": 43.1
},
…
{
“properties”: {
”resource_id”:
“metric_name”:
}
"timestamp": "2014-10-06T14:34:20",
"value": 2
}
]
Measures Measures
The content of properties can be stored differently depending on the database
technology. In older versions of Influx it is possible to store it a series name, but in newer
(which supports proper indexes) these can be stored as columns.
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
Batching Solution: Domain Level Policies
PUT /v1/metric/<metric_name>
{
“metric_name": “vcpus",
“domain_id”: “…”,
"archive_policy": "medium"
}
Metric
Archive policies are unique at the Domain level.
Resource
POST /v1/resource/instance
{
"user_id": “…",
"project_id": “…",
“domain_id”: “…”,
"flavor_id": 2,
"image_ref": "http://image",
"host": "compute1",
"display_name": "myvm",
"metrics": {“vcpus“, “…”, ”…”}
}
Metric
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9
Batching Solution: Domain Level Policies
Metric
Measure
Measures are now
directly connected
to Metric and
Resources and
hence batch-able
Measure
Metric
Resource
Measure Measure
Policy
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
The OpenStack word mark and the Square O Design, together or apart, are trademarks or registered trademarks of OpenStack
Foundation in the United States and other countries, and are used with the OpenStack Foundation's permission.
fabio.giannetti@hp.com

Weitere ähnliche Inhalte

Ähnlich wie Gnocchi batching

Jayashree-4.5 Years Exp on JAVA-J2EE
Jayashree-4.5 Years Exp on JAVA-J2EEJayashree-4.5 Years Exp on JAVA-J2EE
Jayashree-4.5 Years Exp on JAVA-J2EE
Jayashree Panda
 
Simple Web service Offering Repository Deposit (SWORD)‏
Simple Web service Offering Repository Deposit (SWORD)‏Simple Web service Offering Repository Deposit (SWORD)‏
Simple Web service Offering Repository Deposit (SWORD)‏
Julie Allinson
 

Ähnlich wie Gnocchi batching (20)

RESTful APIs and SBCs
RESTful APIs and SBCsRESTful APIs and SBCs
RESTful APIs and SBCs
 
HP Helion OpenStack and Professional Services
HP Helion OpenStack and Professional ServicesHP Helion OpenStack and Professional Services
HP Helion OpenStack and Professional Services
 
Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture
Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture
Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture
 
Lessons Learned Migrating from IBM BigInsights to Hortonworks Data Platform
Lessons Learned Migrating from IBM BigInsights to Hortonworks Data PlatformLessons Learned Migrating from IBM BigInsights to Hortonworks Data Platform
Lessons Learned Migrating from IBM BigInsights to Hortonworks Data Platform
 
4. Big data & analytics HP
4. Big data & analytics HP4. Big data & analytics HP
4. Big data & analytics HP
 
hadoop exp
hadoop exphadoop exp
hadoop exp
 
Virtualized Big Data Platform at VMware Corp IT @ VMWorld 2015
Virtualized Big Data Platform at VMware Corp IT @ VMWorld 2015Virtualized Big Data Platform at VMware Corp IT @ VMWorld 2015
Virtualized Big Data Platform at VMware Corp IT @ VMWorld 2015
 
Postgres in production.2014
Postgres in production.2014Postgres in production.2014
Postgres in production.2014
 
RTI Connext 5.2.0
RTI Connext 5.2.0RTI Connext 5.2.0
RTI Connext 5.2.0
 
Sunil_Vignesh
Sunil_VigneshSunil_Vignesh
Sunil_Vignesh
 
Big Data Expo 2015 - HP Information Management & Governance
Big Data Expo 2015 - HP Information Management & GovernanceBig Data Expo 2015 - HP Information Management & Governance
Big Data Expo 2015 - HP Information Management & Governance
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Cloud Roundtable | Pivoltal: Agile platform
Cloud Roundtable | Pivoltal: Agile platformCloud Roundtable | Pivoltal: Agile platform
Cloud Roundtable | Pivoltal: Agile platform
 
SCAPE - Scalable Preservation Environments
SCAPE - Scalable Preservation EnvironmentsSCAPE - Scalable Preservation Environments
SCAPE - Scalable Preservation Environments
 
LEG Keynote: Linda Knippers - HP
LEG Keynote: Linda Knippers - HPLEG Keynote: Linda Knippers - HP
LEG Keynote: Linda Knippers - HP
 
Infrastructure-as-Code with Puppet Enterprise in the Cloud - PuppetConf 2014
Infrastructure-as-Code with Puppet Enterprise in the Cloud - PuppetConf 2014Infrastructure-as-Code with Puppet Enterprise in the Cloud - PuppetConf 2014
Infrastructure-as-Code with Puppet Enterprise in the Cloud - PuppetConf 2014
 
Experience in managing service portfolio by Pasquale Pagano
Experience in managing service portfolio by Pasquale PaganoExperience in managing service portfolio by Pasquale Pagano
Experience in managing service portfolio by Pasquale Pagano
 
Jayashree-4.5 Years Exp on JAVA-J2EE
Jayashree-4.5 Years Exp on JAVA-J2EEJayashree-4.5 Years Exp on JAVA-J2EE
Jayashree-4.5 Years Exp on JAVA-J2EE
 
IRJET- Analysis of Boston’s Crime Data using Apache Pig
IRJET- Analysis of Boston’s Crime Data using Apache PigIRJET- Analysis of Boston’s Crime Data using Apache Pig
IRJET- Analysis of Boston’s Crime Data using Apache Pig
 
Simple Web service Offering Repository Deposit (SWORD)‏
Simple Web service Offering Repository Deposit (SWORD)‏Simple Web service Offering Repository Deposit (SWORD)‏
Simple Web service Offering Repository Deposit (SWORD)‏
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Kürzlich hochgeladen (20)

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 

Gnocchi batching

  • 1. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Extending Gnocchi for Batching Support Fabio Giannetti January 2015
  • 2. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2 Introduction • Review of current Gnocchi API and Storage Model • Understanding of Archival Policy Granularity Requirements • Batching Enabling Solution Prosed: Domain Level Archival Policies • Next Steps
  • 3. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3 Current Gnocchi API and Storage Model
  • 4. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4 Current Gnocchi API and Storage Model POST /v1/metric { "user_id": "525CDB19-633B-4BCB-B928-9597BFED389F", "project_id": "26B1BC1F-B981-46F4-ADBF-FAD65336F1BA", "archive_policy": "medium" } Metric Resources POST /v1/resource/instance { "user_id": "BD3A1E52-1C62-44CB-BF04-660BD88CD74D", "project_id": "BD3A1E52-1C62-44CB-BF04-660BD88CD74D", "flavor_id": 2, "image_ref": "http://image", "host": "compute1", "display_name": "myvm", "metrics": {"cpu.util": "ID"} } Metric
  • 5. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5 Current Gnocchi API and Storage Model POST /v1/metric { "user_id": "525CDB19-633B-4BCB-B928-9597BFED389F", "project_id": "26B1BC1F-B981-46F4-ADBF-FAD65336F1BA", "archive_policy": "medium" } Metric POST /v1/metric/<ID>/measures [ { "timestamp": "2014-10-06T14:33:57", "value": 43.1 }, … { "timestamp": "2014-10-06T14:34:20", "value": 2 } ] Measures Archive policies are unique on a per project_id/user_id combination Measures
  • 6. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6 Current Gnocchi API and Storage Model Metric Measure Metrics are only connecting measures to retention policies Measure Metric Resource Measure Measure Policy
  • 7. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7 Batching Solution: Domain Level Policies POST /v1/measures [ { ”properties”: { ”resource_id”: “metric_name”: } "timestamp": "2014-10-06T14:33:57", "value": 43.1 }, … { “properties”: { ”resource_id”: “metric_name”: } "timestamp": "2014-10-06T14:34:20", "value": 2 } ] Measures Measures The content of properties can be stored differently depending on the database technology. In older versions of Influx it is possible to store it a series name, but in newer (which supports proper indexes) these can be stored as columns.
  • 8. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8 Batching Solution: Domain Level Policies PUT /v1/metric/<metric_name> { “metric_name": “vcpus", “domain_id”: “…”, "archive_policy": "medium" } Metric Archive policies are unique at the Domain level. Resource POST /v1/resource/instance { "user_id": “…", "project_id": “…", “domain_id”: “…”, "flavor_id": 2, "image_ref": "http://image", "host": "compute1", "display_name": "myvm", "metrics": {“vcpus“, “…”, ”…”} } Metric
  • 9. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9 Batching Solution: Domain Level Policies Metric Measure Measures are now directly connected to Metric and Resources and hence batch-able Measure Metric Resource Measure Measure Policy
  • 10. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Thank you The OpenStack word mark and the Square O Design, together or apart, are trademarks or registered trademarks of OpenStack Foundation in the United States and other countries, and are used with the OpenStack Foundation's permission. fabio.giannetti@hp.com