SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Downloaden Sie, um offline zu lesen
Enhancing Live Migration Process for CPU and/or
memory intensive VMs running Enterprise applications
Benoit Hudzia
CEC Belfast / SAP Research
08/2011
With the contribution of Aidan Shribman and Petter Svard
Agenda
Background: Enterprise Applications and Live Migration
Warm Up
Delta Compression
© 2011 SAP AG. All rights reserved. 2
Delta Compression
Page Priority
Future Works
Background
Migrating Enterprise Class applications
Enterprise application and Live Migration
Issues
•Enterprise class application:
• Bigger than average resource requirement
• Average SAP ERP 16GB + per VM with 32 GB of swap more than common
• OLTP system such as ERP are very sensitive to time variation.
• Rely heavily on precise scheduling capabilities, triggers, timers and on the ACID compliance of the
underlying
•Challenge when migrating such application:
© 2011 SAP AG. All rights reserved. 4
•Challenge when migrating such application:
• Disconnection of services:
• Gigabit Ethernet timeout ≈ 5 seconds (>500 MB memory left in stop and copy phase )
• Downtime is workload dependent
• Disruption of services:
• Migration progressively increasing the amount of resource dedicated to itself => gradually
degrade performance of the coexisting systems / VMs.
• Difficulty to maintain consistency and transparency
• Unpredictability and rigidity
Warm Up for Live Migration
Increasing the flexibility of Live Migration
Warm Up
Increasing flexibility
Extended adaptive Pre-copy phase
without triggering actual migration
Increased flexibility :
“just in time“ triggering of live
migration
Reduce down time
Dynamic adaptive bandwidth allocation
Manual and automatic
Allow “hot standby”
Facilitate WAN link transfer
Classic Live Migration Threshold
New Live Migration Threshold
© 2011 SAP AG. All rights reserved. 6
Time
Utilization
Time
Utilization
Time
Utilization
Trigger Warmup Cancel Warmup Switch to full live
migration
Experimental Results: Warm-up Summary
SAP Sales and Distribution Benchmark
Normal
Service
Perceived Downtime
VM Stopped
Memory Transfer
before stopping
Normal
Service
WithWith
WarmupWarmup
WithoutWithout
WarmupWarmup
© 2011 SAP AG. All rights reserved. 7
WarmupWarmup
VM size : 4GBVM size : 4GB
SMP : 2SMP : 2 vCPUvCPU
Users :Users : 150150
Load ~= 80%Load ~= 80%
CPU Avg Response Time
Baseline 60% 2.18 sec
Warm-up 73% 2.16 sec
Downtime under
load: <1 sec
Success ratio : ~99%
Delta Compression of Page
Limiting the impact of resending Page
Dirty Page Delta Compression
• Cache page with highest
dirtying rate during send
operation
• Compression Algorithm:
–XBRLE : XOR +binary run length
encoding
© 2011 SAP AG. All rights reserved. 9
encoding
Vanilla (no compr.)
Delta compression
Evaluation
Benchmark
•Memory write benchmark
(lm_bench)
• 1 GB RAM, 1 vcpu VM
• Near ideal case
• Downtime reduced by a factor of 100
• Throughput increased by 63 %
•Transcoded HD Video (VLC)
• 1 GB RAM, 1 vcpu VM
• Real-world, non-ideal case
• UDP downtime reduced from 8 s to 1
• Migration is transparent using XBRLE
• 31% faster, 51% less data sent
© 2011 SAP AG. All rights reserved. 10
• Throughput increased by 63 % • 31% faster, 51% less data sent
Evaluation- SAP ERP
Sales and Distribution benchmark, load 100%
• Non-responsive on resume
with vanilla algorithm
• Survived using XBRLE
• >0.5s of downtime = risk of
damaging the system
• Measured downtime was 0.2s
for XBRLE and 2s for vanilla
• Live Migration Cpu usage
directly impact ( limit ) the
available resource for the ERP
© 2011 SAP AG. All rights reserved. 11
damaging the system
Vanilla XBRLE
HW:4x 3,0GHz Xeon dual-core 32GB RAM
16TB Raid 5, 6Gbits/s trunked NFS server
1000Mbit/s Network
VM:8 GB RAM, 4 vcpus VM
App: SAP ERP 7.0 / S&D Benchmark
Page Prioritization
Dynamic page transfer reordering
Dynamic page transfer reordering
Prioritizing page sends ( similar to writable working set concept in Xen)
© 2011 SAP AG. All rights reserved. 13
Dynamic page transfer reordering
Prioritizing page sends
© 2011 SAP AG. All rights reserved. 14
Evaluation
Prio vs XBRLE : reveal Cache miss and compression efficiency Issue
© 2011 SAP AG. All rights reserved. 15
Optimizing Compression
Making XBRLE more efficient
XBZRLE
Increase compression speed /efficiency
•Only compress unmodified data using word aligned encoding and only encodes
runs of zeros
•For encoding page diffs XBZRLE is:
• Compression :
• 20% more efficient than XBRLE
© 2011 SAP AG. All rights reserved. 17
• 20% more efficient than XBRLE
• 20% less efficient than LZO/Snappy.
• Speed:
• Overall 2.5x-5x faster than XOR + LZO/Snappy
• 11x-9x faster than the original XBRLE
•Doesn’t solve the impact of cache miss
Performance comparison
Synthetic benchmark representing enterprise workload
0
500
1000
1500
2000
2500
100
600
1100
1600
2100
2600
3100
3600
Higher bandwidth
(1778-2286 MB/s)
© 2011 SAP AG. All rights reserved. 18
0
0.5
1
1.5
2
0
0.1
0.2
0.3
0.4
0.5
SPARSE
MEDIUM
DENSE
V-DENSE
Encoding Decoding
Lower CPU time
Performance comparison
Live Migration Benchmark
•Compute capacity used for live
migration :
• xbzrle : 50%
• vanilla: between 30%-60%
•Live Migration: 10
20
30
40
50
60
%usr
%sys
%soft
Vanilla
© 2011 SAP AG. All rights reserved. 19
•Live Migration:
• xbzrle : terminate in seconds
• Vanilla :not able to complete in
the allocated time
0
0 5 10 15 20 25 30
0
10
20
30
40
50
60
0 2 4 6 8 10 12 14
%usr
%sys
%soft
s
s
XBZRLE
Future Work
Future Works
•Dynamically disable XBZRLE algorithm if the cache miss
ratio is to important
•Combine Page priority algorithm and XBZRLE:
• Cache page with highest dirtying rate
© 2011 SAP AG. All rights reserved. 21
• Eliminate unnecessary cache check
• Eliminate page compression with low potential return
Thank You!
Contact information:
Dr. Benoit Hudzia
Senior Researcher
benoit.hudzia@sap.com
Experimentations Results: S&D Benchmark with/out
warm-up
ResponseResponse Time (baseline)Time (baseline) ResponseResponse Time (warmTime (warm--up)up)
Time(ms)
Time(ms)
© 2011 SAP AG. All rights reserved. 23
Time(ms)
Time(ms)
2 s response time threshold
VM size : 4GBVM size : 4GB
SMP : 2SMP : 2 vCPUvCPU
Users : 150Users : 150
CPU Avg Response Time
Baseline 60% 2.18 sec
Warm-up 73% 2.16 sec
2 s response time threshold
Downtime under
load: <1 sec
Success ratio : ~99%
Phase 2 : Pre - copy
Duration : ~ 9 min 30 sec
Not successful (human timeout)
Probability of Survivability of the SAP
system : ~0%
Phase 3 : Frozen Transfer
Duration : ~2.16 sec
Scenario 1 : “Classic Live Migration”Scenario 2 : “Warm-up + Live Migration”
Phase 1 : Warm – up
Duration : as long as we want
Live Migration over emulated WAN Link
Physical Server
No Load
1 Vm :SAP ERP DB + CI
4GB RAM, 2 vCPU
No Load
Vm still alive and
usable
Vm Frozen
Vm Alive
ERP Alive
© 2011 SAP AG. All rights reserved. 24
Emulated WAN Link:
10 Mb/s
350 ms latency
50 ms Jitter
[1%,5%] packets drop
Shared
Storage
No part of this publication may be reproduced or transmitted in any form or for any purpose
without the express permission of SAP AG. The information contained herein may be
changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary
software components of other software vendors.
Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft
Corporation.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x,
System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer,
z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server,
PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER,
OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP,
RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX,
Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered
© 2011 SAP AG. All rights reserved
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal
Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services
mentioned herein as well as their respective logos are trademarks or registered trademarks
of Business Objects Software Ltd. Business Objects is an SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase
products and services mentioned herein as well as their respective logos are trademarks or
registered trademarks of Sybase, Inc. Sybase is an SAP company.
All other product and service names mentioned are the trademarks of their respective
companies. Data contained in this document serves informational purposes only. National
product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be
reproduced, copied, or transmitted in any form or for any purpose without the express prior
written permission of SAP AG.
This document is a preliminary version and not subject to your license agreement or any
© 2011 SAP AG. All rights reserved. 25
Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered
trademarks of IBM Corporation.
Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or
registered trademarks of Adobe Systems Incorporated in the United States and/or other
countries.
Oracle is a registered trademark of Oracle Corporation.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are
trademarks or registered trademarks of Citrix Systems, Inc.
HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World
Wide Web Consortium, Massachusetts Institute of Technology.
Java is a registered trademark of Sun Microsystems, Inc.
JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for
technology invented and implemented by Netscape.
SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer,
StreamWork, and other SAP products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of SAP AG in Germany and other
countries.
This document is a preliminary version and not subject to your license agreement or any
other agreement with SAP. This document contains only intended strategies, developments,
and functionalities of the SAP® product and is not intended to be binding upon SAP to any
particular course of business, product strategy, and/or development. Please note that this
document is subject to change and may be changed by SAP at any time without notice.
SAP assumes no responsibility for errors or omissions in this document. SAP does not
warrant the accuracy or completeness of the information, text, graphics, links, or other items
contained within this material. This document is provided without a warranty of any kind,
either express or implied, including but not limited to the implied warranties of
merchantability, fitness for a particular purpose, or non-infringement.
SAP shall have no liability for damages of any kind including without limitation direct,
special, indirect, or consequential damages that may result from the use of these materials.
This limitation shall not apply in cases of intent or gross negligence.
The statutory liability for personal injury and defective products is not affected. SAP has no
control over the information that you may access through the use of hot links contained in
these materials and does not endorse your use of third-party Web pages nor provide any
warranty whatsoever relating to third-party Web pages.

Weitere ähnliche Inhalte

Was ist angesagt?

Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Surekha Parekh
 
Lync Server 2010: High Availability [I3004]
Lync Server 2010: High Availability [I3004] Lync Server 2010: High Availability [I3004]
Lync Server 2010: High Availability [I3004] Fabrizio Volpe
 
[Hi c2011]building mission critical messaging system(guoqiang jerry)
[Hi c2011]building mission critical messaging system(guoqiang jerry)[Hi c2011]building mission critical messaging system(guoqiang jerry)
[Hi c2011]building mission critical messaging system(guoqiang jerry)baggioss
 
Hadoop Summit 2012 | HBase Consistency and Performance Improvements
Hadoop Summit 2012 | HBase Consistency and Performance ImprovementsHadoop Summit 2012 | HBase Consistency and Performance Improvements
Hadoop Summit 2012 | HBase Consistency and Performance ImprovementsCloudera, Inc.
 
Lync 2010 High Availability
Lync 2010 High AvailabilityLync 2010 High Availability
Lync 2010 High AvailabilityHarold Wong
 
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...
Developer's Most Frequent Hadoop Headaches &  How to Address Them__HadoopSumm...Developer's Most Frequent Hadoop Headaches &  How to Address Them__HadoopSumm...
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...Yahoo Developer Network
 
SQL Server Workshop Paul Bertucci
SQL Server Workshop Paul BertucciSQL Server Workshop Paul Bertucci
SQL Server Workshop Paul BertucciMark Ginnebaugh
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure PlatformVitor Tomaz
 
Shared Personalization Service - How To Scale to 15K RPS, Patrice Pelland
Shared Personalization Service - How To Scale to 15K RPS, Patrice PellandShared Personalization Service - How To Scale to 15K RPS, Patrice Pelland
Shared Personalization Service - How To Scale to 15K RPS, Patrice PellandFuenteovejuna
 
SQL Server 2008 Fast Track Data Warehouse
SQL Server 2008 Fast Track Data WarehouseSQL Server 2008 Fast Track Data Warehouse
SQL Server 2008 Fast Track Data WarehouseMark Ginnebaugh
 
Securing Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security ManagementSecuring Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security ManagementNovell
 
Windows azure uk universities overview march 2012
Windows azure uk universities overview march 2012Windows azure uk universities overview march 2012
Windows azure uk universities overview march 2012Lee Stott
 
HP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsHP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsEduardo Castro
 
2011 04-dsi-javaee-in-the-cloud-andreadis
2011 04-dsi-javaee-in-the-cloud-andreadis2011 04-dsi-javaee-in-the-cloud-andreadis
2011 04-dsi-javaee-in-the-cloud-andreadisdandre
 
Oracle10g new features
Oracle10g  new featuresOracle10g  new features
Oracle10g new featuresTanvi_Agrawal
 
DB2 pureScale Technology Preview
DB2 pureScale Technology PreviewDB2 pureScale Technology Preview
DB2 pureScale Technology PreviewCristian Molaro
 
Partitioning CCGrid 2012
Partitioning CCGrid 2012Partitioning CCGrid 2012
Partitioning CCGrid 2012Weiwei Chen
 

Was ist angesagt? (19)

Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
 
Lync Server 2010: High Availability [I3004]
Lync Server 2010: High Availability [I3004] Lync Server 2010: High Availability [I3004]
Lync Server 2010: High Availability [I3004]
 
[Hi c2011]building mission critical messaging system(guoqiang jerry)
[Hi c2011]building mission critical messaging system(guoqiang jerry)[Hi c2011]building mission critical messaging system(guoqiang jerry)
[Hi c2011]building mission critical messaging system(guoqiang jerry)
 
Hadoop Summit 2012 | HBase Consistency and Performance Improvements
Hadoop Summit 2012 | HBase Consistency and Performance ImprovementsHadoop Summit 2012 | HBase Consistency and Performance Improvements
Hadoop Summit 2012 | HBase Consistency and Performance Improvements
 
Lync 2010 High Availability
Lync 2010 High AvailabilityLync 2010 High Availability
Lync 2010 High Availability
 
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...
Developer's Most Frequent Hadoop Headaches &  How to Address Them__HadoopSumm...Developer's Most Frequent Hadoop Headaches &  How to Address Them__HadoopSumm...
Developer's Most Frequent Hadoop Headaches & How to Address Them__HadoopSumm...
 
SQL Server Workshop Paul Bertucci
SQL Server Workshop Paul BertucciSQL Server Workshop Paul Bertucci
SQL Server Workshop Paul Bertucci
 
Ta3
Ta3Ta3
Ta3
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
 
Shared Personalization Service - How To Scale to 15K RPS, Patrice Pelland
Shared Personalization Service - How To Scale to 15K RPS, Patrice PellandShared Personalization Service - How To Scale to 15K RPS, Patrice Pelland
Shared Personalization Service - How To Scale to 15K RPS, Patrice Pelland
 
SQL Server 2008 Fast Track Data Warehouse
SQL Server 2008 Fast Track Data WarehouseSQL Server 2008 Fast Track Data Warehouse
SQL Server 2008 Fast Track Data Warehouse
 
Securing Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security ManagementSecuring Your Endpoints Using Novell ZENworks Endpoint Security Management
Securing Your Endpoints Using Novell ZENworks Endpoint Security Management
 
Windows azure uk universities overview march 2012
Windows azure uk universities overview march 2012Windows azure uk universities overview march 2012
Windows azure uk universities overview march 2012
 
HP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management SolutionsHP Microsoft SQL Server Data Management Solutions
HP Microsoft SQL Server Data Management Solutions
 
2011 04-dsi-javaee-in-the-cloud-andreadis
2011 04-dsi-javaee-in-the-cloud-andreadis2011 04-dsi-javaee-in-the-cloud-andreadis
2011 04-dsi-javaee-in-the-cloud-andreadis
 
Oracle10g new features
Oracle10g  new featuresOracle10g  new features
Oracle10g new features
 
SQL Server User Group 02/2009
SQL Server User Group 02/2009SQL Server User Group 02/2009
SQL Server User Group 02/2009
 
DB2 pureScale Technology Preview
DB2 pureScale Technology PreviewDB2 pureScale Technology Preview
DB2 pureScale Technology Preview
 
Partitioning CCGrid 2012
Partitioning CCGrid 2012Partitioning CCGrid 2012
Partitioning CCGrid 2012
 

Andere mochten auch

Optimizing dirty page tracking mechanism for virtualization based fault toler...
Optimizing dirty page tracking mechanism for virtualization based fault toler...Optimizing dirty page tracking mechanism for virtualization based fault toler...
Optimizing dirty page tracking mechanism for virtualization based fault toler...MPNIKHIL
 
Yabusame: postcopy live migration for qemu/kvm
Yabusame: postcopy live migration for qemu/kvmYabusame: postcopy live migration for qemu/kvm
Yabusame: postcopy live migration for qemu/kvmIsaku Yamahata
 
Dram row-hammer kim-talk_isca14
Dram row-hammer kim-talk_isca14Dram row-hammer kim-talk_isca14
Dram row-hammer kim-talk_isca14Benoit Hudzia
 
Nvmw 2014 extending main memory with flash-the optimized swap approach
Nvmw 2014  extending main memory with flash-the optimized swap approachNvmw 2014  extending main memory with flash-the optimized swap approach
Nvmw 2014 extending main memory with flash-the optimized swap approachBenoit Hudzia
 
TLDK - FD.io Sept 2016
TLDK - FD.io Sept 2016 TLDK - FD.io Sept 2016
TLDK - FD.io Sept 2016 Benoit Hudzia
 
Hana Memory Scale out using the hecatonchire Project
Hana Memory Scale out using the hecatonchire ProjectHana Memory Scale out using the hecatonchire Project
Hana Memory Scale out using the hecatonchire ProjectBenoit Hudzia
 
Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)Novell
 

Andere mochten auch (8)

Optimizing dirty page tracking mechanism for virtualization based fault toler...
Optimizing dirty page tracking mechanism for virtualization based fault toler...Optimizing dirty page tracking mechanism for virtualization based fault toler...
Optimizing dirty page tracking mechanism for virtualization based fault toler...
 
Yabusame: postcopy live migration for qemu/kvm
Yabusame: postcopy live migration for qemu/kvmYabusame: postcopy live migration for qemu/kvm
Yabusame: postcopy live migration for qemu/kvm
 
Dram row-hammer kim-talk_isca14
Dram row-hammer kim-talk_isca14Dram row-hammer kim-talk_isca14
Dram row-hammer kim-talk_isca14
 
Nvmw 2014 extending main memory with flash-the optimized swap approach
Nvmw 2014  extending main memory with flash-the optimized swap approachNvmw 2014  extending main memory with flash-the optimized swap approach
Nvmw 2014 extending main memory with flash-the optimized swap approach
 
Persistent memory
Persistent memoryPersistent memory
Persistent memory
 
TLDK - FD.io Sept 2016
TLDK - FD.io Sept 2016 TLDK - FD.io Sept 2016
TLDK - FD.io Sept 2016
 
Hana Memory Scale out using the hecatonchire Project
Hana Memory Scale out using the hecatonchire ProjectHana Memory Scale out using the hecatonchire Project
Hana Memory Scale out using the hecatonchire Project
 
Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)Virtualization with KVM (Kernel-based Virtual Machine)
Virtualization with KVM (Kernel-based Virtual Machine)
 

Ähnlich wie Enhancing Live Migration Process for CPU and/or memory intensive VMs running Enterprise application - KVM forum 2011

Flash changes everything?! Flash changes nothing...
Flash changes everything?! Flash changes nothing...Flash changes everything?! Flash changes nothing...
Flash changes everything?! Flash changes nothing...Proact Netherlands B.V.
 
NVMe and Flash – Make Your Storage Great Again!
NVMe and Flash – Make Your Storage Great Again!NVMe and Flash – Make Your Storage Great Again!
NVMe and Flash – Make Your Storage Great Again!DataCore Software
 
Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community
 
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...Ceph Community
 
Exadata x4 for_sap
Exadata x4 for_sapExadata x4 for_sap
Exadata x4 for_sapFran Navarro
 
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...Ceph Community
 
Software Stacks to enable SDN and NFV
Software Stacks to enable SDN and NFVSoftware Stacks to enable SDN and NFV
Software Stacks to enable SDN and NFVYoshihiro Nakajima
 
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Community
 
Tidal scale short_story_v2
Tidal scale short_story_v2Tidal scale short_story_v2
Tidal scale short_story_v2Chuck Piercey
 
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSumeet Bansal
 
A5 oracle exadata-the game changer for online transaction processing data w...
A5   oracle exadata-the game changer for online transaction processing data w...A5   oracle exadata-the game changer for online transaction processing data w...
A5 oracle exadata-the game changer for online transaction processing data w...Dr. Wilfred Lin (Ph.D.)
 
Performance tuning intro
Performance tuning introPerformance tuning intro
Performance tuning introaioughydchapter
 
Architectural designs driving sql server performance and high availability
Architectural designs driving sql server performance and high availabilityArchitectural designs driving sql server performance and high availability
Architectural designs driving sql server performance and high availabilitySumeet Bansal
 
EMEA TechTalk – The NetApp Flash Optimized Portfolio
EMEA TechTalk – The NetApp Flash Optimized PortfolioEMEA TechTalk – The NetApp Flash Optimized Portfolio
EMEA TechTalk – The NetApp Flash Optimized PortfolioNetApp
 
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017Cloud Native Day Tel Aviv
 
Building Scalable Applications using Pivotal Gemfire/Apache Geode
Building Scalable Applications using Pivotal Gemfire/Apache GeodeBuilding Scalable Applications using Pivotal Gemfire/Apache Geode
Building Scalable Applications using Pivotal Gemfire/Apache Geodeimcpune
 
Impact2014 session # 1523 performance optimization using ibm java on z and w...
Impact2014  session # 1523 performance optimization using ibm java on z and w...Impact2014  session # 1523 performance optimization using ibm java on z and w...
Impact2014 session # 1523 performance optimization using ibm java on z and w...Elena Nanos
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015Daniela Zuppini
 

Ähnlich wie Enhancing Live Migration Process for CPU and/or memory intensive VMs running Enterprise application - KVM forum 2011 (20)

Flash changes everything?! Flash changes nothing...
Flash changes everything?! Flash changes nothing...Flash changes everything?! Flash changes nothing...
Flash changes everything?! Flash changes nothing...
 
NVMe and Flash – Make Your Storage Great Again!
NVMe and Flash – Make Your Storage Great Again!NVMe and Flash – Make Your Storage Great Again!
NVMe and Flash – Make Your Storage Great Again!
 
Autodesk Technical Webinar: SAP HANA in-memory database
Autodesk Technical Webinar: SAP HANA in-memory databaseAutodesk Technical Webinar: SAP HANA in-memory database
Autodesk Technical Webinar: SAP HANA in-memory database
 
Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph Ceph Community Talk on High-Performance Solid Sate Ceph
Ceph Community Talk on High-Performance Solid Sate Ceph
 
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...
Accelerating Ceph Performance with High Speed Networks and Protocols - Qingch...
 
Exadata x4 for_sap
Exadata x4 for_sapExadata x4 for_sap
Exadata x4 for_sap
 
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...
Ceph Day Berlin: Deploying Flash Storage for Ceph without Compromising Perfor...
 
Software Stacks to enable SDN and NFV
Software Stacks to enable SDN and NFVSoftware Stacks to enable SDN and NFV
Software Stacks to enable SDN and NFV
 
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
 
Tidal scale short_story_v2
Tidal scale short_story_v2Tidal scale short_story_v2
Tidal scale short_story_v2
 
Performance Tuning intro
Performance Tuning introPerformance Tuning intro
Performance Tuning intro
 
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teamsSQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teams
 
A5 oracle exadata-the game changer for online transaction processing data w...
A5   oracle exadata-the game changer for online transaction processing data w...A5   oracle exadata-the game changer for online transaction processing data w...
A5 oracle exadata-the game changer for online transaction processing data w...
 
Performance tuning intro
Performance tuning introPerformance tuning intro
Performance tuning intro
 
Architectural designs driving sql server performance and high availability
Architectural designs driving sql server performance and high availabilityArchitectural designs driving sql server performance and high availability
Architectural designs driving sql server performance and high availability
 
EMEA TechTalk – The NetApp Flash Optimized Portfolio
EMEA TechTalk – The NetApp Flash Optimized PortfolioEMEA TechTalk – The NetApp Flash Optimized Portfolio
EMEA TechTalk – The NetApp Flash Optimized Portfolio
 
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
OpenStack and NetApp - Chen Reuven - OpenStack Day Israel 2017
 
Building Scalable Applications using Pivotal Gemfire/Apache Geode
Building Scalable Applications using Pivotal Gemfire/Apache GeodeBuilding Scalable Applications using Pivotal Gemfire/Apache Geode
Building Scalable Applications using Pivotal Gemfire/Apache Geode
 
Impact2014 session # 1523 performance optimization using ibm java on z and w...
Impact2014  session # 1523 performance optimization using ibm java on z and w...Impact2014  session # 1523 performance optimization using ibm java on z and w...
Impact2014 session # 1523 performance optimization using ibm java on z and w...
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015
 

Kürzlich hochgeladen

Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 

Kürzlich hochgeladen (20)

Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 

Enhancing Live Migration Process for CPU and/or memory intensive VMs running Enterprise application - KVM forum 2011

  • 1. Enhancing Live Migration Process for CPU and/or memory intensive VMs running Enterprise applications Benoit Hudzia CEC Belfast / SAP Research 08/2011 With the contribution of Aidan Shribman and Petter Svard
  • 2. Agenda Background: Enterprise Applications and Live Migration Warm Up Delta Compression © 2011 SAP AG. All rights reserved. 2 Delta Compression Page Priority Future Works
  • 4. Enterprise application and Live Migration Issues •Enterprise class application: • Bigger than average resource requirement • Average SAP ERP 16GB + per VM with 32 GB of swap more than common • OLTP system such as ERP are very sensitive to time variation. • Rely heavily on precise scheduling capabilities, triggers, timers and on the ACID compliance of the underlying •Challenge when migrating such application: © 2011 SAP AG. All rights reserved. 4 •Challenge when migrating such application: • Disconnection of services: • Gigabit Ethernet timeout ≈ 5 seconds (>500 MB memory left in stop and copy phase ) • Downtime is workload dependent • Disruption of services: • Migration progressively increasing the amount of resource dedicated to itself => gradually degrade performance of the coexisting systems / VMs. • Difficulty to maintain consistency and transparency • Unpredictability and rigidity
  • 5. Warm Up for Live Migration Increasing the flexibility of Live Migration
  • 6. Warm Up Increasing flexibility Extended adaptive Pre-copy phase without triggering actual migration Increased flexibility : “just in time“ triggering of live migration Reduce down time Dynamic adaptive bandwidth allocation Manual and automatic Allow “hot standby” Facilitate WAN link transfer Classic Live Migration Threshold New Live Migration Threshold © 2011 SAP AG. All rights reserved. 6 Time Utilization Time Utilization Time Utilization Trigger Warmup Cancel Warmup Switch to full live migration
  • 7. Experimental Results: Warm-up Summary SAP Sales and Distribution Benchmark Normal Service Perceived Downtime VM Stopped Memory Transfer before stopping Normal Service WithWith WarmupWarmup WithoutWithout WarmupWarmup © 2011 SAP AG. All rights reserved. 7 WarmupWarmup VM size : 4GBVM size : 4GB SMP : 2SMP : 2 vCPUvCPU Users :Users : 150150 Load ~= 80%Load ~= 80% CPU Avg Response Time Baseline 60% 2.18 sec Warm-up 73% 2.16 sec Downtime under load: <1 sec Success ratio : ~99%
  • 8. Delta Compression of Page Limiting the impact of resending Page
  • 9. Dirty Page Delta Compression • Cache page with highest dirtying rate during send operation • Compression Algorithm: –XBRLE : XOR +binary run length encoding © 2011 SAP AG. All rights reserved. 9 encoding Vanilla (no compr.) Delta compression
  • 10. Evaluation Benchmark •Memory write benchmark (lm_bench) • 1 GB RAM, 1 vcpu VM • Near ideal case • Downtime reduced by a factor of 100 • Throughput increased by 63 % •Transcoded HD Video (VLC) • 1 GB RAM, 1 vcpu VM • Real-world, non-ideal case • UDP downtime reduced from 8 s to 1 • Migration is transparent using XBRLE • 31% faster, 51% less data sent © 2011 SAP AG. All rights reserved. 10 • Throughput increased by 63 % • 31% faster, 51% less data sent
  • 11. Evaluation- SAP ERP Sales and Distribution benchmark, load 100% • Non-responsive on resume with vanilla algorithm • Survived using XBRLE • >0.5s of downtime = risk of damaging the system • Measured downtime was 0.2s for XBRLE and 2s for vanilla • Live Migration Cpu usage directly impact ( limit ) the available resource for the ERP © 2011 SAP AG. All rights reserved. 11 damaging the system Vanilla XBRLE HW:4x 3,0GHz Xeon dual-core 32GB RAM 16TB Raid 5, 6Gbits/s trunked NFS server 1000Mbit/s Network VM:8 GB RAM, 4 vcpus VM App: SAP ERP 7.0 / S&D Benchmark
  • 12. Page Prioritization Dynamic page transfer reordering
  • 13. Dynamic page transfer reordering Prioritizing page sends ( similar to writable working set concept in Xen) © 2011 SAP AG. All rights reserved. 13
  • 14. Dynamic page transfer reordering Prioritizing page sends © 2011 SAP AG. All rights reserved. 14
  • 15. Evaluation Prio vs XBRLE : reveal Cache miss and compression efficiency Issue © 2011 SAP AG. All rights reserved. 15
  • 17. XBZRLE Increase compression speed /efficiency •Only compress unmodified data using word aligned encoding and only encodes runs of zeros •For encoding page diffs XBZRLE is: • Compression : • 20% more efficient than XBRLE © 2011 SAP AG. All rights reserved. 17 • 20% more efficient than XBRLE • 20% less efficient than LZO/Snappy. • Speed: • Overall 2.5x-5x faster than XOR + LZO/Snappy • 11x-9x faster than the original XBRLE •Doesn’t solve the impact of cache miss
  • 18. Performance comparison Synthetic benchmark representing enterprise workload 0 500 1000 1500 2000 2500 100 600 1100 1600 2100 2600 3100 3600 Higher bandwidth (1778-2286 MB/s) © 2011 SAP AG. All rights reserved. 18 0 0.5 1 1.5 2 0 0.1 0.2 0.3 0.4 0.5 SPARSE MEDIUM DENSE V-DENSE Encoding Decoding Lower CPU time
  • 19. Performance comparison Live Migration Benchmark •Compute capacity used for live migration : • xbzrle : 50% • vanilla: between 30%-60% •Live Migration: 10 20 30 40 50 60 %usr %sys %soft Vanilla © 2011 SAP AG. All rights reserved. 19 •Live Migration: • xbzrle : terminate in seconds • Vanilla :not able to complete in the allocated time 0 0 5 10 15 20 25 30 0 10 20 30 40 50 60 0 2 4 6 8 10 12 14 %usr %sys %soft s s XBZRLE
  • 21. Future Works •Dynamically disable XBZRLE algorithm if the cache miss ratio is to important •Combine Page priority algorithm and XBZRLE: • Cache page with highest dirtying rate © 2011 SAP AG. All rights reserved. 21 • Eliminate unnecessary cache check • Eliminate page compression with low potential return
  • 22. Thank You! Contact information: Dr. Benoit Hudzia Senior Researcher benoit.hudzia@sap.com
  • 23. Experimentations Results: S&D Benchmark with/out warm-up ResponseResponse Time (baseline)Time (baseline) ResponseResponse Time (warmTime (warm--up)up) Time(ms) Time(ms) © 2011 SAP AG. All rights reserved. 23 Time(ms) Time(ms) 2 s response time threshold VM size : 4GBVM size : 4GB SMP : 2SMP : 2 vCPUvCPU Users : 150Users : 150 CPU Avg Response Time Baseline 60% 2.18 sec Warm-up 73% 2.16 sec 2 s response time threshold Downtime under load: <1 sec Success ratio : ~99%
  • 24. Phase 2 : Pre - copy Duration : ~ 9 min 30 sec Not successful (human timeout) Probability of Survivability of the SAP system : ~0% Phase 3 : Frozen Transfer Duration : ~2.16 sec Scenario 1 : “Classic Live Migration”Scenario 2 : “Warm-up + Live Migration” Phase 1 : Warm – up Duration : as long as we want Live Migration over emulated WAN Link Physical Server No Load 1 Vm :SAP ERP DB + CI 4GB RAM, 2 vCPU No Load Vm still alive and usable Vm Frozen Vm Alive ERP Alive © 2011 SAP AG. All rights reserved. 24 Emulated WAN Link: 10 Mb/s 350 ms latency 50 ms Jitter [1%,5%] packets drop Shared Storage
  • 25. No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered © 2011 SAP AG. All rights reserved Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company. Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG. This document is a preliminary version and not subject to your license agreement or any © 2011 SAP AG. All rights reserved. 25 Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. Java is a registered trademark of Sun Microsystems, Inc. JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence. The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.