SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Downloaden Sie, um offline zu lesen
© 2009 IBM Corporation
zIIP Capacity Planning
Martin Packer
martin_packer@uk.ibm.com @martinpacker
© 2014 IBM Corporation2
Abstract
zIIP Capacity Planning tends to be neglected - in favour of General-Purpose Engines (GCPs).
With recent enhancements to DB2 allowing you to offload critical CPU to zIIPs, and to get the
most out of zAAP-on-zIIP, it's time to take zIIP Capacity Planning seriously.
This presentation describes how to do zIIP Capacity Planning properly - with instrumentation
and guidelines.
© 2014 IBM Corporation3
If You Only Remember 3 4 Things
Capacity Planning for zIIPs has become much more important
Pay especial attention to what % Busy represents “full”
Measure zIIP potential and usage down to the address space level
Consider LPAR configuration carefully for zIIPs
© 2014 IBM Corporation4
Why People Don't Do zIIP Capacity Planning
zIIPs are much cheaper than general purpose processors (GCPs)
– Maintenance cost lower also
zIIPs don't attract a software bill
zIIP Utilization hasn't historically been all that high
zIIP-eligible work can spill to GCPs at a pinch
zIIPs are sometimes not the most carefully considered part of a purchase
Ignoring zIIPs, ICFs, IFLs, zAAPs simplifies things to a single processor pool
© 2014 IBM Corporation5
But consider
Spilling to a GCP costs money
Not spilling to a GCP can cost performance & scalability
zIIPs aren't free
Shoving another processor book in can be difficult or impossible
– And at end of processor life upgrades become impossible
More software that exploits zIIP installed
– Some more performance-critical than previous exploiters
New and modernised applications increasingly use zIIP
LPAR configuration for zIIPs affects their performance
© 2014 IBM Corporation6
Recent News
zAAP On zIIP
– Even with zAAPs installed
New 2 : 1 zIIP : GCP configuration rule with zEC12 and zBC12 processors
DB2 Version 10 Deferred Write and Prefetch Engines
DB2 Version 11 further exploiters
© 2014 IBM Corporation7
DB2 Version 10 Deferred Write And Prefetch Engines
Substantial portion of DBM1 address space CPU
– Changed by APAR PM30468 from MSTR address space
100% eligible for zIIP
Very stringent performance requirements
– Must not be delayed
– Latency to cross over to GCP generally too high
Substantially changes zIIP Capacity Planning rules
Treat DBM1 as a key address space and protect its access to CPU, including zIIP
© 2014 IBM Corporation8
Why Protect DB2 System Address Spaces From Being Pre-empted?
MSTR contains the DB2 system monitor task
– Requires aggressive WLM goal to monitor CPU stalls & virtual storage constraints
DBM1 manages DB2 threads & critical for local DB2 latch & cross-system locking
negotiation
– Any delay in negotiating a critical system or application resource (e.g. P-lock on a space
map page) can lead to a slowdown of the whole DB2 data sharing group
DIST & WLM-managed stored procedure AS only run the DB2 service tasks
– i.e. work performed for DB2 not attributable to a single user
– Classification of incoming workload, scheduling of external stored procedures, etc.
– Typically means these address spaces place a minimal CPU load on the system
• BUT… they do require minimal CPU delay to ensure good system wide performance
– The higher CPU demands to run DDF and/or SP workloads are controlled by the WLM
service class definitions for the DDF enclave workloads or the other workloads calling
the SP
• Clear separation between DB2 services which are long-running started tasks used to
manage the environment and transaction workloads that run and use DB2 services
© 2014 IBM Corporation9
© 2014 IBM Corporation10
So Let's Take This Seriously...
© 2014 IBM Corporation11
Many Sources Of Information
From RMF:
– SMF 70
– SMF 72-3
From z/OS:
– SMF 30
From middleware:
– SMF 101 DB2 Accounting Trace
– SMF 110 CICS Statistics Trace
© 2014 IBM Corporation12
With RMF data you can ... see zIIP Pool Busy
© 2014 IBM Corporation13
© 2014 IBM Corporation14
...break down by LPAR
© 2014 IBM Corporation15
© 2014 IBM Corporation16
...drive down to the Service Class level
(Slide is for zIIP on GCP)
© 2014 IBM Corporation17
© 2014 IBM Corporation18
Service Class (Period) Information
For Velocity Goal service class periods you get samples...
For work that's not zIIP eligible you get e.g. Using and Delay samples for CPU and I/O
– These are the sample counters that affect the velocity calculation:
Velocity % = 100 x Using / (Using + Delay)
With zIIP-eligible work you get better resolution – as you get Using and Delay samples
specific to zIIP
Useful to correlate Delay for zIIP with % zIIP on GCP
– Can explain behaviour
© 2014 IBM Corporation19
© 2014 IBM Corporation20
Understanding Your Exploiters
Exploiters come in different shapes and sizes
– And leave “footprints” accordingly
Dependent Enclave
– e.g. DBM1 Prefetch / Deferred Write
Independent Enclave
– e.g. DDF
zAAP-on-zIIP
– Formerly zAAP-eligible e.g. Java
e.g. Dependent Enclave for DBM1 Address Space is Performance Critical from DB2 Version 10
© 2014 IBM Corporation21
Understanding Your Exploiters ...
Table summarised over several hours. You probably need peak 15 – 30 mins
© 2014 IBM Corporation22
A DB2 Version DBM1 Address Space's zIIP and CPU Usage Over 24 Hours
© 2014 IBM Corporation23
Projections
Projecting Near-Term zIIP CPU Requirements:
– For existing workloads that don't run on a zIIP:
• “Project CPU” reports how much CPU is zIIP-eligible via RMF
• DB2 V9 Specific: Coarse Upper Bound on V10 zIIP-eligible is all DBM1 CPU
– For workloads that don't exist yet use any sizing guidelines you can get
– Some “adaptive exploiters” exist:
• These only try to use zIIP if one configured
• “Project CPU” will show zero
Projecting Into The Future
– The same as standard CPU Capacity Planning
© 2014 IBM Corporation24
zIIP “Short Engine” Effect LPAR Configuration is important
LPARs with low zIIP usage sharing a zIIP
– Especially with a low weight
Potential high latency in logical zIIP being dispatched
– If other LPARs have the zIIP
In multiple zIIP case Hiperdispatch can help
– “Corrals” work into fewer logical ( & physical) zIIPs
– But e.g. 1-Way Queuing regime has unhelpful characteristics
Of especial concern:
– Single zIIP LPAR with low weight and only “DBM1 Engines” exploiter
– Consider not configuring the zIIP to the LPAR
© 2014 IBM Corporation25
zIIP To GCP Ratios
What's most important is how the zIIP performs
Extreme case 12 : 1 GCP : zIIP ratio especially unhelpful because of the “1”
An unscientific view is that somewhere in the region of 2 : 1 to 4 : 1 is rarely harmful
Consider both “in LPAR” and “across the machine” effects
– Sometimes the answer will be “no zIIPs for this LPAR”
© 2014 IBM Corporation26
Subcapacity General Purpose Processors
zIIP runs at full speed
– e.g. about twice as fast as a 6xx General Purpose Processor (GCP)
Good news:
– zIIP higher capacity and faster than GCP
Not so good news:
– zIIP-eligible work running on a GCP is worse
– Variability in speed if some runs on zIIP and some not
• Not terribly different to DDF situation since PM12256
How this plays depends on numbers of threads and CPU-intensiveness
CPU Conversion Factor:
– Use R723NFFS to convert zIIP CPU to GCP equivalent (and vice versa)
Consider configuring more zIIPs than the raw capacity requirement would suggest
© 2014 IBM Corporation27
Conclusions
© 2014 IBM Corporation28
If You Only Remembered 3 4 Things I Hope They Were
Capacity Planning for zIIPs has become much more important
Pay especial attention to what % Busy represents “full”
Measure zIIP potential and usage down to the address space level
Consider LPAR configuration carefully for zIIPs
© 2014 IBM Corporation29
Burn Before Reading :-)
Date Version
13 Jan 2014 1 Original version
07 Feb 2014 2 Updated thanks to comments from Kathy Walsh and slide on DB2
address spaces from John Campbell. Also has abstract.
13 Apr 2014 3 Added slide on Subcapacity Models. Plus thoughts on V10 Estimation
and on % of DBM1 work that is zIIP-eligible.

Weitere ähnliche Inhalte

Was ist angesagt?

Munich 2016 - Z011598 Martin Packer - He Picks On CICS
Munich 2016 - Z011598 Martin Packer - He Picks On CICSMunich 2016 - Z011598 Martin Packer - He Picks On CICS
Munich 2016 - Z011598 Martin Packer - He Picks On CICSMartin Packer
 
Memory Matters in 2011
Memory Matters in 2011Memory Matters in 2011
Memory Matters in 2011Martin Packer
 
Even More Fun With DDF
Even More Fun With DDFEven More Fun With DDF
Even More Fun With DDFMartin Packer
 
Munich 2016 - Z011599 Martin Packer - More Fun With DDF
Munich 2016 - Z011599 Martin Packer - More Fun With DDFMunich 2016 - Z011599 Martin Packer - More Fun With DDF
Munich 2016 - Z011599 Martin Packer - More Fun With DDFMartin Packer
 
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the mythsDB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the mythsFlorence Dubois
 
Educational seminar lessons learned from customer db2 for z os health check...
Educational seminar   lessons learned from customer db2 for z os health check...Educational seminar   lessons learned from customer db2 for z os health check...
Educational seminar lessons learned from customer db2 for z os health check...John Campbell
 
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)Florence Dubois
 
Top 5 performance and capacity challenges for z/OS
Top 5 performance and capacity challenges for z/OS Top 5 performance and capacity challenges for z/OS
Top 5 performance and capacity challenges for z/OS Metron
 
Life And Times Of An Address Space
Life And Times Of An Address SpaceLife And Times Of An Address Space
Life And Times Of An Address SpaceMartin Packer
 
FlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OSFlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OSFlorence Dubois
 
DB2 for z/OS - Starter's guide to memory monitoring and control
DB2 for z/OS - Starter's guide to memory monitoring and controlDB2 for z/OS - Starter's guide to memory monitoring and control
DB2 for z/OS - Starter's guide to memory monitoring and controlFlorence Dubois
 
Best practices for DB2 for z/OS log based recovery
Best practices for DB2 for z/OS log based recoveryBest practices for DB2 for z/OS log based recovery
Best practices for DB2 for z/OS log based recoveryFlorence Dubois
 
DB2 Data Sharing Performance
DB2 Data Sharing PerformanceDB2 Data Sharing Performance
DB2 Data Sharing PerformanceMartin Packer
 
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondA Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondSurekha Parekh
 
DB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilityDB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilitySurekha Parekh
 
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle Surekha Parekh
 
A First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM ChangesA First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM ChangesWillie Favero
 
Capacity Management for system z license charge reporting
Capacity Management for system z  license charge reportingCapacity Management for system z  license charge reporting
Capacity Management for system z license charge reportingMetron
 

Was ist angesagt? (19)

Munich 2016 - Z011598 Martin Packer - He Picks On CICS
Munich 2016 - Z011598 Martin Packer - He Picks On CICSMunich 2016 - Z011598 Martin Packer - He Picks On CICS
Munich 2016 - Z011598 Martin Packer - He Picks On CICS
 
Memory Matters in 2011
Memory Matters in 2011Memory Matters in 2011
Memory Matters in 2011
 
Even More Fun With DDF
Even More Fun With DDFEven More Fun With DDF
Even More Fun With DDF
 
Much Ado About CPU
Much Ado About CPUMuch Ado About CPU
Much Ado About CPU
 
Munich 2016 - Z011599 Martin Packer - More Fun With DDF
Munich 2016 - Z011599 Martin Packer - More Fun With DDFMunich 2016 - Z011599 Martin Packer - More Fun With DDF
Munich 2016 - Z011599 Martin Packer - More Fun With DDF
 
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the mythsDB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
 
Educational seminar lessons learned from customer db2 for z os health check...
Educational seminar   lessons learned from customer db2 for z os health check...Educational seminar   lessons learned from customer db2 for z os health check...
Educational seminar lessons learned from customer db2 for z os health check...
 
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
 
Top 5 performance and capacity challenges for z/OS
Top 5 performance and capacity challenges for z/OS Top 5 performance and capacity challenges for z/OS
Top 5 performance and capacity challenges for z/OS
 
Life And Times Of An Address Space
Life And Times Of An Address SpaceLife And Times Of An Address Space
Life And Times Of An Address Space
 
FlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OSFlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OS
 
DB2 for z/OS - Starter's guide to memory monitoring and control
DB2 for z/OS - Starter's guide to memory monitoring and controlDB2 for z/OS - Starter's guide to memory monitoring and control
DB2 for z/OS - Starter's guide to memory monitoring and control
 
Best practices for DB2 for z/OS log based recovery
Best practices for DB2 for z/OS log based recoveryBest practices for DB2 for z/OS log based recovery
Best practices for DB2 for z/OS log based recovery
 
DB2 Data Sharing Performance
DB2 Data Sharing PerformanceDB2 Data Sharing Performance
DB2 Data Sharing Performance
 
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondA Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
 
DB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilityDB2 Design for High Availability and Scalability
DB2 Design for High Availability and Scalability
 
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle
 
A First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM ChangesA First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM Changes
 
Capacity Management for system z license charge reporting
Capacity Management for system z  license charge reportingCapacity Management for system z  license charge reporting
Capacity Management for system z license charge reporting
 

Ähnlich wie zIIP Capacity Planning

Session 7362 Handout 427 0
Session 7362 Handout 427 0Session 7362 Handout 427 0
Session 7362 Handout 427 0jln1028
 
Db2 10 memory management uk db2 user group june 2013 [read-only]
Db2 10 memory management   uk db2 user group june 2013 [read-only]Db2 10 memory management   uk db2 user group june 2013 [read-only]
Db2 10 memory management uk db2 user group june 2013 [read-only]Laura Hood
 
Db2 10 memory management uk db2 user group june 2013
Db2 10 memory management   uk db2 user group june 2013Db2 10 memory management   uk db2 user group june 2013
Db2 10 memory management uk db2 user group june 2013Carol Davis-Mann
 
Db2 on cloud overview
Db2 on cloud overviewDb2 on cloud overview
Db2 on cloud overviewModusOptimum
 
IBM Analytics Accelerator Trends & Directions Namk Hrle
IBM Analytics Accelerator  Trends & Directions Namk Hrle IBM Analytics Accelerator  Trends & Directions Namk Hrle
IBM Analytics Accelerator Trends & Directions Namk Hrle Surekha Parekh
 
Introducing MFX for z/OS 2.1 & ZPSaver Suite
Introducing MFX for z/OS 2.1 & ZPSaver SuiteIntroducing MFX for z/OS 2.1 & ZPSaver Suite
Introducing MFX for z/OS 2.1 & ZPSaver SuitePrecisely
 
DB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and OptimisationDB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and OptimisationJohn Campbell
 
DB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesDB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesJohn Campbell
 
Connect2013 id506 hadr ideas for social business
Connect2013 id506 hadr ideas for social businessConnect2013 id506 hadr ideas for social business
Connect2013 id506 hadr ideas for social businessLuis Guirigay
 
Lotusphere 2012: BP117 Server Colsolidations Done Right
Lotusphere 2012: BP117 Server Colsolidations Done RightLotusphere 2012: BP117 Server Colsolidations Done Right
Lotusphere 2012: BP117 Server Colsolidations Done RightFranziska Tanner
 
Bp117 server consolidations
Bp117 server consolidationsBp117 server consolidations
Bp117 server consolidationspanagenda
 
PPCD_And_AmazonRDS
PPCD_And_AmazonRDSPPCD_And_AmazonRDS
PPCD_And_AmazonRDSVibhor Kumar
 
Coupling Facility CPU
Coupling Facility CPUCoupling Facility CPU
Coupling Facility CPUMartin Packer
 
Row #9: An architecture overview of APNIC's RDAP deployment to the cloud
Row #9: An architecture overview of APNIC's RDAP deployment to the cloudRow #9: An architecture overview of APNIC's RDAP deployment to the cloud
Row #9: An architecture overview of APNIC's RDAP deployment to the cloudAPNIC
 
HDT for Mainframe Considerations: Simplified Tiered Storage
HDT for Mainframe Considerations: Simplified Tiered StorageHDT for Mainframe Considerations: Simplified Tiered Storage
HDT for Mainframe Considerations: Simplified Tiered StorageHitachi Vantara
 
System z Technology Summit Streamlining Utilities
System z Technology Summit Streamlining UtilitiesSystem z Technology Summit Streamlining Utilities
System z Technology Summit Streamlining UtilitiesSurekha Parekh
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015Daniela Zuppini
 
Serverless Apps on Google Cloud: more dev, less ops
Serverless Apps on Google Cloud: more dev, less opsServerless Apps on Google Cloud: more dev, less ops
Serverless Apps on Google Cloud: more dev, less opsmabl
 

Ähnlich wie zIIP Capacity Planning (20)

Session 7362 Handout 427 0
Session 7362 Handout 427 0Session 7362 Handout 427 0
Session 7362 Handout 427 0
 
Db2 10 memory management uk db2 user group june 2013 [read-only]
Db2 10 memory management   uk db2 user group june 2013 [read-only]Db2 10 memory management   uk db2 user group june 2013 [read-only]
Db2 10 memory management uk db2 user group june 2013 [read-only]
 
Db2 10 memory management uk db2 user group june 2013
Db2 10 memory management   uk db2 user group june 2013Db2 10 memory management   uk db2 user group june 2013
Db2 10 memory management uk db2 user group june 2013
 
Db2 on cloud overview
Db2 on cloud overviewDb2 on cloud overview
Db2 on cloud overview
 
IBM Analytics Accelerator Trends & Directions Namk Hrle
IBM Analytics Accelerator  Trends & Directions Namk Hrle IBM Analytics Accelerator  Trends & Directions Namk Hrle
IBM Analytics Accelerator Trends & Directions Namk Hrle
 
Introducing MFX for z/OS 2.1 & ZPSaver Suite
Introducing MFX for z/OS 2.1 & ZPSaver SuiteIntroducing MFX for z/OS 2.1 & ZPSaver Suite
Introducing MFX for z/OS 2.1 & ZPSaver Suite
 
DB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and OptimisationDB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
 
DB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesDB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer Experiences
 
Connect2013 id506 hadr ideas for social business
Connect2013 id506 hadr ideas for social businessConnect2013 id506 hadr ideas for social business
Connect2013 id506 hadr ideas for social business
 
Lotusphere 2012: BP117 Server Colsolidations Done Right
Lotusphere 2012: BP117 Server Colsolidations Done RightLotusphere 2012: BP117 Server Colsolidations Done Right
Lotusphere 2012: BP117 Server Colsolidations Done Right
 
Bp117 server consolidations
Bp117 server consolidationsBp117 server consolidations
Bp117 server consolidations
 
PPCD_And_AmazonRDS
PPCD_And_AmazonRDSPPCD_And_AmazonRDS
PPCD_And_AmazonRDS
 
Coupling Facility CPU
Coupling Facility CPUCoupling Facility CPU
Coupling Facility CPU
 
Row #9: An architecture overview of APNIC's RDAP deployment to the cloud
Row #9: An architecture overview of APNIC's RDAP deployment to the cloudRow #9: An architecture overview of APNIC's RDAP deployment to the cloud
Row #9: An architecture overview of APNIC's RDAP deployment to the cloud
 
HDT for Mainframe Considerations: Simplified Tiered Storage
HDT for Mainframe Considerations: Simplified Tiered StorageHDT for Mainframe Considerations: Simplified Tiered Storage
HDT for Mainframe Considerations: Simplified Tiered Storage
 
System z Technology Summit Streamlining Utilities
System z Technology Summit Streamlining UtilitiesSystem z Technology Summit Streamlining Utilities
System z Technology Summit Streamlining Utilities
 
DB2 Through My Eyes
DB2 Through My EyesDB2 Through My Eyes
DB2 Through My Eyes
 
nZDM.ppt
nZDM.pptnZDM.ppt
nZDM.ppt
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015
 
Serverless Apps on Google Cloud: more dev, less ops
Serverless Apps on Google Cloud: more dev, less opsServerless Apps on Google Cloud: more dev, less ops
Serverless Apps on Google Cloud: more dev, less ops
 

Mehr von Martin Packer

Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance Specialist
Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance SpecialistMunich 2016 - Z011597 Martin Packer - How To Be A Better Performance Specialist
Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance SpecialistMartin Packer
 
I Know What You Did Last Summer
I Know What You Did Last SummerI Know What You Did Last Summer
I Know What You Did Last SummerMartin Packer
 
Optimizing z/OS Batch
Optimizing z/OS BatchOptimizing z/OS Batch
Optimizing z/OS BatchMartin Packer
 
DB2 Data Sharing Performance for Beginners
DB2 Data Sharing Performance for BeginnersDB2 Data Sharing Performance for Beginners
DB2 Data Sharing Performance for BeginnersMartin Packer
 
Curt Cotner DDF Inactive Threads Support DB2 Version 3
Curt Cotner DDF Inactive Threads Support DB2 Version 3Curt Cotner DDF Inactive Threads Support DB2 Version 3
Curt Cotner DDF Inactive Threads Support DB2 Version 3Martin Packer
 

Mehr von Martin Packer (7)

Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance Specialist
Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance SpecialistMunich 2016 - Z011597 Martin Packer - How To Be A Better Performance Specialist
Munich 2016 - Z011597 Martin Packer - How To Be A Better Performance Specialist
 
Time For DIME
Time For DIMETime For DIME
Time For DIME
 
I Know What You Did Last Summer
I Know What You Did Last SummerI Know What You Did Last Summer
I Know What You Did Last Summer
 
Optimizing z/OS Batch
Optimizing z/OS BatchOptimizing z/OS Batch
Optimizing z/OS Batch
 
Much Ado About CPU
Much Ado About CPUMuch Ado About CPU
Much Ado About CPU
 
DB2 Data Sharing Performance for Beginners
DB2 Data Sharing Performance for BeginnersDB2 Data Sharing Performance for Beginners
DB2 Data Sharing Performance for Beginners
 
Curt Cotner DDF Inactive Threads Support DB2 Version 3
Curt Cotner DDF Inactive Threads Support DB2 Version 3Curt Cotner DDF Inactive Threads Support DB2 Version 3
Curt Cotner DDF Inactive Threads Support DB2 Version 3
 

Kürzlich hochgeladen

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
20200723_insight_release_plan
20200723_insight_release_plan20200723_insight_release_plan
20200723_insight_release_planJamie (Taka) Wang
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIUdaiappa Ramachandran
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.francesco barbera
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 

Kürzlich hochgeladen (20)

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
20200723_insight_release_plan
20200723_insight_release_plan20200723_insight_release_plan
20200723_insight_release_plan
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AI
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 

zIIP Capacity Planning

  • 1. © 2009 IBM Corporation zIIP Capacity Planning Martin Packer martin_packer@uk.ibm.com @martinpacker
  • 2. © 2014 IBM Corporation2 Abstract zIIP Capacity Planning tends to be neglected - in favour of General-Purpose Engines (GCPs). With recent enhancements to DB2 allowing you to offload critical CPU to zIIPs, and to get the most out of zAAP-on-zIIP, it's time to take zIIP Capacity Planning seriously. This presentation describes how to do zIIP Capacity Planning properly - with instrumentation and guidelines.
  • 3. © 2014 IBM Corporation3 If You Only Remember 3 4 Things Capacity Planning for zIIPs has become much more important Pay especial attention to what % Busy represents “full” Measure zIIP potential and usage down to the address space level Consider LPAR configuration carefully for zIIPs
  • 4. © 2014 IBM Corporation4 Why People Don't Do zIIP Capacity Planning zIIPs are much cheaper than general purpose processors (GCPs) – Maintenance cost lower also zIIPs don't attract a software bill zIIP Utilization hasn't historically been all that high zIIP-eligible work can spill to GCPs at a pinch zIIPs are sometimes not the most carefully considered part of a purchase Ignoring zIIPs, ICFs, IFLs, zAAPs simplifies things to a single processor pool
  • 5. © 2014 IBM Corporation5 But consider Spilling to a GCP costs money Not spilling to a GCP can cost performance & scalability zIIPs aren't free Shoving another processor book in can be difficult or impossible – And at end of processor life upgrades become impossible More software that exploits zIIP installed – Some more performance-critical than previous exploiters New and modernised applications increasingly use zIIP LPAR configuration for zIIPs affects their performance
  • 6. © 2014 IBM Corporation6 Recent News zAAP On zIIP – Even with zAAPs installed New 2 : 1 zIIP : GCP configuration rule with zEC12 and zBC12 processors DB2 Version 10 Deferred Write and Prefetch Engines DB2 Version 11 further exploiters
  • 7. © 2014 IBM Corporation7 DB2 Version 10 Deferred Write And Prefetch Engines Substantial portion of DBM1 address space CPU – Changed by APAR PM30468 from MSTR address space 100% eligible for zIIP Very stringent performance requirements – Must not be delayed – Latency to cross over to GCP generally too high Substantially changes zIIP Capacity Planning rules Treat DBM1 as a key address space and protect its access to CPU, including zIIP
  • 8. © 2014 IBM Corporation8 Why Protect DB2 System Address Spaces From Being Pre-empted? MSTR contains the DB2 system monitor task – Requires aggressive WLM goal to monitor CPU stalls & virtual storage constraints DBM1 manages DB2 threads & critical for local DB2 latch & cross-system locking negotiation – Any delay in negotiating a critical system or application resource (e.g. P-lock on a space map page) can lead to a slowdown of the whole DB2 data sharing group DIST & WLM-managed stored procedure AS only run the DB2 service tasks – i.e. work performed for DB2 not attributable to a single user – Classification of incoming workload, scheduling of external stored procedures, etc. – Typically means these address spaces place a minimal CPU load on the system • BUT… they do require minimal CPU delay to ensure good system wide performance – The higher CPU demands to run DDF and/or SP workloads are controlled by the WLM service class definitions for the DDF enclave workloads or the other workloads calling the SP • Clear separation between DB2 services which are long-running started tasks used to manage the environment and transaction workloads that run and use DB2 services
  • 9. © 2014 IBM Corporation9
  • 10. © 2014 IBM Corporation10 So Let's Take This Seriously...
  • 11. © 2014 IBM Corporation11 Many Sources Of Information From RMF: – SMF 70 – SMF 72-3 From z/OS: – SMF 30 From middleware: – SMF 101 DB2 Accounting Trace – SMF 110 CICS Statistics Trace
  • 12. © 2014 IBM Corporation12 With RMF data you can ... see zIIP Pool Busy
  • 13. © 2014 IBM Corporation13
  • 14. © 2014 IBM Corporation14 ...break down by LPAR
  • 15. © 2014 IBM Corporation15
  • 16. © 2014 IBM Corporation16 ...drive down to the Service Class level (Slide is for zIIP on GCP)
  • 17. © 2014 IBM Corporation17
  • 18. © 2014 IBM Corporation18 Service Class (Period) Information For Velocity Goal service class periods you get samples... For work that's not zIIP eligible you get e.g. Using and Delay samples for CPU and I/O – These are the sample counters that affect the velocity calculation: Velocity % = 100 x Using / (Using + Delay) With zIIP-eligible work you get better resolution – as you get Using and Delay samples specific to zIIP Useful to correlate Delay for zIIP with % zIIP on GCP – Can explain behaviour
  • 19. © 2014 IBM Corporation19
  • 20. © 2014 IBM Corporation20 Understanding Your Exploiters Exploiters come in different shapes and sizes – And leave “footprints” accordingly Dependent Enclave – e.g. DBM1 Prefetch / Deferred Write Independent Enclave – e.g. DDF zAAP-on-zIIP – Formerly zAAP-eligible e.g. Java e.g. Dependent Enclave for DBM1 Address Space is Performance Critical from DB2 Version 10
  • 21. © 2014 IBM Corporation21 Understanding Your Exploiters ... Table summarised over several hours. You probably need peak 15 – 30 mins
  • 22. © 2014 IBM Corporation22 A DB2 Version DBM1 Address Space's zIIP and CPU Usage Over 24 Hours
  • 23. © 2014 IBM Corporation23 Projections Projecting Near-Term zIIP CPU Requirements: – For existing workloads that don't run on a zIIP: • “Project CPU” reports how much CPU is zIIP-eligible via RMF • DB2 V9 Specific: Coarse Upper Bound on V10 zIIP-eligible is all DBM1 CPU – For workloads that don't exist yet use any sizing guidelines you can get – Some “adaptive exploiters” exist: • These only try to use zIIP if one configured • “Project CPU” will show zero Projecting Into The Future – The same as standard CPU Capacity Planning
  • 24. © 2014 IBM Corporation24 zIIP “Short Engine” Effect LPAR Configuration is important LPARs with low zIIP usage sharing a zIIP – Especially with a low weight Potential high latency in logical zIIP being dispatched – If other LPARs have the zIIP In multiple zIIP case Hiperdispatch can help – “Corrals” work into fewer logical ( & physical) zIIPs – But e.g. 1-Way Queuing regime has unhelpful characteristics Of especial concern: – Single zIIP LPAR with low weight and only “DBM1 Engines” exploiter – Consider not configuring the zIIP to the LPAR
  • 25. © 2014 IBM Corporation25 zIIP To GCP Ratios What's most important is how the zIIP performs Extreme case 12 : 1 GCP : zIIP ratio especially unhelpful because of the “1” An unscientific view is that somewhere in the region of 2 : 1 to 4 : 1 is rarely harmful Consider both “in LPAR” and “across the machine” effects – Sometimes the answer will be “no zIIPs for this LPAR”
  • 26. © 2014 IBM Corporation26 Subcapacity General Purpose Processors zIIP runs at full speed – e.g. about twice as fast as a 6xx General Purpose Processor (GCP) Good news: – zIIP higher capacity and faster than GCP Not so good news: – zIIP-eligible work running on a GCP is worse – Variability in speed if some runs on zIIP and some not • Not terribly different to DDF situation since PM12256 How this plays depends on numbers of threads and CPU-intensiveness CPU Conversion Factor: – Use R723NFFS to convert zIIP CPU to GCP equivalent (and vice versa) Consider configuring more zIIPs than the raw capacity requirement would suggest
  • 27. © 2014 IBM Corporation27 Conclusions
  • 28. © 2014 IBM Corporation28 If You Only Remembered 3 4 Things I Hope They Were Capacity Planning for zIIPs has become much more important Pay especial attention to what % Busy represents “full” Measure zIIP potential and usage down to the address space level Consider LPAR configuration carefully for zIIPs
  • 29. © 2014 IBM Corporation29 Burn Before Reading :-) Date Version 13 Jan 2014 1 Original version 07 Feb 2014 2 Updated thanks to comments from Kathy Walsh and slide on DB2 address spaces from John Campbell. Also has abstract. 13 Apr 2014 3 Added slide on Subcapacity Models. Plus thoughts on V10 Estimation and on % of DBM1 work that is zIIP-eligible.