SlideShare ist ein Scribd-Unternehmen logo
1 von 40
Downloaden Sie, um offline zu lesen
#IDUG
DB2 for z/OS
Real Storage Monitoring, Control and Planning
John Campbell
DB2 for z/OS Development
Session Code: 6006
#IDUG
© Copyright IBM Corporation 2014. All rights reserved.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM
Corp.
The information contained in this presentation is provided for informational purposes only. While efforts were made to verify
the completeness and accuracy of the information contained in this presentation, it is provided “as is” without warranty of
any kind, express or implied. In addition, this information is based on IBM’s current product plans strategy, which are subject
to change by IBM without notice. IBM shall not be responsible for damages arising out of the use of, or otherwise related to,
this presentation or any other documentation. Nothing contain in this presentation is intended to, nor shall have the effect of,
creating any warranties or representations from IBM (or its suppliers or licensors), or altering the terms and conditions of any
agreement or license governing the use of IBM products and/or software.
Information regarding potential future products is intended to outline our general product direction and it should not be relied
on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment,
promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not
be incorporated into any contract. The development, release, and timing of any future features or functionality described for
our products remains at our sole discretion.
This information may contain examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals,
companies, brands, and products. All of these names are fictitious, and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.
Trademarks The following terms are trademarks or registered trademarks of other companies and have been used in at least one of the pages of the presentation:
The following terms are trademarks of International Business Machines Corporation in the United States, other countries, or both: DB2, DB2 Connect, DB2 Extenders, Distributed
Relational Database Architecture, DRDA, eServer, IBM, IMS, iSeries, MVS, z/OS, zSeries
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel and Pentium are trademarks of Intel Corporation in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.
Disclaimer
2
#IDUG
3
Agenda
• 64-bit shared and 64-bit common
• Real storage controls prior to DB2 10
• Beginner’s guide to DISCARD
• Large frame area
• Real storage control in DB2 10 and later
• Performance enhancements and SPIN avoidance
• Futures
• Monitoring REAL/AUX usage
• Summary
#IDUG
64-Bit private storage
‘Below the line’
Nucleus, CSA, SQA, etc.
Nucleus, ECSA, ESQA, etc.
Extended Region
64-Bit private storage
‘Below the line’
Nucleus, CSA, SQA, etc.
Nucleus, ECSA, ESQA, etc.
Extended Region
◄ 64-bit End of Virtual “Above the Bar”
Storage Management – Terminology
•4
◄31-bit Bar “Below the Bar”
◄16 MB “Line”
#IDUG
5
Virtual Storage the big limiter
• Only 2G of 31-bit storage
• Common areas are taken away from this budget
• Effective area is about 800M to 1600M depending on the individual customer
layout
• Big IMS/TM users may have only as little as 800M region
• Answer is to scale horizontally not vertically
• Add more members to a data sharing group
• Add more stand-alone DB2 subsystems if data sharing not required
#IDUG
6
DB2 V8 the start of the 64-bit world
• Starting from Version 8, DB2 can allocate 64-bit memory objects
• Design of DB2 storage manager is the same as the Data Space manager
• Same types of DB2 storage as 31-bit allowed in 64-Bit (except stack)
• Fixed
• Variable
• Getmained
• Fixed and Variable are a subset of Getmained
#IDUG
7
Buffer pools and 64-bit private objects
• Objects are all 64 bit private
• No sharing across DB2 system address spaces
• Buffer pool objects have their own objects in the DBM1 system address space
• Buffer manager does not use Storage manager to obtain storage so tracking buffer
pools gets a little bit more difficult
• All objects that are tagged as DUMP YES will appear in a dump
• If the buffer pools are in total more than 800M at DB2 start-up then ALL buffer
pools will be tagged DUMP NO so no buffer pools will be dumped
#IDUG
8
DB2 9 for z/OS the start of 64-bit shared (private)
• New invention from z/OS
• 64-bit shared is available
• Different than CSA/ECSA
• Token required to connect to a memory object
• Not prone to the overlays of other users of CSA/ECSA
• DB2 gets a 128G object
• Used by DDF and some utilities
• No high usage
• Difficult to track as the HVSHARE area only has a number for the LPAR, not
the individual users e.g., DB2 subsystem
• Usage is small enough to not be much of an issue
#IDUG
9
DB2 10 for z/OS the start of 64-bit shared use for almost all
thread control blocks
• 64 bit shared is used in preference to private storage
• Stack (save areas, working storage)
• Allows one stack to be used by multiple system address spaces cutting down
REAL footprint and complexity
• Thread storage pools now shared, no need to use expensive cross memory moves if
they were required before
• Reduced complexity, addressable storage is always available
• Use of Shared storage now dominates DB2
• Downside
• z/OS treats 64 bit Shared like common storage
• Spin locks more often used for serialisation
• See later charts
#IDUG
10
DB2 10 for z/OS the start of 64-bit common
• New invention from z/OS
• Allows DB2 to move some of the common areas
• Blocks where it is awkward or impossible to know the connect token in advance
• Some usage in DB2 10 DB2 uses a 6G object for the common objects
• Difficulty in starting DB2 if the default HVCOMMON area for LPAR is not enlarged
to cope with multiple DB2 subsystems
#IDUG
11
Controlling REAL storage DB2 V8 and V9
• CONTSTOR
• Contract thread storage regularly based on the number of times the thread
commits
• Very cheap, cost is amortised over at least 5 commits
• MINSTOR
• Can be expensive
• Orders the free chain in size order
• A lot of CPU can be burned running through storage chains
• Heavy hitters for storage include Statement cache, EDM pool, Buffer pools
• Buffer pools are usually densely packed virtual storage
• Almost a V=R relationship
• Can dominate the REAL storage landscape
• Reducing buffer pool sizes can substantially reduce the REAL storage footprint
• Down side is performance loss as read hit ratio degrades and page residency
time decreases
#IDUG
12
REAL Storage control – DB2 10
• The frequency of contraction mode can also be controlled by system parameter
REALSTORAGE_MANAGEMENT
• REALSTORAGE_MANAGEMENT options include:
• OFF
• Do not enter ‘contraction mode’ unless the REALSTORAGE_MAX boundary is
approaching OR z/OS has notified DB2 that there is a critical aux shortage
• ON
• Always operate in ‘contraction’ mode
• This may be desirable for LPAR with many DB2 subsystems or development/test
systems
• AUTO (the default)
• When significant paging is detected, ‘contraction’ mode will be entered
• But also under normal operating conditions with no paging DB2 will still perform
DISCARD at thread Deallocation or after 120 commits
• Important note
• Contraction mode is not exited immediately upon relief to avoid constant toggling in and
out of this mode
• New messages (DSNV516I, DSNV517I)
#IDUG
13
Beginners guide to DISCARD
• To KEEP REAL or not to KEEP REAL that is the question
• 64-bit pages are DISCARDED not freed
• First steps in DB2 V8 to control REAL storage
• Add DISCARDDATA to RESET to tell z/OS to un-back the frames that are no longer
needed
• Did it work?
• z/OS will not release frames until AVQLOW condition
• DB2 is still charged for the storage unless the system begins to page
• When I say discard, I mean it …
• New option in z/OS APAR OA15666
• REQUEST=DISCARDDATA, KEEPREAL=NO (“Hard Discard”)
• Allows DB2 to discard real frames without hitting AVQLOW condition
• DB2 support in PK25427, DB2 uses KEEPREAL=NO and the statistics are now
accurate
#IDUG
14
Large frame area
• Good for DB2 performance
• 1M size page large frames arrived in DB2 10
• Not good to use if the system is paging
• z/OS converts unused 1M size large frames into 256 x 4K size small frames
• DB2 is not allowed to use these frames since DB2 is non swappable and uses
preferred storage
• z/OS expects to recombine the small frames back into large frames later
• Cannot be used for long term page fix
• Could be that CICS ends up using the Large Frame Area
#IDUG
How to make large frames into small frames
0
2000
4000
6000
8000
10000
12000
MB
DSN Shared (Private) Storage
A2GB_SHR_REALF_TS A2GB_SHR_AUXS_TS A2GB_SHR_REALF_STK A2GB_SHR_AUXS_STK A2GB_COMMON_AUXS
Shared Thread storage
is being paged out
#IDUG
16
One Flash Express Card
CPU
nanos
Flash -
microseconds
Disk -milleseconds
Access
Time
If you have no choice but to page – use Flash Express
• Flash Express is a PCIe IO adapter with NAND Flash SSDs
• Physically comprised of internal storage on Flash SSDs
• Used to deliver a new tier of memory- storage class memory
• Uses PCIe I/O drawer
• Sized to accommodate all LPAR paging
• Each card pair provides 1.4 TB usable storage
• Maximum 4 card pairs (4 x 1.4=5.6 TB)
• Immediately usable
• Simplifies capacity planning
• No intelligent data placement needed
• Full virtualization across partitions
• Robust design
• Delivered as a RAID10 mirrored pair
• Designed for long life
• Designed for concurrent firmware upgrade
• Secured
• Flash Express adapter is protected with 128-bit AES encryption
• Key Management provided based on a Smart Card
#IDUG
17
Real storage control
• Paging rate is a critical performance measure for any z/OS system
• When shortage of REAL frames occurs, frames are moved to AUX (DASD)
• Having DB2 paged out is a not good thing for performance
• Paging should be minimised
• Page fixing buffer pools is a good idea for performance
• It avoids page fix and page free for high activity buffer pools (heavy I/O)
• Page fixing 1M size real storage page frames reduces TLB misses (saves CPU)
• But if insufficient REAL storage provisioned for the LPAR
• LPAR begins to page and DB2 is a candidate for page stealing
• Thread and EDM Pool storage is paged out
• Performance problems as data is rapidly paged back in
#IDUG
18
Real storage control …
• “I have a large LPAR (128G) and my DB2 (6G) got paged out …”
• Why is that?
• Shift in workload with REAL frames stolen by overnight batch processing
• Poor response times in the first few minutes of the online day
• A lot of rapid paging going on
• Huge increase in number of threads causing application scaling issues (lock
contention, global contention)
• REAL frames stolen by DB2 utilities
• REORG uses REAL storage for in memory sort e.g., 64G
• DFSORT defaults
• EXPMAX=MAX <<<<<< Make maximum use of storage
• EXPOLD=MAX <<<<<< Allow paging of old frames
• EXPRES=0 <<<<<< Reserved for new work
• Dump capture
• Excessive dump time caused by paging on the LPAR may cause sysplex-wide
sympathy sickness slowdowns
#IDUG
Real storage usage and DFSORT settings …
0
5000
10000
15000
20000
25000
30000
2013-07-29-00.02.00.000161
2013-07-29-04.08.00.000157
2013-07-29-08.14.00.000209
2013-07-29-12.20.00.018877
2013-07-29-16.26.00.000163
2013-07-29-20.32.00.000178
2013-07-30-00.38.00.000166
2013-07-30-04.44.00.000904
2013-07-30-08.50.00.016955
2013-07-30-12.56.00.000175
2013-07-30-17.02.00.000175
2013-07-30-21.08.00.000310
2013-07-31-01.14.00.059911
2013-07-31-05.20.00.019601
2013-07-31-09.26.00.000123
2013-07-31-13.32.00.000499
2013-07-31-17.38.00.000158
2013-07-31-21.44.00.000342
2013-08-01-01.50.00.370531
2013-08-01-05.56.00.093954
2013-08-01-10.02.00.130884
2013-08-01-14.08.00.000155
2013-08-01-18.14.00.000274
2013-08-01-22.20.00.015079
2013-08-02-02.26.00.000102
2013-08-02-06.32.00.000152
2013-08-02-10.38.00.004328
2013-08-02-14.44.00.003906
2013-08-02-18.50.00.036134
2013-08-02-22.56.00.000143
2013-08-03-03.02.00.000214
2013-08-03-07.08.00.000181
2013-08-03-11.14.00.000159
2013-08-03-15.20.00.014000
2013-08-03-19.26.00.000364
2013-08-03-23.32.00.000201
2013-08-04-03.38.00.000168
2013-08-04-07.44.00.000197
2013-08-04-11.50.00.033578
2013-08-04-15.56.00.000174
2013-08-04-20.02.00.000151
(MB)
CBP4 - REAL storage available
#IDUG
20
DB2 pages paged out and a dump happens?
• What is my exposure?
• Increased MASTER CPU time, z/OS tries to steal frames to meet the excessive
demand caused by the dump
• Elongated dump times
• Auxiliary storage number > 0
• In theory each page could have to be paged in
• z/OS can have the page in both places, REAL and AUX
• If total size across all bufferpools is more than 800MB then the bufferpools are
not dumped
• No prefetch on AUX storage, so all synchronous I/O
• Worst case is the number of pages * page-in I/O time
• For example 2GB of 4K pages * 3ms = 524288 * 0.003 = 26 mins)
• Guinness world record for a dump 37 mins
• Full Sysplex hang resulted
#IDUG
21
SYSPLEX sympathy sickness
• Slowdown and no apparent reason why?
• DB2 taking the dump may have TCBs non-dispatchable
• P-Lock negotiation affected
• Locks not released in a timely manner
• Excessive dump time caused by paging on the LPAR may cause massive
sympathy sickness slowdowns
• How can a member slow down when there is plenty of CPU/Storage on the
LPAR
• May be the owner of a P-lock is being dumped or is paging a lot
#IDUG
The DUMP effect – no transactions being processed
0
1000
2000
3000
4000
5000
6000
7000
NUM_ENDED
#IDUG
23
Real storage control …
• Make sure LPAR has enough REAL storage
• REAL storage upgrade is the cheapest and easiest performance upgrade
• REAL storage shortage not only can cause performance issues but if DUMPs are
needed then it can cause a small issue to become a massive SYSPLEX failure
• Cheapest because MLC and other charges do not factor in the amount of REAL
storage
• Vendors do not charge by the amount of REAL on the CEC/CPC processor
• Specify z/OS WLM STORAGE CRITICAL for DB2 system address spaces
• To safeguard the rest of DB2
• Tells WLM to not page these address spaces
• Keeps the thread control blocks, EDM and other needed parts of DB2 in REAL
• Prevents the performance problem as the Online day starts and DB2 has to be
rapidly paged back in
#IDUG
24
Real storage control …
• Make sure MAXSPACE is set properly and defensively
• Represents the total amount of storage for captured dumps for the entire LPAR
• MAXSPACE value should not be set so high that paging can occur causing massive
issues to the LPAR
• If multiple DB2s on same LPAR can wildcard to the same dump, then MAXSPACE
needs to be set appropriately
• MAXSPACE=16G is a good start to cope with more than 90% of all cases
• But there are MVS defects around which are inflating DUMP size
• Fixing z/OS APARs available to handle and minimise DUMP size: OA39596,
OA40856 and OA40015
• MAXSPACE requirement should be
• (DBM1 – Buffer pools) + Shared memory + DIST + MSTR + IRLM + COMMON +
ECSA
• Work is underway to get the exact formula based on all the new IFCID 225 fields
• Once the formula is properly tested, will be posted on the various websites and
Info APARs
#IDUG
25
Real storage control …
• Make sure REALSTORAGE_MANAGEMENT=AUTO (default)
• Particularly when significant paging is detected, “contraction mode” will be entered
to help protect the system
• “Unbacks” virtual pages so that a REAL frame or AUX slot is not consumed for
this page
• Use automation to trap the DSNV516I (start) and DSNV517I (end) messages
• As DB2 approaches the REALSTORAGE_MAX threshold
• “Contraction mode” is also entered to help protect the system
• Control use of storage by DFSORT
• Set EXPMAX down to limit maximum DFSORT usage
• Set EXPOLD=0 to prevent DFSORT from taking "old" frames from other workloads
• Set EXPRES=% or n {reserve enough for MAXSPACE}
• z/OS parameter AUXMGMT=ON
• No new dumps are allowed when AUX storage utilization reaches 50%
• Current dump data capture stops when AUX storage utilization reaches 68%
• Once the limit is exceeded, new dumps will not be processed until the AUX storage
utilization drops below 35%
#IDUG
26
Performance enhancements / SPIN avoidance
• SPIN locks used by z/OS RSM can cause performance issues when DISCARD
processing is running on many CPUs at the same time
• Possible LPAR outage in severe cases
• DB2 APAR PM88804 fixes this outage issue
• Reduce uncaptured time by freeing the virtual but not DISCARDing the REAL when
DISCARD mode is off
• REALSTORAGE_MANAGEMENT=OFF
• No DISCARD processing when REALSTORAGE_MANGEMENT=AUTO and no paging
• Immediate CPU performance reduction when transactions achieve poor thread
reuse and there is a high rate of thread deallocation
• Reduced CPU resource consumption, reduced exposure to SPIN locks
• Customers using REALSTORAGE_MANAGEMENT=AUTO are essentially running OFF
unless paging is occurring
#IDUG
After PM88804 Possible side effect of no DISCARD
Virtual flat, Increasing REAL
0
50
100
150
200
250
300
350
400
0
2000
4000
6000
8000
10000
12000
14000
16000
MB
DSN Total Storage ATB
REAL_STORAGE_FRAME AUX_STORAGE_SLOT A2GB_SHR_REALF_TS A2GB_SHR_AUXS_TS
A2GB_SHR_REALF_STK A2GB_SHR_AUXS_STK A2GB_COMMON_AUXS
A2GB_SHR_AG_LOCAL Total threads
REAL
stays up
Virtual
comes
down
#IDUG
28
Virtual Contraction – DB2 APAR PM86952
• After APAR PM88804 some extreme customer cases saw some big REAL
storage growth
• Very workload dependent
• New APAR PM86952 provides VIRTUAL contraction (NOT REAL)
• Contraction of Virtual has an implicit effect on REAL storage
• Virtual Storage decreases
• REAL Storage decreases
#IDUG
29
DB2 APAR PM99575
• Time to put back the DISCARD in normal processing to prevent runaway
storage growth
• Keep the performance advantage when REALSTORAGE_MANAGEMENT=OFF
• Protect the system as much as DB2 can from SPIN lock contention and spin
out
• REQUEST=DISCARDDATA, KEEPREAL=YES (“Soft Discard”)
• Trade off accurate Statistics for system availability and reduced REAL storage
use
• Statistics are not accurate after PM99575 because frames will not be stolen back to
reduce the count until paging occurs
• Statistics will be a high water mark on most systems
• Statistics will be fairly accurate on systems with small amounts of paging
#IDUG
Storage manager changes: ZPARM RSM
REALSTORAGE_MANAGEMENT=xxx
After PM88804
• ENF 55 signal means DISCARD
KEEPREAL=NO
• RSM=OFF means No DISCARD
• RSM=AUTO with no paging means no
DISCARD at Thread Deallocation or 120
commits
• RSM=AUTO with paging or RSM=ON
means DISCARD with KEEPREAL=NO at
Deallocation or 30 commits. STACK
also DISCARDED
• REALSTORAGE_MAX means DISCARD
KEEPREAL=NO at 80%
After PM99575
• ENF 55 signal means DISCARD
KEEPREAL=NO
• RSM=OFF means No DISCARD
• RSM=AUTO with no paging means
DISCARD with KEEPREAL=YES at Thread
Deallocation or 120 commits
• RSM=AUTO with paging or RSM=ON
means DISCARD with KEEPREAL=YES at
Deallocation or 30 commits. STACK
also DISCARDED
• REALSTORAGE_MAX means DISCARD
KEEPREAL=NO at 100%
#IDUG
31
Just when we thought we were out of the woods -
CRITICALPAGING
• If you have XCF CRITICALPAGING ENABLED, you also need to apply z/OS RSM
APAR OA44913 or provision Flash Express on the LPAR
• Without this APAR, the discarded shared frames with KEEPREAL(YES) are not stolen
to replenish frame queues when paging occurs
• Either APAR may be applied independently without the other
• If z/OS APAR OA44913 is not applied and Flash Express is also not provisioned
then
• No benefit from DB2 APAR PM99575 especially if running with RSM=AUTO, XCF
CRITICALPAGING is enabled, and the system starts to page …
• Do I have it?
• D XCF,COUPLE
• To Activate
• Update COUPLExx with: FUNCTIONS ENABLE(CRITICALPAGING)
#IDUG
32
Futures
• Nothing more in plan for DB2
• Storage manager now DISCARDING frames
• DUMP size
• Inflated dump size and MAXSPACE requirement for full dump
• DB2 and z/OS Development investigating – WATCH THIS SPACE
• REAL storage statistics
• Since DISCARDED frames are not removed from the total, then the statistics are not
as accurate as they could be
• z/OS to look for a solution for this – WATCH THIS SPACE
#IDUG
Monitoring REAL/AUX storage usage – Sample graph #1
0
1000
2000
3000
4000
5000
6000
7000
(MB) D0E1 - Total REAL storage in use
REAL in use for 64-bit common (MB) REAL in use for 64-bit shared stack (MB)
REAL in use for 64-bit shared (MB) ASID DIST REAL in use for 64-bit priv (MB)
ASID DIST REAL in use for 31-bit priv (MB) ASID DBM1 REAL in use for BP (MB)
ASID DBM1 REAL in use for 64-bit priv w/o BP (MB) ASID DBM1 REAL in use for 31-bit priv (MB)
#IDUG
Monitoring REAL/AUX storage usage – Sample graph #2
0
0
0
1
1
1
(MB) D0E1 - Total AUX storage in use
AUX in use for 64-bit common (MB) AUX in use for 64-bit shared stack (MB)
AUX in use for 64-bit shared (MB) ASID DIST AUX in use for 64-bit priv (MB)
ASID DIST AUX in use for 31-bit priv (MB) ASID DBM1 AUX in use for BP (MB)
ASID DBM1 AUX in use for 64-bit priv w/o BP (MB) ASID DBM1 AUX in use for 31-bit priv (MB)
#IDUG
Monitoring REAL/AUX storage usage – Sample graph #3
0
5000
10000
15000
20000
25000
30000
35000
2014-05-28-…
2014-05-29-…
2014-05-29-…
2014-05-29-…
2014-05-29-…
2014-05-29-…
2014-05-29-…
2014-05-30-…
2014-05-30-…
2014-05-30-…
2014-05-30-…
2014-05-30-…
2014-05-30-…
2014-05-31-…
2014-05-31-…
2014-05-31-…
2014-05-31-…
2014-05-31-…
2014-05-31-…
2014-05-31-…
2014-06-01-…
2014-06-01-…
2014-06-01-…
2014-06-01-…
2014-06-01-…
2014-06-01-…
2014-06-02-…
2014-06-02-…
2014-06-02-…
2014-06-02-…
2014-06-02-…
2014-06-02-…
2014-06-02-…
2014-06-03-…
2014-06-03-…
2014-06-03-…
2014-06-03-…
2014-06-03-…
2014-06-03-…
2014-06-04-…
2014-06-04-…
2014-06-04-…
2014-06-04-…
2014-06-04-…
2014-06-04-…
(MB) SYS1 - REAL storage available
#IDUG
Monitoring REAL/AUX storage usage – Based on OMPE PDB
• #1 - Stacked AREA graph - one for each DB2 member (one sheet per member)
• #2 - Stacked AREA graph - one for each DB2 member (one sheet per member)
• #3 - Line graph - one for each LPAR
(REAL_STORAGE_FRAME - A2GB_REAL_FRAME)*4/1024 AS DBM1_REAL_PRIV_31BIT_MB
(A2GB_REAL_FRAME - A2GB_REAL_FRAME_TS)*4/1024 AS DBM1_REAL_PRIV_64BIT_BP_MB
A2GB_REAL_FRAME_TS*4/1024 AS DBM1_REAL_PRIV_64BIT_XBP_MB
(DIST_REAL_FRAME - A2GB_DIST_REAL_FRM)*4/1024 AS DIST_REAL_PRIV_31BIT_MB
A2GB_DIST_REAL_FRM*4/1024 AS DIST_REAL_PRIV_64BIT_MB
A2GB_COMMON_REALF*4/1024 AS REAL_COM_64BIT_MB
A2GB_SHR_REALF_TS*4/1024 AS REAL_SHR_64BIT_MB
A2GB_SHR_REALF_STK*4/1024 AS REAL_SHR_STK_64BIT_MB
(AUX_STORAGE_SLOT - A2GB_AUX_SLOT)*4/1024 AS DBM1_AUX_PRIV_31BIT_MB
(A2GB_AUX_SLOT - A2GB_AUX_SLOT_TS)*4/1024 AS DBM1_AUX_PRIV_64BIT_BP_MB
A2GB_AUX_SLOT_TS*4/1024 AS DBM1_AUX_PRIV_64BIT_XBP_MB
(DIST_AUX_SLOT - A2GB_DIST_AUX_SLOT)*4/1024 AS DIST_AUX_PRIV_31BIT_MB
A2GB_DIST_AUX_SLOT*4/1024 AS DIST_AUX_PRIV_64BIT_MB
A2GB_COMMON_AUXS*4/1024 AS AUX_COM_64BIT_MB
A2GB_SHR_AUXS_TS*4/1024 AS AUX_SHR_64BIT_MB
A2GB_SHR_AUXS_STK*4/1024 AS AUX_SHR_STK_64BIT_MB
QW0225_REALAVAIL*4/1024 AS REAL_AVAIL_LPAR_MB
#IDUG
Monitoring REAL/AUX storage usage – Mapping for reference
IFCID FIELD OMPE FIELD OMPE PDB COLUMN NAME MEMU2 Description
QW0225RL QW0225RL REAL_STORAGE_FRAME DBM1 REAL in use for 31 and 64-bit priv (MB)
QW0225AX QW0225AX AUX_STORAGE_SLOT DBM1 AUX in use for 31 and 64-bit priv (MB)
QW0225HVPagesInReal SW225VPR A2GB_REAL_FRAME DBM1 REAL in use for 64-bit priv (MB)
QW0225HVAuxSlots SW225VAS A2GB_AUX_SLOT DBM1 AUX in use for 64-bit priv (MB)
QW0225PriStg_Real SW225PSR A2GB_REAL_FRAME_TS DBM1 REAL in use for 64-bit priv w/o BP (MB)
QW0225PriStg_Aux SW225PSA A2GB_AUX_SLOT_TS DBM1 AUX in use for 64-bit priv w/o BP (MB)
QW0225RL QW0225RL DIST_REAL_FRAME DIST REAL in use for 31 and 64-bit priv (MB)
QW0225AX QW0225AX DIST_AUX_SLOT DIST AUX in use for 31 and 64-bit priv (MB)
QW0225HVPagesInReal SW225VPR A2GB_DIST_REAL_FRM DIST REAL in use for 64-bit priv (MB)
QW0225HVAuxSlots SW225VAS A2GB_DIST_AUX_SLOT DIST AUX in use for 64-bit priv (MB)
QW0225ShrStg_Real SW225SSR A2GB_SHR_REALF_TS REAL in use for 64-bit shared (MB)
QW0225ShrStg_Aux SW225SSA A2GB_SHR_AUXS_TS AUX in use for 64-bit shared (MB)
QW0225ShrStkStg_Real SW225KSR A2GB_SHR_REALF_STK REAL in use for 64-bit shared stack (MB)
QW0225ShrStkStg_Aux SW225KSA A2GB_SHR_AUXS_STK AUX in use for 64-bit shared stack (MB)
QW0225ComStg_Real SW225CSR A2GB_COMMON_REALF REAL in use for 64-bit common (MB)
QW0225ComStg_Aux SW225CSA A2GB_COMMON_AUXS AUX in use for 64-bit common (MB)
QW0225_REALAVAIL S225RLAV QW0225_REALAVAIL REALAVAIL (MB) (S)
Note: All REAL/AUX storage fields in IFCID 225 and OMPE performance database are expressed in
4KB frames or slots – they should be converted to MB (conversion is already done in MEMU2)
#IDUG
38
Summary
• Apply the DB2 APARs
• Apply the z/OS APAR if XCF CRITICALPAGING is enabled
• Keep the LPAR well provisioned with REAL storage
• For optimal performance avoid paging to AUX or Flash Express
• For most customers set REALSTORAGE_MANAGEMENT=AUTO
• Only use REALSTORAGE_MANAGEMENT=OFF when
• LPAR is generously over provisioned with REAL storage
• Proactive monitoring is in place with alerting if the available REAL storage drops
down encroaching on free cushion
• Do not over commit the LFAREA if the system may page and the large frames
may be broken down and put back together again
• Watch out for MAXSPACE and large dump sizes that may cause the system to
page
• Use ‘common currency’ for monitoring REAL and AUX usage, to determine
what is the normal vs. abnormal system profile
#IDUG
89
#IDUG
John Campbell
DB2 for z/OS Development
campbelj@uk.ibm.com
Session 6006
DB2 for z/OS Real Storage Monitoring, Control and Planning

Weitere ähnliche Inhalte

Was ist angesagt?

Database Consolidation using the Oracle Multitenant Architecture
Database Consolidation using the Oracle Multitenant ArchitectureDatabase Consolidation using the Oracle Multitenant Architecture
Database Consolidation using the Oracle Multitenant Architecture
Pini Dibask
 
A First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM ChangesA First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM Changes
Willie Favero
 

Was ist angesagt? (20)

Presentation db2 connections to db2 for z os
Presentation   db2 connections to db2 for z osPresentation   db2 connections to db2 for z os
Presentation db2 connections to db2 for z os
 
MAINVIEW for DB2.ppt
MAINVIEW for DB2.pptMAINVIEW for DB2.ppt
MAINVIEW for DB2.ppt
 
DB2 on Mainframe
DB2 on MainframeDB2 on Mainframe
DB2 on Mainframe
 
FlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OSFlashCopy and DB2 for z/OS
FlashCopy and DB2 for z/OS
 
Solving the DB2 LUW Administration Dilemma
Solving the DB2 LUW Administration DilemmaSolving the DB2 LUW Administration Dilemma
Solving the DB2 LUW Administration Dilemma
 
DB2 for z/OS Architecture in Nutshell
DB2 for z/OS Architecture in NutshellDB2 for z/OS Architecture in Nutshell
DB2 for z/OS Architecture in Nutshell
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data Sharing
 
Presentation db2 best practices for optimal performance
Presentation   db2 best practices for optimal performancePresentation   db2 best practices for optimal performance
Presentation db2 best practices for optimal performance
 
DB2 DOCUMENT
DB2 DOCUMENTDB2 DOCUMENT
DB2 DOCUMENT
 
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the mythsDB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
DB2 for z/OS and DASD-based Disaster Recovery - Blowing away the myths
 
IBM DB2 for z/OS Administration Basics
IBM DB2 for z/OS Administration BasicsIBM DB2 for z/OS Administration Basics
IBM DB2 for z/OS Administration Basics
 
DB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and OptimisationDB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
DB2 10 & 11 for z/OS System Performance Monitoring and Optimisation
 
DB2 and storage management
DB2 and storage managementDB2 and storage management
DB2 and storage management
 
Database Consolidation using the Oracle Multitenant Architecture
Database Consolidation using the Oracle Multitenant ArchitectureDatabase Consolidation using the Oracle Multitenant Architecture
Database Consolidation using the Oracle Multitenant Architecture
 
Integrated Intrusion Detection Services for z/OS Communications Server
Integrated Intrusion Detection Services for z/OS Communications Server Integrated Intrusion Detection Services for z/OS Communications Server
Integrated Intrusion Detection Services for z/OS Communications Server
 
Z OS IBM Utilities
Z OS IBM UtilitiesZ OS IBM Utilities
Z OS IBM Utilities
 
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
Db2 for z/OS and FlashCopy - Practical use cases (June 2019 Edition)
 
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdfOracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
 
DOAG Oracle Unified Audit in Multitenant Environments
DOAG Oracle Unified Audit in Multitenant EnvironmentsDOAG Oracle Unified Audit in Multitenant Environments
DOAG Oracle Unified Audit in Multitenant Environments
 
A First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM ChangesA First Look at the DB2 10 DSNZPARM Changes
A First Look at the DB2 10 DSNZPARM Changes
 

Andere mochten auch

Final project report on max life insurance 2
Final  project report on max life insurance 2Final  project report on max life insurance 2
Final project report on max life insurance 2
Student
 

Andere mochten auch (13)

DB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesDB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer Experiences
 
ALL ABOUT DB2 DSNZPARM
ALL ABOUT DB2 DSNZPARMALL ABOUT DB2 DSNZPARM
ALL ABOUT DB2 DSNZPARM
 
Db2 and storage management (mullins)
Db2 and storage management (mullins)Db2 and storage management (mullins)
Db2 and storage management (mullins)
 
Planning and executing a DB2 11 for z/OS Migration by Ian Cook
Planning and executing a DB2 11 for z/OS  Migration  by Ian Cook Planning and executing a DB2 11 for z/OS  Migration  by Ian Cook
Planning and executing a DB2 11 for z/OS Migration by Ian Cook
 
Libro blanco espesantes essd
Libro blanco espesantes essdLibro blanco espesantes essd
Libro blanco espesantes essd
 
Best Practices For Optimizing DB2 Performance Final
Best Practices For Optimizing DB2 Performance FinalBest Practices For Optimizing DB2 Performance Final
Best Practices For Optimizing DB2 Performance Final
 
The Five R's: There Can be no DB2 Performance Improvement Without Them!
The Five R's: There Can be no DB2 Performance Improvement Without Them!The Five R's: There Can be no DB2 Performance Improvement Without Them!
The Five R's: There Can be no DB2 Performance Improvement Without Them!
 
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle IBM DB2 Analytics Accelerator  Trends & Directions by Namik Hrle
IBM DB2 Analytics Accelerator Trends & Directions by Namik Hrle
 
Understanding and controlling transaction logs
Understanding and controlling transaction logsUnderstanding and controlling transaction logs
Understanding and controlling transaction logs
 
Universal Table Spaces for DB2 10 for z/OS - IOD 2010 Seesion 1929 - favero
 Universal Table Spaces for DB2 10 for z/OS - IOD 2010 Seesion 1929 - favero Universal Table Spaces for DB2 10 for z/OS - IOD 2010 Seesion 1929 - favero
Universal Table Spaces for DB2 10 for z/OS - IOD 2010 Seesion 1929 - favero
 
The Tao of DB2
The Tao of DB2The Tao of DB2
The Tao of DB2
 
Key Note Session IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
Key Note Session  IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...Key Note Session  IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
Key Note Session IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
 
Final project report on max life insurance 2
Final  project report on max life insurance 2Final  project report on max life insurance 2
Final project report on max life insurance 2
 

Ähnlich wie DB2 for z/OS Real Storage Monitoring, Control and Planning

Db2 10 memory management uk db2 user group june 2013 [read-only]
Db2 10 memory management   uk db2 user group june 2013 [read-only]Db2 10 memory management   uk db2 user group june 2013 [read-only]
Db2 10 memory management uk db2 user group june 2013 [read-only]
Laura Hood
 
Db2 10 memory management uk db2 user group june 2013
Db2 10 memory management   uk db2 user group june 2013Db2 10 memory management   uk db2 user group june 2013
Db2 10 memory management uk db2 user group june 2013
Carol Davis-Mann
 
DB2 and Storage Management
DB2 and Storage ManagementDB2 and Storage Management
DB2 and Storage Management
Craig Mullins
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015
Daniela Zuppini
 
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
IBM India Smarter Computing
 

Ähnlich wie DB2 for z/OS Real Storage Monitoring, Control and Planning (20)

Db2 10 memory management uk db2 user group june 2013 [read-only]
Db2 10 memory management   uk db2 user group june 2013 [read-only]Db2 10 memory management   uk db2 user group june 2013 [read-only]
Db2 10 memory management uk db2 user group june 2013 [read-only]
 
Db2 10 memory management uk db2 user group june 2013
Db2 10 memory management   uk db2 user group june 2013Db2 10 memory management   uk db2 user group june 2013
Db2 10 memory management uk db2 user group june 2013
 
DB2 and Storage Management
DB2 and Storage ManagementDB2 and Storage Management
DB2 and Storage Management
 
DbB 10 Webcast #3 The Secrets Of Scalability
DbB 10 Webcast #3   The Secrets Of ScalabilityDbB 10 Webcast #3   The Secrets Of Scalability
DbB 10 Webcast #3 The Secrets Of Scalability
 
IaaS for DBAs in Azure
IaaS for DBAs in AzureIaaS for DBAs in Azure
IaaS for DBAs in Azure
 
Tuning DB2 in a Solaris Environment
Tuning DB2 in a Solaris EnvironmentTuning DB2 in a Solaris Environment
Tuning DB2 in a Solaris Environment
 
DB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilityDB2 Design for High Availability and Scalability
DB2 Design for High Availability and Scalability
 
IMS09 ims v14 higlights
IMS09   ims v14 higlightsIMS09   ims v14 higlights
IMS09 ims v14 higlights
 
Advantages of migrating to db2 v11.1
Advantages of migrating to db2 v11.1Advantages of migrating to db2 v11.1
Advantages of migrating to db2 v11.1
 
Controlling performance in the cloud: taking charge of your hosting environment
Controlling performance in the cloud: taking charge of your hosting environmentControlling performance in the cloud: taking charge of your hosting environment
Controlling performance in the cloud: taking charge of your hosting environment
 
IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015IBMHadoopofferingTechline-Systems2015
IBMHadoopofferingTechline-Systems2015
 
The Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux KernelThe Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux Kernel
 
Idera live 2021: Managing Databases in the Cloud - the First Step, a Succes...
Idera live 2021:   Managing Databases in the Cloud - the First Step, a Succes...Idera live 2021:   Managing Databases in the Cloud - the First Step, a Succes...
Idera live 2021: Managing Databases in the Cloud - the First Step, a Succes...
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
 
Auditing DB2 on z/OS with DBARS
Auditing DB2 on z/OS with DBARSAuditing DB2 on z/OS with DBARS
Auditing DB2 on z/OS with DBARS
 
DB2 10 Universal Table Space - 2012-03-18 - no template
DB2 10 Universal Table Space - 2012-03-18 - no templateDB2 10 Universal Table Space - 2012-03-18 - no template
DB2 10 Universal Table Space - 2012-03-18 - no template
 
G108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905cG108277 ds8000-resiliency-lagos-v1905c
G108277 ds8000-resiliency-lagos-v1905c
 
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
IBM System Storage DS8000 with SSDs An In-Depth Look at SSD Performance in th...
 
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
 
14 guendert pres
14 guendert pres14 guendert pres
14 guendert pres
 

Kürzlich hochgeladen

➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
amitlee9823
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
gajnagarg
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
amitlee9823
 
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
gajnagarg
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
gajnagarg
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
only4webmaster01
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
amitlee9823
 
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
amitlee9823
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night StandCall Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
amitlee9823
 

Kürzlich hochgeladen (20)

➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls Palakkad Escorts ☎️9352988975 Two shot with one girl...
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
Just Call Vip call girls kakinada Escorts ☎️9352988975 Two shot with one girl...
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
 
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
Just Call Vip call girls roorkee Escorts ☎️9352988975 Two shot with one girl ...
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
 
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men  🔝Ongole🔝   Escorts S...
➥🔝 7737669865 🔝▻ Ongole Call-girls in Women Seeking Men 🔝Ongole🔝 Escorts S...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Begur Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
Detecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning ApproachDetecting Credit Card Fraud: A Machine Learning Approach
Detecting Credit Card Fraud: A Machine Learning Approach
 
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night StandCall Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Shivaji Nagar ☎ 7737669865 🥵 Book Your One night Stand
 
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 

DB2 for z/OS Real Storage Monitoring, Control and Planning

  • 1. #IDUG DB2 for z/OS Real Storage Monitoring, Control and Planning John Campbell DB2 for z/OS Development Session Code: 6006
  • 2. #IDUG © Copyright IBM Corporation 2014. All rights reserved. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. The information contained in this presentation is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided “as is” without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans strategy, which are subject to change by IBM without notice. IBM shall not be responsible for damages arising out of the use of, or otherwise related to, this presentation or any other documentation. Nothing contain in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM (or its suppliers or licensors), or altering the terms and conditions of any agreement or license governing the use of IBM products and/or software. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. This information may contain examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious, and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. Trademarks The following terms are trademarks or registered trademarks of other companies and have been used in at least one of the pages of the presentation: The following terms are trademarks of International Business Machines Corporation in the United States, other countries, or both: DB2, DB2 Connect, DB2 Extenders, Distributed Relational Database Architecture, DRDA, eServer, IBM, IMS, iSeries, MVS, z/OS, zSeries Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel and Pentium are trademarks of Intel Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. Disclaimer 2
  • 3. #IDUG 3 Agenda • 64-bit shared and 64-bit common • Real storage controls prior to DB2 10 • Beginner’s guide to DISCARD • Large frame area • Real storage control in DB2 10 and later • Performance enhancements and SPIN avoidance • Futures • Monitoring REAL/AUX usage • Summary
  • 4. #IDUG 64-Bit private storage ‘Below the line’ Nucleus, CSA, SQA, etc. Nucleus, ECSA, ESQA, etc. Extended Region 64-Bit private storage ‘Below the line’ Nucleus, CSA, SQA, etc. Nucleus, ECSA, ESQA, etc. Extended Region ◄ 64-bit End of Virtual “Above the Bar” Storage Management – Terminology •4 ◄31-bit Bar “Below the Bar” ◄16 MB “Line”
  • 5. #IDUG 5 Virtual Storage the big limiter • Only 2G of 31-bit storage • Common areas are taken away from this budget • Effective area is about 800M to 1600M depending on the individual customer layout • Big IMS/TM users may have only as little as 800M region • Answer is to scale horizontally not vertically • Add more members to a data sharing group • Add more stand-alone DB2 subsystems if data sharing not required
  • 6. #IDUG 6 DB2 V8 the start of the 64-bit world • Starting from Version 8, DB2 can allocate 64-bit memory objects • Design of DB2 storage manager is the same as the Data Space manager • Same types of DB2 storage as 31-bit allowed in 64-Bit (except stack) • Fixed • Variable • Getmained • Fixed and Variable are a subset of Getmained
  • 7. #IDUG 7 Buffer pools and 64-bit private objects • Objects are all 64 bit private • No sharing across DB2 system address spaces • Buffer pool objects have their own objects in the DBM1 system address space • Buffer manager does not use Storage manager to obtain storage so tracking buffer pools gets a little bit more difficult • All objects that are tagged as DUMP YES will appear in a dump • If the buffer pools are in total more than 800M at DB2 start-up then ALL buffer pools will be tagged DUMP NO so no buffer pools will be dumped
  • 8. #IDUG 8 DB2 9 for z/OS the start of 64-bit shared (private) • New invention from z/OS • 64-bit shared is available • Different than CSA/ECSA • Token required to connect to a memory object • Not prone to the overlays of other users of CSA/ECSA • DB2 gets a 128G object • Used by DDF and some utilities • No high usage • Difficult to track as the HVSHARE area only has a number for the LPAR, not the individual users e.g., DB2 subsystem • Usage is small enough to not be much of an issue
  • 9. #IDUG 9 DB2 10 for z/OS the start of 64-bit shared use for almost all thread control blocks • 64 bit shared is used in preference to private storage • Stack (save areas, working storage) • Allows one stack to be used by multiple system address spaces cutting down REAL footprint and complexity • Thread storage pools now shared, no need to use expensive cross memory moves if they were required before • Reduced complexity, addressable storage is always available • Use of Shared storage now dominates DB2 • Downside • z/OS treats 64 bit Shared like common storage • Spin locks more often used for serialisation • See later charts
  • 10. #IDUG 10 DB2 10 for z/OS the start of 64-bit common • New invention from z/OS • Allows DB2 to move some of the common areas • Blocks where it is awkward or impossible to know the connect token in advance • Some usage in DB2 10 DB2 uses a 6G object for the common objects • Difficulty in starting DB2 if the default HVCOMMON area for LPAR is not enlarged to cope with multiple DB2 subsystems
  • 11. #IDUG 11 Controlling REAL storage DB2 V8 and V9 • CONTSTOR • Contract thread storage regularly based on the number of times the thread commits • Very cheap, cost is amortised over at least 5 commits • MINSTOR • Can be expensive • Orders the free chain in size order • A lot of CPU can be burned running through storage chains • Heavy hitters for storage include Statement cache, EDM pool, Buffer pools • Buffer pools are usually densely packed virtual storage • Almost a V=R relationship • Can dominate the REAL storage landscape • Reducing buffer pool sizes can substantially reduce the REAL storage footprint • Down side is performance loss as read hit ratio degrades and page residency time decreases
  • 12. #IDUG 12 REAL Storage control – DB2 10 • The frequency of contraction mode can also be controlled by system parameter REALSTORAGE_MANAGEMENT • REALSTORAGE_MANAGEMENT options include: • OFF • Do not enter ‘contraction mode’ unless the REALSTORAGE_MAX boundary is approaching OR z/OS has notified DB2 that there is a critical aux shortage • ON • Always operate in ‘contraction’ mode • This may be desirable for LPAR with many DB2 subsystems or development/test systems • AUTO (the default) • When significant paging is detected, ‘contraction’ mode will be entered • But also under normal operating conditions with no paging DB2 will still perform DISCARD at thread Deallocation or after 120 commits • Important note • Contraction mode is not exited immediately upon relief to avoid constant toggling in and out of this mode • New messages (DSNV516I, DSNV517I)
  • 13. #IDUG 13 Beginners guide to DISCARD • To KEEP REAL or not to KEEP REAL that is the question • 64-bit pages are DISCARDED not freed • First steps in DB2 V8 to control REAL storage • Add DISCARDDATA to RESET to tell z/OS to un-back the frames that are no longer needed • Did it work? • z/OS will not release frames until AVQLOW condition • DB2 is still charged for the storage unless the system begins to page • When I say discard, I mean it … • New option in z/OS APAR OA15666 • REQUEST=DISCARDDATA, KEEPREAL=NO (“Hard Discard”) • Allows DB2 to discard real frames without hitting AVQLOW condition • DB2 support in PK25427, DB2 uses KEEPREAL=NO and the statistics are now accurate
  • 14. #IDUG 14 Large frame area • Good for DB2 performance • 1M size page large frames arrived in DB2 10 • Not good to use if the system is paging • z/OS converts unused 1M size large frames into 256 x 4K size small frames • DB2 is not allowed to use these frames since DB2 is non swappable and uses preferred storage • z/OS expects to recombine the small frames back into large frames later • Cannot be used for long term page fix • Could be that CICS ends up using the Large Frame Area
  • 15. #IDUG How to make large frames into small frames 0 2000 4000 6000 8000 10000 12000 MB DSN Shared (Private) Storage A2GB_SHR_REALF_TS A2GB_SHR_AUXS_TS A2GB_SHR_REALF_STK A2GB_SHR_AUXS_STK A2GB_COMMON_AUXS Shared Thread storage is being paged out
  • 16. #IDUG 16 One Flash Express Card CPU nanos Flash - microseconds Disk -milleseconds Access Time If you have no choice but to page – use Flash Express • Flash Express is a PCIe IO adapter with NAND Flash SSDs • Physically comprised of internal storage on Flash SSDs • Used to deliver a new tier of memory- storage class memory • Uses PCIe I/O drawer • Sized to accommodate all LPAR paging • Each card pair provides 1.4 TB usable storage • Maximum 4 card pairs (4 x 1.4=5.6 TB) • Immediately usable • Simplifies capacity planning • No intelligent data placement needed • Full virtualization across partitions • Robust design • Delivered as a RAID10 mirrored pair • Designed for long life • Designed for concurrent firmware upgrade • Secured • Flash Express adapter is protected with 128-bit AES encryption • Key Management provided based on a Smart Card
  • 17. #IDUG 17 Real storage control • Paging rate is a critical performance measure for any z/OS system • When shortage of REAL frames occurs, frames are moved to AUX (DASD) • Having DB2 paged out is a not good thing for performance • Paging should be minimised • Page fixing buffer pools is a good idea for performance • It avoids page fix and page free for high activity buffer pools (heavy I/O) • Page fixing 1M size real storage page frames reduces TLB misses (saves CPU) • But if insufficient REAL storage provisioned for the LPAR • LPAR begins to page and DB2 is a candidate for page stealing • Thread and EDM Pool storage is paged out • Performance problems as data is rapidly paged back in
  • 18. #IDUG 18 Real storage control … • “I have a large LPAR (128G) and my DB2 (6G) got paged out …” • Why is that? • Shift in workload with REAL frames stolen by overnight batch processing • Poor response times in the first few minutes of the online day • A lot of rapid paging going on • Huge increase in number of threads causing application scaling issues (lock contention, global contention) • REAL frames stolen by DB2 utilities • REORG uses REAL storage for in memory sort e.g., 64G • DFSORT defaults • EXPMAX=MAX <<<<<< Make maximum use of storage • EXPOLD=MAX <<<<<< Allow paging of old frames • EXPRES=0 <<<<<< Reserved for new work • Dump capture • Excessive dump time caused by paging on the LPAR may cause sysplex-wide sympathy sickness slowdowns
  • 19. #IDUG Real storage usage and DFSORT settings … 0 5000 10000 15000 20000 25000 30000 2013-07-29-00.02.00.000161 2013-07-29-04.08.00.000157 2013-07-29-08.14.00.000209 2013-07-29-12.20.00.018877 2013-07-29-16.26.00.000163 2013-07-29-20.32.00.000178 2013-07-30-00.38.00.000166 2013-07-30-04.44.00.000904 2013-07-30-08.50.00.016955 2013-07-30-12.56.00.000175 2013-07-30-17.02.00.000175 2013-07-30-21.08.00.000310 2013-07-31-01.14.00.059911 2013-07-31-05.20.00.019601 2013-07-31-09.26.00.000123 2013-07-31-13.32.00.000499 2013-07-31-17.38.00.000158 2013-07-31-21.44.00.000342 2013-08-01-01.50.00.370531 2013-08-01-05.56.00.093954 2013-08-01-10.02.00.130884 2013-08-01-14.08.00.000155 2013-08-01-18.14.00.000274 2013-08-01-22.20.00.015079 2013-08-02-02.26.00.000102 2013-08-02-06.32.00.000152 2013-08-02-10.38.00.004328 2013-08-02-14.44.00.003906 2013-08-02-18.50.00.036134 2013-08-02-22.56.00.000143 2013-08-03-03.02.00.000214 2013-08-03-07.08.00.000181 2013-08-03-11.14.00.000159 2013-08-03-15.20.00.014000 2013-08-03-19.26.00.000364 2013-08-03-23.32.00.000201 2013-08-04-03.38.00.000168 2013-08-04-07.44.00.000197 2013-08-04-11.50.00.033578 2013-08-04-15.56.00.000174 2013-08-04-20.02.00.000151 (MB) CBP4 - REAL storage available
  • 20. #IDUG 20 DB2 pages paged out and a dump happens? • What is my exposure? • Increased MASTER CPU time, z/OS tries to steal frames to meet the excessive demand caused by the dump • Elongated dump times • Auxiliary storage number > 0 • In theory each page could have to be paged in • z/OS can have the page in both places, REAL and AUX • If total size across all bufferpools is more than 800MB then the bufferpools are not dumped • No prefetch on AUX storage, so all synchronous I/O • Worst case is the number of pages * page-in I/O time • For example 2GB of 4K pages * 3ms = 524288 * 0.003 = 26 mins) • Guinness world record for a dump 37 mins • Full Sysplex hang resulted
  • 21. #IDUG 21 SYSPLEX sympathy sickness • Slowdown and no apparent reason why? • DB2 taking the dump may have TCBs non-dispatchable • P-Lock negotiation affected • Locks not released in a timely manner • Excessive dump time caused by paging on the LPAR may cause massive sympathy sickness slowdowns • How can a member slow down when there is plenty of CPU/Storage on the LPAR • May be the owner of a P-lock is being dumped or is paging a lot
  • 22. #IDUG The DUMP effect – no transactions being processed 0 1000 2000 3000 4000 5000 6000 7000 NUM_ENDED
  • 23. #IDUG 23 Real storage control … • Make sure LPAR has enough REAL storage • REAL storage upgrade is the cheapest and easiest performance upgrade • REAL storage shortage not only can cause performance issues but if DUMPs are needed then it can cause a small issue to become a massive SYSPLEX failure • Cheapest because MLC and other charges do not factor in the amount of REAL storage • Vendors do not charge by the amount of REAL on the CEC/CPC processor • Specify z/OS WLM STORAGE CRITICAL for DB2 system address spaces • To safeguard the rest of DB2 • Tells WLM to not page these address spaces • Keeps the thread control blocks, EDM and other needed parts of DB2 in REAL • Prevents the performance problem as the Online day starts and DB2 has to be rapidly paged back in
  • 24. #IDUG 24 Real storage control … • Make sure MAXSPACE is set properly and defensively • Represents the total amount of storage for captured dumps for the entire LPAR • MAXSPACE value should not be set so high that paging can occur causing massive issues to the LPAR • If multiple DB2s on same LPAR can wildcard to the same dump, then MAXSPACE needs to be set appropriately • MAXSPACE=16G is a good start to cope with more than 90% of all cases • But there are MVS defects around which are inflating DUMP size • Fixing z/OS APARs available to handle and minimise DUMP size: OA39596, OA40856 and OA40015 • MAXSPACE requirement should be • (DBM1 – Buffer pools) + Shared memory + DIST + MSTR + IRLM + COMMON + ECSA • Work is underway to get the exact formula based on all the new IFCID 225 fields • Once the formula is properly tested, will be posted on the various websites and Info APARs
  • 25. #IDUG 25 Real storage control … • Make sure REALSTORAGE_MANAGEMENT=AUTO (default) • Particularly when significant paging is detected, “contraction mode” will be entered to help protect the system • “Unbacks” virtual pages so that a REAL frame or AUX slot is not consumed for this page • Use automation to trap the DSNV516I (start) and DSNV517I (end) messages • As DB2 approaches the REALSTORAGE_MAX threshold • “Contraction mode” is also entered to help protect the system • Control use of storage by DFSORT • Set EXPMAX down to limit maximum DFSORT usage • Set EXPOLD=0 to prevent DFSORT from taking "old" frames from other workloads • Set EXPRES=% or n {reserve enough for MAXSPACE} • z/OS parameter AUXMGMT=ON • No new dumps are allowed when AUX storage utilization reaches 50% • Current dump data capture stops when AUX storage utilization reaches 68% • Once the limit is exceeded, new dumps will not be processed until the AUX storage utilization drops below 35%
  • 26. #IDUG 26 Performance enhancements / SPIN avoidance • SPIN locks used by z/OS RSM can cause performance issues when DISCARD processing is running on many CPUs at the same time • Possible LPAR outage in severe cases • DB2 APAR PM88804 fixes this outage issue • Reduce uncaptured time by freeing the virtual but not DISCARDing the REAL when DISCARD mode is off • REALSTORAGE_MANAGEMENT=OFF • No DISCARD processing when REALSTORAGE_MANGEMENT=AUTO and no paging • Immediate CPU performance reduction when transactions achieve poor thread reuse and there is a high rate of thread deallocation • Reduced CPU resource consumption, reduced exposure to SPIN locks • Customers using REALSTORAGE_MANAGEMENT=AUTO are essentially running OFF unless paging is occurring
  • 27. #IDUG After PM88804 Possible side effect of no DISCARD Virtual flat, Increasing REAL 0 50 100 150 200 250 300 350 400 0 2000 4000 6000 8000 10000 12000 14000 16000 MB DSN Total Storage ATB REAL_STORAGE_FRAME AUX_STORAGE_SLOT A2GB_SHR_REALF_TS A2GB_SHR_AUXS_TS A2GB_SHR_REALF_STK A2GB_SHR_AUXS_STK A2GB_COMMON_AUXS A2GB_SHR_AG_LOCAL Total threads REAL stays up Virtual comes down
  • 28. #IDUG 28 Virtual Contraction – DB2 APAR PM86952 • After APAR PM88804 some extreme customer cases saw some big REAL storage growth • Very workload dependent • New APAR PM86952 provides VIRTUAL contraction (NOT REAL) • Contraction of Virtual has an implicit effect on REAL storage • Virtual Storage decreases • REAL Storage decreases
  • 29. #IDUG 29 DB2 APAR PM99575 • Time to put back the DISCARD in normal processing to prevent runaway storage growth • Keep the performance advantage when REALSTORAGE_MANAGEMENT=OFF • Protect the system as much as DB2 can from SPIN lock contention and spin out • REQUEST=DISCARDDATA, KEEPREAL=YES (“Soft Discard”) • Trade off accurate Statistics for system availability and reduced REAL storage use • Statistics are not accurate after PM99575 because frames will not be stolen back to reduce the count until paging occurs • Statistics will be a high water mark on most systems • Statistics will be fairly accurate on systems with small amounts of paging
  • 30. #IDUG Storage manager changes: ZPARM RSM REALSTORAGE_MANAGEMENT=xxx After PM88804 • ENF 55 signal means DISCARD KEEPREAL=NO • RSM=OFF means No DISCARD • RSM=AUTO with no paging means no DISCARD at Thread Deallocation or 120 commits • RSM=AUTO with paging or RSM=ON means DISCARD with KEEPREAL=NO at Deallocation or 30 commits. STACK also DISCARDED • REALSTORAGE_MAX means DISCARD KEEPREAL=NO at 80% After PM99575 • ENF 55 signal means DISCARD KEEPREAL=NO • RSM=OFF means No DISCARD • RSM=AUTO with no paging means DISCARD with KEEPREAL=YES at Thread Deallocation or 120 commits • RSM=AUTO with paging or RSM=ON means DISCARD with KEEPREAL=YES at Deallocation or 30 commits. STACK also DISCARDED • REALSTORAGE_MAX means DISCARD KEEPREAL=NO at 100%
  • 31. #IDUG 31 Just when we thought we were out of the woods - CRITICALPAGING • If you have XCF CRITICALPAGING ENABLED, you also need to apply z/OS RSM APAR OA44913 or provision Flash Express on the LPAR • Without this APAR, the discarded shared frames with KEEPREAL(YES) are not stolen to replenish frame queues when paging occurs • Either APAR may be applied independently without the other • If z/OS APAR OA44913 is not applied and Flash Express is also not provisioned then • No benefit from DB2 APAR PM99575 especially if running with RSM=AUTO, XCF CRITICALPAGING is enabled, and the system starts to page … • Do I have it? • D XCF,COUPLE • To Activate • Update COUPLExx with: FUNCTIONS ENABLE(CRITICALPAGING)
  • 32. #IDUG 32 Futures • Nothing more in plan for DB2 • Storage manager now DISCARDING frames • DUMP size • Inflated dump size and MAXSPACE requirement for full dump • DB2 and z/OS Development investigating – WATCH THIS SPACE • REAL storage statistics • Since DISCARDED frames are not removed from the total, then the statistics are not as accurate as they could be • z/OS to look for a solution for this – WATCH THIS SPACE
  • 33. #IDUG Monitoring REAL/AUX storage usage – Sample graph #1 0 1000 2000 3000 4000 5000 6000 7000 (MB) D0E1 - Total REAL storage in use REAL in use for 64-bit common (MB) REAL in use for 64-bit shared stack (MB) REAL in use for 64-bit shared (MB) ASID DIST REAL in use for 64-bit priv (MB) ASID DIST REAL in use for 31-bit priv (MB) ASID DBM1 REAL in use for BP (MB) ASID DBM1 REAL in use for 64-bit priv w/o BP (MB) ASID DBM1 REAL in use for 31-bit priv (MB)
  • 34. #IDUG Monitoring REAL/AUX storage usage – Sample graph #2 0 0 0 1 1 1 (MB) D0E1 - Total AUX storage in use AUX in use for 64-bit common (MB) AUX in use for 64-bit shared stack (MB) AUX in use for 64-bit shared (MB) ASID DIST AUX in use for 64-bit priv (MB) ASID DIST AUX in use for 31-bit priv (MB) ASID DBM1 AUX in use for BP (MB) ASID DBM1 AUX in use for 64-bit priv w/o BP (MB) ASID DBM1 AUX in use for 31-bit priv (MB)
  • 35. #IDUG Monitoring REAL/AUX storage usage – Sample graph #3 0 5000 10000 15000 20000 25000 30000 35000 2014-05-28-… 2014-05-29-… 2014-05-29-… 2014-05-29-… 2014-05-29-… 2014-05-29-… 2014-05-29-… 2014-05-30-… 2014-05-30-… 2014-05-30-… 2014-05-30-… 2014-05-30-… 2014-05-30-… 2014-05-31-… 2014-05-31-… 2014-05-31-… 2014-05-31-… 2014-05-31-… 2014-05-31-… 2014-05-31-… 2014-06-01-… 2014-06-01-… 2014-06-01-… 2014-06-01-… 2014-06-01-… 2014-06-01-… 2014-06-02-… 2014-06-02-… 2014-06-02-… 2014-06-02-… 2014-06-02-… 2014-06-02-… 2014-06-02-… 2014-06-03-… 2014-06-03-… 2014-06-03-… 2014-06-03-… 2014-06-03-… 2014-06-03-… 2014-06-04-… 2014-06-04-… 2014-06-04-… 2014-06-04-… 2014-06-04-… 2014-06-04-… (MB) SYS1 - REAL storage available
  • 36. #IDUG Monitoring REAL/AUX storage usage – Based on OMPE PDB • #1 - Stacked AREA graph - one for each DB2 member (one sheet per member) • #2 - Stacked AREA graph - one for each DB2 member (one sheet per member) • #3 - Line graph - one for each LPAR (REAL_STORAGE_FRAME - A2GB_REAL_FRAME)*4/1024 AS DBM1_REAL_PRIV_31BIT_MB (A2GB_REAL_FRAME - A2GB_REAL_FRAME_TS)*4/1024 AS DBM1_REAL_PRIV_64BIT_BP_MB A2GB_REAL_FRAME_TS*4/1024 AS DBM1_REAL_PRIV_64BIT_XBP_MB (DIST_REAL_FRAME - A2GB_DIST_REAL_FRM)*4/1024 AS DIST_REAL_PRIV_31BIT_MB A2GB_DIST_REAL_FRM*4/1024 AS DIST_REAL_PRIV_64BIT_MB A2GB_COMMON_REALF*4/1024 AS REAL_COM_64BIT_MB A2GB_SHR_REALF_TS*4/1024 AS REAL_SHR_64BIT_MB A2GB_SHR_REALF_STK*4/1024 AS REAL_SHR_STK_64BIT_MB (AUX_STORAGE_SLOT - A2GB_AUX_SLOT)*4/1024 AS DBM1_AUX_PRIV_31BIT_MB (A2GB_AUX_SLOT - A2GB_AUX_SLOT_TS)*4/1024 AS DBM1_AUX_PRIV_64BIT_BP_MB A2GB_AUX_SLOT_TS*4/1024 AS DBM1_AUX_PRIV_64BIT_XBP_MB (DIST_AUX_SLOT - A2GB_DIST_AUX_SLOT)*4/1024 AS DIST_AUX_PRIV_31BIT_MB A2GB_DIST_AUX_SLOT*4/1024 AS DIST_AUX_PRIV_64BIT_MB A2GB_COMMON_AUXS*4/1024 AS AUX_COM_64BIT_MB A2GB_SHR_AUXS_TS*4/1024 AS AUX_SHR_64BIT_MB A2GB_SHR_AUXS_STK*4/1024 AS AUX_SHR_STK_64BIT_MB QW0225_REALAVAIL*4/1024 AS REAL_AVAIL_LPAR_MB
  • 37. #IDUG Monitoring REAL/AUX storage usage – Mapping for reference IFCID FIELD OMPE FIELD OMPE PDB COLUMN NAME MEMU2 Description QW0225RL QW0225RL REAL_STORAGE_FRAME DBM1 REAL in use for 31 and 64-bit priv (MB) QW0225AX QW0225AX AUX_STORAGE_SLOT DBM1 AUX in use for 31 and 64-bit priv (MB) QW0225HVPagesInReal SW225VPR A2GB_REAL_FRAME DBM1 REAL in use for 64-bit priv (MB) QW0225HVAuxSlots SW225VAS A2GB_AUX_SLOT DBM1 AUX in use for 64-bit priv (MB) QW0225PriStg_Real SW225PSR A2GB_REAL_FRAME_TS DBM1 REAL in use for 64-bit priv w/o BP (MB) QW0225PriStg_Aux SW225PSA A2GB_AUX_SLOT_TS DBM1 AUX in use for 64-bit priv w/o BP (MB) QW0225RL QW0225RL DIST_REAL_FRAME DIST REAL in use for 31 and 64-bit priv (MB) QW0225AX QW0225AX DIST_AUX_SLOT DIST AUX in use for 31 and 64-bit priv (MB) QW0225HVPagesInReal SW225VPR A2GB_DIST_REAL_FRM DIST REAL in use for 64-bit priv (MB) QW0225HVAuxSlots SW225VAS A2GB_DIST_AUX_SLOT DIST AUX in use for 64-bit priv (MB) QW0225ShrStg_Real SW225SSR A2GB_SHR_REALF_TS REAL in use for 64-bit shared (MB) QW0225ShrStg_Aux SW225SSA A2GB_SHR_AUXS_TS AUX in use for 64-bit shared (MB) QW0225ShrStkStg_Real SW225KSR A2GB_SHR_REALF_STK REAL in use for 64-bit shared stack (MB) QW0225ShrStkStg_Aux SW225KSA A2GB_SHR_AUXS_STK AUX in use for 64-bit shared stack (MB) QW0225ComStg_Real SW225CSR A2GB_COMMON_REALF REAL in use for 64-bit common (MB) QW0225ComStg_Aux SW225CSA A2GB_COMMON_AUXS AUX in use for 64-bit common (MB) QW0225_REALAVAIL S225RLAV QW0225_REALAVAIL REALAVAIL (MB) (S) Note: All REAL/AUX storage fields in IFCID 225 and OMPE performance database are expressed in 4KB frames or slots – they should be converted to MB (conversion is already done in MEMU2)
  • 38. #IDUG 38 Summary • Apply the DB2 APARs • Apply the z/OS APAR if XCF CRITICALPAGING is enabled • Keep the LPAR well provisioned with REAL storage • For optimal performance avoid paging to AUX or Flash Express • For most customers set REALSTORAGE_MANAGEMENT=AUTO • Only use REALSTORAGE_MANAGEMENT=OFF when • LPAR is generously over provisioned with REAL storage • Proactive monitoring is in place with alerting if the available REAL storage drops down encroaching on free cushion • Do not over commit the LFAREA if the system may page and the large frames may be broken down and put back together again • Watch out for MAXSPACE and large dump sizes that may cause the system to page • Use ‘common currency’ for monitoring REAL and AUX usage, to determine what is the normal vs. abnormal system profile
  • 40. #IDUG John Campbell DB2 for z/OS Development campbelj@uk.ibm.com Session 6006 DB2 for z/OS Real Storage Monitoring, Control and Planning