SlideShare ist ein Scribd-Unternehmen logo
1 von 69
Downloaden Sie, um offline zu lesen
Managing the Performance of
Your IBM DB2 z/OS Applications
by Using IBM InfoSphere Optim
Solutions



Peter Schouboe, IBM SWG Nordic
Norbert Jenninger, IBM




                                 © 2011 IBM Corporation
Disclaimer
          © Copyright IBM Corporation 2010. All rights reserved.
          U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule
          Contract with IBM Corp.

          THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES
          ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE
          INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS” WITHOUT WARRANTY OF
          ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT
          PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM
          SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE
          RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS
          PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR
          REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND
          CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS AND/OR
          SOFTWARE.


    IBM, the IBM logo, ibm.com, Optim, InfoSphere, pureQuery, and Data Studio are trademarks or registered trademarks of
    International Business Machines Corporation in the United States, other countries, or both. If these and other IBM
    trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols
    indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such
    trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is
    available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

    Other company, product, or service names may be trademarks or service marks of others.




1                                                                                                            © 2011 IBM Corporation
Performance Issues                                 Performance issues – main areas
                                                    – Program
                                                       •   Number of file / database trips
                                                       •   DataChecks - Commitpoints
                          File
                         Input                         •   Internal data manipulation
                                                       •   Complex calculations
      User
                                                    – Transaction Managers
    Interface                                          • Number of threads / active users
                                                         vs. Region sizes
                       Program             File
                                          Output       • Transaction mgmt protocol
      Batch
                                                    – Database
     control                                           •   Optimized database design
                                                       •   Index use vs. Direct data access
                                                       •   Advanced vs simple SQL
                Optimizer / Access Plan                •   Database Optimizer help
                                                    – Communication
                                                       • Number of trips to database
                       Database
                     Input/Output                      • Amount of data shipped
                                                       • Number of threads


     Main components to watch for performance reasons:
     Operating Systems – Transaction Managers – Database System – Program
     language compilers – Physical devices / box, connector, memory etc...
2                                                                                    © 2011 IBM Corporation
Application development on System z – old school ☺
    Traditional Mainframe                              Developing for performance relies
    development                                        on 2 min factors:
              zOS Application Server                    – Monitors for each main
                                                          component
                        ------
                        ------
                        ------
                          ------
                                                             • Transactions, Batch jobs,
                         -------
                          ------                               Databases, Operating system
                           -
                                                                 – AddressSpace Monitors
                                                             • SQL monitors
        TSO        CICS / IMS TM          Batch
                                                        – Advise for optimization
                     Applications                            • App. Analyzers
        Assembler, COBOL, PL1, Rexx, ISPF ++
                                                             • Explain (DB2 Optimizer Guess)

         DB2 / IMS DB              File System         Complicated enough, but all inside one known
                                                       box, under one ruleset – the zOS / MVS .
                        MVS                            Complications mainly from,
                                                                    - system & core sw. upgrades
                                                                    - database changes
                                                                    - physical improvements

                                                 zOS


3                                                                                           © 2011 IBM Corporation
Optimizing SQL – The process




                       EXPLAIN         PLAN TABLE

      DB2     DB2            DB2
      Data   Catalog       Optimizer




                                           SQL
             Runstat                      Report




4                                                   © 2011 IBM Corporation
Today, The IT model looks different …
Real-time event-driven workloads, richer content, and modular technologies alter the
composition of systems and how systems are deployed as well as managed


                                                                               Web Servers



                                                                                                        System z
                                            SSL/XML       Security/Directory
                                           Appliances         Servers
                                                                                  Application
                                                                                   Servers

                                Routers
                                Switches
                                                                                                    File/Print
                                                                                 Application &
                                                                                 Data Servers       Servers
                                                             DS Servers
                                            Caching
                     Firewall              Appliances
                     Servers

                                                                                          LAN Servers


      Application software and middleware is deing deployed on several platforms
      Much more complicated to monitor and optimize.
      New, and different methods needs to be considered when developing,
      monitoring and optimizing applications.

                                                                                          CICS
                                                        App server
        Client App          WEB Server                                                                             DB2


5                                                                                                                  © 2011 IBM Corporation
Object oriented versus Relational
The built-in original conflict

             Persistence
               Layers



       Business Object                                       DB2
         Customer




                 Reuse =
                 Development Speed
                                     Object in use
                                     Business Object: Customer
     Object Oriented
                                             Field1 = Variable1, default <empty>
     Java application(s)
                                             Field2 = Variable2, default <empty>
                                             Field3 = Variable3, default <empty>
                                             Etc...
                                     So – use the fields as needed...
                                                                   © 2011 IBM Corporation
Issues in the Optimization process

    Explain requires that you have access to /can find the code
     – It requires that you have access to the SQL
     – Many times it’s very hard to predict dynamic SQL
    Explain will not advise on how to change program / SQL
    Explain bases itself on known Index structures (Fix ?Virtual Index, 8, 9 & 10)
    Explain does not cover trips across the Net
    Explain does not help minimize data shipped
    Explain needs access to production statistics....(Fixed in DB2 10 ☺ !!)
    It’s easy to type errors, and do you know your data ?
    Testing corrections is difficult
    The problem of introducing rewrites
     – Price of corrections grows the later you have to change....
    It’s becomming still harder to figure out if there is an issue, and where you
    need to optimize.


7                                                                            © 2011 IBM Corporation
Other Issues – Dynamic vs. Static SQL

     Dynamic SQL is to development what Chokolade is
     to a child....
       – It’s quick...
       – It solves your problem...
       – It comes in many forms and shapes...

    • But ....

      It’s not going to help meet diet goals
      It will ’cheat’ the system burn-rates
      And – if left alone.....


8                                                      © 2011 IBM Corporation
Difference between “healthy food” and “chokolate”….

                        Dynamic SQL                                                        Static SQL
                   Check authorization for JDBC
                                                                              Check authorization for packages/plans
                 packages/plans for temporary use


                        Parse SQL statements



                 Check authorization for tables/views
                                                                                   Extract access paths from
                                                                             SYSCAT.PACKAGES and .STATEMENTS
                        Calculate access paths


                   Store access paths temporary in
                        JDBC packages/plans


                      Execute SQL statements                                          Execute SQL statements


         DB2 will reuse SQL from dynamic statement cache I           SQL is bound into a package beforehand. All SQL parsing and
            possible. New feature “&” in DB2 10 will help.           initial optimization work is done ahead of time and only once.
    Alternatively using “?” parameter markers rather than Literals            Statements are fully optimized during execution.
                           will enable reuse.
      Still – sheer number of threads might flush statement
                      from the dynamic cache…..
9                                                                                                                 © 2011 IBM Corporation
Management Issues with dynamic SQL...

     Every statement potentially
     fires – Prepare, Bind,
     Execute
     All uses same
     Plan/User/Authority
     Access needs to be granted
     on DB2 Tables/Views
     Litteral vs Parameter
     markers (better in DB2 10)
     Hard to find specific SQL



10                                      © 2011 IBM Corporation
IBM Tools to support the optimization process

     z/OS / ISPF:           SQL performance Analyzer

     z/OS / GUI:            Data Studio (free)
          – Visual Explain
          – SQL Editor
          – Statistics Advisor


     z/OS / GUI:            Infosphere Optim Development Studio
                            Infosphere Optim pureQuey
                            Infosphere Optim Query(Workload)Tuner


     z/OS / GUI:            Omegamon for DB2 PE Extended Edition
11                                                      © 2011 IBM Corporation
Develop
Editing, Testing and Optimizing SQL with Development Studio                       ment
                                                                                 Studio

                                      SQL sensitive
                                         Editor



      Compare performance
     data of various versions                            Visualize
       of your application                            application SQL

                                                                        Visualize execution
                                                                              metrics




 Correlate with
  data source
   attributes                                                       Execute, tune,
                                                                     share, trace,
                                                                     explore SQL

12                                                                         © 2011 IBM Corporation
Reduce trips across net to data                                                                                  pureQuery
- Heterogenous Batching
                                                                       Network
     Users                                                 Table 1, operation 1
                                                           Table 1, operation 2
                                                           Table 1, operation 3

                                                                   Table 2, operation 1
                                                                  Table 2, operation 2
                                                               Table 1, operation 4                                 DBMS
             Application                                 Table 3, operation 1

              Servers                                          The advantage of Heterogenous Batching

                                                         500
                                   Elapsed Time (mSec)



 Heterogenous Batching –                                 400
 Multiple operations across                              300
 different tables all execute as                                                                              HeteroBatching
 one batch                                               200                                                  No Batching
                                                                                                              JDBC Batching
                                                         100

                                                           0
                                                               0        20        40      60   80      100
                                                                     # of operations per transaction


13                                                                                                           © 2011 IBM Corporation
Finding the SQL/Program 2…                                               pureQuery
Managing already developed Applications                                   Runtime


     Monitor                                    Monitor
      – Review performance
      – Analyze hotspots
     Capture                                   Capture
      – Capture performance and application
        metadata
     Optimize
                                                Review     Optimize       Restrict
      – Review and share SQL
         • Visualize hotspots
         • Analyze impacts from schema
           changes
         • Trace SQL to originating source
      – Optimize and replace SQL               Configure         Bind
      – Create approved SQL list
     Deploy
      – Configure execution properties
      – Optionally bind for static execution
                                               Execute

14                                                                    © 2011 IBM Corporation
Using pureQuery in development & Production...

     Up front development vs.
     After the fact
     You decide at runtime....
     – (Dynamic/Static/Mix)
     DB2 / Oracle / Informix




15                                          © 2011 IBM Corporation
Find the SQL and the program using pureQuery                   pureQuery   pureQuery

                                                               AppServer   DB2 Connect

      Optim Development
            Studio

                          PQ
                          APi




                                                                      DB2 for LUW
                                                       PQ
                                  web                Runtime          DB2 for z/OS
                                              DS1
                                application

            Client                            DS2
                                                                             Static SQL
                                                                             Packages
          applications
                            Any Application Server

                                Java Stand-alone
                                                       PQ
                                application          Runtime


           Client tier               Application tier                 Database tier
 16                                                                                © 2011 IBM Corporation
So – does this support ......?




                                 © 2011 IBM Corporation
Develop
Editing, Testing and Optimizing SQL with Development Studio              ment
                                                                        Studio




                                                              Execute, tune,
                                                               share, trace,
                                                               explore SQL

18                                                                © 2011 IBM Corporation
Data Studio
                                      QueryTuner
Visual Explain – Pictures talks…
     Visualize access path
     – See flow of query processing
     – See indexes and operations
     – See optimizer rationale




19                                    © 2011 IBM Corporation
Data Studio
Figure out what triggers Explain/DB2 Optimizer                       QueryTuner
                                                                                              New!
                                                                                      Repair and Complete
                                                                                       Control Statements
                                                          Provides advice on
                                                           – Missing statistics
                                                           – Conflicting statistics
                                              Generates
                                             RUNSTATS      – Out-of-date statistics
                                               control
                                             statements                               Indicates
                                                                                    conflicting and
                                                                                   missing statistics


          Results
           –   Accurate estimated costs
           –   Better query performance
           –   Less CPU consumption
           –   Improved maintenance window
               throughput

                                                                                      Conflicting
“Half of access path PMRs could be                                                     statistics
resolved by statistics advisor before                                                 explanation
calling IBM support.” – IBM Support
 20                                                                                   © 2011 IBM Corporation
Query

Improve Query Design                                                    Tuner

                                                    Guard against errors and
                                                      oversights:
                                    View analysis      Further constrain query,
                                      summary          increase index utilization, and
                                                       reduce data reads
                                                                  Highlights relevant
                                                                  components of the
                                                                         query


     Filter recommendations
             by severity

     Query Advisor checks for
                                                                Recommendation
     – Missing join predicate for
       referential constraint                                     and rationale
     – Predicates that can be
       rewritten as indexable
     – Stage 2 predicates that
       can be rewritten as
       stage 1 predicates



21                                                                      © 2011 IBM Corporation
Query
Visualize Queries and Costs to Speed Analysis                                Tuner



                               Easily see tables,
                                 sections, join        Examine table
                                predicates, etc.        statistics and
                                                    additional information




     Accelerate analysis, reduce downtime
     – Spot human errors
     – Identify where filtering should occur

22                                                                  © 2011 IBM Corporation
Improve performance
                            Query
                             Tuner




23                   © 2011 IBM Corporation
Optimizing programs & SQL in distributed world….
        A high-performance, data access platform to simplify
     developing, managing, securing, and optimizing data access.


     Infosphere Optim pureQuery - Simple and intuitive API
      – Enables SQL access to databases or in-memory Java objects
      – Enables high Batching (fewer trips on the net)
      – Collects run statistics in central database
      – Runtime option enables flexible SQL deployment for DB2
     Infosphere Optim Development Studio
      – Integrated development environment with Java and SQL support
      – Improve problem isolation and impact analysis
     Infosphere Optim Query Workload Tuner
      – Optimize application performance and reduce costs
      – The power of advisors

24                                                                     © 2011 IBM Corporation
Tivoli
So – finding the problem origin…..                                                      Omegamon
                                                 …
                                            OMEGAMON XE
                                             for Mainframe
                                               Networks /
                                              for zNetview

                                            OMEGAMON
                                            XE for CICS

                                            OMEGAMON
                                             XE for IMS



                  DB2                      OMEGAMON XE                         DB2
                 SQL PA                      for DB2 PE                      Query Monitor

    DB2                 Extended Insight
Path Checker                Feature                                Optim Query (Workload) Tuner
                                                                          Data Studio
               Optim Performance
                     Manager
                                            OMEGAMON
      Information Management                XE for z/OS
                                                      => DWL or additionally using
                Tools                                    OMEGAMON DE (Dashboard Edition)
                                              ITCAM
 25                                             ….                                 © 2011 IBM Corporation
Performance Monitoring and Tuning

OMEGAMON XE for DB2 Performance
Expert on z/OS

Norbert Jenninger




                                    © 2011 IBM Corporation
Omegamon for DB2 - Newest Versions
     Version 510 - GA 10/22/2010
            • OMEGAMON XE for DB2 Performance Expert on z/OS V510 *
            • OMEGAMON XE for DB2 Performance Monitor on z/OS V510 *
            • DB2 Buffer Pool Analyzer for z/OS V510

      – Key Content of these new versions
            • Full “Exploitation” Support for DB2 10
            • Additional customer-driven requirements (Improved Data Sharing
              Support)
            • Reduced CPU and storage consumption
            • New Extended Insight allows monitoring an application and SQL
              “end-to-end”



     (*) We will use OMPE and OMPM as abbreviation in this presentation

27                                                                        © 2011 IBM Corporation
OMEGAMON V510 – complete DB2 10 support

     Support for approximately 30 DB2
     Line-items and change requests:
      – SMF compression
      – ACCOUNTING
         • Separation of Lock and Latch wait times
         • More granularity on package level
           although ACCUMAC >1 is used
         • Accounting roll-up changes                DB2 10 beta: More than twenty DB2 10 beta
         • Distributed threads accounting            customers have downloaded and used OM PE
      – STATISTICS                                   V510
         • IFCID 225 (memory) changes
         • Multiple IFCID 2 for each 25 buffer
           pools (>25 buffer pool usage)             OMEGAMON beta: OM PE V510 beta
         • DSC enhancements including static         customers tested OM PE with DB2 V8, 9, and
           SQL                                       10
         • EDM Pool and other working memory
           moved above the bar
      – New and updated ZPARMs
      – PERFORMANCE traces
      – Audit trace changes
         • Row-level and Column-level access
           control
         • New DBA privileges


28                                                                                © 2011 IBM Corporation
Latest News:
New Function PTF UK65924 / APAR PM35049
     Near-Term History now with zIIP off-load
      plus improved precision in NTH CPU filter
     ATF display new DB2 10 metrics for CLOSE CURSOR
     Reporting
      – SQL Activity Trace shows new DB2 10 metrics for CLOSE CURSOR
          Static/Dynamic, Sync buff reads, Getpages, Indexscan, TS scan, rows exam., rows proc., sorts, buffer writes, ….

      – Audit TRACE and REPORT supports new IFCID 271. Data related to objects
        ROW PERMISSION and COLUMN MASK are shown
      – Record Trace show new V10 (after GA DCR) instrumentation
      – New System Parameter
     Performance DB (INTEGER to DECMIAL, extend fields to avoid overflow)
     New PE client driver (Display Static SQL cache)
     plus couple of internal fixes
     …
29                                                                                                                          © 2011 IBM Corporation
So - where is my problem?
=> End-to-end monitoring with SQL level deep dive - Extended Insight
                                                                                DB2 for z/OS




                                            ITCAM for Transactions
                     End-to-End SQL monitoring                        IBM Tivoli OMEGAMON XE for
             ITCAM                         IBM Tivoli                DB2 Performance Expert on z/OS
         for WebSphere                   Monitoring (ITM)                                             details



     … tells me which application it is, and ultimately which business function

     … where I can measure what my application/user is really experiencing. Tells
     me which components are involved and where my application/SQL is spending
     its time

     … tells me where the SQL statement is coded and let’s me change it if
30
     necessary                                                       © 2011 IBM Corporation
DB2 Performance metrics (Trace records – Trace types)


     Legacy workload:                                          Distributed workload:
     Cobol, Batch                                              Internet, WAS, Java
     CICS, OLTP
                                                               Data Warehouse



                                         API
         Snapshot Data                                     Event Trace Data
             START TRACE (MON)                             e.g. START TRACE via ZPARMS




                                               ST FI
                                                           .




                                                 AR RE
                                     S




                                                           .
                                   AD




                                                   I

                                                   T
                                                           or




                                                     TR
                                 RE




                                                           via monitor         SMF /


                                                       AC
                                                           program
                                                        AD
                               I
                             IF




                                                         E
                                                                              GTF
                                                           A

                                                           …

31                                                                       © 2011 IBM Corporation
DB2 Metrics / Instrumentation data and their usage

                                                     Real-Time                                       VTAM
DB2 snapshot
                 IFI API (READS)                     Monitor                                         / ISPF
(synchronous)                                        Data Collector                                  / GUI
trace data


     DB2                  Hook into DB2,               Save materialized data
     control      direct access to control blocks,   in storage or on disk space

     blocks                                                                                              PDB         PWH

                                                                                                              DB2 LOAD

                                                                                     SMF
DB2 event                                                                                                    FILE    SAVE
(asynchronous)
trace data
                                                                                     GTF        Historical
                           OP-
                          buffer
                                                                                                Reporting

                                                                                   Sequential
                                                     Monitor Collector                File
                 IFI API (READA)                     Program
                                                     NTH, CRD
                                                     ATF                                               VTAM
                                                                                     VSAM              (NTH,
                                                                                                       ATF)

32                                                                                                       © 2011 IBM Corporation
Still one major pain point -
What is happening outside of DB2? (e.g. with remote applications)
     z/OS



                    OMPE STC
                   (data collector)
        DB2
         for
        z/OS
                                                                TEP
                   Classic, CUA,
                      PE client




               N
                       Data                           Appl.
               e      Server                          Server
                      Drivers
               t
               w      (JCC,           Application
               o       CLI,.          program          e.g.
               r       NET)                         WebSphere
               k




33                                                                    © 2011 IBM Corporation
Where is my DB2 application spending its time?
     OMEGAMON PE’s Extended Insight is an advanced way to monitor the
     database workload (SQL) of your applications and solutions
     – Get total response times and response time breakdown (appl, driver,
       network, data server) per defined workload/cluster (e.g. per system,
       application, user)
     – Compare workload from various servers / applications
     – Select a time period for analysis
     – Get top SQL statements per defined workload
                                                   User                      User experience
     – Identify top clients contributing                             App pre- and post-processing
       in the workload
                                                   Application                 transaction
                                                                     SQL 1      SQL 2        COMMIT

                                                   WebSphere or
                                                   Java App Server

      Extended Insight is available with           JCC driver
      the Performance Expert Offering
                                                   Network
      only
                                                   DB2
                                                   Operating
                                                   System
34                                                                                      © 2011 IBM Corporation
Can run as
How does it work?                                                Linux, zLinux, Unix, Windows
                                                                                                stand-alone
                                                                                                web UI
     z/OS


                                                                      Repository
                                OMPE STC                              Database

                               (data collector)
        DB2
         for
        z/OS
                                                                                                Integrated
                                                                                                into OMPE
                                                                                                  TEP
                                                                                                TEP (web)
                               Classic, CUA,                                                    workspace
                                  PE client

                                               EI
                                              Client
                                             Software
                           N
                                    Data                                  Appl.
                           e       Server                                 Server
                                   Drivers
                           t
                           w       (JCC,                Application
                           o        CLI,.               program          e.g.
                           r        NET)                              WebSphere
                           k




     Color coding:
                     = OMEGAMON XE for DB2 PE V510
                     = DB2 for z/OS and DB2 Data Server drivers



35                                                                                                            © 2011 IBM Corporation
How to start and navigate to the Extended Insight dashboard

     Seamless navigation depending on the usage/problem scenario …

     1. Integration and navigation to Extended Analysis Dashboard as part
        of new OMEGAMON XE for DB2 PE on z/OS (OMPE) TEP
        workspace

     2. As a stand-alone web console session

     3. Integrated with ITCAM and navigation to Extended Analysis
        Dashboard




36                                                             © 2011 IBM Corporation
OMPE on z/OS TEP
     Navigation to the Extended Insight Analysis Dashboard




                            Navigation to the OMPE workspace with the
                            E2E SQL monitoring information




37                                                             © 2011 IBM Corporation
OMPE on z/OS TEP
     Navigation to the Extended Insight Analysis Dashboard




38                                                      © 2011 IBM Corporation
Optim Performance Manager Web Console with
Health Summary and navigation to Extended Insight Dashboard
                                            OMEGAMON XE for DB2 PE on z/OS
                                            reuses the Optim Performance Manager
                                            Extended Insight monitoring capability..
                                            Health Summary and Extended Insight
                                            Dashboard are enabled for monitoring of
                                            SQL access DB2 for z/OS.




          Navigate to Extended Insight Analysis Dashboard for E2E SQL monitoring =>


39                                                                              © 2011 IBM Corporation
Extended Insight Analysis Dashboard
                   The slider bar allows selection of the time period to be considered




Overview and comparison of “Workload cluster groups” but also on details with the
capability to select and further zoom in.
40                                                                      © 2011 IBM Corporation
Extended Insight Analysis Dashboard




Define your “Workload cluster
groups” as you need
41                                     © 2011 IBM Corporation
Extended Insight Analysis Dashboard




Define your “Workload cluster
groups” as you need
42                                     © 2011 IBM Corporation
Setting Client information - Samples
DB2ConnectionPoolDataSource ds = new DB2ConnectionPoolDataSource();
     ds.setUser("myuser");
     ds.setPassword("mypass");
     ds.setDatabaseName("mydb");
     ds.setConnectionAttribute
      ("ClientApplName=WebSphere-Samples;
        ClientWrkstnName=WebSphere-Wkstn;
        ClientUserid=WebSphere-User
        ClientAcctStr=WebSphere-Acctstr");
     PooledConnection poolconn = ds.getPooledConnection();
     con = poolconn.getConnection();
WhitePaper: http://www.ibm.com/developerworks/data/library/techarticle/0212shayer/0212shayer.html




                                                                                      © 2011 IBM Corporation
Reported on the DB2 for z/OS
     Accounting report, for example
          ACCOUNTING
                 REPORT FROM (04-01-13 ,13:42) TO (04-01-13 ,13:50)
                 ORDER (ENDUSER-WSNAME-TRANSACT)
                 INCLUDE (WSNAME(WORKSTATNAME))
          EXEC


     or in a DB2 “DISPLAY THREAD ….” command output




44                                                               © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Expand to more details, e.g. expand user data and application data




45                                                                 © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Expand to more details, e.g. expand user data and application data




46                                                                 © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Show additional graphs for selected workload clusters




47                                                           © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Show response time histogram for selected workload




       Click to show response time histogram




48                                                        © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Zoom into selected workload and see the TOP SQL list




                                                Shows top SQL statements executed
                                                by distributed Java or CLI applications
                                                like SQW, SAP, Cognos, DataStage,
                                                or WebSphere.
                                                      Zoom in (double click) on a
                                                      selected SQL in question




49                                                                    © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Select SQL from list and zoom into SQL level details




                                                            Launch Optim Query (workload)
                                                            Tuner (or Data Studio) to
                                                            explain and tune the selected
                                                            SQL statement




50                                                                        © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Select SQL from list and zoom into SQL level details




                                      Java class / - package / method, etc. shown if
                                      pureQuery Is installed.               ==> next 2 slides



51                                                                                     © 2011 IBM Corporation
How pureQuery Runtime can help !
Extended Insight feature can tell you where the query came from …

                                                               Application source



                                                                                                             Capture SQL with pureQuery runtime




                                                                                                               Upload collected metadata into OPM
                                                                                 SELECT * FROM DB2ADMIN.I…




      SELECT * FROM DB2ADMIN.INVENTORY




     TestOPM   my.test   main   13       blahVer   N/P   N/P   blah   capture…




52                                                                                                                                      © 2011 IBM Corporation
How pureQuery Runtime can help !
Extended Insight feature can tell you where the query came from …

                                                               Application source



                                                                                                             Capture SQL with pureQuery runtime




                                                                                                               Upload collected metadata into OPM
                                                                                 SELECT * FROM DB2ADMIN.I…




      SELECT * FROM DB2ADMIN.INVENTORY




     TestOPM   my.test   main   13       blahVer   N/P   N/P   blah   capture…




53                                                                                                                                      © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Select a plot area and see the corresponding performance metrics


                      Click on plot area (data server time) to select
                                                                  … for data server times and
                                                                    transaction throughput




                                                                 Click on plot area (network time) to select




     … for network times and
       throughput


54                                                                                       © 2011 IBM Corporation
WebSphere – another area to be monitored in context




                         WebSphere support
                         has a built-in support for OPM (starting with WAS V6.0.21), allowing to ...
                         • identify problems with WAS connection pool
                         • identify differences in the configuration of nodes in a WAS cluster
                         • check if a node in a WAS cluster has a system or network problem
        47
        57.67




                                          47               57.67

                                          52                0.34




55                                                                          © 2011 IBM Corporation
Where is my DB application spending its time?
   e.g. in application, SQL, and network?
          Drill down to
                                                    ITCAM for Transactions
                                                                                                                 Drill down to
          Performance Manager                       •Deep on end-to-end transaction path                     ITCAM WR / ITM
                                                    •Hand-off to Optim, ITCAM, ITM for diagnose / repair



                                User                        User experience                                 ITCAM for WebSphere
                                                                                                              • Deep on application /
                                                      App pre- and post-processing                              web server, J2EE / web
                                                                                                                app, web resources
                                Application                  transaction                                      • Shallow on JCC driver,
                                                  SQL 1        SQL 2          COMMIT                            database app for
                                                                                                                sensing problems, then
      OM DB2 PE with
                                                                                                                hand-off to Optim
     Extended Insight           WebSphere or                                                                    Performance Manager
• Deep on Database,             Java App Server                                                                 for diagnose / repair
  JCC driver, etc
• Shallow on
                                JCC driver
  network, OS, app
  server for sensing
  problems then                                                                                              ITM for Servers
  hand-off to ITM for           Network                                                                        • Deep on OS, Network,
  Servers to diagnose                                                                                            Storage, I/O, etc
  / repair                                                                                                     • Shallow on database
                                Database                                                                         for sensing problems
                                                                                                                 then hand-off to Optim
                                Operating                                                                        Performance Manager
                                System                                                                           for diagnose / repair

          Drill down to ITCAM WR / ITM
                                                                                            Drill down to Optim Performance Manager
  56                                                                                                               © 2011 IBM Corporation
Omegamon for DB2 Architecture Summary:                                                    Can run as
                                                                                          stand-alone
An integrated solution and how it is packaged                                             web UI
     z/OS
                                                           Linux, zLinux, Unix, Windows


                                OMPE STC                               Repository
                               (data collector)                        Database
        DB2
         for                                                                               Optim Query (Workload) Tuner
        z/OS
                                                                                          Integrated
                                                                                          into OMPE




                                                                y
                                                                l it
                                                                                          TEP (web)




                                                            Uti
                                                                                          workspace




                                           p EI
                                              Client
                                           u Software
                                    Data                                        Appl.
                           N
                                   Server
                                           r
                           e                                                    Server
                           t       Drivers e
                           w       (JCC, Q            Application
                                                                               e.g.
                           o        CLI,.      XML program
                           r        NET) u                                  WebSphere      Integrates
                           k               e                                               with
                                              Client                                       ITCAM
                                           r Opt.                                          for TT
                                           y

     Color coding:                          optional

                     = OMEGAMON XE for DB2 PE V510
                     = DB2 for z/OS and DB2 Data Server drivers
                     = Tools (Optim pureQuery runtime and Optim Query [Workload] Tuner)
                     = IBM Tivoli Composite Application Monitoring
57                                                                                                      © 2011 IBM Corporation
Extended Insight Feature Summary
     Advanced way to monitor the database workload
     (SQL) of your applications and solutions
     – Get response times and time breakdown (appl, driver, network,
       data server) per defined workload/cluster, e.g. per system, per
       application, per user
     – Compare workload from various servers / applications
     – Select a time period for analysis
     – Get top SQL statements per defined workload
     – Identify top clients contributing in the workload
     – Zoom into the various layers

     Optional integration (- advantages) with
      – Optim Query (Workload) Tuner / Data Studio
      – pureQuery (Runtime while using Data capturing)
      – ITCAM for WebSphere applications accessing DB2 via JDBC


58                                                                © 2011 IBM Corporation
Thank You !




              © 2011 IBM Corporation
Backup




         © 2011 IBM Corporation
Resources

     pureQuery for DB2 for z/OS video
      – Improving ROI for existing applications
     http://www.ibm.com/developerworks/offers/lp/demos/summary/im-purequery4zos.html


     IBM InfoSphere Optim Development Studio
     http://www-01.ibm.com/software/data/optim/development-studio/


     IBM InfoSphere Optim pureQuery Runtime web page
     www.ibm.com/software/data/studio/purequery/


     Articles and tutorials covering the InfoSphere Optim portfolio
     http://www.ibm.com/developerworks/spaces/optim


     DB2 Connect Advanced edition
https://www.ibm.com/developerworks/mydeveloperworks/blogs/idm/entry/db2_connect_advanced_edition1?l
   ang=en_us



61                                                                                     © 2011 IBM Corporation
Contents of Eclipse-based Query Tuning offerings for zOS

                                   Data Studio   Optim Query Tuner   Optim Query Workload
                                                      for z/OS           Tuner for z/OS
     Queries from all sources           •                •                    •
     Reports                            •                •                    •
     Query Formatter                    •                •                    •
     Access Plan Graph                  •                •                    •
     Query Statistics Advisor           •                •                    •
     Query Annotation                                    •                    •
     Visual Plan Hint                                    •                    •
     Query Index Advisor                                 •                    •
     Query Advisor                                       •                    •
     Access Path Advisor                                 •                    •
     Workload Statistics Advisor                                              •
     Workload Index Advisor                                                   •
     Workload Query Advisor                                                   •



62                                                                            © 2011 IBM Corporation
OM PE V510 customer-driven requirements

                              Cancel remote threads
                              Identify CPU utilization for remote
                              threads
                              Report on DSN Activity for remote
                              threads
                              See DB2 Connect Server details for a
                              distributed thread originating on a remote
                              LPAR
                              See statement text for static SQL in
                              Application Trace
                              Support for SQL/PA V410
                              Launch “explain” tools: Optim Query
                              Workload Tuner as well as Data Studio
                              from OM PE



63                                                           © 2011 IBM Corporation
Improvements in OMPE, e.g. Reduced Overhead
     V510 shows strong improvements compared to V420


     – Moved more storage areas above the bar, resulting in relief below the
       bar ( 31bit private and ECSA)


     – Better management of background processing (code path reductions,
       better stack implementations)


     – Reduced overhead - using extended filtering and qualification (Classic and
       Tivoli Enterprise Portal)


     – Reduced the number of internal TCBs to lower private storage usage (
       Tivoli Enterprise Monitoring Agent)

     – New “out of the box VTAM profile” (basic monitoring to get started)

64                                                                     © 2011 IBM Corporation
Extended Insight Analysis Dashboard
     Page down to review the host Dynamic SQL statement cache metrics




                                       Data retrieved from the host
                                       Dynamic SQL Statement Cache




65                                                                    © 2011 IBM Corporation
Seek out any problems in end-to-end transaction path
           → use ITCAM for Transactions in the TEP console




      End-to-end
transaction paths can
be arbitrarily complex,                            Icon added and
    including many                                  provided with
 components: web &                                metrics by OMPE
   app servers, MQ                                Extended Insight
  comps, databases,                                    feature
       CICS, etc
66                                                    © 2011 IBM Corporation
Launch Extended Insight
Analysis dashboard GUI in
context of the troublesome
database transaction
either from topology view
                                           DB2 z/OS
or list box




                               Launch in context from
                               Launch in context from
                                 troublesome DB2
                                 troublesome DB2
                             transactions to Extended
                             transactions to Extended
                                 Insight Analysis
                                  Insight Analysis
                               Dashboard using the
                                Dashboard using the
                             “Database Diagnostics”
                              “Database Diagnostics”
67                                   context2011 IBM Corporation
                                     context link
                                          © link
“Launch in context” workspace with Extended Insight dashboard
                                     The browser is automatically
                                     positioned to the Extended
                                     Insight details dashboard for
                                     the specific transaction
                                     you selected in TEP. It
                                     knows the context because
                                     of the connection attributes




68                                                    © 2011 IBM Corporation

Weitere ähnliche Inhalte

Ähnlich wie Tools for developing and monitoring SQL in DB2 for z/OS

21st Century SOA
21st Century SOA21st Century SOA
21st Century SOABob Rhubart
 
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXInfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXIBMInfoSphereUGFR
 
Network Sage™ Into To C Level V1.4
Network Sage™ Into To C Level V1.4Network Sage™ Into To C Level V1.4
Network Sage™ Into To C Level V1.4ikirmer
 
21st Century Service Oriented Architecture
21st Century Service Oriented Architecture21st Century Service Oriented Architecture
21st Century Service Oriented ArchitectureBob Rhubart
 
Extending The Value Of Oracle Crm On Demand Through Cloud Based Extensibility
Extending The Value Of Oracle Crm On Demand Through Cloud Based ExtensibilityExtending The Value Of Oracle Crm On Demand Through Cloud Based Extensibility
Extending The Value Of Oracle Crm On Demand Through Cloud Based ExtensibilityJerome Leonard
 
DB2 for i 7.1 - Whats New?
DB2 for i 7.1 - Whats New?DB2 for i 7.1 - Whats New?
DB2 for i 7.1 - Whats New?COMMON Europe
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateNovell
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateNovell
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateNovell
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateNovell
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateNovell
 
Greenplum Database Overview
Greenplum Database Overview Greenplum Database Overview
Greenplum Database Overview EMC
 
Top 6 Reasons to Use a Distributed Data Grid
Top 6 Reasons to Use a Distributed Data GridTop 6 Reasons to Use a Distributed Data Grid
Top 6 Reasons to Use a Distributed Data GridScaleOut Software
 
Ebs operational reporting at santos evaluation, selection & implementation
Ebs operational reporting at santos evaluation, selection & implementationEbs operational reporting at santos evaluation, selection & implementation
Ebs operational reporting at santos evaluation, selection & implementationInSync Conference
 
Introduction to WebSphere Message Broker
Introduction to WebSphere Message BrokerIntroduction to WebSphere Message Broker
Introduction to WebSphere Message BrokerAnt Phillips
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOABob Rhubart
 

Ähnlich wie Tools for developing and monitoring SQL in DB2 for z/OS (20)

21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
 
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXInfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
 
Network Sage™ Into To C Level V1.4
Network Sage™ Into To C Level V1.4Network Sage™ Into To C Level V1.4
Network Sage™ Into To C Level V1.4
 
DBMS
DBMSDBMS
DBMS
 
354 ch1
354 ch1354 ch1
354 ch1
 
21st Century Service Oriented Architecture
21st Century Service Oriented Architecture21st Century Service Oriented Architecture
21st Century Service Oriented Architecture
 
Extending The Value Of Oracle Crm On Demand Through Cloud Based Extensibility
Extending The Value Of Oracle Crm On Demand Through Cloud Based ExtensibilityExtending The Value Of Oracle Crm On Demand Through Cloud Based Extensibility
Extending The Value Of Oracle Crm On Demand Through Cloud Based Extensibility
 
DB2 for i 7.1 - Whats New?
DB2 for i 7.1 - Whats New?DB2 for i 7.1 - Whats New?
DB2 for i 7.1 - Whats New?
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin Orchestrate
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin Orchestrate
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin Orchestrate
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin Orchestrate
 
Run Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin OrchestrateRun Book Automation with PlateSpin Orchestrate
Run Book Automation with PlateSpin Orchestrate
 
Greenplum Database Overview
Greenplum Database Overview Greenplum Database Overview
Greenplum Database Overview
 
It's time to optimize
It's time to optimizeIt's time to optimize
It's time to optimize
 
Top 6 Reasons to Use a Distributed Data Grid
Top 6 Reasons to Use a Distributed Data GridTop 6 Reasons to Use a Distributed Data Grid
Top 6 Reasons to Use a Distributed Data Grid
 
Ebs operational reporting at santos evaluation, selection & implementation
Ebs operational reporting at santos evaluation, selection & implementationEbs operational reporting at santos evaluation, selection & implementation
Ebs operational reporting at santos evaluation, selection & implementation
 
Introduction to WebSphere Message Broker
Introduction to WebSphere Message BrokerIntroduction to WebSphere Message Broker
Introduction to WebSphere Message Broker
 
Db trends final
Db trends   finalDb trends   final
Db trends final
 
21st Century SOA
21st Century SOA21st Century SOA
21st Century SOA
 

Mehr von Surekha Parekh

DB2 11 Technical Overview - John Campbell
DB2 11 Technical Overview - John CampbellDB2 11 Technical Overview - John Campbell
DB2 11 Technical Overview - John CampbellSurekha Parekh
 
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondA Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondSurekha Parekh
 
IBM Analytics Accelerator Trends & Directions Namk Hrle
IBM Analytics Accelerator  Trends & Directions Namk Hrle IBM Analytics Accelerator  Trends & Directions Namk Hrle
IBM Analytics Accelerator Trends & Directions Namk Hrle Surekha Parekh
 
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India)
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India) DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India)
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India) Surekha Parekh
 
DB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilityDB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilitySurekha Parekh
 
DB2 10 Smarter Database - IBM Tech Forum
DB2 10 Smarter Database   - IBM Tech ForumDB2 10 Smarter Database   - IBM Tech Forum
DB2 10 Smarter Database - IBM Tech ForumSurekha Parekh
 
Bank Data Frank Peterson DB2 10-Early_Experiences_pdf
Bank Data   Frank Peterson DB2 10-Early_Experiences_pdfBank Data   Frank Peterson DB2 10-Early_Experiences_pdf
Bank Data Frank Peterson DB2 10-Early_Experiences_pdfSurekha Parekh
 
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Surekha Parekh
 
DB2 for z/OS Update Data Warehousing On System Z
DB2 for z/OS Update Data Warehousing On System ZDB2 for z/OS Update Data Warehousing On System Z
DB2 for z/OS Update Data Warehousing On System ZSurekha Parekh
 
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OS
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OSWhat’s New For SQL Optimization In DB2 9 And DB2 10 For z/OS
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OSSurekha Parekh
 
DB2 9 for z/OS - Business Value
DB2 9 for z/OS  - Business  ValueDB2 9 for z/OS  - Business  Value
DB2 9 for z/OS - Business ValueSurekha Parekh
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data SharingSurekha Parekh
 

Mehr von Surekha Parekh (12)

DB2 11 Technical Overview - John Campbell
DB2 11 Technical Overview - John CampbellDB2 11 Technical Overview - John Campbell
DB2 11 Technical Overview - John Campbell
 
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and BeyondA Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller’s Guide to DB2: Technology Themes for 2014 and Beyond
 
IBM Analytics Accelerator Trends & Directions Namk Hrle
IBM Analytics Accelerator  Trends & Directions Namk Hrle IBM Analytics Accelerator  Trends & Directions Namk Hrle
IBM Analytics Accelerator Trends & Directions Namk Hrle
 
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India)
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India) DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India)
DB2 10 Migration Planning & Customer experiences - Chris Crone (IDUG India)
 
DB2 Design for High Availability and Scalability
DB2 Design for High Availability and ScalabilityDB2 Design for High Availability and Scalability
DB2 Design for High Availability and Scalability
 
DB2 10 Smarter Database - IBM Tech Forum
DB2 10 Smarter Database   - IBM Tech ForumDB2 10 Smarter Database   - IBM Tech Forum
DB2 10 Smarter Database - IBM Tech Forum
 
Bank Data Frank Peterson DB2 10-Early_Experiences_pdf
Bank Data   Frank Peterson DB2 10-Early_Experiences_pdfBank Data   Frank Peterson DB2 10-Early_Experiences_pdf
Bank Data Frank Peterson DB2 10-Early_Experiences_pdf
 
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
Gain Insight Into DB2 9 And DB2 10 for z/OS Performance Updates And Save Cost...
 
DB2 for z/OS Update Data Warehousing On System Z
DB2 for z/OS Update Data Warehousing On System ZDB2 for z/OS Update Data Warehousing On System Z
DB2 for z/OS Update Data Warehousing On System Z
 
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OS
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OSWhat’s New For SQL Optimization In DB2 9 And DB2 10 For z/OS
What’s New For SQL Optimization In DB2 9 And DB2 10 For z/OS
 
DB2 9 for z/OS - Business Value
DB2 9 for z/OS  - Business  ValueDB2 9 for z/OS  - Business  Value
DB2 9 for z/OS - Business Value
 
DB2 for z/O S Data Sharing
DB2 for z/O S  Data  SharingDB2 for z/O S  Data  Sharing
DB2 for z/O S Data Sharing
 

Kürzlich hochgeladen

DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 

Kürzlich hochgeladen (20)

DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 

Tools for developing and monitoring SQL in DB2 for z/OS

  • 1. Managing the Performance of Your IBM DB2 z/OS Applications by Using IBM InfoSphere Optim Solutions Peter Schouboe, IBM SWG Nordic Norbert Jenninger, IBM © 2011 IBM Corporation
  • 2. Disclaimer © Copyright IBM Corporation 2010. All rights reserved. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS” WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS AND/OR SOFTWARE. IBM, the IBM logo, ibm.com, Optim, InfoSphere, pureQuery, and Data Studio are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml Other company, product, or service names may be trademarks or service marks of others. 1 © 2011 IBM Corporation
  • 3. Performance Issues Performance issues – main areas – Program • Number of file / database trips • DataChecks - Commitpoints File Input • Internal data manipulation • Complex calculations User – Transaction Managers Interface • Number of threads / active users vs. Region sizes Program File Output • Transaction mgmt protocol Batch – Database control • Optimized database design • Index use vs. Direct data access • Advanced vs simple SQL Optimizer / Access Plan • Database Optimizer help – Communication • Number of trips to database Database Input/Output • Amount of data shipped • Number of threads Main components to watch for performance reasons: Operating Systems – Transaction Managers – Database System – Program language compilers – Physical devices / box, connector, memory etc... 2 © 2011 IBM Corporation
  • 4. Application development on System z – old school ☺ Traditional Mainframe Developing for performance relies development on 2 min factors: zOS Application Server – Monitors for each main component ------ ------ ------ ------ • Transactions, Batch jobs, ------- ------ Databases, Operating system - – AddressSpace Monitors • SQL monitors TSO CICS / IMS TM Batch – Advise for optimization Applications • App. Analyzers Assembler, COBOL, PL1, Rexx, ISPF ++ • Explain (DB2 Optimizer Guess) DB2 / IMS DB File System Complicated enough, but all inside one known box, under one ruleset – the zOS / MVS . MVS Complications mainly from, - system & core sw. upgrades - database changes - physical improvements zOS 3 © 2011 IBM Corporation
  • 5. Optimizing SQL – The process EXPLAIN PLAN TABLE DB2 DB2 DB2 Data Catalog Optimizer SQL Runstat Report 4 © 2011 IBM Corporation
  • 6. Today, The IT model looks different … Real-time event-driven workloads, richer content, and modular technologies alter the composition of systems and how systems are deployed as well as managed Web Servers System z SSL/XML Security/Directory Appliances Servers Application Servers Routers Switches File/Print Application & Data Servers Servers DS Servers Caching Firewall Appliances Servers LAN Servers Application software and middleware is deing deployed on several platforms Much more complicated to monitor and optimize. New, and different methods needs to be considered when developing, monitoring and optimizing applications. CICS App server Client App WEB Server DB2 5 © 2011 IBM Corporation
  • 7. Object oriented versus Relational The built-in original conflict Persistence Layers Business Object DB2 Customer Reuse = Development Speed Object in use Business Object: Customer Object Oriented Field1 = Variable1, default <empty> Java application(s) Field2 = Variable2, default <empty> Field3 = Variable3, default <empty> Etc... So – use the fields as needed... © 2011 IBM Corporation
  • 8. Issues in the Optimization process Explain requires that you have access to /can find the code – It requires that you have access to the SQL – Many times it’s very hard to predict dynamic SQL Explain will not advise on how to change program / SQL Explain bases itself on known Index structures (Fix ?Virtual Index, 8, 9 & 10) Explain does not cover trips across the Net Explain does not help minimize data shipped Explain needs access to production statistics....(Fixed in DB2 10 ☺ !!) It’s easy to type errors, and do you know your data ? Testing corrections is difficult The problem of introducing rewrites – Price of corrections grows the later you have to change.... It’s becomming still harder to figure out if there is an issue, and where you need to optimize. 7 © 2011 IBM Corporation
  • 9. Other Issues – Dynamic vs. Static SQL Dynamic SQL is to development what Chokolade is to a child.... – It’s quick... – It solves your problem... – It comes in many forms and shapes... • But .... It’s not going to help meet diet goals It will ’cheat’ the system burn-rates And – if left alone..... 8 © 2011 IBM Corporation
  • 10. Difference between “healthy food” and “chokolate”…. Dynamic SQL Static SQL Check authorization for JDBC Check authorization for packages/plans packages/plans for temporary use Parse SQL statements Check authorization for tables/views Extract access paths from SYSCAT.PACKAGES and .STATEMENTS Calculate access paths Store access paths temporary in JDBC packages/plans Execute SQL statements Execute SQL statements DB2 will reuse SQL from dynamic statement cache I SQL is bound into a package beforehand. All SQL parsing and possible. New feature “&” in DB2 10 will help. initial optimization work is done ahead of time and only once. Alternatively using “?” parameter markers rather than Literals Statements are fully optimized during execution. will enable reuse. Still – sheer number of threads might flush statement from the dynamic cache….. 9 © 2011 IBM Corporation
  • 11. Management Issues with dynamic SQL... Every statement potentially fires – Prepare, Bind, Execute All uses same Plan/User/Authority Access needs to be granted on DB2 Tables/Views Litteral vs Parameter markers (better in DB2 10) Hard to find specific SQL 10 © 2011 IBM Corporation
  • 12. IBM Tools to support the optimization process z/OS / ISPF: SQL performance Analyzer z/OS / GUI: Data Studio (free) – Visual Explain – SQL Editor – Statistics Advisor z/OS / GUI: Infosphere Optim Development Studio Infosphere Optim pureQuey Infosphere Optim Query(Workload)Tuner z/OS / GUI: Omegamon for DB2 PE Extended Edition 11 © 2011 IBM Corporation
  • 13. Develop Editing, Testing and Optimizing SQL with Development Studio ment Studio SQL sensitive Editor Compare performance data of various versions Visualize of your application application SQL Visualize execution metrics Correlate with data source attributes Execute, tune, share, trace, explore SQL 12 © 2011 IBM Corporation
  • 14. Reduce trips across net to data pureQuery - Heterogenous Batching Network Users Table 1, operation 1 Table 1, operation 2 Table 1, operation 3 Table 2, operation 1 Table 2, operation 2 Table 1, operation 4 DBMS Application Table 3, operation 1 Servers The advantage of Heterogenous Batching 500 Elapsed Time (mSec) Heterogenous Batching – 400 Multiple operations across 300 different tables all execute as HeteroBatching one batch 200 No Batching JDBC Batching 100 0 0 20 40 60 80 100 # of operations per transaction 13 © 2011 IBM Corporation
  • 15. Finding the SQL/Program 2… pureQuery Managing already developed Applications Runtime Monitor Monitor – Review performance – Analyze hotspots Capture Capture – Capture performance and application metadata Optimize Review Optimize Restrict – Review and share SQL • Visualize hotspots • Analyze impacts from schema changes • Trace SQL to originating source – Optimize and replace SQL Configure Bind – Create approved SQL list Deploy – Configure execution properties – Optionally bind for static execution Execute 14 © 2011 IBM Corporation
  • 16. Using pureQuery in development & Production... Up front development vs. After the fact You decide at runtime.... – (Dynamic/Static/Mix) DB2 / Oracle / Informix 15 © 2011 IBM Corporation
  • 17. Find the SQL and the program using pureQuery pureQuery pureQuery AppServer DB2 Connect Optim Development Studio PQ APi DB2 for LUW PQ web Runtime DB2 for z/OS DS1 application Client DS2 Static SQL Packages applications Any Application Server Java Stand-alone PQ application Runtime Client tier Application tier Database tier 16 © 2011 IBM Corporation
  • 18. So – does this support ......? © 2011 IBM Corporation
  • 19. Develop Editing, Testing and Optimizing SQL with Development Studio ment Studio Execute, tune, share, trace, explore SQL 18 © 2011 IBM Corporation
  • 20. Data Studio QueryTuner Visual Explain – Pictures talks… Visualize access path – See flow of query processing – See indexes and operations – See optimizer rationale 19 © 2011 IBM Corporation
  • 21. Data Studio Figure out what triggers Explain/DB2 Optimizer QueryTuner New! Repair and Complete Control Statements Provides advice on – Missing statistics – Conflicting statistics Generates RUNSTATS – Out-of-date statistics control statements Indicates conflicting and missing statistics Results – Accurate estimated costs – Better query performance – Less CPU consumption – Improved maintenance window throughput Conflicting “Half of access path PMRs could be statistics resolved by statistics advisor before explanation calling IBM support.” – IBM Support 20 © 2011 IBM Corporation
  • 22. Query Improve Query Design Tuner Guard against errors and oversights: View analysis Further constrain query, summary increase index utilization, and reduce data reads Highlights relevant components of the query Filter recommendations by severity Query Advisor checks for Recommendation – Missing join predicate for referential constraint and rationale – Predicates that can be rewritten as indexable – Stage 2 predicates that can be rewritten as stage 1 predicates 21 © 2011 IBM Corporation
  • 23. Query Visualize Queries and Costs to Speed Analysis Tuner Easily see tables, sections, join Examine table predicates, etc. statistics and additional information Accelerate analysis, reduce downtime – Spot human errors – Identify where filtering should occur 22 © 2011 IBM Corporation
  • 24. Improve performance Query Tuner 23 © 2011 IBM Corporation
  • 25. Optimizing programs & SQL in distributed world…. A high-performance, data access platform to simplify developing, managing, securing, and optimizing data access. Infosphere Optim pureQuery - Simple and intuitive API – Enables SQL access to databases or in-memory Java objects – Enables high Batching (fewer trips on the net) – Collects run statistics in central database – Runtime option enables flexible SQL deployment for DB2 Infosphere Optim Development Studio – Integrated development environment with Java and SQL support – Improve problem isolation and impact analysis Infosphere Optim Query Workload Tuner – Optimize application performance and reduce costs – The power of advisors 24 © 2011 IBM Corporation
  • 26. Tivoli So – finding the problem origin….. Omegamon … OMEGAMON XE for Mainframe Networks / for zNetview OMEGAMON XE for CICS OMEGAMON XE for IMS DB2 OMEGAMON XE DB2 SQL PA for DB2 PE Query Monitor DB2 Extended Insight Path Checker Feature Optim Query (Workload) Tuner Data Studio Optim Performance Manager OMEGAMON Information Management XE for z/OS => DWL or additionally using Tools OMEGAMON DE (Dashboard Edition) ITCAM 25 …. © 2011 IBM Corporation
  • 27. Performance Monitoring and Tuning OMEGAMON XE for DB2 Performance Expert on z/OS Norbert Jenninger © 2011 IBM Corporation
  • 28. Omegamon for DB2 - Newest Versions Version 510 - GA 10/22/2010 • OMEGAMON XE for DB2 Performance Expert on z/OS V510 * • OMEGAMON XE for DB2 Performance Monitor on z/OS V510 * • DB2 Buffer Pool Analyzer for z/OS V510 – Key Content of these new versions • Full “Exploitation” Support for DB2 10 • Additional customer-driven requirements (Improved Data Sharing Support) • Reduced CPU and storage consumption • New Extended Insight allows monitoring an application and SQL “end-to-end” (*) We will use OMPE and OMPM as abbreviation in this presentation 27 © 2011 IBM Corporation
  • 29. OMEGAMON V510 – complete DB2 10 support Support for approximately 30 DB2 Line-items and change requests: – SMF compression – ACCOUNTING • Separation of Lock and Latch wait times • More granularity on package level although ACCUMAC >1 is used • Accounting roll-up changes DB2 10 beta: More than twenty DB2 10 beta • Distributed threads accounting customers have downloaded and used OM PE – STATISTICS V510 • IFCID 225 (memory) changes • Multiple IFCID 2 for each 25 buffer pools (>25 buffer pool usage) OMEGAMON beta: OM PE V510 beta • DSC enhancements including static customers tested OM PE with DB2 V8, 9, and SQL 10 • EDM Pool and other working memory moved above the bar – New and updated ZPARMs – PERFORMANCE traces – Audit trace changes • Row-level and Column-level access control • New DBA privileges 28 © 2011 IBM Corporation
  • 30. Latest News: New Function PTF UK65924 / APAR PM35049 Near-Term History now with zIIP off-load plus improved precision in NTH CPU filter ATF display new DB2 10 metrics for CLOSE CURSOR Reporting – SQL Activity Trace shows new DB2 10 metrics for CLOSE CURSOR Static/Dynamic, Sync buff reads, Getpages, Indexscan, TS scan, rows exam., rows proc., sorts, buffer writes, …. – Audit TRACE and REPORT supports new IFCID 271. Data related to objects ROW PERMISSION and COLUMN MASK are shown – Record Trace show new V10 (after GA DCR) instrumentation – New System Parameter Performance DB (INTEGER to DECMIAL, extend fields to avoid overflow) New PE client driver (Display Static SQL cache) plus couple of internal fixes … 29 © 2011 IBM Corporation
  • 31. So - where is my problem? => End-to-end monitoring with SQL level deep dive - Extended Insight DB2 for z/OS ITCAM for Transactions End-to-End SQL monitoring IBM Tivoli OMEGAMON XE for ITCAM IBM Tivoli DB2 Performance Expert on z/OS for WebSphere Monitoring (ITM) details … tells me which application it is, and ultimately which business function … where I can measure what my application/user is really experiencing. Tells me which components are involved and where my application/SQL is spending its time … tells me where the SQL statement is coded and let’s me change it if 30 necessary © 2011 IBM Corporation
  • 32. DB2 Performance metrics (Trace records – Trace types) Legacy workload: Distributed workload: Cobol, Batch Internet, WAS, Java CICS, OLTP Data Warehouse API Snapshot Data Event Trace Data START TRACE (MON) e.g. START TRACE via ZPARMS ST FI . AR RE S . AD I T or TR RE via monitor SMF / AC program AD I IF E GTF A … 31 © 2011 IBM Corporation
  • 33. DB2 Metrics / Instrumentation data and their usage Real-Time VTAM DB2 snapshot IFI API (READS) Monitor / ISPF (synchronous) Data Collector / GUI trace data DB2 Hook into DB2, Save materialized data control direct access to control blocks, in storage or on disk space blocks PDB PWH DB2 LOAD SMF DB2 event FILE SAVE (asynchronous) trace data GTF Historical OP- buffer Reporting Sequential Monitor Collector File IFI API (READA) Program NTH, CRD ATF VTAM VSAM (NTH, ATF) 32 © 2011 IBM Corporation
  • 34. Still one major pain point - What is happening outside of DB2? (e.g. with remote applications) z/OS OMPE STC (data collector) DB2 for z/OS TEP Classic, CUA, PE client N Data Appl. e Server Server Drivers t w (JCC, Application o CLI,. program e.g. r NET) WebSphere k 33 © 2011 IBM Corporation
  • 35. Where is my DB2 application spending its time? OMEGAMON PE’s Extended Insight is an advanced way to monitor the database workload (SQL) of your applications and solutions – Get total response times and response time breakdown (appl, driver, network, data server) per defined workload/cluster (e.g. per system, application, user) – Compare workload from various servers / applications – Select a time period for analysis – Get top SQL statements per defined workload User User experience – Identify top clients contributing App pre- and post-processing in the workload Application transaction SQL 1 SQL 2 COMMIT WebSphere or Java App Server Extended Insight is available with JCC driver the Performance Expert Offering Network only DB2 Operating System 34 © 2011 IBM Corporation
  • 36. Can run as How does it work? Linux, zLinux, Unix, Windows stand-alone web UI z/OS Repository OMPE STC Database (data collector) DB2 for z/OS Integrated into OMPE TEP TEP (web) Classic, CUA, workspace PE client EI Client Software N Data Appl. e Server Server Drivers t w (JCC, Application o CLI,. program e.g. r NET) WebSphere k Color coding: = OMEGAMON XE for DB2 PE V510 = DB2 for z/OS and DB2 Data Server drivers 35 © 2011 IBM Corporation
  • 37. How to start and navigate to the Extended Insight dashboard Seamless navigation depending on the usage/problem scenario … 1. Integration and navigation to Extended Analysis Dashboard as part of new OMEGAMON XE for DB2 PE on z/OS (OMPE) TEP workspace 2. As a stand-alone web console session 3. Integrated with ITCAM and navigation to Extended Analysis Dashboard 36 © 2011 IBM Corporation
  • 38. OMPE on z/OS TEP Navigation to the Extended Insight Analysis Dashboard Navigation to the OMPE workspace with the E2E SQL monitoring information 37 © 2011 IBM Corporation
  • 39. OMPE on z/OS TEP Navigation to the Extended Insight Analysis Dashboard 38 © 2011 IBM Corporation
  • 40. Optim Performance Manager Web Console with Health Summary and navigation to Extended Insight Dashboard OMEGAMON XE for DB2 PE on z/OS reuses the Optim Performance Manager Extended Insight monitoring capability.. Health Summary and Extended Insight Dashboard are enabled for monitoring of SQL access DB2 for z/OS. Navigate to Extended Insight Analysis Dashboard for E2E SQL monitoring => 39 © 2011 IBM Corporation
  • 41. Extended Insight Analysis Dashboard The slider bar allows selection of the time period to be considered Overview and comparison of “Workload cluster groups” but also on details with the capability to select and further zoom in. 40 © 2011 IBM Corporation
  • 42. Extended Insight Analysis Dashboard Define your “Workload cluster groups” as you need 41 © 2011 IBM Corporation
  • 43. Extended Insight Analysis Dashboard Define your “Workload cluster groups” as you need 42 © 2011 IBM Corporation
  • 44. Setting Client information - Samples DB2ConnectionPoolDataSource ds = new DB2ConnectionPoolDataSource(); ds.setUser("myuser"); ds.setPassword("mypass"); ds.setDatabaseName("mydb"); ds.setConnectionAttribute ("ClientApplName=WebSphere-Samples; ClientWrkstnName=WebSphere-Wkstn; ClientUserid=WebSphere-User ClientAcctStr=WebSphere-Acctstr"); PooledConnection poolconn = ds.getPooledConnection(); con = poolconn.getConnection(); WhitePaper: http://www.ibm.com/developerworks/data/library/techarticle/0212shayer/0212shayer.html © 2011 IBM Corporation
  • 45. Reported on the DB2 for z/OS Accounting report, for example ACCOUNTING REPORT FROM (04-01-13 ,13:42) TO (04-01-13 ,13:50) ORDER (ENDUSER-WSNAME-TRANSACT) INCLUDE (WSNAME(WORKSTATNAME)) EXEC or in a DB2 “DISPLAY THREAD ….” command output 44 © 2011 IBM Corporation
  • 46. Extended Insight Analysis Dashboard Expand to more details, e.g. expand user data and application data 45 © 2011 IBM Corporation
  • 47. Extended Insight Analysis Dashboard Expand to more details, e.g. expand user data and application data 46 © 2011 IBM Corporation
  • 48. Extended Insight Analysis Dashboard Show additional graphs for selected workload clusters 47 © 2011 IBM Corporation
  • 49. Extended Insight Analysis Dashboard Show response time histogram for selected workload Click to show response time histogram 48 © 2011 IBM Corporation
  • 50. Extended Insight Analysis Dashboard Zoom into selected workload and see the TOP SQL list Shows top SQL statements executed by distributed Java or CLI applications like SQW, SAP, Cognos, DataStage, or WebSphere. Zoom in (double click) on a selected SQL in question 49 © 2011 IBM Corporation
  • 51. Extended Insight Analysis Dashboard Select SQL from list and zoom into SQL level details Launch Optim Query (workload) Tuner (or Data Studio) to explain and tune the selected SQL statement 50 © 2011 IBM Corporation
  • 52. Extended Insight Analysis Dashboard Select SQL from list and zoom into SQL level details Java class / - package / method, etc. shown if pureQuery Is installed. ==> next 2 slides 51 © 2011 IBM Corporation
  • 53. How pureQuery Runtime can help ! Extended Insight feature can tell you where the query came from … Application source Capture SQL with pureQuery runtime Upload collected metadata into OPM SELECT * FROM DB2ADMIN.I… SELECT * FROM DB2ADMIN.INVENTORY TestOPM my.test main 13 blahVer N/P N/P blah capture… 52 © 2011 IBM Corporation
  • 54. How pureQuery Runtime can help ! Extended Insight feature can tell you where the query came from … Application source Capture SQL with pureQuery runtime Upload collected metadata into OPM SELECT * FROM DB2ADMIN.I… SELECT * FROM DB2ADMIN.INVENTORY TestOPM my.test main 13 blahVer N/P N/P blah capture… 53 © 2011 IBM Corporation
  • 55. Extended Insight Analysis Dashboard Select a plot area and see the corresponding performance metrics Click on plot area (data server time) to select … for data server times and transaction throughput Click on plot area (network time) to select … for network times and throughput 54 © 2011 IBM Corporation
  • 56. WebSphere – another area to be monitored in context WebSphere support has a built-in support for OPM (starting with WAS V6.0.21), allowing to ... • identify problems with WAS connection pool • identify differences in the configuration of nodes in a WAS cluster • check if a node in a WAS cluster has a system or network problem 47 57.67 47 57.67 52 0.34 55 © 2011 IBM Corporation
  • 57. Where is my DB application spending its time? e.g. in application, SQL, and network? Drill down to ITCAM for Transactions Drill down to Performance Manager •Deep on end-to-end transaction path ITCAM WR / ITM •Hand-off to Optim, ITCAM, ITM for diagnose / repair User User experience ITCAM for WebSphere • Deep on application / App pre- and post-processing web server, J2EE / web app, web resources Application transaction • Shallow on JCC driver, SQL 1 SQL 2 COMMIT database app for sensing problems, then OM DB2 PE with hand-off to Optim Extended Insight WebSphere or Performance Manager • Deep on Database, Java App Server for diagnose / repair JCC driver, etc • Shallow on JCC driver network, OS, app server for sensing problems then ITM for Servers hand-off to ITM for Network • Deep on OS, Network, Servers to diagnose Storage, I/O, etc / repair • Shallow on database Database for sensing problems then hand-off to Optim Operating Performance Manager System for diagnose / repair Drill down to ITCAM WR / ITM Drill down to Optim Performance Manager 56 © 2011 IBM Corporation
  • 58. Omegamon for DB2 Architecture Summary: Can run as stand-alone An integrated solution and how it is packaged web UI z/OS Linux, zLinux, Unix, Windows OMPE STC Repository (data collector) Database DB2 for Optim Query (Workload) Tuner z/OS Integrated into OMPE y l it TEP (web) Uti workspace p EI Client u Software Data Appl. N Server r e Server t Drivers e w (JCC, Q Application e.g. o CLI,. XML program r NET) u WebSphere Integrates k e with Client ITCAM r Opt. for TT y Color coding: optional = OMEGAMON XE for DB2 PE V510 = DB2 for z/OS and DB2 Data Server drivers = Tools (Optim pureQuery runtime and Optim Query [Workload] Tuner) = IBM Tivoli Composite Application Monitoring 57 © 2011 IBM Corporation
  • 59. Extended Insight Feature Summary Advanced way to monitor the database workload (SQL) of your applications and solutions – Get response times and time breakdown (appl, driver, network, data server) per defined workload/cluster, e.g. per system, per application, per user – Compare workload from various servers / applications – Select a time period for analysis – Get top SQL statements per defined workload – Identify top clients contributing in the workload – Zoom into the various layers Optional integration (- advantages) with – Optim Query (Workload) Tuner / Data Studio – pureQuery (Runtime while using Data capturing) – ITCAM for WebSphere applications accessing DB2 via JDBC 58 © 2011 IBM Corporation
  • 60. Thank You ! © 2011 IBM Corporation
  • 61. Backup © 2011 IBM Corporation
  • 62. Resources pureQuery for DB2 for z/OS video – Improving ROI for existing applications http://www.ibm.com/developerworks/offers/lp/demos/summary/im-purequery4zos.html IBM InfoSphere Optim Development Studio http://www-01.ibm.com/software/data/optim/development-studio/ IBM InfoSphere Optim pureQuery Runtime web page www.ibm.com/software/data/studio/purequery/ Articles and tutorials covering the InfoSphere Optim portfolio http://www.ibm.com/developerworks/spaces/optim DB2 Connect Advanced edition https://www.ibm.com/developerworks/mydeveloperworks/blogs/idm/entry/db2_connect_advanced_edition1?l ang=en_us 61 © 2011 IBM Corporation
  • 63. Contents of Eclipse-based Query Tuning offerings for zOS Data Studio Optim Query Tuner Optim Query Workload for z/OS Tuner for z/OS Queries from all sources • • • Reports • • • Query Formatter • • • Access Plan Graph • • • Query Statistics Advisor • • • Query Annotation • • Visual Plan Hint • • Query Index Advisor • • Query Advisor • • Access Path Advisor • • Workload Statistics Advisor • Workload Index Advisor • Workload Query Advisor • 62 © 2011 IBM Corporation
  • 64. OM PE V510 customer-driven requirements Cancel remote threads Identify CPU utilization for remote threads Report on DSN Activity for remote threads See DB2 Connect Server details for a distributed thread originating on a remote LPAR See statement text for static SQL in Application Trace Support for SQL/PA V410 Launch “explain” tools: Optim Query Workload Tuner as well as Data Studio from OM PE 63 © 2011 IBM Corporation
  • 65. Improvements in OMPE, e.g. Reduced Overhead V510 shows strong improvements compared to V420 – Moved more storage areas above the bar, resulting in relief below the bar ( 31bit private and ECSA) – Better management of background processing (code path reductions, better stack implementations) – Reduced overhead - using extended filtering and qualification (Classic and Tivoli Enterprise Portal) – Reduced the number of internal TCBs to lower private storage usage ( Tivoli Enterprise Monitoring Agent) – New “out of the box VTAM profile” (basic monitoring to get started) 64 © 2011 IBM Corporation
  • 66. Extended Insight Analysis Dashboard Page down to review the host Dynamic SQL statement cache metrics Data retrieved from the host Dynamic SQL Statement Cache 65 © 2011 IBM Corporation
  • 67. Seek out any problems in end-to-end transaction path → use ITCAM for Transactions in the TEP console End-to-end transaction paths can be arbitrarily complex, Icon added and including many provided with components: web & metrics by OMPE app servers, MQ Extended Insight comps, databases, feature CICS, etc 66 © 2011 IBM Corporation
  • 68. Launch Extended Insight Analysis dashboard GUI in context of the troublesome database transaction either from topology view DB2 z/OS or list box Launch in context from Launch in context from troublesome DB2 troublesome DB2 transactions to Extended transactions to Extended Insight Analysis Insight Analysis Dashboard using the Dashboard using the “Database Diagnostics” “Database Diagnostics” 67 context2011 IBM Corporation context link © link
  • 69. “Launch in context” workspace with Extended Insight dashboard The browser is automatically positioned to the Extended Insight details dashboard for the specific transaction you selected in TEP. It knows the context because of the connection attributes 68 © 2011 IBM Corporation