1. Front cover
Implementing Tivoli
Data Warehouse 1.2
A primer for deployments of any size
and proof of concepts
Latest Version 1.2 features
including Crystal Enterprise
Warehouse enablement
pack case studies
Edson Manoel
Cristiano Colantuono
Hans-Georg Köhne
Devi Raju
Ghufran Shah
Sergio Henrique Soares Monteiro
ibm.com/redbooks

3. International Technical Support Organization
Implementing Tivoli Data Warehouse 1.2
June 2004
SG24-7100-00

4. Note: Before using this information and the product it supports, read the information in
“Notices” on page xix.
First Edition (June 2004)
This edition applies to Version 1.2 of the Tivoli Data Warehouse product.
© Copyright International Business Machines Corporation 2004. All rights reserved.
Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP
Schedule Contract with IBM Corp.

5. Contents
Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
Examples. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
The team that wrote this redbook. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Become a published author . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Part 1. Fundamentals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Chapter 1. Introducing Tivoli Data Warehouse 1.2. . . . . . . . . . . . . . . . . . . . 3
1.1 Data warehousing basics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1.1 Data warehouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1.2 Data mart . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.1.3 Business intelligence. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.1.4 Data mining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.2 Tivoli Data Warehouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.3 What is new in Tivoli Data Warehouse 1.2 . . . . . . . . . . . . . . . . . . . . . . . . 10
1.3.1 Crystal Enterprise™ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
1.3.2 IBM DB2 UDB for OS/390 and z/OS support . . . . . . . . . . . . . . . . . . 13
1.3.3 Flexible and extended configuration support . . . . . . . . . . . . . . . . . . 17
1.3.4 Installation enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
1.3.5 Serviceability and scalability improvements . . . . . . . . . . . . . . . . . . . 19
1.4 Tivoli Data Warehouse architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
1.4.1 Tivoli Data Warehouse control center server . . . . . . . . . . . . . . . . . . 21
1.4.2 Source databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
1.4.3 Central data warehouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
1.4.4 Data marts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
1.4.5 Warehouse agents and agent sites. . . . . . . . . . . . . . . . . . . . . . . . . . 22
1.4.6 Crystal Enterprise Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
1.5 Benefits of using Tivoli Data Warehouse . . . . . . . . . . . . . . . . . . . . . . . . . 23
Chapter 2. Planning for Tivoli Data Warehouse 1.2 . . . . . . . . . . . . . . . . . . 27
© Copyright IBM Corp. 2004. All rights reserved. iii

6. 2.1 Hardware and software requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.1.1 Hardware requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.1.2 Software requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
2.1.3 Database requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.1.4 Crystal Enterprise requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.2 Physical and logical design considerations . . . . . . . . . . . . . . . . . . . . . . . . 36
2.2.1 Source databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
2.2.2 Control server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
2.2.3 Central data warehouse . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
2.2.4 Data marts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
2.2.5 Single machine installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
2.2.6 Distributed deployment on UNIX and Windows servers . . . . . . . . . . 43
2.2.7 Distributed deployment on z/OS, UNIX, and Windows servers . . . . 45
2.2.8 Warehouse agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
2.2.9 Considerations about warehouse databases on z/OS . . . . . . . . . . . 54
2.2.10 Coexistence with other products . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
2.2.11 Selecting port numbers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
2.3 Database sizing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
2.4 Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
2.4.1 Authority required to install and maintain IBM DB2 UDB . . . . . . . . . 57
2.4.2 Authority required to install Tivoli Data Warehouse . . . . . . . . . . . . . 57
2.4.3 Firewalls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
2.4.4 Controlling access to data in the warehouse . . . . . . . . . . . . . . . . . . 59
2.4.5 Protecting information in Crystal Enterprise Professional for Tivoli . 59
2.4.6 Multicustomer and multicenter support . . . . . . . . . . . . . . . . . . . . . . . 60
2.5 Network traffic considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
2.5.1 Architectural choices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
2.5.2 Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
2.6 Integration with other business intelligence tools . . . . . . . . . . . . . . . . . . . 64
2.7 ETL development . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
2.8 Skills required for a Tivoli Data Warehouse project . . . . . . . . . . . . . . . . . 67
2.8.1 Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
2.8.2 Data collection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
2.8.3 Data manipulation (ETL1 and ETL2). . . . . . . . . . . . . . . . . . . . . . . . . 68
2.8.4 Reporting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Chapter 3. Getting Tivoli Data Warehouse 1.2 up and running. . . . . . . . . 71
3.1 Preparing for the installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
3.1.1 Ensuring fully qualified host names. . . . . . . . . . . . . . . . . . . . . . . . . . 74
3.1.2 Installing and configuring IBM DB2 client and server . . . . . . . . . . . . 76
3.1.3 Crystal Enterprise installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
3.2 Tivoli Data Warehouse 1.2 installation . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
3.3 Quick start deployment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
iv Implementing Tivoli Data Warehouse 1.2

7. 3.3.1 Quick start deployment: installation and configuration . . . . . . . . . . . 94
3.3.2 Configuring the control database . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
3.3.3 Creating ODBC connections to the data mart databases . . . . . . . . 101
3.4 Distributed deployment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
3.4.1 Distributed deployment installation: Windows and UNIX . . . . . . . . 104
3.4.2 Distributed deployment installation: z/OS . . . . . . . . . . . . . . . . . . . . 115
3.4.3 Creating ODBC connections to the data mart databases . . . . . . . . 123
3.5 Installing warehouse agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
3.5.1 Installing IBM DB2 Warehouse Manager . . . . . . . . . . . . . . . . . . . . 128
3.5.2 Creating the remote agent sites . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
3.6 Verification of the installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 135
3.6.1 Verifying the remote agent install . . . . . . . . . . . . . . . . . . . . . . . . . . 141
3.7 Installing warehouse enablement packs . . . . . . . . . . . . . . . . . . . . . . . . . 142
Chapter 4. Performance maximization techniques . . . . . . . . . . . . . . . . . 145
4.1 DB2 performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146
4.2 Operating system performance tuning . . . . . . . . . . . . . . . . . . . . . . . . . . 150
4.2.1 Windows environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150
4.2.2 Primary Windows performance factors . . . . . . . . . . . . . . . . . . . . . . 151
4.2.3 AIX environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
4.3 Tivoli Data Warehouse performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . 155
Part 2. Case study scenarios . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Chapter 5. IBM Tivoli NetView Warehouse Enablement Pack . . . . . . . . . 161
5.1 Case study overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162
5.2 IBM Tivoli NetView WEP overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
5.3 Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
5.3.1 Verifying prerequisites. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
5.3.2 Gathering installation information . . . . . . . . . . . . . . . . . . . . . . . . . . 166
5.4 Preparing NetView for data collection . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
5.4.1 Enabling NetView to export data for Tivoli Data Warehouse . . . . . 167
5.4.2 NetView SmartSets configuration . . . . . . . . . . . . . . . . . . . . . . . . . . 170
5.4.3 Configuring NetView Data Warehouse daemon (tdwdaemon) . . . . 176
5.4.4 Verifying NetView data collection enablement . . . . . . . . . . . . . . . . 178
5.5 Installation of the NetView WEPs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181
5.5.1 Backing up the TDW environment . . . . . . . . . . . . . . . . . . . . . . . . . 181
5.5.2 Establishing ODBC connections . . . . . . . . . . . . . . . . . . . . . . . . . . . 182
5.5.3 Installing NetView Enablement Pack Software . . . . . . . . . . . . . . . . 185
5.5.4 Defining the authority to the warehouse sources and targets . . . . . 188
5.6 Testing, scheduling, and promoting the ETLs . . . . . . . . . . . . . . . . . . . . . 191
5.6.1 Promoting the ETLs to TEST mode . . . . . . . . . . . . . . . . . . . . . . . . 192
5.6.2 Testing the ETLs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
5.6.3 Scheduling the ETLs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
Contents v

8. 5.6.4 Promoting the ETLs to Production status . . . . . . . . . . . . . . . . . . . . 197
5.7 Running NetView ETLs on remote agent sites . . . . . . . . . . . . . . . . . . . . 198
5.8 Reporting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
5.8.1 Accessing the Crystal ePortfolio feature . . . . . . . . . . . . . . . . . . . . . 206
Chapter 6. IBM Tivoli Monitoring Warehouse Enablement Pack. . . . . . . 225
6.1 Case study overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226
6.2 IBM Tivoli Monitoring WEP overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
6.3 Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
6.4 Installing the ITM WEP data collector component. . . . . . . . . . . . . . . . . . 232
6.4.1 Activate data collection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
6.5 Installing and configuring ITM Generic WEP. . . . . . . . . . . . . . . . . . . . . . 241
6.5.1 Backing up the TWH databases . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
6.5.2 Establishing an ODBC connection on the Control Center. . . . . . . . 242
6.5.3 Installing the ITM 5.1.1 AMX ETL processes . . . . . . . . . . . . . . . . . 247
6.5.4 Installing AMX Fix Packs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
6.5.5 Defining the authority to the warehouse sources and targets . . . . . 254
6.5.6 Modifying the ETL for the source table name to the RIM user . . . . 257
6.6 Installing and configuring ITM for OS WEP . . . . . . . . . . . . . . . . . . . . . . . 262
6.6.1 Backing up the TWH databases . . . . . . . . . . . . . . . . . . . . . . . . . . . 262
6.6.2 Installing the ITM 5.1.1 AMY ETL processes . . . . . . . . . . . . . . . . . 262
6.6.3 Installing AMY Fix Packs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
6.6.4 Defining the authority to the warehouse sources and targets . . . . . 265
6.7 Testing, scheduling, and promoting the ETLs . . . . . . . . . . . . . . . . . . . . . 267
6.7.1 Testing the ETLs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
6.7.2 Checking that data has been collected . . . . . . . . . . . . . . . . . . . . . . 270
6.7.3 Scheduling the ETLs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
6.7.4 Promoting the ETL status to Production mode . . . . . . . . . . . . . . . . 274
6.8 Reporting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
6.8.1 Available reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
6.8.2 Accessing the Crystal ePortfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
6.9 Troubleshooting of ITM data collection . . . . . . . . . . . . . . . . . . . . . . . . . . 286
6.9.1 Using itmchk.sh script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287
6.9.2 Manual checking of ITM data collection . . . . . . . . . . . . . . . . . . . . . 290
Chapter 7. IBM Tivoli Storage Manager Warehouse Enablement Pack . 297
7.1 Case study overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 298
7.2 IBM Tivoli Storage Manager WEP overview . . . . . . . . . . . . . . . . . . . . . . 299
7.3 Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300
7.4 Installing and configuring ITSM WEP 5.2 . . . . . . . . . . . . . . . . . . . . . . . . 301
7.4.1 Changes required on the IBM Tivoli Storage Manager servers . . . 301
7.4.2 Installing the IBM Tivoli Storage Manager ODBC . . . . . . . . . . . . . . 301
7.4.3 Backing up the TWH databases . . . . . . . . . . . . . . . . . . . . . . . . . . . 304
vi Implementing Tivoli Data Warehouse 1.2

9. 7.4.4 IBM Tivoli Storage Manager WEP installation . . . . . . . . . . . . . . . . 305
7.4.5 Defining the authority to the warehouse sources and targets . . . . . 313
7.5 IBM Tivoli Storage Manager ETL processes . . . . . . . . . . . . . . . . . . . . . . 314
7.5.1 ANR_C05_ETL1_Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315
7.5.2 ANR_C10_EXPServer_Process . . . . . . . . . . . . . . . . . . . . . . . . . . . 319
7.5.3 ANR_M05_ETL2_Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 319
7.6 Testing, scheduling, and promoting the ETLs . . . . . . . . . . . . . . . . . . . . . 320
7.6.1 ETL data collection verification . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
7.7 Reporting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 322
7.7.1 Available reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 322
7.7.2 Accessing the Crystal ePortfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . 322
Part 3. Appendixes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337
Appendix A. IBM DB2 UDB administration for other relational DBAs . . 339
Common DBA tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 340
Creating databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 340
Creating databases in IBM DB2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 341
Creating databases in Oracle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 341
Creating databases in Sybase . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342
Managing space . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343
DB2 space management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343
Oracle space management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345
Sybase space management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346
Creating objects in the database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346
Creating tables in DB2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346
Creating tables in Oracle. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347
Creating tables in Sybase . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347
Additional table control parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347
Appendix B. Tivoli Data Warehouse 1.2 reference . . . . . . . . . . . . . . . . . . 349
Report listing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 350
Measurement sources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
Appendix C. Warehouse Enablement Packs properties file . . . . . . . . . . 361
The twh_install_props.cfg properties file . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362
Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 366
How to get IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 367
Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 367
Contents vii

10. Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369
viii Implementing Tivoli Data Warehouse 1.2

11. Figures
1-1 IBM DB2 Data Warehouse Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1-2 Crystal Enterprise multi-tier architecture . . . . . . . . . . . . . . . . . . . . . . . . 12
1-3 TDS OS/390 and TDW 1.2 Data flow . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1-4 Distributed and OS/390 Data feeds into Tivoli Data Warehouse . . . . . . 16
1-5 Multiple source applications loading into a central data warehouse . . . 17
1-6 Tivoli Data Warehouse — the big picture . . . . . . . . . . . . . . . . . . . . . . . 20
1-7 Detail Component view of Tivoli Data Warehouse 1.2. . . . . . . . . . . . . . 23
1-8 Integrated Systems Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2-1 Single machine installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
2-2 Distributed deployment on Windows and UNIX systems . . . . . . . . . . . . 44
2-3 Operational data sources and the CDW databases on the same server 45
2-4 Data sources, CDW, and data mart databases on a z/OS system . . . . 46
2-5 Operational data sources both on z/OS and on distributed systems . . . 47
2-6 Separate data mart databases on z/OS system and distributed system 48
2-7 Two CDWs on a Windows or UNIX system and on a z/OS system. . . . 49
2-8 Warehouse agent on control server . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
2-9 Warehouse agents on data targets . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
2-10 Configuration with a warehouse agent on the source . . . . . . . . . . . . . . 52
2-11 Tivoli Data Warehouse and firewalls . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
2-12 Business intelligence integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
3-1 Installation process overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
3-2 Install DB2 V7 components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
3-3 Create DB2 Services - DB2 Instance db2inst1 . . . . . . . . . . . . . . . . . . . 79
3-4 Create the DB2 fenced user . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
3-5 Administration Server window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
3-6 Select DB2 Enterprise Edition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
3-7 Installation Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
3-8 MSDE security configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
3-9 Installation window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
3-10 Completion window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
3-11 Crystal Enterprise Launchpad . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
3-12 Crystal Administration Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
3-13 Quick start deployment configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . 94
3-14 InstallShield Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
3-15 Tivoli common logging directory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
3-16 Setup window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
3-17 DB2 connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
3-18 Crystal connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
© Copyright IBM Corp. 2004. All rights reserved. ix

12. 3-19 Summary window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
3-20 Completion window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
3-21 Configuring the IBM DB2 data warehouse center . . . . . . . . . . . . . . . . 100
3-22 Configuring the Warehouse Control Database Management . . . . . . . 101
3-23 Distributed deployment scenario . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
3-24 Install Shield Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
3-25 Tivoli Common Logging Directory . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
3-26 Setup Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
3-27 Before proceeding with TDW 1.2 distributed installation . . . . . . . . . . . 108
3-28 DB2 connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
3-29 Central data warehouse on remote host . . . . . . . . . . . . . . . . . . . . . . . 109
3-30 Central data warehouse database server list. . . . . . . . . . . . . . . . . . . . 110
3-31 Data mart on remote host . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
3-32 Data mart database server list . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
3-33 Crystal connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3-34 Summary window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
3-35 Completion window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
3-36 Configuring the IBM DB2 Data Warehouse Center . . . . . . . . . . . . . . . 114
3-37 Configuring the Warehouse Control Database Management . . . . . . . 115
3-38 Adding central data warehouses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
3-39 z/OS IBM DB2 Server information . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
3-40 z/OS central data warehouse database configuration . . . . . . . . . . . . . 117
3-41 Central data warehouse server on z/OS . . . . . . . . . . . . . . . . . . . . . . . 118
3-42 Central data warehouse summary window . . . . . . . . . . . . . . . . . . . . . 118
3-43 Central data warehouse on z/OS install. . . . . . . . . . . . . . . . . . . . . . . . 119
3-44 Adding data marts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
3-45 z/OS IBM DB2 Server information . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
3-46 z/OS data mart database configuration . . . . . . . . . . . . . . . . . . . . . . . . 121
3-47 Data mart server on z/OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
3-48 Data mart creation summary window. . . . . . . . . . . . . . . . . . . . . . . . . . 122
3-49 Data mart on z/OS install . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
3-50 Distributed environment with agent . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
3-51 Select the DB2 Warehouse Manager components . . . . . . . . . . . . . . . 129
3-52 Install DB2 V7 menu on AIX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130
3-53 Create DB2 Service Menu on AIX . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
3-54 Setup Window - create warehouse agents . . . . . . . . . . . . . . . . . . . . . 132
3-55 Before proceeding with remote agent sites creation . . . . . . . . . . . . . . 133
3-56 Warehouse agents - specify the TDW control server . . . . . . . . . . . . . 134
3-57 Successful remote agent creation window. . . . . . . . . . . . . . . . . . . . . . 135
3-58 DB2 Data Warehouse services . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
3-59 Remote Agent Sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
3-60 Verify Remote Agents on Tivoli Data Warehouse Control Center . . . . 141
5-1 Distributed deployment scenario . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
x Implementing Tivoli Data Warehouse 1.2

13. 5-2 IBM Tivoli NetView Warehouse Enablement Pack data flow . . . . . . . . 164
5-3 NetView Configure data export to DB2 - Parameters . . . . . . . . . . . . . 168
5-4 NetView Configure data export to DB2 - create database . . . . . . . . . . 168
5-5 NetView Configure data export to DB2 - register and start tdwdaemon169
5-6 NetView SmartSet desktop . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
5-7 Microsoft SmartSet Advanced attributes . . . . . . . . . . . . . . . . . . . . . . . 172
5-8 Create Microsoft SmartSet. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173
5-9 NetView SmartSets - Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
5-10 NetView SmartSets - Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175
5-11 SmartSet Microsoft contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
5-12 Create an ODBC data source for NETVIEW . . . . . . . . . . . . . . . . . . . . 183
5-13 Add an ODBC data source for NETVIEW . . . . . . . . . . . . . . . . . . . . . . 183
5-14 Configure NetView Source database connectivity . . . . . . . . . . . . . . . . 184
5-15 NetView WEP installation - List of WEPs to install . . . . . . . . . . . . . . . 185
5-16 NetView WEP installation - Properties file . . . . . . . . . . . . . . . . . . . . . . 186
5-17 NetView WEP installation - List of WEPs to install NetView . . . . . . . . 187
5-18 NetView WEP installation - successful installation . . . . . . . . . . . . . . . 187
5-19 Data Warehouse Control Center - check control database . . . . . . . . . 189
5-20 Configure NetView data warehouse sources . . . . . . . . . . . . . . . . . . . . 190
5-21 Configure NetView data warehouse targets . . . . . . . . . . . . . . . . . . . . 191
5-22 Promote ETLs to test mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
5-23 Test ETL process steps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
5-24 Work in Progress - Log file. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194
5-25 Sample contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
5-26 Schedule ANM_c05_ETL1_Process . . . . . . . . . . . . . . . . . . . . . . . . . . 196
5-27 Schedule configuration for ANM_C05_ETL1_Process . . . . . . . . . . . . 197
5-28 Promote ANM_c05_ETL1_Process . . . . . . . . . . . . . . . . . . . . . . . . . . . 198
5-29 Select remote agents properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
5-30 Change remote agents properties - sources and targets. . . . . . . . . . . 201
5-31 Select ETL process properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
5-32 Demote ETL processes to development mode . . . . . . . . . . . . . . . . . . 202
5-33 Change the ETL processes agent site . . . . . . . . . . . . . . . . . . . . . . . . . 203
5-34 Work in Progress - Run ETL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
5-35 Work in progress - Check ETL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
5-36 Log Details menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
5-37 Crystal Enterprise - Launchpad . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207
5-38 Crystal Enterprise 9 - ePortfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
5-39 Crystal Enterprise 9 - Log in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
5-40 Crystal Enterprise 9 - Folders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
5-41 Crystal Enterprise 9 - Tivoli Reports: IBM Tivoli NetView . . . . . . . . . . 211
5-42 Crystal Enterprise 9 - Daily Status Summary by SmartSet . . . . . . . . . 212
5-43 Crystal Enterprise 9 - Schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
5-44 Crystal Enterprise 9 - Parameters for Schedule Option . . . . . . . . . . . . 213
Figures xi

14. 5-45 Crystal Enterprise 9 - Schedule Parameters . . . . . . . . . . . . . . . . . . . . 214
5-46 Crystal Enterprise 9 - Schedule Parameter Selection . . . . . . . . . . . . . 215
5-47 Crystal Enterprise 9 - Parameters: Specific Time Frame. . . . . . . . . . . 216
5-48 Crystal Enterprise 9 - Report History . . . . . . . . . . . . . . . . . . . . . . . . . . 217
5-49 Failed report generation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
5-50 Crystal Enterprise 9 - Report . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
5-51 Crystal Enterprise 9 - Report (count) . . . . . . . . . . . . . . . . . . . . . . . . . . 220
5-52 Summary of total status changes by SmartSet example . . . . . . . . . . . 221
5-53 Nodes with longest outage times example . . . . . . . . . . . . . . . . . . . . . 222
5-54 Total daily status changes in monitored network example . . . . . . . . . 223
6-1 Environment for our case study . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
6-2 Overview of ITM integration with Tivoli Data Warehouse . . . . . . . . . . 228
6-3 IBM Tivoli Monitoring data flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
6-4 Resource Model Data Logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
6-5 Aggregation time line . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
6-6 Installing warehouse support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
6-7 RIM setup options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
6-8 Logging option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 238
6-9 Client Configuration Assistant opening dialog . . . . . . . . . . . . . . . . . . . 243
6-10 Add Database Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
6-11 Add System dialog window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
6-12 Select ITM_DB in the dialog window . . . . . . . . . . . . . . . . . . . . . . . . . . 246
6-13 Confirmation dialog window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
6-14 User ID and Password dialog window . . . . . . . . . . . . . . . . . . . . . . . . . 247
6-15 ODBC connection successful . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
6-16 Install a Warehouse Pack window . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
6-17 Tivoli Common Logging Directory window . . . . . . . . . . . . . . . . . . . . . . 249
6-18 Add Warehouse Pack window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
6-19 Location of installation properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
6-20 Installation menu window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
6-21 Installation summary window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
6-22 AMX installation completion window. . . . . . . . . . . . . . . . . . . . . . . . . . . 253
6-23 Installation of AMX Fix Pack 6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
6-24 IBM Tivoli Monitoring, Version 5.1.1 Generic ETL1 Sources . . . . . . . . 255
6-25 AMX_ITM_RIM_Source user ID information . . . . . . . . . . . . . . . . . . . . 255
6-26 AMX_TWH_CDW_Source user ID information . . . . . . . . . . . . . . . . . . 256
6-27 IBM Tivoli Monitoring, Version 5.1.1 Generic ETL1 Target . . . . . . . . . 256
6-28 AMX_TWH_CDW_Target user ID information. . . . . . . . . . . . . . . . . . . 257
6-29 Tables and views of AMX_ITM_TIM_Source. . . . . . . . . . . . . . . . . . . . 258
6-30 Table name filter specification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 258
6-31 Endpoint tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259
6-32 AMX_c05_ETL1 process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
6-33 Selecting new table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
xii Implementing Tivoli Data Warehouse 1.2

15. 6-34 Installation menu window with the AMY pack . . . . . . . . . . . . . . . . . . . 263
6-35 AMY installation completion window . . . . . . . . . . . . . . . . . . . . . . . . . . 264
6-36 Installation of AMY Fix Pack 6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
6-37 AMY_TWH_CDW_Source user ID information . . . . . . . . . . . . . . . . . . 266
6-38 AMY_TWH_MART_Target user ID information . . . . . . . . . . . . . . . . . . 267
6-39 Change ETL mode to Test . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
6-40 Manually test the ETLs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
6-41 Work in progress window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
6-42 Sample Content of table F_OS_HOUR . . . . . . . . . . . . . . . . . . . . . . . . 271
6-43 Schedule AMX_c05_ETL1_Process . . . . . . . . . . . . . . . . . . . . . . . . . . 272
6-44 Schedule configuration for AMX_c05_ETL1_Process . . . . . . . . . . . . . 273
6-45 Promoting ETLs to Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
6-46 Crystal Enterprise - Launchpad . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
6-47 Crystal Enterprise 9 - ePortfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277
6-48 Crystal Enterprise 9 - Log in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
6-49 Crystal Enterprise 9 - Folders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279
6-50 Crystal Enterprise 9 - available reports for ITM . . . . . . . . . . . . . . . . . . 280
6-51 Scheduling Operating System Busiest System report . . . . . . . . . . . . . 281
6-52 Crystal Enterprise 9 - parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
6-53 Crystal Enterprise 9 - Parameters for the report . . . . . . . . . . . . . . . . . 282
6-54 Crystal Enterprise 9 - Report History . . . . . . . . . . . . . . . . . . . . . . . . . . 283
6-55 Operating System Busiest Systems report . . . . . . . . . . . . . . . . . . . . . 284
6-56 Operating System Paging File Utilization. . . . . . . . . . . . . . . . . . . . . . . 285
6-57 Operating System Operating System UNIX CPU Statistics . . . . . . . . . 286
7-1 TDW 1.2 - distributed deployment scenario . . . . . . . . . . . . . . . . . . . . . 299
7-2 ITSM ODBC Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 302
7-3 ITSM ODBC data source configuration panel . . . . . . . . . . . . . . . . . . . 303
7-4 Install a Warehouse Pack window . . . . . . . . . . . . . . . . . . . . . . . . . . . . 305
7-5 Tivoli Common Logging Directory window . . . . . . . . . . . . . . . . . . . . . . 306
7-6 Add Warehouse Pack window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306
7-7 Location of installation properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307
7-8 Data mart and remote agent site settings . . . . . . . . . . . . . . . . . . . . . . 308
7-9 Central data warehouse and remote agent site settings . . . . . . . . . . . 309
7-10 Editing IBM Tivoli Storage Manager ODBC settings . . . . . . . . . . . . . . 310
7-11 ITSM ODBC Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311
7-12 Installation menu window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311
7-13 Installation summary window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312
7-14 Installation Progress and Completion window . . . . . . . . . . . . . . . . . . . 313
7-15 Sample of Process Model ANR_C05_ETL1_Process . . . . . . . . . . . . . 316
7-16 Sample Content of Table D_NODE . . . . . . . . . . . . . . . . . . . . . . . . . . . 321
7-17 Crystal Enterprise - Launchpad . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323
7-18 Crystal Enterprise 9 - ePortfolio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
7-19 Crystal Enterprise 9 - Log in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325
Figures xiii

16. 7-20 Crystal Enterprise 9 - Folders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326
7-21 Crystal Enterprise 9 - available reports for ITSM . . . . . . . . . . . . . . . . . 327
7-22 Scheduling Operating System Busiest System report . . . . . . . . . . . . . 328
7-23 Crystal Enterprise 9 - parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329
7-24 Crystal Enterprise 9 - Parameters for the report . . . . . . . . . . . . . . . . . 330
7-25 How Has Clients use of Server Storage Changed Over Time? . . . . . . 331
7-26 How Has Clients Use of Server Storage Changed Over Time? . . . . . 332
7-27 How Has Clients Use of Server Storage Changed by Platform? . . . . . 333
7-28 How Has My Server Storage Space Utilization Changed Over Time? 334
7-29 Which Clients are Using the Most Server Storage?. . . . . . . . . . . . . . . 335
C-1 Location of the twh_install_props.cfg file . . . . . . . . . . . . . . . . . . . . . . . 362
xiv Implementing Tivoli Data Warehouse 1.2

17. Tables
2-1 Hardware recommendations for Tivoli Data Warehouse components . 29
2-2 Additional hard disk space requirements . . . . . . . . . . . . . . . . . . . . . . . . 30
2-3 Software requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
2-4 Web servers and OS supported by Crystal Web Connector . . . . . . . . . 35
2-5 Requirements for Tivoli Data Warehouse components . . . . . . . . . . . . . 36
2-6 Agent sites placement for data transfers to a central data warehouse . 52
2-7 Where to place agent sites for data transfers to data marts . . . . . . . . . 53
2-8 Default port used in Tivoli Data Warehouse environments . . . . . . . . . . 56
5-1 Environment for NetView integration . . . . . . . . . . . . . . . . . . . . . . . . . . 162
5-2 NetView WEP Prerequisite Check - NetView server platform . . . . . . . 165
5-3 Netview Enablement Pack installation information . . . . . . . . . . . . . . . 166
5-4 Case Study SmartSets attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173
5-5 Add database wizard - register TCP/IP . . . . . . . . . . . . . . . . . . . . . . . . 184
5-6 NetView sources and targets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
6-1 Hardware and operating systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
7-1 Environment for NetView integration . . . . . . . . . . . . . . . . . . . . . . . . . . 298
7-2 ITSM WEP Warehouse Object Names . . . . . . . . . . . . . . . . . . . . . . . . 314
C-1 WEP installation properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 363
© Copyright IBM Corp. 2004. All rights reserved. xv

18. xvi Implementing Tivoli Data Warehouse 1.2

19. Examples
3-1 twh_create_datasource script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
3-2 Verification of central data warehouse database on z/OS . . . . . . . . . . 119
3-3 Verification of data mart database on z/OS . . . . . . . . . . . . . . . . . . . . . 123
3-4 twh_create_datasource script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
3-5 Verify control server (twh_list_cs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136
3-6 Verify central data warehouse (twh_list_cdws) . . . . . . . . . . . . . . . . . . 137
3-7 Verify data mart databases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
3-8 Verify remote agent site (twh_list_agentsites) . . . . . . . . . . . . . . . . . . . 138
3-9 Verify Crystal Enterprise Professional for Tivoli installation . . . . . . . . . 139
3-10 Verify data user . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 140
3-11 twh_configwep command output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
5-1 Verify NetView source database updates . . . . . . . . . . . . . . . . . . . . . . 169
5-2 NetView tdwdaemon configuration file tdwdaemon.properties . . . . . . 178
5-3 Restart the NetView data warehouse daemon tdwdaemon . . . . . . . . . 178
5-4 Status of NetView data warehouse daemon (tdwdaemon) . . . . . . . . . 179
5-5 Status of the NetView SNMP collector daemon (snmpcollect) . . . . . . 179
5-6 Check the NetView source database . . . . . . . . . . . . . . . . . . . . . . . . . . 180
6-1 Testing the RIM object . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
6-2 Datacollector configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
6-3 wdmlseng command output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
6-4 wdmcollect command output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
6-5 Sample SQL that check the collection . . . . . . . . . . . . . . . . . . . . . . . . . 240
6-6 Running itmchk.sh tool. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287
6-7 itmchk.sh tool report. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 288
6-8 Retrieving the date of last data upload into ITM database. . . . . . . . . . 290
6-9 Names of the endpoints collecting data . . . . . . . . . . . . . . . . . . . . . . . . 290
6-10 wrimtest command output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291
6-11 Status of resource models distributed on an endpoint . . . . . . . . . . . . . 292
6-12 msg_DataCollector.log. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293
6-13 trace_tmnt_rimh_eng1.log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
6-14 trace_dmxengine.log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 295
© Copyright IBM Corp. 2004. All rights reserved. xvii

20. xviii Implementing Tivoli Data Warehouse 1.2

21. Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult
your local IBM representative for information on the products and services currently available in your area.
Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product, program, or service that
does not infringe any IBM intellectual property right may be used instead. However, it is the user's
responsibility to evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document.
The furnishing of this document does not give you any license to these patents. You can send license
inquiries, in writing, to:
IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions
are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES
THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED,
INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT,
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer
of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made
to the information herein; these changes will be incorporated in new editions of the publication. IBM may
make improvements and/or changes in the product(s) and/or the program(s) described in this publication at
any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any
manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the
materials for this IBM product and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it believes appropriate without
incurring any obligation to you.
Information concerning non-IBM products was obtained from the suppliers of those products, their published
announcements or other publicly available sources. IBM has not tested those products and cannot confirm
the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on
the capabilities of non-IBM products should be addressed to the suppliers of those products.
This information contains examples of data and reports used in daily business operations. To illustrate them
as completely as possible, the examples include the names of individuals, companies, brands, and products.
All of these names are fictitious and any similarity to the names and addresses used by an actual business
enterprise is entirely coincidental.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrates programming
techniques on various operating platforms. You may copy, modify, and distribute these sample programs in
any form without payment to IBM, for the purposes of developing, using, marketing or distributing application
programs conforming to the application programming interface for the operating platform for which the
sample programs are written. These examples have not been thoroughly tested under all conditions. IBM,
therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy,
modify, and distribute these sample programs in any form without payment to IBM for the purposes of
developing, using, marketing, or distributing application programs conforming to IBM's application
programming interfaces.
© Copyright IBM Corp. 2004. All rights reserved. xix

22. Trademarks
The following terms are trademarks of the International Business Machines Corporation in the United States,
other countries, or both:
AIX® IBM® Redbooks™
CICS® IMS™ RMF™
DataJoiner® Informix® S/390®
DB2 Universal Database™ Lotus® SP2®
DB2® MQSeries® Tivoli Enterprise Console®
Domino® MVS™ Tivoli Enterprise™
DRDA® NetView® Tivoli®
^™ NetVista™ WebSphere®
™ OS/390® z/OS®
Everyplace® RACF®
ibm.com® Redbooks (logo) ™
The following terms are trademarks of other companies:
Crystal and Crystal Enterprise are trademarks of Business Objects.
Intel and Intel Inside (logos) are trademarks of Intel Corporation in the United States, other countries, or
both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the
United States, other countries, or both.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun
Microsystems, Inc. in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Other company, product, and service names may be trademarks or service marks of others.
xx Implementing Tivoli Data Warehouse 1.2

23. Preface
With Tivoli® Data Warehouse, you can analyze historical trends from various
Tivoli and customer applications. The Tivoli Data Warehouse infrastructure
enables a set of extract, transform, and load (ETL) utilities to extract and move
data from Tivoli application data stores to a central repository. The open
architecture of Tivoli Data Warehouse also enables data from non-Tivoli
applications to be integrated into its central repository. Data from the central
repository can be extracted into data marts that pertain to the reporting needs of
selected groups. These data marts can also be used to produce cross
application reports.
This IBM Redbook focuses on planning, installation, customization, use,
maintenance, and troubleshooting topics related to the new features of the Tivoli
Data Warehouse version 1.2. This is done using a number of case study
scenarios and several warehouse enablement packs.
The instructions given in this book are very detailed and explicit. These
instructions are not the only way to install the products and related prerequisites.
They are meant to be followed by anyone to successfully install, configure, and
set up Tivoli Data Warehouse environments of any size.
The team that wrote this redbook
This redbook was produced by a team of specialists from around the world
working at the International Technical Support Organization, Austin Center.
Edson Manoel is a Software Engineer at IBM Corporation - International
Technical Support Organization, Austin Center, working as an IT Specialist in the
Systems Management area. Prior to joining the ITSO, Edson worked in the IBM
Software Group as a Tivoli Technology Ambassador and in IBM Brasil
Professional Services Organization as a Certified IT Specialist. He was involved
in numerous projects, designing and implementing systems management
solutions for IBM customers and Business Partners. Edson holds a BSc degree
in Applied Mathematics from Universidade de Sao Paulo, Brazil.
Cristiano Colantuono is an IT Specialist at IBM Tivoli Laboratory in Rome.
He joined IBM in 1999, working in the distributed systems management area. He
projected and implemented several Tivoli solutions for the IT infrastructures in
Rome as well as in other European IBM development laboratories. Before joining
IBM, Cristiano had also some experience as a Web developer and a Web
© Copyright IBM Corp. 2004. All rights reserved. xxi

24. administrator. He graduated in Physics at the University of Rome and
collaborated with the Italian National Institute of Nuclear Physics developing
simulation programs for high energy physics experiments.
Dr. Hans-Georg Köhne is a software architect for SerCon in Germany. He
graduated in physics at the University of Muenster developing simulation
programs for high energy physics experiments. He joined SerCon in 1996,
working in the distributed systems management area. He planned and
implemented several systems management solutions in the areas software
distribution, availability management, and business automation.
Devi Raju is a Tivoli Implementation Specialist for IBM India.
She started her career with IBM and has been with IBM for 8 years now. Devi
has 4 years of experience in Enterprise System Management. She has worked in
various large Tivoli customer projects. She is also a Tivoli Certified Consultant on
PACO products.
Ghufran Shah is an IBM Certified Deployment Professional and an IBM Certified
Instructor based in the UK with os-security.com. He holds a degree in Computer
Science, and has over 8 years of experience in Systems Development and
Enterprise Systems Management. As well as teaching Tivoli courses worldwide,
his areas of expertise include Tivoli Systems Management Architecture,
Implementation, and Training together with Provisioning and Orchestration. His
focus in now on leveraging IBM solutions to provide customers with the vision
and reality of an OnDemand environment.
Sergio Henrique Soares Monteiro is an IT Specialist in Brazil. He has over 10
years of experience in database administration and development fields. He has
worked with Oracle, DB2, Informix and SQL Server on UNIX and Windows,
including clustered servers. He currently works as a Database administrator in
the CTI’s IBM in Hortolandia, Brazil. His areas of expertise include sizing,
performance tuning, and internals of RDBMS.
Thanks to the following people for their contributions to this project:
Budi Darmawan
International Technical Support Organization, Austin Center
David Stephenson
IBM Global Services, Australia
Diana Marcattili
IBM Global Services, Italy
Georg Holzknecht
Senior Systems Consultant, T-Systems CDS GmbH, Germany
xxii Implementing Tivoli Data Warehouse 1.2

25. Jonathan Cook, Brian Jeffrey, Mike Mallo
Tivoli Data Warehouse development team, IBM Software Group, Austin
Ken Hannigan
IBM Tivoli Storage Manager development team, IBM Software Group, Tucson
Yvonne Lyon, editor
International Technical Support Organization, San Jose Center
Become a published author
Join us for a two- to six-week residency program! Help write an IBM Redbook
dealing with specific products or solutions, while getting hands-on experience
with leading-edge technologies. You'll team with IBM technical professionals,
Business Partners and/or customers.
Your efforts will help increase product acceptance and customer satisfaction. As
a bonus, you'll develop a network of contacts in IBM development labs, and
increase your productivity and marketability.
Find out more about the residency program, browse the residency index, and
apply online at:
ibm.com/redbooks/residencies.html
Comments welcome
Your comments are important to us!
We want our Redbooks™ to be as helpful as possible. Send us your comments
about this or other Redbooks in one of the following ways:
Use the online Contact us review redbook form found at:
ibm.com/redbooks
Send your comments in an Internet note to:
redbook@us.ibm.com
Mail your comments to:
IBM® Corporation, International Technical Support Organization
Dept. JN9B Building 003 Internal Zip 2834
11400 Burnet Road
Austin, Texas 78758-3493
Preface xxiii

26. xxiv Implementing Tivoli Data Warehouse 1.2

27. Part 1
Part 1 Fundamentals
© Copyright IBM Corp. 2004. All rights reserved. 1

28. 2 Implementing Tivoli Data Warehouse 1.2

29. 1
Chapter 1. Introducing Tivoli Data
Warehouse 1.2
This chapter provides a brief introduction to the concepts, technologies, and
products behind the Tivoli Data Warehouse, and the new features that can be
found in Version 1.2. We cover the following topics:
“Data warehousing basics” on page 4
“Tivoli Data Warehouse” on page 8
“What is new in Tivoli Data Warehouse 1.2” on page 10
“Tivoli Data Warehouse architecture” on page 20
“Benefits of using Tivoli Data Warehouse” on page 23
© Copyright IBM Corp. 2004. All rights reserved. 3

30. 1.1 Data warehousing basics
Data warehousing is the process of managing a data warehouse and its
components, called data marts. This management process includes all the
ongoing support needs of the refresh cycle, database maintenance, and
continual refinements to the underlying data model. In addition to that, data
warehousing can be thought of as a tool to enable and support business
intelligence.
The concept of data warehousing carries several other important terms
mentioned in the above paragraph. Such terms will be explained in the sections
to follow. They are:
Data warehouse
Data mart
Business intelligence
Data mining
1.1.1 Data warehouse
A data warehouse is the cohesive data model that defines the central data
repository for an organization. An important point is that we don't define a
warehouse in terms of the number of databases. Instead, we consider it a
complete, integrated data model of the enterprise, regardless of how or where
the data is stored.
A data warehouse is a collection of databases where data is collected for the
purpose of being analyzed. This collection of databases can be formed by one or
more databases. The defining characteristic of a data warehouse is its purpose.
Most data is collected to handle a company's on-going business. This type of
data can be called operational data. The systems used to collect operational
data are referred to as OLTP.
A data warehouse collects, organizes, and makes data available for the purpose
of analysis in order to give management the ability to access and analyze
information about its business. This type of data can be called informational
data. The systems used to work with informational data are referred to as online
analytical processing (OLAP).
Bill Inmon coined the term data warehouse in 1990. His definition is as follows:
“A (data) warehouse is a subject-oriented, integrated, time-variant, and
non-volatile collection of data in support of management's decision-making
process.”
4 Implementing Tivoli Data Warehouse 1.2

31. These are the main types of data:
Subject-oriented: Data that gives information about a particular subject
instead of about a company's on-going operations
Integrated: Data that is gathered into the data warehouse from a variety of
sources and merged into a coherent whole
Time-variant: All data in the data warehouse that is identified with a
particular time period
1.1.2 Data mart
A data mart is a repository containing data specific to a particular business group
in an enterprise. All data in a data mart derives from the data warehouse, and all
data relates directly to the enterprise wide data model. Often, data marts contain
summarized or aggregated data that the user community can easily consume.
Another way to differentiate a data warehouse from a data mart is to look at the
data's consumers and format. IT analysts and canned reporting utilities consume
warehouse data, whose storage is usually coded and cryptic. The user
community consumes data mart data, whose storage is usually in a more
readable format. For example, to reduce the need for complex queries and assist
business users who might be uncomfortable with the SQL language, data tables
could contain the de-normalized code table values.
A data mart contains a subset of corporate data that is of value to a specific
business unit, department, or set of users. This subset consists of historical,
summarized, and possibly detailed data captured from transaction processing
systems, or from an enterprise data warehouse. It is important to realize that a
data mart is defined by the functional scope of its users, and not by the size of
the data mart database. In parallel to increasing data mart usage, the underlying
databases will rapidly increase in size.
1.1.3 Business intelligence
Business intelligence (BI) is not business as usual. It is about making better
decisions more quickly and easily.
Businesses collect enormous amounts of data every day: Information about
orders, inventory, accounts payable, point-of-sale transactions, and, of course,
customers. Businesses also acquire data, such as demographics and mailing
lists, from outside sources. Unfortunately, based on a recent survey, over 93
percent of corporate data is not usable in the business decision-making process
today. This applies also to systems management, where data tends to be of
more technical nature.
Chapter 1. Introducing Tivoli Data Warehouse 1.2 5

32. Consolidating and organizing data for better business decisions can lead to a
competitive advantage, and learning to uncover and leverage those advantages
is what business intelligence is all about.
The amount of business data is increasing exponentially. In fact, it doubles every
two to three years. More information means more competition. In the age of the
information explosion, executives, managers, professionals, and workers all
need to be able to make better decisions faster. Because now, more than ever,
time is money.
Much more than a combination of data and technology, BI helps you to create
knowledge from a world of information. Get the right data, discover its power,
and share the value, BI transforms information into knowledge. Business
intelligence is the application of putting the right information into the hands of
the right user at the right time to support the decision-making process.
Business driving forces
It can be noted that there are some business driving forces behind business
intelligence, one being the need to improve ease-of-use and reduce the
resources required to implement and use new information technologies. Other
driving forces behind business intelligence include these:
The need to increase revenues, reduce costs, and compete more effectively.
Gone are the days when end users could manage and plan business
operations using monthly batch reports, and IT organizations had months to
implement new applications. Today companies need to deploy informational
applications rapidly, and provide business users with easy and fast access to
business information that reflects the rapidly changing business environment.
Business intelligence systems are focused towards end user information
access and delivery, and provide packaged business solutions in addition to
supporting the sophisticated information technologies required for the
processing of today’s business information.
The need to manage and model the complexity of today’s business
environment.
Corporate mergers and deregulation means that companies today are
providing and supporting a wider range of products and services to a broader
and more diverse audience than ever before. Understanding and managing
such a complex business environment and maximizing business investment
is becoming increasingly more difficult. Business intelligence systems provide
more than just basic query and reporting mechanisms, they also offer
sophisticated information analysis and information discovery tools that are
designed to handle and process the complex business information associated
with today’s business environment.
6 Implementing Tivoli Data Warehouse 1.2

33. The need to reduce IT costs and leverage existing corporate business
information.
The investment in IT systems today is usually a significant percentage of
corporate expenses, and there is a need not only to reduce this overhead, but
also to gain the maximum business benefits from the information managed by
IT systems. New information technologies like corporate intranets, thin-client
computing, and subscription-driven information delivery help reduce the cost
of deploying business intelligence systems to a wider user audience,
especially information consumers like executives and business managers.
Business intelligence systems also broaden the scope of the information that
can be processed to include not only operational and warehouse data, but
also information managed by office systems and corporate Web servers.
1.1.4 Data mining
Data mining is the process of extracting valid, useful, previously unknown, and
comprehensible information from data and using it to make business decisions.
The organizations of today are under tremendous pressure to compete in an
environment of tight deadlines and reduced profits. Legacy and lengthy business
processes that require data to be extracted and manipulated prior to use will no
longer be acceptable. Instead, enterprises need rapid decision support based on
the analysis and forecasting of predictive behavior. Data warehousing and data
mining techniques provide this capability.
Data mining can be defined as the extraction of hidden predictive information
from large databases, and is a powerful technology with great potential to help
companies focus on the most important information in their data warehouses.
Once a Tivoli Data Warehouse has been established, data mining tools can then
be used to predict future trends and behaviors, allowing businesses to make
proactive, knowledge-driven decisions.
Data mining tools can answer business questions that traditionally were too time
consuming to resolve. These tools hunt databases for hidden patterns, finding
predictive information that experts may miss because it lies outside their
expectations.
The art of data mining is not trivial, and it can be similar to “finding the needle in
the haystack”. In this case, the needle is that single piece of intelligence your
business needs, and the haystack is the large data warehouse you've built up
over a period of time within your business.
Chapter 1. Introducing Tivoli Data Warehouse 1.2 7

34. Most companies already collect and analyze massive quantities of data.
Data mining techniques can be implemented rapidly on existing software and
hardware platforms to enhance the value of existing information resources, and
can be integrated with new products and systems as they are brought on-line.
Given databases of sufficient size and quality, data mining technology can
generate new business opportunities by providing these capabilities:
Automated prediction of trends and behaviors: Data mining automates
the process of finding predictive information in large databases. Questions
that traditionally required extensive hands-on analysis can now be answered
directly from the data and quickly. A typical example of a predictive problem is
targeted server performance. Data mining uses data on past critical events to
identify the servers most likely to cause future critical problems. Other
predictive problems include forecasting server outage and other forms of
performance degradation that is likely to occur, given certain events.
Automated discovery of previously unknown patterns: Data mining tools
sweep through databases and identify previously hidden patterns in one step.
An example of pattern discovery is the analysis of IBM Tivoli Monitoring data
to identify seemingly unrelated events that are often received together.
1.2 Tivoli Data Warehouse
The Tivoli Data Warehouse 1.2 is built on an IBM DB2® Data Warehouse. It
offers all IBM DB2 Data Warehouse functionality with additional Tivoli specific
extensions.
The IBM Data Warehouse Management uses the IBM DB2 Universal Database
Enterprise Edition and the IBM DB2 Data Warehouse Manager feature. It
provides an integrated, distributed, heterogeneous warehouse management
infrastructure for designing, building, maintaining, governing, and accessing
highly scalable, robust data warehouses, operational data stores, and data marts
stored in IBM DB2 databases.
IBM DB2 Data Warehouse Manager helps warehouse administrators:
To manage data volumes, to move data directly from source to target (also
allowing packaged and simplified access to popular partner products such as
SAP R/3), and to control the servers on which transformations take place with
distributed warehouse agents
To speed warehouse and data mart deployment with commonly used,
pre-built data cleansing and statistical transformations
To build and manage from a central point of control, integrated in IBM DB2,
utilizing the Data Warehouse Center graphical user interface
8 Implementing Tivoli Data Warehouse 1.2

35. DB2 warehouse management consists of:
An administrative client to define and manage data warehousing tasks and
objects, and warehouse or data mart operations: the Data Warehouse Center
A manager to manage and control the flow of data: the warehouse server
Agents residing on IBM DB2 Universal Database Enterprise Edition server
platforms to perform requests from the manager or warehouse server: the
local or remote warehouse agent
A warehouse control database storing the warehouse management metadata
on a IBM DB2 database server
A metadata administrative and publishing tool with its own administration
graphical user interface (GUI): Information Catalog Manager to manage and
present both technical and business metadata
The different components of the IBM DB2 Data Warehouse Manager are shown
in Figure 1-1.
Clients Warehouse Warehouse Databases End Users
Server Agents
Data
Warehouse Data Relational
Center Message Source
Data
Message
DB2
Data Target
Message
Non-
Data Relational
Source
Message
Metadata
Data
Metadata Non-DB2
yy Target
Data
Log
Control Editions
Database Configuration
Data
Flat Files,
DB2 Web or
SAP R/3
Included with IBM DB2
Figure 1-1 IBM DB2 Data Warehouse Manager
Chapter 1. Introducing Tivoli Data Warehouse 1.2 9

36. 1.3 What is new in Tivoli Data Warehouse 1.2
Tivoli Data Warehouse 1.2 provides a number of enhancements and new
features over Version 1.1, such as these:
Improved interfaced and Web-based reporting using Crystal Enterprise™
DB2 UDB for OS/390 and z/OS support
Flexible and extended configuration support
Installation enhancements
Serviceability and scalability improvements
We now discuss each of these areas.
1.3.1 Crystal Enterprise™
Among the enhancements that Tivoli Data Warehouse 1.2 provides, an important
change is the new mechanism for producing reports and the user interface.
Version 1.1 of Tivoli Data Warehouse used Tivoli Presentation Services and the
IBM Console. Tivoli Data Warehouse 1.2 does not use the IBM Console nor
Tivoli Presentation Services. The reporting technology is now provided by
Crystal Enterprise™, by Business Objects, which is a world standard for
high-quality and high-performance reporting.
Crystal Enterprise™ provides:
Out-of-the-box Web-based reporting and information delivery for all your
Tivoli products
An extendable, scalable reporting solution to meet the information delivery
needs of your IT organization
A report scheduling capability
An export feature to export reports to variety of formats (Excel, Word, PDF)
The capability to change the look and feel of the reports
The Tivoli Data Warehouse 1.2 comes supplied with Crystal Enterprise
Professional Version 9 for Tivoli (limited use version) to analyze and deliver
out-of-the-box Reports from the Tivoli Data Warehouse into the hands of
decision-makers using a Web browser.
This will allow for a rapid return on investment you have made in your Tivoli
solution, by providing out-of-the-box Web based reporting, including scheduling
and report export capability. All of this is achieved using a customizable platform
for organizing, categorizing, and delivering information.
10 Implementing Tivoli Data Warehouse 1.2

37. If we define a report as an entity that visualizes the output of SQL clauses, or an
“SQL Pull”, then the Crystal Enterprise Professional Version 9 for Tivoli, which is
shipped with the Tivoli Data Warehouse 1.2 product, is supplied with a number of
standard reports provided by the Tivoli Data Warehouse Enablement Packs
(WEPs). When a report is made available by the WEP to Crystal Enterprise, the
layout, legends, colors, and the look-and-feel of the report can all be customized.
However, to create a new report (using the definition above), or to modify the
SQL pull criteria of an existing report, Crystal Reports and a different version of
Crystal Enterprise™ is required: Crystal Enterprise Version 9 Special Edition.
A license for Crystal Enterprise Version 9 Special Edition must be purchased
separately. The Crystal Enterprise Version 9 Special Edition will allow you to:
Extend your reporting capabilities to develop, deliver, and analyze new
reports created from your Tivoli Systems Management Data using Crystal
Reports version 9
Provide support for approximately 75 concurrent online users
Add, modify, and design new reports from your Tivoli Systems Management
Data using Crystal Reports version 9
For the tasks listed above, Crystal Reports Version 9 Special Edition is required
and must be purchased separately.
Next we present a brief introduction to the Crystal Enterprise architecture. As
shown in Figure 1-2, by using the Crystal Enterprise™ multi-tier architecture, the
IBM Tivoli product portfolio has a key partnership developed to ensure the
deepest level of integration and ongoing support for this solution. Please note
that some of the functions may not be available on the Crystal Enterprise
Professional for Tivoli product.
Chapter 1. Introducing Tivoli Data Warehouse 1.2 11

38. Browser or Crystal applications
Crystal Management Console
eProtfolio Client Tier
Crystal Configuration Manager
Publishing Wizard
Import Wizard
Web Server / Web Connector
Crystal Enterprise Framework Intelligence Tier
Web Component Server
File Repository Server Automated Process Scheduler
Cache Server Event Server
Processing Tier
Job Server
Page Server Report Application Server
Data Tier
OLAP
Relational ODBC XML, ERP, CRM, COM
Figure 1-2 Crystal Enterprise multi-tier architecture
In Crystal Enterprise, there are four tiers, each of which can be installed on one
machine, or with the Crystal Enterprise Version 9 Special Edition, spread across
many. The Crystal Enterprise architecture tiers are as follows:
Client tier: Administrators and end users interact with this component
directly, which is made up of the applications that enable people to
administer, publish, and view reports.
Intelligence tier: These components manage the Crystal Enterprise
administration system, which consists of maintaining all aspects of the
security information, storing report instances, and controlling the flow of
requests to the appropriate servers.
12 Implementing Tivoli Data Warehouse 1.2

39. Processing tier: These components access the data and generate the
reports. This is the only tier that communicates directly with the databases
that contain the report data.
Data tier: The databases that contain the data used in the reports fall into this
tier. These databases are referred as Data Sources in Crystal Enterprise, and
a wide range of databases are supported. These databases could contain
historic data and/or operational data.
This redbook does not go into the details of Crystal Enterprise Professional
Version 9 for Tivoli administration and configuration. Refer to the following
documentation shipped with the product:
Crystal Enterprise 9 Installation Guide
Crystal Enterprise 9 Administrator’s Guide
Crystal Enterprise 9 Getting Started Guide
Crystal Enterprise 9 ePortfolio User’s Guide
1.3.2 IBM DB2 UDB for OS/390 and z/OS support
On z/OS® systems, operational data is extracted from a Tivoli Decision Support
for OS/390® database.
As the next generation of historical data reporting and analysis solutions, Tivoli
Data Warehouse is a successor to Tivoli Decision Support (TDS) on distributed
platforms (Wintel/UNIX) and a companion product for Tivoli Decision Support for
OS/390. The following sections explain how Tivoli Data Warehouse relates to
and works with Tivoli Decision Support and Tivoli Decision Support for OS/390.
Tivoli Decision Support for OS/390 and Tivoli Data Warehouse
The following items compare and contrast Tivoli Data Warehouse and Tivoli
Decision Support:
Both Tivoli Data Warehouse and Tivoli Decision Support collect and analyze
data gathered by the system management products in your enterprise.
Both provide an infrastructure for reporting and analysis, but do not
themselves extract data or provide reports. Each relies on other applications
to use the infrastructure to extract and analyze data and to provide reports
that satisfy a specific reporting or analysis need.
In Tivoli Decision Support, an application that provides a solution to a specific
reporting need is called a Tivoli Decision Support Guide. In Tivoli Data
Warehouse, the corresponding application is called a Warehouse
Enablement Pack.
Chapter 1. Introducing Tivoli Data Warehouse 1.2 13

40. Some Tivoli Decision Support Guides require direct access to the data in your
operational data stores, which can decrease the performance of the products
creating and using those data stores. Tivoli Data Warehouse ensures that
your operational data stores are not impacted by users running reports. It also
ensures that users can run reports efficiently by accessing databases that are
optimized for interactive reporting.
By saving historical data in a central location and in a common format, Tivoli
Data Warehouse makes it easier to create reports that draw on data collected
by more than one product.
Tivoli Decision Support stores and accesses data using Cognos Powerplay
and Crystal Reports. In contrast, Tivoli Data Warehouse publishes the format
of its data, as well as the format of the data in the products that feed the
warehouse, allowing the use of various reporting tools.
This enables you to use the business intelligence solutions you already know.
In addition, Tivoli software uses Crystal Enterprise, which is provided with
Tivoli Data Warehouse, as a common reporting solution.
Tivoli Data Warehouse provides support for multiple languages. Tivoli
Decision Support is available only in English. Tivoli Decision Support for
OS/390 is available in English and Japanese.
TDS for OS/390 and Tivoli Data Warehouse 1.2 Interaction
This section describes how Tivoli Decision Support for OS/390 works with Tivoli
Data Warehouse 1.2 to store and aggregate data.
Tivoli Decision Support for OS/390 collects system management data from
System Management Facility (SMF), Information Management System (IMS™),
and other logs. It aggregates and summarizes data on a hourly, daily, and
monthly basis and places the data into its own database.
The Tivoli Decision Support for OS/390 database contains data primarily from
z/OS systems. Tivoli Data Warehouse 1.2 can use the Tivoli Decision Support for
OS/390 databases as an operational data source for the z/OS applications.
The flow of data between Tivoli Decision Support for OS/390 and Tivoli Data
Warehouse 1.2 can be seen in Figure 1-3.
14 Implementing Tivoli Data Warehouse 1.2