Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Take Your Infrastructure To The Next Level Of Agility And Cost Savings–Dynamic Application Infrastructure
1. Take Your Infrastructure To
The Next Level Of Agility And
Cost Savings With A Dynamic
Application Infrastructure
2. The WebSphere Application Server Family –
Special Purpose Capabilities
WebSphere
Application Server World’s first Application Server private cloud
Hypervisor Edition
WebSphere Manage performance, health, and editions of
Virtual Enterprise applications for non-stop operation
In-memory data grid for extreme transaction
WebSphere
eXtreme Scale processing
WebSphere
Compute Grid Execute and manage Java batch processes
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 2
3. SOF Needs A Flexible Infrastructure To Improve
Service Quality While Reducing Costs
I need to make sure my
My infrastructure and applications meet
labor costs keep going response time
up. How can I meet requirements and
my requirements ensure our top
without spending more? customers receive the
best service!
Data Center
Manager
CIO
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 3
4. Server Sprawl Is Out Of Control And Has
Costly Consequences
Low server resource utilization
Excessive energy usage and
heating problems
Too many software licenses
Additional staff required for
platform management
Unexplained outages
Too much complexity
Response to business
requirements is too slow
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 4
5. Dedicated Servers Are Underutilized
Provision for
expected growth
Idle
Resource
Provision capacity
for peak workload
Workload
Idle Idle
Resource Resource
Average
utilization
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
The old paradigm of one server dedicated to one
application wastes your money.
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 5
6. Server Sprawl Drives Increasing Annual
Operating Costs
Physical
Spending Worldwide IT Spending on Servers, Power, Cooling Server Installed
Base (Millions)
US$(B) and Management/Administration
$250
50
Power and Cooling Costs 45
Server Management and Admin Costs
$200 New Server Spending 40
35
$150
30
25
$100 20
15
$50 10
5
$0 0
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
Source: IDC, 2008.
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 6
7. Server Virtualization And WebSphere Can
Improve Utilization And Efficiency
Server Virtualization with PowerVM
Increases server utilization reducing hardware, software, energy
and administration costs
WebSphere Virtual Enterprise
Performance, health and application edition management for non-
stop operation
Increases server utilization reducing hardware, software, energy
and administration costs
WebSphere Cloudburst
Improves labor productivity reducing administration costs
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 7
8. Virtualization And Consolidation On IBM
Power Systems
Dedicated Servers
Consolidated images share
resources on a single
Application Power System
Linux
Application
Move workloads into Application Application Application Application
AIX Power Systems
logical partitions AIX AIX Linux Linux VIOS
POWER Hypervisor
Application
Power Systems SMP Server
Linux
Lower utilization Higher utilization
Application Higher cost Lower cost
More electricity Less electricity per unit
Linux
of work
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 8
9. POWER7 Can Virtualize These Large
Workloads, Sun Servers Can Not
How many servers are needed to
run these workloads?
Run 45 online banking 1 64-way
workloads, each driving 745 45 LPARs … Power 770
transactions per second
(3.1GHz) server
45 2 Power 750
Workloads (3.55GHz) servers
45 LPARs …
IBM WebSphere
Application Server
45 comparable
Sun servers with 8 cores
X4270, T5140, T5440, M5000
IBM Internal Study
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 9
10. POWER7 Costs Less To Run The Same
Workload As Sun Servers (Detail)
Power 770 Power 750 Sun Fire Sun SPARC Sun SPARC Sun SPARC
(1 server) (2 servers) X4270 T5140 T5440 M5000
(45 servers) (45 servers) (45 servers) (45 servers)
Hardware $455k $575k $790k $1977 $2376 $8011k
Purchase
and
Maintenance
Networking $88k $88k $122k $122k $122k $122k
Purchase
and
Maintenance
Software $513k $428k $1887k $3984k $3984 $15329k
Purchase
and
Maintenance
3-Year Total $1.06 $1.09 $2.80 $6.08 $6.84 $23.46
Cost,
millions USD
IBM Internal Study
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 10
11. Oracle VM For SPARC (Logical Domains)
Does Not Share CPU Resources
Threads are dedicated to each domain
Domains cannot share CPU resources with other domains automatically
Lost Business
Requests cannot be
processed fast enough
Loan Mortgage Banking Investment
Application Application Application Application
Solaris Solaris Solaris Solaris
4 Cores 4 Cores 4 Cores 4 Cores
32 Threads 32 Threads 32 Threads 32 Threads
Domain 1 Domain 2 Domain 3 Domain 4
Server Utilization Utilizes 3 processor
cores
Sun UltraSPARC Requires 8 cores to
16 Cores 8 Threads per core
75% process all requests,
128 Total Threads however domain
only has 4
25%
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 11
12. PowerVM Allows for Sharing of CPU
Resources
Partitions can share CPU resources from a shared pool
Improves application performance and improves server utilization
Loan Mortgage Banking Investment
Application Application Application Application
AIX AIX AIX AIX
16 Cores in Shared Pool
Power Hypervisor
Server Utilization Utilizes 3 processor
cores
POWER7 75% When workload
16 Cores spikes, application
uses 8 cores from
50% shared pool
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 12
13. PowerVM Leads In Resource Sharing Capabilities
Driving Higher Utilization And Consolidation
Resource Sharing and
Oracle VM for
Resource Allocation PowerVM
SPARC (LDom)
Factors
Micro-partitioning Yes Partial
Dedicated Shared mode Yes No
Processor sharing (Shared
Yes No
Pools)
Uncapped support Yes No
Processor over-commit Yes No
Memory sharing Yes No
Memory over-commit Yes No
Memory compression Yes No
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 13
14. IBM Sub-Capacity Software Pricing Favors
Virtualization On Power Systems
How many cores must be licensed for each software product?
On Power Systems:
Determine the lesser of virtual processor or total physical cores in
each shared processor pool
− Capped partitions may further reduce total virtual processor per pool
Add the total pools to determine the number of cores that have to be
licensed
Oracle sub-capacity pricing NOT available for UltraSPARC T Series
servers when using Logical Domains!
Oracle does not recognize Logical Domains for sub capacity pricing
Must license each processor core on physical server regardless of
domain configuration
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 14
15. How Many Licenses Are Required?
Oracle DB Licenses: DB2 Licenses:
32 VP (threads) or 4 cores on 8
Core (64 thread) system 8 VP in a 4 Core Pool
License 8 cores License 4 cores
Oracle WebLogic Licenses: WebSphere Licenses:
32 VP (threads) or 4 cores in 8
Cores (64 thread) system 10 VPs in a 4 core Pool
License 8 cores License 4 cores
Uncapped Uncapped
WAS 10 VP=1
WLS 10 - VP=1
WAS 1 VP=1
Oracle Oracle
WAS 2 VP=1
WAS 8 VP=1
WAS 9 VP=1
WAS 3 VP=1
WAS 4 VP=1
WAS 5 VP=1
WAS 6 VP=1
WAS 7 VP=1
WLS 3 - VP=8
WLS 2 - VP=8
WLS 4 - VP=2
WLS 5 - VP=1
WLS 6- VP=1
WLS 7- VP=1
WLS 8- VP=1
WLS 1- VP=8
WLS 9- VP=1
DB DB DB2 DB2
Server 1 Server 2
Server 1 Server 1
VP=4 VP=4
VP=16 VP=16
EC=1 EC=1
Sun Solaris + Logical Domain Manager Shared Pool 1 Shared Pool 2
4 Cores 4 Cores
Sun T5440 - Sun UltraSPARC T2+
8 Cores – 64 threads 8 Cores – Power 750
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 15
16. More Flexible Terms On Power Systems Saves
48% On Licensing Over Oracle/Sun
Sun T5440 Server Power 750 Server
Using Logical Domains for DB2: 400 PVUs
partitioning
− 4 Cores X 100 PVUs
Oracle DB: 8 Cores X .5 (core
factor for T2+ processor) WAS: 400 PVUs
WebLogic: 8 Cores X .5 (core − 4 Cores X 100 PVUs
factor for T2+ processor)
Oracle DB = $21,350
− Standard Edition
Cost:
− $17,500 + $3850
− DB2 WG: $50,400
WebLogic = $12,200
− Standard Edition − WAS SE: $19,100
− $10,000 + $2,200 − Total: $69,500
Cost:
− Oracle DB: $85,400
− WebLogic: $48,800
− Total: $134,200 Prices as of 03/18/2010
http://www.oracle.com/corporate/pricing/pricelists.html
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 16
17. Service Oriented Finance Needs To Meet Service
Level Agreements And Provide Non-Stop Operation
WebSphere can do this also! We
I need to better meet our
Call this “performance
Service Level Agreements management and “non-stop
and have the ability to roll operation”
out new applications without
shutting my existing Let me prove it to you!
applications down.
CIO IBM
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 17
18. WebSphere Virtual Enterprise Solves Three
Enterprise Requirements
1. Non-stop operation
Continuous availability during application maintenance
2. Performance Management
Define service policies based on response time goals
Dynamic cluster capability allocates processor capacity to the
workloads to enforce service policies
On demand router sequences incoming requests based on response
time objectives
Ensure differentiated response time objectives for classes of customers
and applications
Maintain response time objectives despite variable workload demands
3. Efficiency
Maximize server utilization
Maximize application performance
− Throughput
− Response time
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 18
19. Demo: WebSphere Virtual Enterprise
Non-stop Operation
Deploy new applications with lower risk of losing service.
Deploy application versions without interruption.
WebSphere
Application Server Edition 1.0
2.0
quiesce Node 1
& stop
restart
application
On-demand
router Active Session
requests Recovery
restart
quiesce
& stop WebSphere
Application Server Edition 1.0
2.0
Node 2
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 19
20. Response Time Management Using Service
Policies Assures Best Service
Define service level goals
with service policies
Service policies specify the
response time goals and
the relative importance of
the service policy relative to
other service policies
Application requests are
mapped to service policies
based on rules that classify,
prioritize, and intelligently
route requests to ensure
that service policies are met Service Policies define the relative importance
and response time goals of application services
Oracle and Microsoft cannot do this!
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 20
21. WebSphere Virtual Enterprise Sequences Requests To
Satisfy Differentiated Response Time Objectives
Response time objective is 1
H
second
L Response time objective is 2
seconds
Both requests require 0.5 second
to process. Response Time
Incoming Request Queue
H L2 L1 x H
1.5
L2
1.0 0.5
L1
Response time
objective not met
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 21
22. WebSphere Virtual Enterprise Sequences Requests To
Satisfy Differentiated Response Time Objectives
Response time objective is 1
H
second
L Response time objective is 2
seconds
Both requests require 0.5 second
to process. Response Time
x H
1.5
L2
1.0 0.5
L1
Response time
objective not met
Incoming Request Queue Prioritized Request Queue
L2 L1 H
On
L2 L1 Demand
H Router
1.5 1.0 0.5
All response time
objectives met
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 22
23. Create Service Policies That Provides Best
Service For Most Valuable Customers
Service Client WVE On Demand Router Shared Resource Pool
Policies Requests -Classify
-Prioritize Stock Trade
-Dispatch
If Account Balance >= $100K then Dynamic
Lost Cluster
Business
Gold Service Policy
Gold
Service 1200 ms
Policy
High Priority
Requests
Stock Trade
Lost If Account Balance < $100K then
Business Silver Service Policy
LPAR
Silver
Service 2000 ms
Policy
Service Policies
Low Priority Silver
LPAR
Requests GOLD Average
Average
Response
Stock Trade. Response Time
Time
< 1200 ms
< 2000 ms
Account
Mgmt.
1. Create Service Policies defined as response time goals Dynamic
2. Create rules that map application requests to service Cluster
policies based on contents of request
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 23
24. WebSphere Virtual Enterprise -
Maintain Response Time Objectives
Service Client WVE On Demand Router Shared Resource Pool
Policies Requests 1. Classify Requests
2. Prioritize Requests
3. Dispatch Requests Stock Trade
Dynamic
Lost Cluster
Business
Response
Time 1200 ms
Goal Response Time
Increases Due
To Demand High Priority
Requests
Stock Trade
Lost
Business
Response Start
Time 2000 ms App
Goal
Low Priority
Requests
Account Mgmt.
High priority workload maintains Account
Mgmt.
response time objectives Dynamic
despite increasing demand Cluster
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 24
25. WebSphere Virtual Enterprise -
Maintain Response Time Objectives
Service Client WVE On Demand Router Shared Resource Pool
Policies Requests 1. Classify Requests
2. Prioritize Requests
3. Dispatch Requests Stock Trade
Dynamic
Lost Cluster
Business
Response
Time 1200 ms
Goal
High Priority
Requests
Stock Trade
Lost
Business
Response
Time 2000 ms
Goal
Low Priority
Requests
Account Mgmt. Start
App
High priority workload maintains Account
Mgmt.
response time objectives Dynamic
despite server failure Cluster
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 25
26. Ideal Behavior Of An Efficient System
In an environment with multiple applications experiencing
different workloads an ideal system would exhibit the
following properties:
Maximize throughput
Minimize response time
Capable of utilizing all available system resources with
minimum overhead
Equitable resource sharing
− Requests with same priority should have similar throughput and
response time
WebSphere Virtual Enterprise can achieve these properties!
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 26
27. WebSphere Virtual Enterprise Throughput Is Best
And Utilization Is Highest
Comparison of Aggregate Throughput
and Server Utilization
250 100%
200 82%
200 80%
Server Utilization
162 70%
157 63%
Throughput
150 60%
100 40%
50 20%
0
1) WAS Pinned 2) WAS ND Pinned 3) WVE
Aggregate Workload Utilization
Download white paper describing study:
https://www14.software.ibm.com/webapp/iwm/web/signup.do?source=sw-app&S_PKG=wveaddsvalue&S_TACT=109HE36W&S_CMPve
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 27
28. WebSphere Virtual Enterprise Response Time Is
Best – Up To 31% Better Than Other Scenarios
Comparison of Response Times
0.3 WVE has lowest
aggregate
response time
Respone Time (seconds)
0.2
0.1
0
1a) WAS Pinned 2a) WAS ND Pinned 3) WVE
Aggregate Workload
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 28
29. WebSphere Virtual Enterprise Delivers The Best
Performance And Non-Stop Operation
Total transactions Non-Stop
WebSphere per second Operation
Virtual
Enterprise
Workload A, 1x demand
Workload B, 3x demand 3375 Yes
Workload C, 90x demand
POWER7- 8 cores
Three applications: With virtualization
equal priority,
different demand
Oracle WebLogic
Server Enterprise
Workload A, 1x demand
Workload B, 3x demand 2150 No
Workload C, 90x demand
HP Nehalem - 8 cores
With VMware
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 29
30. WebSphere Virtual Enterprise and Server Virtualization
Together Provide Most Flexible Dynamic Infrastructure
Reduced Hardware
Improved H/W Mgmt
Dynamic Adjustment
Adjust placement of WAS servers
Adjust resources (i.e. CPU) Route requests
HW high-availability
Application High-
availability
Service Level
Management
Improved Application
Management
Lower Operational
Costs
WLM for any
workload
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 30
31. Service Oriented Finance Needs To Control
Growing IT Labor Costs
My labor costs are Virtualization, standardization
and automation are key to
going through the controlling rising labor costs!
roof!
WebSphere Cloudburst can
solve this problem!
How can I better
control the ever
rising costs?
CIO IBM
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 31
32. Leverage WebSphere Cloudburst Appliance
For Faster, More Flexible Deployments
New class of hardware appliance for data
centers WebSphere Cloudburst
Appliance
Secure, self-service cloud management
device
Dispenses hardened WAS patterns into a
pool/cloud of virtualized hardware running
a supported hypervisor (e.g. VMware)
Patterns leverage 10 years of WAS best
practices deployment and configuration
experience
Enables consistent and repeatable
deployment of application environments
based on patterns (e.g. single server,
multi-tier, etc.)
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 32
33. Deployment Study:
WebSphere Cloudburst vs. Manual Installation
WebSphere CloudBurst Appliance
Manual
Gigabit Ethernet Install
VM1 VM1
VMware ESX 3.5 VMware ESX 3.5
IBM eServer x365 Dual Core Intel Xeon3.0 GHz IBM eServer x365 Dual Core Intel Xeon3.0 GHz
12 GB Memory 12 GB Memory
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 33
34. WebSphere Cloudburst Appliance Is Fastest!
Minutes To Install Websphere Single Server
150 139
53%
Minutes
100 less
65 91%
less
50 80%
less 13
0
Manual Install Cloudburst 1st Time Cloudburst 2nd Clone
Deployment Approaches
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 34
35. Deployment Details From 1st Manual Install
Deployment/Install Task Time
SLES 10 SP2 Linux OS Install 40 Mins
Upload and update Virtual Image to ESX Server 45 Mins
Install WAS 7 (including unzip) 7 Mins
Install IBM HTTP Server 3 Mins
Install Web Server Plugin 3 Mins
Install WebSphere Update Installer 1 Min
Install WebSphere + JDK Fixpack 3 15 mins
Install SCA Feature Pack + Fixpack 4 mins
Install Web 2.0 Feature Pack 4 mins
Download/Install ISA Lite 3 mins
Deploy Application using WebSphere Admin Console 10 mins
Restart WebSphere 4 mins
TOTAL TIME TO RUN APPLICATION MANUALLY 139 Minutes
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 35
36. Deployment Details From 1st Cloudburst Install
Deployment/Install Task Time
Connect Cloudburst with VMware Server 15 minutes
Create enterprise application package 1 Minute
Upload enterprise application package 1 Minute
Add parameters to script 30 Seconds
Create new pattern 30 Seconds
Update pattern with Single Server Image + Script 30 Seconds
Save pattern 30 Seconds
Deploy new Pattern with enterprise application 46 minutes
TOTAL TIME TO RUN APPLICATION MANUALLY 65 Minutes
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 36
37. Deployment Details From 2nd And Subsequent
Cloudburst Install
Deployment/Install Task Time
Connect Cloudburst with VMware Server 0 minutes
Create enterprise application package 0 Minute
Upload enterprise application package 0 Minute
Add parameters to script 0 Seconds
Create new pattern 0 Seconds
Update pattern with Single Server Image + Script 0 Seconds
Save pattern 0 Seconds
Deploy new Pattern with enterprise application 13 minutes
TOTAL TIME TO RUN APPLICATION MANUALLY 13 Minutes
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 37
38. Service Oriented Finance –
Enterprise Application Overview
WebSphere
Application
Server V 7
Client
JMS
Queue
VMware Image
Clients submit Loan Application form using web application
Application form stored in JMS Queue for further processing
Application running on WebSphere Application Server on VMware
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 38
39. Demo: Deploying A New WebSphere
System In The Cloud
Select
WebSphere CloudBurst Appliance
Pattern
CloudBurst Downloads
Application
CloudBurst WAS HE
Downloads
VM Image
Private
Virtual Image
CloudBurst Cloud
Downloads
Customization
Information CloudBurst Issues
Deploy Image
Command
WAS Installs
Application
ESX Applies
Customization WAS
Linux
ESX Installs
WAS HE
Virtual Machine ESX
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 39
40. Virtualization, Standardization And
Automation Can Reduce Labor Costs
Total Hardware Total Software
Labor Hours Labor Hours
# of
Software Software
Hardware # of
Stack Images Total
Labor Hours Physical + =
Labor Hours Clone Labor Hours
32 Hrs (Intel) Servers
64 Hrs (Power) 36 Hrs Factor (per year)
C
The greater the Automation can The more images you
consolidation you reduce this can standardize and
can achieve, the labor clone, the lower you
lower you can drive component can drive software
hardware labor hours labor hours
Note: labor model best fitted to field data
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 40
41. Total Hardware And Software Labor Hours For 45
Workloads Over 3 Years
10,000
Total Hardware and Software
9,000
Labor Hours Over 3 Years
8,000
45%
7,000 less
6,000
5,000 96%
4,000 less
3,000 77%
less
2,000 67%
less
1,000
0
Distributed Virtualized Virtualized + Virtualized +
(Intel) (POWER) Standardized Standardized
(C=5) (C=5) +
One full time equivalent person (FTE) = 2080 labor hours per year
Automation
06 Take Your Infrastructure to the Next Level of Agility and Cost Savings 41