POWER VM with IBM i and live partition mobility

IBM Power Systems

IBM i PowerVM Virtualization with VIOS and Partition Mobility for IBM i

Gottfried Schimunek
3605 Highway 52 North
Senior Architect Rochester, MN 55901
Application Design
IBM STG Software Tel 507-253-2367
Development Fax 845-491-2347
Lab Services
Gottfried@us.ibm.com
IBM ISV Enablement

© 2012 IBM Corporation

IBM Power Systems

Acknowledgements

Thanks to Kris Whitney for providing this comprehensive and detailed presentation

2 © 2012 IBM Corporation

1

IBM Power Systems

PowerVM: Virtualization Without Limits
Sold with more than 70% of Power Systems

Improves IT resource utilization

Reduces IT infrastructure costs

Simplifies management


IBM Power Systems

PowerVM Technologies
The leading virtualization platform for UNIX, i and Linux enables a
more agile and responsive infrastructure

Hypervisor
Support for multiple operating environments
Dynamic Logical Partitioning VIOS
Micro-partitioning, resource movement
Multiple Shared Processor Pools Power Hypervisor
Cap processor resources for a group of partitions
Virtual I/O Server
Virtualizes resources for client partitions
Integrated Virtualization Manager
Simplifies partition management for entry systems
Lx86
Supports x86 Linux applications
Live Partition Mobility
Move running AIX and Linux partitions
System Planning Tool
Simplifies the planning for and installation of Power servers with
PowerVM


2

IBM Power Systems

PowerVM Editions: Built to Meet Client Virtualization Needs
PowerVM Editions Express Standard Enterprise

Maximum LPARs 1+2 / Server 10 / Core 10 / Core
PowerVM Express Edition
– Evaluations, pilots, PoCs VMControl VMControl VMControl
Management
– Single-server projects IVM IVM, HMC IVM, HMC
PowerVM Standard Edition Virtual I/O Server
– Production deployments PowerVM Lx86
– Server consolidation
Multiple Shared
PowerVM Enterprise Edition Processor Pools
– Multi-server deployments
– Cloud infrastructure Suspend/Resume


Active Memory Sharing
PowerVM Editions
offer a unified
virtualization
solution for any
Power workloads


IBM Power Systems

Evolution towards: Fully Virtualized, Simplified, Lower cost
+ Mobility of Virtual Machines
+Mobility of workloads with automated and
+ Manually intensive server/storage/network mobility
integrated server, network & storage
management
provisioning
+ VM-based Availability/Resilience Mgmt
+ Workload-based Availability/Resilience
+ Storage Pools Mgmt
+ IO virtualization and virtual switching + Converged Datacenter Network fabric
+ Hypervisor clustered fs access to virtual storage + Storage Pools with advanced capabilities
• Physical resource discovery / configuration / (cloning, snapshot, thin provisioning, …)
provisioning / update / system health
SW SW + Managing to QoS Policies (intelligent
• OS provisioning OS OS Virtl NW placement)
• Virtual IO + VM Security Appliance
Virt Storage
• Virtual Machine lifecycle mgmt
VM/LPAR VM/LPAR Virtual IO Svr
• Dynamic resource optimization within a Image Library
Virtualization Virtual Appliance Image
physical system Deployment App
Image
vSwitch App
Image
Storage AppOS
Image
• VLAN Network App
OS
Compute Memory OS
OS
• External virtualized storage
• External virtualized switches
Shared Network
Workload Mobility

SW SW Shared Storage
OS OS Virtl NW

Virt Storage SW
OS Virtl NW
Virtual Server Virtual Server Virtual IO Svr

Virtualization Virt Storage

VM/LPAR Virtual IO Svr Optimized for ….
Virtualization • Availability
Compute Memory • Performance
vSwitch
• Energy
Storage Network
Compute Memory
Emerging: Virtual Appliances
Storage Network
Maturing: Multi-system & Workload mobility within
Established: Physical systems with virtualization managed across scalable and centrally managed
local virtualization Physical Servers System Pools (Ensembles)
6/12/2012

3

IBM Power Systems

Two I/O Server Options

IBM i IBM i
VIOS IBM i
Hypervisor
Hypervisor
POWER6
POWER6

• Built into IBM i •VIOS Server
•Host Disk, Optical, Tape
•Host Disk, Optical, Tape
•Consolidate Ethernet Traffic •Bridge Ethernet Traffic
•Same technology as hosting AIX, •Attach external storage
Linux, and iSCSI
•Advance Virtualization Functions

IBM Power Systems

IBM i Hosting IBM i

IBM i-based Virtualization
– IBM i partition uses I/O resources from another IBM i
partition
– Eliminates requirement to buy adapters and disk drives IBM i IBM i
for each IBM i partition
– Supports simple creation of additional partitions …. e.g.,
for test and development Hypervisor
– Requires POWER6 server with IBM i 6.1 POWER6
– Can mix virtual and direct I/O in client

Platform support
– Most IBM Power6 servers (except blade)

Storage support
– Determined by host IBM i partition ( EXP24, 12S, other
integrated disk and native attached external storage)

LPAR management
– HMC

* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.


4

IBM Power Systems

IBM i 6.1 Host and Client Partitions: Overview
Requirements
– POWER6 hardware
IBM i Host IBM i Client – IBM i 6.1 on host and client
– PowerVM not required
– HMC
DDxx DDxx DASD
– Hardware assigned to host LPAR in
HMC
FC 5294 – DASD can be integrated or SAN
– DASD virtualized as NWSSTG objects
NWSSTGs

Optical
– DVD drive in host LPAR virtualized
Virtual SCSI
directly (OPTxx)
EXP24/12S connection
– Optical IMGCLG in host LPAR may be
virtualized
OPTxx
Networking
DVD – Network adapter (such as HEA) and
OPTxx Virtual Ethernet adapter in host LPAR
DVD – Virtual Ethernet adapter in client LPAR
CMNxx
Virtual LAN Tape
IVE – New support as of 7.1 TR2
connection
DS8000


IBM Power Systems

Virtualizing disk storage with IBM i or VIOS
Redundant IBM i or VIOS hosts provide access SAN or
internal storage
– AIX, IBM i, and Linux client partitions
– Client LPAR protects data via mirroring
– Two sets of disk and adapters

Single IBM i or VIOS host provides access to
SAN or internal storage
– AIX, IBM i, or Linux client partitions
– Protect data via RAID-5, RAID-6, or
RAID-10

Redundant VIOS hosts multiple paths to attached SAN
storage with MPIO
– AIX, IBM i, and Linux client partitions
– One set of disk


5

IBM Power Systems

IBM i Host VSCSI Virtual Optical

-Load images into the IMGCLG on -Utilize them to install or save to in the
the Server. Client.
- Share the physical DVD/CD in the -Automatic switching of images
Server


IBM Power Systems

IBM i Hosting IBM i Positioning
Same technology as IBM i hosting AIX, LINUX, and
iSCSI x86 servers
Leverage existing hardware investment
– Create new IBM i 6.1 LPARs using only virtual IBM i IBM i
hardware (No IOAs, IOPs, disk units, I/O slots
necessary for client partitions), but may also use
Hypervisor
physical I/O.
POWER6
Rapidly deploy new workloads
– Virtual disk created with 1 command or several
clicks in System i Navigator
– New LPAR, virtual resources deployed
dynamically
Create test environments without hardware
provisioning
– Virtual resources allow new test environments of exact
size to be created, deleted without moving hardware
– Test new applications, tools, fixes in virtual test LPAR
– Test the next release in the client partition

* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.


6

IBM Power Systems

VIOS-based Virtualization

– IBM i partition uses I/O resources from Virtual I/O
Server (VIOS)
– VIOS is included with all PowerVM Editions.
– Requires POWER6 systems with IBM i 6.1
VIOS IBM i
Platform support Hypervisor
– IBM Power servers
– IBM BladeCenter JS12 , JS22, JS23, JS43, PS701, POWER6
PS702
Storage support
– Enables attachment to DS3000, DS4000, DS5000,
Storewize V7000, SVC, XIV, DS8000
– Direct Attach Storage (Internal Storage)
• SSD
LPAR management
– HMC or IVM

Integrated Virtualization Manager
– Software for creating and managing
partitions, part of VIOS
– Requires IBM i to use only virtual I/O
resources

IBM Power Systems

What is the VIOS?
A special purpose appliance partition
– Provide I/O virtualization
– Advanced Partition Virtualization enabler
First GAed 2004
Built on top of AIX, but not an AIX partition
IBM i first attached to VIOS in 2008 with the IBM i 6.1
VIOS is licensed with PowerVM


7

IBM Power Systems

Why use the VIOS?

I/O Capacity Utilization
Storage Allocation Flexibility
Ethernet Flexibility
Memory Sharing
Suspend/Resume
Mobility


IBM Power Systems

I/O Virtualization on POWER
I/O Bus Virtualization I/O Adapter Virtualization
with Dedicated Adapters with VIO Server
VIOS LPAR
LPAR A LPAR B
LPAR A LPAR B
Physical Physical
Adapter Adapter Physical
DevDrv DevDrv Adapter Virtual Virtual Virtual Virtual
Increasing Adapter Adapter Adapter Adapter
Adapter BW
DevDrv Server Server DevDrv DevDrv
& LPAR
Hypervisor Density
per Slot Virtual Fabric
Hypervisor
Func Func
PCI adapter
PCI adapter Func

Port Port PCI adapter

Port

Fabric
Fabric


8

IBM Power Systems

IBM i + VSCSI (Classic)
Source
System 1
VIOS IBM i Client IBM i Client IBM i Client
(System 1) (System 2) (System 3)

System 2
FC HBA

System 3

6B22 6B22 6B22
Device Device Device
•Assign storage to the physical HBA Type Type Type
in the VIOS
•Hostconnect is created as an open
storage or AIX hosttype,
•Requires 512 byte per sector LUNs
to be assigned to the hostconnect
•Cannot Migrate existing direct
connect LUNs Hypervisor
•Many Storage options supported

POWER6 with IBM i 6.1.1


IBM Power Systems

IBM i + VSCSI (Classic) Storage Virtualizer

VIOS IBM i Client
•Storage is assigned to
the VIOS partition
•Within the VIOS you FC HBA
map the hdisk (lun) to
the vhost corresponding
to the client partition
6B22
•Storage management Device
allocation is done from Type
vhostXXX hdisk1
both the external storage
hdisk2
box and the VIOS VSCSI VSCSI
SERVER Client
•Flexible disk sizes up to
2Tb -512
•16 disks per vscsi Hypervisor
adapter



9

IBM Power Systems

IBM i + VSCSI File Backed Disks

VIOS IBM i Client
the VIOS partition
FC HBA
•Within the VIOS you fbDisk1

map the logical volume fbDisk2
fbDisk3
backed or file backed
virtual disks to the vhost 6B22
corresponding to the
vhostXXX fbDisk1 Device
client partition fbDisk2 Type
fbDisk3
•Allows more granular
use of the virtual disk VSCSI VSCSI
SERVER Client
•Flexible disk sizes up to
2Tb -512
•Not supported for Hypervisor

suspend/resume or
mobility


IBM Power Systems

IBM i + VSCSI Tape and optical

VIOS IBM i Client
the VIOS partition CD1
OPT01
•Within the VIOS you
map physical tape or
optical or file backed RMT1
TAP01
virtual optical to the
vhost corresponding to
vhostXXX cd1
the client partition rmt1

•No tape library support
with vscsi adpaters. VSCSI VSCSI
Must use VFC adapers. SERVER Client

Hypervisor



10

IBM Power Systems

IBM i + NPIV ( Virtual Fiber Chanel )
Source
System 1

VIOS IBM i Client IBM i Client IBM i Client
(System 1) (System 1) (System 1)
System 2
8Gbs HBA

System 3

•Hypervisor assigns 2 unique
WWPNs to each Virtual fiber
Virtual address example C001234567890001
•Hostconnect is created as an
iSeries hosttype, Hypervisor

•Requires 520 byte per sector LUNs POWER6 with IBM i 6.1.1
to be assigned to the iSeries
hostconnect on DS8K
•Can Migrate existing direct connect
LUNS
•DS8100, DS8300, DS8700,
Note: an NPIV ( N_port ) capable switch is required to connect the
DS8800, DS5100 and DS5300
VIOS to the DS8000 to use virtual fiber.
supported


IBM Power Systems

NPIV Concepts Multiple VFC server adapters may map to
the same physical adapter port.

Each VFC server adapter connects to one
VFC client adapter; each VFC client
adapter gets a unique WWPN.

Client WWPN stays the same regardless of
physical port it is connected to.

Support for dynamically changing the
physical port to virtual port mapping.

Clients can discover and manage physical
devices on the SAN.

VIOS can’t access or emulate storage, just
provides clients access to the SAN.

Support for concurrent microcode download
to the physical FC adapter


11

IBM Power Systems

NPIV Configuration - Server Adapter Mappings


IBM Power Systems

NPIV Configuration - Limitations
Single client adapter per physical port per partition
– Intended to avoid single point of failure
– Documentation only – not enforced

Maximum of 64 active client connections per physical port
– It is possible to map more than 64 clients to a single adapter port
– May be less due to other VIOS resource constraints

32K unique WWPN pairs per system platform
– Removing adapter does not reclaim WWPNs
• Can be manually reclaimed through CLI (mksyscfg, chhwres…)
• “virtual_fc_adapters” attribute
– If exhausted, need to purchase activation code for more
Device Limitations
– Maximum of 128 visible target ports
• Not all visible target ports will necessarily be active
• Redundant paths to a single DS8000 node
• Device level port configuration
• Inactive target ports still require client adapter resources
– Maximum of 64 target devices
Any combination of disk and tape
24 Tape libraries and tape drives are counted separately © 2012 IBM Corporation

12

IBM Power Systems

NPIV Performance

N P IV vs D irect Attach (D S 8300)

0.01

0.009

0.008
Application Response Time

0.007

0.006

0.005

0.004

0.003

0.002

0.001

0
0 20 40 60 80 100 120
CP W Use rs

npiv run2 direc t attac h


IBM Power Systems

IBM i + NPIV ( Virtual Fiber ) with PowerHA
Source
SYSBAS

VIOS 1 IBM i Client 1 IBM i Client 2
IASP VIOS
8Gbs HBA

SYSBAS

IASP

Each port is assigned separate
WWPNs by the Hypervisor Hypervisor
Each port is seen as a separate
adapter by IBM i – so PowerHA reset it
individually.
Reduces the hardware for a single
partition from 4 to 2 adapters for
•Note, This configuration can support up to 64 IBM i partitions without adding
PowerHA
any more adapters


13

IBM Power Systems

PowerHA in the Virtual I/O Environment

With VSCSI
– All Logical replication solutions supported including iCluster
– PowerHA for i - Geographic mirroring
– PowerHA for i – Storwize V7000 Metro and Global Mirror support
(4Q2011)

With NPIV
– All Logical replication solutions supported including iCluster
– PowerHA for i - Geographic mirroring
– PowerHA for i – Storwize V7000 Metro and Global Mirror support
(4Q2011)
Plus:
– DS8000 Metro Mirroring
– DS8000 Global Mirroring
– DS8000 Lun level switching


IBM Power Systems

Fibre Channel Tape library support with NPIV

+

•10/2009 with 6.1.1 •2/2010 with 6.1.1

•3584 (TS3500) with LTO drives •3577 (TS3400) with (TS1120/TS1130 ) drives

•3573 (TS3100 TS3200) with LTO •3584 (TS3500) with (TS1120/TS1130 ) drives
drives •3576 (TS3310) with LTO drives
•TS7650, TS7610

14

IBM Power Systems

Redundant VIOS with NPIV
POWER6
Step 1: configure virtual and physical FC adapters
– Best Practice to make VIOS redundant or
separate individual VIOS partitions where a
IBM i single hardware failure would not take down
IASP SYSBAS both VIOS partitions.
Client
VFC
adapters
Server
VFC Step 2: configure SAN fabric and storage
adapters – Zone Luns to the virtual WWPNs.
– Each DASD sees a path through 2 VIOS
partitions

1
VIOS VIOS

•Notes: Support up to 8 paths per LUN
•Not all paths have to go through
separate VIOS partitions.
•New multi-path algorithm in 7.1 TR2
2
Physical FC
connections


IBM Power Systems

VIOS – Storage attach

Three categories of storage attachment to IBM i through VIOS

1) Supported (IBM storage)
- tested by IBM; IBM supports the solution and owns resolution -
IBM will deliver the fix

2) Tested / Recognized (3rd party storage including EMC and Hitachi)
- IBM / storage vendor collaboration, solution was tested (by vendor, IBM, or both);
- CSA in place, states that IBM and storage vendor will work together to resolve the issue
- IBM or storage vendor will deliver the fix

3) Other
- not tested by IBM, maybe not have been tested at all
No commitment / obligation to provide fix

Category #3 (Other) was introduced in the last few years, “other” storage used to
invalidate the VIOS warranty. IBM Service has committed to provide some limited level of
problem determination for service requests / issues involving "other” storage. To the
extent that they will try to isolate it to being a problem within VIOS or IBM i, or external to
VIOS or IBM i (ie. a storage problem). No guarantee that a fix will be provided, even if the
problem was identified as a VIOS or IBM i issue


15

IBM Power Systems

Support for IBM Storage Systems with IBM i
DS3200
DS4700
Table as of N Series DS3400 Storwize DS5100 DS8100 DS8700
DS4800 DS6800 SVC XIV
April 5, 2011 @@ DS3500 V7000 DS5300 DS8300 DS8800
DS5020
DS3950
6.1 / 7.1 5.4 / 6.1

IBM i POWER6/7 POWER5/6/7
5.4 / 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 5.4 / 6.1 / 7.1 5.4 / 6.1 / 7.1
Version
Rack / Hardware
POWER5/6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER5/6/7 POWER5/6/7
Not DS3200#, Not 7.1 ###
Tower
Yes DS3500## POWER5/6/7
Systems
Direct* or VIOS Direct or VIOS – Direct or VIOS –
IBM i IFS / NFS
VIOS VIOS VIOS –VSCSI and Direct VIOS VIOS VSCSI and VSCSI and
Attach (NAS) NPIV% NPIV** NPIV**

6.1 / 7.1 6.1 / 7.1
IBM i 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1
POWER6/7 POWER6/7 @, Not
Version POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7
IFS / NFS #, ## supported
Power Hardware (BCH) (BCH) (BCH) (BCH) (BCH) (BCH) (BCH)
Blades (NAS)
IBM i IFS VIOS VIOS
VIOS VIOS VIOS VIOS n/a VIOS VIOS
Attach (NAS) NPIV** NPIV**
Notes
- This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations
- POWER7 servers require IBM i 6.1 or later
- This table can change over time as addition hardware/software capabilities/options are added
# DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS
## DS3500 has either SAS or Fibre Channel connection. Ractk/Tower only uses Fibre Channel. Blades support either SAS or Fibre Channel (either BCS or BCH)
### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support
* Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters
** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches
@ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500
@@ N Series can only be used as file server. No load source/boot support. Support only through IFS. No IBM i data base support
% NPIV support for DS5100/DS5300 requires IBM i 7.1 TR2 and must have POWER7 firmware: Ax730_xxx or the POWER6 firmware Service Pack that will be
released 2Q2011

For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/
Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information

IBM Power Systems

IBM PowerVM Virtual Ethernet

Virtual I/O Server Client 1 Client 2

PowerVM Ethernet switch
Shared
– Part of PowerVM Hypervisor Ethernet
Adapter
– Moves data between LPARs
CMN CMN CMN CMN
(Phy) (Vir) (Vir) (Vir)

Shared Ethernet Adapter
– Part of the VIO server
VLAN-Aware Ethernet Switch
– Logical device
PowerVM Hypervisor
– Bridges traffic to and from
external networks

Ethernet
Switch
Additional capabilities
– VLAN aware
– Link aggregation for external networks
– SEA Failover for redundancy

16

IBM Power Systems

SEA Failover Configuration

VIOS VIOS Partition Partition
SEA

SEA
VETH

VETH

VETH

VETH

VETH
VETH
VETH
ETH
ETH

Hypervisor

Client
Network
network


IBM Power Systems

Virtual Ethernet Limits

Description Limit

Maximum virtual Ethernet adapters per LPAR 256

Maximum number of VLANs per virtual adapter 21 VLAN (20 VID, 1
PVID)

Number of virtual adapter per single SEA sharing a 16
single physical network adapter

Maximum number of VLAN IDs 4094

Maximum number of physical adapters in a link 8 primary, 1 backup
aggregation


17

IBM Power Systems

PowerVM Active Memory Sharing

Reduce memory costs by improving memory utilization on Power Servers

Supports over-commitment of logical memory
with overflow going to a paging device
POWER Server

Intelligently flow memory from one partition to Virtual
another for increased utilization and flexibility I/O
Dedicated Server
Memory
Shared Memory

Memory from a shared physical memory pool is
dynamically allocated among logical partitions
as needed to optimize overall memory usage
CPU Shared CPU

Paging
Designed for partitions with variable memory
requirements
PowerVM Hypervisor AMS

PowerVM Enterprise Edition on POWER6 and
Power7 processor-based systems

– Partitions must use VIOS for I/O virtualization
* All statements regarding IBM's future direction and intent are subject to change or
35 withdrawal without notice, and represent goals and objectives only. © 2012 IBM Corporation

IBM Power Systems

AMS Geographic Mirroring Environment
SAS
JS12 in BladeCenter

DS3200
VIOS IBM i IBM i

DS3200
DS3K

Paging
Devices
BCS3B2P1 BCS3B2P2 BCS3B2P3

MEMORY
5 drive 5 drive
sysbas sysbas

16 GB Total IBM i 1 10 drives 10 drives
IBM i 2
Physical
12 GB 12 GB IASP Geographic IASP
Mem
Mirroring

18

IBM Power Systems

LPAR Suspend/Resume – Customer Value

Resource balancing for long-running batch jobs
– e.g. suspend lower priority and/or long running workloads to free resources.

Planned CEC outages for maintenance/upgrades
– Suspend/resume may be used in place of or in conjunction with partition
mobility.
– Suspend/resume may require less time and effort than manual database
shutdown and restart, for example

Requirements:
• All I/O is virtualized
• HMC version 7 releases 7.3
• FW: Ax730_xxx
• IBM i 7.1 TR2
• VIOS 2.2.1.0 FP24 SP2


IBM Power Systems

Partition Suspend/Resume Partition Suspend/Resume supported on POWER7
IBM i 7.1 TR2

Power7 System #1
Storage
Suspended Partition
IBM i Client 1 Subsystem
Validate environment
for appropriate
resources

A
en0 Ask partiton if it’s
(if)
ready for suspend
vscsi0 ent1
Suspend Partition ReservedStorage Pool
CPU and I/O LUN

M M M M M M Move Memory and CPU
VLAN to Storage Pool
C C C

Hypervisor
Partition Suspended
VASI vhost0 ent1
A
Mover ent2 en2
Service vtscsi0
SEA (if)

fcs0 ent0 VIOS


19

IBM Power Systems

Move a running partition from one Power7 server to
another with no application downtime

Movement to a
different server
with no loss of
service

Virtualized SAN and N etwork Infrastructure
Virtualized SAN and N etwork Infrastructure

Reduce planned downtime by moving Rebalance processing power
workloads to another server during across servers when and
system maintenance where you need it

Live Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition

IBM Power Systems

PowerVM Live Partition Mobility R4
1T
i 7.
IBM
• Move running partition from one system to Live Partition Mobility
another with almost no impact to end users

• Requires POWER7 systems or later, PowerVM
Enterprise, and all I/O must be through the Movement of the
OS and
Virtual I/O Server applications to a
different server
with no loss of
service

• Will require IBM i 7.1 with TR4

Virtualized storage and Network Infrastructure
Virtualized storage and Network Infrastructure

Potential Benefits
• Eliminate planned outages
• Balance workloads across systems
• Energy Savings


20

IBM Power Systems

Requirements & Planning

Source and destination must be mobility capable and
compatible.
– Enhanced hardware virtualization capabilities.
– Identical or compatible processors. HMC
– Compatible firmware levels.

Source and destination must be LAN connected – same
subnet. LAN
LPAR
All resources (CPU, Memory, IO adapters) must be
virtualized prior to migration.
– Hypervisor will handle CPU and Memory
automatically, as required. Virtual IO adapters SAN
are pre-configured, and SAN-attached disks
accessed through Virtual IO Server (VIOS)
Boot
Paging
Source and destination VIOS must have symmetrical access Application Data
to the partition’s disks.
– e.g. no internal or VIOS LVM-based disks.

OS is migration enabled/aware.
– Certain tools/middleware can benefit from being
migration aware also.


IBM Power Systems

Partition Mobility: Active and Inactive LPARs
Active Partition Mobility
Active Partition Mobility
Active Partition Migration is the actual movement of a running LPAR from one
Active Partition Migration is the actual movement of a running LPAR from one
physical machine to another without disrupting the operation of the OS and
physical machine to another without disrupting the operation of the OS and
applications running in that LPAR.
applications running in that LPAR.

Applicability
Applicability
Workload consolidation (e.g. many to one)
Workload consolidation (e.g. many to one)
Workload balancing (e.g. move to larger system)
Workload balancing (e.g. move to larger system)
Impending CEC outages (e.g. hardware warning received)
Impending CEC outages (e.g. hardware warning received)
Ability to move from Power7 servers to Power8 servers (when available)
Ability to move from Power7 servers to Power8 servers (when available)
without an outage
without an outage

Inactive Partition Mobility
Inactive Partition Mobility
Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not
Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not
running) from one system to another.
running) from one system to another.

Suspended Partition Mobility
Suspended Partition Mobility
Suspended Partition Migration transfers a partition that is suspended from one
Suspended Partition Migration transfers a partition that is suspended from one
system to another.
system to another.


21

IBM Power Systems Requirements

Software

SDMC/HMC/Firmware
version 7 releases 7.5
FW: 7.3.X SP, 7.4.X
PowerVM Enterprise Edition
VIOS 2.2.1.4
Supported client operating systems I/O
IBM i 7.1 TR4 All I/O through the VIOS
VSCSI, NPIV, VE
External Storage
Same storage to both source and
destination
Power7 Hardware
Both source and destination on same
Ethernet network

IBM Power Systems

Live Partition Mobility Partition Mobility supported on POWER7
IBM i 7.1 TR4

Power7 System #1 Power7 System #2
Suspended Partition
IBM i Client 1 Shelli Partition
IBM Client 1
Once enough memory
Finish the migration
M M M M M M M Validate environment M M M M M M M
Create remove SCSI
Create virtualbeen
pages migrating
and shell partition
Start have the
for appropriate
moved, suspend the
on target system
memory LPAR
original pages
devices
resources
source system
definitions
A LIN1 LIN1 A

DC01 CMN01 CMN01 DC01
HMC
VLAN VLAN
Hypervisor Hypervisor

VASI vhost0 ent1 ent1 vhost0 VASI

Mover ent2 en2 en2 ent2 Mover
Service vtscsi0 vtscsi0 Service
SEA (if) (if) SEA

fcs0 ent0 VIOS VIOS ent0 fcs0

Storage
Subsystem

A


22

IBM Power Systems

If using 5250 interactive support, ensure both the source and target systems
have the "5250 application capable" set to “True”.


IBM Power Systems

Configuration


23

IBM Power Systems

VIOS - Mover service partition (MSP)

Required for ACTIVE Partition Mobility only

Maximum of four (4) concurrent migrations per control point

Provides VIOS functions:
– Asynchronously extracts, transports, installs partition state during
migrations


IBM Power Systems


24

IBM Power Systems


IBM Power Systems

IBM i Restrictions
The logical partition must have all disks backed by physical volumes.
The logical partition must not be assigned a virtual SCSI optical or tape device or an
NPIV attached tape device.
The logical partition cannot be activated with a partition profile which has a virtual
SCSI server adapter: can not be hosting another partition.
The logical partition cannot be activated with a partition profile which has a virtual
SCSI client adapter that is hosted by another IBM i logical partition: can not be a
hosted partition.
No virtual SCSI server adapters can be dynamically added to the logical partition.
No virtual SCSI client adapters that are hosted by another IBM i logical partition can
be dynamically added to the logical partition being moved.
The logical partition must not be an alternative error logging partition.
– An alternative error logging partition is a target from the HMC for error logs.
The logical partition cannot collect physical I/O statistics.
The logical partition must not be a time reference partition.
– Used to synchronize time between partitions
• The VIOS partitions will do this automatically as part of the migration


25

IBM Power Systems

IBM i + VSCSI Zoning Source

VIOS IBM i Client
System 1 (System 1)
FC HBA

Hypervisor
POWER7 with IBM i 7.1 TR4
Destination
VIOS
All zoning is done to the
FC HBA physical HBA in the VIOS
Assign storage to the physical
HBAs in both the VIOS lpars
Make sure to set no_reserve on
the hdisks (chdev -dev hdiskX -
attr reserve_policy=no_reserve)
Hypervisor
POWER7 with IBM i 7.1 TR4

IBM Power Systems

IBM i + NPIV Zoning for Mobility
Source
System 1
VIOS IBM i Client
(System 1)

8Gbs HBA

Hypervisor 1. Zone your storage
POWER7 with IBM i 7.1 TR 4
ports to both WWPNs
VIOS
on the Virtual Fibre
Destination
Channel Adapter.
8Gbs HBA
2. Zone both source and
target VIOSes to see the
same FC targets
Hypervisor 3. Only assign storage to
POWER7 with IBM i 7.1 TR 4
the virtual WWPNs

26

IBM Power Systems

Processor Pool assignment upon Migration?


IBM Power Systems

Questions


27

IBM Power Systems

Requirements

If you have items your
business requires,
Submit a
requirement!

Help IBM understand
how we can help you.


IBM Power Systems


28

IBM Power Systems


IBM Power Systems

Migration Process


29

IBM Power Systems

Source Managed System – Migrating From

Destination Managed System – Migrating To


IBM Power Systems

Logical Partition Mobility - Processes

Validate - Live Partition Mobility and Mobility
Readiness Check

Migrate - Live Partition Mobility via Wizard

Recover – Process implemented after Failed
Migration


30

IBM Power Systems

Logical Partition Mobility - Process

Validate - Live Partition Mobility and Mobility
Readiness Check
Select the IBM i partition to be validated
Operations – Mobility - Validate


IBM Power Systems


31

IBM Power Systems

Migration Validation


IBM Power Systems

HMC validation
Checks the source and destination systems, POWER Hypervisor, Virtual I/O
Servers, and mover service partitions for active partition migration capability and compatibility
Checks that the RMC connections to the mobile partition, the source and destination Virtual
I/O Servers, and the connection between the source and destination mover service partitions
are established
Checks that there are no required physical adapters in the mobile partition and that there are
no required virtual serial slots higher than slot 2
Checks that no client virtual SCSI disks on the mobile partition are backed by logical volumes
and that no disks map to internal disks
Checks the mobile partition, its OS, and its applications for active migration capability.
Checks that the logical memory block size is the same on the source and destination systems
Checks that the mobile partition is not configured with barrier synchronization registers
Checks that the mobile partition is not configured with huge pages
Checks that the partition state is active or running
Checks that the mobile partition is not in a partition workload group
Checks the uniqueness of the mobile partition’s virtual MAC addresses
Checks that the mobile partition’s name is not already in use on the destination server
Checks the number of current active migrations against the number of supported active
migrations

32

IBM Power Systems

IBM i Validation

During validation HMC sends a command to the partition to prepare for
hibernation.
Work Management has 3 exit points for suspend/resume or mobility
– The first one exit program to ask if it’s ok to proceed.
– The exit program is called again for any action required before the
operation.
– The exit for resume is called after the partition is resumed or moved
and it allows for any necessary cleanup.
Current functions that will prevent suspend/resume
– The partition is a member of an active cluster
– A tape resource varied on.*
Current functions that will prevent a migration
– A tape resource varied on


IBM Power Systems

No Network Connection – RMC won’t function
Internal Storage would cause another failure on
Validation - must be shared external storage


33

IBM Power Systems


IBM Power Systems


34

IBM Power Systems

Migrated partition “y0112p6” to destination server


IBM Power Systems
Migrate


35

IBM Power Systems

Migration wizard


IBM Power Systems

Migration wizard continued…


36

IBM Power Systems



IBM Power Systems



37

IBM Power Systems



IBM Power Systems



38

IBM Power Systems



IBM Power Systems

Performance Considerations

Active partition migration involves moving the state of a partition
from one system to another while the partition is still running.
– Partition memory state is tracked while transferring memory state to
the destination system
– Multiple memory transfers are done until a sufficient amount of
clean pages have been moved.
Memory updates on the source system affect transfer time
– Reduce the partition’s memory update activity prior to the migration
Network speed affects the transfer time
– Use a dedicated network, if possible
– At least 1Gb speed
– Possibly use link aggregated ports for more bandwidth


39

IBM Power Systems

Application impacts during migration

In general, applications and the operating system are
unaware that the partition is moved from one system to
another.

There are some exceptions to this:
– Collection Services; when the partition is starting to run
on the target system, the Collection Services collector
job will cycle the collection so correct hardware
information is recorded on the target system.


IBM Power Systems

Workload (Virtual Server) Resilience within a System Pool

Relocate Virtual Servers between Hosts within the Pool
- Determine best host placement within the pool
- Supports single virtual servers and host evacuation

Move virtual servers away from a failing host system.
- Automate relocation and placement of virtual servers in response to
predicted host system failures with no disruption.

Restart virtual servers when a host system fails.
- Automate remote restart and placement of virtual servers in response
to host system failures with minimal disruption.
- From a checkpoint in the future.

Resilience policy associated with the workload
- Provide workload resilience – yes/no
- Enables host system monitoring for failures and predictive failures
- Automates recovery action based on desire level of automation
System Pool (Ensemble)
Automation policy associated with the workload
- Automate = Advise / Automate
- Advise – VMControl recommends actions and requires confirmation
- Automate – VMControl automates actions

View In Animation Mode
80
6/12/2012

40

IBM Power Systems

Resources and references

Techdocs – http://www.ibm.com/support/techdocs
(presentations, tips & techniques, white papers, etc.)

IBM PowerVM Virtualization Introduction and Configuration - SG24-7940
http://www.redbooks.ibm.com/abstracts/sg247940.html?Open
IBM PowerVM Virtualization Managing and Monitoring - SG24-7590
http://www.redbooks.ibm.com/abstracts/sg247590.html?Open
IBM PowerVM Virtualization Active Memory Sharing – REDP4470
http://www.redbooks.ibm.com/abstracts/redp4470.html?Open
IBM System p Advanced POWER Virtualization (PowerVM) Best Practices - REDP4194
http://www.redbooks.ibm.com/abstracts/redp4194.html?Open
Power Systems: Virtual I/O Server and Integrated Virtualization Manager commands
(iphcg.pdf)
http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphcg/iphcg.pdf


IBM Power Systems

IBM Systems Lab Services and Training Mainframe Systems

Our Mission and Profile
Support the IBM Systems Agenda and accelerate the adoption of new Power Systems
products and solutions
Maximize performance of our clients’ existing IBM systems
System x & Bladecenter
Deliver technical training, conferences, and other services tailored to meet
client needs
Team with IBM Service Providers to optimize the deployment of IBM
solutions (GTS, GBS, SWG Lab Services and our IBM Business Partners) System Storage

Our Competitive Advantage
Leverage relationships with the IBM development labs to build deep IT Infrastructure Optimization
technical skills and exploit the expertise of our developers
Combined expertise of Lab Services and the Training for Systems team
Skills can be deployed worldwide to assure all client needs can be met Data Center Services

Training Services
Successful worldwide history:
17 years in Americas, 9 years in Europe/Middle East/Africa,
5 years in Asia Pacific

www.ibm.com/systems/services/labservices stgls@us.ibm.com

41

IBM Power Systems

Performance and Scalability Services
The IBM i Performance & Scalability Services Center in Rochester can provide facilities, hardware and technical expertise
to assist you in testing hardware or software changes

“Traditional” benchmarks
Proofs of Concept (e.g. HA alternatives, SSD analysis, external storage, etc.)
Stress test your system
Evaluate application scalability
Performance optimization and tuning
Assess application performance when migrating to a new release of IBM i
Determine impact of application changes
Virtualization, consolidation, migration services
Release-to-release upgrades
Capacity planning
.… all with the availability of Lab Services IBM i experts and development personnel

To request any of these services, submit at:

• http://www.ibm.com/systems/services/labservices/psscontact.html

• Or email Cindy Mestad at cindysm@us.ibm.com


IBM Power Systems

Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not
significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.

For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:
*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®,
z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®

The following are trademarks or registered trademarks of other companies.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries
in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

* All other products may be trademarks or registered trademarks of their respective companies.

Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will
experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without
notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,
compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

84

42

POWER VM with IBM i and live partition mobility

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (8)

Ähnlich wie POWER VM with IBM i and live partition mobility

Ähnlich wie POWER VM with IBM i and live partition mobility (20)

Mehr von COMMON Europe

Mehr von COMMON Europe (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

POWER VM with IBM i and live partition mobility