Cisco at VMworld 2015

1. VMWorld :31st Aug - 3rd Sep, 2015
Desktop Virtualization Performance Solutions Team
Computing Systems Product Group, Data Center Solutions, Cisco System Inc., San Jose.
Cisco UCS GPU Solution
NVidia Grid Cards and VMware Horizon with View

2. 2© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Agenda
• GPU
enabled
VDI
with
UCS
• GPU
Deployment
Methods
• GPU
Hardware
Installa<on
on
Cisco
UCS
• UCSM
Integrated
GPU
Scenario
• GPU
Installa<on
on
VMware
ESXi
Hypervisor
• VMware
vDGA
&
vSGA
• MicrosoD
Remote
FX
with
GPU

3. 3© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
GPU Requirement for VDI User Profile
DESIGNER
RGraphics & Media
Professionals, Design
Engineers
CATIA, CS6 Inventor
POWER USER
PLM, Solidworks
Adobe Dreamweaver
Medical Imaging
Showcase
Financial Analysts,
Traders, Design
Reviewers
KNOWLEDGE WORKER
Office workers,
productivity & line-of-
business workers
MS Office
Photoshop

4. 4© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
NVIDIA GRID K2
GPU 4 Kepler GK 107 2 High End Kepler GK 104
CUDA cores 768 (192 / GPU) 3072 (1536 / GPU)
Memory Size 16GB DDR3 (4GB / GPU) 8GB GDDR5
Max Power 130 W 225 W
Aux power
requirement
6-pin connector 8-pin connector
PCIe x16 x16
OpenGL 4.x 4.x
Microsoft DirectX 11 11
vGPU support Yes Yes
# users 4 - 1001 2 – 641
1 Number of users depends on software solution, workload, and screen resolution
NVIDIA GRID K1

5. 5© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Graphics Methods for Virtual Desktop Users
• Horizon
vDGA
–
GPU
Pass-­‐through
“Virtualized
Dedicated
Graphics
Accelera=on”
1:1
dedicated
GPU
to
user
• Horizon
vSGA
-­‐
Shared
GPU
“Virtualized
So@ware
Graphics
Accelera=on”
So$ware
virtualiza<on
of
the
GPU.
• Horizon
vGPU
-­‐
Virtual
GPU
“Virtualized
Graphics
Processing
Unit”
Hardware
virtualiza<on
of
the
GPU

6. 6© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Guest OS
UCS Server
CPU
vDGA- GPU Pass-Through
Hardware
Memory Storage Network
Software
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtualization
HYPERVISOR
VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork
App App App AppVDA
Client
NVIDIA
Driver
GPU
GPU
VMware View 6.1
VMware ESX 6
vDGA
GRID K1/K2

7. 7© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
App App App VDA
HYPERVISOR
Guest OS
Virtual
Graphic
s Driver
OS
Virtual
Graphic
s Driver
Guest OS
UCS Server
CPU
Shared GPU- vSGA
Hardware
Memory Storage Network
Software
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtualization
VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork vGraphics
Client
GPU
NVIDIA
Driver
Virtual
Graphics
Driver
Graphics APIs
Rendered Desktop
App App App VDA
App App App AppVDA
VMware vSGA – DX9, OGL 2.1
GRID K1/K2

8. 8© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Guest OS
VIRTUAL MACHINE
HYPERVISOR
NVIDIA
Driver
NVIDIA
Driver
Guest OS
UCS Server
CPU
Virtual GPU- vGPUHardware
Memory Storage Network
Software
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtual
Driver
Virtualization
VIRTUAL MACHINE
vCPU vMemory vStorage vNetwork
Client
GPU
NVIDIA
Driver
vGPU
GRID
Software
Graphic Commands
App App App AppVDA
App App App AppVDA
App App App VDA
Client
Client
Standard NVidia Driver
VMware ESXi 6
NVidia GRID
VGX software

9. 9© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
User No-GPU GPU Sharing
GPU
Pass-through
✗
✗
✔
✗ ✗ / ✔
✔
✔ ✔
✔
Recommended Mode
Designer
Power User
Knowledge
Worker

10. 10© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Chassis: 2 RU Rack Unit
CPU: 1 or 2 Intel Xeon E5 -2600 family processors
Memory: 24 slots registered ECC DIMMS or load reduced DIMMS
Expansion Slots: Up to 6 PCIe slots (CPU1- controls PCIE slots1,2,3
and CPU2 controls slots 4,5,6)
Internal storage devices: Up to 24 2.5” (63.5 mm) SAS/SATA/HDD/
SSD drives with 24 drive backplane
C240 M4 Hardware Overview
C240 M4 Server configuration for GPU Testing
2 Intel Xeon E5-2680v3 @ 2.50 GHz Processors
12 Cores per Processor, 48 Logical Processors per server
384Gb DDR4 2133MHz memory DPC

11. 11© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
UCS Managed C240 M4
Nexus 2232
UCS 6200UCS 6200
• Single Wire Management
• UCSM version 2.2.(4b)
VIC 1227GPU 2 GPU 1
!
Intel
Inside
XEON
UCS
C240 M4
Console
UCS-HDD300GI2F105
15KSAS
300GB
!
1 6 12 18 24
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
OS or Hypervisor

12. 12© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VMware vDGA setup
• GPU
Pass-­‐through
mode
• Virtual
Dedicated
Graphic
Accelerator
(vDGA)
• Supports
all
versions
of
DX,
OpenGL
and
CUDA
• No
driver/soDware
installa<on
needed
on
ESXi
host
• PCI
Pass
thru
must
be
enabled
on
the
ESXi
server
• NVIDIA
Win7
driver
needed
on
the
VMs
• Also
need
to
make
Primary
Display
accelerated
NVidia
GPU
adapter
•
VMware
ESXi
5.1
or
later
&
Horizon
view
5.2
or
later

13. 13© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Enabling Pass thru on ESXi for vDGA
• Go
to
vCenter
client
and
Click
on
host
where
GPU
card
is
installed
• Click
on
Configura<onà
Advanced
Sengs
• Click
on
Configure
Pass-­‐
through
• Select
the
GPU
card
in
the
pass-­‐through

14. 14© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Enabling Pass thru on ESXi for vDGA
• For
one
K2,
there
will
be
two
PCI
VGA
Controller
• For
one
K1
or
2x
K2,
there
will
be
four
PCI
VGA
Controller
• Select
all
and
click
OK
• ESXi
host
reboot
is
required
• TO
validate
pass-­‐through
working,
ssh
to
ESXi
console
&
issue
cmd:
vmkvsitools
lspci
|
grep
“nVidia”

15. 15© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Verify VMWare vDGA
• Check the device manager, there will be NVidia GRID
adapter under Display Adapter.
• Login to Virtual machine via VNC or RDP and check the
device manager for NVIDIA GRID card present or not.
• Select that adapter as primary & disable the VMware
SVGA 3D.
• Log Off the VNC or RDP & log back in with VMware view
client.
• Go to vSphere web client and edit the virtual machine
properties . You can see the NVidia GRID pass
through device attached to the virtual machine

16. 16© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Verify VMware vDGA
• Fully accelerated Open GL and DX apps can be
run.
• NVidia Control Panel is also available for graphics
adapter settings.
• CUDA capable programs can be run with full GPU
acceleration
• nvidia-sim command . SSH into ESXI host and
check the NVidia-sim command for a graphics
card usage and health.

17. 17© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VMWare vSGA setup
• GPU sharing Mode with API intercept
• Virtual Shared Graphics Accelerator (vSGA)
• Nvidia Driver (.vib) needs to be installed on the ESXi hypervisor
• No Nvidia driver in the VM
• Supports OGL 2.1 and DX 9.0 only
• VMware ESXi 5.1 or later with Horizon View 5.2 or later
• Has multi user shared access to Nvidia GPU
• Number of users varies with the application, GPU card & rendering requirement

18. 18© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
vSGA ESXi Host Installation and Verification
Verify the ESXi vSGA mode drivers are installed successfully. gpuvm
Download the latest .vib file from Nvidia website
http://www.nvidia.com/download/driverResults.aspx/85391/en-us
Copy .vib file to ESXi host via SCP or FTP to /tmp directory
Go to /tmp directory and run the command below
~#esxcli software vib install --no-sig-check -v
<driver file>.vib
Install Example
Verify Card Install esxcli software vib list | grep NVIDIA
lspci | grep –I display

19. 19© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
VIRTUAL
DESKTOPS
VIRTUAL MACHINE
Windows 7
NVIDIA Driver
Apps
NVIDIA GRID Enabled
Virtual Desktop Agent
NVIDIA GRID GPU
NVIDIA GRID ENABLED
Hypervisor
vGPU Enabled VDI
!
Intel
Inside
XEON
UCS
C240 M4
Console
UCS-HDD300GI2F105
15KSAS
300GB
!
1 6 12 18 24
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!
UCS-HDD300GI2F105
15KSAS
300GB
!

20. 20© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Go
to
vSphere
Web
client
-­‐-­‐>
Virtual
Machine
à
Proper<es
• Click
on
New
Device.
Add
PCI
device
from
drop
down
menu
• Select
GPU
profile
to
be
added.
• Click
ok
&
Restart
virtual
machine
• Install
latest
NVidia
driver
for
Windows
7
(64
or
32
bit)
Attaching vGPU Profile to Win7 VM

21. 21© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
NVIDIA
GRID
CARD
Virtual
GPU
Profile
Applicati
on
Certificati
on
Graphics
Memory
in MB
Max
Display
per User
Max
Resoltion
per
Display
Max
Users per
Board
Use Case
GRID K2 K280Q YES 4096 4 2560x1600 2 Designer
K260Q
YES
2048 4
2560x1600
4
Designer/
Power User
K240Q
YES
1024 2
2560x1600
8
Designer/
Power User
K220Q
YES
512 2
2560x1600
16
Power User
GRID K1
K180Q
YES
4096 4
2560x1600
4
Power User
K160Q
YES
2048 4
2560x1600
8
Power User
K140Q
YES
1024 2
2560x1600
16
Knowledge
Worker
K120Q
YES
512 2
2560x1600
32
Knowledge
Worker
NVIDIA GRID vGPU Profile Selection Chart

22. 22© 2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Cisco UCS, VMware Horizon and NVIDIA
Reference Documents
http://www.cisco.com/go/vdi-cvd
http://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-c240-m4-rack-server/index.html
https://www.vmware.com/support/horizon-view/doc/horizon-61-view-release-notes.html
https://www.vmware.com/support/horizon-view/doc/horizon-view-602-release-http://blogs.vmware.com/
performance/2014/12/vmware-horizon-6-hardware-accelerated-3d-graphics.html
http://www.vmware.com/files/pdf/VMware-View-OptimizationGuideWindows7-EN.pdf
http://www.nvidia.com/content/grid/pdf/GRID_K2_BD-06580-001_v02.pdf
http://www.cisco.com/c/dam/en/us/products/collateral/servers-unified-computing/ucs-c-series-rack-servers/
nvidia_grid_vgx.pdf

23. Thank you