★ Session Summary ★ Overview of Xen for ARM Servers --------------------------------------------------- ★ Resources ★ Zerista: http://lcu14.zerista.com/event/member/137755 Google Event: https://plus.google.com/u/0/events/cevhqdnomn5g3f84na0ivnflp9k Video: https://www.youtube.com/watch?v=Glabus8qpLY&list=UUIVqQKxCyQLJS6xvSmfndLA Etherpad: http://pad.linaro.org/p/lcu14-308 --------------------------------------------------- ★ Event Details ★ Linaro Connect USA - #LCU14 September 15-19th, 2014 Hyatt Regency San Francisco Airport --------------------------------------------------- http://www.linaro.org http://connect.linaro.org

1. Xen on ARM
The Gears of the Cloud
Stefano Stabellini - 17 September 2014

2. “Citrix is a cloud computing company
that enables mobile workstyles”
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

3. Citrix and Open Source
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix
Created as a Linux Foundation
Collaborative Project in April 2013
ARM joined the Xen Project Advisory
Board in December 2013

4. What is Xen?

5. What is Xen?
● a type-1 hypervisor
● small footprint (less than 100K LOC)
● GPLv2
● 10 million individual users
● powers the largest public clouds in production
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

6. Xen Architecture
Dom0 DomU
PV backends PV Frontends
© 2013 Citrix | Confidential – Do Not Distribute
Xen
Hardware
HW drivers
DomU
PV Frontends
DomU
PV Frontends
© 2014 Citrix

7. Xen Architecture
Dom0 DomU
BlockBack
© 2013 Citrix | Confidential – Do Not Distribute
NetBack BlockFront
Xen
Hardware
NetFront
Disk Driver
Domain
Toolstack Disk Driver
Network Driver
Domain
Network Driver
© 2014 Citrix

8. Xen Architecture: driver domains
● scalability
● security
● isolation
● resilience
● disaggregation
● componentization
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

9. Xen on ARM

10. Xen on ARM: not just a port
● a lean and simple architecture
● we removed all the cruft accumulated during the years
● no emulation, no QEMU
● one type of guest
● exploit the hardware as much as possible
● a very good match for the hardware
● clean architecture = small code base
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

11. Xen on ARM: architecture
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

12. Xen on ARM: architecture
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

13. Code size: smaller is better!
● X86_64 ~= 140,000LOC
● ARMv7 + ARMv8 ~= 1/6 x86_64 code
© 2013 Citrix | Confidential – Do Not Distribute
Common ARMv7 ARMv8 Total
xen/arch/arm 11,767 3,503 1,812 17,082
C 11,587 954 813 13,354
ASM 180 2,549 999 3,728
xen/include/asm-arm 4,786 984 1,050 6,820
TOTAL 16,553 4,487 2,826 23,902
© 2014 Citrix

14. Achievements
Xen support for ARM
upstream in Linux 3.7
Xen support for ARM64
upstream in Linux 3.11
11/11 08/12 09/12
11/12 03/13 07/13
Xen running on real ARM
hardware
First Xen on ARM talk at
Xen Summit 2012
© 2013 Citrix | Confidential – Do Not Distribute
Xen 64-bit on
ARM64
01/13
Citrix announces
that will be joining
Linaro
Xen 4.3 released with
ARM and ARM64 support
Part-time Xen ARM
hacking starts
Xen 4.4 release
06/13 03/14
© 2014 Citrix

15. Hypervisor: Commits and Authors
Xen-devel : Messages per Month Contributors / Authors per Month
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix
Highest ever

16. Website Traffic and Social Media
Average monthly web visits
grew by 30%
Social Media following
grew by 47%
© 2014 Citrix

17. Press Mentions
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

18. The role of Xen on ARM
25-30% of xen-devel traffic is ARM specific
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

19. Xen on ARM: new horizons
● embedded
● set-top boxes
● smarphones
● internet of things
● automotive
● aviation industry
● high reliability
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

20. Xen Project 4.4 release: status
Features:
● 64-bit guest support in ARMv8
● stable hypercall ABI
● basic lifecycle operations
● memory ballooning
● scheduler configurations, vcpu pinning, cpu pools
HCL (not inclusive):
● ARMv8 FVP
● Arndale board
● Allwinner Sunxi (Cubieboard 2)
● TI OMAP5
● Applied Micro X-Gene
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

21. Linux v3.13: status
● dom0 and domU
● 32-bit and 64-bit
● SMP
● PV drivers
○ disk
○ network
○ console
○ framebuffer
○ keyboard
○ mouse
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

22. Coming in Xen 4.5
● irq latency reduction
● interrupt priorities
● irq migration
● SMMU support
● Xen UEFI host booting
● GICv3 support
● support for up to 1TB of guest RAM
● super pages
● support for 48-bit physical addresses
● QEMU PV backend on ARM: framebuffer,
mouse, keyboard, multi-console
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

23. Benchmarks

24. Execution environment
● Linux v3.15-rc8
dom0, domU and native kernel
● Xen v4.5-unstable+
● QEMU-KVM v2.0.0
● OpenSUSE 13.1
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix
Applied Micro X-Gene Intel Xeon CPU X5650
ARMv8 64-bit 8 cores 2.4 Ghz x86_64 2 sockets x 6 cores 2.67 Ghz

25. Kernbench
virtualization overhead (percentage) - Lower is better
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

26. PBZIP2
virtualization overhead (percentage) - Lower is better
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

27. FIO rand-rw
virtualization overhead (percentage) - Lower is better
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

28. SPECjbb2005
virtualization overhead (percentage) - Lower is better
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

29. SpecINT 2006
Xen on ARM virtualization overhead (percentage) - Lower is better
© 2013 Citrix | Confidential – Do Not Distribute
2%
© 2014 Citrix

30. Why Xen?

31. Xen on ARM: the gears of the cloud
● strong in the cloud
● strong community
● successful in automotive and embedded
● strong security guarantees
● easy to deploy
● from source, Linux distributions, products, etc.
● minimal overhead
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

32. More information
● http://www.xenproject.org
● Xen on ARM @wiki.xenproject.org http://goo.gl/FKNXe
● Xen on ARM whitepaper http://goo.gl/vWMn7D
● http://lists.xenproject.org/mailman/listinfo/xen-devel
© 2013 Citrix | Confidential – Do Not Distribute
© 2014 Citrix

33. Questions?

34. © 2013 Citrix | Confidential – Do Not Distribute
Citrix
Work better. Live Better.
© 2014 Citrix