Introduction to NCHC Ezilla and Haduzilla project in OSC.JP CLOUD 2012 Tokyo https://www.ospn.jp/osc2012.cloud/modules/eventrsv/?id=1&noform=1

1. Build Your Own Private Cloud
with Ezilla and Haduzilla
@ 2012-12-16
OSC.JP CLOUD 2012
National Center for High-performance Computing
Software Technology Division / Ezilla Team
Jazz Yao-Tsung Wang
jazz@nchc.narl.org.tw

2. Agenda
➢Breif Introduction to NCHC
➢Five little Zillas from Free Software Lab
➢Brief Introduction to Ezilla Project
➢Brief Introduction to Haduzilla Project

3. Breif Introduction to NCHC
@ 2012-12-16
OSC.JP CLOUD 2012
National Center for High-performance Computing
Software Technology Division / Ezilla Team
Jazz Yao-Tsung Wang
jazz@nchc.narl.org.tw

4. About NCHC
NCHC
To Become a World-class Supercomputing Center
To Become a World-class Supercomputing Center
To Promote Global Scientific Discoveries & Technical Innovation
To Promote Global Scientific Discoveries & Technical Innovation
Fundamental Role
Fundamental Role Enabling Role
Enabling Role
• Provide HPC, storage, and • Provide customized “total
networking Facilities solution” to users
• Infuse innovative technology; • Perform collaborative research
Foster growth of HPC professionals with other institutes; Create
technology breakthroughs

5. HPC Services
• Open for academic, research, and Industrial users.
• Windrider (a.k.a. ALPS system)- newly deployed supercomputer in 2011; peak
performance: 177 TFLOPS, 442.00 MFLOPS/W
● 25,600 Cores ● 73,728 GB Memory ● 1,074 TB Disk
Jun. 2011:
Top500 Ranking: No. 42
Green500 Ranking: No. 60
Nov. 2011:
Top500 Ranking: No. 60
Green500 Ranking: No. 64
Advanced Large-scale Parallel Supercluster
IBM Cluster 1350 / 19.91TF HP Superdome2

6. Research and Education Network
• Provides research network, education
network (TANet), and optical Lightpath
services
• Peering with 35 IPv4 and 24 IPv6 networks
worldwide
• Network availability rate up to 99.991%
• Enables dynamic circuit provisioning

7. Five little Zillas
from Free Software Lab
@ 2012-12-16
OSC.JP CLOUD 2012
National Center for High-performance Computing
Software Technology Division / Ezilla Team
Jazz Yao-Tsung Wang
jazz@nchc.narl.org.tw

8. 5 little Zillas in the Cloud
Cluster Deployment P2P, P2V, V2V
DRBL Clonezilla
Diskless Remote Boot in Linux Open Source Cloning System
Provides a “diskless” and/or A partitioning and disk cloning
“systemless” environment for utilities similar to Ghost® and
client machines True image®
Haduzilla
Hadoop Deployment
Provides unattended installation and Provides unattended installation and
web management interface for web management interface for
virtualization infrastructure Hadoop infrastructure
Virtual Machine Big Data Platform
Manager (VMM) Provides cluster-based intranet
search engine with chinese word
segamentation support
Application Example

9. Cloud Architecture
Tomcat Nutch Nucth
PaaS
PaaS
Hadoop Hadoop Hadoop
VM OS VM OS VM OS
Web Frontend
IaaS
IaaS
VMM VMM Hadoop Hadoop
Hypervisor Hypervisor JVM JVM
OS OS OS OS
Disk Diskless Disk Disk

10. Brief Introduction to
Ezilla Project
@ 2012-12-16
OSC.JP CLOUD 2012

11. Pervasive Computing Lab
What is Ezilla ？
Ezilla is designed to
◦ A Toolkit to build your Private Cloud
◦ A Toolkit to build Infrastructure as a Service
Ezilla provide user a simple web interface to
create and access personal virtual desktop
Ezilla is based on:
◦ (1) DRBL (Diskless Remote Boot in Linux)
◦ (2) Web Interface
◦ (3) Cloud Middleware
◦ (4) Moosefs
◦ (5) Clonezilla

12. Pervasive Computing Lab
Architecture of Ezilla
VM
Ezilla Web Interface

13. Pervasive Computing Lab System Blocks of Ezilla
Ezilla Master
TM MAD IM MAD VM MAD
Libvirt
SSH
KVM
Ezilla
Slave

14. Pervasive Computing Lab Feature #1: Unattaned Installation
Virtual Machines
Ezilla WebOS

15. Pervasive Computing Lab Feature #2: Parallel File System
Virtual Machines
Ezilla Web Interface

16. Pervasive Computing Lab
Based on Sun Stone

17. Pervasive Computing Lab
Normal User Dashboard

18. Pervasive Computing Lab Feature #3: Enhanced Web interface
Drag and Drop to define your VMs.

19. Pervasive Computing Lab Feature #4: Port Redirect Middleware

20. Pervasive Computing Lab EasyCloud : Virtual Classroom Service
http://easycloud.nchc.org.tw

21. Pervasive Computing Lab Work in Progress
To support OCCI (Cloud Interop) :

We're now based on OpenNebula

But will add support to OpenStack via OCCI
VM#U1-1 VM#U2-1
rOCCI
VM#U1-2 VM#U2-2
OpenNebula OpenStack
(Powered by KVM) (Powered by Xen) 21

22. Pervasive Computing Lab
Work in Progress
3. Query
Resource Catalog
1. Register
2. Upload 4. Download
OpenNebula OpenStack
Micro Data Center Mini Data Center
VM#U1-1 VM#U1-1
VM#U1-2 VM#U2-2
(Powered by KVM) (Powered by Xen)
22

23. Pervasive Computing Lab Marketplace

Status Report :

Once an image is added into the “Marketplace”,
users should be able to choose in the D&D, in
the near future. 23

24. Pervasive Computing Lab
More information
Official Website
◦ http://ezilla.nchc.org.tw
◦ http://ezilla.info
Public IaaS portal
◦ http://easycloud.nchc.org.tw
Sourceforge
◦ http://ezilla-nchc.sf.net
Developers
◦ http://percomp.nchc.org.tw

25. Brief Introduction to
Haduzilla Project
@ 2012-12-16
OSC.JP CLOUD 2012
Jazz Yao-Tsung Wang
jazz@nchc.narl.org.tw

26. What is Haduzilla ?
 Haduzilla is consisted with two parts:
(1) DRBL-Hadoop and (2) Hadoop4Win.
 DRBL-Hadoop aim to provide an easy way to
deploy Hadoop cluster with DRBL (Diskless
Remote Boot in Linux) developed by NCHC.
 Hadoop4Win is for students to build Hadoop
developing environment on Windows.

27. DRBL-Hadoop System Architecture

28. Haduzilla in production
Haduzilla had been deployed
at http://hadoop.nchc.org.tw to
serve the only public hadoop
experimental cluster in Taiwan
since June 2009. There are
about 2,000+ registed users,
executed 150,026 jobs till
Nov. 2012.

29. We use Ganglia for monitoring
http://hadoop.nchc.org.tw/ganglia

30. We designed a web interface for user-login

31. Hadoop4Win
Hadoop4Win is a
windows installer for
beginner to learn
Hadoop Ecosystem.
Download from
http://hadoop4win.sf.net

32. Questions ? Demo ?
Welcome to our booth for more details
Or drop me a line – jazz@nchc.org.tw