TECNIRIS@: OpenNebula Tutorial

OpenNebula Tutorial - RedIRIS 2013
November 19th, 2013

An Introduction to Cloud Computing with
OpenNebula
Daniel Molina Aranda
dmolina@opennebula.org
Project Engineer

Acknowledgments
The research leading to these results has received funding from the European Union's Seventh Framework
Programme ([FP7/2007-2013] ) under grant agreement n° 612053 (CloudCatalyst Project)

Creative Commons Attribution-NonCommercial-ShareAlike License

1/16

Agenda
An Introduction to Cloud Computing with OpenNebula

● Infrastructure as a Service
● The OpenNebula Model
● The Anatomy of the Cloud


2

Infrastructure as a Service
Types of Cloud Services

What

Who

Software as a Service

On-demand access
to any application

End-user
(does not care about hw or sw)

Platform as a Service

Platform for building
and delivering web
applications

Developer
(no managing of the underlying hw &
swlayers)

Raw computer
infrastructure

System Administrator
(complete management of the
computer infrastructure)

Infrastructure as a
ﾺ
Service

Physical Infrastructure

3

Types of Cloud Deployments

Public Cloud
• Simple Web Interface
• Raw Infrastructure Resources
• Pay-as-you-go (On-demand access)
• Elastic & “infinite” Capacity


4


Public Cloud

Private Cloud
A “Public Cloud behind the firewall”

• Simplify internal operations
• Dynamic allocation of resources
• Higher utilization & operational savings
• Security concerns


5


Public Cloud

Private Cloud



Hybrid Cloud
• Supplement the capacity of the Private Cloud
• Utility Computing dream made a reality!


6


Public Cloud

Private Cloud



Hybrid Cloud
• Suplement the capacity of the Private Cloud
• Utility Computing dream made a reality!


7

Challenges of IaaS Clouds

● How do I provision a new VM?
Image Management & Context
● Where do I store the disks?
Storage
● How do I set up networking for a multitier service?
Network & VLANs
● Where do I put my web server VM?
Monitoring & Scheduling
● How do I manage any hypervisor?
Virtualization
● Who has access to the Cloud’s resources?
User & Role Management
● How do I manage my distributed infrastructure?
Interfaces & APIs

8

Challenges of IaaS Clouds

● How do I provision a new VM?
Image Management & Context

Uniform management
● Where do I store the disks?
Storage

layer that
orchestrates multiple technologies

● How do I set up networking for a multitier service?
Network & VLANs
● Where do I put my web server VM?
Monitoring & Scheduling
● How do I manage any hypervisor?
Virtualization
● Who has access to the Cloud’s resources?
User & Role Management
● How do I manage my distributed infrastructure?
Interfaces & APIs

9

The Anatomy of the Cloud
Cloud Architecture - The Internals of the Cloud

Interfaces, Tools & API
• CLI & Sunstone (GUI)
• API
• Cloud (EC2,OCCI)
• Service Management & Catalogs

Network

Storage

• VLAN

• VM disks (file & block)

• Firewalling

• Image Distribution

• Multiple Technologies

• Multiple Backends

Compute Hosts

Multi-tenancy

• Grouped into logical clusters

• AAA Services

• Multiple hypervisors

• Scheduling

• Monitoring

• Permissions & roles


10

Different Perspectives of the Cloud – Demands from the Different Communities

Cloud Consumer

Cloud
Administrator

Cloud Application
Developer

Cloud Integrator


11

An Uniform Management Layer


12

Story
A Project Aimed at Building the Industry Standard Open Cloud Management Tool

Large-scale production
deployment: 16,000 VMs

•Develop & innovate
•Support the community
•Collaborate

TP

v1.0

v1.2 v1.4

v2.0

v2.2 v3.0 v3.2 v3.4 v3.6 v3.8 v4.0 V4.2

2005

2008

2009

2010

2011

2012

2013

2014

5,000
downloads/month
Research
Project


13

The OpenNebula Model
Design principles

Openness

Adaptable

• Open Architecture
• Open Interfaces & Code

• Modular architecture

Proven
• Tested & Mature

Powerful
• Features for
DC virtualization

Very Light
• Highly efficient

No Lock-In
• Platform
independant

Interoperable

Enterprise Ready

• Use of standards
• OCCI, AWS EC2

• Single installing & update process
• Support for various platforms


14

The OpenNebula Model
Widely Used to Build Enterprise Private Clouds in Medium and Large Data Centers

Reference Users

Survey Q2/Q3 2012 (2,500 users http://c12g.com/resources/survey/)


15

OpenNebula Architecture - Infrastructure Agnostic and Highly Customizable

CLI

Cloud
Servers

GUI

Scheduler

OCA (Ruby, Java)
XML-RPC API

OpenNebula core

Monitoring

Storage

Network

Virtualization

Images

Auth

DB

Languages


16

Basic OpenNebula Deployment

Monitoring,Virtualization,
Storage and Network

• Repository of VM images
• Multiple Backends (LVM, Ceph)

• Provides physical resources for the VMs
• Must have a hypervisor installed


17

Questions?
We Will Be Happy to Clarify Any Question


18

OpenNebula Tutorial - RedIRIS 2013
November 19th, 2013

Installation and Basic Usage
Daniel Molina Aranda
dmolina@opennebula.org
Project Engineer

Acknowledgments
The research leading to these results has received funding from the European Union's Seventh Framework
Programme ([FP7/2007-2013] ) under grant agreement n° 612053 (CloudCatalyst Project)

Creative Commons Attribution-NonCommercial-ShareAlike License

19/16

Agenda
Installing and Basic Usage

● Planning the Installation
● Virtual Lab Configuration
● Basic Usage
● Managing Hosts
● Images, Networks, Templates and VMs
● Managing Users, Quotas and ACLs
● Logging & Debugging
● Configuration Files
● Appendix A - Installation


20

A Typical OpenNebula Environment
Planning the Installation

Monitoring,Virtualization,
Storage and Network

• Repository of VM images
• Multiple Backends (LVM, Ceph)

• Provides physical resources for the VMs
• Must have a hypervisor installed


21

Required Software
Installing

● Head node
● ssh, ruby
● OpenNebula: oned, mm_sched, sunstone, …
● Worker nodes
● Hypervisor (KVM, Xen or VMWare)
● ssh, ruby (Xen & KVM)
● Optional
● Storage Backends (LVM, iSCSI, Ceph, …)
● Networking systems (VLAN, Open vSwitch, …)
● Ganglia, LDAP, Apache, Nginx

22

Virtual Lab
Planning the Installation

NODE 1


NODE 2

23

Virtual Lab
Installing

● Start Virtual Box
● File > Import Appliance…
● frontend_node1.ova & node2.ova
● Create a Host-only network in VirtualBox if you have
not created it yet


24

Virtual Lab
Installing

● Start frontend_node1 and node2 images
● You can access them from:
1. VirtualBox GUI
2. Console/putty
● frontend_node1 (password centos)
$ ssh localhost -l root -p 2222

● node2 (password centos)
$ ssh localhost -l root -p 2223


25

CLI – node1
Basic Usage

Hands on (node1) !
● OpenNebula CLI Commands
# su - oneadmin
$ one[TAB]

oneuser

Manage Users

oneimage

Manage Images

onegroup

Manage Groups

onetemplate

Manage Templates

oneacl

Manage ACLs

onevm

Manage VMs

onehost

Manage Hosts

oneacct

Accounting Tool

onecluster

Manage Clusters

onemarket

Marketplace Tool

onevnet

Manage Networks

onedb

DB Tool

onedatastore

Manage Datastores


26

CLI – node1
Basic Usage

● Get the Sunstone Login information
# (as oneadmin)
$ cat ~/.one/one_auth
oneadmin:<password>

● Try out sunstone!
http://localhost:9869


27

Adding Hosts - Sunstone
Basic Usage – Hosts

Hands on! (Sunstone)
● Create one host in Sunstone: node1
● Virtualization: KVM
● Information: KVM
● Network:
dummy
● Cluster:
none
● Watch transition INIT  ON
● Click on the row for more information
● Automatic gathering of monitoring data
● Take a look at the graphs


28

Adding Hosts - CLI
Basic Usage – Hosts

Hands on! (CLI)
(always as oneadmin in the Frontend – node 1)
$ onehost -help
$ onehost create -help

$
$
$
$

ssh node2 ls /var/tmp/one
onehost create node2 -i kvm -v kvm -n dummy
onehost list
onehost top

# Wait for ON ... and then CTRL-C
$
$
$
$

ssh node2 ls
onehost show
onehost show
onehost show

/var/tmp/one
node2
1
-x 1


29

Adding Images
Basic Usage – Images

● Create an Image in Sunstone
● Name: tty
● Provide a Path: /var/tmp/tutorial/ttylinux.qcow2.img
● Advanced  Driver: qcow2
● Datastore: default
● Create!
● Watch transition LOCKED  READY
● Ownership and Permissions (ala Unix!), Size, Driver...
Hands on! (CLI)
$ oneimage list
$ oneimage show tty
# DO NOT EXECUTE THE FOLLOWING COMMAND
$ oneimage create --name tty --driver qcow2
--path /var/tmp/tutorial/ttylinux.qcow2.img -d default

30

System Datastore
Basic Usage – Datastores

● Inspect each Datastore:
● The system datastore:
● Holds images for running VMs
● The TM_MAD (transfer manager driver) is shared which means:


31

Shared Datastore
Basic Usage – Datastores

● The default datastore:
● Holds images ready to be cloned or linked for VMs
● The DS_MAD is fs because our image is a regular file
● The TM_MAD (transfer manager driver) is shared which means:


32

Adding Networks
Basic Usage – Networks

● Create a new Network
● Name: private
● Type: Fixed Network
● IP: 192.168.0.1 -> [ENTER] -> repeat ... -> 192.168.0.4
● Network Model: default
● Bridge: br1

VM

VM

VM

VM

br1

br1

eth1

eth1

Node 1

Node 2


33

Adding Networks
Basic Usage – Networks

● Network extended information:
● Lease Management  Add, Hold and Remove Leases
Hands on! (CLI)
$ cat private2.net
NAME = private2
TYPE = fixed
BRIDGE = br1
LEASES = [ IP = 10.0.0.1 ]
LEASES = [ IP = 10.0.0.2 ]
$
$
$
$
$

onevnet
onevnet
onevnet
onevnet
onevnet

create private2
list
show private
addleases private 192.168.0.105
hold private 192.168.0.105


34

Adding Templates
Basic Usage – Template

● A template is a Virtual Machine definition ready to be instantiated
● It has CPU, Memory, Disks, NIC, Graphical Ports, etc...
● Create a new Template:
● Name:
ttylinux
● CPU:
0.1
● Memory:
64M
● Storage:
tty
● Network:
private
● Input/Output: VNC
● Random values in Context  Custom Variables
● Create!


35

Adding Templates
Basic Usage – Template

Hands on! (CLI)
● Try the useful --dry option in the CLI
$ onetemplate create --help
$ onetemplate create --name ttylinux --cpu 0.1
--memory 64 --disk tty --nic private --vnc --dry
NAME="ttylinux“
CPU=0.1
MEMORY=64
DISK=[
IMAGE="tty“
]
NIC=[
NETWORK="private“
]
GRAPHICS=[ TYPE="vnc", LISTEN="0.0.0.0" ]


36

Instantiating
Basic Usage – VMs

● Instantiate the template
● Deploy 2 VMs
● Leave the name blank
● Watch the transition PENDING  RUNNING
● In which host is running each VM?
● vnc (vm1)  root / password
● ifconfig  configured using context
● ping the other machine (vm2)
● Migrate / live-migrate (vm2)


37

Main VM actions
Basic Usage – VMs

suspend

VM state saved. Kept in the host.

power off (--hard)

Powers off a VM. Kept in the host.

stop

VM state saved. Taken to the system datastore.

undeploy (--hard)

Powers off a VM. Taken to the system datastore.

reboot (--hard)

Reboots the VM.

delete --recreate

Cleans the VM and moves it to PENDING.

shutdown (--hard)

Powers off a VM, cleans host and VM is removed
from OpenNebula.

delete

VM is immediately destroyed regardless of state.
Recommended only for oneadmin.


38

Other VM actions
Basic Usage – VMs

● VM extended information tab
● Capacity - Resize VM capacity (power off –hard, first halt from vnc)
● Storage
● Network - Attach new nic
● create a new network  attach nic  reboot from vnc
● Snapshot
● create a file using VNC
● Take snapshot
● Modify the file
● Revert
● Placement
● Actions - Schedule action
● Template
● Log

39

Managing Users
Basic Usage – Users

● Create new user: testuser / testpass
● Click on new user  Update Quotas
● Enforce 1 Max VMs  Add/edit quota
● Other possible options
● limit the use of a Datastore
● limit the use of an Image
● limit the use of a Network
● Apply changes!


40

Logs
Basic Usage – Logging and Debugging

● Logs are kept under /var/log/one
● oned.log: all the information related to the oned daemon. Every
request, actions and driver errors will be here.
The verbosity is set by DEBUG_LEVEL in /etc/one/oned.conf
● sched.log:has all the information related to the placement of Virtual
Machines. If a VM is not being deployed (kept in PENDING state), this
log will explain why.
● <id>.log: the log of each VM. Also accessible through Sunstone.


41

oned.conf
Configuration

/etc/one/oned.conf (open this file and take a look!)
● OpenNebula Daemon:
● LOG, PORT, DB
● Monitoring Intervals:
● MANAGER_TIMER, MONITORING_INTERVAL
● Configuration options for VMs:
● VNC_BASE_PORT
● MAC_PREFIX (MAC  IP)
● DEFAULT_DEVICE_PREFIX = "hd“ (or vd, xvd, etc…)
● Drivers:
● IM_MAD, VMM_MAD, TM_MAD, DATASTORE_MAD, HM_MAD, AUTH
_MAD
● Resources:
● DEFAULT_UMASK
● VM_RESTRICTED_ATTR, IMAGE_RESTRICTED_ATTR

42

sched.conf
Configuration

/etc/one/sched.conf (open this file and take a look!)
● Scheduler Daemon:
● ONED_PORT, SCHED_INTERVAL, LOG
● Dispatch Options
● MAX_VM, MAX_DISPATCH, MAX_HOST, LIVE_RESCHEDS
● Policy
● DEFAULT_SCHED (packing, striping, load-aware, custom)


43

Questions?
We Will Be Happy to Clarify Any Question


44

Appendix A

Installation
This is just a reference of what have been done to configure the frontend_node1 and
node2 images


45

Installation node 1 - Frontend
Installing

● Activate repo and Install Packages
# cp /var/tmp/tutorial/opennebula.repo /etc/yum.repos.d/
# yum clean all
# yum install opennebula-server opennebula-sunstone
opennebula-node-kvm

● Add QEMU drivers
# Change VM_MAD type from kvm to qemu

● Configure NFS Server
# cat /etc/exports
/var/lib/one
*(rw,sync,no_subtree_check,root_squash,anonuid=9869,anongid=9869)


46

Installation node 1 - Frontend
Installing

● Configure Sunstone
# sed -i 's/127.0.0.1/0.0.0.0/' /etc/one/sunstone-server.conf

● Start Services
#
#
#
#
#

service nfs start
service libvirtd start
service opennebula start
service opennebula-sunstone start
chkconfig nfs on

● Quick overview of the CLI
#
#
$
$

gpasswd -a oneadmin wheel
su - oneadmin
oneuser show
oneuser -help


47

Installation node 2 – Worker Node
Installing

● Activate repo and Install Packages
# cp /var/tmp/tutorial/opennebula.repo /etc/yum.repos.d/
# yum clean all
# yum install opennebula-node-kvm

● Configure Network, Hostname, NFS and sudo
# chkconfig NetworkManager off
# service NetworkManager stop
# echo HOSTNAME=node2 > /etc/sysconfig/network
# hostname node2
# sed -i 's/1.1.1.1/1.1.1.2/' /etc/sysconfig/networkscripts/ifcfg-br1
# ifconfig br1 1.1.1.2/24 up
# mount –t nfs 1.1.1.1:/var/lib/one /var/lib/one
# gpasswd -a oneadmin wheel
# service libvirtd start


48

Configure Password-less SSH
Installing

● OpenNebula needs passwordless ssh access to
all the nodes from all the nodes:
# (as oneadmin)
$ ssh-keyscan node1 node2 > ~/.ssh/known_hosts
# test it!

$
$
$
$

ssh node2
exit
ssh node1
exit


49

TECNIRIS@: OpenNebula Tutorial

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Ähnlich wie TECNIRIS@: OpenNebula Tutorial

Ähnlich wie TECNIRIS@: OpenNebula Tutorial (20)

Mehr von OpenNebula Project

Mehr von OpenNebula Project (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

TECNIRIS@: OpenNebula Tutorial