Cloud Computing represents a radical change in the way we organize and use computing resources and storage. The scientific and academic communities face the challenge of not only adapting their procedures to this new paradigm, but also contributing Cloud Computing development and leading its evolution towards open, secure and interoperable computing infrastructures, which will playing a key role in the community clouds paradigm. The Spanish MEGHA initiative promotes and coordinates contributions to cloud computing R&D, education and management made by institutions affiliated with RedIRIS [7] in Spain. In the first phase (2010–2012), MEGHA validated federated cloud platforms using Opennebula and OCCI [10] to streamline the use of cloud technologies among R&E service centers. Representative infrastructure providers (CESCA, CESGA, PIC), middleware providers (OpenNebula, RedIRIS, OSAmI-Commons) and users (UAB, UOC, UM) together with intermediate/identity/brokers resources (RedIRIS) joined efforts to demonstrate the viability of this approach. The results stimulated the development of use cases including e-learning platforms on demand (Learning Apps project), a distributed HPC platform (e-Science), and Virtual Labs (VDI) in a hybrid scenario (Academic services). Next Steps? As next goal, the Spanish research and academic community is working to assess the possibilities of creating a productive Infrastructure Cloud Computing service within member institutions. With this new approach new challenges appear: Federated user authentication and authorization mechanisms. Brokering architecture scenario. Secure VM image distribution and validation. A federated cloud accounting system integrating the accounting records of multiple cloud managers and supporting federated cloud governance. Monitoring and notification of unpredictable changes in availability and readability status. Security Policies and Service Level Agreements (SLA’s).

1. CommunityCommunity
Clouds from ScratchClouds from Scratch
A Real World Introduction
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Jordi Guijarro - jguijarro@cesca.cat
@cloudadms

4. About

5. What CloudWhat Cloud
Computing reallyComputing really
means for R&Emeans for R&E
A strategy, a tactical solution...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

6. A Research and Education Network is a
non-profit Internet service provider
dedicated to supporting the needs of the
research and education communities.
It has a high-speed backbone network.
Research and Education Networks are usually
the places where new Internet protocols and
architectures are introduced before their
public deployment:
R&E Networks
Protocols: IPv6 and multicast.
Architecture: Client/Server and Cloud Computing
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

7. R&E Networks
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

8. JUST A BUZZWORD?
What Cloud Computing really means for R&E Community ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

9. What Cloud Computing really means
SELFSERVICE(s)?
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

10. What Cloud Computing really mean for R&E Community?
RESPONSIBILITIES...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

11. MEGHA WorkingMEGHA Working
GroupGroup
Let's pull all together...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

12. MISSION
MEGHA Working Group
the development of
innovation in Cloud
Computing technologies
within the scope of the
institutions affiliated to
RedIRIS
for the application of
open and interoperable
Cloud technologies in
other areas in which it
can influence, such as
business in government.
TO PROMOTE
TO ACT AS A CATALYST
INTEROPERABLE
OPEN
PROMOTION
USE CASES
TESTBED
IDENTITY
http://wiki.rediris.es/megha
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

13. Deploy a federated Cloud infrastructure
as a platform for innovation and
evaluation.
Explore the possibilities for the
application of Cloud computing has in
research, academic and management
environments.
Facilitate the creation of an ecosystem of
open-source middleware components to
deploy interoperable Clouds and
coordinate training and education
activities for its deployment.
MAIN OBJECTIVES
MEGHA Working Group
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

14. MEGHA IntercloudMEGHA Intercloud
projectproject
From myth to reality...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

15. INITIAL STAGE
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

16. CESCA Cloud InfrastructureCESCA Cloud Infrastructure

17. CESGA Cloud InfrastructureCESGA Cloud Infrastructure

18. INTEROPERABILITY
MEGHA Intercloud Project
A “Virtual Poka Yoke” ?A “Virtual Poka Yoke” ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

19. OPEN PLEASE!
MEGHA Intercloud Project
Director,...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

20. INTEROPERABLE
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

21. FEDERATED
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

22. FEDERATED
MEGHA Intercloud Project
PKIRISGRID
X.509 Cert
UI
OpenNebula3.8
r
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

23. Public high speed connectivity.
Images, instances and networks management.
SSH access (root).
User manual & Service Provider Howtos
(ONE 3.x)
“Terms of Service”.
MATURING TOGETHER
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

24. MAIN PLAYERS
MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

25. Some Real WorldSome Real World
User CasesUser Cases
Cloudified...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

26. UOC: Learning Apps
REAL WORLD USER CASES
A store on the
internet inspired by
Apple's App Store
which focuses on
educational
applications
The provision of the
educational
environments is
automated (OCCI 0.8)
and the amount of infr.
depends on parameters
such as a preconfigured
concurrency.
RESTFUL API
http://www.learningappsstore.org/
ON DEMAND
ACADEMICACADEMIC
EDUCATION
AUTOMATION
CONTEXTUALIZATION
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

27. jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

28. PIC: Grid & Cloud
REAL WORLD USER CASES
DIRAC (Interware)
allows homogeneous
access to
heterogeneous
computing resources.
Providing transparent
access and interoperability
between Grids and Clouds
OCCI 1.1 interface.
SCIENTIFICINTEGRATION
CONTEXTUALIZATION
DIRACINTERWARE
Víctor Méndez (www.pic.es)
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

29. PIC: Grid & Cloud
REAL WORLD USER CASES
DIRAC WMS
Task
Queue
VM Scheduler
VM Director
MeghaCloud
Infrastructure
Command-line
DIRAC API
Web Portal
Virtual
Machine
User
Admin
Image Repo
Cloud Manager
DIRAC CS
Cloud Driver
Integration Design: VM Job Running
Víctor Méndez (www.pic.es)
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

30. PIC: Grid & Cloud
REAL WORLD USER CASES
Víctor Méndez (www.pic.es)
DIRAC WMS
Task
Queue
VM Scheduler
OCCI Director
(VM Director)
MeghaCloud
Infrastructure
Virtual
Machine
Image Repo
OCCI / OpenNebula
?
OCCI Image
OCCI RESTful
Client
Integration Design: Occi VM Submission
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

31. PIC: Grid & Cloud
REAL WORLD USER CASES
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012
Virtual Machine
VM Monitor
Job Agent
DIRAC WMS
Task
Queue
VM Manager
Job
Cloud Manager
Virtual
Machine
MeghaCloud
Infrastructure
VM
VM
VM
Job Run
CPU statistics
Job State Update
Job Matcher
Víctor Méndez (www.pic.es)
Integration Design: VM Job Running
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

32. Next Steps...Next Steps...
This is only the tip of the iceberg
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

33. DETECTED PROBLEMS
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Small and medium Scientific Research centers
don ́t have the manpower or know-how to
build a 24/365 data center
Server deployment takes a long time
Can ́t solve peak problems
Usually can ́t have more than one data center

34. TEST PLATFORM
NEXT STEPS FOR...
VO's ? SUNSTONE FEDERATION ?
COMPATIBILITY AND FEATURES
TO BUILD A MARKETPLACE ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

35. REAL SCENARIO
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

36. SomeSome
conclusions...conclusions...
Options to cater to all tastes!
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

37. NEW CHALLENGES
NEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Federated user authentication and authorization
mechanisms and user management between
different cloud managers.
Secure VM image distribution and validation.
among heterogeneous cloud managers.
Federated Cloud accounting system integrating
the accounting records of multiple cloud managers
and supporting the Federated Cloud governance.
Monitoring and notification of unpredictable
change of availability.

38. Distributed scenario
FUTURE COMMUNITY FEDERATED CLOUD MODELFUTURE COMMUNITY FEDERATED CLOUD MODEL
Scalability (Commercial prov. included)
Resource sharing
High Availability
Efficient use of infrastructure
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013

39. Strategy, strategy, strategy, ...
Dedicated to those who made ​​MEGHA possible.
Gràcies!Gràcies!
Gracias!Gracias!
ThanksThanks!!
Jordi Guijarro
jguijarro@cesca.cat
@cloudadms