jclouds Birds of a Feather at OSCON 2013

1. Control Multi-Cloud
Infrastructure With Java
jclouds
Everett Toews
Developer Advocate
@everett_toews
OSCON
July 22, 2013 @ 7:00 pm

2. Intro
Developer

3. Committer on jclouds

4. Intro
Advocate

5. Avatar

6. Intro
Operations

7. Co-author of The OpenStack Operations Guide
docs.openstack.org/ops

8. Cultural Learnings
In startup we
are not allow
dev team for
talk to ops team
except by API.
@DevOps_Borat

9. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Agenda

10. Agenda
•Introduction to Apache jclouds
•Where Does jclouds Live?
•What Can jclouds Do For You
Today?
•Terminology
•Example
•Potpourri

11. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Introduction to
Apache jclouds

12. Apache jclouds
• Multi-Cloud Toolkit
• Open Source (Apache v2)
• Community
• Portable APIs
• Ecosystem APIs
• Provider APIs
• Java

13. Supported Compute Clouds
•Rackspace Cloud Servers
•HP Cloud Compute
•AWS EC2
•ElasticHosts
•GoGrid
•All Clouds

14. Supported Storage Clouds
•Rackspace Cloud Files
•HP Cloud Storage
•AWS S3
•Azure
•CloudOne
•All Clouds

15. Community

17. APIs and Providers
APIs
openstack-nova ec2 rackspace-clouddns

18. APIs and Providers
APIs
Providers
openstack-nova ec2 rackspace-clouddns
rackspace-
cloudservers-us
rackspace-
cloudservers-uk
aws-ec2
rackspace-
clouddns-us
rackspace-
clouddns-uk

19. APIs
APIs
openstack-nova
NovaApi:
ServerApi
FlavorApi
ImageApi
=Extensions=
KeyPairApi
SecurityGroupApi
FloatingIpApi
...
ec2
EC2Api:
TagApi
SubnetApi
WindowsApi
rackspace-clouddns
CloudDNSApi:
LimitApi
DomainApi
RecordApi
ReverseDNSApi

20. Providers
Providers
rackspace-
cloudservers-us
rackspace-
cloudservers-uk
rackspace-
cloudservers-us
rackspace-
cloudservers-uk
rackspace-
clouddns-us
rackspace-
clouddns-uk
•configuration
•provider specific features

21. Compute Venn
Portable
Ecosystem

22. Compute Layers
•ComputeService
•OpenStack
•Rackspace
•HP, AWS, etc.
•NovaApi (*Api)
•OpenStack
•Rackspace
•HP
Portable
Ecosystem

23. Storage Venn
Portable
Ecosystem
Provider

24. Storage Layers
•BlobStore
•OpenStack
•Rackspace
•HP, AWS, etc.
•SwiftApi
•OpenStack
•Rackspace
•HP
•CloudFilesClient
•Rackspace
Portable
Ecosystem
Provider

25. Cultural Learnings
After 3 beer I
can able use
any of cloud
API.
@DevOps_Borat

26. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Where Does jclouds Live?

27. SDK Deployment
Your
System
S
D
K
Cloud
A
P
I
VM
VM
VM
User
System

28. SDK Deployment
A
P
I
Cloud
Your
System
S
D
K
User
System
VM
VM
VM
VM

29. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
What Can jclouds
Do For You Today?

30. SDKs
Plumbing

31. SDKs
(Re)Authentication

32. SDKs
Pagination

33. SDKs
State Polling

34. SDKs
Rate Limiting

35. SDKs
Retry

36. SDKs
Smoothing
Rough Edges

37. SDKs
Open Source

38. Cultural Learnings
In devops
nobody is get
fire for buy
open source.
@DevOps_Borat

39. SDKs
Community

40. SDKs
Packaged

41. SDKs
All-in-one

42. SDKs
Extensions

43. SDKs
No lock-in

44. SDKs
Battle Tested Code

45. SDKs
Sample Code

46. SDKs
Documentation

47. Cultural Learnings
Survey is show
junior devops
are still believe
in Tooth Fairy,
Santa Claus and
documentation. @DevOps_Borat

48. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Terminology

49. Terminology
jclouds Rackspace/OpenStack
Compute Cloud Servers/Nova
Node Server
Location Region
Hardware Flavor
NodeMetadata Server details
User Metadata Metadata
BlobStore Cloud Files/Swift
Blob File/Object

50. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Example

51. Maven
•mkdir jclouds-workshop
•cd jclouds-workshop
•Create pom.xml
•gist.github.com/everett-toews/3861545
•mvn dependency:copy-dependencies
"-DoutputDirectory=./lib"

52. JCloudsWorkshop.java
•Create JCloudsWorkshop.java
•gist.github.com/everett-toews/5624677
•javac -cp ".:lib/*" JCloudsWorkshop.java
•java -cp ".:lib/*" JCloudsWorkshop

53. RACKSPACE® HOSTING | WWW.RACKSPACE.COM
Potpourri

54. Potpourri
•Moved to Apache Software Foundation
•groupId change
• 1.6.0
•<groupId>org.jclouds.X</groupId>
• 1.6.1-incubating
•<groupId>org.apache.jclouds.X</groupId>
•Package change
•1.6.x: import org.jclouds
•1.7: import org.apache.jclouds

55. Potpourri
•Google’s Guice & Guava
•Removal of the AsyncApis in 1.7
•Dropping support for Java 1.6?
•Cloud Files isn’t multi-region...yet
•Cloud Databases in progress
•More endpoints

56. Potpourri
•Command Line Interface
•Jenkins Plugin
•jclouds-chef
•Who Uses jclouds?
•CloudBees
•Cloudify
•EnterpriseDB
•Pallet
•Stratos etc etc etc

57. Thank You
Everett Toews
Developer Advocate
@everett_toews
developer.rackspace.com