Oracle Cloud InfrastructureでのCloudera活用に関するセッションです。

1. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Cloudera on Oracle Cloud Infrastructure
Ben.Lackey@Oracle.com
Director, Big Data and Analytics Partnerships
Zach.Smith@Oracle.com
Senior Member of Technical Staff

2. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Agenda
• Cloudera on OCI 概要 (20 min)
– Cloudera/Oracle Partnership
– Customer Examples
– What is OCI?
– Benchmarks
– Best Practices
– Deployment
• Demo – Deploy Cloudera on OCI (20 min)
– Git repo
– Terraform
– OCI Console
– View UI

3. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Cloudera と Oracle のパートナーシップ
• 2011 – Big Data Appliance (BDA)
• 2012 – Oracle Big Data Connectors
• 2016 – Cloudera and Oracle Partner on
Launch of Bare Metal Cloud
• 2017 – Big Data Cloud Service (BDCS)
• 2017 – 500+ Joint Oracle and Cloudera
customers
• 2018 – Terraform on OCI
• 2018 – Joint benchmarking

4. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
お客様 - Cloudera on Oracle

5. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Oracle Data Cloud runs Cloudera on OCI
1日に430億件
のAPIコールをリ
アルタイム処理
毎月7.5兆データ
ポイントを収集
2,200ベアメタル・イ
ンスタンスを利用
11Peta Byteの
データ
750ノードの
Cloudera

6. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Oracle – Clouderaの実行に最適な基盤!
NVMe storage Load Balancers, …Bare Metal VMs Exadata, RAC
PHYSICAL NETWORK
DATACENTERSREGION
VIRTUAL NETWORK
COMPUTE, STORAGE,
DATABASE, LBs, …
Availability
Domain 1
Availability
Domain 2
Availability
Domain 3

7. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Oracle – 優れたサーバー・パフォーマンスを提供
Oracle AWS Oracle offers:
Compute 2.57 TFLOPs 1.77 TFLOPs 45% more
Memory 153.02 GB/s 134.03 GB/s 14% more
Block Storage 500,000 IOPS 80,000 IOPS 525% more
Network 50 Gbps 25 Gbps 100% more

8. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Oracle – 非常にアグレッシブな価格
Oracle AWS Oracle costs:
Compute
Standard compute core/hours
$0.03 $0.096 68% less
Block Storage
1 TB @ 25K IOPS /per month
$43 $1,750 97% less
Network
100 TB egress per month
$76 $7,800 99% less

9. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
6X Performance
Maximum IOPS
Oracle AWS
500,000
80,000
97% Cheaper
1TB with 25,000 IOPS
Oracle AWS
$1,750
$42.50
Block Storage (Serverあたり): 優れたパフォーマンスと価格

10. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
業界初、エンタープライズ・レベルのSLAを提供
AWS
Availability Covered Covered
Performance Covered No coverage
Manageability Covered No coverage

11. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
ASHBURN, VAPHOENIX
FRANKFURT
Oracle Cloud Infrastructure Global Footprint by 2019
Commercial
Edge Points of Presence
Government
SYDNEY
CHICAGO
TORONTO
SAO PAULO
TOKYOSEOUL
MUMBAI
ZURICH
OSAKA
LONDON

12. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
10 Worker Nodes and 3 Master Nodes
ベンチマーク結果 - 10TB TeraSort
VM.Standard1.8 VM.Standard2.8 VM.Standard1.16 VM.Standard2.16 BM.Standard1.36 BM.DenseIO1.36 BM.DenseIO2.52
1h 56m 5s
4h 27m 34s
Block Storage NVME Storage
38m 34s
1h 4m 7s
43m 12s
1h 59m 21s
3h 45m 18s

13. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
ベンチマーク結果 - 10TB TeraSort

14. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Region
ベスト・プラクティス – リファレンス・アーキテクチャ
Private Subnet
Master Worker
ZooKeeper
NameNode
HDFS
Public Subnet
Edge Utility
Edge Service Postgres
CMS
Virtual Network

15. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Persistent Clusters(永続)
• BM.DenseIO2.52
– 52 OCPU
– 768GB RAM
– 51.2 TB NVMe SSD
• 最大1TBまでのBlock storage
• 追加でobject storageを活用して階
層化
Ephemeral Clusters(揮発性)
• BM.Standard.E2.64
– 64 OCPU
– 512GB RAM
• 最大1PBまでのBlock Storage
• 使用しない時は、Computeを停止!
ベスト・プラクティス - Compute

16. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Bare Metal NVMe Block Volume Object Storage
Hot Data Warm Data Cold Data
Archive Storage
Frozen Data
• Computeとストレー
ジを同居
• ハイ・パフォーマンス
かつSLAで保護
• Workerを増やしてス
ケール
• SLAでパフォーマンス保護
• Computeに依存せずにス
ケール
• 必要なキャパシティに応じ
てスケール
• 低コストな長期保存スト
レージ
• Computeをストレージに
依存せずにスケール
• 容易なデータ共有
ベスト・プラクティス - Storage

17. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
ベスト・プラクティス - Network
• Virtual Networks
– 高いセキュリティを実現するための、Privateと
Publicの2 Tierモデル
– シンプルで容易に使用できるシングルPublic
Networkモデル
• Availability Domains
– 低遅延：1 AD
– 高可用性: 3AD
Region
Virtual Network
Availability Domain
Public Subnet
Utility
Edge
Private Subnet
Master
Worker

18. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
• Infrastructure as Code (IaC)
– https://github.com/terraform-providers/terraform-provider-oci
• ベスト・プラクティスにそったインフラのデプロイ
– Compute
– Storage
– Network
• 30分で環境がReady

19. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Demo Time!

20. Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
OCI is the best place to run Cloudera!
• 参考情報
– Landing Page - https://cloud.oracle.com/iaas/cloudera
– Webinar - https://go.oracle.com/LP=70788/?elqCampaignId=138010
– White Paper - https://cloud.oracle.com/iaas/whitepapers/cloudera_reference_arch_oci.pdf
– Blog - https://blogs.oracle.com/cloud-infrastructure/cloudera-enterprise-data-hub-now-validated-
on-oracle-cloud-infrastructure
• トライアル
– https://github.com/cloud-partners/oci-cloudera
• Ben.Lackey@Oracle.com
– https://twitter.com/benofben
• Zach.Smith@Oracle.com