Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

•Download as KEY, PDF•

9 likes•1,818 views

Ryu Kobayashi

Technology

• Hadoop MapReduce
• Cassandra
• MapReduce + Cassandra
• Cassandra MapReduce

•

•
•
• ...

• ...

• Twitter @ryu_kobayashi

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook
• Twitter

Cassandra

Facebook KVS NoSQL DB
0.6.2 0.6.3

• Facebook
• Twitter
•
•

@shot6

Hadoop MR + Cassandra

Cassandra Contributer

Hadoop MR + Cassandra

Hadoop Cassandra H

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase

Hadoop MR + Cassandra
• MR HDFS
• HDFS 30 40

• Cassandra 0.6 Hadoop
(API )
• KVS HDFS
Hbase
•
Cassandra InputFormat
RDBS

AWS EMR(Elastic MapReduce + S3

Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra

Hadoop MR + Cassandra
Cassandra HDFS +TaskTracker
Cassandra

Contribute

Cassandra MapReduce

• org.apache.cassandra.hadoop

• storage-conf.xml
# Thrift storage-conf.xml
• Jar Cassadra Thrift
classpath

• OutputFormat HDFS
(0.7 )
• 1000 Map

# FAQ Issue http://goo.gl/5Q3Z

Cassandra MapReduce

github

http://bit.ly/9nwgSu

Cassandra-GUI
http://code.google.com/p/cassandra-gui/

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

What's hot

Cloud Optimized Big DataJoydeep Sen Sarma

Messaging architecture @FB (Fifth Elephant Conference)Joydeep Sen Sarma

Hadoop cassandra trainingMagnific Trainings

Big Data A La Carte MenuVenkatesh Balakumar

Concepts on HadoopChristopher Sharkey

Hadoop and MapReduceHemanth Kumar Mantri

Nextag talkJoydeep Sen Sarma

Welcome to the Jungle: Distributed Systems for Large Data Sets - StampedeCon ...StampedeCon

Introduction to Big Data & Hadoop Architecture - Module 1Rohit Agrawal

Hadoop and Distributed ComputingFederico Cargnelutti

Hadoop An IntroductionMohanasundaram Ponnusamy

Facebook - Jonthan Gray - Hadoop World 2010Cloudera, Inc.

Apache Hadoop at 10Cloudera, Inc.

Intro To HadoopAl Chin

RSpec for AWSフルマネージドサービスYotaro Fujii

HadoopGagan Agrawal

Cloudera Hadoop DistributionThisara Pramuditha

Acunu overviewAcunu

Cassandra Hadoop Best Practices by Jeremy HannaModern Data Stack France

140614 bigdatacamp-la-keynote-jon hsiehData Con LA

What's hot (20)

Cloud Optimized Big Data

Messaging architecture @FB (Fifth Elephant Conference)

Hadoop cassandra training

Big Data A La Carte Menu

Concepts on Hadoop

Hadoop and MapReduce

Nextag talk

Welcome to the Jungle: Distributed Systems for Large Data Sets - StampedeCon ...

Introduction to Big Data & Hadoop Architecture - Module 1

Hadoop and Distributed Computing

Hadoop An Introduction

Facebook - Jonthan Gray - Hadoop World 2010

Apache Hadoop at 10

Intro To Hadoop

RSpec for AWSフルマネージドサービス

Hadoop

Cloudera Hadoop Distribution

Acunu overview

Cassandra Hadoop Best Practices by Jeremy Hanna

140614 bigdatacamp-la-keynote-jon hsieh

Viewers also liked

Portfolio Melt Advertising S.r.l.Melt Advertising S.r.l.

Office live meeting presentationTexasgirl10

Mobile Learning Using The iPod Touch - A Panel Discussion at Spring CUE 11Mobicip.com

Presentazione Melt Advertising s.r.l.Melt Advertising S.r.l.

Case history Cross-Media Mktg per PMIMelt Advertising S.r.l.

Social Media MarketingMelt Advertising S.r.l.

Viewers also liked (6)

Portfolio Melt Advertising S.r.l.

Office live meeting presentation

Mobile Learning Using The iPod Touch - A Panel Discussion at Spring CUE 11

Presentazione Melt Advertising s.r.l.

Case history Cross-Media Mktg per PMI

Social Media Marketing

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Developers summit cassandraで見るNoSQLRyu Kobayashi

Hadoop+Cassandra_IntegrationJoyabrata Das

Hadoop Conference Japan 2011 Fallに行ってきましたmoai kids

Partners in Crime: Cassandra Analytics and ETL with HadoopStu Hood

Cassandra+HadoopJeremy Hanna

Hadoop online trainingsGeek Trainings

Intro to cassandra + hadoopJeremy Hanna

マーケティングのためのHadoop利用Tatsuya Sasaki

Nosql taxonomy with new nuggetMatt Ingenthron

Stratio big data spainÁlvaro Agea Herradón

COOKPADでのHadoop利用Tatsuya Sasaki

Microsoft's Big Play for Big DataAndrew Brust

Microsoft's Big Play for Big Data- Visual Studio Live! NY 2012Andrew Brust

Qubole Overview at the Fifth Elephant ConferenceJoydeep Sen Sarma

800万人の"食べたい"をHadoopで分散処理Tatsuya Sasaki

Real World NoSQL (by Chris Yuen)orcsab

Deep dive into event store using Apache CassandraAhmedabadJavaMeetup

Cassandra Distributions and VariantsAnant Corporation

The Hadoop Path by Subash DSouza of Archangel Technology Consultants, LLC.Data Con LA

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra (20)

Developers summit cassandraで見るNoSQL

Hadoop+Cassandra_Integration

Hadoop Conference Japan 2011 Fallに行ってきました

Partners in Crime: Cassandra Analytics and ETL with Hadoop

Cassandra+Hadoop

Hadoop online trainings

Intro to cassandra + hadoop

マーケティングのためのHadoop利用

Nosql taxonomy with new nugget

Stratio big data spain

COOKPADでのHadoop利用

Microsoft's Big Play for Big Data

Microsoft's Big Play for Big Data- Visual Studio Live! NY 2012

Qubole Overview at the Fifth Elephant Conference

800万人の"食べたい"をHadoopで分散処理

Real World NoSQL (by Chris Yuen)

Deep dive into event store using Apache Cassandra

Cassandra Distributions and Variants

The Hadoop Path by Subash DSouza of Archangel Technology Consultants, LLC.

Recently uploaded

A Domino Admins Adventures (Engage 2024)Gabriella Davis

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

A Call to Action for Generative AI in 2024Results

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Histor y of HAM Radio presentation slidevu2urc

A Year of the Servo Reboot: Where Are We Now?Igalia

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

Scaling API-first – The story of a global engineering organizationRadu Cotescu

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Real Time Object Detection Using Open CVKhem

Slack Application Development 101 Slidespraypatel2

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Recently uploaded (20)

A Domino Admins Adventures (Engage 2024)

Automating Google Workspace (GWS) & more with Apps Script

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Presentation on how to chat with PDF using ChatGPT code interpreter

Boost Fertility New Invention Ups Success Rates.pdf

A Call to Action for Generative AI in 2024

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Histor y of HAM Radio presentation slide

A Year of the Servo Reboot: Where Are We Now?

Exploring the Future Potential of AI-Enabled Smartphone Processors

Scaling API-first – The story of a global engineering organization

08448380779 Call Girls In Friends Colony Women Seeking Men

🐬 The future of MySQL is Postgres 🐘

Real Time Object Detection Using Open CV

Slack Application Development 101 Slides

Data Cloud, More than a CDP by Matt Robison

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

1. 3 Hadoop Hadoop MR + Cassandra 2010/06/28 @ryu_kobayashi

2. • Hadoop MapReduce • Cassandra • MapReduce + Cassandra • Cassandra MapReduce •

3. • • • ... • ... • Twitter @ryu_kobayashi

4. Hadoop MapReduce Google MapReduce

5. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3

6. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3

7. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook

8. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter

9. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter •

10. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter • •

11. Cassandra Facebook KVS NoSQL DB 0.6.2 0.6.3 • Facebook • Twitter • • @shot6

12. Hadoop MR + Cassandra

13. Hadoop MR + Cassandra

14. Hadoop MR + Cassandra

15. Hadoop MR + Cassandra Cassandra Contributer

16. Hadoop MR + Cassandra

17. Hadoop MR + Cassandra

18. Hadoop MR + Cassandra

19. Hadoop MR + Cassandra Hadoop Cassandra H

20. H

21. Hadoop MR + Cassandra

22. Hadoop MR + Cassandra • MR HDFS

23. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40

24. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API )

25. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API ) • KVS HDFS Hbase

26. Hadoop MR + Cassandra • MR HDFS • HDFS 30 40 • Cassandra 0.6 Hadoop (API ) • KVS HDFS Hbase • Cassandra InputFormat RDBS AWS EMR(Elastic MapReduce + S3

27. Hadoop MR + Cassandra

28. Hadoop MR + Cassandra

29. Hadoop MR + Cassandra

30. Hadoop MR + Cassandra Cassandra HDFS +TaskTracker Cassandra

31. Hadoop MR + Cassandra Cassandra HDFS +TaskTracker Cassandra Contribute

32. Cassandra MapReduce • org.apache.cassandra.hadoop • storage-conf.xml # Thrift storage-conf.xml • Jar Cassadra Thrift classpath • OutputFormat HDFS (0.7 ) • 1000 Map # FAQ Issue http://goo.gl/5Q3Z

33. Cassandra MapReduce github http://bit.ly/9nwgSu

34.

35. Cassandra-GUI http://code.google.com/p/cassandra-gui/

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (6)

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Similar to Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra (20)

More from Ryu Kobayashi

More from Ryu Kobayashi (6)

Recently uploaded

Recently uploaded (20)

Hadoopソースコードリーディング第3回 Hadopo MR + Cassandra

Editor's Notes