Suche senden
Hochladen
Hadoopを業務で使ってみました
•
4 gefällt mir
•
2,196 views
Tatsuya Sasaki
Folgen
テックライフLT #tllt で使ったスライドです
Weniger lesen
Mehr lesen
Technologie
Bildung
Melden
Teilen
Melden
Teilen
1 von 23
Jetzt herunterladen
Downloaden Sie, um offline zu lesen
Empfohlen
800万人の"食べたい"をHadoopで分散処理
800万人の"食べたい"をHadoopで分散処理
Tatsuya Sasaki
マーケティングのためのHadoop利用
マーケティングのためのHadoop利用
Tatsuya Sasaki
961万人の食卓を支えるデータ解析
961万人の食卓を支えるデータ解析
Tatsuya Sasaki
Big Data in the Microsoft Platform
Big Data in the Microsoft Platform
Jesus Rodriguez
Cloud Friendly Hadoop and Hive
Cloud Friendly Hadoop and Hive
DataWorks Summit
Intro to cassandra + hadoop
Intro to cassandra + hadoop
Jeremy Hanna
Yahoo! - Arun Murthy - Hadoop World 2010
Yahoo! - Arun Murthy - Hadoop World 2010
Cloudera, Inc.
Hadoop_content_by_sasidhar2
Hadoop_content_by_sasidhar2
Akshara Technologies Training by Industry Experts
Weitere ähnliche Inhalte
Was ist angesagt?
Qubole Overview at the Fifth Elephant Conference
Qubole Overview at the Fifth Elephant Conference
Joydeep Sen Sarma
Cassandra/Hadoop Integration
Cassandra/Hadoop Integration
Jeremy Hanna
Cloud Optimized Big Data
Cloud Optimized Big Data
Joydeep Sen Sarma
PySpark Cassandra - Amsterdam Spark Meetup
PySpark Cassandra - Amsterdam Spark Meetup
Frens Jan Rumph
Hadoop big data online training
Hadoop big data online training
Magnific Trainings
Hadoop 101 - Big Data Technology
Hadoop 101 - Big Data Technology
Firman Gautama
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Yahoo Developer Network
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Big Data Joe™ Rossi
Introduction to the Hadoop Ecosystem (codemotion Edition)
Introduction to the Hadoop Ecosystem (codemotion Edition)
Uwe Printz
Introduction to Apache Hivemall v0.5.2 and v0.6
Introduction to Apache Hivemall v0.5.2 and v0.6
Makoto Yui
Productive data engineer
Productive data engineer
Rafał Wojdyła
Hive vs Pig for HadoopSourceCodeReading
Hive vs Pig for HadoopSourceCodeReading
Mitsuharu Hamba
Hadoop introduction
Hadoop introduction
shubham kuwar
Drill at the Chug 9-19-12
Drill at the Chug 9-19-12
Ted Dunning
Hadoop basics
Hadoop basics
Antonio Silveira
Cassandra + Spark (You’ve got the lighter, let’s start a fire)
Cassandra + Spark (You’ve got the lighter, let’s start a fire)
Robert Stupp
Hadoop training
Hadoop training
TIB Academy
Introduction to pig & pig latin
Introduction to pig & pig latin
knowbigdata
Map reduce and hadoop at mylife
Map reduce and hadoop at mylife
responseteam
Was ist angesagt?
(19)
Qubole Overview at the Fifth Elephant Conference
Qubole Overview at the Fifth Elephant Conference
Cassandra/Hadoop Integration
Cassandra/Hadoop Integration
Cloud Optimized Big Data
Cloud Optimized Big Data
PySpark Cassandra - Amsterdam Spark Meetup
PySpark Cassandra - Amsterdam Spark Meetup
Hadoop big data online training
Hadoop big data online training
Hadoop 101 - Big Data Technology
Hadoop 101 - Big Data Technology
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Flickr: Computer vision at scale with Hadoop and Storm (Huy Nguyen)
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Hadoop: Past, Present and Future - v2.1 - SQLSaturday #340
Introduction to the Hadoop Ecosystem (codemotion Edition)
Introduction to the Hadoop Ecosystem (codemotion Edition)
Introduction to Apache Hivemall v0.5.2 and v0.6
Introduction to Apache Hivemall v0.5.2 and v0.6
Productive data engineer
Productive data engineer
Hive vs Pig for HadoopSourceCodeReading
Hive vs Pig for HadoopSourceCodeReading
Hadoop introduction
Hadoop introduction
Drill at the Chug 9-19-12
Drill at the Chug 9-19-12
Hadoop basics
Hadoop basics
Cassandra + Spark (You’ve got the lighter, let’s start a fire)
Cassandra + Spark (You’ve got the lighter, let’s start a fire)
Hadoop training
Hadoop training
Introduction to pig & pig latin
Introduction to pig & pig latin
Map reduce and hadoop at mylife
Map reduce and hadoop at mylife
Mehr von Tatsuya Sasaki
からあげエンジニアについて
からあげエンジニアについて
Tatsuya Sasaki
クックパッドでのemr利用事例
クックパッドでのemr利用事例
Tatsuya Sasaki
からあげとビーチと私
からあげとビーチと私
Tatsuya Sasaki
メタプログラミングでDSLを書こう
メタプログラミングでDSLを書こう
Tatsuya Sasaki
NoSQLデータベースが登場した背景と特徴
NoSQLデータベースが登場した背景と特徴
Tatsuya Sasaki
Hadoopをemr経由で利用する方法
Hadoopをemr経由で利用する方法
Tatsuya Sasaki
COOKPADでのHadoop利用
COOKPADでのHadoop利用
Tatsuya Sasaki
Hadoop導入事例 in クックパッド
Hadoop導入事例 in クックパッド
Tatsuya Sasaki
Hadoopを業務で使ってみた
Hadoopを業務で使ってみた
Tatsuya Sasaki
YUI
YUI
Tatsuya Sasaki
Mehr von Tatsuya Sasaki
(10)
からあげエンジニアについて
からあげエンジニアについて
クックパッドでのemr利用事例
クックパッドでのemr利用事例
からあげとビーチと私
からあげとビーチと私
メタプログラミングでDSLを書こう
メタプログラミングでDSLを書こう
NoSQLデータベースが登場した背景と特徴
NoSQLデータベースが登場した背景と特徴
Hadoopをemr経由で利用する方法
Hadoopをemr経由で利用する方法
COOKPADでのHadoop利用
COOKPADでのHadoop利用
Hadoop導入事例 in クックパッド
Hadoop導入事例 in クックパッド
Hadoopを業務で使ってみた
Hadoopを業務で使ってみた
YUI
YUI
Kürzlich hochgeladen
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UbiTrack UK
20150722 - AGV
20150722 - AGV
Jamie (Taka) Wang
20230104 - machine vision
20230104 - machine vision
Jamie (Taka) Wang
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
Eric D. Schabell
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
Jamie (Taka) Wang
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
IES VE
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
Udaiappa Ramachandran
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
DianaGray10
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
Adtran
201610817 - edge part1
201610817 - edge part1
Jamie (Taka) Wang
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
D Cloud Solutions
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
Mahmoud Rabie
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
UiPathCommunity
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
DianaGray10
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
GDSC PJATK
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
Asko Soukka
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IES VE
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
Matt Ray
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Commit University
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
DianaGray10
Kürzlich hochgeladen
(20)
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
20150722 - AGV
20150722 - AGV
20230104 - machine vision
20230104 - machine vision
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
201610817 - edge part1
201610817 - edge part1
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
Hadoopを業務で使ってみました
1.
Hadoop
2.
• id:sasata299 • • Ruby
Perl •
3.
Hadoop
4.
816 30
3 1
5.
(
)
7.
• • GROUP BY
( ( Д`) • 7000 ( )
9.
Hadoop
10.
Hadoop • Hadoop Streaming •
Ruby • Amazon EC2 Hadoop • 50
11.
Hadoop Streaming
12.
•
( ) • Mapper Reducer
14.
HDFS Mapper, Reducer
15.
Java ( or
JRuby ) Java API
16.
Hadoop Streaming
…orz
18.
Hadoop
cat `hadoop dfs -cat s3://xxxx/user/root/in/hoge` HDFS
19.
7000
( )→
20.
7000
( )→ 30
21.
Hadoop
!!
22.
• Hadoop Streaming
HDFS (Hadoop cat ) • 7000 30 Hadoop
Jetzt herunterladen