Map reduce hackerdojo

•Download as PPT, PDF•

1 like•490 views

nagwww

How to think in Map-Reduce Paradigm Ayon Sinha

Overview ,[object Object],[object Object],[object Object]

How to think in MapReduce paradigm ,[object Object],[object Object],[object Object],[object Object]

Thinking in MapReduce contd.. ,[object Object],[object Object],[object Object],[object Object],[object Object]

Example of Join in MapReduce ,[object Object],[object Object],[object Object],[object Object],[object Object]

$Example contd. User details Mappers User purchase mappers <userId456: “D_”+details> <userId123: “D_”+details> <userId991: “D_”+details> <userId678: “D_”+details> <userId234: “D_”+details> <userId459: “D_”+details> <userId991: “P_”+purch-details> <userId123: “P_”+purch-details> <userId678: “P_”+purch-details> <userId234: “P_”+purch-details> <userId456: “P_”+purch-details> Input to Reducer: <userdId456>:{D_John Doe, 123 main st, Home Town, CA P_Amazon Kindle 3 $139 03/25/2011 P_Cowboy boots, $145, 04/01/2011 P_Aviator Sunglasses $69, 03/31/2011 .. … } Aggregate and emit from Reducer Reducer for one userID$

Ricky's Blog ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

K-Means Time complexity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Recommendations ,[object Object],[object Object],[object Object],[object Object]

References ,[object Object],[object Object],[object Object],[object Object]

Viewers also liked

BigData_Week1nagwww

Python installation ver 2nagwww

Vertica 7.0 Architecture OverviewAndrey Karpov

Survey onhpcs languagesSaliya Ekanayake

High Performance Data Analytics with Java on Large Multicore HPC ClustersSaliya Ekanayake

Canopy kmeansnagwww

Towards a Systematic Study of Big Data Performance and BenchmarkingSaliya Ekanayake

MapReduce in Simple TermsSaliya Ekanayake

Java Thread and Process Performance for Parallel Machine Learning on Multicor...Saliya Ekanayake

Amazon EC2 & VPC HOLAmazon Web Services

Viewers also liked (10)

BigData_Week1

Python installation ver 2

Vertica 7.0 Architecture Overview

Survey onhpcs languages

High Performance Data Analytics with Java on Large Multicore HPC Clusters

Canopy kmeans

Towards a Systematic Study of Big Data Performance and Benchmarking

MapReduce in Simple Terms

Java Thread and Process Performance for Parallel Machine Learning on Multicor...

Amazon EC2 & VPC HOL

Similar to Map reduce hackerdojo

Elementary Concepts of data minigDr Anjan Krishnamurthy

Mastering MapReduce: MapReduce for Big Data Management and AnalysisTeradata Aster

Introduction to MapReduce & hadoopColin Su

No more struggles with Apache Spark workloads in productionChetan Khatri

Google Cluster InnardsMartin Dvorak

Strata Presentation: One Billion Objects in 2GB: Big Data Analytics on Small ...randyguck

Cloudera Data Science ChallengeMark Nichols, P.E.

Data Science Challenge presentation given to the CinBITools Meetup GroupDoug Needham

Hadoop & Hive Change the Data Warehousing Game ForeverDataWorks Summit

Cloud Computing ...changes everythingLew Tucker

Cloudera Movies Data Science Project On Big DataAbhishek M Shivalingaiah

Hadoop Hive Talk At IIT-DelhiJoydeep Sen Sarma

Multiplatform Spark solution for Graph datasources by Javier DominguezBig Data Spain

Applying stratosphere for big data analyticsAvinash Pandu

Benefits of Using MongoDB Over RDBMSsMongoDB

Aggregating In AccumuloBill Slacum

February 2016 Webinar Series - Introduction to DynamoDBAmazon Web Services

At the core you will have KUSTORiccardo Zamana

Azure Databricks for Data ScientistsRichard Garris

Cassandra & puppet, scaling data at $15 per monthdaveconnors

Similar to Map reduce hackerdojo (20)

Elementary Concepts of data minig

Mastering MapReduce: MapReduce for Big Data Management and Analysis

Introduction to MapReduce & hadoop

No more struggles with Apache Spark workloads in production

Google Cluster Innards

Strata Presentation: One Billion Objects in 2GB: Big Data Analytics on Small ...

Cloudera Data Science Challenge

Data Science Challenge presentation given to the CinBITools Meetup Group

Hadoop & Hive Change the Data Warehousing Game Forever

Cloud Computing ...changes everything

Cloudera Movies Data Science Project On Big Data

Hadoop Hive Talk At IIT-Delhi

Multiplatform Spark solution for Graph datasources by Javier Dominguez

Applying stratosphere for big data analytics

Benefits of Using MongoDB Over RDBMSs

Aggregating In Accumulo

February 2016 Webinar Series - Introduction to DynamoDB

At the core you will have KUSTO

Azure Databricks for Data Scientists

Cassandra & puppet, scaling data at $15 per month