SlideShare a Scribd company logo

SDEC2011 Essentials of map reduce

•
•
K
Korea Sdec
Technology
1 of 8
Download to read offline
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Essentials of MapReduce Mastering Hadoop Map-reduce for Data Analysis Shashank Tiwari blog: shanky.org | twitter: @tshanky st@treasuryofideas.com
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Walk Through a Map Reduce Example • A mapper class that emits key/value pairs. • A reducer class that takes the values emitted from mapper and manipulates it to create aggregations. In the data upload example, the mapper only inserts the data into an HBase table. • A driver class that puts the mapper class and the reducer class together. • A class that triggers the job in its main method • NYSE HLOC Data Hadoop MapReduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Questions? • blog: shanky.org | twitter: @tshanky • st@treasuryofideas.com

Recommended

Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)jbartley
 
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveSDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveKorea Sdec
 
Interpreting maps
Interpreting mapsInterpreting maps
Interpreting mapsrrodri37
 
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Gail Matthews-DeNatale
 
Transilience map & analysis
Transilience map & analysisTransilience map & analysis
Transilience map & analysisCarlos Hidalgo
 
Types of Maps and other Interpretation
Types of Maps and other Interpretation Types of Maps and other Interpretation
Types of Maps and other Interpretation Lyn Gile Facebook
 
Earth system science notes
Earth system science notesEarth system science notes
Earth system science notesRachael Hubbard
 
The risk reward diagrams
The risk reward diagramsThe risk reward diagrams
The risk reward diagramshttp://www.drawpack.com
 

Recommended

Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)jbartley
 
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveSDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveKorea Sdec
 
Interpreting maps
Interpreting mapsInterpreting maps
Interpreting mapsrrodri37
 
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Gail Matthews-DeNatale
 
Transilience map & analysis
Transilience map & analysisTransilience map & analysis
Transilience map & analysisCarlos Hidalgo
 
Types of Maps and other Interpretation
Types of Maps and other Interpretation Types of Maps and other Interpretation
Types of Maps and other Interpretation Lyn Gile Facebook
 
Earth system science notes
Earth system science notesEarth system science notes
Earth system science notesRachael Hubbard
 
The risk reward diagrams
The risk reward diagramsThe risk reward diagrams
The risk reward diagramshttp://www.drawpack.com
 
Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedMissST
 
Basics of Map reading
Basics of Map reading Basics of Map reading
Basics of Map reading Javed Iqbal Student of M.S (Teacher Education) at University of Tennessee USA
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, softwareNadia Spang Bovey
 
The risk reward diagram
The risk reward diagramThe risk reward diagram
The risk reward diagramhttp://www.drawpack.com
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Mapsmaggiedesmond
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animationrbritton24
 
Map Reading
Map ReadingMap Reading
Map ReadingYee Seng Gan
 
Types of Maps
Types of MapsTypes of Maps
Types of Mapsitutor
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic mapRachael Hubbard
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapMarioSonic54
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperAtrayee SenGupta
 
Topography powerpoint
Topography powerpointTopography powerpoint
Topography powerpointJennifer Bertolino
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map ReadingLEEENNA
 
Map & a diagram (1)
Map & a diagram (1)Map & a diagram (1)
Map & a diagram (1)jasminerachel
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of MapsDan Klumper
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bankPK121
 
Concept Mapping
Concept MappingConcept Mapping
Concept MappingDr. Ann Marie E. McSwain
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept MappingJames Neill
 
SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerKorea Sdec
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionKorea Sdec
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopKorea Sdec
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopKorea Sdec
 

More Related Content

Viewers also liked

Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedMissST
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, softwareNadia Spang Bovey
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Mapsmaggiedesmond
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animationrbritton24
 
Types of Maps
Types of MapsTypes of Maps
Types of Mapsitutor
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic mapRachael Hubbard
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapMarioSonic54
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperAtrayee SenGupta
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map ReadingLEEENNA
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of MapsDan Klumper
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bankPK121
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept MappingJames Neill
 

Viewers also liked (18)

Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combined
 
Basics of Map reading
Basics of Map reading Basics of Map reading
Basics of Map reading
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, software
 
The risk reward diagram
The risk reward diagramThe risk reward diagram
The risk reward diagram
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Maps
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animation
 
Map Reading
Map ReadingMap Reading
Map Reading
 
Types of Maps
Types of MapsTypes of Maps
Types of Maps
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic map
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic Map
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question Paper
 
Topography powerpoint
Topography powerpointTopography powerpoint
Topography powerpoint
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map Reading
 
Map & a diagram (1)
Map & a diagram (1)Map & a diagram (1)
Map & a diagram (1)
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of Maps
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bank
 
Concept Mapping
Concept MappingConcept Mapping
Concept Mapping
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept Mapping
 

More from Korea Sdec

SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerKorea Sdec
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionKorea Sdec
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopKorea Sdec
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopKorea Sdec
 
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingSDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingKorea Sdec
 
SDEC2011 Essentials of Pig
SDEC2011 Essentials of PigSDEC2011 Essentials of Pig
SDEC2011 Essentials of PigKorea Sdec
 
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutSDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutKorea Sdec
 
SDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveSDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveKorea Sdec
 
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsSDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsKorea Sdec
 
Sdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopSdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopKorea Sdec
 
SDEC2011 Rapidant
SDEC2011 RapidantSDEC2011 Rapidant
SDEC2011 RapidantKorea Sdec
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whyKorea Sdec
 
SDEC2011 Going by TACC
SDEC2011 Going by TACCSDEC2011 Going by TACC
SDEC2011 Going by TACCKorea Sdec
 
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesSDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesKorea Sdec
 
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedSDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedKorea Sdec
 
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudSDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudKorea Sdec
 

More from Korea Sdec (16)

SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuer
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestion
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing Hadoop
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoop
 
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingSDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modelling
 
SDEC2011 Essentials of Pig
SDEC2011 Essentials of PigSDEC2011 Essentials of Pig
SDEC2011 Essentials of Pig
 
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutSDEC2011 Essentials of Mahout
SDEC2011 Essentials of Mahout
 
SDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveSDEC2011 Essentials of Hive
SDEC2011 Essentials of Hive
 
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsSDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and models
 
Sdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopSdec2011 Introducing Hadoop
Sdec2011 Introducing Hadoop
 
SDEC2011 Rapidant
SDEC2011 RapidantSDEC2011 Rapidant
SDEC2011 Rapidant
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the why
 
SDEC2011 Going by TACC
SDEC2011 Going by TACCSDEC2011 Going by TACC
SDEC2011 Going by TACC
 
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesSDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & Experiences
 
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedSDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speed
 
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudSDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloud
 

Recently uploaded

Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 

Recently uploaded (20)

Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 

SDEC2011 Essentials of map reduce

  • 1. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Essentials of MapReduce Mastering Hadoop Map-reduce for Data Analysis Shashank Tiwari blog: shanky.org | twitter: @tshanky st@treasuryofideas.com
  • 2. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 3. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 4. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 5. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 6. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 7. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Walk Through a Map Reduce Example • A mapper class that emits key/value pairs. • A reducer class that takes the values emitted from mapper and manipulates it to create aggregations. In the data upload example, the mapper only inserts the data into an HBase table. • A driver class that puts the mapper class and the reducer class together. • A class that triggers the job in its main method • NYSE HLOC Data Hadoop MapReduce
  • 8. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Questions? • blog: shanky.org | twitter: @tshanky • st@treasuryofideas.com