Big data and Hadoop session - KnowBigData (techgig)
•
0 gefällt mir•498 views
This is the first introductory session on Big Data & Hadoop. It clears a lot of myths and confusion about Big Data. How exactly Big Data handling is a challenge and how does Hadoop addresses those problems. In this session we talks about Big Data and related challenges and how does Hadoop solves those challenges. By the end of this presentation you should be fairly clear about Hadoop and Big Data. To watch the video or know more about the course, please visit http://www.knowbigdata.com/page/big-data-and-hadoop-online-instructor-led-training
Empfohlen
Weitere ähnliche Inhalte
Andere mochten auch
Andere mochten auch (15)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Big data and Hadoop session - KnowBigData (techgig)
- 1. www.KnowBigData.comHadoop What, Why & How to Get Started with Big Data & Hadoop
- 2. www.KnowBigData.comHadoop ABOUT INSTRUCTOR? 2014 KnowBigData Founded 2014 Amazon Built High Throughput Systems for Amazon.com site similar to storm. 2012 2012 InMobi Built Recommender that churns 200 TB 2011 tBits Global Founded tBits Global Built an enterprise grade Document Management System 2006 D.E.Shaw Built the big data systems before the term was coined 2002 2002 IIT Roorkee Finished B.Tech.
- 3. www.KnowBigData.comHadoop ❏ What/why of Big Data? ❏ Why Now? ❏ Examples Customers ❏ What is Hadoop? TODAY’S CLASS ❏ Components of Hadoop ❏ Further Reading/Assignment
- 4. www.KnowBigData.comHadoop WHAT IS BIG DATA? • Simply: Data of Very Big Size • Can’t process with usual tools • Distributed Architecture Needed
- 5. www.KnowBigData.comHadoop 1.Groups of networked computers 2.Interact with each other 3.To achieve a common goal. DISTRIBUTED COMPUTING
- 6. www.KnowBigData.comHadoop CHARACTERSTICS OF BIG DATA Problems Involving the handling of data coming at fast rate. e.g. Number of requests being received by Facebook, Youtube streaming, Google Analytics Problems involving complex data structures e.g. Maps, Social Graphs, Recommendations VOLUME VELOCITY VARIETY Data At Rest Data In Motion Data in Many Forms Problems related to storage of huge data reliably. e.g. Storage of Logs of a website, Storage of data by gmail. FB: 300 PB. 600TB/ day
- 7. www.KnowBigData.comHadoop WHY IS IT IMPORTANT NOW? Smart Phones 4.6 billion mobile-phones. 1 - 2 billion people accessing the internet. Facebook:1.06 bn monthly active users, 30 billion pieces shared monthly. ~175 million tweets every day Connectivity: Social Networks The connectivity improved. The devices became cheaper, faster and smaller. Connectivity: Internet Of Things
- 8. www.KnowBigData.comHadoop EXAMPLE BIG DATA CUSTOMERS Web and e-commerce 1.Recommendation Engines 2.Search Quality 3.Sentiment Analyses 4.A/B testing Telecommunications 1.Customer Churn Prevention 2.Network Performance Optimization 3.Calling Data Record (CDR) Analysis 4.Analyzing Network to Predict Failure
- 9. www.KnowBigData.comHadoop EXAMPLE BIG DATA CUSTOMERS Government 1.Fraud Detection 2.Cyber Security Welfare 3.Justice Healthcare & Life Sciences 1.Health information exchange 2.Gene sequencing 3.Healthcare improvements 4.Drug Safety
- 10. www.KnowBigData.comHadoop EXAMPLE BIG DATA PROBLEMS Recommendations
- 11. www.KnowBigData.comHadoop EXAMPLE BIG DATA PROBLEMS Recommendations
- 12. www.KnowBigData.comHadoop EXAMPLE BIG DATA PROBLEMS Sentiment Analysis
- 14. www.KnowBigData.comHadoop BIG DATA SOLUTIONS 1.Apache Hadoop ○ Apache Spark 2.Cassandra 3.MongoDB 4.Google Compute Engine
- 15. www.KnowBigData.comHadoop WHAT IS HADOOP? A. Created by Doug Cutting (of Yahoo) and Mike Cafarella B. Based on GFS, GMR & Google Big Table C. Built for Nutch search engine project D. Named after Toy Elephant E. Open Source - Apache F. Power, Popular & Supported G. Framework to handle Big Data H. For reliable, scalable, distributed computing I. Written in Java
- 16. www.KnowBigData.comHadoop Workflow SQL Inteface New Language Machine learning / STATS NoSQL Datastore Compute Engine Main Component COMPONENTS
- 17. www.KnowBigData.comHadoop ABOUT KNOWBIGDATA ❏ Expert Instructors ❏ CloudxLab ❏ Lifetime access to LMS ❏ Presentations ❏ Class Recording ❏ Assignments + Quizzes ❏ Project Work ❏ Real Life Project ❏ Course Completion Certificate ❏ 24x7 support ❏ KnowBigData - Alumni ❏ Jobs ❏ Stay Abreast (Updated Content, Complimentary Sessions) ❏ Stay Connected
- 18. www.KnowBigData.comHadoop WHAT IS CLOUDxLABSTM ? 1. For Real Life Experience 2. An online cluster of servers 3. With all required tools installed 4. Accessible globally 5. Do not require high end configuration
- 19. www.KnowBigData.comHadoop www.KnowBigData.com 1.Starting on... ● 12 Dec - 7am Big Data & Hadoop ● 12 Dec - 8:30pm Big Data & Spark 2.Sat-Sun - 3 hours 3.33 hrs - 3 hr x 11 classes 4.₹19999 (25% off) (Incl. Taxes) - $369 5.Includes CloudxLabs + Support + LMS 6.Every class is also recorded. reachus@KnowBigData.com +1 419 665 3276 (US) +91 803 959 1464 (IN) Upcoming Courses
- 20. www.KnowBigData.comHadoop Thank you. reachus@knowbigdata.com +1 419 665 3276 (US) +91 803 959 1464 (IN) Subscribe to our Youtube channel for latest videos - https://www. youtube.com/channel/UCxugRFe5wETYA7nMH6VGyEA