Hw09 Production Deep Dive With High Availability

•

4 gefällt mir•1,191 views

Cloudera, Inc.

Technologie

Hadoop at ContextWeb Alex Dorman, VP Engineering Paul George, Sr. Systems Architect October 2009

ContextWeb: Traffic ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

ContextWeb Architecture highlights ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Data Set ,[object Object],[object Object],[object Object],[object Object]

Hadoop Cluster ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Cluster ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Architectural Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Partitioned Data Set: Date/Time ,[object Object],[object Object],[object Object],[object Object],[object Object]

Partitioned Data Set: Revisions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Logical Schemas and Headers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Getting Data in and out ,[object Object],[object Object],[object Object],[object Object]

Getting Data in and out: WebDAV driver ,[object Object],[object Object],[object Object],[object Object],[object Object]

QlikView Reporting Application ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

High Availability for NameNode/JobTracker ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Redundant Network Architecture ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software Packages We Use for HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Replication of NameNode Metadata ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

In the Unlikely Event of a Water Landing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Other Options to Consider ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Was ist angesagt?

Hadoop2.2Sreejith P

Yarn by default (Spark on YARN)Ferran Galí Reniu

Apache Hadoop In Theory And PracticeAdam Kawa

HadoopScott Leberknight

How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...DataWorks Summit/Hadoop Summit

Bd class 2 completeJigsawAcademy2014

Hadoop operations-2015-hadoop-summit-san-jose-v5Chris Nauroth

Hadoop 1.x vs 2Rommel Garcia

Hadoop and big data trainingagiamas

Upgrading hadoopShashwat Shriparv

Hadoop interview quations1Vemula Ravi

Hadoop InternalsPietro Michiardi

Rds data lake @ Robinhood BalajiVaradarajan13

Hadoop interview questionsKalyan Hadoop

Hadoop for Scientific Workloads__HadoopSummit2010Yahoo Developer Network

SF Big Analytics 20191112: How to performance-tune Spark applications in larg...Chester Chen

HDFS InternalsApache Apex

Hadoop Interview Questions and AnswersBig Data Interview Questions

Strata Conference + Hadoop World NY 2016: Lessons learned building a scalable...Sumeet Singh

Hadoop hdfs interview questionsKalyan Hadoop

Was ist angesagt? (20)

Hadoop2.2

Yarn by default (Spark on YARN)

Apache Hadoop In Theory And Practice

Hadoop

How to overcome mysterious problems caused by large and multi-tenancy Hadoop ...

Bd class 2 complete

Hadoop operations-2015-hadoop-summit-san-jose-v5

Hadoop 1.x vs 2

Hadoop and big data training

Upgrading hadoop

Hadoop interview quations1

Hadoop Internals

Rds data lake @ Robinhood

Hadoop interview questions

Hadoop for Scientific Workloads__HadoopSummit2010

SF Big Analytics 20191112: How to performance-tune Spark applications in larg...

HDFS Internals

Hadoop Interview Questions and Answers

Strata Conference + Hadoop World NY 2016: Lessons learned building a scalable...

Hadoop hdfs interview questions

Ähnlich wie Hw09 Production Deep Dive With High Availability

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal

Hadoop and Voldemort @ LinkedInHadoop User Group

Advanced Hadoop Tuning and Optimization - Hadoop ConsultingImpetus Technologies

DrupalCampLA 2011: Drupal backend-performanceAshok Modi

Big data hadooop analytic and data warehouse comparison guideDanairat Thanabodithammachari

Hadoop and BigData - July 2016Ranjith Sekar

Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...Cloudera, Inc.

Big data Hadoop Analytic and Data warehouse comparison guideDanairat Thanabodithammachari

Hadoop installation by santosh nageSantosh Nage

Presentation sreenu dwh-servicesSreenu Musham

Hadoop ecosystem framework n hadoop in live environmentDelhi/NCR HUG

Bringing OLTP woth OLAP: Lumos on HadoopDataWorks Summit

Lecture 2 part 1Jazan University

Hadoop IntroductionSNEHAL MASNE

Health Check Your DB2 UDB For Z/OS Systemsjreese

Apache Hadoop India Summit 2011 talk "Hadoop Map-Reduce Programming & Best Pr...Yahoo Developer Network

Asko Oja Moskva Architecture HighloadOntico

HadoopDinakar nk

Hadoop Summit Amsterdam 2014: Capacity Planning In Multi-tenant Hadoop Deploy...Sumeet Singh

Apache Hadoop- Hadoop Basics.pptxMiraj Godha

Ähnlich wie Hw09 Production Deep Dive With High Availability (20)

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010

Hadoop and Voldemort @ LinkedIn

Advanced Hadoop Tuning and Optimization - Hadoop Consulting

DrupalCampLA 2011: Drupal backend-performance

Big data hadooop analytic and data warehouse comparison guide

Hadoop and BigData - July 2016

Hadoop World 2011: Building Web Analytics Processing on Hadoop at CBS Interac...

Big data Hadoop Analytic and Data warehouse comparison guide

Hadoop installation by santosh nage

Presentation sreenu dwh-services

Hadoop ecosystem framework n hadoop in live environment

Bringing OLTP woth OLAP: Lumos on Hadoop

Lecture 2 part 1

Hadoop Introduction

Health Check Your DB2 UDB For Z/OS System

Apache Hadoop India Summit 2011 talk "Hadoop Map-Reduce Programming & Best Pr...

Asko Oja Moskva Architecture Highload

Hadoop

Hadoop Summit Amsterdam 2014: Capacity Planning In Multi-tenant Hadoop Deploy...

Apache Hadoop- Hadoop Basics.pptx

Mehr von Cloudera, Inc.

Partner Briefing_January 25 (FINAL).pptxCloudera, Inc.

Cloudera Data Impact Awards 2021 - Finalists Cloudera, Inc.

2020 Cloudera Data Impact Awards FinalistsCloudera, Inc.

Edc event vienna presentation 1 oct 2019Cloudera, Inc.

Machine Learning with Limited Labeled Data 4/3/19Cloudera, Inc.

Data Driven With the Cloudera Modern Data Warehouse 3.19.19Cloudera, Inc.

Introducing Cloudera DataFlow (CDF) 2.13.19Cloudera, Inc.

Introducing Cloudera Data Science Workbench for HDP 2.12.19Cloudera, Inc.

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19Cloudera, Inc.

Leveraging the cloud for analytics and machine learning 1.29.19Cloudera, Inc.

Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Cloudera, Inc.

Leveraging the Cloud for Big Data Analytics 12.11.18Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 3Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 2Cloudera, Inc.

Modern Data Warehouse Fundamentals Part 1Cloudera, Inc.

Extending Cloudera SDX beyond the PlatformCloudera, Inc.

Federated Learning: ML with Privacy on the Edge 11.15.18Cloudera, Inc.

Analyst Webinar: Doing a 180 on Customer 360Cloudera, Inc.

Build a modern platform for anti-money laundering 9.19.18Cloudera, Inc.

Introducing the data science sandbox as a service 8.30.18Cloudera, Inc.

Mehr von Cloudera, Inc. (20)

Partner Briefing_January 25 (FINAL).pptx

Cloudera Data Impact Awards 2021 - Finalists

2020 Cloudera Data Impact Awards Finalists

Edc event vienna presentation 1 oct 2019

Machine Learning with Limited Labeled Data 4/3/19

Data Driven With the Cloudera Modern Data Warehouse 3.19.19

Introducing Cloudera DataFlow (CDF) 2.13.19

Introducing Cloudera Data Science Workbench for HDP 2.12.19

Shortening the Sales Cycle with a Modern Data Warehouse 1.30.19

Leveraging the cloud for analytics and machine learning 1.29.19

Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19

Leveraging the Cloud for Big Data Analytics 12.11.18

Modern Data Warehouse Fundamentals Part 3

Modern Data Warehouse Fundamentals Part 2

Modern Data Warehouse Fundamentals Part 1

Extending Cloudera SDX beyond the Platform

Federated Learning: ML with Privacy on the Edge 11.15.18

Analyst Webinar: Doing a 180 on Customer 360

Build a modern platform for anti-money laundering 9.19.18

Introducing the data science sandbox as a service 8.30.18

Kürzlich hochgeladen

Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani

Landscape Catalogue 2024 Australia-1.pdfAarwolf Industries LLC

Scale your database traffic with Read & Write split using MySQL RouterMydbops

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765

Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3

Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll

Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple

Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar

Top 10 Hubspot Development Companies in 2024TopCSSGallery

All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough

Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica

Decarbonising Buildings: Making a net-zero built environment a realityIES VE

Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes

Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA

Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh

Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González

Kürzlich hochgeladen (20)

Potential of AI (Generative AI) in Business: Learnings and Insights

Landscape Catalogue 2024 Australia-1.pdf

Scale your database traffic with Read & Write split using MySQL Router

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration

Moving Beyond Passwords: FIDO Paris Seminar.pdf

Emixa Mendix Meetup 11 April 2024 about Mendix Native development

Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...

Genislab builds better products and faster go-to-market with Lean project man...

The State of Passkeys with FIDO Alliance.pptx

React Native vs Ionic - The Best Mobile App Framework

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes

Top 10 Hubspot Development Companies in 2024

All These Sophisticated Attacks, Can We Really Detect Them - PDF

Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...

Decarbonising Buildings: Making a net-zero built environment a reality

Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes

Long journey of Ruby standard library at RubyConf AU 2024

Generative AI - Gitex v1Generative AI - Gitex v1.pptx

Generative Artificial Intelligence: How generative AI works.pdf