2012-01-10-data tuesday

•Als PPTX, PDF herunterladen•

0 gefällt mir•593 views

Additional information on #datatuesday: http://data-tuesday.com/ Additional information on Hadoop on Azure: http://www.hadooponazure.com, http://aka.ms/benjguinhadoop

Technologie

Data Tuesday – 10 janvier 2012
Pierre Lagarde (DPE) – pierlag@microsoft.com
Benjamin Guinebertière (DPE) – www.benjguin.com

Microsoft Distribution of Hadoop [MDH]

• Code name : Isotope
• Leveraging the Hadoop data-driven
community
– OnPremise – Cloud
– Windows Server integration [AD – Secure HDFS]
– Connection with SQL Server / Excel
– Developer Framework [JavaScript, .NET, F#, …]
– Hadoop as a Service through Azure [eMDH]

Structural Overview

ISOTOPE
[Azure and Enterprise]

Java - JavaScript Streaming OM HiveQL PigLatin .NET/C#/F# (T)SQL

NOSQL OCEAN OF DATA ETL
[unstructured, semi-structured, structured]

HDFS

A SEAMLESS OCEAN OF INFORMATION PROCESSING AND ANALYTICS

EIS / ERP RDBMS File System OData [RSS] Azure Storage

Démo - JavaScript

distcp HDFS

Sort/filter
JavaScript M/R
from("books")
Azure Storage .mapReduce("file.js", "word, count:long")
.orderBy("count DESC")
.take(10)
.to("top10")

HDFS File

Graph.bar(data)

Excel ODBC Reporting
Hive Connector SQLServer

• from("books")
.mapReduce("bin/WordCountLong.js", "word, count:long")
.orderBy("count DESC")
.take(10)
.to("demo-top10")

Weitere ähnliche Inhalte

Was ist angesagt?

Hadoop hbase introductionJakub Stransky

Hive(ppt)Abhinav Tyagi

report on aadhaar anlysis using bid data hadoop and hivesiddharthboora

Hive ICDE 2010ragho

Advanced topics in hiveUday Vakalapudi

hbaseconasia2019 Spatio temporal Data Management based on Ali-HBase Ganos and...Michael Stack

Big data and hadoopRahul Johari

Workspace Managementwaldotyson

2012 apache hadoop_map_reduce_windows_azureDataPlato, Crossing the line

Hadoop online trainingSmartittrainings

Empowering Semantic Zooming with Hadoop and HBaseDataWorks Summit

Big data solution capacity planningRiyaz Shaikh

HadoopRakesh Tadishetty

Yes, Sql!Uri Cohen

Making Big Data, smallMarcinJedyk

RTree Spatial Indexing with MongoDB - MongoDC Nicholas Knize, Ph.D., GISP

JOSA TechTalks - Big Data on HadoopJordan Open Source Association

Hadoop: Distributed data processingroyans

Alexander Ignatyev "MapReduce infrastructure"Yandex

Was ist angesagt? (19)

Hadoop hbase introduction

Hive(ppt)

report on aadhaar anlysis using bid data hadoop and hive

Hive ICDE 2010

Advanced topics in hive

hbaseconasia2019 Spatio temporal Data Management based on Ali-HBase Ganos and...

Big data and hadoop

Workspace Management

2012 apache hadoop_map_reduce_windows_azure

Hadoop online training

Empowering Semantic Zooming with Hadoop and HBase

Big data solution capacity planning

Hadoop

Yes, Sql!

Making Big Data, small

RTree Spatial Indexing with MongoDB - MongoDC

JOSA TechTalks - Big Data on Hadoop

Hadoop: Distributed data processing

Alexander Ignatyev "MapReduce infrastructure"

Ähnlich wie 2012-01-10-data tuesday

NoSQL: Why, When, and HowBigBlueHat

Apache Hadoop India Summit 2011 talk "Hive Evolution" by Namit JainYahoo Developer Network

20130912 YTC_Reynold Xin_Spark and SharkYahooTechConference

Hands-On Apache SparkDuchess France

Escalando Aplicaciones WebSantiago Coffey

NoSQL - "simple" web monitoringSamir Siqueira

Big data pptThirunavukkarasu Ps

Big data vahidamiri-tabriz-13960226-datastack.irdatastack

Clogeny Hadoop ecosystem - an overviewMadhur Nawandar

Nosql seminarShreyashkumar Nangnurwar

Let Spark Fly: Advantages and Use Cases for Spark on HadoopMapR Technologies

Big Data Essentials meetup @ IBM Ljubljana 23.06.2015Andrey Vykhodtsev

Apache Spark RDDsDean Chen

Hands on Hadoop and pigSudar Muthu

Big Data on the CloudSercan Karaoglu

SQL on Hadoop for the Oracle ProfessionalMichael Rainey

Azure Databricks is Easier Than You ThinkIke Ellis

Above the cloud: Big Data and BIDenny Lee

Zh tw cloud computing eraTrendProgContest13

Apache spark - Architecture , Overview & librariesWalaa Hamdy Assy

Ähnlich wie 2012-01-10-data tuesday (20)

NoSQL: Why, When, and How

Apache Hadoop India Summit 2011 talk "Hive Evolution" by Namit Jain

20130912 YTC_Reynold Xin_Spark and Shark

Hands-On Apache Spark

Escalando Aplicaciones Web

NoSQL - "simple" web monitoring

Big data ppt

Big data vahidamiri-tabriz-13960226-datastack.ir

Clogeny Hadoop ecosystem - an overview

Nosql seminar

Let Spark Fly: Advantages and Use Cases for Spark on Hadoop

Big Data Essentials meetup @ IBM Ljubljana 23.06.2015

Apache Spark RDDs

Hands on Hadoop and pig

Big Data on the Cloud

SQL on Hadoop for the Oracle Professional

Azure Databricks is Easier Than You Think

Above the cloud: Big Data and BI

Zh tw cloud computing era

Apache spark - Architecture , Overview & libraries

Mehr von benjguin

Le Bulletin Azure, épisode 15benjguin

Le Bulletin Azure, témoignage, Capsule Technologiebenjguin

Le bulletin Azure épisode 14: MetricsHub et HDInsightbenjguin

Le Bulletin Azure épisode 13benjguin

Le Bulletin Azure, épisode 10benjguin

Le bulletin Azure épisode 8benjguin

2012 06-15-la fermeduweb-microsoftbenjguin

Le Bulletin Azure Mobiles Republicbenjguin

Le Bulletin Azure - Témoignage avec ZeCloudbenjguin

Le Bulletin Azure - Témoignage avec Ysance et SpecialChembenjguin

JavaScript aussi sur le serveur et jusque dans le cloud?benjguin

Le Bulletin Azure Episode 5benjguin

Le Bulletin Azure, témoignage de V-Trafic et Inifinite Squarebenjguin

Le bulletin Azure épisode 3benjguin

Créez votre application sur Windows Azure avec visual studio 2010benjguin

AppFabric : le middleware disponible aussi en nuagebenjguin

Développer un site Web fonctionnel et élastique sur Azurebenjguin

Le bulletin Azure épisode 2benjguin

Le Bulletin Azure épisode 1benjguin

ArchiTech archims webbenjguin

Mehr von benjguin (20)

Le Bulletin Azure, épisode 15

Le Bulletin Azure, témoignage, Capsule Technologie

Le bulletin Azure épisode 14: MetricsHub et HDInsight

Le Bulletin Azure épisode 13

Le Bulletin Azure, épisode 10

Le bulletin Azure épisode 8

2012 06-15-la fermeduweb-microsoft

Le Bulletin Azure Mobiles Republic

Le Bulletin Azure - Témoignage avec ZeCloud

Le Bulletin Azure - Témoignage avec Ysance et SpecialChem

JavaScript aussi sur le serveur et jusque dans le cloud?

Le Bulletin Azure Episode 5

Le Bulletin Azure, témoignage de V-Trafic et Inifinite Square

Le bulletin Azure épisode 3

Créez votre application sur Windows Azure avec visual studio 2010

AppFabric : le middleware disponible aussi en nuage

Développer un site Web fonctionnel et élastique sur Azure

Le bulletin Azure épisode 2

Le Bulletin Azure épisode 1

ArchiTech archims web

Kürzlich hochgeladen

Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan

What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina

Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal

Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery

(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5

From Family Reminiscence to Scholarly Archive .Alan Dix

Time Series Foundation Models - current state and future directionsNathaniel Shimoni

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González

How to write a Business Continuity PlanDatabarracks

Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani

Decarbonising Buildings: Making a net-zero built environment a realityIES VE

DevEX - reference for building teams, processes, and platformsSergiu Bodiu

So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda

A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3

Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3

Kürzlich hochgeladen (20)

Emixa Mendix Meetup 11 April 2024 about Mendix Native development

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx

The State of Passkeys with FIDO Alliance.pptx

Generative AI for Technical Writer or Information Developers

What is DBT - The Ultimate Data Build Tool.pdf

Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...

Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...

(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...

From Family Reminiscence to Scholarly Archive .

Time Series Foundation Models - current state and future directions

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024

Generative Artificial Intelligence: How generative AI works.pdf

How to write a Business Continuity Plan

Potential of AI (Generative AI) in Business: Learnings and Insights

Decarbonising Buildings: Making a net-zero built environment a reality

DevEX - reference for building teams, processes, and platforms

So einfach geht modernes Roaming fuer Notes und Nomad.pdf

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx

Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx

2012-01-10-data tuesday

1. Data Tuesday – 10 janvier 2012 Pierre Lagarde (DPE) – pierlag@microsoft.com Benjamin Guinebertière (DPE) – www.benjguin.com

2. Microsoft Distribution of Hadoop [MDH] • Code name : Isotope • Leveraging the Hadoop data-driven community – OnPremise – Cloud – Windows Server integration [AD – Secure HDFS] – Connection with SQL Server / Excel – Developer Framework [JavaScript, .NET, F#, …] – Hadoop as a Service through Azure [eMDH]

3. Structural Overview ISOTOPE [Azure and Enterprise] Java - JavaScript Streaming OM HiveQL PigLatin .NET/C#/F# (T)SQL NOSQL OCEAN OF DATA ETL [unstructured, semi-structured, structured] HDFS A SEAMLESS OCEAN OF INFORMATION PROCESSING AND ANALYTICS EIS / ERP RDBMS File System OData [RSS] Azure Storage

4. Création d’un cluster à la demande

5. Map/Reduce - Java

6. Map/Reduce – C#

7. Map/Reduce - JavaScript

8. Démo - JavaScript distcp HDFS Sort/filter JavaScript M/R from("books") Azure Storage .mapReduce("file.js", "word, count:long") .orderBy("count DESC") .take(10) .to("top10") HDFS File Graph.bar(data) Excel ODBC Reporting Hive Connector SQLServer

10.

11. • from("books") .mapReduce("bin/WordCountLong.js", "word, count:long") .orderBy("count DESC") .take(10) .to("demo-top10")

12.

13. • #get top10

Hinweis der Redaktion

Isotope is the all-up effort around Microsoft and Hadoop. It includes several components:A full distribution of Apache Hadoop that runs on standard windows hardware.A full version of Apache Hadoop that runs on the Azure cloudConnectors from Hadoop (any Hadoop, not just Microsoft’s) to Microsoft’s key products – SQL, Excel, PDW, etc.Jscript shell for live scripting of Hadoop from the browserAdmin, monitoring, and authoring tools to make Microsoft Hadoop best-in-class

2012-01-10-data tuesday

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (19)

Ähnlich wie 2012-01-10-data tuesday

Ähnlich wie 2012-01-10-data tuesday (20)

Mehr von benjguin

Mehr von benjguin (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

2012-01-10-data tuesday

Hinweis der Redaktion