Big Data DIY

•Als PPTX, PDF herunterladen•

0 gefällt mir•1,036 views

Big Data DIY auf der Microsoft CeBIT Bühne. Big Data ist einer der großen IT-Trends und doch für viele noch Neuland. In dieser Session stellen wir vor, wie man Big Data selber mit Hilfe von Tweets bauen kann. Anhand einer Windows Azure Applikation für die Echtzeit-Analyse von Twitter-Daten schildern wir die Rolle der Microsoft Technologien und wie Open Source Technologien, wie Hadoop, in Windows Azure integriert ist. Unser Szenario kann leicht „nachgebaut“ werden und ist ein guter Ausgangspunkt für eigene Entwicklungen.

Technologie

Big Data Do-It-Yourself
mit Microsoft
Olivia Klose
Technical Evangelist, Microsoft Deutschland GmbH
aka.ms/oliviaklose, @oliviaklose

Die 3 Vs
MB
GB
TB
PB
batch
periodic
real
time
table
data
base
un-
struc-
tured
web
Big Data, Gesellschaft für Informatik, 2013,
http://www.gi.de/service/informatiklexikon/
detailansicht/article/big-data.html

Demo
Demo
Tweets extrahieren: Echtzeit-Dashboard

Extract
StreamInsight
Azure SQL
Azure Blob
Storage
Real-Time
Dashboard
Twitter
Tweets extrahieren

Demo
Demo
Tweets speichern im
Windows Azure Blob Storage

Analyze
Hive Tables
…
Azure Blob
Storage
Azure Blob
Storage
Mash Up &
Visualise
Tweets in HDInsight Analyze
Azure SQL
Real-Time
Dashboard
Twitter
Extract
StreamInsight

Analyze
Hive Tables
…
Azure Blob
Storage
Azure Blob
Storage
Mash Up &
Visualise
Hive in HDInsight Analyze
Hive Tables
…
Azure SQL
Real-Time
Dashboard
Twitter
Extract
StreamInsight

Mash Up &
VisualiseAzure SQL
Tweets visualisieren
Mash Up &
Visualise
Analyze
Hive Tables
…
Real-Time
Dashboard
Twitter
Extract
StreamInsight
Azure SQL
Azure Blob
Storage

Extract
StreamInsight
Azure SQL
Azure Blob
Storage
Real-Time
Dashboard
Twitter
Big Data Twitter Infrastruktur
Mash Up &
Visualise
Analyze
Hive Tables
…

Big Data DIY in der MVA
http://aka.ms/BigDataDIY

Weitere Informationen
olivia.klose
@microsoft.com
aka.ms/oliviaklose
Twitter:
@oliviaklose
Big Data DIY Kurs
http://aka.ms/BigDataDIY
Windows Azure Trial
http://aka.ms/azurenow
HDInsight
http://tinyurl.com/hdinsight
Hortonworks for Windows
http://aka.ms/hdp
Microsoft Big Data Support
http://aka.ms/bigdatasupport

Weitere ähnliche Inhalte

Andere mochten auch

Data Governance in Apache Falcon - Hadoop Summit Brussels 2015 Seetharam Venkatesh

Infrastructure Solution Day | FinalMicrosoft Österreich

Microsoft Lizenzierung – ServerMicrosoft Österreich

Microsoft: #DigitaleHelden Symposium - Graphic RecordingMicrosoft Österreich

Modernes Rechenzentrum - Future DecodedMicrosoft Österreich

Wsus best practicesConcentrated Technology

Microsoft Trusted Cloud - Harald Leitenmüller (Microsoft)Microsoft Österreich

Tipps & Tricks zum Aufbau einer Unternehmenscloud mit CC13OPITZ CONSULTING Deutschland

Wsus sample scriptsConcentrated Technology

SharePoint 2010 Infrastruktur Planung in UnternehmenMichael Kirst-Neshva

Microsoft Lizenzierung – Schwerpunkt DesktopprogrammeMicrosoft Österreich

Windows 10 im UnternehmenA. Baggenstos & Co. AG

Andere mochten auch (12)

Data Governance in Apache Falcon - Hadoop Summit Brussels 2015

Infrastructure Solution Day | Final

Microsoft Lizenzierung – Server

Microsoft: #DigitaleHelden Symposium - Graphic Recording

Modernes Rechenzentrum - Future Decoded

Wsus best practices

Microsoft Trusted Cloud - Harald Leitenmüller (Microsoft)

Tipps & Tricks zum Aufbau einer Unternehmenscloud mit CC13

Wsus sample scripts

SharePoint 2010 Infrastruktur Planung in Unternehmen

Microsoft Lizenzierung – Schwerpunkt Desktopprogramme

Windows 10 im Unternehmen

Ähnlich wie Big Data DIY

Introduction to Azure Stream AnalyticsSlava Kokaev

Real Time Power BIDavide Mauri

Real-Time PowerBISolidQIT

MSDN - Converting an existing ASP.NET application to Windows AzureMaarten Balliauw

Big Data Analytics from Azure Cloud to Power BI MobileRoy Kim

Power BI for Big Data and the New Look of Big Data SolutionsJames Serra

Internet of Things in TbilisiAlexey Bokov

Microsoft Azure IoT 手把手實作 @ K.NET by Maduka (2017-8-12)Jeff Chu

SharePoint Days Casablanca 2016 - Tout ce que vous devez savoir sur Power BI v2Benoit Jester

Building Cloud-Native Applications with Microsoft Windows AzureBill Wilder

How to manage one million messages per second using Azure, Radu Vunvulea, ITD...Radu Vunvulea

Microsoft Build 2020: Data Science RecapMark Tabladillo

Democratizing Artificial IntelligenceDmitry Petukhov

Big Data, Bigger BrainsDenny Lee

Go Serverless with Cosmos DB, Azure Functions and BlazorTimothy McAliley

Modern Business Intelligence and Advanced AnalyticsCollective Intelligence Inc.

Modern business intelligenceMichael Stephenson

Azure Functions Hands-on lab | Global Azure Bootcamp | Radu VunvuleaRadu Vunvulea

Ch-ch-ch-ch-changes....Stitch Triggers - Andrew MorganMongoDB

Pbi iot data vizDavid Moss

Ähnlich wie Big Data DIY (20)

Introduction to Azure Stream Analytics

Real Time Power BI

Real-Time PowerBI

MSDN - Converting an existing ASP.NET application to Windows Azure

Big Data Analytics from Azure Cloud to Power BI Mobile

Power BI for Big Data and the New Look of Big Data Solutions

Internet of Things in Tbilisi

Microsoft Azure IoT 手把手實作 @ K.NET by Maduka (2017-8-12)

SharePoint Days Casablanca 2016 - Tout ce que vous devez savoir sur Power BI v2

Building Cloud-Native Applications with Microsoft Windows Azure

How to manage one million messages per second using Azure, Radu Vunvulea, ITD...

Microsoft Build 2020: Data Science Recap

Democratizing Artificial Intelligence

Big Data, Bigger Brains

Go Serverless with Cosmos DB, Azure Functions and Blazor

Modern Business Intelligence and Advanced Analytics

Modern business intelligence

Azure Functions Hands-on lab | Global Azure Bootcamp | Radu Vunvulea

Ch-ch-ch-ch-changes....Stitch Triggers - Andrew Morgan

Pbi iot data viz

Mehr von Olivia Klose

Evolution of AI - Why is my computer still so dumb?Olivia Klose

Deep Learning for New User Interactions (Gestures, Speech and Emotions)Olivia Klose

TechCamps - Internet of ThingsOlivia Klose

What does Bob really want? Recommenders in the CloudOlivia Klose

Developer Week 2015: Azure Machine LearningOlivia Klose

Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndOlivia Klose

Would I have survived the Titanic? Machine Learning in Microsoft AzureOlivia Klose

Jumpstarting big data projects / Architectural Considerations of HDInsight Ap...Olivia Klose

Big Data mit Microsoft?Olivia Klose

Mehr von Olivia Klose (9)

Evolution of AI - Why is my computer still so dumb?

Deep Learning for New User Interactions (Gestures, Speech and Emotions)

TechCamps - Internet of Things

What does Bob really want? Recommenders in the Cloud

Developer Week 2015: Azure Machine Learning

Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End

Would I have survived the Titanic? Machine Learning in Microsoft Azure

Jumpstarting big data projects / Architectural Considerations of HDInsight Ap...

Big Data mit Microsoft?

Kürzlich hochgeladen

HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics

Manulife - Insurer Innovation Award 2024The Digital Insurer

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software

Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez

Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya

Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer

Artificial Intelligence: Facts and MythsJoaquim Jorge

A Domino Admins Adventures (Engage 2024)Gabriella Davis

TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun

Kürzlich hochgeladen (20)

HTML Injection Attacks: Impact and Mitigation Strategies

Manulife - Insurer Innovation Award 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

AWS Community Day CPH - Three problems of Terraform

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

Artificial Intelligence Chap.5 : Uncertainty

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Boost Fertility New Invention Ups Success Rates.pdf

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Artificial Intelligence: Facts and Myths

A Domino Admins Adventures (Engage 2024)

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Exploring the Future Potential of AI-Enabled Smartphone Processors

Data Cloud, More than a CDP by Matt Robison

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Powerful Google developer tools for immediate impact! (2023-24 C)

Big Data DIY

1. Big Data Do-It-Yourself mit Microsoft Olivia Klose Technical Evangelist, Microsoft Deutschland GmbH aka.ms/oliviaklose, @oliviaklose

2. Die 3 Vs MB GB TB PB batch periodic real time table data base un- struc- tured web Big Data, Gesellschaft für Informatik, 2013, http://www.gi.de/service/informatiklexikon/ detailansicht/article/big-data.html

3. Daten

4. Demo Demo Tweets extrahieren: Echtzeit-Dashboard

5. StreamInsight

6. Extract StreamInsight Azure SQL Azure Blob Storage Real-Time Dashboard Twitter Tweets extrahieren

7. Demo Demo Tweets speichern im Windows Azure Blob Storage

8. Hadoop

9. Hadoop

10. MapReduce

11. MapReduce

12. MapReduce: Map

13. MapReduce: Reduce

14. Analyze Hive Tables … Azure Blob Storage Azure Blob Storage Mash Up & Visualise Tweets in HDInsight Analyze Azure SQL Real-Time Dashboard Twitter Extract StreamInsight

15.

16. HDInsight auf PowerShell

17. Analyze Hive Tables … Azure Blob Storage Azure Blob Storage Mash Up & Visualise Hive in HDInsight Analyze Hive Tables … Azure SQL Real-Time Dashboard Twitter Extract StreamInsight

18.

19. Mash Up & VisualiseAzure SQL Tweets visualisieren Mash Up & Visualise Analyze Hive Tables … Real-Time Dashboard Twitter Extract StreamInsight Azure SQL Azure Blob Storage

20. Demo Demo Tweets visualisieren

21. Demo Demo Tweets visualisieren

22. Extract StreamInsight Azure SQL Azure Blob Storage Real-Time Dashboard Twitter Big Data Twitter Infrastruktur Mash Up & Visualise Analyze Hive Tables …

23. Big Data DIY in der MVA http://aka.ms/BigDataDIY

24. Weitere Informationen olivia.klose @microsoft.com aka.ms/oliviaklose Twitter: @oliviaklose Big Data DIY Kurs http://aka.ms/BigDataDIY Windows Azure Trial http://aka.ms/azurenow HDInsight http://tinyurl.com/hdinsight Hortonworks for Windows http://aka.ms/hdp Microsoft Big Data Support http://aka.ms/bigdatasupport

Big Data DIY

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Andere mochten auch

Andere mochten auch (12)

Ähnlich wie Big Data DIY

Ähnlich wie Big Data DIY (20)

Mehr von Olivia Klose

Mehr von Olivia Klose (9)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Big Data DIY