SlideShare ist ein Scribd-Unternehmen logo
1 von 98
Downloaden Sie, um offline zu lesen
Jumpstarting
Big Data Projects
Architectural
Considerations in
HDInsight
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Up to 75 control units in 1 vehicle
About 1,000 individual possible extra equipments
1 GB car software, 15 GB data on board (incl. navi)
2,000 user functions implemented
12,000 types of error stored onboard for diagnosis
Daily up to 60,000 car diagnosis worldwide
</meldungText><antwort>False</antwort><wert>na</wert></meldung><steuergeraet sgbdVariante="SMG_60"><steuergeraeteFunktion
zeitstempel="2013-04-30T09:00:37.9926171-04:00" endDate="2013-04-30T09:00:38.1158609-04:00" jobName="STATUS_FAHRZEUGTESTER"><datensatz
satzNr="1"><result name="JOB_STATUS">OKAY</result><result name="_TEL_ANTWORT">80 F1 18 70 70 02 01 00 00 00 00 00 00 00 00 00 00 00 00 00
00 82 6B 00 6D 6B 39 CD 14 00 14 00 00 0E 00 15 00 0A 00 19 00 0C 00 12 00 15 85 57 71 88 81 C0 7D 73 C2 08 01 05 02 F7 00 FF FF 01 73 00 00 02 A8
00 C2 00 01 E0 00 00 00 00 00 00 3D 01 00 00 00 01 03 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 FD 01 E1 02 05 01 F8 03 4F FF AD
04</result><result name="_TEL_AUFTRAG">83 18 F1 30 02 01</result><result name="STAT_KL15_ROH">0</result><result
name="STAT_KLR_EIN_ROH">0</result><result name="STAT_WAKE_UP_ROH">1</result><result name="STAT_ISTGANG_TEXT">Neutral</result>
<sgFunktion zeitstempel=“2013-04-30T10:33:37.0834084+02:00" endDate="2013-04-30T10:33:37.9310504+02:00"
jobName="_FLM_LESEN_BOSCH"><datensatz satzNr="1"><result name="FLM_DATEN_1">00 00 00 03 02 08 C6 56 46 4C 4D 39 00 16 4B B2 00 00 00 32
00 00 06 99 00 00 00 65 00 00 18 6E 00 00 00 73 00 00 00 20 00 00 00 73 00 00 00 00 00 00 10 69 00 00 0F 53 00 00 00 2C 00 00 00 0A 00 00 79 6D 00 00
B7 34 00 00 D3 9E 4A 4C 41 52 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2C 00 00 00 00 00 00 1A 5C 00 15 4B CA 00 00 44 08 00 00 2D
39 00 00 1E 45 00 00 26 89 00 00 1E EB 00 00 0C 65 00 00 04 47 00 00 00 00 00 00 00 00 00 00 00 04 00 00 00 27 00 00 01 1E 00 00 02 AB 00 00 07 71 00
00 13 D7 00 00 36 48 00 15 91 AD 00 00 3F 97 00 00 19 C1 00 00 07 F9 00 00 02 D4 00 00 00 BD 00 00 00 20 00 16 1C 42 00 00 18 B1 00 00 09 40 00 00
08 9F 00 00 04 3A 00 00 01 3E 00 01 8C D7 00 00 61 A3 00 00 37 9D 00 00 1E 78 00 00 14 96 00 00 0A 71 00 00 05 49 00 00 02 B1 00 00 00 A7 00 00 00
1D 00 00 00 09 00 00 00 05 00 00 00 00 00 00 00 00 00 00 23 BB 00 00 2F 84 00 00 14 EF 00 00 09 40 00 00 04 71 00 00 03 34 00 00 02 12 00 00 01 AC 00
00 01 59 00 00 0B C4 00 00 00 06 00 00 00 38 00 00 00 19 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00
03 00 00 00 00 00 00 00 00 52 4F 54 48 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 04 00 00 00 00 00
00 00 00 56 30 00 00 00 03 00 11 00 01 01 06 00 00 00 00 00 00 00 00 00 01 00 00 00 0E 00 05 00 1A 00 12 00 00 00 26 00 00 00 00 00 0B 00 00 00 01 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 44 44 00 43 00 16 00 08 00 0D 00 04 00 02 00 00 00 02 00 11 00 20 00 1A 00
0A 00 15 00 0F 00 1B 00 13 00 08 00 08 00 00 00 00 00 07 00 0E 00 08 00 04 00 02 00 01 00 00 00 6D 00 03 00 02 00 01 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 0A 00 21 00 15 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 0B 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 18 05 1F 00 00 00 00 00 00 00 00 00 1F 00 03 00 02 00 00 00
00 00 00 00 20 00 05 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 62 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 2E 00 00 1B 00 19
00 18 00 0D 00 00 00 00 00 00 00 01 00 01 00 02 00 00 06 00 01 E6 00 00 12 00 03 00 02 00 07 00 00 00 00 00 00 00 00 00 00 00 00 00 04 00 02 01 BA 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 24 00</result><result name="FLM_DATEN_2">08 00 00 00 00 00 00 00 00 00 00 0C
00 80 1B 00 45 10 00 A6 0D 00 51 16 00 59 44 00 00 EB 00 00 CA 00 00 49 00 00 17 00 10 00 0C 00 05 00 04 00 06 00 02 00 01 00 00 00 00 12 00 00 3A…
Here!
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
HDInsight
http://aka.ms/HDIpowershell
Hadoop on Azure
https://github.com/lararubbelke/Azure-
DDP/
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Databases Storage Account
Others
Hadoop does not do
well with lots of small files
http://aka.ms/HDI_smallfiles
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Clean & prepare data
Customer polarisation & segmentation
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
- SQL-like abstraction of
MapReduce
- Compatible with other
RDBMs
- Simple aggregations
- DBAs
- Complex Joins
- Unstructured data
- UDF is complex
- Slice & dicing (or
complex query)
- Streaming objects
- UDF
- Software developers
- Integration with analytical
tools/RDBMs
Feature vector per customer
Scoring and prioritisation
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Mahout Azure Machine Learning
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Distributed similarity measure
Version number of Mahout
Input
Output
Limit of #similar items per item
Max #preferences per user/item
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
1.
2.
3.
4.
user/<remote_user>
user/hdp/
user/<remote_user>
r>@<storage_account>.blob.core.windows.
net/user/hdp/testdata/KDDTest
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
hadoop jar
C:appsdistmahout-0.9mahout-core-0.9-job.jar
org.apache.mahout.classifier.df.tools.Describe
-p wasb:///user/hdp/testdata/KDDTrain+.arff
-f wasb:///user/hdp/testdata/KDDTrain+.info
-d N 3 C 2 N C 4 N C 8 N 2 C 19 N L
Describing the columns
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Leaf size
Data
Data Set
Selection #Trees
Partial
Output
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Test Data
Data Set / Descriptor File
Forest Model
Analysing the
classification results
Use MapReduce Jobs
Output
9,458 253
8,325
Predicted
4,508
normal anomaly
Actual
normalanomaly
accuracy =
#correctly classified instances
#classified instances
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Scoring and
prioritization
Read & process
data for the day
 Extract into outputs
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Deploy compute
Run workload
Monitoring
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
$coreConfig = @{
"io.compression.codec"="org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.ha
doop.io.compress.BZip2Codec";
"io.sort.mb" = "1024";
}
$mapredConfig = new-object 'Microsoft.WindowsAzure.Management.HDInsight.Cmdlet.DataObjects.AzureHDInsightMapReduceConfiguration'
$mapredConfig.Configuration = @{
"mapred.tasktracker.map.tasks.maximum"="2";
}
$clusterConfig = New-AzureHDInsightClusterConfig -ClusterSizeInNodes $numberNodes `
| Set-AzureHDInsightDefaultStorage -StorageAccountName $fqStorageAccountName -StorageAccountKey $storageAccountKey `
-StorageContainerName ($storageContainer.Name)
$continueCheck = Read-Host "Attach additional storage accounts? (yes to continue)"
if ($continueCheck -eq "yes")
{
foreach($asa in 1..5) {
$newStorageAccountName = ($clusterPrefix + [DateTime]::Now.ToString("yyyyMMddHHmmss") + "a" + $asa)
New-AzureStorageAccount -StorageAccountName $newStorageAccountName -Location "North Europe"
$clusterConfig = $clusterConfig | Add-AzureHDInsightStorage `
-StorageAccountName ($newStorageAccountName + ".blob.core.windows.net") `
-StorageAccountKey (Get-AzureStorageKey $newStorageAccountName).Primary
}
}
$clusterConfig = $clusterConfig | Add-AzureHDInsightConfigValues -Core $coreConfig -MapReduce $mapredConfig
# "At this point we are able to create a hdinsight cluster with a customised configuration"
http://aka.ms/HDIconfiguration
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Example: Oozie job configuration
nameNode=wasb://container_name@storage_name.blob.core.windows.net
jobTracker=jobtrackerhost:9010
queueName=default
oozie.wf.application.path=wasb:///user/admin/examples/apps/ooziejobs
outputDir=ooziejobs-out
oozie.use.system.libpath=true
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
12/29 6/29
Customer
ID
URL Item Time
Customer
ID
Item
IIS Logs
IIS Logs
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Raw Data
Storage
Processing
Processed
Data
Storage
Validation &
Troubleshooting
Raw Data
Storage
Processing
Processed
Data
Storage
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Compute
Mahout / Pig
Calculations
I/O
HDFS
Blob
Raw Data
Storage
Processing
Processed
Data
Storage
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Raw Data
Storage
Processing
Processed
Data
Storage
AuthorizationError,
Availability,
AverageE2ELatency,
AverageServerLatency,
ClientTimeoutError,
NetworkError,
PercentAuthorizationError,
PercentNetworkError,
PercentSuccess,
ServerTimeoutError,
Success,
ThrottlingError
Timestamp,
TotalBillableRequests,
TotalEgress,
TotalIngress,
TotalRequests
Application
Storage throttling
When?
Data exchange
0
2E+09
4E+09
6E+09
8E+09
1E+10
1.2E+10
1.4E+10
Jobs Storage
Sum of TotalIngress Sum of TotalEgress
0
200
400
600
800
1000
1200
Jobs StorageTotal
2014-03-26 22:28:37,321 INFO CallbackServlet:539 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-140326181153083-oozie-hdp-W] ACTION[0000000-
140326181153083-oozie-hdp-W@pig-node-01] callback for action [0000000-140326181153083-oozie-hdp-W@pig-node-01]
2014-03-26 22:28:37,472 INFO PigActionExecutor:539 - USER[Admin] GROUP[-] TOKEN[] APP[receipts-products-mahout] JOB[0000000-140326181153083-oozie-hdp-W]
ACTION[0000000-140326181153083-oozie-hdp-W@pig-node-01] action completed, external ID [job_201403261811_0001]
2014-03-26 22:28:37,562 WARN PigActionExecutor:542 - USER[Admin] GROUP[-] TOKEN[] APP[receipts-products-mahout] JOB[0000000-140326181153083-oozie-hdp-
W] ACTION[0000000-140326181153083-oozie-hdp-W@pig-node-01]
Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.PigMain], exit code [2]
2014-03-26 22:28:38,101 INFO ActionEndXCommand:539 - USER[Admin] GROUP[-] TOKEN[] APP[receipts-products-mahout] JOB[0000000-140326181153083-oozie-
hdp-W] ACTION[0000000-140326181153083-oozie-hdp-W@pig-node-01] ERROR is considered as FAILED for SLA
2014-03-26 22:28:38,228 WARN JPAService:542 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] JPAExecutor [WorkflowActionGetJPAExecutor]
ended with an active transaction, rolling back
2014-03-26 22:28:38,343 INFO ActionStartXCommand:539 - USER[Admin] GROUP[-] TOKEN[] APP[receipts-products-mahout] JOB[0000000-140326181153083-oozie-
hdp-W] ACTION[0
High Latency  Timeout
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications
http://blogs.technet.com/b/oliviaklose/
http://alexeikh.wordpress.com/
http://blogs.msdn.com/b/bigdatasupport/
Jumpstarting big data projects / Architectural Considerations of HDInsight Applications

Weitere ähnliche Inhalte

Was ist angesagt?

第42PHP勉強会Ethna 発表資料
第42PHP勉強会Ethna 発表資料第42PHP勉強会Ethna 発表資料
第42PHP勉強会Ethna 発表資料Sotaro Karasawa
 
Inteligência Artificial - Introdução
Inteligência Artificial - IntroduçãoInteligência Artificial - Introdução
Inteligência Artificial - IntroduçãoFelipeAlcino
 
4200 Kte7.0 Training V1.0
4200 Kte7.0 Training V1.04200 Kte7.0 Training V1.0
4200 Kte7.0 Training V1.0wayneliao
 
ambil aja
ambil aja ambil aja
ambil aja muxander
 
كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين
 كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين
كيف تعمل الكاميرا وشرح الية الابصار وتشريح العينmohammad505
 
Physics spm koleksi-tips-terbaik
Physics spm   koleksi-tips-terbaikPhysics spm   koleksi-tips-terbaik
Physics spm koleksi-tips-terbaik慈心 Chan
 
Writer parameters training
Writer parameters trainingWriter parameters training
Writer parameters trainingKheng Kait Lim
 
Improving Performance in .NET Applications
Improving Performance in .NET ApplicationsImproving Performance in .NET Applications
Improving Performance in .NET Applicationsjasonbock
 
Seguridad Computacional
Seguridad ComputacionalSeguridad Computacional
Seguridad ComputacionalAdixs Cabrejos
 
Decisao liminar vereadores
Decisao liminar vereadoresDecisao liminar vereadores
Decisao liminar vereadoresMarcianoBortolin
 

Was ist angesagt? (13)

第42PHP勉強会Ethna 発表資料
第42PHP勉強会Ethna 発表資料第42PHP勉強会Ethna 発表資料
第42PHP勉強会Ethna 発表資料
 
Inteligência Artificial - Introdução
Inteligência Artificial - IntroduçãoInteligência Artificial - Introdução
Inteligência Artificial - Introdução
 
4200 Kte7.0 Training V1.0
4200 Kte7.0 Training V1.04200 Kte7.0 Training V1.0
4200 Kte7.0 Training V1.0
 
ambil aja
ambil aja ambil aja
ambil aja
 
كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين
 كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين
كيف تعمل الكاميرا وشرح الية الابصار وتشريح العين
 
Physics spm koleksi-tips-terbaik
Physics spm   koleksi-tips-terbaikPhysics spm   koleksi-tips-terbaik
Physics spm koleksi-tips-terbaik
 
Dilon ki Islaah
Dilon ki IslaahDilon ki Islaah
Dilon ki Islaah
 
Liminar airbnb
Liminar airbnbLiminar airbnb
Liminar airbnb
 
Writer parameters training
Writer parameters trainingWriter parameters training
Writer parameters training
 
Improving Performance in .NET Applications
Improving Performance in .NET ApplicationsImproving Performance in .NET Applications
Improving Performance in .NET Applications
 
1. basico instalaciones bt
1.   basico instalaciones bt1.   basico instalaciones bt
1. basico instalaciones bt
 
Seguridad Computacional
Seguridad ComputacionalSeguridad Computacional
Seguridad Computacional
 
Decisao liminar vereadores
Decisao liminar vereadoresDecisao liminar vereadores
Decisao liminar vereadores
 

Andere mochten auch

PCMA Conference 2016 Power Point - Ai Evolution
PCMA Conference 2016 Power Point -  Ai EvolutionPCMA Conference 2016 Power Point -  Ai Evolution
PCMA Conference 2016 Power Point - Ai EvolutionJoshua Wagner
 
Happy life of old century (nx power lite)
Happy life of old century (nx power lite)Happy life of old century (nx power lite)
Happy life of old century (nx power lite)Lia Dumitrescu
 
Folk Art.
Folk Art.Folk Art.
Folk Art.abuxus
 
Appalachian Folk Art Weaving
Appalachian Folk Art WeavingAppalachian Folk Art Weaving
Appalachian Folk Art WeavingGeorge Canfield
 
Sonata ao luar- Beethoven
Sonata ao luar- Beethoven Sonata ao luar- Beethoven
Sonata ao luar- Beethoven Irene Aguiar
 
15 відтінків зеленого. Оздоровчі ефекти рослинної їжі
15 відтінків зеленого. Оздоровчі ефекти рослинної їжі15 відтінків зеленого. Оздоровчі ефекти рослинної їжі
15 відтінків зеленого. Оздоровчі ефекти рослинної їжіOksana Skytalinska
 
Green Trees Beautiful Scenery
Green Trees Beautiful SceneryGreen Trees Beautiful Scenery
Green Trees Beautiful SceneryElv Ir
 
Saudi culture, traditions and Art
Saudi culture, traditions and ArtSaudi culture, traditions and Art
Saudi culture, traditions and Art Ali Alshourbagy
 
Microsoft Cognitive Services
Microsoft Cognitive ServicesMicrosoft Cognitive Services
Microsoft Cognitive ServicesAnyline
 
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...Naoki (Neo) SATO
 

Andere mochten auch (20)

Hungarian folk art
Hungarian folk artHungarian folk art
Hungarian folk art
 
PCMA Conference 2016 Power Point - Ai Evolution
PCMA Conference 2016 Power Point -  Ai EvolutionPCMA Conference 2016 Power Point -  Ai Evolution
PCMA Conference 2016 Power Point - Ai Evolution
 
BREAKFAST
BREAKFASTBREAKFAST
BREAKFAST
 
Happy life of old century (nx power lite)
Happy life of old century (nx power lite)Happy life of old century (nx power lite)
Happy life of old century (nx power lite)
 
Toi Et Moi
Toi Et MoiToi Et Moi
Toi Et Moi
 
Folk Art
Folk ArtFolk Art
Folk Art
 
Folk Art.
Folk Art.Folk Art.
Folk Art.
 
UVC100_Fall16_Class4
UVC100_Fall16_Class4UVC100_Fall16_Class4
UVC100_Fall16_Class4
 
Appalachian Folk Art Weaving
Appalachian Folk Art WeavingAppalachian Folk Art Weaving
Appalachian Folk Art Weaving
 
Chinese style
Chinese styleChinese style
Chinese style
 
Folk art
Folk artFolk art
Folk art
 
Sonata ao luar- Beethoven
Sonata ao luar- Beethoven Sonata ao luar- Beethoven
Sonata ao luar- Beethoven
 
Women and Cats
Women and CatsWomen and Cats
Women and Cats
 
Relax Presentation
Relax PresentationRelax Presentation
Relax Presentation
 
15 відтінків зеленого. Оздоровчі ефекти рослинної їжі
15 відтінків зеленого. Оздоровчі ефекти рослинної їжі15 відтінків зеленого. Оздоровчі ефекти рослинної їжі
15 відтінків зеленого. Оздоровчі ефекти рослинної їжі
 
Green Trees Beautiful Scenery
Green Trees Beautiful SceneryGreen Trees Beautiful Scenery
Green Trees Beautiful Scenery
 
Folk art
Folk artFolk art
Folk art
 
Saudi culture, traditions and Art
Saudi culture, traditions and ArtSaudi culture, traditions and Art
Saudi culture, traditions and Art
 
Microsoft Cognitive Services
Microsoft Cognitive ServicesMicrosoft Cognitive Services
Microsoft Cognitive Services
 
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...
[Connect(); // Japan 2016] Microsoft の AI 開発最新アップデート ~ Cognitive Services からA...
 

Ähnlich wie Jumpstarting big data projects / Architectural Considerations of HDInsight Applications

Big Data mit Microsoft?
Big Data mit Microsoft?Big Data mit Microsoft?
Big Data mit Microsoft?Olivia Klose
 
Examining Malware with Python
Examining Malware with PythonExamining Malware with Python
Examining Malware with Pythonmrphilroth
 
Compilation process
Compilation processCompilation process
Compilation processAlex Denisov
 
A Journey to Protect Points of Sale (POS)
A Journey to Protect Points of Sale (POS)A Journey to Protect Points of Sale (POS)
A Journey to Protect Points of Sale (POS)DaveEdwards12
 
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copyRick Lougee
 
Acerノートpcバッテリー,リチウムイオンバッテリー
Acerノートpcバッテリー,リチウムイオンバッテリーAcerノートpcバッテリー,リチウムイオンバッテリー
Acerノートpcバッテリー,リチウムイオンバッテリーFollowpower Liu
 
LT SAP HANAネットワークプロトコル初段
LT SAP HANAネットワークプロトコル初段LT SAP HANAネットワークプロトコル初段
LT SAP HANAネットワークプロトコル初段Koji Shinkubo
 
Horses for Courses: Deep Learning Beyond Niche Applications
Horses for Courses: Deep Learning Beyond Niche ApplicationsHorses for Courses: Deep Learning Beyond Niche Applications
Horses for Courses: Deep Learning Beyond Niche ApplicationsNikita Johnson
 
Lanner client Hayward Tyler Group share their experience with predictive simu...
Lanner client Hayward Tyler Group share their experience with predictive simu...Lanner client Hayward Tyler Group share their experience with predictive simu...
Lanner client Hayward Tyler Group share their experience with predictive simu...Lanner
 
Altitude San Francisco 2018: Logging at the Edge
Altitude San Francisco 2018: Logging at the Edge Altitude San Francisco 2018: Logging at the Edge
Altitude San Francisco 2018: Logging at the Edge Fastly
 
realestate and MySQL devops melbourne
realestate and MySQL devops melbournerealestate and MySQL devops melbourne
realestate and MySQL devops melbournemysqldbahelp
 
Execution plans for mere mortals
Execution plans for mere mortalsExecution plans for mere mortals
Execution plans for mere mortalsMike Lawell
 

Ähnlich wie Jumpstarting big data projects / Architectural Considerations of HDInsight Applications (20)

Big Data mit Microsoft?
Big Data mit Microsoft?Big Data mit Microsoft?
Big Data mit Microsoft?
 
Examining Malware with Python
Examining Malware with PythonExamining Malware with Python
Examining Malware with Python
 
Compilation process
Compilation processCompilation process
Compilation process
 
Log
LogLog
Log
 
A Journey to Protect Points of Sale (POS)
A Journey to Protect Points of Sale (POS)A Journey to Protect Points of Sale (POS)
A Journey to Protect Points of Sale (POS)
 
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy
2018 vegas-mstr world- cisco jacob-mathew_preso-final-longversion-fordist - copy
 
Performance Risk Management
Performance Risk ManagementPerformance Risk Management
Performance Risk Management
 
Log
LogLog
Log
 
Acerノートpcバッテリー,リチウムイオンバッテリー
Acerノートpcバッテリー,リチウムイオンバッテリーAcerノートpcバッテリー,リチウムイオンバッテリー
Acerノートpcバッテリー,リチウムイオンバッテリー
 
LT SAP HANAネットワークプロトコル初段
LT SAP HANAネットワークプロトコル初段LT SAP HANAネットワークプロトコル初段
LT SAP HANAネットワークプロトコル初段
 
Pass Thru Pay
Pass Thru PayPass Thru Pay
Pass Thru Pay
 
Horses for Courses: Deep Learning Beyond Niche Applications
Horses for Courses: Deep Learning Beyond Niche ApplicationsHorses for Courses: Deep Learning Beyond Niche Applications
Horses for Courses: Deep Learning Beyond Niche Applications
 
Mach-O par Stéphane Sudre
Mach-O par Stéphane SudreMach-O par Stéphane Sudre
Mach-O par Stéphane Sudre
 
Oiu
OiuOiu
Oiu
 
Lanner client Hayward Tyler Group share their experience with predictive simu...
Lanner client Hayward Tyler Group share their experience with predictive simu...Lanner client Hayward Tyler Group share their experience with predictive simu...
Lanner client Hayward Tyler Group share their experience with predictive simu...
 
Altitude San Francisco 2018: Logging at the Edge
Altitude San Francisco 2018: Logging at the Edge Altitude San Francisco 2018: Logging at the Edge
Altitude San Francisco 2018: Logging at the Edge
 
No more dumb hex!
No more dumb hex!No more dumb hex!
No more dumb hex!
 
Keyexpo
KeyexpoKeyexpo
Keyexpo
 
realestate and MySQL devops melbourne
realestate and MySQL devops melbournerealestate and MySQL devops melbourne
realestate and MySQL devops melbourne
 
Execution plans for mere mortals
Execution plans for mere mortalsExecution plans for mere mortals
Execution plans for mere mortals
 

Mehr von Olivia Klose

Evolution of AI - Why is my computer still so dumb?
Evolution of AI - Why is my computer still so dumb?Evolution of AI - Why is my computer still so dumb?
Evolution of AI - Why is my computer still so dumb?Olivia Klose
 
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)Olivia Klose
 
TechCamps - Internet of Things
TechCamps - Internet of ThingsTechCamps - Internet of Things
TechCamps - Internet of ThingsOlivia Klose
 
What does Bob really want? Recommenders in the Cloud
What does Bob really want? Recommenders in the CloudWhat does Bob really want? Recommenders in the Cloud
What does Bob really want? Recommenders in the CloudOlivia Klose
 
Developer Week 2015: Azure Machine Learning
Developer Week 2015: Azure Machine LearningDeveloper Week 2015: Azure Machine Learning
Developer Week 2015: Azure Machine LearningOlivia Klose
 
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndDotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndOlivia Klose
 
Would I have survived the Titanic? Machine Learning in Microsoft Azure
Would I have survived the Titanic? Machine Learning in Microsoft AzureWould I have survived the Titanic? Machine Learning in Microsoft Azure
Would I have survived the Titanic? Machine Learning in Microsoft AzureOlivia Klose
 

Mehr von Olivia Klose (8)

Evolution of AI - Why is my computer still so dumb?
Evolution of AI - Why is my computer still so dumb?Evolution of AI - Why is my computer still so dumb?
Evolution of AI - Why is my computer still so dumb?
 
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)Deep Learning for New User Interactions (Gestures, Speech and Emotions)
Deep Learning for New User Interactions (Gestures, Speech and Emotions)
 
TechCamps - Internet of Things
TechCamps - Internet of ThingsTechCamps - Internet of Things
TechCamps - Internet of Things
 
What does Bob really want? Recommenders in the Cloud
What does Bob really want? Recommenders in the CloudWhat does Bob really want? Recommenders in the Cloud
What does Bob really want? Recommenders in the Cloud
 
Developer Week 2015: Azure Machine Learning
Developer Week 2015: Azure Machine LearningDeveloper Week 2015: Azure Machine Learning
Developer Week 2015: Azure Machine Learning
 
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-EndDotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End
Dotnet Cologne 2015: //Rebuild - Big Data Analysis End-to-End
 
Would I have survived the Titanic? Machine Learning in Microsoft Azure
Would I have survived the Titanic? Machine Learning in Microsoft AzureWould I have survived the Titanic? Machine Learning in Microsoft Azure
Would I have survived the Titanic? Machine Learning in Microsoft Azure
 
Big Data DIY
Big Data DIYBig Data DIY
Big Data DIY
 

Kürzlich hochgeladen

Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
Cyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis ProjectCyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis Projectdanielbell861
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
Create Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopCreate Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopThinkInnovation
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 

Kürzlich hochgeladen (13)

Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
Cyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis ProjectCyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis Project
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
Create Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopCreate Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI Desktop
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 

Jumpstarting big data projects / Architectural Considerations of HDInsight Applications