SlideShare ist ein Scribd-Unternehmen logo

"Human Cloning: The Data Scientist Bottleneck Resolved" Dr. Alex Farquhar @ds_ldn

•
•
Data Science London
Data Science London

Dr. Alex Farquhar, Data Scientist @ForwardTek presentation at Data Science London @ds_ldn On the scarcity of data scientists, and how data scientists can maximise their output.

Seele & GeistTechnologie
1 von 20
HUMAN CLONING The Data Scientist bottleneck resolved Dr Alex Farquhar Friday, 24 February 2012
exabytes data (IDC/EMC report 2008) 20,000 15,000 10,000 5,000 0 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 Friday, 24 February 2012
By 2018, the United States alone could face a shortage of 140,000 to 190,000 data people... Friday, 24 February 2012
WE’RE ALL DOOMED Friday, 24 February 2012
DATA PEOPLE? © Drew Conway Friday, 24 February 2012
MAYBE WE CAN JUST.... •1 statistician + 1 developer ≈ 1 data scientist? Friday, 24 February 2012
HOW ABOUT.... •4 statisticians + 4 developers ≈ 4 Data Scientists? Friday, 24 February 2012
Friday, 24 February 2012
Friday, 24 February 2012
WHAT CAN WE DO? • Train more new data scientists (not fast enough) • Cross-train people • Cobble together different skills in teams (see above) Friday, 24 February 2012
WHAT CAN WE DO? • Do more work Friday, 24 February 2012
DOING MORE • simplify (fob the work off) • automate (fob even more work off) • choose/build the right tools • parallelise • iterate Friday, 24 February 2012
SIMPLIFY & AUTOMATE • Counting stuff is not much fun Friday, 24 February 2012
SIMPLIFY & AUTOMATE Hive TSV files Hadoop Friday, 24 February 2012
AUTOMATE / PARALLELISE magic Hadoop Job Friday, 24 February 2012
AUTOMATE / PARALLELISE magic Hadoop Lots of jobs at once Job 1 Job 2 Job 3 Job 4 Friday, 24 February 2012
TOOLS • something thats allows fast iteration i.e. not java • R, ruby, python Friday, 24 February 2012
PARALLELISE Friday, 24 February 2012
ITERATE • try different things • improve what works • dump what doesn’t • constant improvement & learning → get faster Friday, 24 February 2012
WE’RE NOT ALL DOOMED Friday, 24 February 2012

Empfohlen

"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn
"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn
"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldnData Science London
 
M2 actividad2 10
M2 actividad2 10M2 actividad2 10
M2 actividad2 10Escuela de educación media superior
 
Autonomous Discovery: The New Interface?
Autonomous Discovery: The New Interface?Autonomous Discovery: The New Interface?
Autonomous Discovery: The New Interface?Data Science London
 
Investigative Analytics- What's in a Data Scientists Toolbox
Investigative Analytics- What's in a Data Scientists ToolboxInvestigative Analytics- What's in a Data Scientists Toolbox
Investigative Analytics- What's in a Data Scientists ToolboxData Science London
 
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJE
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJELA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJE
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJEsuperveromena
 
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.Energy for One World
 
Fico success story
Fico success storyFico success story
Fico success storyMichal Friedrich
 
ortodoncia
ortodonciaortodoncia
ortodonciaJULY PAILINA SALDARRIAGA VELEZ
 

Empfohlen

"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn
"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldn
"Telling Stories about People and Their Influence" Ferenc Huszár @ds_ldnData Science London
 
M2 actividad2 10
M2 actividad2 10M2 actividad2 10
M2 actividad2 10Escuela de educación media superior
 
Autonomous Discovery: The New Interface?
Autonomous Discovery: The New Interface?Autonomous Discovery: The New Interface?
Autonomous Discovery: The New Interface?Data Science London
 
Investigative Analytics- What's in a Data Scientists Toolbox
Investigative Analytics- What's in a Data Scientists ToolboxInvestigative Analytics- What's in a Data Scientists Toolbox
Investigative Analytics- What's in a Data Scientists ToolboxData Science London
 
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJE
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJELA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJE
LA TECNOLOGIA COMO APOYO EN EL PROCESO ENSEÑANZA-APRENDIZAJEsuperveromena
 
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.
EFOW/ LERCPA: Leaders of Energy without Borders. On our way to 100% renewables.Energy for One World
 
Fico success story
Fico success storyFico success story
Fico success storyMichal Friedrich
 
ortodoncia
ortodonciaortodoncia
ortodonciaJULY PAILINA SALDARRIAGA VELEZ
 
Utilización y selección
Utilización y selecciónUtilización y selección
Utilización y selecciónweticsblog
 
Mais cultura
Mais culturaMais cultura
Mais culturaEDUCADOR EM HISTÓRIA...
 
Gradle_ToursJUG
Gradle_ToursJUGGradle_ToursJUG
Gradle_ToursJUGGregory Boissinot
 
Research at last.fm
Research at last.fmResearch at last.fm
Research at last.fmData Science London
 
Sarwat Jahan_cv
Sarwat Jahan_cvSarwat Jahan_cv
Sarwat Jahan_cvSarwat Jahan
 
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...Jasper Moelker
 
Super-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapRSuper-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapRData Science London
 
PetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPosterPetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPosterSierra Peterson
 
Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )romilkharia
 
aparatologia ortodontica
aparatologia ortodontica aparatologia ortodontica
aparatologia ortodontica JULY PAILINA SALDARRIAGA VELEZ
 
JENKINS_BreizhJUG_20111003
JENKINS_BreizhJUG_20111003JENKINS_BreizhJUG_20111003
JENKINS_BreizhJUG_20111003Gregory Boissinot
 
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...Mery Lucy Flores M.
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learningbigdatasyd
 
Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data Erin Jo Richey
 
Del Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchadorDel Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchadorMedio y forma
 
Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012John Clegg
 
Learning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the ClassroomLearning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the Classroomjoloui16
 
鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度andyhu1007
 
Talkdesk - Call center in the browser
Talkdesk - Call center in the browserTalkdesk - Call center in the browser
Talkdesk - Call center in the browser500 Startups
 
Workbench: Managing Content Management
Workbench: Managing Content ManagementWorkbench: Managing Content Management
Workbench: Managing Content Managementnyccamp
 
Misguided manager
Misguided managerMisguided manager
Misguided managerZoe Slattery
 
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...Gigaom
 

Weitere ähnliche Inhalte

Andere mochten auch

Utilización y selección
Utilización y selecciónUtilización y selección
Utilización y selecciónweticsblog
 
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...Jasper Moelker
 
Super-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapRSuper-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapRData Science London
 
PetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPosterPetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPosterSierra Peterson
 
Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )romilkharia
 
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...Mery Lucy Flores M.
 

Andere mochten auch (12)

Utilización y selección
Utilización y selecciónUtilización y selección
Utilización y selección
 
Mais cultura
Mais culturaMais cultura
Mais cultura
 
Gradle_ToursJUG
Gradle_ToursJUGGradle_ToursJUG
Gradle_ToursJUG
 
Research at last.fm
Research at last.fmResearch at last.fm
Research at last.fm
 
Sarwat Jahan_cv
Sarwat Jahan_cvSarwat Jahan_cv
Sarwat Jahan_cv
 
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
(Inter)national Facades: International Facade Master: WHY? by Arie Bergsma (2...
 
Super-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapRSuper-Fast Clustering Report in MapR
Super-Fast Clustering Report in MapR
 
PetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPosterPetersonSierra_Interface_SustainabilityPoster
PetersonSierra_Interface_SustainabilityPoster
 
Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )Lines and angles ( Class 6-7 )
Lines and angles ( Class 6-7 )
 
aparatologia ortodontica
aparatologia ortodontica aparatologia ortodontica
aparatologia ortodontica
 
JENKINS_BreizhJUG_20111003
JENKINS_BreizhJUG_20111003JENKINS_BreizhJUG_20111003
JENKINS_BreizhJUG_20111003
 
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
Solucionario del primer examen con ingreso directo de la PRE SAN MARCOS ciclo...
 

Ähnlich wie "Human Cloning: The Data Scientist Bottleneck Resolved" Dr. Alex Farquhar @ds_ldn

Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learningbigdatasyd
 
Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data Erin Jo Richey
 
Del Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchadorDel Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchadorMedio y forma
 
Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012John Clegg
 
Learning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the ClassroomLearning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the Classroomjoloui16
 
鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度andyhu1007
 
Talkdesk - Call center in the browser
Talkdesk - Call center in the browserTalkdesk - Call center in the browser
Talkdesk - Call center in the browser500 Startups
 
Workbench: Managing Content Management
Workbench: Managing Content ManagementWorkbench: Managing Content Management
Workbench: Managing Content Managementnyccamp
 
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...Gigaom
 
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...marcocasario
 
Weather Sensebox for Schools
Weather Sensebox for SchoolsWeather Sensebox for Schools
Weather Sensebox for SchoolsThomas Bartoschek
 
Introducción a Agile y Scrum
Introducción a Agile y ScrumIntroducción a Agile y Scrum
Introducción a Agile y Scrumbetabeers
 
Introducción a Agile y Scrum (BetaBeers.com)
Introducción a Agile y Scrum (BetaBeers.com)Introducción a Agile y Scrum (BetaBeers.com)
Introducción a Agile y Scrum (BetaBeers.com)Carlos Buenosvinos
 

Ähnlich wie "Human Cloning: The Data Scientist Bottleneck Resolved" Dr. Alex Farquhar @ds_ldn (15)

Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
 
Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data Filtered and Refined: Interfaces for Distilling Data
Filtered and Refined: Interfaces for Distilling Data
 
Del Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchadorDel Druplicon a la máscara de luchador
Del Druplicon a la máscara de luchador
 
Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012Summer of tech - Career Seminar 2012
Summer of tech - Career Seminar 2012
 
Learning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the ClassroomLearning @school Integrating ICT in the Classroom
Learning @school Integrating ICT in the Classroom
 
鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度鱼与熊掌 － 软件质量和交付速度
鱼与熊掌 － 软件质量和交付速度
 
Talkdesk - Call center in the browser
Talkdesk - Call center in the browserTalkdesk - Call center in the browser
Talkdesk - Call center in the browser
 
Workbench: Managing Content Management
Workbench: Managing Content ManagementWorkbench: Managing Content Management
Workbench: Managing Content Management
 
Misguided manager
Misguided managerMisguided manager
Misguided manager
 
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
BIG DATA: AN AUGMENTED INTELLIGENCE FOR STRATEGIC DECISION MAKING from Struct...
 
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...
HTML5 Italy: Back end ecosystems for your applications - Cesare Rocchi + Clau...
 
Weather Sensebox for Schools
Weather Sensebox for SchoolsWeather Sensebox for Schools
Weather Sensebox for Schools
 
Introducción a Agile y Scrum
Introducción a Agile y ScrumIntroducción a Agile y Scrum
Introducción a Agile y Scrum
 
Introducción a Agile y Scrum (BetaBeers.com)
Introducción a Agile y Scrum (BetaBeers.com)Introducción a Agile y Scrum (BetaBeers.com)
Introducción a Agile y Scrum (BetaBeers.com)
 
P Lamp
P LampP Lamp
P Lamp
 

Mehr von Data Science London

Standardizing +113 million Merchant Names in Financial Services with Greenplu...
Standardizing +113 million Merchant Names in Financial Services with Greenplu...Standardizing +113 million Merchant Names in Financial Services with Greenplu...
Standardizing +113 million Merchant Names in Financial Services with Greenplu...Data Science London
 
Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?Data Science London
 
Real-Time Queries in Hadoop w/ Cloudera Impala
Real-Time Queries in Hadoop w/ Cloudera ImpalaReal-Time Queries in Hadoop w/ Cloudera Impala
Real-Time Queries in Hadoop w/ Cloudera ImpalaData Science London
 
Numpy, the Python foundation for number crunching
Numpy, the Python foundation for number crunchingNumpy, the Python foundation for number crunching
Numpy, the Python foundation for number crunchingData Science London
 
Python pandas workshop iPython notebook (163 pages)
Python pandas workshop iPython notebook (163 pages)Python pandas workshop iPython notebook (163 pages)
Python pandas workshop iPython notebook (163 pages)Data Science London
 
Big Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least SquaresBig Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least SquaresData Science London
 
Bringing back the excitement to data analysis
Bringing back the excitement to data analysisBringing back the excitement to data analysis
Bringing back the excitement to data analysisData Science London
 
ACM RecSys 2012: Recommender Systems, Today
ACM RecSys 2012: Recommender Systems, TodayACM RecSys 2012: Recommender Systems, Today
ACM RecSys 2012: Recommender Systems, TodayData Science London
 
Beyond Accuracy: Goal-Driven Recommender Systems Design
Beyond Accuracy: Goal-Driven Recommender Systems DesignBeyond Accuracy: Goal-Driven Recommender Systems Design
Beyond Accuracy: Goal-Driven Recommender Systems DesignData Science London
 
Machine Learning and Hadoop: Present and Future
Machine Learning and Hadoop: Present and FutureMachine Learning and Hadoop: Present and Future
Machine Learning and Hadoop: Present and FutureData Science London
 
Music and Data: Adding Up the UK Music Industry
Music and Data: Adding Up the UK Music IndustryMusic and Data: Adding Up the UK Music Industry
Music and Data: Adding Up the UK Music IndustryData Science London
 
Scientific Article Recommendations with Mahout
Scientific Article Recommendations with MahoutScientific Article Recommendations with Mahout
Scientific Article Recommendations with MahoutData Science London
 
Simple Matrix Factorization for Recommendation in Mahout
Simple Matrix Factorization for Recommendation in MahoutSimple Matrix Factorization for Recommendation in Mahout
Simple Matrix Factorization for Recommendation in MahoutData Science London
 
Going Real-Time with Mahout, Predicting gender of Facebook Users
Going Real-Time with Mahout, Predicting gender of Facebook UsersGoing Real-Time with Mahout, Predicting gender of Facebook Users
Going Real-Time with Mahout, Predicting gender of Facebook UsersData Science London
 
Understanding Cause & Effect in Customer Behaviour
Understanding Cause & Effect in Customer BehaviourUnderstanding Cause & Effect in Customer Behaviour
Understanding Cause & Effect in Customer BehaviourData Science London
 

Mehr von Data Science London (20)

Standardizing +113 million Merchant Names in Financial Services with Greenplu...
Standardizing +113 million Merchant Names in Financial Services with Greenplu...Standardizing +113 million Merchant Names in Financial Services with Greenplu...
Standardizing +113 million Merchant Names in Financial Services with Greenplu...
 
Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?
 
Real-Time Queries in Hadoop w/ Cloudera Impala
Real-Time Queries in Hadoop w/ Cloudera ImpalaReal-Time Queries in Hadoop w/ Cloudera Impala
Real-Time Queries in Hadoop w/ Cloudera Impala
 
Nowcasting Business Performance
Nowcasting Business PerformanceNowcasting Business Performance
Nowcasting Business Performance
 
Numpy, the Python foundation for number crunching
Numpy, the Python foundation for number crunchingNumpy, the Python foundation for number crunching
Numpy, the Python foundation for number crunching
 
Python pandas workshop iPython notebook (163 pages)
Python pandas workshop iPython notebook (163 pages)Python pandas workshop iPython notebook (163 pages)
Python pandas workshop iPython notebook (163 pages)
 
Big Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least SquaresBig Practical Recommendations with Alternating Least Squares
Big Practical Recommendations with Alternating Least Squares
 
Bringing back the excitement to data analysis
Bringing back the excitement to data analysisBringing back the excitement to data analysis
Bringing back the excitement to data analysis
 
Survival Analysis of Web Users
Survival Analysis of Web UsersSurvival Analysis of Web Users
Survival Analysis of Web Users
 
ACM RecSys 2012: Recommender Systems, Today
ACM RecSys 2012: Recommender Systems, TodayACM RecSys 2012: Recommender Systems, Today
ACM RecSys 2012: Recommender Systems, Today
 
Beyond Accuracy: Goal-Driven Recommender Systems Design
Beyond Accuracy: Goal-Driven Recommender Systems DesignBeyond Accuracy: Goal-Driven Recommender Systems Design
Beyond Accuracy: Goal-Driven Recommender Systems Design
 
Machine Learning and Hadoop: Present and Future
Machine Learning and Hadoop: Present and FutureMachine Learning and Hadoop: Present and Future
Machine Learning and Hadoop: Present and Future
 
Data Science for Live Music
Data Science for Live MusicData Science for Live Music
Data Science for Live Music
 
Music and Data: Adding Up the UK Music Industry
Music and Data: Adding Up the UK Music IndustryMusic and Data: Adding Up the UK Music Industry
Music and Data: Adding Up the UK Music Industry
 
Scientific Article Recommendations with Mahout
Scientific Article Recommendations with MahoutScientific Article Recommendations with Mahout
Scientific Article Recommendations with Mahout
 
Simple Matrix Factorization for Recommendation in Mahout
Simple Matrix Factorization for Recommendation in MahoutSimple Matrix Factorization for Recommendation in Mahout
Simple Matrix Factorization for Recommendation in Mahout
 
Going Real-Time with Mahout, Predicting gender of Facebook Users
Going Real-Time with Mahout, Predicting gender of Facebook UsersGoing Real-Time with Mahout, Predicting gender of Facebook Users
Going Real-Time with Mahout, Predicting gender of Facebook Users
 
Practical Magic with Incanter
Practical Magic with IncanterPractical Magic with Incanter
Practical Magic with Incanter
 
Understanding Cause & Effect in Customer Behaviour
Understanding Cause & Effect in Customer BehaviourUnderstanding Cause & Effect in Customer Behaviour
Understanding Cause & Effect in Customer Behaviour
 
Bootstrapping Data Science
Bootstrapping Data ScienceBootstrapping Data Science
Bootstrapping Data Science
 

Kürzlich hochgeladen

Understanding Jainism Beliefs and Information.pptx
Understanding Jainism Beliefs and Information.pptxUnderstanding Jainism Beliefs and Information.pptx
Understanding Jainism Beliefs and Information.pptxjainismworldseo
 
Seerah un nabi Muhammad Quiz Part-1.pdf
Seerah un nabi Muhammad Quiz Part-1.pdfSeerah un nabi Muhammad Quiz Part-1.pdf
Seerah un nabi Muhammad Quiz Part-1.pdfAnsariB1
 
Do You Think it is a Small Matter- David’s Men.pptx
Do You Think it is a Small Matter- David’s Men.pptxDo You Think it is a Small Matter- David’s Men.pptx
Do You Think it is a Small Matter- David’s Men.pptxRick Peterson
 
Sawwaf Calendar, 2024
Sawwaf Calendar, 2024Sawwaf Calendar, 2024
Sawwaf Calendar, 2024Bassem Matta
 
Amil baba kala jadu expert asli ilm ka malik
Amil baba kala jadu expert asli ilm ka malikAmil baba kala jadu expert asli ilm ka malik
Amil baba kala jadu expert asli ilm ka malikamil baba kala jadu
 
Amil baba in uk amil baba in Australia amil baba in canada
Amil baba in uk amil baba in Australia amil baba in canadaAmil baba in uk amil baba in Australia amil baba in canada
Amil baba in uk amil baba in Australia amil baba in canadaamil baba kala jadu
 
Dubai Call Girls Skinny Mandy O525547819 Call Girls Dubai
Dubai Call Girls Skinny Mandy O525547819 Call Girls DubaiDubai Call Girls Skinny Mandy O525547819 Call Girls Dubai
Dubai Call Girls Skinny Mandy O525547819 Call Girls Dubaikojalkojal131
 
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptx
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptxThe Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptx
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptxNetwork Bible Fellowship
 
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)Darul Amal Chishtia
 
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in Karachi
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in KarachiNo.1 Amil baba in Pakistan amil baba in Lahore amil baba in Karachi
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in KarachiAmil Baba Mangal Maseeh
 
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证jdkhjh
 
Unity is Strength 2024 Peace Haggadah + Song List.pdf
Unity is Strength 2024 Peace Haggadah + Song List.pdfUnity is Strength 2024 Peace Haggadah + Song List.pdf
Unity is Strength 2024 Peace Haggadah + Song List.pdfRebeccaSealfon
 
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialist
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialistAsli amil baba in Karachi Pakistan and best astrologer Black magic specialist
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialistAmil Baba Mangal Maseeh
 
Asli amil baba near you 100%kala ilm ka mahir
Asli amil baba near you 100%kala ilm ka mahirAsli amil baba near you 100%kala ilm ka mahir
Asli amil baba near you 100%kala ilm ka mahirAmil Baba Mangal Maseeh
 
Asli amil baba in Karachi asli amil baba in Lahore
Asli amil baba in Karachi asli amil baba in LahoreAsli amil baba in Karachi asli amil baba in Lahore
Asli amil baba in Karachi asli amil baba in Lahoreamil baba kala jadu
 
Deerfoot Church of Christ Bulletin 4 21 24
Deerfoot Church of Christ Bulletin 4 21 24Deerfoot Church of Christ Bulletin 4 21 24
Deerfoot Church of Christ Bulletin 4 21 24deerfootcoc
 

Kürzlich hochgeladen (20)

Understanding Jainism Beliefs and Information.pptx
Understanding Jainism Beliefs and Information.pptxUnderstanding Jainism Beliefs and Information.pptx
Understanding Jainism Beliefs and Information.pptx
 
Seerah un nabi Muhammad Quiz Part-1.pdf
Seerah un nabi Muhammad Quiz Part-1.pdfSeerah un nabi Muhammad Quiz Part-1.pdf
Seerah un nabi Muhammad Quiz Part-1.pdf
 
Do You Think it is a Small Matter- David’s Men.pptx
Do You Think it is a Small Matter- David’s Men.pptxDo You Think it is a Small Matter- David’s Men.pptx
Do You Think it is a Small Matter- David’s Men.pptx
 
young Whatsapp Call Girls in Adarsh Nagar🔝 9953056974 🔝 escort service
young Whatsapp Call Girls in Adarsh Nagar🔝 9953056974 🔝 escort serviceyoung Whatsapp Call Girls in Adarsh Nagar🔝 9953056974 🔝 escort service
young Whatsapp Call Girls in Adarsh Nagar🔝 9953056974 🔝 escort service
 
Sawwaf Calendar, 2024
Sawwaf Calendar, 2024Sawwaf Calendar, 2024
Sawwaf Calendar, 2024
 
Amil baba kala jadu expert asli ilm ka malik
Amil baba kala jadu expert asli ilm ka malikAmil baba kala jadu expert asli ilm ka malik
Amil baba kala jadu expert asli ilm ka malik
 
Amil baba in uk amil baba in Australia amil baba in canada
Amil baba in uk amil baba in Australia amil baba in canadaAmil baba in uk amil baba in Australia amil baba in canada
Amil baba in uk amil baba in Australia amil baba in canada
 
Dubai Call Girls Skinny Mandy O525547819 Call Girls Dubai
Dubai Call Girls Skinny Mandy O525547819 Call Girls DubaiDubai Call Girls Skinny Mandy O525547819 Call Girls Dubai
Dubai Call Girls Skinny Mandy O525547819 Call Girls Dubai
 
🔝9953056974 🔝young Delhi Escort service Vinay Nagar
🔝9953056974 🔝young Delhi Escort service Vinay Nagar🔝9953056974 🔝young Delhi Escort service Vinay Nagar
🔝9953056974 🔝young Delhi Escort service Vinay Nagar
 
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptx
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptxThe Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptx
The Chronological Life of Christ part 097 (Reality Check Luke 13 1-9).pptx
 
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)
Monthly Khazina-e-Ruhaniyaat April’2024 (Vol.14, Issue 12)
 
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in Karachi
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in KarachiNo.1 Amil baba in Pakistan amil baba in Lahore amil baba in Karachi
No.1 Amil baba in Pakistan amil baba in Lahore amil baba in Karachi
 
young Call girls in Dwarka sector 3🔝 9953056974 🔝 Delhi escort Service
young Call girls in Dwarka sector 3🔝 9953056974 🔝 Delhi escort Serviceyoung Call girls in Dwarka sector 3🔝 9953056974 🔝 Delhi escort Service
young Call girls in Dwarka sector 3🔝 9953056974 🔝 Delhi escort Service
 
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证
原版1:1复刻莫纳什大学毕业证Monash毕业证留信学历认证
 
Unity is Strength 2024 Peace Haggadah + Song List.pdf
Unity is Strength 2024 Peace Haggadah + Song List.pdfUnity is Strength 2024 Peace Haggadah + Song List.pdf
Unity is Strength 2024 Peace Haggadah + Song List.pdf
 
Top 8 Krishna Bhajan Lyrics in English.pdf
Top 8 Krishna Bhajan Lyrics in English.pdfTop 8 Krishna Bhajan Lyrics in English.pdf
Top 8 Krishna Bhajan Lyrics in English.pdf
 
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialist
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialistAsli amil baba in Karachi Pakistan and best astrologer Black magic specialist
Asli amil baba in Karachi Pakistan and best astrologer Black magic specialist
 
Asli amil baba near you 100%kala ilm ka mahir
Asli amil baba near you 100%kala ilm ka mahirAsli amil baba near you 100%kala ilm ka mahir
Asli amil baba near you 100%kala ilm ka mahir
 
Asli amil baba in Karachi asli amil baba in Lahore
Asli amil baba in Karachi asli amil baba in LahoreAsli amil baba in Karachi asli amil baba in Lahore
Asli amil baba in Karachi asli amil baba in Lahore
 
Deerfoot Church of Christ Bulletin 4 21 24
Deerfoot Church of Christ Bulletin 4 21 24Deerfoot Church of Christ Bulletin 4 21 24
Deerfoot Church of Christ Bulletin 4 21 24
 

"Human Cloning: The Data Scientist Bottleneck Resolved" Dr. Alex Farquhar @ds_ldn

  • 1. HUMAN CLONING The Data Scientist bottleneck resolved Dr Alex Farquhar Friday, 24 February 2012
  • 2. exabytes data (IDC/EMC report 2008) 20,000 15,000 10,000 5,000 0 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 Friday, 24 February 2012
  • 3. By 2018, the United States alone could face a shortage of 140,000 to 190,000 data people... Friday, 24 February 2012
  • 4. WE’RE ALL DOOMED Friday, 24 February 2012
  • 5. DATA PEOPLE? © Drew Conway Friday, 24 February 2012
  • 6. MAYBE WE CAN JUST.... •1 statistician + 1 developer ≈ 1 data scientist? Friday, 24 February 2012
  • 7. HOW ABOUT.... •4 statisticians + 4 developers ≈ 4 Data Scientists? Friday, 24 February 2012
  • 10. WHAT CAN WE DO? • Train more new data scientists (not fast enough) • Cross-train people • Cobble together different skills in teams (see above) Friday, 24 February 2012
  • 11. WHAT CAN WE DO? • Do more work Friday, 24 February 2012
  • 12. DOING MORE • simplify (fob the work off) • automate (fob even more work off) • choose/build the right tools • parallelise • iterate Friday, 24 February 2012
  • 13. SIMPLIFY & AUTOMATE • Counting stuff is not much fun Friday, 24 February 2012
  • 14. SIMPLIFY & AUTOMATE Hive TSV files Hadoop Friday, 24 February 2012
  • 15. AUTOMATE / PARALLELISE magic Hadoop Job Friday, 24 February 2012
  • 16. AUTOMATE / PARALLELISE magic Hadoop Lots of jobs at once Job 1 Job 2 Job 3 Job 4 Friday, 24 February 2012
  • 17. TOOLS • something thats allows fast iteration i.e. not java • R, ruby, python Friday, 24 February 2012
  • 19. ITERATE • try different things • improve what works • dump what doesn’t • constant improvement & learning → get faster Friday, 24 February 2012
  • 20. WE’RE NOT ALL DOOMED Friday, 24 February 2012