Thiago de Faria - AI with a devops mindset - experimentation, sharing and easy deployment of Machine Learning components - Codemotion Berlin 2018

@thiagoavadore#codemotionBerlin
AI WITH A DEVOPS MINDSET -
EXPERIMENTATION, SHARING AND EASY
ML DEPLOYMENT
THIAGO DE FARIA 
DATAOPS & AI LEAD @LINKIT

…

~/
▸ ! @ "

~/
▸ ! @ "
▸ ❤ 👶 🎸 🎹 '

~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '

~/
▸ ! @ "
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorﬂow, Scala & Spark

~/
▸ ! @ "
▸ ❤ 👶 🎸 🎹 '
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

~/
▸ ! @ "
▸ DevOps believer
▸ ❤ 👶 🎸 🎹 '
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

FIGHTING THE
DOWNWARDS SPIRAL
TIMELESS CONFLICT

Product
Dev
IT Ops
QA
Infosec

HYPE WARS - REVENGE OF AI

GOOGLE AI MAKES PHONE CALLS??!! 
CAN YOU DO SOMETHING LIKE THAT USING
THAT TENSORFLOW STUFF? 
OUR USERS WOULD LOVE THAT!
PERSON A, VP OF PRODUCT 
The real goal? A great PR
HYPE WARS - REVENGE OF AI

HYPE WARS - OTHER HYPES STRIKE BACK

WAIT… CAN YOU ALSO DO
THAT IN A CONTAINER USING
BLOCKCHAIN?
PERSON B, appointed new VP of product
HYPE WARS - OTHER HYPES STRIKE BACK

HYPE WARS - THE ULTIMATE MEDIUM READER

WHY DON’T WE CREATE AN AI DEVOPS
CLOUD-NATIVE APP ON K8S USING
BLOCKCHAIN BACKED BY IOT DEVICES THAT
THE USER WILL EXPERIENCE WITH A VR
HEADSET? A TRULY DISRUPTIVE DIGITAL
TRANSFORMATION!

WHY DON’T WE CREATE AN AI DEVOPS
CLOUD-NATIVE APP ON K8S USING
BLOCKCHAIN BACKED BY IOT DEVICES THAT
THE USER WILL EXPERIENCE WITH A VR
HEADSET? A TRULY DISRUPTIVE DIGITAL
TRANSFORMATION!
PERSON C, appointed CEO and master-of-all things 
Gets funded and moves to the Bay Area

AI
MAKE COMPUTERS
CAPABLE OF DOING
THINGS THAT WHEN
DONE BY A HUMAN,
WOULD BE THOUGHT
TO REQUIRE
INTELLIGENCE

MAKE MACHINES
FIND PATTERNS
WITHOUT EXPLICITLY
PROGRAMMING
THEM TO DO SO
AI
MACHINE
LEARNING

TRADITIONAL DEVELOPMENT
REVOLVES AROUND IF/ELSE, LOOPS
& FUNCTIONS RETURNING A VALUE

ML DEVELOPMENT REVOLVES
AROUND HYPERPARAMETERS
& DATA PIPELINE

DATA
PIPELINE
Manual 
INGESTION
EXPLORE
CLEAN
FEATURE
ENGINEERING

DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Manual 
INGESTION

DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Automated 
INGESTION

DATA
PIPELINE
MODEL DEVOPERATIONS
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TEST
TUNE
PACKAGE
LOGGING
MONITOR
DEPLOY
Automated 
INGESTION
SERVE

TRADITIONAL PROBLEMS ALONG THE WAY…

▸ Brown ﬁeld

▸ Data & API changes
▸ Brown ﬁeld

▸ Business does not know what
they want/need
▸ Brown ﬁeld

they want/need
▸ Internal Politics
▸ Brown ﬁeld

they want/need
▸ Going live
▸ Brown ﬁeld

they want/need
▸ Going live
▸ Brown ﬁeld
▸ Monitoring

they want/need
▸ Going live
▸ Brown ﬁeld
▸ Monitoring
▸ Nobody wants be “on-call”

THE DATA PIPELINE & ML EXTRA PROBLEMS

▸ DS != software engineers

▸ Data pipeline won’t scale

▸ Local development, local data
& lack of versioning

▸ Lot of rework

▸ Lot of rework
▸ Packaging, deploying &
serving??!

▸ Lot of rework
▸ Packaging, deploying &
serving??!
▸ Even harder to measure the
efﬁcacy

SILVER BULLET
CULTURE CHANGE &
NEW WAYS OF WORKING.DOES IT SOUND SIMILAR?

CHANGE THE CULTURE.  
INVOLVE ML/DS.

Product
Dev
IT Ops
QA
Infosec
ML Engineer
Data Scientist

LOCAL DATA
SCIENCE IS DEAD

CI/CD FOR ML 
*IT ISN’T EASY…

MORE THAN CI/CD,
CONTINUOUS EVALUATION

BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

COLLABORATION.

COLLABORATION.
VERSION - CODE & DATA.

COLLABORATION.
EVALUATION.

COLLABORATION.
EVALUATION.
PACKAGING.

COLLABORATION.
EVALUATION.
PACKAGING.
DEPLOYMENT.

COLLABORATION.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

BESIDES CULTURE, HOW TO BRIDGE THE GAP

▸ 2.3 on

▸ 2.3 on
▸ …… on Ha. 3.1

▸ 2.3 on
▸ …… on Ha. 3.1
▸ .

▸ 2.3 on
▸ …… on Ha. 3.1
▸ .
▸ .

DEMO GODS, BE KIND…

COLLABORATION
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

COLLABORATION
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT! 
!CULTURE CHANGE!

COLLABORATION
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT! 
!CULTURE CHANGE!
& MANY OTHERS

Questions?

Questions?
SHAMELESS PLUG…

THE AMAZING PICTURES ARE FROM THE
GREAT JD HANCOCK! 
 
PHOTOS.JDHANCOCK.COM

Thiago de Faria - AI with a devops mindset - experimentation, sharing and easy deployment of Machine Learning components - Codemotion Berlin 2018

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie Thiago de Faria - AI with a devops mindset - experimentation, sharing and easy deployment of Machine Learning components - Codemotion Berlin 2018

Ähnlich wie Thiago de Faria - AI with a devops mindset - experimentation, sharing and easy deployment of Machine Learning components - Codemotion Berlin 2018 (20)

Mehr von Codemotion

Mehr von Codemotion (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Thiago de Faria - AI with a devops mindset - experimentation, sharing and easy deployment of Machine Learning components - Codemotion Berlin 2018