AI is the buzzword while ML is the underlying component... but when do we use ML? To solve problems that machines can find patterns without explicitly programming them to do so. But do you have a team building an ML model? How far are they from the IT team? Do they know how to deploy and serve that? Testing? And sharing what they have done? That's where a devops mindset comes in: reduce the batch size, continuous-everything and a culture of failure/experimentation are vital for your data team! In the end, I will show how the workflow of a data scientist can be on the real life with a live demo!

1. @thiagoavadore#codemotionBerlin
AI WITH A DEVOPS MINDSET -
EXPERIMENTATION, SHARING AND EASY
ML DEPLOYMENT
THIAGO DE FARIA
DATAOPS & AI LEAD @LINKIT

2. @thiagoavadore#codemotionBerlin
…

3. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "

4. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "
▸ ❤ 👶 🎸 🎹 '

5. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '

6. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark

7. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

8. @thiagoavadore#codemotionBerlin
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ DevOps believer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

9. @thiagoavadore#codemotionBerlin
FIGHTING THE
DOWNWARDS SPIRAL
TIMELESS CONFLICT

10. @thiagoavadore#codemotionBerlin
Product
Dev
IT Ops
QA
Infosec

11. @thiagoavadore#codemotionBerlin
HYPE WARS - REVENGE OF AI

12. @thiagoavadore#codemotionBerlin
GOOGLE AI MAKES PHONE CALLS??!!
CAN YOU DO SOMETHING LIKE THAT USING
THAT TENSORFLOW STUFF?
OUR USERS WOULD LOVE THAT!
PERSON A, VP OF PRODUCT
The real goal? A great PR
HYPE WARS - REVENGE OF AI

13. @thiagoavadore#codemotionBerlin
HYPE WARS - OTHER HYPES STRIKE BACK

14. @thiagoavadore#codemotionBerlin
WAIT… CAN YOU ALSO DO
THAT IN A CONTAINER USING
BLOCKCHAIN?
PERSON B, appointed new VP of product
HYPE WARS - OTHER HYPES STRIKE BACK

15. @thiagoavadore#codemotionBerlin
HYPE WARS - THE ULTIMATE MEDIUM READER

16. @thiagoavadore#codemotionBerlin
WHY DON’T WE CREATE AN AI DEVOPS
CLOUD-NATIVE APP ON K8S USING
BLOCKCHAIN BACKED BY IOT DEVICES THAT
THE USER WILL EXPERIENCE WITH A VR
HEADSET? A TRULY DISRUPTIVE DIGITAL
TRANSFORMATION!
HYPE WARS - THE ULTIMATE MEDIUM READER

17. @thiagoavadore#codemotionBerlin
WHY DON’T WE CREATE AN AI DEVOPS
CLOUD-NATIVE APP ON K8S USING
BLOCKCHAIN BACKED BY IOT DEVICES THAT
THE USER WILL EXPERIENCE WITH A VR
HEADSET? A TRULY DISRUPTIVE DIGITAL
TRANSFORMATION!
PERSON C, appointed CEO and master-of-all things
Gets funded and moves to the Bay Area
HYPE WARS - THE ULTIMATE MEDIUM READER

18. @thiagoavadore#codemotionBerlin
AI
MAKE COMPUTERS
CAPABLE OF DOING
THINGS THAT WHEN
DONE BY A HUMAN,
WOULD BE THOUGHT
TO REQUIRE
INTELLIGENCE

19. @thiagoavadore#codemotionBerlin
MAKE MACHINES
FIND PATTERNS
WITHOUT EXPLICITLY
PROGRAMMING
THEM TO DO SO
AI
MACHINE
LEARNING

20. @thiagoavadore#codemotionBerlin
TRADITIONAL DEVELOPMENT
REVOLVES AROUND IF/ELSE, LOOPS
& FUNCTIONS RETURNING A VALUE

21. @thiagoavadore#codemotionBerlin

22. @thiagoavadore#codemotionBerlin

23. @thiagoavadore#codemotionBerlin
ML DEVELOPMENT REVOLVES
AROUND HYPERPARAMETERS
& DATA PIPELINE

24. @thiagoavadore#codemotionBerlin

25. @thiagoavadore#codemotionBerlin
DATA
PIPELINE
Manual
INGESTION
EXPLORE
CLEAN
FEATURE
ENGINEERING

26. @thiagoavadore#codemotionBerlin
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Manual
INGESTION

27. @thiagoavadore#codemotionBerlin
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Automated
INGESTION

28. @thiagoavadore#codemotionBerlin
DATA
PIPELINE
MODEL DEVOPERATIONS
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TEST
TUNE
PACKAGE
LOGGING
MONITOR
DEPLOY
Automated
INGESTION
SERVE

29. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…

30. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Brown field

31. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Brown field

32. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Brown field

33. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Brown field

34. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field

35. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field
▸ Monitoring

36. @thiagoavadore#codemotionBerlin
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field
▸ Monitoring
▸ Nobody wants be “on-call”

37. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS

38. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers

39. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale

40. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning

41. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework

42. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework
▸ Packaging, deploying &
serving??!

43. @thiagoavadore#codemotionBerlin
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework
▸ Packaging, deploying &
serving??!
▸ Even harder to measure the
efficacy

44. @thiagoavadore#codemotionBerlin
SILVER BULLET
CULTURE CHANGE &
NEW WAYS OF WORKING.DOES IT SOUND SIMILAR?

45. @thiagoavadore#codemotionBerlin
CHANGE THE CULTURE.
INVOLVE ML/DS.

46. @thiagoavadore#codemotionBerlin
Product
Dev
IT Ops
QA
Infosec
ML Engineer
Data Scientist

47. @thiagoavadore#codemotionBerlin
LOCAL DATA
SCIENCE IS DEAD

48. @thiagoavadore#codemotionBerlin
CI/CD FOR ML
*IT ISN’T EASY…

49. @thiagoavadore#codemotionBerlin
MORE THAN CI/CD,
CONTINUOUS EVALUATION

50. @thiagoavadore#codemotionBerlin
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

51. @thiagoavadore#codemotionBerlin
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

52. @thiagoavadore#codemotionBerlin
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

53. @thiagoavadore#codemotionBerlin
COLLABORATION.

54. @thiagoavadore#codemotionBerlin
COLLABORATION.
VERSION - CODE & DATA.

55. @thiagoavadore#codemotionBerlin
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.

56. @thiagoavadore#codemotionBerlin
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.

57. @thiagoavadore#codemotionBerlin
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.

58. @thiagoavadore#codemotionBerlin
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

59. @thiagoavadore#codemotionBerlin
BESIDES CULTURE, HOW TO BRIDGE THE GAP

60. @thiagoavadore#codemotionBerlin
BESIDES CULTURE, HOW TO BRIDGE THE GAP
▸ 2.3 on

61. @thiagoavadore#codemotionBerlin
BESIDES CULTURE, HOW TO BRIDGE THE GAP
▸ 2.3 on
▸ …… on Ha. 3.1

62. @thiagoavadore#codemotionBerlin
BESIDES CULTURE, HOW TO BRIDGE THE GAP
▸ 2.3 on
▸ …… on Ha. 3.1
▸ .

63. @thiagoavadore#codemotionBerlin
BESIDES CULTURE, HOW TO BRIDGE THE GAP
▸ 2.3 on
▸ …… on Ha. 3.1
▸ .
▸ .

64. @thiagoavadore#codemotionBerlin
DEMO GODS, BE KIND…

65. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

66. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

67. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

68. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

69. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

70. @thiagoavadore#codemotionBerlin
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!
& MANY OTHERS

71. @thiagoavadore#codemotionBerlin
Questions?

72. @thiagoavadore#codemotionBerlin
Questions?
SHAMELESS PLUG…

73. @thiagoavadore#codemotionBerlin
THE AMAZING PICTURES ARE FROM THE
GREAT JD HANCOCK!
PHOTOS.JDHANCOCK.COM