DataEngConf SF16 - Bridging the gap between data science and data engineering
•
9 gefällt mir•2,207 views
Day 1 Keynote. Talk by Josh Wills, Slack. To hear about future conferences go to http://dataengconf.com
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Andere mochten auch
Andere mochten auch (15)
Ähnlich wie DataEngConf SF16 - Bridging the gap between data science and data engineering
Ähnlich wie DataEngConf SF16 - Bridging the gap between data science and data engineering (20)
Mehr von Hakka Labs
Mehr von Hakka Labs (11)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
DataEngConf SF16 - Bridging the gap between data science and data engineering
- 1. Data Engineering and Data Science: Bridging the Gap
- 2. About Me ● Slack’s Head of Data Engineering ● Used to work at Cloudera, Google, other places ● Wrote popular tweet that I’m sort of tired of talking about ● Only owns one hat
- 3. First Question: Why Bother?
- 5. What Do We Both Want?
- 6. Infinite Loop of Sadness Data Eng Ops Data Science Business
- 8. Back To First Principles
- 10. Infinite Loop of Sadness Empathy Data Eng Ops Data Science Business
- 11. Rage In Support Of The Machine
- 12. Everybody ETLs
- 13. Option 1: SQL-Centric ETL
- 14. Option 2: JVM-Centric ETL
- 15. A Third Way
- 16. #1: The Rise of Spark
- 17. #2: Too Many Streaming Engines
- 18. #3: Streaming Design Patterns
- 19. #4: A Focus On The Real Problem
- 20. Inspiration From Deep Learning
- 21. Not Quite Static Typing
- 22. Glitch
- 25. ...but SQL when you need it
- 26. A Brave New World
- 27. Thanks! (oh and we’re hiring)