2. INVERTING 80/20: BEYOND BESPOKE
BIG DATA
Ari Gesher
Palantir Technologies
Wednesday, March 26, 14
SLIDES BY 3/14 at NOON - TBD.....
3. INVERTING 80/20
Beyond Bespoke Big Data
(or how operating systems change everything)
mailto: agesher@palantir.com
twitter: @alephbass
Ari Gesher, Engineering Ambassador
Wednesday, March 26, 14
! •! Hiring, hiring, hiring - the only way to have this problem (and it’s a good one to have) is to have a hiring machine that’s kicking ass.
! •! Design for growth - make sure your systems (IT, food, etc) can handle exponential growth. Build small, but design scalable
! •! Be most worried about long-lead time resources: hiring, leadership, and real estate
! •! Culture: how it changes, how to preserve it
! •! Discard your old biases - project managers enable scale, but process hinders at small scale
4. Wednesday, March 26, 14
Artillery tables, calculated by people called ‘computers’
9. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
Wednesday, March 26, 14
10. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
Wednesday, March 26, 14
11. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
• Programmers started with nothing but primitive functionality
Wednesday, March 26, 14
12. Yak Shavers, Inc
BEFORE OPERATING SYSTEMS
• Programmers had to write the minutiae of hardware, error codes, etc
• Writing directly for the hardware of a single computer
• Programmers started with nothing but primitive functionality
• Very little of the effort went into building the actual intent of the
software
Wednesday, March 26, 14
14. yak shaving, n
1. Any apparently useless activity which, by
allowing you to overcome intermediate
difficulties, allows you to solve a
larger problem.
Wednesday, March 26, 14
15. yak shaving
Any apparently useless activity which, by allowing
you to overcome intermediate difficulties, allows
you to solve a larger problem.
Wednesday, March 26, 14
17. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
Wednesday, March 26, 14
18. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
Wednesday, March 26, 14
19. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
• Common functionality (GUI, networking, files) shared by all programs
Wednesday, March 26, 14
20. Yaks keep hair
AFTER OPERATING SYSTEMS
• OS API is a clean abstraction, hardware agnostic
• Hardware can change and code still works
• Common functionality (GUI, networking, files) shared by all programs
• Majority of effort goes into primary purpose
Wednesday, March 26, 14
28. big data, n
1. Data sets that are too large and complex to
manipulate or interrogate with standard
methods or tools (OED, 2013).
2. A set of technologies and tools designed to
address large-scale data analysis problems.
3. A IT buzzword from the early teens of the
21st century.
Wednesday, March 26, 14