How Big Data is a changing businesses and society? Where is the gold in all of that data and how can it improve productivity, profitability, competitive advantage, and personal efficiencies? André Simões - BI Architect and Big Data Evangelist, @Xpand IT Xpand IT presentation during the Pentaho & Big Data Ecosystem - Live Seminar 2013

1. THE
BIG DATA
challenge
André Simões
andre.simoes@xpand-it.com

2. “Everyone talks about it
Nobody really knows how to do it
Everyone thinks everyone else is doing it
So everyone claims they are doing it…”
(Dan
Ariely,
Duke
University)
BIG DATA IS LIKE TEENAGE SEX

3. BEING ABLE TO USe
More than
5%
OF YOUR DATA FOR ANALYSIS
THE CHALLENGES

4. CAPTURING
MORE THAN 1/4
OF YOUR
YEARLY DATA
FOR ANALYSIS
THE CHALLENGES

5. MAKE YOUR TEAM
ABLE TO KEEP UP
WITH THE
THE CHALLENGES
CHANGES

6. WHERE TO START ?

7. V olume
V ariety
V elocity
THE 3 V’S

8. WHY BUY AN AIRPLANE
When you can…
SCALE OUT
THE CHALLENGES

9. DISTRIBUTED
filesystems

10. COMODITY HARDWARE
REPLICATION
DISTRIBUTED COMPUTATION
STEEP LEARNING CURVE
DISTRIBUTED DATABASES

11. ETL DEVELOPERS
ARE
EASY
TO FIND
MAP/REDUCE DEVELOPERS
ARE
DISTRIBUTED FILESYSTEMS
NOT

12. FORTUNATELY, PENTAHO
THOUGHT ABOUT THIS…
DISTRIBUTED FILESYSTEMS

13. EASY FOR ETL DEVELOPERS
SEAMLESS INTEGRATION
DISTRIBUTED COMPUTATION
VERY SMALL LEARNING CURVE
DISTRIBUTED DATABASESO MAP/REDUCE

14. SOMETIMES YOUR
MIGHT ALSO
LOOK LIKE
THIS…
THE CHALLENGES
DATA
WHAT TO
DO?

15. NOSQL

16. UNSTRUCTURED
PARADIGM SHIFT
SCHEMALESS DESIGN
FAST, very fast!
NOSQL

17. But most of the time, when
you think of Big Data…
THE CHALLENGES

18. … you just really need a
better infrastructure!
THE CHALLENGES

19. ANALYTICAL
DATABASES

20. SQL
Very FAST REads
GOOD OLD
Slower writes
SMALL LEARNING
ANALYTICAL DATABASES
CURVE

21. DO YOU
REALLY NEED
BIG DATA ?

22. REMEMBER to
ALWAYS
DO YOUR HOMEWORK FIRST!

23. And if you need help...
WE ARE
BIG DATA
experts

24. THANK YOU!
THE BIG DATA
challenge
André Simões
andre.simoes@xpand-it.com