SlideShare ist ein Scribd-Unternehmen logo
1 von 87
THE BIG DATA CON
Why Big Data is a Problem Not a Solution



           #TheBigDataCon
IAN PLOSKER
Director, Technical Operations, EMEA
          Basho Technologies
           @dstroyallmodels
WHO IS




basho
   ?
WE MAKE
DISCLAIMERS
ALL OPINIONS EXPRESSED HEREIN
ARE MY OWN AND NOT THOSE OF
 MY EMPLOYER OR ANYONE ELSE
I’M NOT TROLLING
I’M NOT FUD RAKING
WELL, MAYBE JUST A LITTLE
          BIT
LET’S GET STARTED
WHAT IS BIG DATA?
HOW BIG IS BIG?
GIGABYTES, TERABYTES,
PETABYTES, EXABYTES?
IF THERE’S BIG DATA,
SHOULDN’T THERE ALSO BE
MEDIUM AND SMALL DATA
BIG DATA IS MORE DATA
THAN YOU KNOW WHAT TO
        DO WITH
BIG DATA IS THE DATA THAT
YOU DON’T KNOW WHAT TO
         DO WITH
THE PROMISE OF BIG DATA
IS TO STORE THE REAMS
YOU DON’T KNOW HOW TO
          USE
SO YOU CAN EXTRACT
VALUE FROM IT IN THE
      FUTURE
LET’S BE HONEST
THE PEOPLE WHO ARE
MAKING MONEY OFF OF BIG
         DATA
ARE THE PEOPLE
EXTRACTING VALUE FROM IT
         TODAY
I.E. THE PEOPLE SELLING BIG
      DATA SOLUTIONS
EVERYONE AND THEIR
GRANDMA ARE TRYING TO
 GET IN ON THE ACTION
VENDORS ARE REPACKAGING
   THE SAME OLD THING
AND TRYING TO TRICK US
INTO THINKING ITS THE NEW
         HOTNESS
LET’S NOT BE FOOLED BY
       MARKETING
WORDS ARE IMPORTANT
MARKETING WORKS TO
SEPARATE WORDS FROM
    THEIR MEANING
FROM THEIR ORIGINAL
      INTENT
TO GET YOU TO ASSOCIATE
        WORDS
WITH PARTICULAR
PRODUCTS
BRANDS
AND VENDORS
</RANT>
LET’S TRY TO IMPROVE THE
  STATE OF DISCOURSE
SO LET’S BRING SOME NEW
CATCHPHRASES TO THE TABLE
SO WE DON’T HAVE TO TALK
ABOUT BIG DATA ANYMORE
INSTEAD LET’S TALK ABOUT
     CRITICAL DATA
WHAT IS CRITICAL DATA?
Is your data really
    that critical,
       dude?
IT’S MISSION CRITICAL DATA
IT’S DATA WHOSE
 UNAVAILABILITY
COSTS YOU MONEY
CRED
OR LIVES
IT IS THE DATA NEEDED NOW
NOT AT SOME DISTANT
POINT IN THE FUTURE
IT IS THE DATA THAT YOU
YOUR CUSTOMERS
OR SOCIETY
CAN CAPITALIZE ON TODAY
ITS VALUE IS CAPTURED BY
THE OWNERS OF THE DATA
RATHER THAN A THIRD PARTY
HOW DO YOU IDENTIFY
 YOUR CRITICAL DATA?
LATENCY AT SOME MARGIN
    APPEARS SIMPLY AS
     UNAVAILABILITY
Who cares about latency?




Sometimes high latency looks like an outage
             to the end user.
FOR AMAZON:
       100MS LATENCY
    DECREASES SALES BY 1%


Source: http://sites.google.com/site/glinden/Home/StanfordDataMining.2006-11-28.ppt
FOR GOOGLE:
    A 500MS INCREASE IN LATENCY
          REDUCED TRAFFIC
           BY 20 PERCENT



Source: http://sites.google.com/site/glinden/Home/StanfordDataMining.2006-11-28.ppt
WHAT DOES A SYSTEM FOR
CRITICAL DATA LOOK LIKE?
STREAMING PROCESSING
STORM
RIAK_PIPE
EXAMPLES OF DYNAMO
      SYSTEMS
VOLDEMORT
THESE SYSTEMS SACRIFICE
 CONSISTENCY FOR HIGH
AVAILABILITY/LOW LATENCY
I'M NOT MAKING A SALES
         PITCH
DON'T USE MY DATABASE
SERIOUSLY, DON'T
UNLESS
YOU ARE WILLING TO
    SACRIFICE
FAMILIAR DATA AND QUERY
         MODELS
FAMILIAR HIRING PATTERNS
KNOWN OPERATIONAL
     ISSUES
FOR
PREDICTABLE LATENCY
AVAILABILITY
PREDICTABLE OPERATIONS
OR IF DATA UNAVAILABILITY
 COSTS YOU $$$ OR MORE
THANKS
ian@basho.com

  @dstroyallmodels

github.com/ian-plosker

Weitere ähnliche Inhalte

Ähnlich wie The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker

Scott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fitScott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fit
betterbigdata
 
Big data big_ruse
Big data big_ruseBig data big_ruse
Big data big_ruse
shoshi107
 

Ähnlich wie The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker (20)

Scott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fitScott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fit
 
ie - presentation Application Master
ie - presentation Application Masterie - presentation Application Master
ie - presentation Application Master
 
Data is the New Gold
Data is the New GoldData is the New Gold
Data is the New Gold
 
Big data big_ruse
Big data big_ruseBig data big_ruse
Big data big_ruse
 
WiDS - Unleashing the promises of big data
WiDS - Unleashing the promises of big dataWiDS - Unleashing the promises of big data
WiDS - Unleashing the promises of big data
 
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths NowWant a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
 
Big Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? DefinitelyBig Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? Definitely
 
Big Data for the Retail Business I Swan Insights I Solvay Business School
Big Data for the Retail Business I Swan Insights I Solvay Business SchoolBig Data for the Retail Business I Swan Insights I Solvay Business School
Big Data for the Retail Business I Swan Insights I Solvay Business School
 
All About the Data and How to Use It
All About the Data and How to Use ItAll About the Data and How to Use It
All About the Data and How to Use It
 
Big data-analytics-ebook
Big data-analytics-ebookBig data-analytics-ebook
Big data-analytics-ebook
 
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku -  Big data paris 2015 - A Hybrid Platform, a Hybrid Team Dataiku -  Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
 
Suburbia Sales Booklet (2019)
Suburbia Sales Booklet (2019)Suburbia Sales Booklet (2019)
Suburbia Sales Booklet (2019)
 
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
 
What do we do with all this big
What do we do with all this big What do we do with all this big
What do we do with all this big
 
Bidata
BidataBidata
Bidata
 
MindSEO Pitch [EN - 2017]
MindSEO Pitch [EN - 2017]MindSEO Pitch [EN - 2017]
MindSEO Pitch [EN - 2017]
 
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
 
The Myths of Big Data
The Myths of Big DataThe Myths of Big Data
The Myths of Big Data
 
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
 
AWS Transformation Day - Minneapolis 2018
AWS Transformation Day - Minneapolis 2018AWS Transformation Day - Minneapolis 2018
AWS Transformation Day - Minneapolis 2018
 

Mehr von JAX London

Everything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexityEverything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexity
JAX London
 

Mehr von JAX London (20)

Everything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexityEverything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexity
 
Devops with the S for Sharing - Patrick Debois
Devops with the S for Sharing - Patrick DeboisDevops with the S for Sharing - Patrick Debois
Devops with the S for Sharing - Patrick Debois
 
Busy Developer's Guide to Windows 8 HTML/JavaScript Apps
Busy Developer's Guide to Windows 8 HTML/JavaScript AppsBusy Developer's Guide to Windows 8 HTML/JavaScript Apps
Busy Developer's Guide to Windows 8 HTML/JavaScript Apps
 
It's code but not as we know: Infrastructure as Code - Patrick Debois
It's code but not as we know: Infrastructure as Code - Patrick DeboisIt's code but not as we know: Infrastructure as Code - Patrick Debois
It's code but not as we know: Infrastructure as Code - Patrick Debois
 
Locks? We Don't Need No Stinkin' Locks - Michael Barker
Locks? We Don't Need No Stinkin' Locks - Michael BarkerLocks? We Don't Need No Stinkin' Locks - Michael Barker
Locks? We Don't Need No Stinkin' Locks - Michael Barker
 
Worse is better, for better or for worse - Kevlin Henney
Worse is better, for better or for worse - Kevlin HenneyWorse is better, for better or for worse - Kevlin Henney
Worse is better, for better or for worse - Kevlin Henney
 
Java performance: What's the big deal? - Trisha Gee
Java performance: What's the big deal? - Trisha GeeJava performance: What's the big deal? - Trisha Gee
Java performance: What's the big deal? - Trisha Gee
 
Clojure made-simple - John Stevenson
Clojure made-simple - John StevensonClojure made-simple - John Stevenson
Clojure made-simple - John Stevenson
 
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias WessendorfHTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
 
Play framework 2 : Peter Hilton
Play framework 2 : Peter HiltonPlay framework 2 : Peter Hilton
Play framework 2 : Peter Hilton
 
Complexity theory and software development : Tim Berglund
Complexity theory and software development : Tim BerglundComplexity theory and software development : Tim Berglund
Complexity theory and software development : Tim Berglund
 
Why FLOSS is a Java developer's best friend: Dave Gruber
Why FLOSS is a Java developer's best friend: Dave GruberWhy FLOSS is a Java developer's best friend: Dave Gruber
Why FLOSS is a Java developer's best friend: Dave Gruber
 
Akka in Action: Heiko Seeburger
Akka in Action: Heiko SeeburgerAkka in Action: Heiko Seeburger
Akka in Action: Heiko Seeburger
 
NoSQL Smackdown 2012 : Tim Berglund
NoSQL Smackdown 2012 : Tim BerglundNoSQL Smackdown 2012 : Tim Berglund
NoSQL Smackdown 2012 : Tim Berglund
 
Closures, the next "Big Thing" in Java: Russel Winder
Closures, the next "Big Thing" in Java: Russel WinderClosures, the next "Big Thing" in Java: Russel Winder
Closures, the next "Big Thing" in Java: Russel Winder
 
Java and the machine - Martijn Verburg and Kirk Pepperdine
Java and the machine - Martijn Verburg and Kirk PepperdineJava and the machine - Martijn Verburg and Kirk Pepperdine
Java and the machine - Martijn Verburg and Kirk Pepperdine
 
Mongo DB on the JVM - Brendan McAdams
Mongo DB on the JVM - Brendan McAdamsMongo DB on the JVM - Brendan McAdams
Mongo DB on the JVM - Brendan McAdams
 
New opportunities for connected data - Ian Robinson
New opportunities for connected data - Ian RobinsonNew opportunities for connected data - Ian Robinson
New opportunities for connected data - Ian Robinson
 
HTML5 Websockets and Java - Arun Gupta
HTML5 Websockets and Java - Arun GuptaHTML5 Websockets and Java - Arun Gupta
HTML5 Websockets and Java - Arun Gupta
 
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
 

Kürzlich hochgeladen

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Kürzlich hochgeladen (20)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 

The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker