SlideShare ist ein Scribd-Unternehmen logo
1 von 34
Downloaden Sie, um offline zu lesen
1!
Mining the Social Web for Fun & Profit Within Your Organization "
Prepared for Nashville Technology Breakfast (Lipscomb University Spark Center)!
April 8, 2014!
Matthew A. Russell (Chief Technology Officer @ Digital Reasoning)!
Twitter: @ptwobrussell & @dreasoning!
!
2!
Get these slides @!
Slideshare.net/dreasoning!
Overview!
•  Intro
•  Mining the Social Web
•  “Know thy data…”
•  “…and know thyself.”
•  Q&A
3!
INTRO!
4!
Hello, My Name Is ... Matthew!
•  Background in Computer Science
•  Data mining, AI, machine learning, etc.
•  CTO @ Digital Reasoning Systems
•  Moving toward cognitive computing
•  Author
•  5 published books on technology (just for fun)
•  CrossFit, triathlon, Bikram hot yoga
•  Stress management
5!
6  
Engineered to reveal critically important information, regardless of the data set size
or type, while delivering true analytics based on machine learning: designed to
adapt to changing data, behaviors, relationships and risks
Making Human Communication "
Viable for Data Science!
6!
The only easy day was yesterday.
-- Motto of the U.S. Navy SEALs
7!
It pays to be a winner.
-- Motto of the U.S. Navy SEALs
8!
Mining the Social Web!
9!
Data Exhaust => Digital Fingerprints!
•  World population: ~7B people
•  Facebook: 1.15B users
•  Twitter: 500M users
•  Google+ 343M users
•  LinkedIn: 238M users
•  ~200M+ blogs (conservative estimate)
10!
•  An interactive learning platform
•  An open source project
•  A (rewritten) book
•  http://MiningTheSocialWeb.com
Transforming Curiosity Into Insight!
11!
"Know thy data..."!
12!
If we have data, let’s look at data. If we have
opinions, let’s go with mine.
--Jim Barksdale
13!
In God we trust. All others must bring data.
--W. Edwards Deming
14!
Communication => Data!
•  Communication
•  Senders
•  humans & machines
•  Messages
•  natural language, images, videos, etc.
•  Recipients
•  humans & machines
15!
Data Alchemy!
•  Data: Documents & document fragments (text
messages, etc.)
•  Information: "Assertions", summaries, tags, etc.
•  Knowledge: Aggregated, query-able information
•  Wisdom: “Compressed” knowledge
•  Gold: Money
16!
Social Media Strategy v1!
•  Spread marketing messages
•  Find new customers
•  Implement proactive customer service
•  Keep existing customers
•  Follow Best Practices
•  Keep messages relevant and regular
•  Know the best times of day to tweet, post, etc.
•  Include photos as often as possible
17!
Social Media Strategy v2!
•  Data Mining Processes
•  Really understand your team, customers, and
competitors
•  Proactively recruit (and retain) employees
•  Reward your “most valuable customers”
•  Intelligent recommendations with targeted ads
(offline ó online)
•  “Big Understanding”
18!
Data Mining = Curiosity + Stats!
•  Curiosity
•  Interests, desires, and intuitions
•  Statistics
•  Counting, comparing, filtering, and ranking
•  How to do it
•  Blindly interrogate your data
•  How to do it well
•  Thoughtfully interrogate the right data
19!
Machine Learning!
•  A program that learns (improves)
from experience (data)
according to some objective
•  Supervised learning
•  Unsupervised learning
•  Reinforcement learning
•  How to do it
•  Program mathematical
models that leverage data
and hope for the best...
•  How to do it well
•  Program state-of-the-art
mathematical models with
sufficient representative data
20!
co-ref
co-reference
co-reference
Co-reference
co-reference
address
business
Phone
number
*2012-08-23
*40.002498,-75.118033
Introducing Synthesys "
(Think: Structuring Unstructured Data)!
Person 1: Mathew Russell
Person 2: Robert Metcalf
Type: Meeting
Location: 730 Cool Springs Blvd, Suite 100
Franklin, TN 37207
Date: Aug. 23, 2012*
Time: Unknown
Event Details
  
Associated Entities
Temporal Reasoning
Geospatial Reasoning
Complex Event Detection
Entities Related to Concept
Colleagues
21!
Any sufficiently advanced technology is
indistinguishable from magic.
--Arthur C. Clarke
22!
Knowledge is a process of piling up facts;
wisdom lies in their simplification.
--Martin Fischer
23!
"...and know thyself"!
24!
Is Privacy Already an Illusion?!
•  Digital happenings circa 2014
•  The Cloud
•  Social Media
•  Deep Learning
•  The Internet of Things
•  Internet.org
25!
If you have something that you
don’t want anyone to know,
maybe you shouldn’t be doing it
in the first place.
-- Eric Schmidt, (former) CEO of Google
26!
Civilization is the progress toward
a society of privacy.
--Ayn Rand
27!
Influences on Ethics!
•  Capitalism, economics, & marketing
•  Fiduciary duty: Maximize the common stock’s value
•  How to do it? By transacting commerce
•  How do it well? Good advertisements
•  How to do it really well? Highly personalized ads
•  Terms of Service (ToS) - The legal extent of ethical
obligations?
28!
If you're not paying for the product, you
are the product.
-- Savvy consumers everywhere one day (?)
29!
For the wisdom of this world is
foolishness...
-- Saint Paul
30!
The Future of the Web...!
•  The Blue Pill: Consumer data stored/controlled by a few
of the world's most powerful international corporations
•  The Red Pill: Consumer data returns to the edge of the
network in a distributed/decentralized cloud
•  The Purple Pill: Find a set of common values and
gravitate toward the middle
•  Legislative reforms for consumer protection
•  Consumer education & advocacy
•  “Don’t Be Evil” “Do the right thing”
31!
The real danger is the gradual erosion of
individual liberties through automation,
integration, and interconnection of many
small, separate record-keeping systems,
each of which alone may seem innocuous,
even benevolent, and wholly justifiable.
-- Anonymous (U. S. Privacy Study Commission, 1977)
32!
.  
There are two primary choices in life:
to accept conditions as they exist,
or accept the responsibility for
changing them.
-- Dennis Waitley
33!
Q&A!
34!

Weitere ähnliche Inhalte

Was ist angesagt?

Intro to Data Science
Intro to Data ScienceIntro to Data Science
Intro to Data ScienceTJ Stalcup
 
Ethics in Data Science and Machine Learning
Ethics in Data Science and Machine LearningEthics in Data Science and Machine Learning
Ethics in Data Science and Machine LearningHJ van Veen
 
Dark data by Worapol Alex Pongpech
Dark data by Worapol Alex PongpechDark data by Worapol Alex Pongpech
Dark data by Worapol Alex PongpechBAINIDA
 
Data Culture Series - Keynote & Panel - Birmingham - 8th April 2015
Data Culture Series  - Keynote & Panel - Birmingham - 8th April 2015Data Culture Series  - Keynote & Panel - Birmingham - 8th April 2015
Data Culture Series - Keynote & Panel - Birmingham - 8th April 2015Jonathan Woodward
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science TJ Stalcup
 
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...Connected Data World
 
Big Data Content Organization, Discovery, and Management
Big Data Content Organization, Discovery, and ManagementBig Data Content Organization, Discovery, and Management
Big Data Content Organization, Discovery, and ManagementAccess Innovations, Inc.
 
Open data + open government open goodness
Open data + open government open goodnessOpen data + open government open goodness
Open data + open government open goodnessPhase2
 
Miranda Marcus – Data and ethics
Miranda Marcus – Data and ethicsMiranda Marcus – Data and ethics
Miranda Marcus – Data and ethicsNEXTConference
 
Data mining with big data implementation
Data mining with big data implementationData mining with big data implementation
Data mining with big data implementationSandip Tipayle Patil
 
The dawn of big data
The dawn of big dataThe dawn of big data
The dawn of big dataNeal Hannon
 
Graphs in Government
Graphs in GovernmentGraphs in Government
Graphs in GovernmentNeo4j
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolutionitnewsafrica
 
Big Data Analytics for Dodd-Frank
Big Data Analytics for Dodd-FrankBig Data Analytics for Dodd-Frank
Big Data Analytics for Dodd-FrankDataWorks Summit
 
Mining Big Data in Real Time
Mining Big Data in Real TimeMining Big Data in Real Time
Mining Big Data in Real TimeAlbert Bifet
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationDoug Denton
 
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...BigMine
 

Was ist angesagt? (20)

Intro to Data Science
Intro to Data ScienceIntro to Data Science
Intro to Data Science
 
Ethics in Data Science and Machine Learning
Ethics in Data Science and Machine LearningEthics in Data Science and Machine Learning
Ethics in Data Science and Machine Learning
 
Dark data by Worapol Alex Pongpech
Dark data by Worapol Alex PongpechDark data by Worapol Alex Pongpech
Dark data by Worapol Alex Pongpech
 
Big Data World
Big Data WorldBig Data World
Big Data World
 
Data Culture Series - Keynote & Panel - Birmingham - 8th April 2015
Data Culture Series  - Keynote & Panel - Birmingham - 8th April 2015Data Culture Series  - Keynote & Panel - Birmingham - 8th April 2015
Data Culture Series - Keynote & Panel - Birmingham - 8th April 2015
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science
 
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...
Κnowledge Architecture: Combining Strategy, Data Science and Information Arch...
 
Big Data Content Organization, Discovery, and Management
Big Data Content Organization, Discovery, and ManagementBig Data Content Organization, Discovery, and Management
Big Data Content Organization, Discovery, and Management
 
Open data + open government open goodness
Open data + open government open goodnessOpen data + open government open goodness
Open data + open government open goodness
 
Miranda Marcus – Data and ethics
Miranda Marcus – Data and ethicsMiranda Marcus – Data and ethics
Miranda Marcus – Data and ethics
 
Data mining with big data implementation
Data mining with big data implementationData mining with big data implementation
Data mining with big data implementation
 
Big Data 101
Big Data 101Big Data 101
Big Data 101
 
The dawn of big data
The dawn of big dataThe dawn of big data
The dawn of big data
 
Graphs in Government
Graphs in GovernmentGraphs in Government
Graphs in Government
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
 
Big Data Analytics for Dodd-Frank
Big Data Analytics for Dodd-FrankBig Data Analytics for Dodd-Frank
Big Data Analytics for Dodd-Frank
 
Open data
Open dataOpen data
Open data
 
Mining Big Data in Real Time
Mining Big Data in Real TimeMining Big Data in Real Time
Mining Big Data in Real Time
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentation
 
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...
Challenging Problems for Scalable Mining of Heterogeneous Social and Informat...
 

Andere mochten auch

Unleashing twitter data for fun and insight
Unleashing twitter data for fun and insightUnleashing twitter data for fun and insight
Unleashing twitter data for fun and insightDigital Reasoning
 
Mining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMatthew Russell
 
Privacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebPrivacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebMatthew Russell
 
Mining Social Web APIs with IPython Notebook (PyCon 2014)
Mining Social Web APIs with IPython Notebook (PyCon 2014)Mining Social Web APIs with IPython Notebook (PyCon 2014)
Mining Social Web APIs with IPython Notebook (PyCon 2014)Matthew Russell
 
Mining the Geo Needles in the Social Haystack
Mining the Geo Needles in the Social HaystackMining the Geo Needles in the Social Haystack
Mining the Geo Needles in the Social HaystackMatthew Russell
 
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)Matthew Russell
 

Andere mochten auch (7)

How to Build a Tech Team
How to Build a Tech TeamHow to Build a Tech Team
How to Build a Tech Team
 
Unleashing twitter data for fun and insight
Unleashing twitter data for fun and insightUnleashing twitter data for fun and insight
Unleashing twitter data for fun and insight
 
Mining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started GuideMining the Social Web for Fun and Profit: A Getting Started Guide
Mining the Social Web for Fun and Profit: A Getting Started Guide
 
Privacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social WebPrivacy, Ethics, and Future Uses of the Social Web
Privacy, Ethics, and Future Uses of the Social Web
 
Mining Social Web APIs with IPython Notebook (PyCon 2014)
Mining Social Web APIs with IPython Notebook (PyCon 2014)Mining Social Web APIs with IPython Notebook (PyCon 2014)
Mining Social Web APIs with IPython Notebook (PyCon 2014)
 
Mining the Geo Needles in the Social Haystack
Mining the Geo Needles in the Social HaystackMining the Geo Needles in the Social Haystack
Mining the Geo Needles in the Social Haystack
 
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
Mining Social Web APIs with IPython Notebook (Data Day Texas 2015)
 

Ähnlich wie Mining the Social Web for Fun & Profit Within Your Organization

Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Thinkful
 
Getting Started in Data Science
Getting Started in Data ScienceGetting Started in Data Science
Getting Started in Data ScienceThinkful
 
Getting started in Data Science (April 2017, Los Angeles)
Getting started in Data Science (April 2017, Los Angeles)Getting started in Data Science (April 2017, Los Angeles)
Getting started in Data Science (April 2017, Los Angeles)Thinkful
 
Presentacion pp 16 9 - tech summit 2015 (ecco)
Presentacion pp 16 9 - tech summit 2015 (ecco)Presentacion pp 16 9 - tech summit 2015 (ecco)
Presentacion pp 16 9 - tech summit 2015 (ecco)PPDPR
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptxAkhirulAminulloh2
 
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...Cartegraph
 
Grow Your Own - How to Create a Data Culture at Your Organization
Grow Your Own - How to Create a Data Culture at Your OrganizationGrow Your Own - How to Create a Data Culture at Your Organization
Grow Your Own - How to Create a Data Culture at Your OrganizationLuciano Pesci, PhD
 
Data Economy: Lessons learned and the Road ahead!
Data Economy: Lessons learned and the Road ahead!Data Economy: Lessons learned and the Road ahead!
Data Economy: Lessons learned and the Road ahead!Ahmet Bulut
 
Getting started in data science (4:3)
Getting started in data science (4:3)Getting started in data science (4:3)
Getting started in data science (4:3)Thinkful
 
Getting started in data science (4:3)
Getting started in data science (4:3)Getting started in data science (4:3)
Getting started in data science (4:3)Thinkful
 
Big Data Australian Vendor Review
Big Data Australian Vendor ReviewBig Data Australian Vendor Review
Big Data Australian Vendor ReviewKINSHIP digital
 
Generating Big Value from Big Data
Generating Big Value from Big DataGenerating Big Value from Big Data
Generating Big Value from Big DataBrendan Aldrich
 
Ethics and UX IxDA Berlin 2018
Ethics and UX IxDA Berlin 2018Ethics and UX IxDA Berlin 2018
Ethics and UX IxDA Berlin 2018Eric Reiss
 
The power of Structured Journalism & Hacker Culture in NPR
The power of Structured Journalism & Hacker Culture in NPRThe power of Structured Journalism & Hacker Culture in NPR
The power of Structured Journalism & Hacker Culture in NPRPoderomedia
 
CIL Stats Workshop April1 2022 Abram Silk.pdf
CIL Stats Workshop April1 2022 Abram Silk.pdfCIL Stats Workshop April1 2022 Abram Silk.pdf
CIL Stats Workshop April1 2022 Abram Silk.pdfStephen Abram
 
130220 how to_search_online_to_validate_a_business_opportunity.pptx
130220 how to_search_online_to_validate_a_business_opportunity.pptx130220 how to_search_online_to_validate_a_business_opportunity.pptx
130220 how to_search_online_to_validate_a_business_opportunity.pptxAmaury de Buchet
 
Giancarlos Gonzalez @ Tech Summit PR 2015
Giancarlos Gonzalez @ Tech Summit PR 2015Giancarlos Gonzalez @ Tech Summit PR 2015
Giancarlos Gonzalez @ Tech Summit PR 2015Tech Summit PR 2014
 
Ethics and ux ux sofia nov 2018
Ethics and ux ux sofia nov 2018Ethics and ux ux sofia nov 2018
Ethics and ux ux sofia nov 2018Eric Reiss
 

Ähnlich wie Mining the Social Web for Fun & Profit Within Your Organization (20)

Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)
 
Getting Started in Data Science
Getting Started in Data ScienceGetting Started in Data Science
Getting Started in Data Science
 
Getting started in Data Science (April 2017, Los Angeles)
Getting started in Data Science (April 2017, Los Angeles)Getting started in Data Science (April 2017, Los Angeles)
Getting started in Data Science (April 2017, Los Angeles)
 
Presentacion pp 16 9 - tech summit 2015 (ecco)
Presentacion pp 16 9 - tech summit 2015 (ecco)Presentacion pp 16 9 - tech summit 2015 (ecco)
Presentacion pp 16 9 - tech summit 2015 (ecco)
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptx
 
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...
Loras College 2014 Business Analytics Symposium | Gebhard Rainer: Building a ...
 
Grow Your Own - How to Create a Data Culture at Your Organization
Grow Your Own - How to Create a Data Culture at Your OrganizationGrow Your Own - How to Create a Data Culture at Your Organization
Grow Your Own - How to Create a Data Culture at Your Organization
 
Big data
Big dataBig data
Big data
 
Data Economy: Lessons learned and the Road ahead!
Data Economy: Lessons learned and the Road ahead!Data Economy: Lessons learned and the Road ahead!
Data Economy: Lessons learned and the Road ahead!
 
Getting started in data science (4:3)
Getting started in data science (4:3)Getting started in data science (4:3)
Getting started in data science (4:3)
 
Getting started in data science (4:3)
Getting started in data science (4:3)Getting started in data science (4:3)
Getting started in data science (4:3)
 
Mining Social Data
Mining Social DataMining Social Data
Mining Social Data
 
Big Data Australian Vendor Review
Big Data Australian Vendor ReviewBig Data Australian Vendor Review
Big Data Australian Vendor Review
 
Generating Big Value from Big Data
Generating Big Value from Big DataGenerating Big Value from Big Data
Generating Big Value from Big Data
 
Ethics and UX IxDA Berlin 2018
Ethics and UX IxDA Berlin 2018Ethics and UX IxDA Berlin 2018
Ethics and UX IxDA Berlin 2018
 
The power of Structured Journalism & Hacker Culture in NPR
The power of Structured Journalism & Hacker Culture in NPRThe power of Structured Journalism & Hacker Culture in NPR
The power of Structured Journalism & Hacker Culture in NPR
 
CIL Stats Workshop April1 2022 Abram Silk.pdf
CIL Stats Workshop April1 2022 Abram Silk.pdfCIL Stats Workshop April1 2022 Abram Silk.pdf
CIL Stats Workshop April1 2022 Abram Silk.pdf
 
130220 how to_search_online_to_validate_a_business_opportunity.pptx
130220 how to_search_online_to_validate_a_business_opportunity.pptx130220 how to_search_online_to_validate_a_business_opportunity.pptx
130220 how to_search_online_to_validate_a_business_opportunity.pptx
 
Giancarlos Gonzalez @ Tech Summit PR 2015
Giancarlos Gonzalez @ Tech Summit PR 2015Giancarlos Gonzalez @ Tech Summit PR 2015
Giancarlos Gonzalez @ Tech Summit PR 2015
 
Ethics and ux ux sofia nov 2018
Ethics and ux ux sofia nov 2018Ethics and ux ux sofia nov 2018
Ethics and ux ux sofia nov 2018
 

Mining the Social Web for Fun & Profit Within Your Organization

  • 1. 1! Mining the Social Web for Fun & Profit Within Your Organization " Prepared for Nashville Technology Breakfast (Lipscomb University Spark Center)! April 8, 2014! Matthew A. Russell (Chief Technology Officer @ Digital Reasoning)! Twitter: @ptwobrussell & @dreasoning! !
  • 2. 2! Get these slides @! Slideshare.net/dreasoning!
  • 3. Overview! •  Intro •  Mining the Social Web •  “Know thy data…” •  “…and know thyself.” •  Q&A 3!
  • 5. Hello, My Name Is ... Matthew! •  Background in Computer Science •  Data mining, AI, machine learning, etc. •  CTO @ Digital Reasoning Systems •  Moving toward cognitive computing •  Author •  5 published books on technology (just for fun) •  CrossFit, triathlon, Bikram hot yoga •  Stress management 5!
  • 6. 6   Engineered to reveal critically important information, regardless of the data set size or type, while delivering true analytics based on machine learning: designed to adapt to changing data, behaviors, relationships and risks Making Human Communication " Viable for Data Science! 6!
  • 7. The only easy day was yesterday. -- Motto of the U.S. Navy SEALs 7!
  • 8. It pays to be a winner. -- Motto of the U.S. Navy SEALs 8!
  • 10. Data Exhaust => Digital Fingerprints! •  World population: ~7B people •  Facebook: 1.15B users •  Twitter: 500M users •  Google+ 343M users •  LinkedIn: 238M users •  ~200M+ blogs (conservative estimate) 10!
  • 11. •  An interactive learning platform •  An open source project •  A (rewritten) book •  http://MiningTheSocialWeb.com Transforming Curiosity Into Insight! 11!
  • 13. If we have data, let’s look at data. If we have opinions, let’s go with mine. --Jim Barksdale 13!
  • 14. In God we trust. All others must bring data. --W. Edwards Deming 14!
  • 15. Communication => Data! •  Communication •  Senders •  humans & machines •  Messages •  natural language, images, videos, etc. •  Recipients •  humans & machines 15!
  • 16. Data Alchemy! •  Data: Documents & document fragments (text messages, etc.) •  Information: "Assertions", summaries, tags, etc. •  Knowledge: Aggregated, query-able information •  Wisdom: “Compressed” knowledge •  Gold: Money 16!
  • 17. Social Media Strategy v1! •  Spread marketing messages •  Find new customers •  Implement proactive customer service •  Keep existing customers •  Follow Best Practices •  Keep messages relevant and regular •  Know the best times of day to tweet, post, etc. •  Include photos as often as possible 17!
  • 18. Social Media Strategy v2! •  Data Mining Processes •  Really understand your team, customers, and competitors •  Proactively recruit (and retain) employees •  Reward your “most valuable customers” •  Intelligent recommendations with targeted ads (offline ó online) •  “Big Understanding” 18!
  • 19. Data Mining = Curiosity + Stats! •  Curiosity •  Interests, desires, and intuitions •  Statistics •  Counting, comparing, filtering, and ranking •  How to do it •  Blindly interrogate your data •  How to do it well •  Thoughtfully interrogate the right data 19!
  • 20. Machine Learning! •  A program that learns (improves) from experience (data) according to some objective •  Supervised learning •  Unsupervised learning •  Reinforcement learning •  How to do it •  Program mathematical models that leverage data and hope for the best... •  How to do it well •  Program state-of-the-art mathematical models with sufficient representative data 20!
  • 21. co-ref co-reference co-reference Co-reference co-reference address business Phone number *2012-08-23 *40.002498,-75.118033 Introducing Synthesys " (Think: Structuring Unstructured Data)! Person 1: Mathew Russell Person 2: Robert Metcalf Type: Meeting Location: 730 Cool Springs Blvd, Suite 100 Franklin, TN 37207 Date: Aug. 23, 2012* Time: Unknown Event Details   Associated Entities Temporal Reasoning Geospatial Reasoning Complex Event Detection Entities Related to Concept Colleagues 21!
  • 22. Any sufficiently advanced technology is indistinguishable from magic. --Arthur C. Clarke 22!
  • 23. Knowledge is a process of piling up facts; wisdom lies in their simplification. --Martin Fischer 23!
  • 25. Is Privacy Already an Illusion?! •  Digital happenings circa 2014 •  The Cloud •  Social Media •  Deep Learning •  The Internet of Things •  Internet.org 25!
  • 26. If you have something that you don’t want anyone to know, maybe you shouldn’t be doing it in the first place. -- Eric Schmidt, (former) CEO of Google 26!
  • 27. Civilization is the progress toward a society of privacy. --Ayn Rand 27!
  • 28. Influences on Ethics! •  Capitalism, economics, & marketing •  Fiduciary duty: Maximize the common stock’s value •  How to do it? By transacting commerce •  How do it well? Good advertisements •  How to do it really well? Highly personalized ads •  Terms of Service (ToS) - The legal extent of ethical obligations? 28!
  • 29. If you're not paying for the product, you are the product. -- Savvy consumers everywhere one day (?) 29!
  • 30. For the wisdom of this world is foolishness... -- Saint Paul 30!
  • 31. The Future of the Web...! •  The Blue Pill: Consumer data stored/controlled by a few of the world's most powerful international corporations •  The Red Pill: Consumer data returns to the edge of the network in a distributed/decentralized cloud •  The Purple Pill: Find a set of common values and gravitate toward the middle •  Legislative reforms for consumer protection •  Consumer education & advocacy •  “Don’t Be Evil” “Do the right thing” 31!
  • 32. The real danger is the gradual erosion of individual liberties through automation, integration, and interconnection of many small, separate record-keeping systems, each of which alone may seem innocuous, even benevolent, and wholly justifiable. -- Anonymous (U. S. Privacy Study Commission, 1977) 32!
  • 33. .   There are two primary choices in life: to accept conditions as they exist, or accept the responsibility for changing them. -- Dennis Waitley 33!