SlideShare ist ein Scribd-Unternehmen logo
1 von 8
Downloaden Sie, um offline zu lesen
Data Mining & Social Network Analysis
Eric Robson
Introduction

• What is Data Mining?
• How is it relevant to the
  mobile world?
• What can be discovered?
• Techniques and
  technologies used:
  –   Matrix and Network Theory
  –   Semantic Analysis
  –   Statistical Analysis
  –   Predictive Analytics
  –   Visualisation
TSSG & 3CS R&D

• Service Reporting
  – Data Warehousing: ETL,
    Star Schema;
• Service Analytics
  – Predictive Analytics:
    Classification, Clustering,
    Frequent Pattern Mining
• Service
  Recommendation
  – Passive Collaborative
    Filtering
A Case Study of our
           Industry Engagement
• Using Social Network Analysis in the
  Criminal Intelligence Domain
   – Internal Intelligence
       •   Land Registry
       •   Ports Authority
       •   Revenue
       •   Court Transcripts
   – Open Source Intelligence (OSINT)
       • Newspapers
       • Internet Forums
       • Social Networking Websites
• Uncover people and relationships
  previously unknown to the authorities.
• S.N.A. techniques to discover social
  patterns in criminal organisations.
TSSG & 3CS’s Near-Term R&D

• National
  – PADIE
     • Large scale Data Warehousing project for processing Data
  – Content Recommender
     • Content recommendation based on semantic analysis of
       reviews.
• European
  – Societies
     • Community Smart Spaces.
  – SNAP
     • Professional services social network. Dynamic relationships
       created based on semantic analysis of current situation.
TSSG and 3CS Long-Term R&D
          Roadmap
• Volume of Data increasing
   – ROI for data storage is increasing.
• Structured Data Vs Unstructured
   – Marketing
   – Identifying Key Product Influencers
• Context Enabled Services
   – Mobile based services
   – Location, Time, presence
• Data Privacy
   – Laws governing data privacy becoming increasingly strict
   – Public knowledge and understanding of privacy issues becoming
     more apparent.
Industry Predictions for
            2014
• Internet searching to be replaced by personal
  social networks.
• Changes to data protection and ownership laws.
      – Empowering people to manage their own
          data.
• Changes to privacy laws and expectations will
  completely change Social Networking Websites.
      – Privacy laws as a competitive weapon?
Contact


Eric Robson
Knowledge Discovery and Databases
TSSG, Waterford Institute of Technology
erobson@tssg.org
http://ie.linkedin.com/in/erobson
+353 51 302960 (w)

Weitere ähnliche Inhalte

Was ist angesagt?

Tensions between intellectual property and knowledge discovery in the digital...
Tensions between intellectual property and knowledge discovery in the digital...Tensions between intellectual property and knowledge discovery in the digital...
Tensions between intellectual property and knowledge discovery in the digital...LIBER Europe
 
POLE Investigations with Neo4j
POLE Investigations with Neo4jPOLE Investigations with Neo4j
POLE Investigations with Neo4jNeo4j
 
The impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesThe impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesCityPulse Project
 
Internet of Things: The story so far
Internet of Things: The story so farInternet of Things: The story so far
Internet of Things: The story so farPayamBarnaghi
 
20100417 Hover Bee Ar Dev Camp
20100417 Hover Bee Ar Dev Camp20100417 Hover Bee Ar Dev Camp
20100417 Hover Bee Ar Dev CampHans Overbeek
 
Information Governance: accentuating the positive, eliminating the negative
Information Governance: accentuating the positive, eliminating the negativeInformation Governance: accentuating the positive, eliminating the negative
Information Governance: accentuating the positive, eliminating the negativeHeather Jack
 
Synthesys Technical Overview
Synthesys Technical OverviewSynthesys Technical Overview
Synthesys Technical OverviewDigital Reasoning
 
Governance of Big Data
Governance of Big DataGovernance of Big Data
Governance of Big DataAlberto Asquer
 
Global identities for a global knowledge
Global identities for a global knowledgeGlobal identities for a global knowledge
Global identities for a global knowledgeCarlos Iglesias
 
Big Data & Analytics for Government - Case Studies
Big Data & Analytics for Government - Case StudiesBig Data & Analytics for Government - Case Studies
Big Data & Analytics for Government - Case StudiesJohn Palfreyman
 
Big data, new epistemologies and paradigm shifts
Big data, new epistemologies and paradigm shiftsBig data, new epistemologies and paradigm shifts
Big data, new epistemologies and paradigm shiftsrobkitchin
 
Data journalism in the second machine age
Data journalism in the second machine ageData journalism in the second machine age
Data journalism in the second machine ageAlexander Howard
 
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth)
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth) The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth)
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth) mysociety
 
Presentation at ICT4D Seminar at Computer Science Department, UCT
Presentation at ICT4D Seminar at Computer Science Department, UCT Presentation at ICT4D Seminar at Computer Science Department, UCT
Presentation at ICT4D Seminar at Computer Science Department, UCT Mariya Badeva-Bright
 
Citizen centric approaches to Social Media analysis (CaSMa)
Citizen centric approaches to Social Media analysis (CaSMa)Citizen centric approaches to Social Media analysis (CaSMa)
Citizen centric approaches to Social Media analysis (CaSMa)Ansgar Koene
 
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Spring
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information SpringESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Spring
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Springeswcsummerschool
 

Was ist angesagt? (20)

Tensions between intellectual property and knowledge discovery in the digital...
Tensions between intellectual property and knowledge discovery in the digital...Tensions between intellectual property and knowledge discovery in the digital...
Tensions between intellectual property and knowledge discovery in the digital...
 
POLE Investigations with Neo4j
POLE Investigations with Neo4jPOLE Investigations with Neo4j
POLE Investigations with Neo4j
 
The impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart citiesThe impact of Big Data on next generation of smart cities
The impact of Big Data on next generation of smart cities
 
Internet of Things: The story so far
Internet of Things: The story so farInternet of Things: The story so far
Internet of Things: The story so far
 
Open Data in Half a Day
Open Data in Half a DayOpen Data in Half a Day
Open Data in Half a Day
 
20100417 Hover Bee Ar Dev Camp
20100417 Hover Bee Ar Dev Camp20100417 Hover Bee Ar Dev Camp
20100417 Hover Bee Ar Dev Camp
 
Big Data
Big Data Big Data
Big Data
 
Information Governance: accentuating the positive, eliminating the negative
Information Governance: accentuating the positive, eliminating the negativeInformation Governance: accentuating the positive, eliminating the negative
Information Governance: accentuating the positive, eliminating the negative
 
Neil Fraser
Neil FraserNeil Fraser
Neil Fraser
 
Synthesys Technical Overview
Synthesys Technical OverviewSynthesys Technical Overview
Synthesys Technical Overview
 
Governance of Big Data
Governance of Big DataGovernance of Big Data
Governance of Big Data
 
Global identities for a global knowledge
Global identities for a global knowledgeGlobal identities for a global knowledge
Global identities for a global knowledge
 
Big Data & Analytics for Government - Case Studies
Big Data & Analytics for Government - Case StudiesBig Data & Analytics for Government - Case Studies
Big Data & Analytics for Government - Case Studies
 
Big data, new epistemologies and paradigm shifts
Big data, new epistemologies and paradigm shiftsBig data, new epistemologies and paradigm shifts
Big data, new epistemologies and paradigm shifts
 
Data journalism in the second machine age
Data journalism in the second machine ageData journalism in the second machine age
Data journalism in the second machine age
 
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth)
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth) The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth)
The Impacts of PopVote in Hong Kong - Virgile Deville (Democracy Earth)
 
Big Data
Big DataBig Data
Big Data
 
Presentation at ICT4D Seminar at Computer Science Department, UCT
Presentation at ICT4D Seminar at Computer Science Department, UCT Presentation at ICT4D Seminar at Computer Science Department, UCT
Presentation at ICT4D Seminar at Computer Science Department, UCT
 
Citizen centric approaches to Social Media analysis (CaSMa)
Citizen centric approaches to Social Media analysis (CaSMa)Citizen centric approaches to Social Media analysis (CaSMa)
Citizen centric approaches to Social Media analysis (CaSMa)
 
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Spring
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information SpringESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Spring
ESWC SS 2013 - Wednesday Keynote Kieron O'hara: The Information Spring
 

Ähnlich wie 6. FOMS _Data Mining_ Analysis_ Eric Robson

SoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningSoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningResearch Data Alliance
 
Data Mining and Big Data Challenges and Research Opportunities
Data Mining and Big Data Challenges and Research OpportunitiesData Mining and Big Data Challenges and Research Opportunities
Data Mining and Big Data Challenges and Research OpportunitiesKathirvel Ayyaswamy
 
Big Data Landscape 2018
Big Data Landscape 2018Big Data Landscape 2018
Big Data Landscape 2018Leanne Hwee
 
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...Sirris
 
General introduction to IoTCrawler
General introduction to IoTCrawlerGeneral introduction to IoTCrawler
General introduction to IoTCrawlerIoTCrawler
 
Learning from past infrastructure to embrace friction and create the Research...
Learning from past infrastructure to embrace friction and create the Research...Learning from past infrastructure to embrace friction and create the Research...
Learning from past infrastructure to embrace friction and create the Research...Research Data Alliance
 
Big data session five ( a )f
Big data session five ( a )fBig data session five ( a )f
Big data session five ( a )fmarukanda
 
Big data - An Introduction
Big data - An IntroductionBig data - An Introduction
Big data - An IntroductionSpotle.ai
 
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...welingtonms
 
Advanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsAdvanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsSloan Carne
 
Data science and visualization lab presentation
Data science and visualization lab presentationData science and visualization lab presentation
Data science and visualization lab presentationiHub Research
 
Discovering Things and Things’ data/services
Discovering Things and  Things’ data/servicesDiscovering Things and  Things’ data/services
Discovering Things and Things’ data/servicesPayamBarnaghi
 
Understanding Human Mobility
Understanding Human MobilityUnderstanding Human Mobility
Understanding Human MobilityWidy Widyawan
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptxAkhirulAminulloh2
 
Ketnote: GraphTour Boston
Ketnote: GraphTour BostonKetnote: GraphTour Boston
Ketnote: GraphTour BostonNeo4j
 
introduction to data science
introduction to data scienceintroduction to data science
introduction to data sciencebhavesh lande
 
Advanced Analytics and Data Science Expertise
Advanced Analytics and Data Science ExpertiseAdvanced Analytics and Data Science Expertise
Advanced Analytics and Data Science ExpertiseSoftServe
 

Ähnlich wie 6. FOMS _Data Mining_ Analysis_ Eric Robson (20)

SoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningSoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social Mining
 
Data Mining and Big Data Challenges and Research Opportunities
Data Mining and Big Data Challenges and Research OpportunitiesData Mining and Big Data Challenges and Research Opportunities
Data Mining and Big Data Challenges and Research Opportunities
 
Big Data Landscape 2018
Big Data Landscape 2018Big Data Landscape 2018
Big Data Landscape 2018
 
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...
Sirris innovate2011 - Smart Products with smart data - introduction, Dr. Elen...
 
What is Big Data?
What is Big Data?What is Big Data?
What is Big Data?
 
DBMS
DBMSDBMS
DBMS
 
Data Science.pptx
Data Science.pptxData Science.pptx
Data Science.pptx
 
General introduction to IoTCrawler
General introduction to IoTCrawlerGeneral introduction to IoTCrawler
General introduction to IoTCrawler
 
Learning from past infrastructure to embrace friction and create the Research...
Learning from past infrastructure to embrace friction and create the Research...Learning from past infrastructure to embrace friction and create the Research...
Learning from past infrastructure to embrace friction and create the Research...
 
Big data session five ( a )f
Big data session five ( a )fBig data session five ( a )f
Big data session five ( a )f
 
Big data - An Introduction
Big data - An IntroductionBig data - An Introduction
Big data - An Introduction
 
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...
Status Report - A COGNITIVE PRIVACY FRAMEWORK TO A SMART CITY ARCHITECTURE BA...
 
Advanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsAdvanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU Investigators
 
Data science and visualization lab presentation
Data science and visualization lab presentationData science and visualization lab presentation
Data science and visualization lab presentation
 
Discovering Things and Things’ data/services
Discovering Things and  Things’ data/servicesDiscovering Things and  Things’ data/services
Discovering Things and Things’ data/services
 
Understanding Human Mobility
Understanding Human MobilityUnderstanding Human Mobility
Understanding Human Mobility
 
Introduction Data Science.pptx
Introduction Data Science.pptxIntroduction Data Science.pptx
Introduction Data Science.pptx
 
Ketnote: GraphTour Boston
Ketnote: GraphTour BostonKetnote: GraphTour Boston
Ketnote: GraphTour Boston
 
introduction to data science
introduction to data scienceintroduction to data science
introduction to data science
 
Advanced Analytics and Data Science Expertise
Advanced Analytics and Data Science ExpertiseAdvanced Analytics and Data Science Expertise
Advanced Analytics and Data Science Expertise
 

Mehr von FOMS011

8. FOMS_ Betapond_ Peter_ Elgar
8. FOMS_ Betapond_ Peter_ Elgar8. FOMS_ Betapond_ Peter_ Elgar
8. FOMS_ Betapond_ Peter_ ElgarFOMS011
 
7.FOMS _ Making Connections_ Tom Curran
7.FOMS _ Making Connections_ Tom Curran7.FOMS _ Making Connections_ Tom Curran
7.FOMS _ Making Connections_ Tom CurranFOMS011
 
5. FOMS_ Mobile Social_Networks_Robert Mullins
5. FOMS_ Mobile Social_Networks_Robert Mullins5. FOMS_ Mobile Social_Networks_Robert Mullins
5. FOMS_ Mobile Social_Networks_Robert MullinsFOMS011
 
4. FOMS _ Pervasive Services _ John_McGovern
4. FOMS _ Pervasive  Services _ John_McGovern4. FOMS _ Pervasive  Services _ John_McGovern
4. FOMS _ Pervasive Services _ John_McGovernFOMS011
 
3. FOMS_ IMS services_Shane_Dempsey
3. FOMS_ IMS services_Shane_Dempsey3. FOMS_ IMS services_Shane_Dempsey
3. FOMS_ IMS services_Shane_DempseyFOMS011
 
8. beta pond peter_elgar
8. beta pond  peter_elgar8. beta pond  peter_elgar
8. beta pond peter_elgarFOMS011
 
2. FOMS _ FeedHenry_ Mícheál Ó Foghlú
2. FOMS _ FeedHenry_ Mícheál Ó Foghlú2. FOMS _ FeedHenry_ Mícheál Ó Foghlú
2. FOMS _ FeedHenry_ Mícheál Ó FoghlúFOMS011
 
1. FOMS_ Introduction_ Barry Downes
1. FOMS_ Introduction_ Barry Downes1. FOMS_ Introduction_ Barry Downes
1. FOMS_ Introduction_ Barry DownesFOMS011
 

Mehr von FOMS011 (8)

8. FOMS_ Betapond_ Peter_ Elgar
8. FOMS_ Betapond_ Peter_ Elgar8. FOMS_ Betapond_ Peter_ Elgar
8. FOMS_ Betapond_ Peter_ Elgar
 
7.FOMS _ Making Connections_ Tom Curran
7.FOMS _ Making Connections_ Tom Curran7.FOMS _ Making Connections_ Tom Curran
7.FOMS _ Making Connections_ Tom Curran
 
5. FOMS_ Mobile Social_Networks_Robert Mullins
5. FOMS_ Mobile Social_Networks_Robert Mullins5. FOMS_ Mobile Social_Networks_Robert Mullins
5. FOMS_ Mobile Social_Networks_Robert Mullins
 
4. FOMS _ Pervasive Services _ John_McGovern
4. FOMS _ Pervasive  Services _ John_McGovern4. FOMS _ Pervasive  Services _ John_McGovern
4. FOMS _ Pervasive Services _ John_McGovern
 
3. FOMS_ IMS services_Shane_Dempsey
3. FOMS_ IMS services_Shane_Dempsey3. FOMS_ IMS services_Shane_Dempsey
3. FOMS_ IMS services_Shane_Dempsey
 
8. beta pond peter_elgar
8. beta pond  peter_elgar8. beta pond  peter_elgar
8. beta pond peter_elgar
 
2. FOMS _ FeedHenry_ Mícheál Ó Foghlú
2. FOMS _ FeedHenry_ Mícheál Ó Foghlú2. FOMS _ FeedHenry_ Mícheál Ó Foghlú
2. FOMS _ FeedHenry_ Mícheál Ó Foghlú
 
1. FOMS_ Introduction_ Barry Downes
1. FOMS_ Introduction_ Barry Downes1. FOMS_ Introduction_ Barry Downes
1. FOMS_ Introduction_ Barry Downes
 

6. FOMS _Data Mining_ Analysis_ Eric Robson

  • 1. Data Mining & Social Network Analysis Eric Robson
  • 2. Introduction • What is Data Mining? • How is it relevant to the mobile world? • What can be discovered? • Techniques and technologies used: – Matrix and Network Theory – Semantic Analysis – Statistical Analysis – Predictive Analytics – Visualisation
  • 3. TSSG & 3CS R&D • Service Reporting – Data Warehousing: ETL, Star Schema; • Service Analytics – Predictive Analytics: Classification, Clustering, Frequent Pattern Mining • Service Recommendation – Passive Collaborative Filtering
  • 4. A Case Study of our Industry Engagement • Using Social Network Analysis in the Criminal Intelligence Domain – Internal Intelligence • Land Registry • Ports Authority • Revenue • Court Transcripts – Open Source Intelligence (OSINT) • Newspapers • Internet Forums • Social Networking Websites • Uncover people and relationships previously unknown to the authorities. • S.N.A. techniques to discover social patterns in criminal organisations.
  • 5. TSSG & 3CS’s Near-Term R&D • National – PADIE • Large scale Data Warehousing project for processing Data – Content Recommender • Content recommendation based on semantic analysis of reviews. • European – Societies • Community Smart Spaces. – SNAP • Professional services social network. Dynamic relationships created based on semantic analysis of current situation.
  • 6. TSSG and 3CS Long-Term R&D Roadmap • Volume of Data increasing – ROI for data storage is increasing. • Structured Data Vs Unstructured – Marketing – Identifying Key Product Influencers • Context Enabled Services – Mobile based services – Location, Time, presence • Data Privacy – Laws governing data privacy becoming increasingly strict – Public knowledge and understanding of privacy issues becoming more apparent.
  • 7. Industry Predictions for 2014 • Internet searching to be replaced by personal social networks. • Changes to data protection and ownership laws. – Empowering people to manage their own data. • Changes to privacy laws and expectations will completely change Social Networking Websites. – Privacy laws as a competitive weapon?
  • 8. Contact Eric Robson Knowledge Discovery and Databases TSSG, Waterford Institute of Technology erobson@tssg.org http://ie.linkedin.com/in/erobson +353 51 302960 (w)