SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
#FAIL!
THINGS THAT DIDN‘T WORK OUT IN SOCIAL
MEDIA RESEARCH
- AND WHAT WE CAN LEARN FROM THEM
Workshop at Internet Research 16, Phoenix, October 21st, 2015.
• Workshop hashtag: #fail2015b
• Conference hashtag: #ir16
• Workshop website:
http://failworkshops.wordpress.com
• Etherpad: https://pad.okfn.org/p/fail
WELCOME
Luca Rossi
@LR
Karine Nahon
@karineb
Katrin Weller
@kwelle
ABOUT #FAIL! WORKSHOPS
• Traveling on to different conferences. First
workshop was at WebSci15 (June 2015)
• Aim: collect various examples for things that
can go wrong and share them with different
communities
learn from experiences
Connect different research communities
WHAT WE‘VE LEARNED SO FAR
0
100
200
300
400
500
600
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
Twitter
Facebook
YouTube
Blogs
Wikis
Foursquare
LinkedIn
MySpace
Number of publications per year, which mention the respective social media platform‘s name in their title. Scopus
Title Search. For details: http://kwelle.wordpress.com/2014/04/07/bibliometric-analysis-of-social-media-research/
SOCIAL MEDIA RESEARCH
2008-2013 papers on Twitter and elections: data sources
Weller, K. (2014). Twitter und Wahlen: Zwischen 140 Zeichen und Milliarden von Tweets. In: R. Reichert (Ed.), Big
Data: Analysen zum digitalen Wandel von Wissen, Macht und Ökonomie (pp. 239-257). Bielefeld: transcript.
6
Data source number
No information 11
Collected manually from Twitter website (Copy-Paste /
Screenshot)
6
Twitter API (no further information) 8
Twitter Search API 3
Twitter Streaming API 1
Twitter Rest API 1
Twitter API user timeline 1
Own program for accessing Twitter APIs 4
Twitter Gardenhose 1
Official Reseller (Gnip, DataSift) 3
YourTwapperKeeper 3
Other tools (e.g. Topsy) 6
Received from colleagues 1
SOCIAL MEDIA RESEARCH
What we discussed at the first workshop…
CURRENT PROBLEMS
Challenge 1: users
• How to involve social media users in the
research process?
• Presentation by Elodie Crespel: “Extending
data collection with web browser extension”
– Participants may be creative in their use of
technology – flexibility is needed.
Challenge 2: methods
• Data analytics: which approaches should be
chosen?
• Taha Yasseri: “The double-edged sword of
statistical significance”
– Questions the p-value as a standard for data
analytics.
– “too much of attention and reliance on specific
measures or methods without being aware of the
logic behind them, can be misleading”
Challenge 3: tools
• Many researchers use third party tools for
data collection or analysis – which may not
always work as expected.
• Presentation by Michael Bossetta and
Anamaria Dutceac Segesten: “Tracing
Eurosceptic Party Networks via Hyperlink
Network Analysis and #FAIL!ng: Can Web
Crawlers Keep up with Web Design?”
– Exemplary case: issuecrawler.
Challenge 4: content
• Content analysis is heavily effected by the
dynamic nature of social media.
• Presentation by Marie Van Cranenbroeck:
“Managing and Using Unstable Data in a Social
Science Research about Museums and
Audiences on Social Media”
– Data collection and storage challenges
Specific details and additions
• Researchers and users may have different ideas
about the definition of social media / social
networks
• Lack of evaluation standards
• Availability of data (also: not enough data)
• Data may be corrupt (e.g. missing data)
• Social media as a moving target (Karpf, D. (2012).
Social science research methods in Internet time.
Information, Communication & Society
15(5):639-661. )
Meta discussion
• Social media research can have various forms.
Different disciplines involved.
• Best practices and pitfalls in social media
research are mainly discussed informally. Few
possibilities to share unsuccessful approaches.
WHAT WE‘D LIKE TO LEARN TODAY
• Towards a categorization of challenges for
social media research: what can go wrong?
• Collection of more experiences
• Structuring them into different categories
WHAT WE‘D LIKE TO LEARN TODAY
Today:
- 4 presentations
- Think about your own experiences!
- … in connection to each presentation
- … in general
9:00 Introduction: “What we’ve learnt from the first workshop and
what we’d like to learn today”
9:15 Shawn Walker: “Complexity of collecting social media data
in ephemeral contexts”
9:40 Cornelius Puschmann: “Why LIWC sucks (or: saner options
for social media content analysis)”
10:05 Break
10:20 Luca Rossi: “The fourth deadly sin of social media researchers
(or: scientific research and unstable socio-technical platforms)”
10:45 Marco Toledo Bastos, “Individual Behavior from Aggregate
Social Media Data“
11:10 Discussion & Conclusions
12:00 End
PROGRAM
• Other experiences? Share your thoughts!
• Main categories of #fail cases?
• Top 3 take away messages for next workshop?
DISCUSSION
WHERE TO GO FROM HERE?
• Next steps – lessons learnt for future
workshop organisation
• Which additional conferences?
• Publication? Guidebook?
• Archiving:
– URLs may vanish (Question: linear rate of decay?)
– Images missing
– Platforms changing (moving target!) – not just about the interface!
• Visualization of results
– Word cloud (compare histograms)
• Tools
– sentiment140, Internet Archive, GNIP
• Methods
– Content Analysis:
• replicability? Validation?
• Context for social media contents (e.g. surrounding tweets).
• LIWC, General Inquirer
– Predictions
– „Data Science“
• Lack of theory
• Data Quality:
– Can we still cite/use data and research published in 2007/2008`?
– Baseline? (how to define for a moving target)
• Theory:
– Can we only do descriptive work for single platforms?
– Look for the theory instead for the data?
• Meta
– Systematic review of existing literature is needed
• Documentation
– Timeframe generalizaion
– Document time, cultures?
– How long will my results be valid?
– Have a general base for comparison

Weitere ähnliche Inhalte

Was ist angesagt?

Academic Social Network Sites: a rough guide for researchers
Academic Social Network Sites: a rough guide for researchersAcademic Social Network Sites: a rough guide for researchers
Academic Social Network Sites: a rough guide for researchersDanny Kingsley
 
Creation of visualizations based on Linked Data
Creation of visualizations based on Linked DataCreation of visualizations based on Linked Data
Creation of visualizations based on Linked DataAlvaro Graves
 
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...pascal aventurier
 
Web 2.0 study tools 02
Web 2.0 study tools 02Web 2.0 study tools 02
Web 2.0 study tools 02Scott Gilbert
 
Librarians & altmetrics: Tools, tips and use cases
Librarians & altmetrics: Tools, tips and use casesLibrarians & altmetrics: Tools, tips and use cases
Librarians & altmetrics: Tools, tips and use casesLibrary_Connect
 
scholarly Publishing, CORE, Tampere
scholarly Publishing, CORE, Tamperescholarly Publishing, CORE, Tampere
scholarly Publishing, CORE, TampereNick Jankowski
 
Champlain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationChamplain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationMichelle Miller
 
Discovery of Technology: Tools for Research Management & Interdisciplinary C...
Discovery of Technology:  Tools for Research Management & Interdisciplinary C...Discovery of Technology:  Tools for Research Management & Interdisciplinary C...
Discovery of Technology: Tools for Research Management & Interdisciplinary C...Rebecca Kate Miller
 
Social media: introduction to useful tools for academics
Social media: introduction to useful tools for academicsSocial media: introduction to useful tools for academics
Social media: introduction to useful tools for academicsLancaster University Library
 
Academic social networks site as networked socio-technical systems for schola...
Academic social networks site as networked socio-technical systems for schola...Academic social networks site as networked socio-technical systems for schola...
Academic social networks site as networked socio-technical systems for schola...Stefania Manca
 
Visualization as a New Media Literacy
Visualization as a New Media LiteracyVisualization as a New Media Literacy
Visualization as a New Media LiteracyErin Reilly
 
Computational Approaches to Studying Anti-Social Behaviour on Social Media
Computational Approaches to Studying Anti-Social Behaviour on Social MediaComputational Approaches to Studying Anti-Social Behaviour on Social Media
Computational Approaches to Studying Anti-Social Behaviour on Social MediaToronto Metropolitan University
 
Software Codesign With Older People
Software Codesign With Older PeopleSoftware Codesign With Older People
Software Codesign With Older PeopleGuy Dewsbury
 

Was ist angesagt? (20)

MATC New Student Library Presentation
MATC New Student Library PresentationMATC New Student Library Presentation
MATC New Student Library Presentation
 
Academic Social Network Sites: a rough guide for researchers
Academic Social Network Sites: a rough guide for researchersAcademic Social Network Sites: a rough guide for researchers
Academic Social Network Sites: a rough guide for researchers
 
Creation of visualizations based on Linked Data
Creation of visualizations based on Linked DataCreation of visualizations based on Linked Data
Creation of visualizations based on Linked Data
 
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...
Academic Social Networks : Challenges and opportunities. 7th UNICA Scholarly ...
 
Web 2.0 study tools 02
Web 2.0 study tools 02Web 2.0 study tools 02
Web 2.0 study tools 02
 
Give me kudos for taking responsibility for self-marketing my scientific publ...
Give me kudos for taking responsibility for self-marketing my scientific publ...Give me kudos for taking responsibility for self-marketing my scientific publ...
Give me kudos for taking responsibility for self-marketing my scientific publ...
 
Librarians & altmetrics: Tools, tips and use cases
Librarians & altmetrics: Tools, tips and use casesLibrarians & altmetrics: Tools, tips and use cases
Librarians & altmetrics: Tools, tips and use cases
 
scholarly Publishing, CORE, Tampere
scholarly Publishing, CORE, Tamperescholarly Publishing, CORE, Tampere
scholarly Publishing, CORE, Tampere
 
Champlain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationChamplain College LILAC 2010 Presentation
Champlain College LILAC 2010 Presentation
 
Discovery of Technology: Tools for Research Management & Interdisciplinary C...
Discovery of Technology:  Tools for Research Management & Interdisciplinary C...Discovery of Technology:  Tools for Research Management & Interdisciplinary C...
Discovery of Technology: Tools for Research Management & Interdisciplinary C...
 
Social media: introduction to useful tools for academics
Social media: introduction to useful tools for academicsSocial media: introduction to useful tools for academics
Social media: introduction to useful tools for academics
 
Research students-2010.01.18
Research students-2010.01.18Research students-2010.01.18
Research students-2010.01.18
 
Academic social networks site as networked socio-technical systems for schola...
Academic social networks site as networked socio-technical systems for schola...Academic social networks site as networked socio-technical systems for schola...
Academic social networks site as networked socio-technical systems for schola...
 
Finding and Using E-Books
Finding and Using E-BooksFinding and Using E-Books
Finding and Using E-Books
 
Visualization as a New Media Literacy
Visualization as a New Media LiteracyVisualization as a New Media Literacy
Visualization as a New Media Literacy
 
Online 1207
Online 1207Online 1207
Online 1207
 
Social Networking Tools for Scientists and Building an Online Profile
Social Networking Tools for Scientists and Building an Online ProfileSocial Networking Tools for Scientists and Building an Online Profile
Social Networking Tools for Scientists and Building an Online Profile
 
Computational Approaches to Studying Anti-Social Behaviour on Social Media
Computational Approaches to Studying Anti-Social Behaviour on Social MediaComputational Approaches to Studying Anti-Social Behaviour on Social Media
Computational Approaches to Studying Anti-Social Behaviour on Social Media
 
Software Codesign With Older People
Software Codesign With Older PeopleSoftware Codesign With Older People
Software Codesign With Older People
 
Preliminary task 7.09
Preliminary task 7.09Preliminary task 7.09
Preliminary task 7.09
 

Andere mochten auch

Presentacion top 5
Presentacion top 5Presentacion top 5
Presentacion top 5marttin12
 
Tet2015 projecto homem-de-agua_pedronunes_pt
Tet2015 projecto homem-de-agua_pedronunes_ptTet2015 projecto homem-de-agua_pedronunes_pt
Tet2015 projecto homem-de-agua_pedronunes_ptPedronunes Nomundo
 
最近二十年中國文學史綱
最近二十年中國文學史綱最近二十年中國文學史綱
最近二十年中國文學史綱TAAZE 讀冊生活
 
Will 3G Networks Cope 2010
Will 3G Networks Cope 2010Will 3G Networks Cope 2010
Will 3G Networks Cope 2010Alastair Brydon
 
Conversions
ConversionsConversions
Conversionsanna3485
 
Balıkesir katı atık deponi alanı
Balıkesir katı atık deponi alanıBalıkesir katı atık deponi alanı
Balıkesir katı atık deponi alanıB35 Yapı
 
PV NOTÍCIAS EDIÇÃO N° 10
PV NOTÍCIAS EDIÇÃO N° 10PV NOTÍCIAS EDIÇÃO N° 10
PV NOTÍCIAS EDIÇÃO N° 10Jonasblog
 
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicos
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicosCurso: Comunicación de datos y redes: 01 Repaso de conceptos básicos
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicosJack Daniel Cáceres Meza
 
La apreciacion musical
La apreciacion musicalLa apreciacion musical
La apreciacion musicalAngie Cadena
 
Marketing is Dead. Only Moments Matter.
Marketing is Dead. Only Moments Matter.Marketing is Dead. Only Moments Matter.
Marketing is Dead. Only Moments Matter.Kyle Lacy
 
How Did Life Begin
How Did Life BeginHow Did Life Begin
How Did Life Beginanna3485
 
Weller pleasures+perils social media
Weller pleasures+perils social mediaWeller pleasures+perils social media
Weller pleasures+perils social mediaKatrin Weller
 
Weller social media as research data_psm15
Weller social media as research data_psm15Weller social media as research data_psm15
Weller social media as research data_psm15Katrin Weller
 
Tema 1 administración de compras y abastecimientos
Tema 1 administración de compras y abastecimientosTema 1 administración de compras y abastecimientos
Tema 1 administración de compras y abastecimientosmidgarddelfoos
 

Andere mochten auch (20)

Presentacion top 5
Presentacion top 5Presentacion top 5
Presentacion top 5
 
Tet2015 projecto homem-de-agua_pedronunes_pt
Tet2015 projecto homem-de-agua_pedronunes_ptTet2015 projecto homem-de-agua_pedronunes_pt
Tet2015 projecto homem-de-agua_pedronunes_pt
 
最近二十年中國文學史綱
最近二十年中國文學史綱最近二十年中國文學史綱
最近二十年中國文學史綱
 
Boletín EHS noviembre 2015
Boletín EHS noviembre 2015Boletín EHS noviembre 2015
Boletín EHS noviembre 2015
 
Will 3G Networks Cope 2010
Will 3G Networks Cope 2010Will 3G Networks Cope 2010
Will 3G Networks Cope 2010
 
Conversions
ConversionsConversions
Conversions
 
Balıkesir katı atık deponi alanı
Balıkesir katı atık deponi alanıBalıkesir katı atık deponi alanı
Balıkesir katı atık deponi alanı
 
三元挨星秘訣仙傳
三元挨星秘訣仙傳三元挨星秘訣仙傳
三元挨星秘訣仙傳
 
PV NOTÍCIAS EDIÇÃO N° 10
PV NOTÍCIAS EDIÇÃO N° 10PV NOTÍCIAS EDIÇÃO N° 10
PV NOTÍCIAS EDIÇÃO N° 10
 
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicos
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicosCurso: Comunicación de datos y redes: 01 Repaso de conceptos básicos
Curso: Comunicación de datos y redes: 01 Repaso de conceptos básicos
 
Educación Musical
Educación MusicalEducación Musical
Educación Musical
 
La apreciacion musical
La apreciacion musicalLa apreciacion musical
La apreciacion musical
 
Marketing is Dead. Only Moments Matter.
Marketing is Dead. Only Moments Matter.Marketing is Dead. Only Moments Matter.
Marketing is Dead. Only Moments Matter.
 
Aula sinais e símbolos
Aula   sinais e símbolosAula   sinais e símbolos
Aula sinais e símbolos
 
How Did Life Begin
How Did Life BeginHow Did Life Begin
How Did Life Begin
 
Sistemas de refuerzo sonoro
Sistemas de refuerzo sonoroSistemas de refuerzo sonoro
Sistemas de refuerzo sonoro
 
Weller pleasures+perils social media
Weller pleasures+perils social mediaWeller pleasures+perils social media
Weller pleasures+perils social media
 
Weller social media as research data_psm15
Weller social media as research data_psm15Weller social media as research data_psm15
Weller social media as research data_psm15
 
EstimacióN Y Prueba De HipóTesis
EstimacióN Y Prueba De HipóTesisEstimacióN Y Prueba De HipóTesis
EstimacióN Y Prueba De HipóTesis
 
Tema 1 administración de compras y abastecimientos
Tema 1 administración de compras y abastecimientosTema 1 administración de compras y abastecimientos
Tema 1 administración de compras y abastecimientos
 

Ähnlich wie Fail ir16 intro

Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slidesMining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slidesMichael Mathioudakis
 
Lisa's research 10th oct 2012
Lisa's research 10th oct 2012Lisa's research 10th oct 2012
Lisa's research 10th oct 2012Lisa Harris
 
Digital scholarship - all day workshop
Digital scholarship - all day workshopDigital scholarship - all day workshop
Digital scholarship - all day workshopMartin Weller
 
The Hidden Data of Social Media Rearch_CSS-winter-symposium
The Hidden Data of Social Media Rearch_CSS-winter-symposiumThe Hidden Data of Social Media Rearch_CSS-winter-symposium
The Hidden Data of Social Media Rearch_CSS-winter-symposiumKatrin Weller
 
Influencing the MOOC agenda - analysis of #MOOC Twitter Data
Influencing the MOOC agenda - analysis of #MOOC Twitter Data  Influencing the MOOC agenda - analysis of #MOOC Twitter Data
Influencing the MOOC agenda - analysis of #MOOC Twitter Data Mairéad Nic Giolla Mhichíl
 
Hidden Data of Social Media Research
Hidden Data of Social Media ResearchHidden Data of Social Media Research
Hidden Data of Social Media ResearchKatrin Weller
 
Ico guest lecture 2015 'Social media'
Ico guest lecture 2015 'Social media'Ico guest lecture 2015 'Social media'
Ico guest lecture 2015 'Social media'University of Utrecht
 
Managing Your Research Profile
Managing Your Research ProfileManaging Your Research Profile
Managing Your Research Profilelisbk
 
Scholarly social media applications platforms for knowledge sharing and net...
Scholarly social media applications   platforms for knowledge sharing and net...Scholarly social media applications   platforms for knowledge sharing and net...
Scholarly social media applications platforms for knowledge sharing and net...tullemich
 
Picturing the Social: Talk for Transforming Digital Methods Winter School
Picturing the Social: Talk for Transforming Digital Methods Winter SchoolPicturing the Social: Talk for Transforming Digital Methods Winter School
Picturing the Social: Talk for Transforming Digital Methods Winter SchoolFarida Vis
 
Social Media for Scientists - University of Melbourne guest lecture May 2014
Social Media for Scientists - University of Melbourne guest lecture May 2014Social Media for Scientists - University of Melbourne guest lecture May 2014
Social Media for Scientists - University of Melbourne guest lecture May 2014Joyce Seitzinger
 
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...Lauri Eloranta
 
@WebSciDL PhD Student Project Reviews August 5&6, 2015
@WebSciDL PhD Student Project Reviews August 5&6, 2015@WebSciDL PhD Student Project Reviews August 5&6, 2015
@WebSciDL PhD Student Project Reviews August 5&6, 2015Michael Nelson
 
How Social Media Can Enhance Your Research Activities
How Social Media Can Enhance Your Research ActivitiesHow Social Media Can Enhance Your Research Activities
How Social Media Can Enhance Your Research Activitieslisbk
 
Herramientas 2.0 para comunicar la actividad científica
Herramientas 2.0 para comunicar la actividad científicaHerramientas 2.0 para comunicar la actividad científica
Herramientas 2.0 para comunicar la actividad científicaXavier Lasauca i Cisa
 
Using social media to build your academic career
Using social media to build your academic careerUsing social media to build your academic career
Using social media to build your academic careerlisbk
 

Ähnlich wie Fail ir16 intro (20)

Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slidesMining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
Mining the Social Web - Lecture 1 - T61.6020 lecture-01-slides
 
Lisa's research 10th oct 2012
Lisa's research 10th oct 2012Lisa's research 10th oct 2012
Lisa's research 10th oct 2012
 
Digital scholarship - all day workshop
Digital scholarship - all day workshopDigital scholarship - all day workshop
Digital scholarship - all day workshop
 
The Hidden Data of Social Media Rearch_CSS-winter-symposium
The Hidden Data of Social Media Rearch_CSS-winter-symposiumThe Hidden Data of Social Media Rearch_CSS-winter-symposium
The Hidden Data of Social Media Rearch_CSS-winter-symposium
 
Influencing the MOOC agenda - analysis of #MOOC Twitter Data
Influencing the MOOC agenda - analysis of #MOOC Twitter Data  Influencing the MOOC agenda - analysis of #MOOC Twitter Data
Influencing the MOOC agenda - analysis of #MOOC Twitter Data
 
ESWC 2014 Tutorial part 1
ESWC 2014 Tutorial part 1ESWC 2014 Tutorial part 1
ESWC 2014 Tutorial part 1
 
Hidden Data of Social Media Research
Hidden Data of Social Media ResearchHidden Data of Social Media Research
Hidden Data of Social Media Research
 
Ico guest lecture 2015 'Social media'
Ico guest lecture 2015 'Social media'Ico guest lecture 2015 'Social media'
Ico guest lecture 2015 'Social media'
 
Social media & research
Social media & researchSocial media & research
Social media & research
 
Managing Your Research Profile
Managing Your Research ProfileManaging Your Research Profile
Managing Your Research Profile
 
Digital Scholarship: building an online scholarly presence
Digital Scholarship: building an online scholarly presenceDigital Scholarship: building an online scholarly presence
Digital Scholarship: building an online scholarly presence
 
Scholarly social media applications platforms for knowledge sharing and net...
Scholarly social media applications   platforms for knowledge sharing and net...Scholarly social media applications   platforms for knowledge sharing and net...
Scholarly social media applications platforms for knowledge sharing and net...
 
Picturing the Social: Talk for Transforming Digital Methods Winter School
Picturing the Social: Talk for Transforming Digital Methods Winter SchoolPicturing the Social: Talk for Transforming Digital Methods Winter School
Picturing the Social: Talk for Transforming Digital Methods Winter School
 
Cook social network innovation
Cook   social network innovationCook   social network innovation
Cook social network innovation
 
Social Media for Scientists - University of Melbourne guest lecture May 2014
Social Media for Scientists - University of Melbourne guest lecture May 2014Social Media for Scientists - University of Melbourne guest lecture May 2014
Social Media for Scientists - University of Melbourne guest lecture May 2014
 
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
A Summary of Computational Social Science - Lecture 8 in Introduction to Comp...
 
@WebSciDL PhD Student Project Reviews August 5&6, 2015
@WebSciDL PhD Student Project Reviews August 5&6, 2015@WebSciDL PhD Student Project Reviews August 5&6, 2015
@WebSciDL PhD Student Project Reviews August 5&6, 2015
 
How Social Media Can Enhance Your Research Activities
How Social Media Can Enhance Your Research ActivitiesHow Social Media Can Enhance Your Research Activities
How Social Media Can Enhance Your Research Activities
 
Herramientas 2.0 para comunicar la actividad científica
Herramientas 2.0 para comunicar la actividad científicaHerramientas 2.0 para comunicar la actividad científica
Herramientas 2.0 para comunicar la actividad científica
 
Using social media to build your academic career
Using social media to build your academic careerUsing social media to build your academic career
Using social media to build your academic career
 

Mehr von Katrin Weller

Challenges in-archiving-twitter
Challenges in-archiving-twitterChallenges in-archiving-twitter
Challenges in-archiving-twitterKatrin Weller
 
The digital traces of user generated content
The digital traces of user generated contentThe digital traces of user generated content
The digital traces of user generated contentKatrin Weller
 
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...Katrin Weller
 
Publishing with impact
Publishing with impactPublishing with impact
Publishing with impactKatrin Weller
 
"I always feel it must be great to be a hacker"
"I always feel it must be great to be a hacker" "I always feel it must be great to be a hacker"
"I always feel it must be great to be a hacker" Katrin Weller
 
Social-Media-Forschung
Social-Media-ForschungSocial-Media-Forschung
Social-Media-ForschungKatrin Weller
 
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...Katrin Weller
 
What’s new in social media research?
What’s new in social media research?What’s new in social media research?
What’s new in social media research?Katrin Weller
 
Twitter-Daten in der sozialwissenschaftlichen Forschung
Twitter-Daten in der sozialwissenschaftlichen ForschungTwitter-Daten in der sozialwissenschaftlichen Forschung
Twitter-Daten in der sozialwissenschaftlichen ForschungKatrin Weller
 
Social Media Research Methods
Social Media Research MethodsSocial Media Research Methods
Social Media Research MethodsKatrin Weller
 
Quantität vor Qualität? Big Data im Kontext von Social Media Daten
Quantität vor Qualität? Big Data im Kontext von Social Media DatenQuantität vor Qualität? Big Data im Kontext von Social Media Daten
Quantität vor Qualität? Big Data im Kontext von Social Media DatenKatrin Weller
 
The pleasures and perils of studying Twitter
The pleasures and perils of studying TwitterThe pleasures and perils of studying Twitter
The pleasures and perils of studying TwitterKatrin Weller
 
Friends or Followers. German Soccer Clubs and Their Fans on Twitter
Friends or Followers. German Soccer Clubs and Their Fans on TwitterFriends or Followers. German Soccer Clubs and Their Fans on Twitter
Friends or Followers. German Soccer Clubs and Their Fans on TwitterKatrin Weller
 
What do we get from Twitter - and what not?
What do we get from Twitter - and what not?What do we get from Twitter - and what not?
What do we get from Twitter - and what not?Katrin Weller
 
Twitter research overview
Twitter research overviewTwitter research overview
Twitter research overviewKatrin Weller
 
Diata12 opening: Twitter research in Düsseldorf
Diata12 opening: Twitter research in DüsseldorfDiata12 opening: Twitter research in Düsseldorf
Diata12 opening: Twitter research in DüsseldorfKatrin Weller
 
Twitter tipps online11
Twitter tipps online11Twitter tipps online11
Twitter tipps online11Katrin Weller
 
Approaches to Analyzing Scientific Communication on Twitter
Approaches to Analyzing Scientific Communication on TwitterApproaches to Analyzing Scientific Communication on Twitter
Approaches to Analyzing Scientific Communication on TwitterKatrin Weller
 

Mehr von Katrin Weller (20)

Challenges in-archiving-twitter
Challenges in-archiving-twitterChallenges in-archiving-twitter
Challenges in-archiving-twitter
 
The digital traces of user generated content
The digital traces of user generated contentThe digital traces of user generated content
The digital traces of user generated content
 
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...
Twitter-Daten in der sozialwissenschaftlichen Forschung – Möglichkeiten und H...
 
Publishing with impact
Publishing with impactPublishing with impact
Publishing with impact
 
"I always feel it must be great to be a hacker"
"I always feel it must be great to be a hacker" "I always feel it must be great to be a hacker"
"I always feel it must be great to be a hacker"
 
Social-Media-Forschung
Social-Media-ForschungSocial-Media-Forschung
Social-Media-Forschung
 
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...
Big data - Gewinnung, Auswertung und Darstellung großer Mengen onlinegenerier...
 
What’s new in social media research?
What’s new in social media research?What’s new in social media research?
What’s new in social media research?
 
Twitter-Daten in der sozialwissenschaftlichen Forschung
Twitter-Daten in der sozialwissenschaftlichen ForschungTwitter-Daten in der sozialwissenschaftlichen Forschung
Twitter-Daten in der sozialwissenschaftlichen Forschung
 
Social Media Research Methods
Social Media Research MethodsSocial Media Research Methods
Social Media Research Methods
 
Quantität vor Qualität? Big Data im Kontext von Social Media Daten
Quantität vor Qualität? Big Data im Kontext von Social Media DatenQuantität vor Qualität? Big Data im Kontext von Social Media Daten
Quantität vor Qualität? Big Data im Kontext von Social Media Daten
 
The pleasures and perils of studying Twitter
The pleasures and perils of studying TwitterThe pleasures and perils of studying Twitter
The pleasures and perils of studying Twitter
 
Friends or Followers. German Soccer Clubs and Their Fans on Twitter
Friends or Followers. German Soccer Clubs and Their Fans on TwitterFriends or Followers. German Soccer Clubs and Their Fans on Twitter
Friends or Followers. German Soccer Clubs and Their Fans on Twitter
 
What do we get from Twitter - and what not?
What do we get from Twitter - and what not?What do we get from Twitter - and what not?
What do we get from Twitter - and what not?
 
Twitter research overview
Twitter research overviewTwitter research overview
Twitter research overview
 
Tweeting the news
Tweeting the news Tweeting the news
Tweeting the news
 
Diata12 opening: Twitter research in Düsseldorf
Diata12 opening: Twitter research in DüsseldorfDiata12 opening: Twitter research in Düsseldorf
Diata12 opening: Twitter research in Düsseldorf
 
Twitter tipps online11
Twitter tipps online11Twitter tipps online11
Twitter tipps online11
 
Diata11_opening
Diata11_openingDiata11_opening
Diata11_opening
 
Approaches to Analyzing Scientific Communication on Twitter
Approaches to Analyzing Scientific Communication on TwitterApproaches to Analyzing Scientific Communication on Twitter
Approaches to Analyzing Scientific Communication on Twitter
 

Kürzlich hochgeladen

Revolutionize Your Pinterest: Socio Cosmos Exclusive Deal
Revolutionize Your Pinterest: Socio Cosmos Exclusive DealRevolutionize Your Pinterest: Socio Cosmos Exclusive Deal
Revolutionize Your Pinterest: Socio Cosmos Exclusive DealSocioCosmos
 
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos""Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"SocioCosmos
 
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thị
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thịNhững điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thị
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thịUreka Media Vietnam CO., LTD
 
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...Riches General marchandise
 
Fintech app development company with financial management
Fintech app development company with financial managementFintech app development company with financial management
Fintech app development company with financial managementHazel Johnson
 
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.lindseyjanelladuran
 

Kürzlich hochgeladen (6)

Revolutionize Your Pinterest: Socio Cosmos Exclusive Deal
Revolutionize Your Pinterest: Socio Cosmos Exclusive DealRevolutionize Your Pinterest: Socio Cosmos Exclusive Deal
Revolutionize Your Pinterest: Socio Cosmos Exclusive Deal
 
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos""Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"
"Beyond Limits: Powering Your YouTube Ascent with Socio Cosmos"
 
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thị
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thịNhững điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thị
Những điều cơ bản về AI - Hướng dẫn hiểu và ứng dụng AI cho nhà tiếp thị
 
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...
THE DIGITAL MINE:Striking Gold in The Digital Mine: Attracting Leads and Maki...
 
Fintech app development company with financial management
Fintech app development company with financial managementFintech app development company with financial management
Fintech app development company with financial management
 
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.
BLOGGING. PPT. PTASK. 10-ST.LEOTHEGREAT.
 

Fail ir16 intro

  • 1. #FAIL! THINGS THAT DIDN‘T WORK OUT IN SOCIAL MEDIA RESEARCH - AND WHAT WE CAN LEARN FROM THEM Workshop at Internet Research 16, Phoenix, October 21st, 2015.
  • 2. • Workshop hashtag: #fail2015b • Conference hashtag: #ir16 • Workshop website: http://failworkshops.wordpress.com • Etherpad: https://pad.okfn.org/p/fail WELCOME Luca Rossi @LR Karine Nahon @karineb Katrin Weller @kwelle
  • 3. ABOUT #FAIL! WORKSHOPS • Traveling on to different conferences. First workshop was at WebSci15 (June 2015) • Aim: collect various examples for things that can go wrong and share them with different communities learn from experiences Connect different research communities
  • 5. 0 100 200 300 400 500 600 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Twitter Facebook YouTube Blogs Wikis Foursquare LinkedIn MySpace Number of publications per year, which mention the respective social media platform‘s name in their title. Scopus Title Search. For details: http://kwelle.wordpress.com/2014/04/07/bibliometric-analysis-of-social-media-research/ SOCIAL MEDIA RESEARCH
  • 6. 2008-2013 papers on Twitter and elections: data sources Weller, K. (2014). Twitter und Wahlen: Zwischen 140 Zeichen und Milliarden von Tweets. In: R. Reichert (Ed.), Big Data: Analysen zum digitalen Wandel von Wissen, Macht und Ökonomie (pp. 239-257). Bielefeld: transcript. 6 Data source number No information 11 Collected manually from Twitter website (Copy-Paste / Screenshot) 6 Twitter API (no further information) 8 Twitter Search API 3 Twitter Streaming API 1 Twitter Rest API 1 Twitter API user timeline 1 Own program for accessing Twitter APIs 4 Twitter Gardenhose 1 Official Reseller (Gnip, DataSift) 3 YourTwapperKeeper 3 Other tools (e.g. Topsy) 6 Received from colleagues 1 SOCIAL MEDIA RESEARCH
  • 7. What we discussed at the first workshop… CURRENT PROBLEMS
  • 8. Challenge 1: users • How to involve social media users in the research process? • Presentation by Elodie Crespel: “Extending data collection with web browser extension” – Participants may be creative in their use of technology – flexibility is needed.
  • 9. Challenge 2: methods • Data analytics: which approaches should be chosen? • Taha Yasseri: “The double-edged sword of statistical significance” – Questions the p-value as a standard for data analytics. – “too much of attention and reliance on specific measures or methods without being aware of the logic behind them, can be misleading”
  • 10. Challenge 3: tools • Many researchers use third party tools for data collection or analysis – which may not always work as expected. • Presentation by Michael Bossetta and Anamaria Dutceac Segesten: “Tracing Eurosceptic Party Networks via Hyperlink Network Analysis and #FAIL!ng: Can Web Crawlers Keep up with Web Design?” – Exemplary case: issuecrawler.
  • 11. Challenge 4: content • Content analysis is heavily effected by the dynamic nature of social media. • Presentation by Marie Van Cranenbroeck: “Managing and Using Unstable Data in a Social Science Research about Museums and Audiences on Social Media” – Data collection and storage challenges
  • 12. Specific details and additions • Researchers and users may have different ideas about the definition of social media / social networks • Lack of evaluation standards • Availability of data (also: not enough data) • Data may be corrupt (e.g. missing data) • Social media as a moving target (Karpf, D. (2012). Social science research methods in Internet time. Information, Communication & Society 15(5):639-661. )
  • 13. Meta discussion • Social media research can have various forms. Different disciplines involved. • Best practices and pitfalls in social media research are mainly discussed informally. Few possibilities to share unsuccessful approaches.
  • 14. WHAT WE‘D LIKE TO LEARN TODAY • Towards a categorization of challenges for social media research: what can go wrong? • Collection of more experiences • Structuring them into different categories
  • 15. WHAT WE‘D LIKE TO LEARN TODAY Today: - 4 presentations - Think about your own experiences! - … in connection to each presentation - … in general
  • 16. 9:00 Introduction: “What we’ve learnt from the first workshop and what we’d like to learn today” 9:15 Shawn Walker: “Complexity of collecting social media data in ephemeral contexts” 9:40 Cornelius Puschmann: “Why LIWC sucks (or: saner options for social media content analysis)” 10:05 Break 10:20 Luca Rossi: “The fourth deadly sin of social media researchers (or: scientific research and unstable socio-technical platforms)” 10:45 Marco Toledo Bastos, “Individual Behavior from Aggregate Social Media Data“ 11:10 Discussion & Conclusions 12:00 End PROGRAM
  • 17. • Other experiences? Share your thoughts! • Main categories of #fail cases? • Top 3 take away messages for next workshop? DISCUSSION
  • 18. WHERE TO GO FROM HERE? • Next steps – lessons learnt for future workshop organisation • Which additional conferences? • Publication? Guidebook?
  • 19. • Archiving: – URLs may vanish (Question: linear rate of decay?) – Images missing – Platforms changing (moving target!) – not just about the interface! • Visualization of results – Word cloud (compare histograms) • Tools – sentiment140, Internet Archive, GNIP • Methods – Content Analysis: • replicability? Validation? • Context for social media contents (e.g. surrounding tweets). • LIWC, General Inquirer – Predictions – „Data Science“ • Lack of theory • Data Quality: – Can we still cite/use data and research published in 2007/2008`? – Baseline? (how to define for a moving target) • Theory: – Can we only do descriptive work for single platforms? – Look for the theory instead for the data? • Meta – Systematic review of existing literature is needed • Documentation – Timeframe generalizaion – Document time, cultures? – How long will my results be valid? – Have a general base for comparison

Hinweis der Redaktion

  1. Social media platforms and users – a moving target… Best practices and pitfalls in social media research are mainly discussed informally. Few possibilities to share unsuccessful approaches. Researchers with lots of different disciplinary backgrounds enter the field. Different fields of expertise, few interdisciplinary exchange of approaches. Limited possibilities for data sharing / validation and reproduction of results.