Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

Practical Applications of Altmetrics

86 Aufrufe

Veröffentlicht am

Presented at the European Summer School for Scientometrics held in Leuven (Belgium) on July 20, 2019.

Veröffentlicht in: Bildung
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

Practical Applications of Altmetrics

  1. 1. Practical Applications of Altmetrics
  2. 2. Practical Applications of Altmetrics Presentation prepared for the EUROPEAN SUMMER SCHOOL FOR SCIENTOMETRICS by Nicolás Robinson-Garcia doi:10.5281/zenodo.3355276 http://nrobinsongarcia.com @nrobinsongarcia 2 This work is licensed under a Creative Commons Attribution-ShareALike 4.0 International License
  3. 3. 3
  4. 4. The promises of altmetrics ◉ Diversity Indicators and results ◉ Speed Immediate impact ◉ Openness Indicators and results ◉ Beyond scientific impact Societal impact Wouters & Costas, 2012 4 Escher, 1935
  5. 5. In the beginning all most studies on altmetrics were about… ◉ Data source analyses ◉ Description and definition of indicators ◉ Lots of promises… … and many correlations 5
  6. 6. … and now? 6 Conceptual limitations ◉ Attribution problem ◉ Passive approach Technical limitations ◉ Disparity ◉ Manipulation ◉ Volatility
  7. 7. Is it the end of altmetrics? the potential of social media data for impact assessment lies in that it may help understand the social interactions of researchers, both within and outside the scientific sphere Robinson-Garcia et al 2018 Many data and indicators […] that make up the altmetric universe are actually data about social media use, reception, and impact Wouters et al 2018 7
  8. 8. 8 New approaches New methods Reinterpreting results
  9. 9. Some considerations 9 01 0302 0 Data sources Indicators Design
  10. 10. Which data source? ◉ Wide and diverse range of indicators ◉ Each source offers its own set of indicators ◉ Each source shows different results based on the same indicators ◉ These differences are not errors but are derived from the data collection process 10
  11. 11. “ “Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments” Priem, Groth & Taraborelli, 2012 11
  12. 12. 12
  13. 13. 13
  14. 14. 14
  15. 15. Types of altmetric sources BY SOURCE ◉ Mendeley ◉ Twitter ◉ Facebook ◉ ResearchGate 15 ALL IN ONE ◉ Altmetric.com ◉ PlumX Analytics ◉ CrossRef EventData ◉ Lagotto
  16. 16. Types of altmetric sources BY SOURCE ◉ Mendeley ◉ Twitter ◉ Facebook ◉ ResearchGate 16 ALL IN ONE ◉ Altmetric.com ◉ PlumX Analytics ◉ CrossRef EventData ◉ Lagotto Springer Nature Elsevier Plos
  17. 17. Sources and indicators 17 Social networks • Twitter, Facebook, Google Plus… Tweets, retweets, likes, users Social tagging • Mendeley, Zotero, ReadCube… Bookmarks, collections, readers Scientific blogging • Publishers, institutional, personal… Mentions, comments, links Open content • PLOS journals, DataCite, Github… Downloads, comments, views
  18. 18. 18 ALTMETRIC.COM ◉ Public policy documents ◉ Blogs ◉ Mainstream media ◉ Citations (web of science / scopus) ◉ Online reference managers (mendeley) ◉ Research highlights (F1000) ◉ Peer review platforms (pubpeer, publons) ◉ Social Media (Facebook public pages, Twitter, Google+, LinkedIn, Sina, Weibo and Pinterest) ◉ Open Syllabus Project ◉ Multimedia and others (YouTube, Reddit )
  19. 19. 19 PLUMX
  20. 20. 20 LAGOTTO Viewed • PubMed Central Usage Stats • Copernicus Discussed • Facebook, Twitter • Blogs • Wikipedia • Reddit • OpenEdition Saved • CiteULike • Mendeley Cited • CrossRef, PubMed • Scopus • WoS • DataCite • Europe PMC Recommended • F1000 Prime Only PLOS • Usage • Figshare usage • Comments
  21. 21. 21 CROSS REF EVENT DATA
  22. 22. Differences on coverage 22 Zahedi & Costas, 2018
  23. 23. Differences on coverage ◉ Data collection. Use of different APIs when accessing primary sources. ◉ Aggregation and presentation. Different strategies to identify mentions and document versions (DOI, URL, PMID, etc.) ◉ Update. Different periodicity by source and platform 23 Zahedi & Costas, 2018
  24. 24. Tweeting different versions of the same paper 24
  25. 25. Unifying different versions of the same paper in Altmetric.com 25
  26. 26. Some considerations 26 02 0403 Indicators Design Implementation
  27. 27. Selecting indicators ◉ What is the goal of the analysis? ◉ Is the indicator a reasonable proxy of what we aim to analyse? ◉ Are our indicators reliable and consistent? ◉ Is our approach appropriate? 27
  28. 28. 28 Case I. Twitter as an indicator of consumption of scientific literature ◉ There is too much noise. No clear signal of scientific consumption ◉ Indicator and proxy are not aligned Robinson-Garcia et al., 2017
  29. 29. 29 Case II. Twitter as an indicator of social attention on scientific literature ◉ Indicator and proxy are aligned but for the wrong reasons Costas @ ESSS Granada 2016
  30. 30. 30 Case III. Syllabi mentions to analyse academic impact ◉ Indicator and proxy are aligned ◉ They capture the phenomenon under analysis ◉ But results are not consistent Torres-Salinas et al 2018
  31. 31. Some considerations 31 03 04 Design Implementation
  32. 32. 32 Monitoring ◉ Exploratory or descriptive ◉ We assume certain levels of uncertainty Assessment ◉ Intervention ◉ Altmetrics as complementary ◉ Starting point for qualitative analyses
  33. 33. What do we want to capture? 33 Academics SMEs, Non-profits, Hospital, Gov. Agencies, Associations, Large firms Society Altmetrics
  34. 34. 34 vsAltmetric approach Relational approach
  35. 35. Some considerations 35 04 Implementation
  36. 36. Applications of altmetrics 36 • Proactive attitude towards social context • Research linked to societal challenges Scientists’ social engagement • Social attention on scientific topics • Social controversies on scientific topics Socially relevant topics • Actors consumming scientific literature • Social perception of science Communities of attention
  37. 37. Altmetrics in practice Let’s check some examples… 37
  38. 38. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 38 http://profiles.impactstory.org/ Setting up your profile
  39. 39. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 39 http://knowmetrics.org/
  40. 40. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 40 D’Este et al 2018
  41. 41. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 41 Robinson-Garcia et al 2018
  42. 42. Scientists’ social engagement ◉ Scientists ○ Showcasing achievements ◉ Institutions ○ Monitoring social attention to scientific literature ○ Profiling scientists ◉ Journals ○ Monitoring social attention to scientific literature ○ Identifying potential authors 42 Robinson-Garcia et al 2017
  43. 43. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 43 Robinson-Garcia et al 2019
  44. 44. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 44 Robinson-Garcia 2017
  45. 45. Socially relevant topics ◉ Scientists ○ Selecting research lines ◉ Institutions ○ Identifying social interest on science ○ Understanding social reception ◉ Librarians ○ Collection development 45 Torres-Salinas et al 2017
  46. 46. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 46 Joubert & Costas 2019
  47. 47. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 47 Zahedi & van Eck, 2014
  48. 48. Communities of attention ◉ Funding agencies ○ Identifying potentially interested non-academic stakeholders ◉ Librarians and journals ○ Users’ studies ◉ Scientists ○ Searching for collaboration opportunities ○ Social reception 48 Diaz-Faes et al 2019
  49. 49. An example with the Altmetric Explorer Downloading altmetric data 49 Click here to watch the demo!
  50. 50. Practical applications of altmetrics Thanks! 50 Nicolas Robinson-Garcia You can find me at @nrobinsongarcia and http://nrobinsongarcia.com

×