SlideShare ist ein Scribd-Unternehmen logo
1 von 61
Downloaden Sie, um offline zu lesen
Scientific interactions
and research evaluation:
from bibliometrics to altmetrics
Stefanie Haustein
stefanie.haustein@umontreal.ca
@stefhaustein
crc.ebsi.umontreal.ca/sloan
Scientific Interactions
Research Evaluation
Opportunities & Challenges
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Invisible Colleges
Père Marin Mersenne
(1588-1648)
Henry Oldenburg
(1619-1677)
http://commons.wikimedia.org/wiki/File:Marin_mersenne.jpg#/media/File:Marin_mersenne.jpg
http://commons.wikimedia.org/wiki/File:Henry_Oldenburg.jpg
Invisible Colleges
Père Marin Mersenne
(1588-1648)
Henry Oldenburg
(1619-1677)
http://commons.wikimedia.org/wiki/File:Marin_mersenne.jpg#/media/File:Marin_mersenne.jpg
http://commons.wikimedia.org/wiki/File:Henry_Oldenburg.jpg
Information
Hubs
Scientific Societies
L’Académie royale des sciences
22 December 1666
The Royal Society
28 November 1660
http://upload.wikimedia.org/wikipedia/commons/thumb/6/61/Louis_XIV_und_Colbert_in_der_Akademie.jpg/640px-Louis_XIV_und_Colbert_in_der_Akademie.jpg
https://www.rcseng.ac.uk/museums/hunterian/images/lost-museums-2011/the-royal-society-repository/Image%201%20-%20GreshamCollege.jpg/image_preview
http://en.wikipedia.org/wiki/Nullius_in_verba#/media/File:Bookplate_of_the_Royal_Society_(Great_Britain).jpg
Scientific Societies
L’Académie royale des sciences
22 December 1666
The Royal Society
28 November 1660
http://upload.wikimedia.org/wikipedia/commons/thumb/6/61/Louis_XIV_und_Colbert_in_der_Akademie.jpg/640px-Louis_XIV_und_Colbert_in_der_Akademie.jpg
https://www.rcseng.ac.uk/museums/hunterian/images/lost-museums-2011/the-royal-society-repository/Image%201%20-%20GreshamCollege.jpg/image_preview
http://en.wikipedia.org/wiki/Nullius_in_verba#/media/File:Bookplate_of_the_Royal_Society_(Great_Britain).jpg
Institutionalization
of Science
Scientific Journals
Le journal des sçavans
5 January 1665
Philosophical Transactions
6 March 1665
http://de.wikipedia.org/wiki/Journal_des_s%C3%A7avans#/media/File:1665_journal_des_scavans_title.jpg
http://en.wikipedia.org/wiki/Philosophical_Transactions_of_the_Royal_Society#/media/File:Philosophical_Transactions_Volume_1_frontispiece.jpg
Scientific Journals
Le Journal des sçavans
5 January 1665
Philosophical Transactions
6 March 1665
http://de.wikipedia.org/wiki/Journal_des_s%C3%A7avans#/media/File:1665_journal_des_scavans_title.jpg
http://en.wikipedia.org/wiki/Philosophical_Transactions_of_the_Royal_Society#/media/File:Philosophical_Transactions_Volume_1_frontispiece.jpg
Registration
Certification
Dissemination
Archiving
Scientific Articles: 17th to Early 19th Century
•  Experiments and descriptions of the natural world
•  Avoiding “fine speaking”
•  Various styles of arguing
•  Qualitative and personal judgements
Harmon, J.E. & Gross, A.G. (2007). The Scientific Literature. A Guided Tour. Chicago: University of Chicago Press.
Modern Scientific Articles
•  Professionalized and highly specialized
•  Increased focus on data, graphs, tables and theory
•  Impersonal, technical and codified
•  Style guides and gatekeeping
•  Citations
•  Introduction, Methods, Results and Discussion
Larivière, V., Archambault, É. & Gingras, Y. (2008). Long-term variations in the aging of scientific literature: From exponential growth to steady-state science (1900-2004). Journal of the American
Society for Information Science and Technology, 59(2), 288-296.
Sollaci, L.B. & Pereira, M.G. (2004). The introduction, methods, results, and discussion (IMRAD) structure: a fifty-year survey. Journal of the Medical Library Association, 92(3), 364-371
Sollaci&Pereira(2004,p.365)
Proportion of IMRaD adoption in medical journalsNumber of references 1900 to 2004
Larivière,Archambaul&Gingras(2008,p.293)
arXiv submission statistics from http://arxiv.org/stats/monthly_submissions
Larivière, V., Lozano, G.A. & Gingras, Y. (2014). Are elite journals declining? Journal of the Association for Information Science and Technology, 65(4), 649-655.
•  Improved access
•  Acceleration
•  Collaboration
•  Peer review
•  Distribution of preprints
•  Decreasing importance of
scientific journals
•  Journal functions
•  Diversification of publication
venues
•  Appearance and symbolic
capital of journals unchanged
Digital Revolution
Submissions to arXiv
Share of top 1% most cited papers
Larivière,Lozano&Gingras(2014,p.652)
Academic Publishing Market
Larivière, V., Haustein, S. & Mongeon, P. (in press). The oligopoly of academic publishers in the digital era. PLoS ONE.
Larivière,Haustein&Mongeon(inpress)
•  Aggravation of
serials crisis
•  Elsevier: €3,400
subscription price,
30% increase
•  Profit margins of
commercial publishers
up to 40%
•  Decline of
scientific societies
as publishers
•  >50% of papers owned
by five major
publishers
Budapest Open Access Initiative
Open Access
“immediate, free availability on the public internet, permitting
any users to read, download, copy, distribute, print, search or
link to the full text of these articles”
Budapest Open Access Initiative (2002)
Archambaultetal.(2013,p.13)
Freely available journal papers 2004 to 2011
•  Gold and Green
•  Libre and Gratis
•  Hybrid journals
•  Elsevier: $500 to 5,000
•  Springer: $3,000
•  Wiley: $3,000
Archambault, É., Amyot, D., Deschamps, P., Nicol, A., Rebout, L. & Roberge, G. (2013). Proportion of Open Access Peer-Reviewed Papers at the European and World Levels 2004-2011. Report for
the European Commission. http://www.science-metrix.com/pdf/SM_EC_OA_Availability_2004-2011.pdf
Open Science
“opening up the research process by making all of its
outcomes, and the way in which these outcomes were
achieved, publicly available on the World Wide Web”
Kraker et al. (2011, p. 645)
Kraker, P., Leony, D., Reinhardt, W. & Beham, G. (2011). The case for an open science in technology enhanced learning. International Journal of Technology Enhanced Learning, 3(6), 643-654.
•  Open Data
•  Open Source
•  Open Methodology
•  Open Access
•  Open Peer Review
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Björneborn, L. & Ingwersen, P. (2004), Toward a basic framework for webometrics. Journal of the American Society for Information Science and Technology, 55(14), 1216–1227.
Definition of
Scholarly Metrics
adaptedfrom:Björneborn&Ingwersen(2004,p.1217)
informetrics
scientometrics
bibliometrics
cybermetrics
webometrics altmetrics
Otlet, P. (1934). Traité de documentation: le livre sur le livre, théorie et pratique.
Pritchard, P. (1927). Statistical bibliography or bibliometrics? Journal of Documentation, 25, 348-349..
Definition of
Scholarly Metrics
informetrics
scientometrics
bibliometrics
cybermetrics
webometrics altmetrics
“La «Bibliometrie» sera
la partie définie de la
Bibliologie qui s'occupe
de la mesure ou quantité
appliquée aux livres.”
“the application of
mathematics and
statistical methods to
books and other media
of communication”
Pritchard (1969, p. 348)
Otlet (1934, p. 14)
Priem, J. (2014). Altmetrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: harnessing multidimensional indicators of performance (pp. 263–287). Cambridge, MA: MIT Press.
Rousseau, R. & Ye, F. (2013). A multi-metric approach for research evaluation. Chinese Science Bulletin, 10–12. doi:10.1007/s11434-013-5939-3
informetrics
scientometrics
cybermetrics
webometrics altmetrics
“study and use of
scholarly impact
measures based on
activity in online tools
and environments”
“a good idea but a
bad name”
Rousseau & Ye (2013, p. 2)
Priem (2014, p. 266)
bibliometrics
Definition of
Scholarly Metrics
Definition of
Scholarly Metrics
informetrics
scientometrics
bibliometrics
cybermetrics
webometrics altmetrics
scholarly metrics
Scholarly metrics are
metrics based on acts
and events (e.g.,
viewing, reading, saving,
diffusing, mentioning,
citing, reusing, modifying)
related to scholarly
documents (e.g.,
papers, blog posts,
datasets, code, notes)
or scholarly agents
(e.g., researchers,
universities, journals).
Gross, P.L.K. & Gross, E.M. (1927). College libraries and chemical education. Science, 66(1713), 385-389..
Citation analysis for objective collection management
Bibliometrics for
Library Mangement
Gross&Gross,1927,p.386
Journals cited in the Journal of the American Chemical Society 1926
Garfield, E. (1955). Citation indexes for science. A new dimension in documentation through association of ideas. Science, 122, 108-111.
Bibliometrics for
Information Retrieval
Retrieval tool to handle information overload
•  Institute for Scientific Information
•  Science Citation Index
•  Source Author Index
•  Citation Index
“It would not be excessive to demand that the
thorough scholar check all papers that have
cited or criticized such papers, if they could be
located quickly. The citation index makes this
check practicable.”
Garfield, 1955, p. 108
Derek J. de Solla Price
Science since Babylon (1961)
Little Science – Big Science (1963)
Bibliometrics for
Sociology of Science
Price, D. J. d. S. (1961). Science Since Babylon. New Haven / London: Yale University Press,
Price, D. J. d. S. (1963). Little Science, Big Science. New York: Columbia University Press.
Merton, R. K. (1988). The Matthew effect in science, II: Cumulative advantage and the symbolism of intellectual property. Isis, 79, 606–623.
Robert K. Merton
•  Social norms of science
•  Communalism
•  Universalism
•  Disinterestedness
•  Organized skepticism
•  Matthew effect
Bibliometrics for
Sociology of Science
“symbolically, [the reference] registers in the
enduring archives the intellectual property of
the acknowledged source by providing a
pellet of peer recognition of the knowledge
claim” Merton (1988, p. 621)
•  Performance measurement and policy instrument
•  Commercialization
Bibliometrics for
Research Evaluation
“When used properly, bibliometric indicators can provide a
‘monitoring device’ for university research-management and
science policy. They enable research policy-makers to ask
relevant questions of researchers on their scientific
performance, in order to find explanations of the bibliometric
results in terms of factors relevant to policy.”
Moed et al. (1985, p. 131)
Moed, H.F., Burger, W.J.M., Frankfort, J.G, van Raan, A.F.J. (1985). The use of bibliometric data for the measurement of university research performance. Research Policy, 14(3), 131-149.
•  Oversimplification
publications = productivity
citations = impact
•  Uninformed use and misuse
Impact Factor
h-index
•  Adverse effects
“salami” publishing
honorary authorship
self-citations
citation cartels
Bibliometrics for
Research Evaluation
Hvistendahl, M. (2013). China’s publication bazaar. Science, 342(6162), 1035-1039.
van Noorden, R. (2013). Brazilian citation scheme outed: Thomson Reuters suspends journals from its rankings for ‘citation stacking’, Nature, 500(7464), 510-511.
Criticism against current form of research evaluation
Ø  Alternative forms of research ouput
Ø  Alternative use and visibility of publications
Altmetrics
“We rely on filters to make sense of the scholarly literature, but the
narrow, traditional filters are being swamped. However, the growth of
new, online scholarly tools allows us to make new filters; these
altmetrics reflect the broad, rapid impact of scholarship in this
burgeoning ecosystem.”
…
Priem et al. (2010)
Information overload
…
Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Alt-metrics: a manifesto. October. Retrieved from http://altmetrics.org/manifesto/
Piwowar, H. A. (2013). Altmetrics: Value all research products. Nature, 493(7431), 159.
Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215.
(for Mendeley reader counts only: 2010-2012 PubMed/WoS papers)
Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830.
(for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI)
Altmetrics
What do we know?
%
Altmetrics
What do we know?
Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215.
(for Mendeley reader counts only: 2010-2012 PubMed/WoS papers)
Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830.
(for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI)
%
Altmetrics
What do we know?
Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215.
(for Mendeley reader counts only: 2010-2012 PubMed/WoS papers)
Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830.
(for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI)
%
Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830.
Altmetrics
What do we know?
Biomedical & Health Sciences
Social Sciences & Humanities
Life & Earth Sciences
Natural Sciences & Engineering
Mathematics & Computer Science
Twittercoverage
Documenttype
Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830.
Altmetrics
What do we know?
Biomedical & Health Sciences
Social Sciences & Humanities
Life & Earth Sciences
Natural Sciences & Engineering
Mathematics & Computer Science
Twittercoverage
Altmetrics
Highly tweeted
Altmetrics
Highly tweeted
Altmetrics
Highly tweeted
Altmetrics
Highly tweeted
Altmetrics
Altmetrics in the wild
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Meaning of metrics
Opportunities
•  Heterogenous users
•  Diverse motivations
Challenges
•  Understanding underlying processes
•  Determining the meaning of metrics
Meaning of metrics
Motivations and norms
Saving
to Mendeley
Mentioning
in News
Meaning of metrics
Motivations and norms
Recommending
on F1000
Tweeting
Meaning of metrics
Bertin, M., Atanassova, I., Gingras, Y., & Larivière, V. (in press). The invariant distribution of references in scientific articles. Journal of the Association for Information Science and Technology.
Bertin,Atanassova,Gingras&Larivière(inpress,p.13)
Distribution of references along the IMRaD structure
Citing in a
journal article
Meaning of Metrics
Haustein, S., Bowman, T.D. & Costas, R. (in press). Interpreting “altmetrics”: viewing acts on social media through the lens of citation and social theories. In Sugimoto , C.R. (Ed.). Theories of
Informetrics: A Festschrift in Honor of Blaise Cronin.
Acts leading to (online) events used for metrics
Haustein,Bowman&Costas(inpress,p.13)
RESEARCH
OBJECT
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Opportunities
•  Detailed life cycle of scientific output
•  Fine-grained indicators and adequate benchmarks
Challenges
•  Versions of research output
•  Publication dates
Time Analysis
Time Analysis
Journal article
•  Submitted manuscript
•  Revised manuscript
•  Accepted manuscript
•  Version of Record
•  Online publication
•  Journal issue
•  Online date
•  Issue month
Ø  Adjusting indicators
3 March 2014
15 July 2014
21 January 2015
February 2015
Time Analysis
Time Analysis
Haustein, S., Bowman, T.D. & Costas, R. (in press). When is an article actually published? An analysis of online availability, publication, and indexation dates. Proceedings of the 15th International
Conference on Scientometrics and Informetrics, Istanbul, Turkey.
Tweets before publication?
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Communities of Attention
Opportunity
•  Differentiating between types of use
•  Measuring social impact
Challenges
•  Determining engagement
•  Identifying users
Level of engagement on Twitter
Communities of Attention
!Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R. & Larivière, V. (in press), Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter.
Journal of the Association for Information Science and Technology. doi: 10.1002/asi.23456
Communities of Attention
Automated Twitter bots
Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R. & Larivière, V. (in press), Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter.
Journal of the Association for Information Science and Technology. doi: 10.1002/asi.23456
tweeting preprints
from arXiv subject
area
tweeting topic-
relevant papers
selection of
interesting papers
Communities of Attention
exposure
engagement
median dissimilarity with paper title
mediannumberoffollowers
influencers /
brokers
orators /
discussing
disseminators /
mumblers
broadcasters
tweet text differs
from paper title
tweet text is identical
to paper title
few followers many followers
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Communities of Attention
708 of 125,083 users (0.6%) tweeting
WoS papers published in 2012 (>100)
Node size represents number of papers
Network of users tweeting the same papers
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Communities of Attention
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Communities of Attention
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Communities of Attention
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Communities of Attention
Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015,
Toronto, Canada.
Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015
Outlook
Sociological research.
Scientometric studies.
Avoid adverse effects.
Stefanie Haustein
Thank you for your attention!
Questions?
stefanie.haustein@umontreal.ca
@stefhaustein
crc.ebsi.umontreal.ca/sloan
Thank you for your attention!

Más contenido relacionado

Was ist angesagt?

Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...
Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...
Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...Stefanie Haustein
 
Altmetrics Overview
Altmetrics OverviewAltmetrics Overview
Altmetrics OverviewPaul Groth
 
Altmetrics - Measuring the impact of scientific activities
Altmetrics - Measuring the impact of scientific activitiesAltmetrics - Measuring the impact of scientific activities
Altmetrics - Measuring the impact of scientific activitiesKim Holmberg
 
Altmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputAltmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputRobin Featherstone
 
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research ImpactTweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research ImpactRobin Featherstone
 
Automated arXiv feeds on Twitter: On the role of bots in scholarly communication
Automated arXiv feeds on Twitter:On the role of bots in scholarly communicationAutomated arXiv feeds on Twitter:On the role of bots in scholarly communication
Automated arXiv feeds on Twitter: On the role of bots in scholarly communicationStefanie Haustein
 
Empirical analyses of scientific papers and researchers on Twitter: Results...
 	Empirical analyses of scientific papers and researchers on Twitter: Results... 	Empirical analyses of scientific papers and researchers on Twitter: Results...
Empirical analyses of scientific papers and researchers on Twitter: Results...Stefanie Haustein
 
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter BinfieldPeter Binfield
 
Altmetrics for Showing Research Impact
Altmetrics for Showing Research ImpactAltmetrics for Showing Research Impact
Altmetrics for Showing Research ImpactRobin Featherstone
 
From socially to scholarly and back again
From socially to scholarly and back againFrom socially to scholarly and back again
From socially to scholarly and back againKudos
 
COVID-19 and Changing Paradigm in Scholarly communication
COVID-19 and Changing Paradigm in Scholarly communication COVID-19 and Changing Paradigm in Scholarly communication
COVID-19 and Changing Paradigm in Scholarly communication Vasantha Raju N
 
Altmetric: Getting Started with Article-Level Metrics
Altmetric: Getting Started with Article-Level MetricsAltmetric: Getting Started with Article-Level Metrics
Altmetric: Getting Started with Article-Level MetricsAltmetric
 
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...Jason Price, PhD
 
Altmetrics for research: impact measurement &#hcsm
Altmetrics for research: impact measurement &#hcsmAltmetrics for research: impact measurement &#hcsm
Altmetrics for research: impact measurement &#hcsmRobin Featherstone
 
When will librarians start research support with altmetrics to their research...
When will librarians start research support with altmetrics to their research...When will librarians start research support with altmetrics to their research...
When will librarians start research support with altmetrics to their research...Keita Bando
 
Are the scientists on to something altmetrics 6 16
Are the scientists on to something altmetrics 6 16Are the scientists on to something altmetrics 6 16
Are the scientists on to something altmetrics 6 16Katie Brown
 
From Theory to Practice: Can Opennesss Improve the Quality of OER Research?
From Theory to Practice: Can Opennesss Improve the Quality of OER Research? From Theory to Practice: Can Opennesss Improve the Quality of OER Research?
From Theory to Practice: Can Opennesss Improve the Quality of OER Research? Beck Pitt
 

Was ist angesagt? (20)

Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...
Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...
Haustein, Paul-Hus, Sugimoto & Larivière (2016). Is the gender gap in science...
 
Altmetrics Overview
Altmetrics OverviewAltmetrics Overview
Altmetrics Overview
 
Altmetrics - Measuring the impact of scientific activities
Altmetrics - Measuring the impact of scientific activitiesAltmetrics - Measuring the impact of scientific activities
Altmetrics - Measuring the impact of scientific activities
 
Altmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputAltmetrics for Measuring Research Output
Altmetrics for Measuring Research Output
 
NISO Webinar: Beyond Publish or Perish: Alternative Metrics for Scholarship
NISO Webinar: Beyond Publish or Perish: Alternative Metrics for ScholarshipNISO Webinar: Beyond Publish or Perish: Alternative Metrics for Scholarship
NISO Webinar: Beyond Publish or Perish: Alternative Metrics for Scholarship
 
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research ImpactTweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
Tweet Your Pubs: How Altmetrics are Changing the Way We Measure Research Impact
 
Automated arXiv feeds on Twitter: On the role of bots in scholarly communication
Automated arXiv feeds on Twitter:On the role of bots in scholarly communicationAutomated arXiv feeds on Twitter:On the role of bots in scholarly communication
Automated arXiv feeds on Twitter: On the role of bots in scholarly communication
 
Empirical analyses of scientific papers and researchers on Twitter: Results...
 	Empirical analyses of scientific papers and researchers on Twitter: Results... 	Empirical analyses of scientific papers and researchers on Twitter: Results...
Empirical analyses of scientific papers and researchers on Twitter: Results...
 
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield
"PLoS ONE and the Rise of the Open Access Mega Journal" by Peter Binfield
 
Altmetrics for Showing Research Impact
Altmetrics for Showing Research ImpactAltmetrics for Showing Research Impact
Altmetrics for Showing Research Impact
 
From socially to scholarly and back again
From socially to scholarly and back againFrom socially to scholarly and back again
From socially to scholarly and back again
 
COVID-19 and Changing Paradigm in Scholarly communication
COVID-19 and Changing Paradigm in Scholarly communication COVID-19 and Changing Paradigm in Scholarly communication
COVID-19 and Changing Paradigm in Scholarly communication
 
Where to publish
Where to publish Where to publish
Where to publish
 
Altmetric: Getting Started with Article-Level Metrics
Altmetric: Getting Started with Article-Level MetricsAltmetric: Getting Started with Article-Level Metrics
Altmetric: Getting Started with Article-Level Metrics
 
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...
Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...
 
Altmetrics for research: impact measurement &#hcsm
Altmetrics for research: impact measurement &#hcsmAltmetrics for research: impact measurement &#hcsm
Altmetrics for research: impact measurement &#hcsm
 
Altmetrics
AltmetricsAltmetrics
Altmetrics
 
When will librarians start research support with altmetrics to their research...
When will librarians start research support with altmetrics to their research...When will librarians start research support with altmetrics to their research...
When will librarians start research support with altmetrics to their research...
 
Are the scientists on to something altmetrics 6 16
Are the scientists on to something altmetrics 6 16Are the scientists on to something altmetrics 6 16
Are the scientists on to something altmetrics 6 16
 
From Theory to Practice: Can Opennesss Improve the Quality of OER Research?
From Theory to Practice: Can Opennesss Improve the Quality of OER Research? From Theory to Practice: Can Opennesss Improve the Quality of OER Research?
From Theory to Practice: Can Opennesss Improve the Quality of OER Research?
 

Andere mochten auch

Impact of Web 2.0 on Scholarly Communication
Impact of Web 2.0 on Scholarly CommunicationImpact of Web 2.0 on Scholarly Communication
Impact of Web 2.0 on Scholarly CommunicationMeik Poschen
 
Bibliometric indicators of quality?
Bibliometric indicators of quality?Bibliometric indicators of quality?
Bibliometric indicators of quality?Lorna Wildgaard
 
Altmetrics 2015 jan
Altmetrics 2015 janAltmetrics 2015 jan
Altmetrics 2015 janCMHSL
 
Citation impact: an introduction to bibliometrics for researchers
Citation impact: an introduction to bibliometrics for researchersCitation impact: an introduction to bibliometrics for researchers
Citation impact: an introduction to bibliometrics for researchersucclibrarybibliometrics
 
Interactions 09 Object Oriented Approach To Design--OAD
Interactions 09 Object Oriented Approach To Design--OADInteractions 09 Object Oriented Approach To Design--OAD
Interactions 09 Object Oriented Approach To Design--OADNick Iozzo
 
Qualitative research by Dr. Subraham Pany
Qualitative research by Dr. Subraham PanyQualitative research by Dr. Subraham Pany
Qualitative research by Dr. Subraham PanySubraham Pany
 
Cost of quality concept and advantages
Cost of quality   concept and advantagesCost of quality   concept and advantages
Cost of quality concept and advantagesImran Jamil
 
Ethics in qualitative research
Ethics in qualitative researchEthics in qualitative research
Ethics in qualitative researchIrina Bobeică
 
"Phenomenology, Methodology, and Theory"
"Phenomenology, Methodology, and Theory""Phenomenology, Methodology, and Theory"
"Phenomenology, Methodology, and Theory"David Rosenthal
 
Types of interactions
Types of interactionsTypes of interactions
Types of interactionsjdrinks
 
Research Methodology - types of scale
Research Methodology - types of scaleResearch Methodology - types of scale
Research Methodology - types of scaleKarpagam Alagappan
 
Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IJames Neill
 
07 09 04 Ctqi Standard
07 09 04 Ctqi Standard07 09 04 Ctqi Standard
07 09 04 Ctqi StandardKieran F Ring
 
Research Methodology
Research MethodologyResearch Methodology
Research Methodologysh_neha252
 

Andere mochten auch (20)

Impact of Web 2.0 on Scholarly Communication
Impact of Web 2.0 on Scholarly CommunicationImpact of Web 2.0 on Scholarly Communication
Impact of Web 2.0 on Scholarly Communication
 
Bibliometric indicators of quality?
Bibliometric indicators of quality?Bibliometric indicators of quality?
Bibliometric indicators of quality?
 
Altmetrics 2015 jan
Altmetrics 2015 janAltmetrics 2015 jan
Altmetrics 2015 jan
 
Citation impact: an introduction to bibliometrics for researchers
Citation impact: an introduction to bibliometrics for researchersCitation impact: an introduction to bibliometrics for researchers
Citation impact: an introduction to bibliometrics for researchers
 
Measuring research impact with bibliometrics
Measuring research impact with bibliometricsMeasuring research impact with bibliometrics
Measuring research impact with bibliometrics
 
Interactions 09 Object Oriented Approach To Design--OAD
Interactions 09 Object Oriented Approach To Design--OADInteractions 09 Object Oriented Approach To Design--OAD
Interactions 09 Object Oriented Approach To Design--OAD
 
Qualitative research by Dr. Subraham Pany
Qualitative research by Dr. Subraham PanyQualitative research by Dr. Subraham Pany
Qualitative research by Dr. Subraham Pany
 
Cost of quality concept and advantages
Cost of quality   concept and advantagesCost of quality   concept and advantages
Cost of quality concept and advantages
 
Ethics in qualitative research
Ethics in qualitative researchEthics in qualitative research
Ethics in qualitative research
 
Cost of quality
Cost of qualityCost of quality
Cost of quality
 
"Phenomenology, Methodology, and Theory"
"Phenomenology, Methodology, and Theory""Phenomenology, Methodology, and Theory"
"Phenomenology, Methodology, and Theory"
 
Types of interactions
Types of interactionsTypes of interactions
Types of interactions
 
Ethnographic research (2)
Ethnographic research (2)Ethnographic research (2)
Ethnographic research (2)
 
Research Methodology - types of scale
Research Methodology - types of scaleResearch Methodology - types of scale
Research Methodology - types of scale
 
Multiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA IMultiple Linear Regression II and ANOVA I
Multiple Linear Regression II and ANOVA I
 
Cost of quality
Cost of qualityCost of quality
Cost of quality
 
07 09 04 Ctqi Standard
07 09 04 Ctqi Standard07 09 04 Ctqi Standard
07 09 04 Ctqi Standard
 
Qualitative Research Methods
Qualitative Research MethodsQualitative Research Methods
Qualitative Research Methods
 
Qualitative Research
Qualitative ResearchQualitative Research
Qualitative Research
 
Research Methodology
Research MethodologyResearch Methodology
Research Methodology
 

Ähnlich wie Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015

Haustein, S. (2017). The evolution of scholarly communication and the reward ...
Haustein, S. (2017). The evolution of scholarly communication and the reward ...Haustein, S. (2017). The evolution of scholarly communication and the reward ...
Haustein, S. (2017). The evolution of scholarly communication and the reward ...Stefanie Haustein
 
Open Research and Archaeology
Open Research and ArchaeologyOpen Research and Archaeology
Open Research and ArchaeologyCrossref
 
Leveraging network of repositories to create changes in scholarly communication
Leveraging network of repositories to create changes in scholarly communicationLeveraging network of repositories to create changes in scholarly communication
Leveraging network of repositories to create changes in scholarly communicationLeslie Chan
 
Open Access Advantages, Quality and Progress of the Research
Open Access Advantages, Quality and Progress of the ResearchOpen Access Advantages, Quality and Progress of the Research
Open Access Advantages, Quality and Progress of the ResearchIryna Kuchma
 
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014 Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014 eswcsummerschool
 
Rebecca Grant DPASSH presentation 2015
Rebecca Grant DPASSH presentation 2015Rebecca Grant DPASSH presentation 2015
Rebecca Grant DPASSH presentation 2015dri_ireland
 
Scientific Communication Before and After Networked Science
Scientific Communication Before and After Networked ScienceScientific Communication Before and After Networked Science
Scientific Communication Before and After Networked ScienceJohnC_HPL
 
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...Wouter Beek
 
Rare (and emergent) disciplines in the light of science studies
Rare (and emergent) disciplines in the light of science studiesRare (and emergent) disciplines in the light of science studies
Rare (and emergent) disciplines in the light of science studiesAndrea Scharnhorst
 
Academic libraries, open access, institutional repositories, and the public good
Academic libraries, open access, institutional repositories, and the public goodAcademic libraries, open access, institutional repositories, and the public good
Academic libraries, open access, institutional repositories, and the public goodSarah Sutton
 
Remapping the Global and Local in Knowledge Production: Roles of Open Access
Remapping the Global and Local in Knowledge Production: Roles of Open AccessRemapping the Global and Local in Knowledge Production: Roles of Open Access
Remapping the Global and Local in Knowledge Production: Roles of Open AccessLeslie Chan
 
Explore open access books - Springer Nature & Digital Science event in Boston...
Explore open access books - Springer Nature & Digital Science event in Boston...Explore open access books - Springer Nature & Digital Science event in Boston...
Explore open access books - Springer Nature & Digital Science event in Boston...Springer Nature
 
Open Science - Paradigm Shift or Revival of Old Ideas?
Open Science - Paradigm Shift or Revival of Old Ideas?Open Science - Paradigm Shift or Revival of Old Ideas?
Open Science - Paradigm Shift or Revival of Old Ideas?Heidi Laine
 
Democratizing Knowledge Through Open Science #pdf2016
Democratizing Knowledge Through Open Science #pdf2016Democratizing Knowledge Through Open Science #pdf2016
Democratizing Knowledge Through Open Science #pdf2016Fundacja ePaństwo
 
FRBR, Physics, And The World Wide Web
FRBR, Physics, And The World Wide WebFRBR, Physics, And The World Wide Web
FRBR, Physics, And The World Wide WebRonald Murray
 
Scientific information retrieval: Challenges and opportunities
Scientific information retrieval: Challenges and opportunitiesScientific information retrieval: Challenges and opportunities
Scientific information retrieval: Challenges and opportunitiesLudo Waltman
 
Serving the Biomedical Research Community
Serving the Biomedical Research CommunityServing the Biomedical Research Community
Serving the Biomedical Research CommunityMelissa Rethlefsen
 

Ähnlich wie Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015 (20)

Haustein, S. (2017). The evolution of scholarly communication and the reward ...
Haustein, S. (2017). The evolution of scholarly communication and the reward ...Haustein, S. (2017). The evolution of scholarly communication and the reward ...
Haustein, S. (2017). The evolution of scholarly communication and the reward ...
 
Open Research and Archaeology
Open Research and ArchaeologyOpen Research and Archaeology
Open Research and Archaeology
 
Leveraging network of repositories to create changes in scholarly communication
Leveraging network of repositories to create changes in scholarly communicationLeveraging network of repositories to create changes in scholarly communication
Leveraging network of repositories to create changes in scholarly communication
 
LIS DREaM 1 Keynote: “… And into the zone of quasi-rationality”
LIS DREaM 1 Keynote: “… And into the zone of quasi-rationality”LIS DREaM 1 Keynote: “… And into the zone of quasi-rationality”
LIS DREaM 1 Keynote: “… And into the zone of quasi-rationality”
 
Open Access Advantages, Quality and Progress of the Research
Open Access Advantages, Quality and Progress of the ResearchOpen Access Advantages, Quality and Progress of the Research
Open Access Advantages, Quality and Progress of the Research
 
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014 Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014
Keynote: Conflicting Cultures of Knowledge - D. Oldman - ESWC SS 2014
 
Rebecca Grant DPASSH presentation 2015
Rebecca Grant DPASSH presentation 2015Rebecca Grant DPASSH presentation 2015
Rebecca Grant DPASSH presentation 2015
 
Scientific Communication Before and After Networked Science
Scientific Communication Before and After Networked ScienceScientific Communication Before and After Networked Science
Scientific Communication Before and After Networked Science
 
Fundamentals of research methodology on primary and secondary sources in the ...
Fundamentals of research methodology on primary and secondary sources in the ...Fundamentals of research methodology on primary and secondary sources in the ...
Fundamentals of research methodology on primary and secondary sources in the ...
 
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...
Dutch Book Trade 1660-1750: using the STCN to gain insight in publishers’ str...
 
Rare (and emergent) disciplines in the light of science studies
Rare (and emergent) disciplines in the light of science studiesRare (and emergent) disciplines in the light of science studies
Rare (and emergent) disciplines in the light of science studies
 
Academic libraries, open access, institutional repositories, and the public good
Academic libraries, open access, institutional repositories, and the public goodAcademic libraries, open access, institutional repositories, and the public good
Academic libraries, open access, institutional repositories, and the public good
 
Remapping the Global and Local in Knowledge Production: Roles of Open Access
Remapping the Global and Local in Knowledge Production: Roles of Open AccessRemapping the Global and Local in Knowledge Production: Roles of Open Access
Remapping the Global and Local in Knowledge Production: Roles of Open Access
 
Explore open access books - Springer Nature & Digital Science event in Boston...
Explore open access books - Springer Nature & Digital Science event in Boston...Explore open access books - Springer Nature & Digital Science event in Boston...
Explore open access books - Springer Nature & Digital Science event in Boston...
 
The Virtual Research Environment and Libraries
The Virtual Research Environment and LibrariesThe Virtual Research Environment and Libraries
The Virtual Research Environment and Libraries
 
Open Science - Paradigm Shift or Revival of Old Ideas?
Open Science - Paradigm Shift or Revival of Old Ideas?Open Science - Paradigm Shift or Revival of Old Ideas?
Open Science - Paradigm Shift or Revival of Old Ideas?
 
Democratizing Knowledge Through Open Science #pdf2016
Democratizing Knowledge Through Open Science #pdf2016Democratizing Knowledge Through Open Science #pdf2016
Democratizing Knowledge Through Open Science #pdf2016
 
FRBR, Physics, And The World Wide Web
FRBR, Physics, And The World Wide WebFRBR, Physics, And The World Wide Web
FRBR, Physics, And The World Wide Web
 
Scientific information retrieval: Challenges and opportunities
Scientific information retrieval: Challenges and opportunitiesScientific information retrieval: Challenges and opportunities
Scientific information retrieval: Challenges and opportunities
 
Serving the Biomedical Research Community
Serving the Biomedical Research CommunityServing the Biomedical Research Community
Serving the Biomedical Research Community
 

Mehr von Stefanie Haustein

Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...
Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...
Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...Stefanie Haustein
 
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...Stefanie Haustein
 
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...Stefanie Haustein
 
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...Stefanie Haustein
 
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...Lés médias sociaux dans la communication et l'évaluation scientifique : résul...
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...Stefanie Haustein
 
Communities of attention' around journal papers: Who is tweeting about scient...
Communities of attention' around journal papers: Who is tweeting about scient...Communities of attention' around journal papers: Who is tweeting about scient...
Communities of attention' around journal papers: Who is tweeting about scient...Stefanie Haustein
 
When is an article actually published? An analysis of online availability, pu...
When is an article actually published? An analysis of online availability, pu...When is an article actually published? An analysis of online availability, pu...
When is an article actually published? An analysis of online availability, pu...Stefanie Haustein
 
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...Stefanie Haustein
 
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...Stefanie Haustein
 
The heterogeneity of social media metrics and its effects on statistics
The heterogeneity of social media metrics and its effects on statisticsThe heterogeneity of social media metrics and its effects on statistics
The heterogeneity of social media metrics and its effects on statisticsStefanie Haustein
 
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...Stefanie Haustein
 
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...Stefanie Haustein
 

Mehr von Stefanie Haustein (12)

Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...
Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...
Scholarly Twitter metrics: How, when and what does the Twittersphere tweet ab...
 
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...
Haustein, S. (2017). Temporalité et publication savante : le cycle de vie des...
 
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...
Haustein, S., Smith, E., Mongeon, P., Shu, F., & Larivière, V. (2016): Access...
 
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...
Haustein, S. (2016). Les « altmetrics » et les médias sociaux dans la communi...
 
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...Lés médias sociaux dans la communication et l'évaluation scientifique : résul...
Lés médias sociaux dans la communication et l'évaluation scientifique : résul...
 
Communities of attention' around journal papers: Who is tweeting about scient...
Communities of attention' around journal papers: Who is tweeting about scient...Communities of attention' around journal papers: Who is tweeting about scient...
Communities of attention' around journal papers: Who is tweeting about scient...
 
When is an article actually published? An analysis of online availability, pu...
When is an article actually published? An analysis of online availability, pu...When is an article actually published? An analysis of online availability, pu...
When is an article actually published? An analysis of online availability, pu...
 
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...
Altmetrics: opportunités et défis associés à l’usage des médias sociaux dans ...
 
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...
Mendeley as a Source of Readership by Students and Postdocs? Evaluating Ar...
 
The heterogeneity of social media metrics and its effects on statistics
The heterogeneity of social media metrics and its effects on statisticsThe heterogeneity of social media metrics and its effects on statistics
The heterogeneity of social media metrics and its effects on statistics
 
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...
Stefanie Haustein, Timothy D. Bowman, Benoît Macaluso, Cassidy R. Sugimoto &...
 
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
 

Último

Brain Tumor Detection with Machine Learning.pptx
Brain Tumor Detection with Machine Learning.pptxBrain Tumor Detection with Machine Learning.pptx
Brain Tumor Detection with Machine Learning.pptxShammiRai3
 
How to Build an Experimentation Culture for Data-Driven Product Development
How to Build an Experimentation Culture for Data-Driven Product DevelopmentHow to Build an Experimentation Culture for Data-Driven Product Development
How to Build an Experimentation Culture for Data-Driven Product DevelopmentAggregage
 
Báo cáo Social Media Benchmark 2024 cho dân Marketing
Báo cáo Social Media Benchmark 2024 cho dân MarketingBáo cáo Social Media Benchmark 2024 cho dân Marketing
Báo cáo Social Media Benchmark 2024 cho dân MarketingMarketingTrips
 
Data Collection from Social Media Platforms
Data Collection from Social Media PlatformsData Collection from Social Media Platforms
Data Collection from Social Media PlatformsMahmoud Yasser
 
Unleashing Datas Potential - Mastering Precision with FCO-IM
Unleashing Datas Potential - Mastering Precision with FCO-IMUnleashing Datas Potential - Mastering Precision with FCO-IM
Unleashing Datas Potential - Mastering Precision with FCO-IMMarco Wobben
 
The market for cross-border mortgages in Europe
The market for cross-border mortgages in EuropeThe market for cross-border mortgages in Europe
The market for cross-border mortgages in Europe321k
 
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptxSTOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptxFurkanTasci3
 
2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-ProfitsTimothy Spann
 
Empowering Decisions A Guide to Embedded Analytics
Empowering Decisions A Guide to Embedded AnalyticsEmpowering Decisions A Guide to Embedded Analytics
Empowering Decisions A Guide to Embedded AnalyticsGain Insights
 
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptxSTOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptxFurkanTasci3
 
TCFPro24 Building Real-Time Generative AI Pipelines
TCFPro24 Building Real-Time Generative AI PipelinesTCFPro24 Building Real-Time Generative AI Pipelines
TCFPro24 Building Real-Time Generative AI PipelinesTimothy Spann
 
Data Analytics Fundamentals: data analytics types.potx
Data Analytics Fundamentals: data analytics types.potxData Analytics Fundamentals: data analytics types.potx
Data Analytics Fundamentals: data analytics types.potxEmmanuel Dauda
 
Stochastic Dynamic Programming and You.pptx
Stochastic Dynamic Programming and You.pptxStochastic Dynamic Programming and You.pptx
Stochastic Dynamic Programming and You.pptxjkmrshll88
 
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdf
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdfNeo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdf
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdfNeo4j
 
Using DAX & Time-based Analysis in Data Warehouse
Using DAX & Time-based Analysis in Data WarehouseUsing DAX & Time-based Analysis in Data Warehouse
Using DAX & Time-based Analysis in Data WarehouseThinkInnovation
 
Bengaluru Tableau UG event- 2nd March 2024 Q1
Bengaluru Tableau UG event- 2nd March 2024 Q1Bengaluru Tableau UG event- 2nd March 2024 Q1
Bengaluru Tableau UG event- 2nd March 2024 Q1bengalurutug
 
Air Con Energy Rating Info411 Presentation.pdf
Air Con Energy Rating Info411 Presentation.pdfAir Con Energy Rating Info411 Presentation.pdf
Air Con Energy Rating Info411 Presentation.pdfJasonBoboKyaw
 
Microeconomic Group Presentation Apple.pdf
Microeconomic Group Presentation Apple.pdfMicroeconomic Group Presentation Apple.pdf
Microeconomic Group Presentation Apple.pdfmxlos0
 
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...ferisulianta.com
 
PPT for Presiding Officer.pptxvvdffdfgggg
PPT for Presiding Officer.pptxvvdffdfggggPPT for Presiding Officer.pptxvvdffdfgggg
PPT for Presiding Officer.pptxvvdffdfggggbhadratanusenapati1
 

Último (20)

Brain Tumor Detection with Machine Learning.pptx
Brain Tumor Detection with Machine Learning.pptxBrain Tumor Detection with Machine Learning.pptx
Brain Tumor Detection with Machine Learning.pptx
 
How to Build an Experimentation Culture for Data-Driven Product Development
How to Build an Experimentation Culture for Data-Driven Product DevelopmentHow to Build an Experimentation Culture for Data-Driven Product Development
How to Build an Experimentation Culture for Data-Driven Product Development
 
Báo cáo Social Media Benchmark 2024 cho dân Marketing
Báo cáo Social Media Benchmark 2024 cho dân MarketingBáo cáo Social Media Benchmark 2024 cho dân Marketing
Báo cáo Social Media Benchmark 2024 cho dân Marketing
 
Data Collection from Social Media Platforms
Data Collection from Social Media PlatformsData Collection from Social Media Platforms
Data Collection from Social Media Platforms
 
Unleashing Datas Potential - Mastering Precision with FCO-IM
Unleashing Datas Potential - Mastering Precision with FCO-IMUnleashing Datas Potential - Mastering Precision with FCO-IM
Unleashing Datas Potential - Mastering Precision with FCO-IM
 
The market for cross-border mortgages in Europe
The market for cross-border mortgages in EuropeThe market for cross-border mortgages in Europe
The market for cross-border mortgages in Europe
 
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptxSTOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
 
2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits2024 Build Generative AI for Non-Profits
2024 Build Generative AI for Non-Profits
 
Empowering Decisions A Guide to Embedded Analytics
Empowering Decisions A Guide to Embedded AnalyticsEmpowering Decisions A Guide to Embedded Analytics
Empowering Decisions A Guide to Embedded Analytics
 
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptxSTOCK PRICE ANALYSIS  Furkan Ali TASCI --.pptx
STOCK PRICE ANALYSIS Furkan Ali TASCI --.pptx
 
TCFPro24 Building Real-Time Generative AI Pipelines
TCFPro24 Building Real-Time Generative AI PipelinesTCFPro24 Building Real-Time Generative AI Pipelines
TCFPro24 Building Real-Time Generative AI Pipelines
 
Data Analytics Fundamentals: data analytics types.potx
Data Analytics Fundamentals: data analytics types.potxData Analytics Fundamentals: data analytics types.potx
Data Analytics Fundamentals: data analytics types.potx
 
Stochastic Dynamic Programming and You.pptx
Stochastic Dynamic Programming and You.pptxStochastic Dynamic Programming and You.pptx
Stochastic Dynamic Programming and You.pptx
 
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdf
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdfNeo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdf
Neo4j Graph Summit 2024 Workshop - EMEA - Breda_and_Munchen.pdf
 
Using DAX & Time-based Analysis in Data Warehouse
Using DAX & Time-based Analysis in Data WarehouseUsing DAX & Time-based Analysis in Data Warehouse
Using DAX & Time-based Analysis in Data Warehouse
 
Bengaluru Tableau UG event- 2nd March 2024 Q1
Bengaluru Tableau UG event- 2nd March 2024 Q1Bengaluru Tableau UG event- 2nd March 2024 Q1
Bengaluru Tableau UG event- 2nd March 2024 Q1
 
Air Con Energy Rating Info411 Presentation.pdf
Air Con Energy Rating Info411 Presentation.pdfAir Con Energy Rating Info411 Presentation.pdf
Air Con Energy Rating Info411 Presentation.pdf
 
Microeconomic Group Presentation Apple.pdf
Microeconomic Group Presentation Apple.pdfMicroeconomic Group Presentation Apple.pdf
Microeconomic Group Presentation Apple.pdf
 
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...
Prediction Of Cryptocurrency Prices Using Lstm, Svm And Polynomial Regression...
 
PPT for Presiding Officer.pptxvvdffdfgggg
PPT for Presiding Officer.pptxvvdffdfggggPPT for Presiding Officer.pptxvvdffdfgggg
PPT for Presiding Officer.pptxvvdffdfgggg
 

Scientific Interactions and Research Evaluation: From Bibliometrics to Altmetrics - Keynote ISI2015

  • 1. Scientific interactions and research evaluation: from bibliometrics to altmetrics Stefanie Haustein stefanie.haustein@umontreal.ca @stefhaustein crc.ebsi.umontreal.ca/sloan
  • 4. Invisible Colleges Père Marin Mersenne (1588-1648) Henry Oldenburg (1619-1677) http://commons.wikimedia.org/wiki/File:Marin_mersenne.jpg#/media/File:Marin_mersenne.jpg http://commons.wikimedia.org/wiki/File:Henry_Oldenburg.jpg
  • 5. Invisible Colleges Père Marin Mersenne (1588-1648) Henry Oldenburg (1619-1677) http://commons.wikimedia.org/wiki/File:Marin_mersenne.jpg#/media/File:Marin_mersenne.jpg http://commons.wikimedia.org/wiki/File:Henry_Oldenburg.jpg Information Hubs
  • 6. Scientific Societies L’Académie royale des sciences 22 December 1666 The Royal Society 28 November 1660 http://upload.wikimedia.org/wikipedia/commons/thumb/6/61/Louis_XIV_und_Colbert_in_der_Akademie.jpg/640px-Louis_XIV_und_Colbert_in_der_Akademie.jpg https://www.rcseng.ac.uk/museums/hunterian/images/lost-museums-2011/the-royal-society-repository/Image%201%20-%20GreshamCollege.jpg/image_preview http://en.wikipedia.org/wiki/Nullius_in_verba#/media/File:Bookplate_of_the_Royal_Society_(Great_Britain).jpg
  • 7. Scientific Societies L’Académie royale des sciences 22 December 1666 The Royal Society 28 November 1660 http://upload.wikimedia.org/wikipedia/commons/thumb/6/61/Louis_XIV_und_Colbert_in_der_Akademie.jpg/640px-Louis_XIV_und_Colbert_in_der_Akademie.jpg https://www.rcseng.ac.uk/museums/hunterian/images/lost-museums-2011/the-royal-society-repository/Image%201%20-%20GreshamCollege.jpg/image_preview http://en.wikipedia.org/wiki/Nullius_in_verba#/media/File:Bookplate_of_the_Royal_Society_(Great_Britain).jpg Institutionalization of Science
  • 8. Scientific Journals Le journal des sçavans 5 January 1665 Philosophical Transactions 6 March 1665 http://de.wikipedia.org/wiki/Journal_des_s%C3%A7avans#/media/File:1665_journal_des_scavans_title.jpg http://en.wikipedia.org/wiki/Philosophical_Transactions_of_the_Royal_Society#/media/File:Philosophical_Transactions_Volume_1_frontispiece.jpg
  • 9. Scientific Journals Le Journal des sçavans 5 January 1665 Philosophical Transactions 6 March 1665 http://de.wikipedia.org/wiki/Journal_des_s%C3%A7avans#/media/File:1665_journal_des_scavans_title.jpg http://en.wikipedia.org/wiki/Philosophical_Transactions_of_the_Royal_Society#/media/File:Philosophical_Transactions_Volume_1_frontispiece.jpg Registration Certification Dissemination Archiving
  • 10. Scientific Articles: 17th to Early 19th Century •  Experiments and descriptions of the natural world •  Avoiding “fine speaking” •  Various styles of arguing •  Qualitative and personal judgements Harmon, J.E. & Gross, A.G. (2007). The Scientific Literature. A Guided Tour. Chicago: University of Chicago Press.
  • 11. Modern Scientific Articles •  Professionalized and highly specialized •  Increased focus on data, graphs, tables and theory •  Impersonal, technical and codified •  Style guides and gatekeeping •  Citations •  Introduction, Methods, Results and Discussion Larivière, V., Archambault, É. & Gingras, Y. (2008). Long-term variations in the aging of scientific literature: From exponential growth to steady-state science (1900-2004). Journal of the American Society for Information Science and Technology, 59(2), 288-296. Sollaci, L.B. & Pereira, M.G. (2004). The introduction, methods, results, and discussion (IMRAD) structure: a fifty-year survey. Journal of the Medical Library Association, 92(3), 364-371 Sollaci&Pereira(2004,p.365) Proportion of IMRaD adoption in medical journalsNumber of references 1900 to 2004 Larivière,Archambaul&Gingras(2008,p.293)
  • 12. arXiv submission statistics from http://arxiv.org/stats/monthly_submissions Larivière, V., Lozano, G.A. & Gingras, Y. (2014). Are elite journals declining? Journal of the Association for Information Science and Technology, 65(4), 649-655. •  Improved access •  Acceleration •  Collaboration •  Peer review •  Distribution of preprints •  Decreasing importance of scientific journals •  Journal functions •  Diversification of publication venues •  Appearance and symbolic capital of journals unchanged Digital Revolution Submissions to arXiv Share of top 1% most cited papers Larivière,Lozano&Gingras(2014,p.652)
  • 13. Academic Publishing Market Larivière, V., Haustein, S. & Mongeon, P. (in press). The oligopoly of academic publishers in the digital era. PLoS ONE. Larivière,Haustein&Mongeon(inpress) •  Aggravation of serials crisis •  Elsevier: €3,400 subscription price, 30% increase •  Profit margins of commercial publishers up to 40% •  Decline of scientific societies as publishers •  >50% of papers owned by five major publishers
  • 14. Budapest Open Access Initiative Open Access “immediate, free availability on the public internet, permitting any users to read, download, copy, distribute, print, search or link to the full text of these articles” Budapest Open Access Initiative (2002) Archambaultetal.(2013,p.13) Freely available journal papers 2004 to 2011 •  Gold and Green •  Libre and Gratis •  Hybrid journals •  Elsevier: $500 to 5,000 •  Springer: $3,000 •  Wiley: $3,000 Archambault, É., Amyot, D., Deschamps, P., Nicol, A., Rebout, L. & Roberge, G. (2013). Proportion of Open Access Peer-Reviewed Papers at the European and World Levels 2004-2011. Report for the European Commission. http://www.science-metrix.com/pdf/SM_EC_OA_Availability_2004-2011.pdf
  • 15. Open Science “opening up the research process by making all of its outcomes, and the way in which these outcomes were achieved, publicly available on the World Wide Web” Kraker et al. (2011, p. 645) Kraker, P., Leony, D., Reinhardt, W. & Beham, G. (2011). The case for an open science in technology enhanced learning. International Journal of Technology Enhanced Learning, 3(6), 643-654. •  Open Data •  Open Source •  Open Methodology •  Open Access •  Open Peer Review
  • 17. Björneborn, L. & Ingwersen, P. (2004), Toward a basic framework for webometrics. Journal of the American Society for Information Science and Technology, 55(14), 1216–1227. Definition of Scholarly Metrics adaptedfrom:Björneborn&Ingwersen(2004,p.1217) informetrics scientometrics bibliometrics cybermetrics webometrics altmetrics
  • 18. Otlet, P. (1934). Traité de documentation: le livre sur le livre, théorie et pratique. Pritchard, P. (1927). Statistical bibliography or bibliometrics? Journal of Documentation, 25, 348-349.. Definition of Scholarly Metrics informetrics scientometrics bibliometrics cybermetrics webometrics altmetrics “La «Bibliometrie» sera la partie définie de la Bibliologie qui s'occupe de la mesure ou quantité appliquée aux livres.” “the application of mathematics and statistical methods to books and other media of communication” Pritchard (1969, p. 348) Otlet (1934, p. 14)
  • 19. Priem, J. (2014). Altmetrics. In B. Cronin & C. R. Sugimoto (Eds.), Beyond bibliometrics: harnessing multidimensional indicators of performance (pp. 263–287). Cambridge, MA: MIT Press. Rousseau, R. & Ye, F. (2013). A multi-metric approach for research evaluation. Chinese Science Bulletin, 10–12. doi:10.1007/s11434-013-5939-3 informetrics scientometrics cybermetrics webometrics altmetrics “study and use of scholarly impact measures based on activity in online tools and environments” “a good idea but a bad name” Rousseau & Ye (2013, p. 2) Priem (2014, p. 266) bibliometrics Definition of Scholarly Metrics
  • 20. Definition of Scholarly Metrics informetrics scientometrics bibliometrics cybermetrics webometrics altmetrics scholarly metrics Scholarly metrics are metrics based on acts and events (e.g., viewing, reading, saving, diffusing, mentioning, citing, reusing, modifying) related to scholarly documents (e.g., papers, blog posts, datasets, code, notes) or scholarly agents (e.g., researchers, universities, journals).
  • 21. Gross, P.L.K. & Gross, E.M. (1927). College libraries and chemical education. Science, 66(1713), 385-389.. Citation analysis for objective collection management Bibliometrics for Library Mangement Gross&Gross,1927,p.386 Journals cited in the Journal of the American Chemical Society 1926
  • 22. Garfield, E. (1955). Citation indexes for science. A new dimension in documentation through association of ideas. Science, 122, 108-111. Bibliometrics for Information Retrieval Retrieval tool to handle information overload •  Institute for Scientific Information •  Science Citation Index •  Source Author Index •  Citation Index “It would not be excessive to demand that the thorough scholar check all papers that have cited or criticized such papers, if they could be located quickly. The citation index makes this check practicable.” Garfield, 1955, p. 108
  • 23. Derek J. de Solla Price Science since Babylon (1961) Little Science – Big Science (1963) Bibliometrics for Sociology of Science Price, D. J. d. S. (1961). Science Since Babylon. New Haven / London: Yale University Press, Price, D. J. d. S. (1963). Little Science, Big Science. New York: Columbia University Press.
  • 24. Merton, R. K. (1988). The Matthew effect in science, II: Cumulative advantage and the symbolism of intellectual property. Isis, 79, 606–623. Robert K. Merton •  Social norms of science •  Communalism •  Universalism •  Disinterestedness •  Organized skepticism •  Matthew effect Bibliometrics for Sociology of Science “symbolically, [the reference] registers in the enduring archives the intellectual property of the acknowledged source by providing a pellet of peer recognition of the knowledge claim” Merton (1988, p. 621)
  • 25. •  Performance measurement and policy instrument •  Commercialization Bibliometrics for Research Evaluation “When used properly, bibliometric indicators can provide a ‘monitoring device’ for university research-management and science policy. They enable research policy-makers to ask relevant questions of researchers on their scientific performance, in order to find explanations of the bibliometric results in terms of factors relevant to policy.” Moed et al. (1985, p. 131) Moed, H.F., Burger, W.J.M., Frankfort, J.G, van Raan, A.F.J. (1985). The use of bibliometric data for the measurement of university research performance. Research Policy, 14(3), 131-149.
  • 26. •  Oversimplification publications = productivity citations = impact •  Uninformed use and misuse Impact Factor h-index •  Adverse effects “salami” publishing honorary authorship self-citations citation cartels Bibliometrics for Research Evaluation Hvistendahl, M. (2013). China’s publication bazaar. Science, 342(6162), 1035-1039. van Noorden, R. (2013). Brazilian citation scheme outed: Thomson Reuters suspends journals from its rankings for ‘citation stacking’, Nature, 500(7464), 510-511.
  • 27. Criticism against current form of research evaluation Ø  Alternative forms of research ouput Ø  Alternative use and visibility of publications Altmetrics “We rely on filters to make sense of the scholarly literature, but the narrow, traditional filters are being swamped. However, the growth of new, online scholarly tools allows us to make new filters; these altmetrics reflect the broad, rapid impact of scholarship in this burgeoning ecosystem.” … Priem et al. (2010) Information overload … Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Alt-metrics: a manifesto. October. Retrieved from http://altmetrics.org/manifesto/ Piwowar, H. A. (2013). Altmetrics: Value all research products. Nature, 493(7431), 159.
  • 28. Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215. (for Mendeley reader counts only: 2010-2012 PubMed/WoS papers) Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830. (for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI) Altmetrics What do we know? %
  • 29. Altmetrics What do we know? Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215. (for Mendeley reader counts only: 2010-2012 PubMed/WoS papers) Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830. (for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI) %
  • 30. Altmetrics What do we know? Haustein, S., Larivière, V., Thelwall, M., Amyot, D., & Peters, I. (2014). Tweets vs. Mendeley readers: How do these two social media metrics differ? It - Information Technology, 56(5), 207–215. (for Mendeley reader counts only: 2010-2012 PubMed/WoS papers) Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830. (for all metrics except Mendeley reader counts: 2012 WoS papers with a DOI) %
  • 31. Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830. Altmetrics What do we know? Biomedical & Health Sciences Social Sciences & Humanities Life & Earth Sciences Natural Sciences & Engineering Mathematics & Computer Science Twittercoverage
  • 32. Documenttype Haustein, S., Costas, R. & Larivière, V. (2015) Characterizing social media metrics of scholarly papers: The effect of document properties and collaboration patterns. PLoS ONE, 10(5), e0127830. Altmetrics What do we know? Biomedical & Health Sciences Social Sciences & Humanities Life & Earth Sciences Natural Sciences & Engineering Mathematics & Computer Science Twittercoverage
  • 39. Meaning of metrics Opportunities •  Heterogenous users •  Diverse motivations Challenges •  Understanding underlying processes •  Determining the meaning of metrics
  • 40. Meaning of metrics Motivations and norms Saving to Mendeley Mentioning in News
  • 41. Meaning of metrics Motivations and norms Recommending on F1000 Tweeting
  • 42. Meaning of metrics Bertin, M., Atanassova, I., Gingras, Y., & Larivière, V. (in press). The invariant distribution of references in scientific articles. Journal of the Association for Information Science and Technology. Bertin,Atanassova,Gingras&Larivière(inpress,p.13) Distribution of references along the IMRaD structure Citing in a journal article
  • 43. Meaning of Metrics Haustein, S., Bowman, T.D. & Costas, R. (in press). Interpreting “altmetrics”: viewing acts on social media through the lens of citation and social theories. In Sugimoto , C.R. (Ed.). Theories of Informetrics: A Festschrift in Honor of Blaise Cronin. Acts leading to (online) events used for metrics Haustein,Bowman&Costas(inpress,p.13) RESEARCH OBJECT
  • 45. Opportunities •  Detailed life cycle of scientific output •  Fine-grained indicators and adequate benchmarks Challenges •  Versions of research output •  Publication dates Time Analysis
  • 46. Time Analysis Journal article •  Submitted manuscript •  Revised manuscript •  Accepted manuscript •  Version of Record •  Online publication •  Journal issue •  Online date •  Issue month Ø  Adjusting indicators 3 March 2014 15 July 2014 21 January 2015 February 2015
  • 48. Time Analysis Haustein, S., Bowman, T.D. & Costas, R. (in press). When is an article actually published? An analysis of online availability, publication, and indexation dates. Proceedings of the 15th International Conference on Scientometrics and Informetrics, Istanbul, Turkey. Tweets before publication?
  • 50. Communities of Attention Opportunity •  Differentiating between types of use •  Measuring social impact Challenges •  Determining engagement •  Identifying users
  • 51. Level of engagement on Twitter Communities of Attention !Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R. & Larivière, V. (in press), Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter. Journal of the Association for Information Science and Technology. doi: 10.1002/asi.23456
  • 52. Communities of Attention Automated Twitter bots Haustein, S., Bowman, T. D., Holmberg, K., Tsou, A., Sugimoto, C. R. & Larivière, V. (in press), Tweets as impact indicators: Examining the implications of automated “bot” accounts on Twitter. Journal of the Association for Information Science and Technology. doi: 10.1002/asi.23456 tweeting preprints from arXiv subject area tweeting topic- relevant papers selection of interesting papers
  • 53. Communities of Attention exposure engagement median dissimilarity with paper title mediannumberoffollowers influencers / brokers orators / discussing disseminators / mumblers broadcasters tweet text differs from paper title tweet text is identical to paper title few followers many followers Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 54. Communities of Attention 708 of 125,083 users (0.6%) tweeting WoS papers published in 2012 (>100) Node size represents number of papers Network of users tweeting the same papers Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 55. Communities of Attention Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 56. Communities of Attention Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 57. Communities of Attention Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 58. Communities of Attention Haustein, S., Bowman, T.D. & Costas, R. (in press), ‘Communities of attention’ around scientific publications: who is tweeting about scientific papers? Proceedings of Social Media & Society 2015, Toronto, Canada.
  • 61. Stefanie Haustein Thank you for your attention! Questions? stefanie.haustein@umontreal.ca @stefhaustein crc.ebsi.umontreal.ca/sloan Thank you for your attention!