5. How are we able to compare numbers?
ï§ Scientist Z. Math has a publication from 2001 with 17 citations
ï§ Scientist M. Biology has a publication from 2007 with 32 citations
8. A quantitative example
ï§ Bouma, J, Bulte, EH, & DP van Soest (2008)
Trust, Trustworthiness and Cooperation: Social Capital
and Community Resource Management. J. Env. Ec. &
Mngmt 56(2)155-166.
â Cited 12 times
ï§ Journal of Environmental Economics and Management
from journals menu in ESI:
â Economics & Business
ï§ Baseline data for Economics & Business (from ESI)
â Article from 2008: Average: 3.62 Citations; Top
10%: 9 citations; Top 1% 27 citations
ï§ RI = 12 / 3.62 = 3.31
9. Baseline data to normalize citation data?
Citations data source Baselines
Web of Science ESI or InCites
Scopus SciVal Strata
Google Scholar none
Propriatary A&I database none
10. H-index
ï§ Balance between productivity
and citedness
ï§ To rule out the effect of one
or two highly cited papers
ï§ Applicable to
authors, journals, research
groups, compounds, subjects
etcâŠ
ï§ But there are some serious
doubts about robustness
Waltman, L. & N. J. van Eck (2011). The inconsistency of
the h-index. Journal of the American Society for
Information Science and Technology 63(2):406-415
http://dx.doi.org/10.1002/asi.21678
13. Where to publish?
ï§ A valued journal?
â Quality
â Editorial board
â Acceptance rate
â Time to publication
â Journal circulation
â Visibility
14. 50% of articles generate 90% of all cites
Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. BMJ
314(7079): 497-502. http://bmj.bmjjournals.com/cgi/content/full/314/7079/497
20. Document type and article impact 2003-
2009, for Wageningen UR
Document
type Pubs RI T10(%T10) T1(%T1)
Article 11212 1.62 2777(25%) 437( 4%)
Review 705 4.45 418 (59%) 145(21%)
Aggregate 11917 1.79 3195(27%) 582(5%)
Source: Wageningen Yield, Feb. 2012
21. The impact factor Matthew effect
The journal in which papers are published have a strong
influence on their citation rates, as duplicate papers
published in high-impact journals obtain, on
average, twice as many citations as their identical
counterparts published in journals with lower impact
factors..
LariviĂšre, V. and Y. Gingras (2010). The impact factor's Matthew Effect: A
natural experiment in bibliometrics. Journal of the American Society for
Information Science and Technology 61(2): 424-427.
http://dx.doi.org/10.1002/asi.21232
22. Final word on journal quality
It is better to publish one paper in a quality journal than
multiple papers in lesser journals. [...]. Try to publish in
journals that have high impact factors; chances are your
paper will have high impact, too, if accepted.
Bourne, P. E. (2005). Ten Simple Rules for Getting
Published. PLoS Computational Biology 1(5): e57.
http://dx.doi.org/10.1371/journal.pcbi.0010057
26. Cooperation...
Teams increasingly dominate solo authors in the
production of knowledge. Research is increasingly done in
teams across nearly all fields.
Teams typically produce more frequently cited research
than individuals do, and this advantage has been
increasing over time.
Teams now also produce the exceptionally high-impact
research, even where that distinction was once the domain
of solo authors.
Wuchty, S., B. F. Jones, et al. (2007). The increasing dominance of
teams in production of knowledge. Science 316(5827): 1036-1039.
http://dx.doi.org/10.1126/science.1136099
27. Networking is important
ï§ Start early, make use of Social Networking tools
â Facebook
â LinkedIn
â Social networks for scientists
â SSRN, Academics.edu, Researchgate
29. On using social media
McKenzie and Ăzler (2011) The impact of economics blogs
30. Consider the Wikipedia
ï§ For better or worse, people are guided to Wikipedia
when searching the Web for biomedical information. So
there is an increasing need for the scientific community
to engage with Wikipedia to ensure that the information
it contains is accurate and current.
Logan, D.W., M. Sandal, P.P. Gardner, M. Manske & A. Bateman
(2010). Ten Simple Rules for Editing Wikipedia. PLoS Comput Biol,
6(9): e1000941 http://dx.doi.org/10.1371/journal.pcbi.1000941
32. Self citations
The model [...] implies that external citations are
enhanced by self-citations, so that we have the
âchain reaction:â Larger size leads to more self-
citations, which lead to more external citations.
van Raan, A. F. J. (2008). Self-citation as an impact-reinforcing mechanism in the
science system. Journal of the American Society for Information Science and
Technology 59(10): 1631-1643.
11/28
33. More on references
Articles that cite more references are in turn
cited more themselves
Webster, G. D., P. K. Jonason, et al. (2009). Hot Topics and Popular Papers in Evolutionary
Psychology: Analyses of Title Words and Citation Counts in Evolution and Human Behavior, 1979
â 2008. Evolutionary Psychology 7(3): 348-362.
http://www.epjournal.net/filestore/ep07348362.pdf
To be the best, cite the best
Borrowed from: Corbyn, Z. (2010). "To be the best, cite the best." Nature News, 13 October
2010, http://dx.doi.org/10.1038/news.2010.539 Reporting on the publication of Bornmann, L., F.
de Moya AnegĂłn, et al. (2010). Do Scientific Advancements Lean on the Shoulders of Giants? A
Bibliometric Investigation of the Ortega Hypothesis. PLoS ONE 5(10): e13327 DOI:
http://dx.doi.org/10.1371/journal.pone.0013327.
34. More articles per research project?
ï§ Publishing more articles results in higher citation counts
if the articles provide sufficient substantive content to
other researchers.
â Beware of the ethical standards
â Bornmann looked at total citations, not to relative
impact
Bornmann, L. & H.-D. Daniel (2007). Multiple publication on a single research study:
Does it pay? The influence of number of research articles on total citation counts in
biomedicine. Journal of the American Society for Information Science and
Technology, 58(8): 1100-1107 http://dx.doi.org/10.1002/asi.20531
35. Journal selection and referencing with
multidisciplinary research
ï§ Higher citations are linked to the citation-intensive
disciplines.
â But LariviĂšre et al. looked at absolute citations rather that relative to the field
ï§ Articles citing citation-intensive disciplines are more
likely to be cited by those disciplines and, hence, obtain
higher citation scores than would articles citing non-
citation-intensive disciplines.
LariviĂšre, V. & Y. Gingras (2010). On the relationship between interdisciplinarity and scientific
impact. Journal of the American Society for Information Science and Technology, 61(1): 126-131
http://dx.doi.org/10.1002/asi.21226
36. Consider Open Access publishing
ï§ Be aware of your copyrights when publishing
ï§ Golden Road
â PloS Journals, BMC, etc.
ï§ Green Road
â Self archived copies (final authorâs version)
â TU Repository, RePec, SSRN etc.
ï§ Open Choice
â Hybrid system, author pays and library pays
â Sage model (only 10% of standard fees)
37. Is there a citation advantage for OA?
ï§ Evidence is mounting
â There is certainly no dis-advantange
â Van Raan has started to self archive his preprints
â Publishers allow self archiving of the final peer
reviewed authors version
â Open Citation Project
ï§ OA is important for developing countries
Evans, J.A., Reimer, J., 2009. Open access and global participation in
science. Science. 323, 1025. http://dx.doi.org/10.1126/science.1154562
38. Publish your data!
ï§ Henneken et al. (2011) "articles with links to data result
in higher citation rates than articles without such links"
http://arxiv.org/abs/1111.3618
ï§ Piwowar et al. (2007) "Sharing detailed research data is
associated with increased citation rate
http://dx.doi.org/10.1371/journal.pone.0000308
ï§ Also relevant in the view of the latest developments
(KNAW)
ï§ Library assists in curating datasets
43. Final word of warning!
ï§ Publishing strategies are meant to improve the impact of
good quality research. Using these techniques to
upgrade CVs or boosting research performance ratings of
research groups is a dangerous tactic.
Tijssen, R.J.W. (2003). Scoreboards of research excellence. Research
Evaluation, 12(2): 91-104; p.16 is especially relevant for Tilburg University