A atual revolução na avaliação de pesquisa é devido a uma série de fatores que estão presentes há vários anos, mas que agora estão convergindo para oferecer um novo cenário onde a presença na web das iniciativas em Acesso Aberto, dos repositórios institucionais, dos portais de periódicos e dos pesquisadores individuais desempenha um papel muito importante. O ranking de Universidades Webometrics há muito tempo antecipou muitas das novidades teóricas e práticas e suas ferramentas ainda são valiosas para descrever os novos processos científicos e sociais que estão afetando não só a academia, mas a todos os atores ligados de alguma forma para o avanço científico, a disseminação das atividades, a divulgação dos resultados e implementação socioeconômica das inovações. The current revolution in research assessment is due to a series of factors that have been present for several years but that now are converging for offering a new scenario where the Open Access initiatives, the institutional repositories, the portals of journals and the researchers individual web presence are to play a very important role. Webometrics long ago anticipated many of the theoretical and practical novelties and its tools are still valuable for describing the new scientific and social processes that are affecting not only to the academia but to all the actors linked in one or other way to the scientific advance, dissemination of the activities, popularization of the results and the socio-economic of the implementation of the innovations. La revolución actual en la evaluación de la investigación se debe a una serie de factores que han estado presentes durante varios años, pero que ahora están convergiendo para ofrecer un nuevo escenario en el que las iniciativas de Acceso Abierto, los repositorios institucionales, los portales de revistas y la presencia individual de los investigadores en el Web, van a jugar un papel muy importante. La webometría hace mucho tiempo ha anticipado muchas de las novedades teóricas y prácticas y sus herramientas siguen siendo valiosas para describir los nuevos procesos científicos y sociales que afectan no sólo a la academia sino a todos los actores vinculados de una u otra manera con el avance científico, la difusión de las actividades, la divulgación de los resultados y el desarrollo socio-económico de la aplicación de las innovaciones.

1. I-Metrics
biblio-, web-, alt- & usagemetrics
Isidro F. Aguillo
isidro.aguillo@csic.es

2. AGENDA
 BORED
– Journal-level Metrics (infamous Impact Factor)
– Citation-only Analysis (unreliable h-Index)
– Metadata focused repositories
 COOL
– Identifiers
– Article Level Metrics (ALM)
– Altmetrics (not only ALM)
 BETA
– Profiles
• Composite indicators
• Visualization
• Rankings
2

3. Current situation
 Priorities for editors, librarians, intermediaries
– Journal is the unit: continent not content focused
– Article is the unit: the bibliographic record, its metadata description
– Journals Portals: emphasis is on open access
• Unreliable biased metrics (Redalyc)
 Priorities for scientists, academicians, policy managers
– Visibility: Barriers to crawling in most of the repositories: Huge gaps in
Google Scholar coverage
– Evaluation: Metrics are relevant at author or institutional level
• Not exactly PLoS model: Article-level metrics (also by Altmetric)
• A big issue is the lack of identifiers
– Intellectual property
• OA priority as an excuse for abuses in personal and institutional
attributions (moral rights)
3

4. Standard Identifiers are badly needed!
PP
PERSONAL PROFILES
ORCID
ALM
DOI
IR
4
ARTICLE-LEVEL METRICS
INSTITUTIONAL REPORTS
ISNI

5. A Plea for Personal Profiles
 Sources
– Commercial bibliographic databases (WoS, Scopus,…)
– Public Web search engines, incl. academic ones (GS, MS AS, Mendeley)
– Social Web platforms
(Academia.edu, ResearchGate, LinkedIn, Wikipedia, YouTube, Twitter, …)
– Personal (and group) webpages
– Repositories
 Metrics
– Activity: Formal (peer-reviewed papers/chapters/monographs), Informal
– Visibility: Inclusion in repositories, bibliographic databases/search engines
– Impact: Citations, Links, Mentions (incl. likes, discussions & similar)
– Usage: Visits, Visitors (incl. followers), Downloads
 Integration (and visualization)
– A model like … ImpactStory Plus or PlumX
5

6. A model for I-Metrics
BIBLIOMETRICS
WEBOMETRICS
Number of times the
bibliographic record
(identifier) of a paper/book is
cited in another similar
formally published paper
Number of times the URL of
a document/author webpage
is linked from another
webpage
Document-level metrics
Title
Source:Journal/Book/Patent
Publication Year
Citations
Identifier: URL/DOI/Handle
Subject/Tags
Author-level metrics
ALTMETRICS
Number of times the
elements are mentioned
(shared) in
websites, wikis, blogs, soci
al bookmarks and networks
(incl. Twitter) or search
engines
6
Author(s)
Institution (Affiliation)
Publication Year
Discipline/Tags
Web profiles
Web 2.0 profiles
USAGEMETRICS
Number of times the
document is
read/visited/downloaded from
its publishing place (incl.
websites)

7. Personal (Bibliometric) Profiles (I)
7

8. Rankings
8

9. Hey, Google Scholar
We badly need an API!!
9

10. Personal (Bibliometric) Profiles (II)
10

11. Visualization
11

12. New actors (I)
12

13. New actors (II)
13

14. Webometrics for individuals, not yet? …
14

15. Altmetrics for individuals, not yet? …
15

16. (Super)Repositories for individuals, not yet? …
16

17. Usagemetrics for individuals, not yet? …
17

18. Not against intermediaries, but
Institutions & authors
FIRST!
18

19. IMHO … Personal Institutional Webpage
 From Profile to Portfolio
– Institutionally hosted
• Prestige, authority, long-term preservation
– Caring about Identifiers
– Not only Metrics
• Beyond CV: Narrative introduction
• Updated frequently: Twitter, Blog or similar
• Outlinks rich
 But also Metrics
– APIs based: Objectivity, Reliability
• Absolute and relative (rankings) figures
– Network visualization: topics, colleagues, institutions
– Public (interactive) dashboard
• Current standard Google Analytics needs to (publicly) emerge
19

20. Powered by Harvard’s
20

21. Combined with … PlumX
21

22. Open forum
Thank you!
22