Providing Tools for Author Evaluation - A case study

•

1 gefällt mir•1,262 views

inscit2006

Elsevier/Scopus' presentation at InSciT2006.

Wirtschaft & Finanzen Technologie

Providing Tools for Author Evaluation A case study _______________________________________ Merida, October 27, 2006 Jaco Zijlstra Director Scopus

Why do we evaluate scientific output ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Criteria for effective evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Why do we evaluate authors? ,[object Object],[object Object],[object Object],[object Object],[object Object],Important to get it right

Author evaluation in Scopus ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Data requirements for evaluation There are limitations that complicate author evaluation ,[object Object],[object Object],[object Object]

Data limitations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Finding/matching all relevant information to evaluate authors is difficult

The Challenge: finding an author ,[object Object],[object Object],[object Object]

The Solution: Author Disambiguation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],… and used this data to group articles that belong to a specific author

Step 1: Searching for an author Enter name in Author Search box

Step 2: Select your author Which S. Albracht are you looking for? Available information

Step 3: The Author details Unique Author ID & matched documents

No 100% recall… The same author with different author ID’s

Why were these not matched? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Feedback loop includes Scopus check Dedicated team investigating feedback requests to guarantee quality

Author Identifier Feedback ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Step 3: The Author details … we have matched the author to documents – now what? Unique Author ID & matched documents

Why the Scopus Citation Tracker? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Evaluation Data Instant citation overview for an author

Step 4: The citation overview Excluding self citations

The H-index in Scopus An alternative approach to evaluating an author

Step 3: Scroll to H-index “ Dr. Albracht has index 30 as 30 of his 127 papers have at least 30 citations each, and the remaining papers have no more than 30 citations each”

Additional tools for evaluating authors PatentCites and WebCites

PatentCites and WebCites ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

PatentCites per document Dr. Albracht has additional citations…

Information available in Scopus for Dr. Albracht ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Quality of evaluation is dependent on quality of underlying data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Evaluating authors is at root of any evaluation of scientific output ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Was ist angesagt?

Zaven Akopov (DESY -L-) For the INSPIRE Collaboration DESY ...

Zaven Hakopov

Metadata harvesting

AndrewLIS688

Hughes RDAP11 Data Publication Repositories

ASIS&T

Documents, services, and data on the web

Chiara Del Vescovo

FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...

Carole Goble

Establishing the Connection: Creating a Linked Data Version of the BNB

nw13

Project Website: http://www.researchobject.org/ researchobjects.org is a community project that has developed an approach to describe and package up all resources used as part of an investigation as Research Objects (RO’s). RO’s - provide two main features; a manifest - a consistent way to provide a well-typed, structured description of the resources used in an investigation; and a ‘bundle’ - a mechanism for packaging up manifests with resources as a single, publishable unit. RO’s therefore carry the research context of an experiment - data, software, standard operating procedures (SOPs), models etc - and gather together the components of an experiment so that they are findable, accessible, interoperable and reproducible (FAIR). RO’s combine software and data into an aggregative data structure consisting of well described reconstructable parts. RO’s have the potential to address a number of challenges pertinent to open research including: a) supporting interoperability between infrastructures by using ROs as a primary mechanism for exchange and publication b) supporting the evolution of research objects as a living collection, enabling provenance tracking c) providing the ability to pivot research object components (data, software, models) that are not restricted to the traditional publication. Here we present work towards the development and adoption of ROs: (i) A series of specifications and conventions, using community standards, for the RO manifest and RO bundles. (ii) Implementations of Java, Python and Ruby APIs and tooling against those specifications; (iii) Examples of representations of the RO models in various languages (e.g. JSON-LD, RDF, HTML).

Research Shared: researchobject.org

Norman Morrison

RDM@Edinburgh_interoperation_IDCC2015

Historic Environment Scotland

Making data typing efforts or automatically detecting data types for automat...

National Institute of Informatics

Will the rich domain knowledge from research publications and the implicit cross-domain metadata of cultural objects be compliant with each other? A contextual framework is proposed as dynamic and relational in supporting three different contexts: Reusing, Publication and Curation, which are individually constructed but overlapped with major conceptual elements. A Relations for Reusing (R4R) ontology has been devised for modeling these overlapping conceptual components (Article, Data, Code, Provence, and License) for interlinking research outputs and cultural heritage data. In particular, packaging and citation relations are key to build up interpretations for dynamic contexts. Examples are provided for illustrating how the linking mechanism can be constructed and represented as a result to reveal the data linked in different contexts.

Relations for Reusing (R4R) in A Shared Context: An Exploration on Research P...

andrea huang

Open Archives Initiatives For Metadata Harvesting

Nikesh Narayanan

Putting Historical Data in Context: how to use DSpace-GLAM

4Science

Research Objects, SEEK and FAIRDOM

Carole Goble

External CV support in Dataverse 5.7

vty

How to clean data less through Linked (Open Data) approach?

andrea huang

PRELIDA Project Draft Roadmap

PRELIDA Project

2016 Bio-IT World Cell Line Coordination Poster 2016-04-05v1

Bruce Kozuma

Jeroen Kleinhoven (Treparel), Turn Big Content into Business Insights - Data ...

Cre-Aid

Analytics and Access to the UK web archive

Lewis Crawford

Text Indexing and Retrieval

Rachmat Wahid Saleh Insani

Was ist angesagt? (20)

Zaven Akopov (DESY -L-) For the INSPIRE Collaboration DESY ...

Metadata harvesting

Hughes RDAP11 Data Publication Repositories

Documents, services, and data on the web

FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...

Establishing the Connection: Creating a Linked Data Version of the BNB

Research Shared: researchobject.org

RDM@Edinburgh_interoperation_IDCC2015

Making data typing efforts or automatically detecting data types for automat...

Relations for Reusing (R4R) in A Shared Context: An Exploration on Research P...

Open Archives Initiatives For Metadata Harvesting

Putting Historical Data in Context: how to use DSpace-GLAM

Research Objects, SEEK and FAIRDOM

External CV support in Dataverse 5.7

How to clean data less through Linked (Open Data) approach?

PRELIDA Project Draft Roadmap

2016 Bio-IT World Cell Line Coordination Poster 2016-04-05v1

Jeroen Kleinhoven (Treparel), Turn Big Content into Business Insights - Data ...

Analytics and Access to the UK web archive

Text Indexing and Retrieval

Andere mochten auch

Research Evaluation: When you measure a system, you change the system

Giuseppe De Nicolao

Research Papers - Using the Internet & Library

Amy Sasser

Grading and student evaluation

Lilik Yuliyanti

The basics of scientific writing in the digital age. From the book Scientific Writing for Impact Factor Journals, Nova Publishers. This presentation distillates the main points that scientists should have in mind when writing a scientific article: Novelty, Communication, Focus, Distillation, Micro-Article, Unexpected, Contrast, Text, Clear, Introduction, Images, Photos, Iphone, Rejected, Social Media.

Scientific Writing for Impact Factor Journals

Eric Lichtfouse

Assessment: Grading & Student Evaluation

Eddy White, Ph.D.

Characteristics and criteria of good research

A B

Meaning and characteristics of research

jedliam

Andere mochten auch (7)

Research Evaluation: When you measure a system, you change the system

Research Papers - Using the Internet & Library

Grading and student evaluation

Scientific Writing for Impact Factor Journals

Assessment: Grading & Student Evaluation

Characteristics and criteria of good research

Meaning and characteristics of research

Ähnlich wie Providing Tools for Author Evaluation - A case study

Who's counting: an introduction to bibliometrics

University of York Library

Essential guide to_lit_reviews_presentation-converted

subhasreen

Research Metrics

Surendra Kumar Pal

Bibliometrics: Now There Are Options

Elaine Lasda

Showcasing your Research Impact using Bibliometrics

Ciarán Quinn

Bibliometrics Primer

Elaine Lasda

ITCT - Library Resources

Melanie Parlette-Stewart

Bibliometrics: journals, articles, authors (v2)

Lancaster University Library

Bibliometrics presentation, Window on Research June 2010

Jenny Delasalle

CL8 Scientiometrics Module 6 RPE-Rijo TKMCE.pdf

ssuserb76cdd

What is bibliometrics and how does it work?

Ciarán Quinn

Apresentação UCA

Graça Gabriel

Open Access and IR along with Quality Indicators.pptx

ManiMaran230751

Final delasalle for uksg

UKSG: connecting the knowledge community

Literature Review.pptx

Abhishek Job

Lit Reviews for the Health Sciences

Robin Featherstone

Elsevier how to get more citation - University of Balamand

uoblibraries

UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...

UKSG: connecting the knowledge community

The third session took place on Wednesday 15 February and covered making content easily discoverable. Well-structured and complete metadata about your published works are the key to ensuring content can be easily found, purchased, and used - particularly within the emerging Demand Driven Acquisition Model. The discussion explored: - The changing landscape of discovery and collection development - Current industry initiatives surrounding publication metadata - Review of discovery platforms and discovery layers - Ringgold's ProtoView service - supporting publishers with the creation and targeted dissemination of quality metadata

Ringgold Webinar Series: 3. Lean and Mean - Publication Metadata to Enhance D...

Ringgold Inc

MSE - Year 1 - Jan 2012

Melanie Parlette-Stewart

Ähnlich wie Providing Tools for Author Evaluation - A case study (20)

Who's counting: an introduction to bibliometrics

Essential guide to_lit_reviews_presentation-converted

Research Metrics

Bibliometrics: Now There Are Options

Showcasing your Research Impact using Bibliometrics

Bibliometrics Primer

ITCT - Library Resources

Bibliometrics: journals, articles, authors (v2)

Bibliometrics presentation, Window on Research June 2010

CL8 Scientiometrics Module 6 RPE-Rijo TKMCE.pdf

What is bibliometrics and how does it work?

Apresentação UCA

Open Access and IR along with Quality Indicators.pptx

Final delasalle for uksg

Literature Review.pptx

Lit Reviews for the Health Sciences

Elsevier how to get more citation - University of Balamand

UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...

Ringgold Webinar Series: 3. Lean and Mean - Publication Metadata to Enhance D...

MSE - Year 1 - Jan 2012

Mehr von inscit2006

Information Searcher-Provider Fit through Information Presentation and Visual...

inscit2006

Difference of application of fuzzy rough sets and probability random on targe...

inscit2006

The Interaction of Navigation Instructions and Visual Attention in Dynamic Au...

inscit2006

Weighted Naïve Bayes Model for Semi-Structured Document Categorization

inscit2006

The role of education within the framework of information sciences and techno...

inscit2006

A Metadata-Driven Approach to Computing Financial Analytics in a Relational D...

inscit2006

A Comparative Study of RDBMs and OODBMs in Relation to Security of Data

inscit2006

iCE- Interactive Co-innovation Environment Software, Spatial Mapping Tools fo...

inscit2006

Designing People’s Interconnections in Mobile Social Networks

inscit2006

Visual Literacy: A Semiotic Analysis of Icons as Visual Information Represent...

inscit2006

Visualizing Search Term Relevance, Boolean Operators, and Phrases using the C...

inscit2006

Visualization of Multidimensional Information from Scientific Computations

inscit2006

High dimensional Data Visualization using Star Coordinates on Three Dimensions

inscit2006

Knowledge Discovery in Environmental Impact Report’s summary texts: an explor...

inscit2006

Improvement in Quality of Speech associated with Braille codes - A Review

inscit2006

Identificación de Nombres de Genes en la Literatura Biomédica

inscit2006

An Intuitive Natural Language Understanding System

inscit2006

Requirement analysis for mobile information exchange in the police using a ti...

inscit2006

Parametric Study to Enhance Genetic Algorithm's Performance using Ranked base...

inscit2006

Information updated and conveyed by the neural network systems

inscit2006

Mehr von inscit2006 (20)