SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Maria Kowalczuk, PhD
Deputy Biology Editor, BioMed Central
Innovation in Peer Review
http://www.meta-activism.org/2011/05/fixing-peer-review-freeing-knowledge-creation/
Traditional peer review
• Peer review in the current form has been used
since 1960s.
• Traditionally scientific journals use single blind
peer review or double blind peer review models.
• Online publishing and open access have changed
the publishing landscape while peer review
process has remained the same.
Pitfalls of traditional
peer review
• Slow
• Expensive to manage
• Inconsistent
• Bias
• Favouritism
• Abuse
http://www.eusci.org.uk/articles/exploring-scientific-peer-review
Innovative peer review models
• Open peer review
• Minimal re-review
• Portable peer review
• Technical peer review
• Decoupled peer review
• Post publication peer review
http://www.bishop-
hill.net/blog/2011/3/20/peer-review-not-for-
the-short-sighted-josh-87.html
Open (non-anonymous) peer review
Randomised Controlled Trial (BMJ 1999; 318: 23 – 27):
- no effect on report quality, recommendation, or time taken to review
- increased likelihood of reviewers declining to review
Biology Direct PubMed record
Publishing peer review documents
- In all 4 EMBO publications, including EMBO J, EMBO Reports
-‘Peer Review Process File’ shows all referee reports , author responses and editorial
decision letters
- Referees remain anonymous; opt-out is possible
- 95% of take-up rate; willingness of referees to review unchanged
Authors can opt out of re-review; if the editors judge the revisions sufficient,
the article is published, often accompanied by a critical Commentary.
Discussed in Editorial: http://www.biomedcentral.com/1741-7007/11/18.
Re-review opt-out – BMC Biology
Portable peer review
Flagships
Subject-specific
journals
BMC Research Notes
BMC series
BMC Neuroscience
BMC Public Health
BMC Independent
Journals
Neuroscience Peer Review Consortium
Technical peer review
Post publication peer review via comments
• PubMed Commons
• PubPeer.com
• Research Gate
• Frontiers
• BioMed Central and other publishers
Conclusions
 Peer review is under scrutiny
 Developments in peer review include:
 Open peer review
 Minimizing re-review
 Portable peer review
 Technical peer review
 Peer review decoupled from journal
 Post publication peer review
Thank you!
Maria Kowalczuk, PhD
Deputy Biology Editor, BioMed Central
Maria.Kowalczuk@biomedcentral.com
Any questions?

Weitere ähnliche Inhalte

Was ist angesagt?

OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing ResearchOA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
William Gunn
 
JPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapersJPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapers
manrai1953
 

Was ist angesagt? (15)

Can We Fix Peer Review
Can We Fix Peer ReviewCan We Fix Peer Review
Can We Fix Peer Review
 
How Often Are Studies Wrong?
How Often Are Studies Wrong?How Often Are Studies Wrong?
How Often Are Studies Wrong?
 
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
Practical Uses of Altmetrics - Hear librarians talk about how they use new me...
 
Peer reviewing
Peer reviewingPeer reviewing
Peer reviewing
 
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific FraudHow Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
How Journalists Can Effectively -- And Safely -- Report on Scientific Fraud
 
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
January 13, 2016 NISO Webinar: Ensuring the Scholarly Record: Scholarly Retra...
 
The Retraction Watch Database
The Retraction Watch DatabaseThe Retraction Watch Database
The Retraction Watch Database
 
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing ResearchOA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
 
BioMed Central's open data initiatives
BioMed Central's open data initiativesBioMed Central's open data initiatives
BioMed Central's open data initiatives
 
Conference on Vaccines
Conference on VaccinesConference on Vaccines
Conference on Vaccines
 
Retractions, Peer Review, and Transparency
Retractions, Peer Review, and TransparencyRetractions, Peer Review, and Transparency
Retractions, Peer Review, and Transparency
 
Human Subjects, Research and Navigating the IRB Process
Human Subjects, Research and Navigating the IRB ProcessHuman Subjects, Research and Navigating the IRB Process
Human Subjects, Research and Navigating the IRB Process
 
Literature Searching for BSc Health Promotion 2014
Literature Searching for BSc Health Promotion 2014Literature Searching for BSc Health Promotion 2014
Literature Searching for BSc Health Promotion 2014
 
JPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapersJPROT-TargetedProteomics-CallforPapers
JPROT-TargetedProteomics-CallforPapers
 
Why should my institution support RRIDs?
Why should my institution support RRIDs?Why should my institution support RRIDs?
Why should my institution support RRIDs?
 

Ähnlich wie Innovation in peer review

ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research ImpactALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
William Gunn
 
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
Max Haring
 

Ähnlich wie Innovation in peer review (20)

Blockchain based digital currency for researchers (Peer-reviewers)
Blockchain based digital currency for researchers (Peer-reviewers)Blockchain based digital currency for researchers (Peer-reviewers)
Blockchain based digital currency for researchers (Peer-reviewers)
 
ALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research ImpactALAMW14 Altmetrics Panel: Redefining Research Impact
ALAMW14 Altmetrics Panel: Redefining Research Impact
 
Open access workshop wits - 24th october 2013 - copy
Open access workshop   wits - 24th october 2013 - copyOpen access workshop   wits - 24th october 2013 - copy
Open access workshop wits - 24th october 2013 - copy
 
BIOMEDICAL .ppt
BIOMEDICAL .pptBIOMEDICAL .ppt
BIOMEDICAL .ppt
 
Understanding scientific peer review
Understanding scientific peer reviewUnderstanding scientific peer review
Understanding scientific peer review
 
Manuscript Management Systems: Understanding the Workflow from Submission to ...
Manuscript Management Systems: Understanding the Workflow from Submission to ...Manuscript Management Systems: Understanding the Workflow from Submission to ...
Manuscript Management Systems: Understanding the Workflow from Submission to ...
 
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
Systematic Reviews: the process, quantitative, qualitative and mixed methods ...
 
Reproducibility and replicability: a practical approach
Reproducibility and replicability: a practical approachReproducibility and replicability: a practical approach
Reproducibility and replicability: a practical approach
 
eLife peer review alpsp talk
eLife peer review alpsp talkeLife peer review alpsp talk
eLife peer review alpsp talk
 
EoE HLN summer conference 2015 IK - open access & research data management
EoE HLN summer conference 2015 IK - open access & research data managementEoE HLN summer conference 2015 IK - open access & research data management
EoE HLN summer conference 2015 IK - open access & research data management
 
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
 
1.2 study designs, data types, choosing statistical tests, data analysis chec...
1.2 study designs, data types, choosing statistical tests, data analysis chec...1.2 study designs, data types, choosing statistical tests, data analysis chec...
1.2 study designs, data types, choosing statistical tests, data analysis chec...
 
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
OpenEd13 UTAH MOOCs and social responsibility to learners V Rolfe Nov2013
 
Open Research Practices in the Age of a Papermill Pandemic
Open Research Practices in the Age of a Papermill PandemicOpen Research Practices in the Age of a Papermill Pandemic
Open Research Practices in the Age of a Papermill Pandemic
 
Demystifying open access
Demystifying open accessDemystifying open access
Demystifying open access
 
Getting Published: Tips and Resources
Getting Published: Tips and ResourcesGetting Published: Tips and Resources
Getting Published: Tips and Resources
 
Introduction to F1000Research: an open review journal
Introduction to F1000Research: an open review journalIntroduction to F1000Research: an open review journal
Introduction to F1000Research: an open review journal
 
Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...
 
Smart research thorough online tools.pdf
Smart research thorough online tools.pdfSmart research thorough online tools.pdf
Smart research thorough online tools.pdf
 
Role of libraries in accelerating research
Role of libraries in accelerating researchRole of libraries in accelerating research
Role of libraries in accelerating research
 

Kürzlich hochgeladen

Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Sérgio Sacani
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Lokesh Kothari
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
PirithiRaju
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
RohitNehra6
 

Kürzlich hochgeladen (20)

Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Creating and Analyzing Definitive Screening Designs
Creating and Analyzing Definitive Screening DesignsCreating and Analyzing Definitive Screening Designs
Creating and Analyzing Definitive Screening Designs
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencyHire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICESAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 

Innovation in peer review

  • 1. Maria Kowalczuk, PhD Deputy Biology Editor, BioMed Central Innovation in Peer Review http://www.meta-activism.org/2011/05/fixing-peer-review-freeing-knowledge-creation/
  • 2. Traditional peer review • Peer review in the current form has been used since 1960s. • Traditionally scientific journals use single blind peer review or double blind peer review models. • Online publishing and open access have changed the publishing landscape while peer review process has remained the same.
  • 3. Pitfalls of traditional peer review • Slow • Expensive to manage • Inconsistent • Bias • Favouritism • Abuse http://www.eusci.org.uk/articles/exploring-scientific-peer-review
  • 4. Innovative peer review models • Open peer review • Minimal re-review • Portable peer review • Technical peer review • Decoupled peer review • Post publication peer review http://www.bishop- hill.net/blog/2011/3/20/peer-review-not-for- the-short-sighted-josh-87.html
  • 5. Open (non-anonymous) peer review Randomised Controlled Trial (BMJ 1999; 318: 23 – 27): - no effect on report quality, recommendation, or time taken to review - increased likelihood of reviewers declining to review
  • 6.
  • 7.
  • 8.
  • 9.
  • 11. Publishing peer review documents - In all 4 EMBO publications, including EMBO J, EMBO Reports -‘Peer Review Process File’ shows all referee reports , author responses and editorial decision letters - Referees remain anonymous; opt-out is possible - 95% of take-up rate; willingness of referees to review unchanged
  • 12. Authors can opt out of re-review; if the editors judge the revisions sufficient, the article is published, often accompanied by a critical Commentary. Discussed in Editorial: http://www.biomedcentral.com/1741-7007/11/18. Re-review opt-out – BMC Biology
  • 13.
  • 14. Portable peer review Flagships Subject-specific journals BMC Research Notes BMC series BMC Neuroscience BMC Public Health BMC Independent Journals
  • 16.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23. Post publication peer review via comments • PubMed Commons • PubPeer.com • Research Gate • Frontiers • BioMed Central and other publishers
  • 24. Conclusions  Peer review is under scrutiny  Developments in peer review include:  Open peer review  Minimizing re-review  Portable peer review  Technical peer review  Peer review decoupled from journal  Post publication peer review
  • 25. Thank you! Maria Kowalczuk, PhD Deputy Biology Editor, BioMed Central Maria.Kowalczuk@biomedcentral.com Any questions?