SlideShare ist ein Scribd-Unternehmen logo
1 von 17
REF2014 and beyond
Nicola Dowson, Open University Library
Session outline
• Overview of the REF
• Systems used for the publications submission
• Library role
• Reflections
• Next REF
The assessment framework
Overall quality
Publications
Maximum of 4 per
researcher
Impact
Impact template and
case studies
Environment
Environment data and
template
65% 20% 15%
Overview:
Publications overview
• Assesses all types of research outputs in terms of their
‘originality, significance and rigour’
• Expert sub panels for each 36 (subject based) Units of
Assessment
• Publication period 1st Jan 2008 – 31st Dec 2013
• Citation data used in some panels to ‘inform the
assessment’
Assessment criteria
The criteria for assessing the quality of publications are
originality, significance and rigour*
Four star Quality that is world-leading in terms of originality, significance
and rigour
Three star
Quality that is internationally excellent in terms of originality,
significance and rigour but which falls short of the highest
standards of excellence
Two star Quality that is recognised internationally in terms of originality,
significance and rigour
One star Quality that is recognised nationally in terms of originality,
significance and rigour
Unclassified
Quality that falls below the standard of nationally recognised
work. Or work which does not meet the published definition of
research for the purposes of this assessment
* Each main panel provides descriptive account of the criteria
Outputs:
REF Systems
• Research Profile System – all elements of the REF
submission
• Research Profile Form – publications selected for
submission
• Eprints plugin on ORO (OU’s institutional repository)
• REF submission system
Library role
• Managing publications submission:
–Scoping and planning
–Technical phase
–Testing and evaluation
–Quality assurance
–Communication – within and outside the OU
–Validating citation data
–Scanning and print submission
Reflections
Beyond REF2014
• Consultation in 2013
• HEFCE policy for journal articles and conference
proceedings published in March 2014
• For publications accepted after 1st April 2016:
– Open access - deposit of the ‘authors accepted
manuscript in a repository’
– Deposit of metadata completed no longer than 3
months after acceptance with an extra month to deposit
the full-text if there is no publisher embargo
Beyond REF2014 (continued)
• Full-text embargoes – panel A&B (Science, Technology,
Medicine) no longer than 12 months, C&D no longer 24
months, full-text must be available within one month after
the end of the embargo period
• Exceptions will be allowed
• Must enable machine readable discovery and access
• Data and text mining
• HEFCE are working with Jisc to support repositories in
implementing this policy
• HEFCE consultation out on the role of metrics in the next
REF
Nicola Dowson
Library Services
The Open University
Walton Hall
Milton Keynes
MK7 6AA
www.open.ac.uk/library
Nicola.Dowson@open.ac.uk

Weitere ähnliche Inhalte

Was ist angesagt?

Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...
Kristi Holmes
 
JCDL2014_HAN_XU_pptx
JCDL2014_HAN_XU_pptxJCDL2014_HAN_XU_pptx
JCDL2014_HAN_XU_pptx
Han Xu, PhD
 
Research courses for the EdD
Research courses for the EdDResearch courses for the EdD
Research courses for the EdD
CPEDInitiative
 

Was ist angesagt? (20)

The IPCC: Contributing and Experiences
The IPCC: Contributing and ExperiencesThe IPCC: Contributing and Experiences
The IPCC: Contributing and Experiences
 
Classifying R&D: Why and How Organizations Develop Taxonomies for Research Fi...
Classifying R&D: Why and How Organizations Develop Taxonomies for Research Fi...Classifying R&D: Why and How Organizations Develop Taxonomies for Research Fi...
Classifying R&D: Why and How Organizations Develop Taxonomies for Research Fi...
 
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012Rubriq: Independent Peer Review & Journal Matching   ISMTE 2012
Rubriq: Independent Peer Review & Journal Matching ISMTE 2012
 
How Do I Know Thee? Let Me Count the Ways: Panel 2: Jeffrey Alexander & Patri...
How Do I Know Thee? Let Me Count the Ways: Panel 2: Jeffrey Alexander & Patri...How Do I Know Thee? Let Me Count the Ways: Panel 2: Jeffrey Alexander & Patri...
How Do I Know Thee? Let Me Count the Ways: Panel 2: Jeffrey Alexander & Patri...
 
Kyrillidou Session One NISO Training Assessment Practices
Kyrillidou Session One NISO Training Assessment PracticesKyrillidou Session One NISO Training Assessment Practices
Kyrillidou Session One NISO Training Assessment Practices
 
Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...
 
JCDL2014_HAN_XU_pptx
JCDL2014_HAN_XU_pptxJCDL2014_HAN_XU_pptx
JCDL2014_HAN_XU_pptx
 
Simple title scheme for simpler guideline retrieval
Simple title scheme for simpler guideline retrievalSimple title scheme for simpler guideline retrieval
Simple title scheme for simpler guideline retrieval
 
Open Assessment and Open Citation Analysis - Experiences with the Journal "E...
Open Assessment  and Open Citation Analysis - Experiences with the Journal "E...Open Assessment  and Open Citation Analysis - Experiences with the Journal "E...
Open Assessment and Open Citation Analysis - Experiences with the Journal "E...
 
Erl presentation march 17 Selecting Open Access Journals
Erl presentation march 17 Selecting Open Access JournalsErl presentation march 17 Selecting Open Access Journals
Erl presentation march 17 Selecting Open Access Journals
 
Thesis writing help in india
Thesis writing help in indiaThesis writing help in india
Thesis writing help in india
 
Transferrable thrills: Taking the Librarian out of the Library
Transferrable thrills: Taking the Librarian out of the LibraryTransferrable thrills: Taking the Librarian out of the Library
Transferrable thrills: Taking the Librarian out of the Library
 
Beyond the Factor: Talking about Research Impact
Beyond the Factor: Talking about Research ImpactBeyond the Factor: Talking about Research Impact
Beyond the Factor: Talking about Research Impact
 
Responsible metrics: One size doesn't fit all
Responsible metrics: One size doesn't fit allResponsible metrics: One size doesn't fit all
Responsible metrics: One size doesn't fit all
 
Tim Ferris et al 2008
Tim Ferris et al 2008Tim Ferris et al 2008
Tim Ferris et al 2008
 
National Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation ExcellenceNational Center for Academic & Dissertation Excellence
National Center for Academic & Dissertation Excellence
 
Supporting Bibliometrics
Supporting BibliometricsSupporting Bibliometrics
Supporting Bibliometrics
 
International comparisons in senior secondary assessments
International comparisons in senior secondary assessmentsInternational comparisons in senior secondary assessments
International comparisons in senior secondary assessments
 
Research courses for the EdD
Research courses for the EdDResearch courses for the EdD
Research courses for the EdD
 
Behind the scenes of peer review
Behind the scenes of peer reviewBehind the scenes of peer review
Behind the scenes of peer review
 

Ähnlich wie Nicola Dowson: Ref2014 and beyond

Where to Publish: evaluating journals
Where to Publish: evaluating journalsWhere to Publish: evaluating journals
Where to Publish: evaluating journals
Sharon Karasmanis
 
Probation Assessment 2013 Marian petre
Probation Assessment 2013   Marian petreProbation Assessment 2013   Marian petre
Probation Assessment 2013 Marian petre
VreckaScott
 
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
Max Haring
 
Demystifying the COMREC Processes and Procedures
Demystifying the COMREC Processes and ProceduresDemystifying the COMREC Processes and Procedures
Demystifying the COMREC Processes and Procedures
Lucinda Manda-Taylor?
 

Ähnlich wie Nicola Dowson: Ref2014 and beyond (20)

What makes a REF paper REF-able?
What makes a REF paper REF-able?What makes a REF paper REF-able?
What makes a REF paper REF-able?
 
Presentation on Software process improvement in GSD
Presentation on Software process improvement in GSDPresentation on Software process improvement in GSD
Presentation on Software process improvement in GSD
 
DOAJ as Gatekeeper for Quality Open Access Journals
DOAJ as Gatekeeper for Quality Open Access JournalsDOAJ as Gatekeeper for Quality Open Access Journals
DOAJ as Gatekeeper for Quality Open Access Journals
 
Where to Publish: evaluating journals
Where to Publish: evaluating journalsWhere to Publish: evaluating journals
Where to Publish: evaluating journals
 
Creating and Maintaining a Sustainable Research Data Management Service: Wher...
Creating and Maintaining a Sustainable Research Data Management Service: Wher...Creating and Maintaining a Sustainable Research Data Management Service: Wher...
Creating and Maintaining a Sustainable Research Data Management Service: Wher...
 
The new Evaluation Methodology
The new Evaluation MethodologyThe new Evaluation Methodology
The new Evaluation Methodology
 
Gai Moore, Sax Institute
Gai Moore, Sax InstituteGai Moore, Sax Institute
Gai Moore, Sax Institute
 
Abstracting and indexing_Dr. Guenther Eichhorn
Abstracting and indexing_Dr. Guenther EichhornAbstracting and indexing_Dr. Guenther Eichhorn
Abstracting and indexing_Dr. Guenther Eichhorn
 
Probation Assessment 2013 Marian petre
Probation Assessment 2013   Marian petreProbation Assessment 2013   Marian petre
Probation Assessment 2013 Marian petre
 
Panel evaluation, processes and results
Panel evaluation, processes and resultsPanel evaluation, processes and results
Panel evaluation, processes and results
 
Researcher profiles and metrics that matter
Researcher profiles and metrics that matterResearcher profiles and metrics that matter
Researcher profiles and metrics that matter
 
2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania2014 Springer Author Workshop Lithuania
2014 Springer Author Workshop Lithuania
 
Promoting High Quality Open Access Journals in African Higher Education
Promoting High Quality Open Access Journals in African Higher EducationPromoting High Quality Open Access Journals in African Higher Education
Promoting High Quality Open Access Journals in African Higher Education
 
Writing for publication
Writing for publicationWriting for publication
Writing for publication
 
DORA and the reinvention of research assessment
DORA and the reinvention of research assessmentDORA and the reinvention of research assessment
DORA and the reinvention of research assessment
 
Adam Etkin's Flash Presentation from STM Spring 2014
Adam Etkin's Flash Presentation from STM Spring 2014Adam Etkin's Flash Presentation from STM Spring 2014
Adam Etkin's Flash Presentation from STM Spring 2014
 
Demystifying the COMREC Processes and Procedures
Demystifying the COMREC Processes and ProceduresDemystifying the COMREC Processes and Procedures
Demystifying the COMREC Processes and Procedures
 
Writing Research Proposals and Publications: Getting started
Writing Research Proposals and Publications: Getting startedWriting Research Proposals and Publications: Getting started
Writing Research Proposals and Publications: Getting started
 
Supporting the ref5
Supporting the ref5Supporting the ref5
Supporting the ref5
 
Reporting and utilizing research findings
Reporting and utilizing research findingsReporting and utilizing research findings
Reporting and utilizing research findings
 

Kürzlich hochgeladen

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 

Kürzlich hochgeladen (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 

Nicola Dowson: Ref2014 and beyond

  • 1. REF2014 and beyond Nicola Dowson, Open University Library
  • 2. Session outline • Overview of the REF • Systems used for the publications submission • Library role • Reflections • Next REF
  • 3. The assessment framework Overall quality Publications Maximum of 4 per researcher Impact Impact template and case studies Environment Environment data and template 65% 20% 15% Overview:
  • 4. Publications overview • Assesses all types of research outputs in terms of their ‘originality, significance and rigour’ • Expert sub panels for each 36 (subject based) Units of Assessment • Publication period 1st Jan 2008 – 31st Dec 2013 • Citation data used in some panels to ‘inform the assessment’
  • 5. Assessment criteria The criteria for assessing the quality of publications are originality, significance and rigour* Four star Quality that is world-leading in terms of originality, significance and rigour Three star Quality that is internationally excellent in terms of originality, significance and rigour but which falls short of the highest standards of excellence Two star Quality that is recognised internationally in terms of originality, significance and rigour One star Quality that is recognised nationally in terms of originality, significance and rigour Unclassified Quality that falls below the standard of nationally recognised work. Or work which does not meet the published definition of research for the purposes of this assessment * Each main panel provides descriptive account of the criteria Outputs:
  • 6. REF Systems • Research Profile System – all elements of the REF submission • Research Profile Form – publications selected for submission • Eprints plugin on ORO (OU’s institutional repository) • REF submission system
  • 7. Library role • Managing publications submission: –Scoping and planning –Technical phase –Testing and evaluation –Quality assurance –Communication – within and outside the OU –Validating citation data –Scanning and print submission
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 14.
  • 15. Beyond REF2014 • Consultation in 2013 • HEFCE policy for journal articles and conference proceedings published in March 2014 • For publications accepted after 1st April 2016: – Open access - deposit of the ‘authors accepted manuscript in a repository’ – Deposit of metadata completed no longer than 3 months after acceptance with an extra month to deposit the full-text if there is no publisher embargo
  • 16. Beyond REF2014 (continued) • Full-text embargoes – panel A&B (Science, Technology, Medicine) no longer than 12 months, C&D no longer 24 months, full-text must be available within one month after the end of the embargo period • Exceptions will be allowed • Must enable machine readable discovery and access • Data and text mining • HEFCE are working with Jisc to support repositories in implementing this policy • HEFCE consultation out on the role of metrics in the next REF
  • 17. Nicola Dowson Library Services The Open University Walton Hall Milton Keynes MK7 6AA www.open.ac.uk/library Nicola.Dowson@open.ac.uk

Hinweis der Redaktion

  1. Results won’t be available until the 18th December, HEFCE will develop their funding formula over christmas. Martin Bean comment