Value of-grey-to-research-business-jeffery-gl conf-20131. The Value of Grey to
Research, Business and Society
Keith G Jeffery
keith.jeffery@keithgjefferyconsultants.co.uk
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
1
4. CAREER
ā¢ Late 60s First UK
relational system: GEXEC
ā¢ 70s Filematch:
interoperation
ā¢ Early 80s Online
grants, library, science
ā¢ Late80s IDEAS, EXIRPTS
ā¢ 90s CERIF
ā¢ 00s e-Science
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
4
5. And the running theme isā¦
To describe:
Persons (users),
Data (including publications),
Processes,
e-Infrastructure
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
5
6. Which allowsā¦.
The user neither knows nor cares
how her processing is done as long as
service levels and quality of service
are appropriate
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
6
7. Grey Literature Publications
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
Jeffery, K G: āAn Architecture for Grey Literature in a R&D Contextā Proceedings GL'99 (Grey
Literature) Conference Washington DC October 1999 ; TextRelease
Keith G. Jeffery, (2000) "An architecture for grey literature in a R&D context", International Journal
on Grey Literature, Vol. 1 Iss: 2, pp.64 - 72 DOI: 10.1108/14666180010327429
K G Jeffery, A G S Asserson Relating Intellectual Property Products to the Corporate Context;
Proceedings Grey Literature 6 Conference, New York, December 2004; TextRelease; ISBN 90-7748403-5
Asserson, A; Jeffery, K.G.; āResearch Output Publications and CRISā The Grey Journal volume 1
number 1: Spring 2005 TextRelease/Greynet ISSN 1574-1796 pp5-8
K G Jeffery, A G S Asserson āGrey in the R&D Processā; Proceedings Grey Literature 7
Conference, Nancy, December 2005; TextRelease; ISBN 90-77484-06-X ISSN 1386-2316
K G Jeffery, A G S Asserson āGrey in the R&D Processā; The Grey Journal Vol 2 Number 3 September
2006 ISSN 1574-1796
Keith G Jeffery, Anne Asserson: āHyperactive Grey Objectsā Proceedings Grey Literature 8
Conference (GL8), New Orleans, December 2006; TextRelease; ISBN 90-77484-08-6. ISSN 1386-2316
; No. 8-06-X
Keith G Jeffery, Anne Asserson: āHyperactive Grey Objectsā in Robert E Baensch (Ed); Publishing
Research Quarterly Vol 23 Number 1 March 2007; pp 71-77; Springer New York and
www.springeronline.com
Keith G Jeffery, Anne Asserson: āGreyscapeā Opening Paper in Proceedings Grey Literature 9
Conference Antwerp (GL9) 10-11 December 2007 pp9-14; Textrelease, Amsterdam; ISSN 1386-2316
Keith G Jeffery, Anne Asserson: āGreyscapeā The Grey Journal 4 (3) 2008 pp 137-142 ISSN 1574-1796
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
7
8. Grey Literature Publications
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
Keith G Jeffery, Anne Asserson: āINTERESTā Proceedings Grey Literature Conference Amsterdam 8-9
December 2008 in Tenth International Conference on Grey Literature : Designing the Grey Grid for
Information Society, 8-9 December 2008, Science Park Amsterdam, The Netherlands ed. by
Dominic J. Farace and Jerry Frantzen ; GreyNet, Grey Literature Network Service. - Amsterdam :
TextRelease, February 2009. GL-Conference series, ISSN 1386-2316; No. 10. - ISBN 978-90-7748411-1.
Keith G Jeffery, Anne Asserson: āMOSAIC: Shades of Greyā Proceedings Eleventh International
Conference on Grey Literature Conference Washington DC 15-16 December 2009 Ed Dominic
Farace and Jerry Frantzen pp54-58 TextRelease Amsterdam Series ISSN 1386-2316; no 11; ISBN
978-90-77484-13-5
Keith G Jeffery, Anne Asserson āGL Transparency: Through a Glass, Clearlyā Proceedings Twelfth
International Conference on Grey Literature, Prague December 2010 Ed Dominic Farace and Jerry
Frantzen 95-100, TextRelease Amsterdam Series ISSN 1386-2316; no 12; ISBN 978-90-77484-16-6
Keith G Jeffery, Anne Asserson āGL Transparency: Through a Glass, Clearlyā The Grey
Journal, Volume 7, Number 2, pp 99-104 Summer 2011 ISSN 1574-1796
Keith Jeffery & Anne Asserson: āGrey in the Innovation Processā GL14 2012: In Dominic Farace &
Jerry Frantzen (Eds): Proceedings International Conference on Grey Literature November Rome
2012
Keith Jeffery & Anne Asserson: āGrey in the Innovation Processā The Grey Journal Volume
9, Number 3, Autumn 2013 http://www.greynet.org/thegreyjournal/forthcoming.html
Keith Jeffery & Anne Asserson: āAuditing Grey in a CRIS Environmentā accepted for presentation at
GL15 2013 Bratislava December 2013
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
8
9. Grey Literature Career
ā¢ And references to GL in
many other publications
and presentations
ā¢ You will note much of
the work has been done
jointly with Anne
Asserson, University of
Bergen Library, whose
contributions are
hereby acknowledged.
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
9
11. GL Questions (Greynet.org)
1. What is the definition of grey literature?
2. How is grey literature best described?
3. Once grey literature is indexed and referenced, does it
cease to be grey?
4. Should grey literature be free to access?
5. Is grey literature subject to a review process?
6. Is the content of commercially published documents
superior to grey?
7. Does grey literature constitute a field in information
studies?
8. Should the average net-user recognize the term grey
literature?
9. What problems currently face grey literature?
10 What is the impact of grey literature?
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
11
12. What is Grey Literature
ā¢ "Grey literature stands for
manifold document types
produced on all levels of
government, academics, bu
siness and industry in print
and electronic formats that
are protected by intellectual
property rights, of sufficient
quality to be collected and
preserved by library
holdings or institutional
repositories, but not
controlled by commercial
publishers i.e., where
publishing is not the
primary activity of the
producing bodyā.
ā International Conference on
Grey Literature 2010
Ā©Keith G Jeffery
ā¢ That which is not āwhiteā
ā Quality
ā Institutional holding
ā Not managed by commercial
publishers
ā¢ In fact commonly it is
ā the IP (intellectual property)
ā the āknow howā
Of an organisation
ā¢ And is thus more
valuable than the
āwhiteā literature
ā which āgives awayā
the IP
Recognising the value of Grey Literature
20131114
12
13. Examples
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
PhD Thesis
Workshop Reports
Unrefereed conference material
Technical reports
ā May be later published as
refereed papers
ā Possibly after revision
Seminar materials
Learning Materials
Masters Thesis
Technical manuals, instructions
ā Usually version controlled
Ā©Keith G Jeffery
ā¢ Records of management
decisions
ā Policy documents
ā Meeting minutes, agendas
ā¢ Marketing material
ā Usually version controlled
ā¢ Computer software
ā¢ Data not validated independently
ā¢ Art artefacts
ā¢ Popular
articles, interviews, presentation
ā¢ Does one include ephemera?
Recognising the value of Grey Literature
20131114
13
14. Grey and White
Example: Doctoral Thesis
Doctoral
Thesis
extract
The whitest of the grey?
(double review)
aggregate
Ā©Keith G Jeffery
Recognising the value of Grey Literature
Published
peerReviewed
paper
20131114
14
15. GL Issues
ā¢ Is the process documented?
ā¢ Does it include review?
ā Internal, informal ļ§ļØ External, formal
ā By whom?
ā With what role?
ā¢ Is the provenance documented?
ā¢ Are versions documented?
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
15
16. Quality
ā¢ Data (the document or object)
ā The quality is determined by
ā¢ Provenance
ā¢ Review process
ā (internal, [formal | informal])
ā¢ Subsequent reconsideration (annotation)
ā¢ Metadata
ā The quality of the metadata determines
ā¢ Recall and relevance in retrieval
ā¢ Access and rights management
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
16
17. Achieving Quality
ā¢ Collected as early as
possible in the process
by people intimately
related to the subject
ā¢ Quality checked within
the process
ā ISO9001
ā Some grey literature
critically important for
business continuity / risk
management
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
17
18. GL and OA
ā¢ Grey Literature is increasingly stored in an
institutional OA repository by the organisation where
it is generated
ā¢ Access: metadata must be in standard form and of
high quality (minimally OAI-PMH-DC)
ā Ease of access: recall, relevance
ā Access restrictions: rights, security
ā¢ Object quality: may be measured by hyperlinks from
other objects, accesses or downloads
ā Is this the equivalent of citations
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
18
19. GL Repository Issues
ā¢ Measuring impact of grey
ā Academic
ā Wealth creation / improvement in quality of life
ā¢
ā¢
ā¢
ā¢
Version management
Access management
Rights management
How to distinguish in the repository grey from
green?
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
19
20. GL Repository Issues
ā¢ Measuring impact of grey
ā Academic
ā Wealth creation / improvement in quality of life
ā¢
ā¢
ā¢
ā¢
Version management
Access management
Rights management
How to distinguish in the repository grey from
green?
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
20
21. CRIS-IR
In 2002 CRIS and IR were different worlds.
Progressive integration.
Catalogue of IRs in euroCRIS DRIS
Recognition of value of CERIF as metadata for IR
OpenAIRE adopted CERIF
COAR strategic relationship
Ā©Keith G Jeffery
Recognising the value of Grey Literature
2011 Rome
Declaration
20131114
21
22. Introducing GL and CERIF
ā¢ CERIF places the grey literature in context
ā¢ A Result_Publication or Product linked to:
ā
ā
ā
ā
ā
Project, Person, OrganisationalUnit
Funding
Event
Facility, equipment
Prize/Award
ā¢ Which allows the end-user to assess better relevance, quality
of grey material
ā¢ Which allows research managers to measure output of grey
material
ā¢ Which allows innovators (subject to security) to discover
research products to take to wealth creation or improvement
in the quality of life
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
22
23. Introducing GL and CERIF
ā¢ A CERIF-CRIS (together with a repository)
solves most of the issues documented
previously
ā¢ By providing a structured, logical context for
the grey object
ā¢ Within the R&D process
ā¢ Allowing the end-user to determine quality
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
23
25. Value of Research
The ability to create, distribute and exploit knowledge has become a major
source of competitive advantage, wealth creation and improvements in the
quality of life.
[OECD 2000]
Civilised society has always carried out research. Such research is
documented from early Chinese civilisations, and may well have been
documented in Neolithic times. Indeed, the paintings in caves such as
Lascaux appear to be both an observational record (of local fauna) and a
modelling or simulation of intended action (hunting). The key point is that
research leads to wealth creation and improvement in the quality of life. The
problem is that the process to create wealth or life improvement from
research outputs is little understood and apparently non-deterministic.
However, there is a general belief that if one documents the research
activity, and the research output, then the opportunities for wealth creation
or improvement in the quality of life are increased.
[Asserson & Jeffery wissenschaftsmanagement 1 ā¢ januar/februar ā¢ 2009]
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
25
26. R&D Spend
ā¢ World annual spend on R&D is ~1.5 trillion usd
ā¢ This needs to be managed
ā By funders to justify spend
ā By research institutions to justify outputs from
inputs
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
26
27. UK Examples of Impact
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
27
28. Knowledge/ Technology Transfer
ā¢ The process from research to:
ā Wealth creation (business)
ā Improvement in the quality of life (society)
ā¢ Appears to be non-deterministic
ā¢ However it can be improved by:
ā Making information on the research easily available
ā¢ What it is (with as much context as possible)
ā¢ How it could be used
ā¢ Ownership and conditions of use (protecting IP)
The answer is: high quality metadata
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
28
30. Impact and Grey
ā¢ Behind (almost) all impact examples there is a
large body of grey material
ā Technical reports, manuals, datasets, software
IDEA
GREY
MATERIAL
DECISION
PATENT
PUBLISH
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
30
31. Grey Citations
J. Schƶpfel, et al. (2005). `Citation Analysis and Grey Literature:
Stakeholders in the Grey Circuit'. vol. 1, pp. 31-40
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
31
32. Obstacles to Realising Value
ā¢ Difficult to find / utilise the grey material
ā Not recorded / catalogued
ā Access restrictions
ā¢ IP protection
ā Poor metadata
ā¢ Hard to understand the context of the grey material
ā¢ Hard to envisage how the research products may be
used for business and/or society
ā Lack of classification of kinds of grey
ā¢ Confuses potential users
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
32
34. Policies
ā¢ In many countries and institutions there exist
policies on research publications:
ā Usually publicly-funded research should be
available to the public toll-free
ā Various licensing schemes each with advantages
and disadvantages
ā Green v Gold
ā¢ But they apply to peer-reviewed white
publications
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
34
35. Policies
ā¢ There are attempts to extend to research
datasets
ā Since they are commonly intimately related to and
support a peer-reviewed white publication
ā¢ But none for grey
ā¢ Left to individual institutions
ā Repository of scholarly publications
ā Distinguish grey from white
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
35
36. Towards Policies
ā¢ Recognising the value
ā http://www.nlm.nih.gov/nichsr/greylitreport_06.h
tml
ā¢ Access
ā Open data (data.gov)
ā¢ Datasets but in fact many are pdf reports
ā Using legislation
ā¢ Freedom of information requests
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
36
37. Achieving Value
ā¢ Availability
ā¢ Relevance
ā¢ Quality
ā¢ Metadata
ā As well as title, abstract
keywords..
ā And access restrictions
ā¢ Within an organisation
ā¢ Between partner
organisatons
ā¢ Open
ā Process steps recorded
ā Context recorded
(project, organisation, pers
on, funding, facilities /
equipment)
ā Related publications
recorded
ā¢ Related datasets, software
recorded
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
37
38. User Classes
ā¢ Research and Development Information
ā For the political decision-makers
ā For the funding organisations
ā For the entrepreneurs
ā For the researchers
ā For the research managers
ā For the innovators
ā For the media
ā For the general public
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
38
41. RESULT_PUBLICATION
PROJECT
CERIF Expressiveness
ORGUNIT
PERSON
Result_Publication
Can Express:
Person A (DT1 - DT2)
Orgunit O (DT1 - DT2)
Person A (DT1 - DT2)
Person A (DT1 - DT2)
Person A (DT1-DT2)
Person A (DT1-DT2)
Orgunit M (DT1-DT2)
Orgunit N (DT1-DT2)
Ā©Keith G Jeffery
(is author of)
(is owner of IPR in)
(is employee of )
(is project leader of)
(is member of)
(is member of)
(is part of)
(is part of)
Recognising the value of Grey Literature
Publication X
Publication X
Orgunit O
Project P
Orgunit M
Orgunit N
Orgunit O
Orgunit O
20131114
41
43. Repositories and CERIF
ā¢ To view content (white or grey) in repositories through
contextualised, structured metadata
ā E.g. Relate publication to:
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
ā¢
Persons
Organisations
Projects
Funding
Facilities
Equipment
Event
Patent
Product
Allows the user to judge
better relevance, quality
ā¢ Repository metadata DC (Dublin Core) insufficient
ā¢ (as recognised by OpenAIREPlus when adopted CERIF)
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
43
44. CERIF Features
CERIF
ā¢ Developed by international community ā consensus
ā¢ Flexible and extensible
ā¢ Separation of base and link entities
ā Flexible / extensible
ā Rich semantics (role)
ā Temporal : it is the relationships that have duration
ā¢ Multi characterset
ā¢ Multilingual
ā¢ Formal Syntax
ā Efficient, accurate computer processing
ā¢ Declared Semantics
ā Including crosswalks for interoperation
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
44
46. Conclusion
ā¢ Grey material is a critically important
component of information generated by R&D
ā¢ It provides the basis for commercial
exploitation of R&D
ā¢ It provides the basis for improvements in the
quality of life
ā¢ It needs to be exposed by quality metadata
It is time the value of grey is recognised
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
46
48. Metadata Standards
ā¢ There are hundreds of specific formats used as a āstandardā within a
specific community but ones used widely are:
ā¢ DC (Dublin Core): used to describe web pages ļØ web resources
ā¢ CKAN (Comprehensive Knowledge Archive Network): used in
government open data sites ā based on DC
ā¢ eGMS; e-Government Metadata Standard ā based on DC
ā¢ DCAT (Data Catalog): used for datasets on the web ā based on DC
ā¢ INSPIRE : used for datasets with geospatial coordinates
ā EU Directive and standard; some overlap with DC but extended
ā¢ CERIF (Common European research Information Format): used for
all research information
ā¢ All but CERIF are āflatā or ālinearā
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
48
52. Metadata Standards: DCAT
Same as DC are:
Title, description, identi
fier, keyword, language
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
52
53. Metadata Standards: INSPIRE
ā¢ EU Directive (2008, 2009)
ā¢ For Geospatial datasets
ā Initiated by ESA
ā¢ Essentially DC plus geospatial information
ā¢ Geospatial information very detailed ā
coordinate system, precision etc
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
53
54. Metadata Standards: CERIF
ā¢ Common European Research Information Format
ā¢ Data Model for exchange and storage of information about
research
ā¢ CERIF91 (1987-1990) quite like the later Dublin Core (late
1990s)
ā¢ CERIF2000 (1997-1999) used full E-E-R modelling
ā Base entities
ā Linking entities with role and temporal interval
ā¢ 2002 EC requested euroCRIS to maintain, develop and
promote CERIF www.eurocris.org
ā¢ Now in use in 43 countries and national standard for
research information in 10
Ā©Keith G Jeffery
Recognising the value of Grey Literature
20131114
54
55. CERIF-CRIS in context
Directory
Services
Web pages
CERIF-CRIS
Dataset
Publication
Software
repository
repository
Ā©Keith G Jeffery
Finance
system
Human
Resources
system
Project
Management
system
Recognising the value of Grey Literature
20131114
55