SlideShare ist ein Scribd-Unternehmen logo
1 von 43
FRASCATI MANUAL 2015
GUIDELINES FOR COLLECTING AND REPORTING DATA
ON RESEARCH AND EXPERIMENTAL DEVELOPMENT
Main features and outcomes of the 6th revision
Part 1. Background to the Frascati Manual
• The manual’s origins
• The 6th revision
Part 2. 2015 edition
• Main features of the 2015 edition
• Key elements chapter by chapter.
Part 3. Implementation of the 2015 Frascati
Manual
Contents
BACKGROUND TO THE
FRASCATI MANUAL AND ITS
2015 EDITION
• An OECD standard
– Statistical purpose, developed by NESTI
– Non binding rules
– De facto global standard
– Used by policy makers and others
• 1st ed. in 1963 – context has changed, but
monitoring resources for R&D has always
mattered
– Name comes from Italian town where
guidelines were first approved in 1962
– Revised 5 times in the past
– Last time in 2002
• First step in the international
measurement of STI and its impacts
– Focus on R&D inputs, integrated into
broader measurement and analysis system
What is the “Frascati Manual”?
• Address user and producer needs
– Clarify concepts, address new topics and changes in how
R&D is performed and funded
– Improve international comparability of R&D data.
– Relevant and applicable in developing countries
– Facilitate use of FM for R&D data used in National Accounts
– Align to new and revised statistical classifications, systems,
Frascati family of manuals
– Improve comparability - address methodological challenges
and disseminate best practices
– Role of administrative data in addition to surveys
– Take into account the use of R&D microdata and linking for
analysis
• An in-depth revision was required to meet these needs
Why revised in 2015?
Examples of
Frascati in ‘use’
EU Community framework for
state aid for research and
development and innovation
(2006/C 323/01)
When classifying different activities, the
Commission will refer to its own practice as
well as the specific examples and
explanations provided in the Frascati
Manual on the Measurement of Scientific
and technological Activities, Proposed
Standard Practice for Surveys on Research
and Experimental Development.
Relevance:
Meets data users’ needs
Based on
consensus among
data producers:
Adopted
internationally and
supports comparable
statistics
Feasible: based on
measurement
experience and
tested approaches
Revision process and contents aligned
to meet three criteria:
• A statistical manual, but aware of its broader use.
• NESTI responsibility.
• Drawing on other OECD committees input and stakeholder
web-based open consultation.
• Declassified by OECD Statistics Committee (CSSP) and
OECD Committee for Scientific and Technological Policy
• Avoid unwarranted potential disruption to policy uses and
data series
• Main focus on R&D resources
– Clarify that FM measurement perspective not tied to the “linear
model of innovation”
– Evidence collected to feed into guidance on outputs and analysis
of links between inputs and outputs
Boundaries applying to the revision
90+ different individuals (and country leads) signed up to develop
guidance on:
• R&D definition – implementation guidance (ITA)
• Outputs of R&D – (CAN, DEU)
• Measures of government funding (CHE, secretariat)
• R&D expenditures (NOR)
• R&D personnel (RUS)
• Institutional sector classifications (FRA)
• Higher education (DEU, NOR)
• R&D globalisation (USA, BEL)
• R&D capitalisation (GBR)
• Use of administrative data & survey methodologies (CAN)
• R&D by industry (secretariat)
External input secured through an open consultation in 2013
Phase 1. (March 2013-June 2014)
Country-led revision groups
• New, expanded chapter structure agreed by NESTI
• NESTI Bureau tasked to deliver a draft based on
discussions and decisions
• Preparation and discussion of draft chapters.
• Workshop with country experts, Lisbon, December
2014
• Draft manual presented to delegates, March 2015.
Phase 2. Drafting the new manual
(Jul 2014-March 2015)
• April 2015. NESTI agrees the new manual on
principle.
• Written comments from NESTI delegates
incorporated in draft.
• Style editing
• Draft submitted to and approved by CSTP and
CSSP for declassification
• Manual design and publishing
• Launch at World S&T Forum and CSTP
Ministerial meeting, Daejeon, Korea. 19 Oct
2015.
Phase 3. April-October 2015.
Approval and publication.
OECD Working Party of National Experts on
Science and Technology Indicators (NESTI)
April 2014
NESTI group photo after the approval in principle of the Frascati Manual 2015
• Some examples
– Intensive use of online community space sharing material and commenting
• (100+ users, 250+ documents)
– Intensive use of videoconferencing for group discussion and webinars (up to
30 people at times)
– Online-based stakeholder consultation (50+ submissions)
– Use of online survey tool for delegate R&D vignette survey response gathering
– Since September 2014, weekly Bureau meetings to assist in the editing
– Two NESTI dedicated workshops (+90 participants)
• Outcomes
– A learning process for delegates, new countries. The revision process serves a
pedagogical function within the NESTI community and within the OECD as a
‘learning organisation’
– Most inclusive revision process to date.
– Considerable financial savings and value for money
– Relevant experience for other groups and future guideline work by NESTI
Some major changes in collaborative
project working
CONTENTS OF THE 2015
EDITION
Frascati Manual 2015
Guidelines for Collecting and Reporting Data on Research and
Experimental Development
• The Frascati Manual provides guidelines and
recommendations for compiling and reporting
internationally comparable statistics on R&D expenditures
and personnel.
• It is a consensus document with no mandatory
enforcement mechanisms that is revised on a regular basis
to take into account new developments in the areas of
statistics and of R&D (see next slide).
• The title of 7th edition has been changed, reflecting
expansion in focus.
Chapter 1: Introduction to R&D Statistics
and the Frascati Manual
• Provides objectives, background and general overview of the manual ; of
particular interest to non-statisticians, policy makers and various types of users.
• Explains reasons for revisions to the Frascati Manual and expanded coverage:
– The explicit adoption in the 2008 revision of the System of National Accounts of Frascati
R&D definitions and data as the basis for treating R&D expenditures as capital formation
(investment).
– The need to better reconcile the widespread use of Frascati Manual for both statistical and
policy-related purposes (e.g. coverage of R&D tax relief topics and difficulties of measuring
R&D business expenses).
– Use of the Frascati Manual by countries at different stages of economic development, with
varying forms of economic structures and national research systems necessitated the
introduction of individual sector-specific chapters to allow greater granularly in collection
guidance. In particular, can better address some specific developing country related topics.
– Because of ongoing changes to the organisation of R&D activities, there was the need to
address new statistical challenges (such as measuring intramural versus extramural R&D
performance, and R&D globalisation issues).
– Desire to address new types of uses of R&D data (micro-data analyses), methodological
challenges (related to burden and response rates) and opportunities (use of administrative
records).
– Need to reflect changes/revisions in statistical classification systems implemented since the
last 2002 Frascati Manual update.
Chapter 2. Concepts and definitions for
identifying R&D
Modified R&D definitions meant to remain consistent with previous
definitions
FM2002:
• Research and experimental development (R&D) comprise creative
work undertaken on a systematic basis in order to increase the stock of
knowledge, including knowledge of man, culture and society, and the use of
this stock of knowledge to devise new applications.
FM2015 (see next slide):
• Research and experimental development (R&D) comprise creative
and systematic work undertaken in order to increase the stock of knowledge
– including knowledge of humankind, culture and society – and to devise
new applications of available knowledge.
“Research and experimental development
(R&D) comprise creative work
undertaken on a systematic basis in
order to increase the stock of knowledge,
including knowledge of man, culture
and society,
and the use of this stock of
knowledge to devise new
applications.”
“Research and experimental development
(R&D) comprise creative and
systematic work undertaken in order
to increase the stock of knowledge,
- including knowledge of humankind,
culture and society -
gender neutral, still remind users that Social
sciences, Arts & Humanities are within scope
less words,
“systematic” on par with “creative”
FM2002 FM2015
and to devise new applications of
available knowledge.”
The previous definition could imply that all knowledge used for experimental development (“D”) had
been created by R&D (linear model?). The parsing also hinted that all uses of R&D knowledge for new
applications were D.
New definition asserts more explicitly that D also has to be creative and systematic work increasing
knowledge.
Modified R&D definitions meant to remain
consistent with previous definitions
Type of R&D
FM2002 and FM2015 (unchanged):
• Basic research is experimental or theoretical work undertaken primarily to acquire new
knowledge of the underlying foundation of phenomena and observable facts, without any
particular application or use in view.
FM2002 and FM2015 (~unchanged):
• Applied research is also original investigation undertaken in order to acquire new
knowledge. It is, however, directed primarily towards a specific practical aim or objective.
FM2002:
• Experimental development is systematic work, drawing on existing knowledge gained
from research and practical experience, that is directed to producing new materials,
products or devices; to installing new processes, systems and services; or to improving
substantially those already produced or installed.
FM2015 (slight modification and next slide):
• Experimental development is systematic work, drawing on knowledge gained from
research and practical experience and generating additional knowledge, which is directed
to producing new products or processes or to improving existing products or processes.
Chapter 2: Concepts and Definitions for
Identifying R&D
• Identifies a set of explanatory criteria to help in implementation. All five
criteria are to be met, at least in principle, every time an R&D activity is
undertaken whether on a continuous or occasional basis, by a performer in
any sector.
– Novel (aimed at new findings)
– Creative (based on original concepts; not obvious)
– Uncertain (outcome, cost, time allocation not known a priori)
– Systematic (planned and budgeted)
– Transferable and/or reproducible (should be the potential to transfer results)
• Explicit introduction of the concept of “R&D project” as an aid to resolve
challenging boundary cases
• Explicit inclusion of “the arts” as a Field of Research and Development
(FORD), (previously field of “S&T” )
• Field-specific examples of basic, applied, and experimental development
• More up to date list of examples of boundaries and exclusions from R&D
– R&D and innovation activities — R&D and related scientific and technological
activities
– R&D and (versus) design — R&D versus artistic creation
– R&D versus product development — R&D versus pre-production development
– R&D and software development — R&D and service activities
Chapter 3: Institutional Sectors and Classifications
• The five institutional sectors (Business enterprise, Government, Higher
education, Private non-profit and Rest of the world) are maintained and are
consistent with those of the SNA with the exception of HE which does not
have a direct counterpart in the SNA, but which is core to R&D performance.
• “Abroad” has been renamed “Rest of the world” in accordance with the
SNA.
• Definition of HE slightly modified to only retain institutions that provide
“formal tertiary education programmes” and “research institutes, centres,
experimental stations and clinics that have their R&D activities under the
direct control of, or administered by, tertiary education institutions.”
• New figure introduced that gives a stylized representation of domestic
Frascati institutional sectors and their borderlines. Main borderline cases
discussed in a systematic way. More explicit recognition of organizational
complexities.
• Inclusion of text giving a list of general classifications applicable to all
institutional units (regardless of sector), i.e. by main economic activity, by
public or private status, by affiliation status to a broader group (domestic or
foreign), into SNA’s Corporations, General government and Non-profit
sectors, by field of R&D and by geography.
Decision tree for sectoring institutional classification
BE Business enterprise sector
HE Higher education sector
GOV Government sector
PNP Private non-profit sector
1. NPIs primarily serving businesses (e.g.
trade associations, etc.) are classified in the
Business enterprise sector, following the SNA
convention of classifying those into the SNA
Corporations sector.
2. This sector can be further subdivided into
public and private Business enterprises,
depending on whether the institution is
controlled by government or not. This is
analogous to the SNA treatment of public and
private corporations.
Chapter 4: Measurement of R&D Expenditures
• Gross domestic expenditure on R&D (GERD) includes current expenditures (including
labour and other current costs) plus gross fixed capital expenditures (such as for land,
buildings, machinery and equipment).
• Inclusion of new concepts and terminology: internal/external sources of funds
(originating within or outside of the control of the R&D-performing unit) and
exchange/transfer funds (with or without a compensatory return of R&D).
• Inclusion of a summary table on intramural expenditure categories and of a figure on
funding flows from the perspective of an R&D performer.
• New examples on identifying R&D sources for funds that flow through multiple units
and across sectors.
• Inclusion of a text on measurement of funds for extramural R&D and on sales and
purchases of R&D.
• Inclusion of a table identifying which sources of funds should be collected on R&D
performer surveys.
• Improved guidelines on the treatment of labor costs, in particular for external R&D
personnel fully integrated into the intramural R&D of a reporting unit, to be in line
with identified categories of R&D personnel in chapter 5.
• Recommendation to collect depreciation costs, but not to include such costs in
intramural R&D.
Chapter 4: Measurement of R&D Expenditures
• Inclusion of a comprehensive list of types of fixed assets used for R&D - i.e. land and
buildings, machinery and equipment (in place of ‘instruments and equipment),
capitalized computer software and other intellectual property products - and for which
R&D expenditure data should be collected.
• Differentiation of FM depreciation from SNA depreciation (capital consumption).
• Clarified guidelines on the collection of software R&D that is part of current costs and
part of capital expenditure.
• Explanation on how software R&D is treated differently by FM (part of R&D) and by the
SNA (part of software).
• Inclusion of specific recommendations on the treatment of deductible taxes such as VAT.
• New clarifications and examples for allowable reporting (e.g., related to administration
costs; to treatment of MNE R&D cost allocations; and to operations & maintenance costs
of rented research facilities).
• Clarification on how to report public general university funds (GUF).
• Recommendation to report R&D tax incentives separately from other government
sources of R&D funds. (e.g., tax credits used for performing business R&D should be
treated as internal funds, not public funds).
Chapter 5: Measurement of R&D Personnel:
Persons employed and External contributors
FM2015 R&D personnel in a statistical unit include all persons engaged directly in R&D,
whether they are employed by the statistical unit or are external contributors fully integrated
into the statistical unit’s R&D activities, as well as those providing direct services for the R&D
activities (such as R&D managers, administrators, technicians and clerical staff).
• Coverage of R&D personnel now refers to total persons employed and deals explicitly with
the treatment of non-employees and external personnel fully integrated into the intramural
R&D of a reporting unit, e.g. categories such as self-employed, volunteers and students.
• Two main groups of individuals who potentially contribute to the R&D activities can be
identified:
– Persons employed by the statistical unit who contribute to the unit’s intramural R&D
activities (used interchangeably with the term “internal R&D personnel” in the manual).
– External contributors to the unit's intramural R&D activities (used interchangeably with the
term “external R&D personnel”). This group includes two subgroups: (i) persons who
receive wages/salaries but not from the statistical unit performing the R&D, and (ii) a number
of special cases of persons external to a statistical unit who contribute to intramural R&D.
Chapter 5: Measurement of R&D Personnel
• Classification of R&D personnel is now envisaged according to their ‘function’
(researchers, technicians, other supporting staff).
• Definition of researchers has been changed:
– Researchers are professionals engaged in the conception or creation of new
knowledge., products, processes, methods and systems and also in the management
of the projects concerned. They conduct research and improve or develop concepts,
theories, models, techniques instrumentation, software or operational methods.
• To be counted in R&D personnel totals, individuals should make appreciable
contributions (at least 0.1 FTE) and any one individual cannot contribute more than 1.0
FTE.
• Doctoral and master’s students may be included in either group of R&D personnel if
they meet the specific criteria aimed at ensuring that only individuals with an
appreciable contribution to the institution’s R&D are included.
• Improved convergence with the treatment of related labour costs in chapter 4.
• Definitions of FTEs (recommended counts for international comparisons) and of
headcounts (recommended primarily to describe, in percentage terms, R&D personnel
characteristics) are included.
• Guidelines are given for identifying/estimating FTEs and HCs and for estimating FTEs
according to a specific formula, if necessary.
• Distributions of aggregate R&D personnel totals discussed (e.g., by sex, function, age,
and formal qualification).
Chapter 6: Methodologies and Procedures
• This chapter provides general guidelines on methodology that are in
principle common to all institutional sectors. Some considerations on each
individual sector’s sampling units are nevertheless given in this chapter.
• Guidelines on survey design (e.g., sampling plan, questionnaire design) are
given and the use of administrative data is also considered. Preference for
dedicated R&D surveys is still acknowledged.
• The chapter covers issues with respect to data collection, integration of
multiple data sets, editing of collected data and imputation, estimation and
output validation.
• The need to provide indicators of data quality for the published aggregates is
explicitly acknowledged.
• Compilers of R&D statistics are encouraged to collect data on expected
expenditure data for the following year(s) (nowcasting).
Chapter 7: Business Enterprise R&D
• New chapter, but incorporates material previously part of FM2002 chapter on
“Functional Distributions”.
• Extensive guidance on defining units in the BE sector.
• Interest and benefit of using identification codes for sampling and collecting data
from statistical units.
– Main economic activity (as indicated by ‘value added’ or substitute criteria)
– public or private status and by affiliation status (parents or members of a domestic or foreign
group; foreign controlled enterprise).
– New size classifications recommended. (e.g. size cut-off at 10 or more employees)
• Variety of functional distributions of Business enterprise Expenditure on R&D
(BERD) detailed (e.g. source of funds, type of R&D)
• Distribution by industry orientation vs. economic activity discussed and inclusion
of a table describing the different approaches and criteria used.
• Distribution by FORD, socioeconomic objective, and technology areas discussed
(not specifically recommended).
• Comprehensive section on survey design, frame creation, data collection,
estimation and data quality relevant to the Business enterprise sector.
• Case of “combined” R&D and innovation surveys accepted but not recommended.
• Inclusion of cautionary guidance related to the use of financial accounting
sources (e.g., R&D expense) and over- and under-reporting of R&D.
Chapter 8: Government R&D
• New chapter, with a focus on collecting data from Government performers.
• Provides definitions of the components of the Government sector, i.e. central (federal), regional
(state) and local (municipal) governments.
• Boundaries between units overlapping sectors, and notion of ‘control’ clarified.
– Government ≠ Public (e.g. public corporation is part of Business enterprise sector)
• Variety of functional distributions of GOVernment Expenditure on R&D (GOVERD) detailed
(e.g. socioeconomic objective, type of R&D).
• Identification of R&D vs. related S&T activities, policy-related studies, health care in ‘public’
hospitals, system development and demonstration, technology readiness-level (TRL)
classifications .
– When a prototype performance is assessed by actual operational usage, this assessment is
unlikely to represent R&D.
• Some measurement specifics for Government sector R&D costs are considered: treatment of
pension funds and other social security costs, VAT, cost of facilities.
• Non-government sources of funding discussed.
• Guidelines on treatment of individuals dedicated to administration and assessment of R&D
funding proposals (generally not included in R&D).
• Cautionary guidance provided on the role of “intermediary” agencies that pass R&D funds from
one agency to another.
• Recommendation to classify researchers by seniority grade.
• Funder-based approach discussed in some detail, but considered as a complementary approach
to performer-based.
Chapter 9: Higher Education R&D
• New chapter, but incorporates and expands annex material previously part of FM2002.
• Definition of the Higher Education sector slightly modified and includes
– all universities, colleges of technology and other institutions providing formal tertiary
education programmes, whatever their source of finance or legal status; and
– all research institutes, centres, experimental stations and clinics that have their R&D
activities under the direct control of, or administered by, tertiary education institutions.
• Variety of institutional and functional distributions of Higher education Expenditure on R&D
(HERD) and personnel detailed
• Inclusion of a guiding framework for compiling HERD statistics in the light of the diversity of
international institutional settings and of the range of statistical sources.
• Inclusion of a proposed classification by seniority grades.
• Inclusion of guidelines for time-use surveys to help estimate the R&D components of FTEs
and expenditures.
• New terminology and definitions for “foreign-owned branch campuses” (FBC) and “branch
campuses abroad” (BCA) to address measurement aspects related to globalisation of Higher
education.
Chapter 10: Private Non-Profit R&D
• New Chapter.
• Scope and definition of the sector kept identical to FM2002 (non-profit institutions
serving households (NPISH) + individuals)  residual sector in nature.
– Non-profit institutions ≠ Non-market institutions (there are market-producing NPIs)
• Tagging of NPIs belonging to other sectors, using for example statistical registers,
may allow presentation of total performance as per general non-profit accounts .
– NPIs controlled by Higher education institutions are part of Higher education sector
– NPIs serving business (e.g., trade associations) are part of Business enterprise sector
• Inclusion of guidelines on identification of R&D in the PNP sector (e.g., cautionary
guidance on the need to exclude programmatic evaluations and assessments).
• Variety of functional distributions of Private Non-Profit Expenditure on R&D
(PNPERD) detailed (e.g. source of funds, type of R&D).
• Clarification on the treatment of individuals/volunteers in this sector.
• Funder-based approach considered relevant for the PNP sector, but complementary
to the performer-based approach.
• Acknowledgement of new funding models, i.e. wealthy philanthropists and crowd-
funding.
Chapter 11: Measurement of R&D Globalisation
• New chapter: the manual now explicitly recognises the concept of R&D
globalisation. Consistent with the SNA, the term “Rest of the world” has (in
general) replaced the term “abroad”.
• Covers both business and non-business R&D globalisation.
• Business sector: three statistical measures are covered (i) cross border R&D
funding flows [consistent with traditional FM, but expanded ownership
details]; (ii) current costs and personnel for R&D performed by members of
multinational enterprises (MNEs) within compiling countries and abroad
[new]; and (iii) international trade in R&D services [new].
• Relevant MNE definitions are given and an illustrative example of MNE
member ownership relationships with corresponding terminology.
• New terms and definitions of foreign-owned branch campuses (FBC) and
branch campuses abroad (BCA) provided for the Higher education sector.
• Special case of international organisations considered
Chapter 12: Government Budget Allocations for R&D
• Acronym changed from GBAORD to GBARD. Revised chapter stresses
priority of ensuring timeliness for the collection of these data. It is
suggested that GBARD data be based on initial budget appropriations
voted on by the legislature.
• Includes a detailed description of the various types of R&D support (e.g.
payments for services, grants, loan guarantees, etc.) and their treatment.
• Notes (but does not recommend) the common practice of using
government surveys to compile GBARD (in particular to identify R&D
content and GUF).
• It is recommended to distribute GBARD by socio-economic objectives
updated to reflect Eurostat’s latest 2007 NABS classification.
• Distribution by (and recent work on) modes of funding (e.g. project
versus institution) acknowledged, but not recommended.
Chapter 13: Measurement of Government Tax
Relief for R&D
• New chapter providing guidelines on reporting government support for R&D through tax
incentives, with a view to assisting in the production of internationally comparable
indicators of Government Tax Relief for R&D expenditures (GTARD). New measurement
area subject to further developments.
• Basic definitions given for tax allowance, tax credit, tax exemption and tax expenditures
given in the glossary of terms.
• Detailed description of existing types of tax instruments.
• Guidelines on estimation methods and formulation of a common benchmark for
international reporting. Ideally, countries should record the following:
• [1] refundable credits provided to taxpayers or other types of units for R&D in the reference period (if applicable)
• [2] foregone tax revenues in the reference period, for R&D in the same period
• [3] credits earned but not used in the reference period, e.g. carried forward, valued on a nominal basis
• [4] credits earned in a previous period used in the reference period, also on a nominal basis.
• The two main indicators for GTARD can be defined on the basis of these components:
• GTARD on an earned or accruals basis = [1]+[2]+[3]
• GTARD on a use or cash basis = [1]+[2]+[4]
Two printed annexes and a series of online annexes
Printed:
• Annex 1. Brief history and origins of the manual
– Describes historical developments and changes introduced in the
different editions
• Annex 2. Glossary of terms
– New to this edition
– Printed version includes some 125 terms with definitions/explanations
– To be maintained and further developed online at http://oe.cd/frascati
Annexes
On-line Annexes
• Removed from FM2002 – retrievable in older editions
– R&D in the Higher education sector
– Treatment of R&D in the United Nations’ System of National Accounts
– Supplementary guidance on the classification of large R&D projects (in defense and
aerospace)
– Correspondence between R&D personnel in Frascati and ISCO-88 classes
– Online Annex on R&D in developing countries (issues covered in the 2015 manual)
– Fields of Science and Technology (included in the 2015 edition as Fields of R&D, in ch2)
• Retained FM2002 annexes - www.oecd.org/sti/inno/frascatiannexes.htm
– R&D related to health, information and communication technology (ICT) and biotechnology
– Methods of deriving regional R&D data
– R&D deflators and currency converters
– Practical methods of providing up-to-date estimates and R&D projections
• Preparations for new annexes in FM2015
– Expanded note on integrating SNA and FM R&D concepts, terms and needs
– Expanded material and sources for R&D globalisation measures
37
IMPLEMENTATION
• Already proved useful for training new generation of
S&T statisticians
• Success depends on effective implementation
– Recommendations implemented in surveys
– Information shared on a timely basis with national and
global user community
– Reduced burden on respondents and NSOs
– Effective discussions among practitioners and OECD on
how to interpret the new guidelines and achieve greater
international comparability
• Towards improved quality of and trust in R&D
statistics
• Work towards improving the use and interpretation of
the data, including micro-data
Realising value from this revision
• Frascati webpage fully revamped
• Links to all relevant Frascati resources
• …including Frascati Community space for R&D
survey practitioners
– http://oe.cd/frascati-community
– Revision collaborative space transformed into
implementation support space
– Key features
• Safe space for NESTI delegates and approved experts
• Q&As on FM methodology interpretation in substitution for
bilateral email
• Relevant documents, e.g. questionnaires, country news.
• Basis for future annex development
Webpage – http://oe.cd/frascati
Daejeon, launch 19 Oct Tokyo, 27 Oct 2015 NEXT?
Seoul, 23rd Oct
“Roadshow” seminars
Presentation of key aspects to Frascati users
• OECD now has to revise its approach to collect data
from countries international data collection
– Structure and content of data requested from countries
– Collection processes and IT systems
– OECD R&D data tables and publications (RDS and MSTI)
– Co-ordination with other international organisations
– Transitional arrangements
• Discussion of proposals and decision at NESTI –
March 2016
• Systems development phase
• Initial adoption intended by end 2016
Working towards implementation
Frascati Manual 2015 in OECD databases
Please visit our Web site: http://oe.cd/frascati
Thank you!

Weitere ähnliche Inhalte

Was ist angesagt?

The world trade organization (wto)
The world trade organization (wto)The world trade organization (wto)
The world trade organization (wto)
Tinaaz Wadia
 
Open Innovation: An Introduction and Overview (Chalmers)
Open Innovation: An Introduction and Overview (Chalmers)Open Innovation: An Introduction and Overview (Chalmers)
Open Innovation: An Introduction and Overview (Chalmers)
Marcel Bogers
 
Doing business in ffv- Colombia kick off
Doing business in ffv- Colombia kick offDoing business in ffv- Colombia kick off
Doing business in ffv- Colombia kick off
ProColombia
 

Was ist angesagt? (20)

Unido
UnidoUnido
Unido
 
The world trade organization (wto)
The world trade organization (wto)The world trade organization (wto)
The world trade organization (wto)
 
Open Innovation: An Introduction and Overview (Chalmers)
Open Innovation: An Introduction and Overview (Chalmers)Open Innovation: An Introduction and Overview (Chalmers)
Open Innovation: An Introduction and Overview (Chalmers)
 
world trade organization ppt
world trade organization pptworld trade organization ppt
world trade organization ppt
 
20210727-Technoprenuership-EntreprenuershipDev.ppsx
20210727-Technoprenuership-EntreprenuershipDev.ppsx20210727-Technoprenuership-EntreprenuershipDev.ppsx
20210727-Technoprenuership-EntreprenuershipDev.ppsx
 
Regional Economic Integration and International Business
Regional Economic Integration and  International BusinessRegional Economic Integration and  International Business
Regional Economic Integration and International Business
 
Regional Comprehensive Economic Partnership: Economic and Technical Cooperati...
Regional Comprehensive Economic Partnership: Economic and Technical Cooperati...Regional Comprehensive Economic Partnership: Economic and Technical Cooperati...
Regional Comprehensive Economic Partnership: Economic and Technical Cooperati...
 
2016 - 1. The concept of Innovation and Innovation Management. The type of in...
2016 - 1. The concept of Innovation and Innovation Management. The type of in...2016 - 1. The concept of Innovation and Innovation Management. The type of in...
2016 - 1. The concept of Innovation and Innovation Management. The type of in...
 
Most Popular Turkey B2B Websites
Most Popular Turkey B2B WebsitesMost Popular Turkey B2B Websites
Most Popular Turkey B2B Websites
 
International trade
International tradeInternational trade
International trade
 
World Trade Organization
World Trade OrganizationWorld Trade Organization
World Trade Organization
 
Macroeconomic Management in Pakistan
Macroeconomic Management in PakistanMacroeconomic Management in Pakistan
Macroeconomic Management in Pakistan
 
Miga
MigaMiga
Miga
 
Doing business in ffv- Colombia kick off
Doing business in ffv- Colombia kick offDoing business in ffv- Colombia kick off
Doing business in ffv- Colombia kick off
 
Innovation Systems
Innovation SystemsInnovation Systems
Innovation Systems
 
Technology Innovation
  Technology Innovation   Technology Innovation
Technology Innovation
 
Open Innovation Process and Open Closed Innovation
Open Innovation Process and Open Closed Innovation Open Innovation Process and Open Closed Innovation
Open Innovation Process and Open Closed Innovation
 
UNCTAD
UNCTADUNCTAD
UNCTAD
 
Y20151003 詹文男-物聯網的商機與挑戰
Y20151003 詹文男-物聯網的商機與挑戰Y20151003 詹文男-物聯網的商機與挑戰
Y20151003 詹文男-物聯網的商機與挑戰
 
Innovation ecosystem potential & performance in Africa (abstract)
Innovation ecosystem potential & performance in Africa (abstract)Innovation ecosystem potential & performance in Africa (abstract)
Innovation ecosystem potential & performance in Africa (abstract)
 

Ähnlich wie Frascati Manual 2015

01 gina asef presentation_seminar
01 gina asef presentation_seminar01 gina asef presentation_seminar
01 gina asef presentation_seminar
Grazyna Pulawska
 
Ia4 si caps concertation presentation
Ia4 si caps concertation presentationIa4 si caps concertation presentation
Ia4 si caps concertation presentation
CAPS2020
 
Towards Strategic Dissemination Management - SALDRU
Towards Strategic Dissemination Management - SALDRUTowards Strategic Dissemination Management - SALDRU
Towards Strategic Dissemination Management - SALDRU
Thomas King
 
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-projectFissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
gemmacafl
 

Ähnlich wie Frascati Manual 2015 (20)

Creating knowledge
Creating knowledgeCreating knowledge
Creating knowledge
 
Tag Piccolo: Improving (CRS) codelist management
Tag Piccolo:  Improving (CRS) codelist management Tag Piccolo:  Improving (CRS) codelist management
Tag Piccolo: Improving (CRS) codelist management
 
The Role of Universities in the context of Smart Specialisation -
The Role of Universities in the context of Smart Specialisation - The Role of Universities in the context of Smart Specialisation -
The Role of Universities in the context of Smart Specialisation -
 
01 gina asef presentation_seminar
01 gina asef presentation_seminar01 gina asef presentation_seminar
01 gina asef presentation_seminar
 
Ia4 si caps concertation presentation
Ia4 si caps concertation presentationIa4 si caps concertation presentation
Ia4 si caps concertation presentation
 
HE-PSF_webpage_presentation.pptx
HE-PSF_webpage_presentation.pptxHE-PSF_webpage_presentation.pptx
HE-PSF_webpage_presentation.pptx
 
WS 8 Living Lab Methodology Handbook
WS 8 Living Lab Methodology HandbookWS 8 Living Lab Methodology Handbook
WS 8 Living Lab Methodology Handbook
 
Digital data collection
Digital data collectionDigital data collection
Digital data collection
 
Horizon 2020 LEIT-Space 2016-participaton rules and lessons learned
Horizon 2020 LEIT-Space 2016-participaton rules and lessons learned Horizon 2020 LEIT-Space 2016-participaton rules and lessons learned
Horizon 2020 LEIT-Space 2016-participaton rules and lessons learned
 
Towards Strategic Dissemination Management - SALDRU
Towards Strategic Dissemination Management - SALDRUTowards Strategic Dissemination Management - SALDRU
Towards Strategic Dissemination Management - SALDRU
 
Akis 2 presentation final report
Akis 2 presentation final reportAkis 2 presentation final report
Akis 2 presentation final report
 
module 1 activity 4
module 1 activity 4module 1 activity 4
module 1 activity 4
 
CoworkMED
CoworkMEDCoworkMED
CoworkMED
 
STRATEGIC ANALYSIS OF FOUR SUSTAINABLE ACTIVITIES.
STRATEGIC ANALYSIS OF FOUR SUSTAINABLE ACTIVITIES.STRATEGIC ANALYSIS OF FOUR SUSTAINABLE ACTIVITIES.
STRATEGIC ANALYSIS OF FOUR SUSTAINABLE ACTIVITIES.
 
Communicating About Standards: Creating A Technical Infrastructure That Every...
Communicating About Standards: Creating A Technical Infrastructure That Every...Communicating About Standards: Creating A Technical Infrastructure That Every...
Communicating About Standards: Creating A Technical Infrastructure That Every...
 
Monitoring the process using the PEG M&E Tool
Monitoring the process using the PEG M&E ToolMonitoring the process using the PEG M&E Tool
Monitoring the process using the PEG M&E Tool
 
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-projectFissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
Fissac 2018-use-of-adapted-tis-analysis-in-the-fissac-project
 
Towards and OECD productivity network_Dirk Pilat_6-7 July 2015_Mexico
Towards and OECD productivity network_Dirk Pilat_6-7 July 2015_MexicoTowards and OECD productivity network_Dirk Pilat_6-7 July 2015_Mexico
Towards and OECD productivity network_Dirk Pilat_6-7 July 2015_Mexico
 
act4-b1
act4-b1act4-b1
act4-b1
 
12.2.9. #2 arp_je
12.2.9. #2 arp_je12.2.9. #2 arp_je
12.2.9. #2 arp_je
 

Mehr von innovationoecd

Global Forum on Digital Security for Prosperity December 2018 event photo book
Global Forum on Digital Security for Prosperity December 2018 event photo bookGlobal Forum on Digital Security for Prosperity December 2018 event photo book
Global Forum on Digital Security for Prosperity December 2018 event photo book
innovationoecd
 

Mehr von innovationoecd (20)

OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024
 
Presentation of the OECD Science, Technology and Innovation Outlook 2023
Presentation of the OECD Science, Technology and Innovation Outlook 2023Presentation of the OECD Science, Technology and Innovation Outlook 2023
Presentation of the OECD Science, Technology and Innovation Outlook 2023
 
OECD bibliometric indicators: Selected highlights, March 2023 edition
OECD bibliometric indicators: Selected highlights, March 2023 editionOECD bibliometric indicators: Selected highlights, March 2023 edition
OECD bibliometric indicators: Selected highlights, March 2023 edition
 
OECD-Vinnova workshop, 7-8 February 2022
OECD-Vinnova workshop, 7-8 February 2022OECD-Vinnova workshop, 7-8 February 2022
OECD-Vinnova workshop, 7-8 February 2022
 
OECD-Vinnova workshop, 7-8 February 2022
OECD-Vinnova workshop, 7-8 February 2022OECD-Vinnova workshop, 7-8 February 2022
OECD-Vinnova workshop, 7-8 February 2022
 
OECD-VINNOVA Workshop, 7-8 February 2022
OECD-VINNOVA Workshop, 7-8 February 2022OECD-VINNOVA Workshop, 7-8 February 2022
OECD-VINNOVA Workshop, 7-8 February 2022
 
Analysis of scientific publishing activity: Key findings, December 2021
Analysis of scientific publishing activity: Key findings, December 2021Analysis of scientific publishing activity: Key findings, December 2021
Analysis of scientific publishing activity: Key findings, December 2021
 
Recommandation du Conseil de l'OCDE sur l'amélioration de l'accès aux données...
Recommandation du Conseil de l'OCDE sur l'amélioration de l'accès aux données...Recommandation du Conseil de l'OCDE sur l'amélioration de l'accès aux données...
Recommandation du Conseil de l'OCDE sur l'amélioration de l'accès aux données...
 
OECD Council Recommendation on Enhancing Access to and Sharing of Data
OECD Council Recommendation on Enhancing Access to and Sharing of DataOECD Council Recommendation on Enhancing Access to and Sharing of Data
OECD Council Recommendation on Enhancing Access to and Sharing of Data
 
2020.01.12 OECD STI Outlook launch - Impacts of COVID-19: How STI systems res...
2020.01.12 OECD STI Outlook launch - Impacts of COVID-19: How STI systems res...2020.01.12 OECD STI Outlook launch - Impacts of COVID-19: How STI systems res...
2020.01.12 OECD STI Outlook launch - Impacts of COVID-19: How STI systems res...
 
OECD Digital Economy Outlook 2020: Key findings
OECD Digital Economy Outlook 2020: Key findingsOECD Digital Economy Outlook 2020: Key findings
OECD Digital Economy Outlook 2020: Key findings
 
Understanding the world of science and scientists
Understanding the world of science and scientistsUnderstanding the world of science and scientists
Understanding the world of science and scientists
 
Global Forum on Digital Security for Prosperity November 2019 event photo book
Global Forum on Digital Security for Prosperity November 2019 event photo bookGlobal Forum on Digital Security for Prosperity November 2019 event photo book
Global Forum on Digital Security for Prosperity November 2019 event photo book
 
Going Digital: Shaping Policies, Improving Lives
Going Digital: Shaping Policies, Improving LivesGoing Digital: Shaping Policies, Improving Lives
Going Digital: Shaping Policies, Improving Lives
 
Global Forum on Digital Security for Prosperity December 2018 event photo book
Global Forum on Digital Security for Prosperity December 2018 event photo bookGlobal Forum on Digital Security for Prosperity December 2018 event photo book
Global Forum on Digital Security for Prosperity December 2018 event photo book
 
OECD Digital Economy Outlook 2017: Setting the foundations for the digital tr...
OECD Digital Economy Outlook 2017: Setting the foundations for the digital tr...OECD Digital Economy Outlook 2017: Setting the foundations for the digital tr...
OECD Digital Economy Outlook 2017: Setting the foundations for the digital tr...
 
OECD Digital Economy Outlook 2017: Presentation at Global Parliamentary Netwo...
OECD Digital Economy Outlook 2017: Presentation at Global Parliamentary Netwo...OECD Digital Economy Outlook 2017: Presentation at Global Parliamentary Netwo...
OECD Digital Economy Outlook 2017: Presentation at Global Parliamentary Netwo...
 
Making the next production revolution inclusive open and secure
Making the next production revolution inclusive open and secureMaking the next production revolution inclusive open and secure
Making the next production revolution inclusive open and secure
 
Presentation for the OECD Telecommunication and Broadcasting Review of Mexico...
Presentation for the OECD Telecommunication and Broadcasting Review of Mexico...Presentation for the OECD Telecommunication and Broadcasting Review of Mexico...
Presentation for the OECD Telecommunication and Broadcasting Review of Mexico...
 
Groningen Growth and Development Centre (GGDC) 25th anniversary | 28-30 June ...
Groningen Growth and Development Centre (GGDC) 25th anniversary | 28-30 June ...Groningen Growth and Development Centre (GGDC) 25th anniversary | 28-30 June ...
Groningen Growth and Development Centre (GGDC) 25th anniversary | 28-30 June ...
 

Kürzlich hochgeladen

Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
raffaeleoman
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
Kayode Fayemi
 
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
amilabibi1
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
Kayode Fayemi
 

Kürzlich hochgeladen (18)

Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verifiedSector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
Sector 62, Noida Call girls :8448380779 Noida Escorts | 100% verified
 
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
 
ICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdfICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdf
 
Dreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video TreatmentDreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video Treatment
 
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
Aesthetic Colaba Mumbai Cst Call girls 📞 7738631006 Grant road Call Girls ❤️-...
 
Dreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio IIIDreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio III
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
 
My Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle BaileyMy Presentation "In Your Hands" by Halle Bailey
My Presentation "In Your Hands" by Halle Bailey
 
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdfAWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
 
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
Bring back lost lover in USA, Canada ,Uk ,Australia ,London Lost Love Spell C...
 
Report Writing Webinar Training
Report Writing Webinar TrainingReport Writing Webinar Training
Report Writing Webinar Training
 
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdfThe workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
 
lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
 
Causes of poverty in France presentation.pptx
Causes of poverty in France presentation.pptxCauses of poverty in France presentation.pptx
Causes of poverty in France presentation.pptx
 
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
 
Digital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of DrupalDigital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of Drupal
 
Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510Thirunelveli call girls Tamil escorts 7877702510
Thirunelveli call girls Tamil escorts 7877702510
 

Frascati Manual 2015

  • 1. FRASCATI MANUAL 2015 GUIDELINES FOR COLLECTING AND REPORTING DATA ON RESEARCH AND EXPERIMENTAL DEVELOPMENT Main features and outcomes of the 6th revision
  • 2. Part 1. Background to the Frascati Manual • The manual’s origins • The 6th revision Part 2. 2015 edition • Main features of the 2015 edition • Key elements chapter by chapter. Part 3. Implementation of the 2015 Frascati Manual Contents
  • 3. BACKGROUND TO THE FRASCATI MANUAL AND ITS 2015 EDITION
  • 4. • An OECD standard – Statistical purpose, developed by NESTI – Non binding rules – De facto global standard – Used by policy makers and others • 1st ed. in 1963 – context has changed, but monitoring resources for R&D has always mattered – Name comes from Italian town where guidelines were first approved in 1962 – Revised 5 times in the past – Last time in 2002 • First step in the international measurement of STI and its impacts – Focus on R&D inputs, integrated into broader measurement and analysis system What is the “Frascati Manual”?
  • 5. • Address user and producer needs – Clarify concepts, address new topics and changes in how R&D is performed and funded – Improve international comparability of R&D data. – Relevant and applicable in developing countries – Facilitate use of FM for R&D data used in National Accounts – Align to new and revised statistical classifications, systems, Frascati family of manuals – Improve comparability - address methodological challenges and disseminate best practices – Role of administrative data in addition to surveys – Take into account the use of R&D microdata and linking for analysis • An in-depth revision was required to meet these needs Why revised in 2015?
  • 6. Examples of Frascati in ‘use’ EU Community framework for state aid for research and development and innovation (2006/C 323/01) When classifying different activities, the Commission will refer to its own practice as well as the specific examples and explanations provided in the Frascati Manual on the Measurement of Scientific and technological Activities, Proposed Standard Practice for Surveys on Research and Experimental Development.
  • 7. Relevance: Meets data users’ needs Based on consensus among data producers: Adopted internationally and supports comparable statistics Feasible: based on measurement experience and tested approaches Revision process and contents aligned to meet three criteria:
  • 8. • A statistical manual, but aware of its broader use. • NESTI responsibility. • Drawing on other OECD committees input and stakeholder web-based open consultation. • Declassified by OECD Statistics Committee (CSSP) and OECD Committee for Scientific and Technological Policy • Avoid unwarranted potential disruption to policy uses and data series • Main focus on R&D resources – Clarify that FM measurement perspective not tied to the “linear model of innovation” – Evidence collected to feed into guidance on outputs and analysis of links between inputs and outputs Boundaries applying to the revision
  • 9. 90+ different individuals (and country leads) signed up to develop guidance on: • R&D definition – implementation guidance (ITA) • Outputs of R&D – (CAN, DEU) • Measures of government funding (CHE, secretariat) • R&D expenditures (NOR) • R&D personnel (RUS) • Institutional sector classifications (FRA) • Higher education (DEU, NOR) • R&D globalisation (USA, BEL) • R&D capitalisation (GBR) • Use of administrative data & survey methodologies (CAN) • R&D by industry (secretariat) External input secured through an open consultation in 2013 Phase 1. (March 2013-June 2014) Country-led revision groups
  • 10. • New, expanded chapter structure agreed by NESTI • NESTI Bureau tasked to deliver a draft based on discussions and decisions • Preparation and discussion of draft chapters. • Workshop with country experts, Lisbon, December 2014 • Draft manual presented to delegates, March 2015. Phase 2. Drafting the new manual (Jul 2014-March 2015)
  • 11. • April 2015. NESTI agrees the new manual on principle. • Written comments from NESTI delegates incorporated in draft. • Style editing • Draft submitted to and approved by CSTP and CSSP for declassification • Manual design and publishing • Launch at World S&T Forum and CSTP Ministerial meeting, Daejeon, Korea. 19 Oct 2015. Phase 3. April-October 2015. Approval and publication.
  • 12. OECD Working Party of National Experts on Science and Technology Indicators (NESTI) April 2014 NESTI group photo after the approval in principle of the Frascati Manual 2015
  • 13. • Some examples – Intensive use of online community space sharing material and commenting • (100+ users, 250+ documents) – Intensive use of videoconferencing for group discussion and webinars (up to 30 people at times) – Online-based stakeholder consultation (50+ submissions) – Use of online survey tool for delegate R&D vignette survey response gathering – Since September 2014, weekly Bureau meetings to assist in the editing – Two NESTI dedicated workshops (+90 participants) • Outcomes – A learning process for delegates, new countries. The revision process serves a pedagogical function within the NESTI community and within the OECD as a ‘learning organisation’ – Most inclusive revision process to date. – Considerable financial savings and value for money – Relevant experience for other groups and future guideline work by NESTI Some major changes in collaborative project working
  • 14. CONTENTS OF THE 2015 EDITION
  • 15.
  • 16. Frascati Manual 2015 Guidelines for Collecting and Reporting Data on Research and Experimental Development • The Frascati Manual provides guidelines and recommendations for compiling and reporting internationally comparable statistics on R&D expenditures and personnel. • It is a consensus document with no mandatory enforcement mechanisms that is revised on a regular basis to take into account new developments in the areas of statistics and of R&D (see next slide). • The title of 7th edition has been changed, reflecting expansion in focus.
  • 17. Chapter 1: Introduction to R&D Statistics and the Frascati Manual • Provides objectives, background and general overview of the manual ; of particular interest to non-statisticians, policy makers and various types of users. • Explains reasons for revisions to the Frascati Manual and expanded coverage: – The explicit adoption in the 2008 revision of the System of National Accounts of Frascati R&D definitions and data as the basis for treating R&D expenditures as capital formation (investment). – The need to better reconcile the widespread use of Frascati Manual for both statistical and policy-related purposes (e.g. coverage of R&D tax relief topics and difficulties of measuring R&D business expenses). – Use of the Frascati Manual by countries at different stages of economic development, with varying forms of economic structures and national research systems necessitated the introduction of individual sector-specific chapters to allow greater granularly in collection guidance. In particular, can better address some specific developing country related topics. – Because of ongoing changes to the organisation of R&D activities, there was the need to address new statistical challenges (such as measuring intramural versus extramural R&D performance, and R&D globalisation issues). – Desire to address new types of uses of R&D data (micro-data analyses), methodological challenges (related to burden and response rates) and opportunities (use of administrative records). – Need to reflect changes/revisions in statistical classification systems implemented since the last 2002 Frascati Manual update.
  • 18. Chapter 2. Concepts and definitions for identifying R&D Modified R&D definitions meant to remain consistent with previous definitions FM2002: • Research and experimental development (R&D) comprise creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications. FM2015 (see next slide): • Research and experimental development (R&D) comprise creative and systematic work undertaken in order to increase the stock of knowledge – including knowledge of humankind, culture and society – and to devise new applications of available knowledge.
  • 19. “Research and experimental development (R&D) comprise creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications.” “Research and experimental development (R&D) comprise creative and systematic work undertaken in order to increase the stock of knowledge, - including knowledge of humankind, culture and society - gender neutral, still remind users that Social sciences, Arts & Humanities are within scope less words, “systematic” on par with “creative” FM2002 FM2015 and to devise new applications of available knowledge.” The previous definition could imply that all knowledge used for experimental development (“D”) had been created by R&D (linear model?). The parsing also hinted that all uses of R&D knowledge for new applications were D. New definition asserts more explicitly that D also has to be creative and systematic work increasing knowledge.
  • 20. Modified R&D definitions meant to remain consistent with previous definitions Type of R&D FM2002 and FM2015 (unchanged): • Basic research is experimental or theoretical work undertaken primarily to acquire new knowledge of the underlying foundation of phenomena and observable facts, without any particular application or use in view. FM2002 and FM2015 (~unchanged): • Applied research is also original investigation undertaken in order to acquire new knowledge. It is, however, directed primarily towards a specific practical aim or objective. FM2002: • Experimental development is systematic work, drawing on existing knowledge gained from research and practical experience, that is directed to producing new materials, products or devices; to installing new processes, systems and services; or to improving substantially those already produced or installed. FM2015 (slight modification and next slide): • Experimental development is systematic work, drawing on knowledge gained from research and practical experience and generating additional knowledge, which is directed to producing new products or processes or to improving existing products or processes.
  • 21. Chapter 2: Concepts and Definitions for Identifying R&D • Identifies a set of explanatory criteria to help in implementation. All five criteria are to be met, at least in principle, every time an R&D activity is undertaken whether on a continuous or occasional basis, by a performer in any sector. – Novel (aimed at new findings) – Creative (based on original concepts; not obvious) – Uncertain (outcome, cost, time allocation not known a priori) – Systematic (planned and budgeted) – Transferable and/or reproducible (should be the potential to transfer results) • Explicit introduction of the concept of “R&D project” as an aid to resolve challenging boundary cases • Explicit inclusion of “the arts” as a Field of Research and Development (FORD), (previously field of “S&T” ) • Field-specific examples of basic, applied, and experimental development • More up to date list of examples of boundaries and exclusions from R&D – R&D and innovation activities — R&D and related scientific and technological activities – R&D and (versus) design — R&D versus artistic creation – R&D versus product development — R&D versus pre-production development – R&D and software development — R&D and service activities
  • 22. Chapter 3: Institutional Sectors and Classifications • The five institutional sectors (Business enterprise, Government, Higher education, Private non-profit and Rest of the world) are maintained and are consistent with those of the SNA with the exception of HE which does not have a direct counterpart in the SNA, but which is core to R&D performance. • “Abroad” has been renamed “Rest of the world” in accordance with the SNA. • Definition of HE slightly modified to only retain institutions that provide “formal tertiary education programmes” and “research institutes, centres, experimental stations and clinics that have their R&D activities under the direct control of, or administered by, tertiary education institutions.” • New figure introduced that gives a stylized representation of domestic Frascati institutional sectors and their borderlines. Main borderline cases discussed in a systematic way. More explicit recognition of organizational complexities. • Inclusion of text giving a list of general classifications applicable to all institutional units (regardless of sector), i.e. by main economic activity, by public or private status, by affiliation status to a broader group (domestic or foreign), into SNA’s Corporations, General government and Non-profit sectors, by field of R&D and by geography.
  • 23. Decision tree for sectoring institutional classification BE Business enterprise sector HE Higher education sector GOV Government sector PNP Private non-profit sector 1. NPIs primarily serving businesses (e.g. trade associations, etc.) are classified in the Business enterprise sector, following the SNA convention of classifying those into the SNA Corporations sector. 2. This sector can be further subdivided into public and private Business enterprises, depending on whether the institution is controlled by government or not. This is analogous to the SNA treatment of public and private corporations.
  • 24. Chapter 4: Measurement of R&D Expenditures • Gross domestic expenditure on R&D (GERD) includes current expenditures (including labour and other current costs) plus gross fixed capital expenditures (such as for land, buildings, machinery and equipment). • Inclusion of new concepts and terminology: internal/external sources of funds (originating within or outside of the control of the R&D-performing unit) and exchange/transfer funds (with or without a compensatory return of R&D). • Inclusion of a summary table on intramural expenditure categories and of a figure on funding flows from the perspective of an R&D performer. • New examples on identifying R&D sources for funds that flow through multiple units and across sectors. • Inclusion of a text on measurement of funds for extramural R&D and on sales and purchases of R&D. • Inclusion of a table identifying which sources of funds should be collected on R&D performer surveys. • Improved guidelines on the treatment of labor costs, in particular for external R&D personnel fully integrated into the intramural R&D of a reporting unit, to be in line with identified categories of R&D personnel in chapter 5. • Recommendation to collect depreciation costs, but not to include such costs in intramural R&D.
  • 25. Chapter 4: Measurement of R&D Expenditures • Inclusion of a comprehensive list of types of fixed assets used for R&D - i.e. land and buildings, machinery and equipment (in place of ‘instruments and equipment), capitalized computer software and other intellectual property products - and for which R&D expenditure data should be collected. • Differentiation of FM depreciation from SNA depreciation (capital consumption). • Clarified guidelines on the collection of software R&D that is part of current costs and part of capital expenditure. • Explanation on how software R&D is treated differently by FM (part of R&D) and by the SNA (part of software). • Inclusion of specific recommendations on the treatment of deductible taxes such as VAT. • New clarifications and examples for allowable reporting (e.g., related to administration costs; to treatment of MNE R&D cost allocations; and to operations & maintenance costs of rented research facilities). • Clarification on how to report public general university funds (GUF). • Recommendation to report R&D tax incentives separately from other government sources of R&D funds. (e.g., tax credits used for performing business R&D should be treated as internal funds, not public funds).
  • 26. Chapter 5: Measurement of R&D Personnel: Persons employed and External contributors FM2015 R&D personnel in a statistical unit include all persons engaged directly in R&D, whether they are employed by the statistical unit or are external contributors fully integrated into the statistical unit’s R&D activities, as well as those providing direct services for the R&D activities (such as R&D managers, administrators, technicians and clerical staff). • Coverage of R&D personnel now refers to total persons employed and deals explicitly with the treatment of non-employees and external personnel fully integrated into the intramural R&D of a reporting unit, e.g. categories such as self-employed, volunteers and students. • Two main groups of individuals who potentially contribute to the R&D activities can be identified: – Persons employed by the statistical unit who contribute to the unit’s intramural R&D activities (used interchangeably with the term “internal R&D personnel” in the manual). – External contributors to the unit's intramural R&D activities (used interchangeably with the term “external R&D personnel”). This group includes two subgroups: (i) persons who receive wages/salaries but not from the statistical unit performing the R&D, and (ii) a number of special cases of persons external to a statistical unit who contribute to intramural R&D.
  • 27. Chapter 5: Measurement of R&D Personnel • Classification of R&D personnel is now envisaged according to their ‘function’ (researchers, technicians, other supporting staff). • Definition of researchers has been changed: – Researchers are professionals engaged in the conception or creation of new knowledge., products, processes, methods and systems and also in the management of the projects concerned. They conduct research and improve or develop concepts, theories, models, techniques instrumentation, software or operational methods. • To be counted in R&D personnel totals, individuals should make appreciable contributions (at least 0.1 FTE) and any one individual cannot contribute more than 1.0 FTE. • Doctoral and master’s students may be included in either group of R&D personnel if they meet the specific criteria aimed at ensuring that only individuals with an appreciable contribution to the institution’s R&D are included. • Improved convergence with the treatment of related labour costs in chapter 4. • Definitions of FTEs (recommended counts for international comparisons) and of headcounts (recommended primarily to describe, in percentage terms, R&D personnel characteristics) are included. • Guidelines are given for identifying/estimating FTEs and HCs and for estimating FTEs according to a specific formula, if necessary. • Distributions of aggregate R&D personnel totals discussed (e.g., by sex, function, age, and formal qualification).
  • 28. Chapter 6: Methodologies and Procedures • This chapter provides general guidelines on methodology that are in principle common to all institutional sectors. Some considerations on each individual sector’s sampling units are nevertheless given in this chapter. • Guidelines on survey design (e.g., sampling plan, questionnaire design) are given and the use of administrative data is also considered. Preference for dedicated R&D surveys is still acknowledged. • The chapter covers issues with respect to data collection, integration of multiple data sets, editing of collected data and imputation, estimation and output validation. • The need to provide indicators of data quality for the published aggregates is explicitly acknowledged. • Compilers of R&D statistics are encouraged to collect data on expected expenditure data for the following year(s) (nowcasting).
  • 29. Chapter 7: Business Enterprise R&D • New chapter, but incorporates material previously part of FM2002 chapter on “Functional Distributions”. • Extensive guidance on defining units in the BE sector. • Interest and benefit of using identification codes for sampling and collecting data from statistical units. – Main economic activity (as indicated by ‘value added’ or substitute criteria) – public or private status and by affiliation status (parents or members of a domestic or foreign group; foreign controlled enterprise). – New size classifications recommended. (e.g. size cut-off at 10 or more employees) • Variety of functional distributions of Business enterprise Expenditure on R&D (BERD) detailed (e.g. source of funds, type of R&D) • Distribution by industry orientation vs. economic activity discussed and inclusion of a table describing the different approaches and criteria used. • Distribution by FORD, socioeconomic objective, and technology areas discussed (not specifically recommended). • Comprehensive section on survey design, frame creation, data collection, estimation and data quality relevant to the Business enterprise sector. • Case of “combined” R&D and innovation surveys accepted but not recommended. • Inclusion of cautionary guidance related to the use of financial accounting sources (e.g., R&D expense) and over- and under-reporting of R&D.
  • 30. Chapter 8: Government R&D • New chapter, with a focus on collecting data from Government performers. • Provides definitions of the components of the Government sector, i.e. central (federal), regional (state) and local (municipal) governments. • Boundaries between units overlapping sectors, and notion of ‘control’ clarified. – Government ≠ Public (e.g. public corporation is part of Business enterprise sector) • Variety of functional distributions of GOVernment Expenditure on R&D (GOVERD) detailed (e.g. socioeconomic objective, type of R&D). • Identification of R&D vs. related S&T activities, policy-related studies, health care in ‘public’ hospitals, system development and demonstration, technology readiness-level (TRL) classifications . – When a prototype performance is assessed by actual operational usage, this assessment is unlikely to represent R&D. • Some measurement specifics for Government sector R&D costs are considered: treatment of pension funds and other social security costs, VAT, cost of facilities. • Non-government sources of funding discussed. • Guidelines on treatment of individuals dedicated to administration and assessment of R&D funding proposals (generally not included in R&D). • Cautionary guidance provided on the role of “intermediary” agencies that pass R&D funds from one agency to another. • Recommendation to classify researchers by seniority grade. • Funder-based approach discussed in some detail, but considered as a complementary approach to performer-based.
  • 31. Chapter 9: Higher Education R&D • New chapter, but incorporates and expands annex material previously part of FM2002. • Definition of the Higher Education sector slightly modified and includes – all universities, colleges of technology and other institutions providing formal tertiary education programmes, whatever their source of finance or legal status; and – all research institutes, centres, experimental stations and clinics that have their R&D activities under the direct control of, or administered by, tertiary education institutions. • Variety of institutional and functional distributions of Higher education Expenditure on R&D (HERD) and personnel detailed • Inclusion of a guiding framework for compiling HERD statistics in the light of the diversity of international institutional settings and of the range of statistical sources. • Inclusion of a proposed classification by seniority grades. • Inclusion of guidelines for time-use surveys to help estimate the R&D components of FTEs and expenditures. • New terminology and definitions for “foreign-owned branch campuses” (FBC) and “branch campuses abroad” (BCA) to address measurement aspects related to globalisation of Higher education.
  • 32. Chapter 10: Private Non-Profit R&D • New Chapter. • Scope and definition of the sector kept identical to FM2002 (non-profit institutions serving households (NPISH) + individuals)  residual sector in nature. – Non-profit institutions ≠ Non-market institutions (there are market-producing NPIs) • Tagging of NPIs belonging to other sectors, using for example statistical registers, may allow presentation of total performance as per general non-profit accounts . – NPIs controlled by Higher education institutions are part of Higher education sector – NPIs serving business (e.g., trade associations) are part of Business enterprise sector • Inclusion of guidelines on identification of R&D in the PNP sector (e.g., cautionary guidance on the need to exclude programmatic evaluations and assessments). • Variety of functional distributions of Private Non-Profit Expenditure on R&D (PNPERD) detailed (e.g. source of funds, type of R&D). • Clarification on the treatment of individuals/volunteers in this sector. • Funder-based approach considered relevant for the PNP sector, but complementary to the performer-based approach. • Acknowledgement of new funding models, i.e. wealthy philanthropists and crowd- funding.
  • 33. Chapter 11: Measurement of R&D Globalisation • New chapter: the manual now explicitly recognises the concept of R&D globalisation. Consistent with the SNA, the term “Rest of the world” has (in general) replaced the term “abroad”. • Covers both business and non-business R&D globalisation. • Business sector: three statistical measures are covered (i) cross border R&D funding flows [consistent with traditional FM, but expanded ownership details]; (ii) current costs and personnel for R&D performed by members of multinational enterprises (MNEs) within compiling countries and abroad [new]; and (iii) international trade in R&D services [new]. • Relevant MNE definitions are given and an illustrative example of MNE member ownership relationships with corresponding terminology. • New terms and definitions of foreign-owned branch campuses (FBC) and branch campuses abroad (BCA) provided for the Higher education sector. • Special case of international organisations considered
  • 34. Chapter 12: Government Budget Allocations for R&D • Acronym changed from GBAORD to GBARD. Revised chapter stresses priority of ensuring timeliness for the collection of these data. It is suggested that GBARD data be based on initial budget appropriations voted on by the legislature. • Includes a detailed description of the various types of R&D support (e.g. payments for services, grants, loan guarantees, etc.) and their treatment. • Notes (but does not recommend) the common practice of using government surveys to compile GBARD (in particular to identify R&D content and GUF). • It is recommended to distribute GBARD by socio-economic objectives updated to reflect Eurostat’s latest 2007 NABS classification. • Distribution by (and recent work on) modes of funding (e.g. project versus institution) acknowledged, but not recommended.
  • 35. Chapter 13: Measurement of Government Tax Relief for R&D • New chapter providing guidelines on reporting government support for R&D through tax incentives, with a view to assisting in the production of internationally comparable indicators of Government Tax Relief for R&D expenditures (GTARD). New measurement area subject to further developments. • Basic definitions given for tax allowance, tax credit, tax exemption and tax expenditures given in the glossary of terms. • Detailed description of existing types of tax instruments. • Guidelines on estimation methods and formulation of a common benchmark for international reporting. Ideally, countries should record the following: • [1] refundable credits provided to taxpayers or other types of units for R&D in the reference period (if applicable) • [2] foregone tax revenues in the reference period, for R&D in the same period • [3] credits earned but not used in the reference period, e.g. carried forward, valued on a nominal basis • [4] credits earned in a previous period used in the reference period, also on a nominal basis. • The two main indicators for GTARD can be defined on the basis of these components: • GTARD on an earned or accruals basis = [1]+[2]+[3] • GTARD on a use or cash basis = [1]+[2]+[4]
  • 36. Two printed annexes and a series of online annexes Printed: • Annex 1. Brief history and origins of the manual – Describes historical developments and changes introduced in the different editions • Annex 2. Glossary of terms – New to this edition – Printed version includes some 125 terms with definitions/explanations – To be maintained and further developed online at http://oe.cd/frascati Annexes
  • 37. On-line Annexes • Removed from FM2002 – retrievable in older editions – R&D in the Higher education sector – Treatment of R&D in the United Nations’ System of National Accounts – Supplementary guidance on the classification of large R&D projects (in defense and aerospace) – Correspondence between R&D personnel in Frascati and ISCO-88 classes – Online Annex on R&D in developing countries (issues covered in the 2015 manual) – Fields of Science and Technology (included in the 2015 edition as Fields of R&D, in ch2) • Retained FM2002 annexes - www.oecd.org/sti/inno/frascatiannexes.htm – R&D related to health, information and communication technology (ICT) and biotechnology – Methods of deriving regional R&D data – R&D deflators and currency converters – Practical methods of providing up-to-date estimates and R&D projections • Preparations for new annexes in FM2015 – Expanded note on integrating SNA and FM R&D concepts, terms and needs – Expanded material and sources for R&D globalisation measures 37
  • 39. • Already proved useful for training new generation of S&T statisticians • Success depends on effective implementation – Recommendations implemented in surveys – Information shared on a timely basis with national and global user community – Reduced burden on respondents and NSOs – Effective discussions among practitioners and OECD on how to interpret the new guidelines and achieve greater international comparability • Towards improved quality of and trust in R&D statistics • Work towards improving the use and interpretation of the data, including micro-data Realising value from this revision
  • 40. • Frascati webpage fully revamped • Links to all relevant Frascati resources • …including Frascati Community space for R&D survey practitioners – http://oe.cd/frascati-community – Revision collaborative space transformed into implementation support space – Key features • Safe space for NESTI delegates and approved experts • Q&As on FM methodology interpretation in substitution for bilateral email • Relevant documents, e.g. questionnaires, country news. • Basis for future annex development Webpage – http://oe.cd/frascati
  • 41. Daejeon, launch 19 Oct Tokyo, 27 Oct 2015 NEXT? Seoul, 23rd Oct “Roadshow” seminars Presentation of key aspects to Frascati users
  • 42. • OECD now has to revise its approach to collect data from countries international data collection – Structure and content of data requested from countries – Collection processes and IT systems – OECD R&D data tables and publications (RDS and MSTI) – Co-ordination with other international organisations – Transitional arrangements • Discussion of proposals and decision at NESTI – March 2016 • Systems development phase • Initial adoption intended by end 2016 Working towards implementation Frascati Manual 2015 in OECD databases
  • 43. Please visit our Web site: http://oe.cd/frascati Thank you!

Hinweis der Redaktion

  1. 2002 Frascati Manual title: Proposed Standard Practice for Surveys on Research and Experimental Development
  2. FM2002 R&D personnel : All persons employed directly on R&D should be counted, as well as those providing direct services such as R&D managers, administrators, and clerical staff.