Research Program Assessment from Research and Social Impacts, presented at PICMET 2012

1. 12.8.1
Research
Program
Assessment
from
Research
and
Social
Impacts
Yuriko
Sawatani,
JST
Agenda
• Background
– RISTEX
Social
technology
R&D
– Reference
R&D
model
• Related
research
– product
&
service
innovaEon
– IBM
service
research
• Research
program
assessment
analysis
1

2. 12.8.1
Program
Program
assessment
Government strategy
Policy
Science and Technology Basic Plan
prior-, mid-term, end-year
Program
mid-term, end-year, follow-up (after 5years)
Project
R&D program
The 3rd Science and Technology Basic Plan
Science and Technology Basic Law
（enacted in 1995）
1st Basic Plan 2nd Basic Plan 3rd Basic Plan
(FY1996-2000) (FY2001-2005) (FY2006-2010)
# Review of the 1st and 2nd plans
# Increase in governmental # Three basic ideas (i) The 1st and 2nd S&T Basic Plans
(i) Creation of knowledge have solidified the foundation of
R&D expenditure (ii) Vitality from knowledge S&T in Japan.
The total budget for (iii) Sophisticated society by (ii) “Mega-competition for
governmental R&D knowledge knowledge” that Japan faces
expenditure exceeded 170 involves not only the United
billion dollars # Key policies States and Europe but also
# Construction of new R&D Strategic priority setting in S&T Asian nations such as South
- Promotion of basic research Korea and China.
system
- Prioritization of R&D on key
- Increase in competitive national/social agenda Our decision for the future:
research funds S&T system reforms stronger emphasis on the
- Support plan for 10,000 - Doubling of competitive role of “Knowledge”
postdoctoral fellows research funds
(including Ph.D students) - Enhancement of industry-
academia- #Main Challenges
- Promotion of industry-
government collaboration - How to form creative S&T
academia- government Total budget : 240 billion dollars human resources?
collaboration - Further reform of S&T related
- Implementation of systems, leading to higher
evaluation systems performance
4
2

3. 12.8.1
RISTEX
OrganizaEon
Director-General
Evaluation Committee
Advisory Council
Special Advisor to the Director
Redesigning
Community-­‐based
Protec8ng
Science
Informa8on
and
Implementa8on
Service
Science,
Solu8ons
Ac8ons
against
Technology
and
technology
Program
Communi8es
for
Global
Warming
Children
from
and
Founda8on
Aged
Society
and
Environmental
Crime
Humanity
R&D
Focus
Area
Integrated
Research
R&D
Focus
area
Degrada8on
R&D
Focus
Area
R&D
Focus
program
R&D
Focus
area
Area
Area Director
Area Director
Area Director
Area Director
Area Director
ＰＯ
ＰＯ
R&D
R&D
Program
R&D
Program
Program
R&D
Program
R&D
Program
Community-­‐based
Science
Governance
Redesigning
Ac8ons
against
Technology
in
Communi8es
Global
Warming
Protec8ng
and
Humanity
Ubiquitous
Launched
2010
for
Aged
Society
and
Environmental
aar
from
Children
Launched
2007
Society
Launched
2010
Launched
2008
Degrada8on
Crime
R&D Program
Challenge in
Launched
2010
Science and Identifying the
Launched
2009
Launched
2007
Technology Vulnerabilities
in Our Hidden
Literacy in the Sophisticated
21st
Information
プログラム
Science and
21世紀の
Exploring
Solutions
Director, Department of Planning and Management
Department of Management
Fellows
Planning and Promotion Group
Administration and Support Group
Investigation and coordination group
RISTEX’s
R&D
focus
Social
technology
R&D
Intensity of interaction with society (users)
High
Low
High
Natural science
Science
Technology
Technology
and
Maturity of Humanity
research area
Community-­‐based
AcEons
against
Global
Warming
ProtecEng
and
Environmental
Children
DegradaEon
Low
from
Crime
Service
Science,
SoluEons
and
FoundaEon
Integrated
Research
(S3FIRE)
3

4. 12.8.1
Ⅰ.
Iden'fying
Ⅱ.
Determining
R&D
focus
n
ture
areas
W
specific
ideas
for
(o cus
social
problems
Litera orks lua D
fo
,
search ws,
focus
areas
forum hops,
va
of
R& ector
s
l
e t ir
tervie ps
Collabora(on
of
social
and
natural
sciences,
(a en s
d
in
ho Ini blishm
and
it
works Par(cipa(on
of
government,
industry,
academia
and
ci(zens
Ageing
popula8on
a a
est are
Environment
Safety
and
security
risk
management
Industrial
NPO
Business
compe88veness
Ⅲ.
Promo'ng
R&D
Researcher
Re
Urban
vs.
rural
areas
qu
Human
capital
R&D
Focus
Areas
S&T
“seeds”
es
S&T
governance,
Labor
ts
ins8tu8onal
constraints
(from
basic
research)
Solicita(on
and
selec(on
of
project
&
proposals,
regular
mee(ngs,
on-­‐site
ne
visits,
expanding
networks…
ed
s
research
interviews
conference
R&D
projects
workshops
searches
SOCIET Constantly
Building
research
system
with
various
fora/
symposia
Y
COLLABORATING
S&T
stakeholders,
surveying
&
analyzing
the
condi(ons
on
the
ground,
hypothesis
forma(on
Requests
& PDCA
Proposing
soluEons
Contribu8on
to
the
cycle
ExperimentaEon
general
public/society
in
society
inform nd h
aEo
uElizin n
service/
g
a it
cin ng
w R&D
Focus
Areas
n
g
netw u Ev
rod n' ”
orks
eeds
NPO
Adop8on
f
f (mid alu
.
P me es ”
o a
Ⅳxperi o-­‐typ -­‐types ls;
dl
low-­‐uterm,
e (on
o -­‐ Global
warming
&
Requests
environmental
Business
Government
&
e ro t to ed
de uire
p
) x-­‐po
“p pround /
mo req
(i.e.
degrada8on
needs
“ st
Diffusion
o
s
” an
ing -­‐gr ries on es al
d
lop ally eo di( -­‐typ (on Public
safety
eve(fic s
/
th
con rotons(tu rs;
d
and
security
Implementa8on
of
research
•
D ien od ing
“p ty,
i d e
an ty,
sc eth min
the liari lea ce ie
re
an soc
output
to
society
m Exa ply ecu S&T
in
the
•
ap nal
p ts);
futu ceptg
by
humani8es
to gio rain ing
ac din ts
Solu8ons
and
re st r ng il en S&T’s
impact
on
IT
Ⅴ.
Assis'ng
the
applica'on
of
oRuetsearch
conNurtu o(us-­‐bruecipi Founda8on
rSesearch
othe ome •
rom ns e
c program
for
ervice
“proto-­‐types”
to
wider
areas
r
pros
fromP nse f
th
Science,
jects • co
o
Management
and
Redesigning
Communi8es
for
Aged
Society
ize
Implementa8on
Support
Program
s Engineering
program
Specific and Latent Needs of Society
Government & Public Policy Sustainability
Research & Development Management
Medical, Healthcare & Social welfare Services Transportation
Learning & Education Management
Service Science, Solutions and Foundation
Integrated Research Program
Research Type A. Research on Soution-Development
Research Type B.
Research on Scientific Element of Service Science
Fundamental Disciplines and Methodologies
Natural Sciences Social Sciences
Complexity simulation,Emergency Medicine, Management
Operations Research, Pharmaceutical Engineering, Human Cognitive Science,Social Psychology,
Sciences, Multiple Classification Analysis, Engineering, Quality Educational Psychology,Ethnography,
etc. Engineering,etc. Environmental Economics, etc.
4

5. 12.8.1
R
&
D
Model
for
Value
co-­‐creaEon
R&D
Value
co-­‐
creaEon
Site
Sphere
Sphere
Sphere
New
research
New
service
theme
system
creaEon
creaEon
Value
co-­‐
creaEon
R&D
acEviEes
Mutual
Site
knowledge
understanding
of
R&D
and
site
Management
System
9
Related
research:
Service
innovaEon
research
 Shid
to
Service
Economy
 transforming
social
structure
affects
to
research
and
development
(R&D)
organizaEon
 Macro
level
surveys
on
service
innovaEon
do
not
capture
R&D
reality
(Miles
2007)
Service
marke8ng
&
R&D
management
management
(1980-­‐)
Focused
Product
based
industry
Service
industry
industry
New
Product
New
Service
Development
Research
Development
(NPD)
(NSD)
InnovaEon
Service
professional
Technology
trajectory
source
trajectory
Product
and
process
Process
and
knowledge/
Outcomes
innovaEon
organizaEonal
innovaEon
10
5

6. 12.8.1
Customer
Focused
Product
InnovaEon
Research
• R&D
and
markeEng
collaboraEon
– Effect
to
funcEon
expansion
of
product,
reducEon
of
product
development
period
Company
R&D
MarkeEng
Customer
Product
InnovaEon
• User
innovaEon
research
(von
Hippel
1994)
– InformaEon
sEckiness
based
Company
Products・toolkits
R&D
Customer
User
InnovaEon
11
Service
InnovaEon
Process
Research
 Service
innovaEon
process
by
companies
and
customers
collaboraEon
 FaciliEes,
TransformaEon,
Usage
(Moeller
2008)
12
6

7. 12.8.1
Service
Research
Model
for
Value
co-­‐creaEon
IBM
Service
research
case
R&D
Value
co-­‐
creaEon
Site
Sphere
Sphere
Sphere
New
research
New
service
theme
system
creaEon
creaEon
Value
co-­‐
creaEon
R&D
acEviEes
Mutual
Site
knowledge
understanding
of
R&D
and
site
Management
System
13
Examples
of
Service
Science
Research
Themes
Site
knowledge
Business
strategy
SCM
Business
modeling
Research
management
Business
evaluaEon
methods
CRM
Service
value
evaluaEon
methods
Quality
analysis
Service
system
modeling
Environment/traffic
simulaEon
Service
provider
support
Risk
analysis
Service
quality
Social
modeling
Problem
determinaEon
OpEmizaEon
Brand
analysis
Behavior
analysis
CSAT
analysis
Psychology
Voice
Network
analysis
Text
mining
Sodware
enquiring
SimulaEon
Natural
language
processing
System
sodware
R&D
outputs
Data
science
InformaEon
technology
MathemaEcal
science
New
research
theme
7

8. 12.8.1
IBM
Service
research
Findings
1.
the
outputs
were
not
only
new
technologies,
but
also
integraEon
and
design
methods
– embed
technologies
into
service
systems
uElizing
site
knowledge
received
from
the
customers
2.
the
R&D
collaboraEon
with
service
receivers
changes
behaviors
of
researchers
– create
new
research
themes
by
enlarging
the
research
scope
to
create
a
new
service
system
supported
by
management
system
a
new
type
of
service-­‐oriented
researchers
have
emerged
ObjecEves
of
research
program
analysis
• How
program
design
relates
to
the
research
program
assessment?
– research
program
goals
and
research
program
assessment
• What
kinds
of
values
can
be
provided
by
management
system,
which
is
unique
funcEon
of
social
technology
R&D
– working
in
progress
S3FIRE
management
system
– What
will
be
the
assessment
of
S3FIRE?
(12/2012)
8

9. 12.8.1
RISTEX
OrganizaEon
Director-General
Evaluation Committee
Advisory Council
Special Advisor to the Director
Redesigning
Community-­‐based
Protec8ng
Science
Informa8on
and
Implementa8on
Service
Science,
Solu8ons
Ac8ons
against
Technology
and
technology
Program
Communi8es
for
Global
Warming
Children
from
and
Founda8on
Aged
Society
and
Environmental
Crime
Humanity
R&D
Focus
Area
Integrated
Research
R&D
Focus
area
Degrada8on
R&D
Focus
Area
R&D
Focus
program
R&D
Focus
area
Area
Area Director
Area Director
Area Director
Area Director
Area Director
ＰＯ
ＰＯ
R&D
R&D
Program
R&D
Program
Program
R&D
Program
R&D
Program
Community-­‐based
Science
Governance
Redesigning
Ac8ons
against
Technology
in
Communi8es
Global
Warming
Protec8ng
and
Humanity
Ubiquitous
Launched
2010
for
Aged
Society
and
Environmental
aar
from
Children
Launched
2007
Society
Launched
2010
Launched
2008
Degrada8on
Crime
R&D Program
Challenge in
Launched
2010
Science and Identifying the
Launched
2009
Launched
2007
Technology Vulnerabilities
in Our Hidden
Literacy in the Sophisticated
21st
Information
プログラム
Science and
21世紀の
Exploring
Solutions
Director, Department of Planning and Management
Department of Management
Fellows
Planning and Promotion Group
Administration and Support Group
Investigation and coordination group
Logic
model
Research
program
inputs,
acEviEes,
outputs
and
outcomes
Input
AcEviEes
Outputs
Outcomes
Resources
• Community
• Establishment
• Management
creaEon
and
growth
of
system
(project
• Research
community
and
• Research
area
selecEon,
system
• Research
research
system
creaEon
monitoring,
creaEon
for
area
• Research
• Research
impacts
management,
the
research
(maturity)
impacts
• Social
impacts
promoEon)
area
• Research
• Community
fund
creaEon
among
• Manageme
R&D,
site
people
• Projects:
nt
staffs
• ConEnuous
and
the
other
• Projects
Research
pracEcal
use
at
stakeholders
execuEon
(plan,
impacts
a
site
do,
see/report)
• Projects:
• Social
impacts
Social
impacts
Social
impacts
EvaluaEon
• Research
area
(Goals,
social
• Process
(management
system,
• Impacts
(research
and
social
impacts,
linkage,
management
staffs)
projects)
research
system,
community)
9

10. 12.8.1
Research
Program
Goals
Management
System
Process
R&D
Value
co-­‐
creaEon
Site
Sphere
Sphere
Sphere
Research
impact
New
research
New
service
• Research
plan
theme
system
(total,
yearly)
creaEon
• Research
report
creaEon
(total,
yearly)
• Review
meeEng
Value
co-­‐
creaEon
R&D
Mutual
Site
knowledge
acEviEes
understanding
of
R&D
and
site
Project
progress
monitoring
Value
co-­‐creaEon
management
• Dashboard
• Research
plan
(total,
yearly)
• IP,
InformaEon,
Fund
operaEon
• Site
visits
(a
few
Emes
/
year)
10

11. 12.8.1
Mid-­‐term
Program
Assessment
Summary
Weak
OK
Research
Program
Goals
11

12. 12.8.1
Mid-­‐term
Program
Assessment
Summary
Weak
OK
S3FIRE 3 Layer Management System
• Management
system
helps
– Structuring
knowledge
–
strategic
research
themes
– Transforming
Social
system
Macro
Social
System
Law, Policy, Social system
 Finding social issues Meso
Metho
 Identify R&D area
Model
モデル
dology
Model, Methodology
Micro
PJ
PJ
PJ
PJ
PJ
R&D project
24
12

13. 12.8.1
Project
porlolio
Research
themes/approach
x
Issues
in
Industry
Industry area
Energy
Food/ Retail/ Educati Cross
Transpor Wat / Financ Healthc
Produc IT
City
Hospita on/ Public
industr
t/ SCM
er
Environ e
are
ts
lity
Work
y
ment
Value latency Service
service
value co-
Basic
theory
creation
Altruistic model
mechanism
Creative
Methods service
/ Large Service Systems Typical Services
Technol Value co-
Service design creation and
ogy
methods & tools
support
Technology methods
Agriculture Service Communication
Technol
water oriented innovation by voice
ogy
system
crowds
A Type
B Type
25
S3FIER
Management
System
S3FIRE
direction
from PO
PO
Project
feedback
advice AD
review request
feedback
based on
specialty
External
review
• direction from project
• professional feedbacks based management viewpoints
on each specialty • professional feedbacks based on
each specialty
13

14. 12.8.1
Research
themes
in
S3FIRE
• Anthropology
Function Value co-creation
Service value
• Behavior
realization
• consensus building • Value eng
science
• robotics • Interaction design
• Knowledge eng
• Game theory
• Requirement eng • Macro/Micro economics
Provider activities
Receiver activities
• Design Contents
• Marketing
• System eng
• Behavior science
• OR/IE
• Kansei eng
• Quality
• Human modeling
management
Service • Human management
• Cost management Provider
Channel
Service Receiver
Service provider
Organization Service Social system
environment
science
visualization
modeling
• Human resource • Management • SW eng • Policy
• Education science • Informatics • Society
• Building • System eng • Robotics
• Culture
• IT infrastructure • Social science
RelaEonship
with
the
current
disciplines
System
layer
X
Context
dependency
Context dependency
high (ecological)
Receiver activities
Social study
Kansei eng Law
Organization science Sustainability
Human
Service marketing
eng Human network Human management
Human modeling Consensus building
Business
Psycholog Behavior science
management Service value
y
Micro view Service eng Value co-creation Macro view
PSS Business System layer
process
Social system modeling
OR/IE management
Quality management Service value
Complex system
Provider
Design environment
Economics
Function realization
Provider activities
Robotics Visualization
Japan
Science
and
Technology/
28
12.8.1
RISTEX
low (structural)
14

15. 12.8.1
Findings
from
RISTEX
programs
• The
research
maturity,
such
as
exisEng
academic
socieEes,
affects
research
project
selecEon
as
well
as
porlolio
management.
• When
the
research
maturity
is
low,
then
a
research
program
tends
to
focus
on
social
issues.
As
the
result,
the
research
project
porlolio
is
managed
from
problem-­‐solving
viewpoints.
• Even
though
the
research
maturity
is
low,
acEviEes
to
link
research
projects
led
by
the
management
system
has
a
good
potenEal
to
influence
posiEvely
to
create
strategic
research
themes
from
the
bonom-­‐up
research
projects.
30
Society for Serviceology (SfS)
The Society for Serviceology aims at providing
collaborative opportunity among the experts in business and
research on services.
Copyright© All Reserved. arai-tamio@robot.t.u-tokyo.ac.jp, 2011-2012, arai-t@shibaura-it.ac.jp 2012
 SfS must be an international society but it first starts in
Japan.
 SfS must be constructed not only for research but for
business.
 The journal accepts “design paper” and “case study paper”
 Academic society: conferences and workshops
 Business on services: education, qualification, standardization
15

16. 12.8.1
The 1st International Conference on 31
Serviceology
ICServ 2013
October 16-18, 2013
AIST Waterfront, Tokyo, Japan
Copyright© All Reserved. arai-tamio@robot.t.u-tokyo.ac.jp, 2011-2012, arai-t@shibaura-it.ac.jp 2012
 Committee  Topics
 General Chair: Dr. M. Mochimaru  Economic aspects of services
 General Co-Chair: Dr. T. Murakami Human modeling for services
 Program Chair: Dr. K. Ueda  Innovation & value co-creation
 Learning and education for
services
 Process management of services
 Product Service System (PSS)
 Productivity management
 Service engineering
 Service design support
 Service management
 Service marketing
 Psychological aspects of services
Thank
you!
16