1.
Facts
20.000 Students
60 Mio. Euro Budget
15 Study places
CELSTEC
- 100 FTE
- 7 Mio. budget (R.Koper)
- 2 R&D Programs:
a.) Technology-Enhanced
Learning (M.Specht)
b.) Learning Science
(P. Kirschner)
Hendrik Drachsler 4 December 2012 1

2.
Involvement in European Projects
Technology Enhanced Learning (TEL)
Cooperation
Learning Environments Learner Support
TEL
Inquiry
Content
Creativity
3
Hendrik Drachsler 4 December 2012 2

3.
Involvement in European Projects
Different professions
SALOMO
Health Logistics
Water management
Teacher education
4
Hendrik Drachsler 4 December 2012 3

4.
Dr. Hendrik Drachsler (WP2 Leader):
Research Interests in social media, mobile technologies, TEL,
semantic web and recommender systems (www.drachsler.de).
Mail: hendrik.drachsler@ou.nl
Phone: 0031-(0)45-576-2218
Skype: celstec-hendrik.drachsler
Dr. Slavi Stoyanov:
Research Interests in developing educational materials in
cooperation with domain experts and performance support
systems. Expert in applied research methods esp. Group
Concept Mapping.
Mail: slavi.stoyanov@ou.nl
Phone: 0031-(0)45-576-2893
Hendrik Drachsler 4 December 2012 4

5.
Dr. Hendrik Drachsler (Project Manager):
Research Interests in social media, mobile technologies, TEL,
semantic web and recommender systems (www.drachsler.de).
Mail: hendrik.drachsler@ou.nl
Phone: 0031-(0)45-576-2218
Skype: celstec-hendrik.drachsler
Dr. Slavi Stoyanov:
Research Interests in developing educational materials in
cooperation with domain experts and performance support
systems. Expert in applied research methods esp. Group
Concept Mapping.
Mail: slavi.stoyanov@ou.nl
Phone: 0031-(0)45-576-2893
Hendrik Drachsler 4 December 2012 5

6.
LinkedUp
Vision
Adopting open Web data, educational and cross-domain resources to
provide educational services up to university degree-level in open and
distance education.
1) A domain-specific 2) A generic set of criteria
(educational) set of for the evaluation of open
criteria Web data applications.
“There is a substantial risk that the evaluation criteria are not
adequately specified."
At what point are the criteria adequately specified?
When the stakeholders agree on the criteria.
Hendrik Drachsler 15/05/12 6

7.
Development
of
the
Evalua7on
Framework
P1: Initialisation P2: Establishment P3: Exit and
and Evaluation Sustainability
M0-M6: Preparation M7-M18: Competition cycle M18-M24: Finalising
Comp
etition
Revie Final
Expert
3x
Draft w of
EF proposal EF release
validation of EF
New Refin
versio ement
n of EF
Literature review Group Concept Documentation
Cognitive Mapping Mapping Dissemination
Practical experiences
and refinement
Hendrik Drachsler 25/05/12 7

8.
LinkedUp
Stefan Dietze
Hendrik Drachsler 15/05/12 8

9.
Cogni7ve
Mapping
1. Literature review of suitable evaluation approaches and criteria
2. Review of comprising initiatives such as LinkedEducation, MULCE, E3FPLE and
the SIG dataTEL
Stefan Dietze
Hendrik Drachsler 25/05/12 9

10.
Group
Concept
Mapping
• Group Concept Mapping resembles the
Post-it notes problem solving technique
and Delphi method
• GCM involves participants in a few
simple activities (generating, sorting
and rating of ideas) that most people are
used to.
GCM is different in two substantial ways:
1. Robust analysis (MDS and HCA)
GCM takes up the original participants contribution and then quantitatively
aggregate it to show their collective view (as thematic clusters)
2. Visualisation
GCM presents the results from the analysis as conceptual maps and other graphical
representations (pattern matching and go-zones).
Stefan Dietze
Hendrik Drachsler 25/05/12 10

11.
Development
of
the
Evalua7on
Framework
Stefan Dietze
Hendrik Drachsler 15/05/12 11

12.
WP2
Planning
-­‐
M6
Stefan Dietze
Hendrik Drachsler 25/05/12 12

13.
S3: Eval. framework & criteria
• 05-minute Introduction (Hendrik)
• 20-minute Presentations on experiences, best practices
(Philippe Cudré-Mauroux)
(Nikolaus Forgo)
• 10-minute Plenary Discussion on lessons learned for LinkedUp (All)
• 15-minute Presentation on Group Concept Mapping (Hendrik)
• 15-minute Presentation of the initial version of the evaluation framework +
examples for educational and usability evaluation criteria and suitable methods
(Hendrik)
• 25-minute Plenary discussion on suitable evaluation criteria, methods, and
experts that should be involved in the development of the evaluation framework
Stefan Dietze
Hendrik Drachsler 25/05/12 13

14.
Group
Concept
Mapping
Example: EU FP7
Handover
• 105 criteria about accurate handover training
interventions
• Sorting on similarity in meaning
• Rating on importance and feasibility
Stefan Dietze
Hendrik Drachsler 25/05/12 14

15.
Group
Concept
Mapping
A point map
Stefan Dietze
Hendrik Drachsler 25/05/12 15

16.
Group
Concept
Mapping
A cluster map
Stefan Dietze
Hendrik Drachsler 25/05/12 16

17.
Group
Concept
Mapping
Clusters’ labels
A
Stefan Dietze
Hendrik Drachsler 25/05/12 17

18.
Group
Concept
Mapping
Rating Map importance
Stefan Dietze
Hendrik Drachsler 25/05/12 18

19.
Group
Concept
Mapping
Rating Map feasibility
Stefan Dietze
Hendrik Drachsler 25/05/12 19

20.
Group
Concept
Mapping
Stefan Dietze
Hendrik Drachsler 25/05/12 20

21.
Practical experiences and refinement
Compe
titions
Review
Draft
3x
of EF
Refine
New
version
ment
of EF
Stefan Dietze
Hendrik Drachsler 25/05/12 21

22.
Thank you!
Stefan Dietze 25/05/12 22