SlideShare ist ein Scribd-Unternehmen logo
1 von 25
What stakeholders really think of eLearning. Quality through self-evaluation. Deborah Arnold, Vidéoscop-Université Nancy 2, France This project has been funded with support from the European Commission. This communication reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
[object Object]
How to design sound-self-evaluation questionnaires
Interpreting results
SEVAQ+ user testing and survey
Scenarios for implementing SEVAQ+What are wegoing to cover?
Whatis SEVAQ+? ,[object Object]
A Lifelong Learning Programme KA4 Project (2009-2010) “Dissemination and exploitation of results”
Support for improving the quality and attractiveness of Vocational Education and Training (VET)
Support for the HE modernisation agenda: governance, curricular reform,[object Object]
Analyse results with easy-to-interpret data.
Improve the quality of our courses.
Teachers and trainers can gather feedback on what learners really think of their learning experience.
Training managers can get the full picture by comparing responses from the different stakeholders involved.
Organisations can use the results of SEVAQ+ to benchmark against others.
Learners too have a voice in the process.,[object Object]
2nd conceptual model: the EFQM model   © EFQM European Foundation for Quality Management A management model for total quality (all processes, all actors) Each domain acts in interaction with all the others
The main stakeholder in SEVAQ v1.0: the learner  Partially EFQM and partially Kirkpatrick  learner 3 domains of the evaluation:  The resourcesused by the learner during his      learning experience  The  processes (activities) proposed to the learner     during the delivery of the course  ,[object Object],     in the workplace
A wider scope of processes: the learning processes +   all the design processes of the provider  A wider target of users: the learner + the other stakeholders interested in the delivery of the offer   Two distinctive contexts: e-learning in VET (as before)  + e-learning in HE SEVAQ+: extending the approach  Object E-learning design  Learning process Teacher/ trainer User Manager TGs VET HE Context
The extension of SEVAQ+ Managers  Trainers Providers  Learners + stakeholders+ contexts (HE and VET)  + EFQM domains+Kirkpatrick levels
Sub-criterion a Sub-criterion b Statements Sub-criterionc Sub-criteriond Sub-criterione 208 statements723 statements  38 sub-criteria99 Sub-criteria Resources Criterion  1 Criterion  2 Activities  Criterion 3 Criterion 4 Results SEVAQ 1SEVAQ +  17 Criteria22 Criteria  The structure of the SEVAQ+  questionnaires
EFQM & Kirkpatrick applied EFQM Kirkpatrick 1 & 2 EFQM Kirkpatrick 3
Testing SEVAQ+: Step 1 - getting started SEVAQ+ demos: http://www.sevaq-plus.preau.ccip.fr/demo/demo_1/sevaqplus_demo.html
Step 2: design and implement questionnaires Demo 1 Demo 2a Demo 2b Demo 3 Demo 4
Interpreting results: Histograms Question 247 : You knew every week (or day) what you were expected to do.

Weitere ähnliche Inhalte

Was ist angesagt?

CHAMP Advisory Committee Meeting Feb 24 2014
CHAMP Advisory Committee Meeting Feb 24 2014CHAMP Advisory Committee Meeting Feb 24 2014
CHAMP Advisory Committee Meeting Feb 24 2014cccscoetc
 
Course Outcome and Program Outcome Calculation(new method)
Course Outcome and Program Outcome Calculation(new method)Course Outcome and Program Outcome Calculation(new method)
Course Outcome and Program Outcome Calculation(new method)Ravikumar Tiwari
 
Quality assurance in e learning
Quality assurance in e learningQuality assurance in e learning
Quality assurance in e learningSoumendra Mishra
 
CHAMP Instructional Design presentation advisory meeting june 23 2014
CHAMP Instructional Design presentation advisory meeting june 23 2014CHAMP Instructional Design presentation advisory meeting june 23 2014
CHAMP Instructional Design presentation advisory meeting june 23 2014cccschamp
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelJon Rosewell
 
Developmental Education Redesign CCCS March 2013
Developmental Education Redesign CCCS March 2013Developmental Education Redesign CCCS March 2013
Developmental Education Redesign CCCS March 2013cccscoetc
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelEADTU
 
Detf recommendations metro
Detf recommendations metroDetf recommendations metro
Detf recommendations metrocccscoetc
 
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...Charles Darwin University
 
Developmental Education Taskforce Update for December 2012
Developmental Education Taskforce Update for December 2012Developmental Education Taskforce Update for December 2012
Developmental Education Taskforce Update for December 2012cccscoetc
 
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...BlackboardEMEA
 
Analysis and Development of Curriculum to Build the Foundation for eLearning ...
Analysis and Development of Curriculum to Build the Foundation for eLearning ...Analysis and Development of Curriculum to Build the Foundation for eLearning ...
Analysis and Development of Curriculum to Build the Foundation for eLearning ...Gihan Wikramanayake
 
CDHE Task Force 9 28 12
CDHE Task Force 9 28 12CDHE Task Force 9 28 12
CDHE Task Force 9 28 12cccscoetc
 
[EADTU-ENQA PLA] Anaylisis of questionnaires
[EADTU-ENQA PLA] Anaylisis of questionnaires[EADTU-ENQA PLA] Anaylisis of questionnaires
[EADTU-ENQA PLA] Anaylisis of questionnairesEADTU
 
REVIVE pedagogical approach
REVIVE pedagogical approachREVIVE pedagogical approach
REVIVE pedagogical approachJoanna Wild
 
Preparing for ABET EAC Evaluation Visit r032916
Preparing for ABET EAC Evaluation Visit r032916Preparing for ABET EAC Evaluation Visit r032916
Preparing for ABET EAC Evaluation Visit r032916Susan Schall
 
MOOCs and Quality Issues
MOOCs and Quality IssuesMOOCs and Quality Issues
MOOCs and Quality IssuesJon Rosewell
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Jon Rosewell
 
Mesquite High School S Ta R Results
Mesquite High School S Ta R ResultsMesquite High School S Ta R Results
Mesquite High School S Ta R Resultskarenblair
 

Was ist angesagt? (20)

CHAMP Advisory Committee Meeting Feb 24 2014
CHAMP Advisory Committee Meeting Feb 24 2014CHAMP Advisory Committee Meeting Feb 24 2014
CHAMP Advisory Committee Meeting Feb 24 2014
 
Course Outcome and Program Outcome Calculation(new method)
Course Outcome and Program Outcome Calculation(new method)Course Outcome and Program Outcome Calculation(new method)
Course Outcome and Program Outcome Calculation(new method)
 
Quality assurance in e learning
Quality assurance in e learningQuality assurance in e learning
Quality assurance in e learning
 
CHAMP Instructional Design presentation advisory meeting june 23 2014
CHAMP Instructional Design presentation advisory meeting june 23 2014CHAMP Instructional Design presentation advisory meeting june 23 2014
CHAMP Instructional Design presentation advisory meeting june 23 2014
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality label
 
Developmental Education Redesign CCCS March 2013
Developmental Education Redesign CCCS March 2013Developmental Education Redesign CCCS March 2013
Developmental Education Redesign CCCS March 2013
 
Quality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality labelQuality assurance of MOOCs: The OpenupEd quality label
Quality assurance of MOOCs: The OpenupEd quality label
 
Detf recommendations metro
Detf recommendations metroDetf recommendations metro
Detf recommendations metro
 
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...Governing Quality Of Online Content Through Threshold Standards: Facilitating...
Governing Quality Of Online Content Through Threshold Standards: Facilitating...
 
Developmental Education Taskforce Update for December 2012
Developmental Education Taskforce Update for December 2012Developmental Education Taskforce Update for December 2012
Developmental Education Taskforce Update for December 2012
 
Colomatyc
ColomatycColomatyc
Colomatyc
 
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...
TLC2016 - Peer Review, Peer Assessment, and Peer Feedback methods based on Bl...
 
Analysis and Development of Curriculum to Build the Foundation for eLearning ...
Analysis and Development of Curriculum to Build the Foundation for eLearning ...Analysis and Development of Curriculum to Build the Foundation for eLearning ...
Analysis and Development of Curriculum to Build the Foundation for eLearning ...
 
CDHE Task Force 9 28 12
CDHE Task Force 9 28 12CDHE Task Force 9 28 12
CDHE Task Force 9 28 12
 
[EADTU-ENQA PLA] Anaylisis of questionnaires
[EADTU-ENQA PLA] Anaylisis of questionnaires[EADTU-ENQA PLA] Anaylisis of questionnaires
[EADTU-ENQA PLA] Anaylisis of questionnaires
 
REVIVE pedagogical approach
REVIVE pedagogical approachREVIVE pedagogical approach
REVIVE pedagogical approach
 
Preparing for ABET EAC Evaluation Visit r032916
Preparing for ABET EAC Evaluation Visit r032916Preparing for ABET EAC Evaluation Visit r032916
Preparing for ABET EAC Evaluation Visit r032916
 
MOOCs and Quality Issues
MOOCs and Quality IssuesMOOCs and Quality Issues
MOOCs and Quality Issues
 
Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)Quality frameworks for e-learning (SIEAD 2018, Brazil)
Quality frameworks for e-learning (SIEAD 2018, Brazil)
 
Mesquite High School S Ta R Results
Mesquite High School S Ta R ResultsMesquite High School S Ta R Results
Mesquite High School S Ta R Results
 

Andere mochten auch

Version spaces
Version spacesVersion spaces
Version spacesGekkietje
 
25et_Bulgaria
25et_Bulgaria25et_Bulgaria
25et_BulgariaGavranica
 
Christmas in croatia eng
Christmas in croatia engChristmas in croatia eng
Christmas in croatia engGavranica
 
RCD CDHO - EE in HOME Workshop
RCD CDHO - EE in HOME WorkshopRCD CDHO - EE in HOME Workshop
RCD CDHO - EE in HOME WorkshopICF_HCD
 
Diploma de Innovación Educativa con Tecnologías Emergentes
Diploma de Innovación Educativa con Tecnologías EmergentesDiploma de Innovación Educativa con Tecnologías Emergentes
Diploma de Innovación Educativa con Tecnologías EmergentesIsmael Burone
 
ailehekimliği
ailehekimliğiailehekimliği
ailehekimliğianttab
 
Honey Bee by Journey
Honey Bee by JourneyHoney Bee by Journey
Honey Bee by Journeyvebrya
 
Thinking about Thinking
Thinking about ThinkingThinking about Thinking
Thinking about ThinkingJennifer Orr
 
Báo Cáo Thương Mại Điện Tử VN - 2006
Báo Cáo Thương Mại Điện Tử VN - 2006Báo Cáo Thương Mại Điện Tử VN - 2006
Báo Cáo Thương Mại Điện Tử VN - 2006Phuc Nguyen Thanh
 
新聞整理五則
新聞整理五則新聞整理五則
新聞整理五則guest370229
 
2010 I Rendementbijeenkomst
2010 I Rendementbijeenkomst2010 I Rendementbijeenkomst
2010 I Rendementbijeenkomstmr38schev
 
Inbound Marketing Cookbook
Inbound Marketing CookbookInbound Marketing Cookbook
Inbound Marketing CookbookEddie Choi
 
Womens Day Of Learning
Womens Day Of LearningWomens Day Of Learning
Womens Day Of Learningjfmdalliance
 
Hay vida antes del Community Manager
Hay vida antes del Community ManagerHay vida antes del Community Manager
Hay vida antes del Community ManagerDavinia Suárez
 
A Long Walk to Water - Lesson2 unit2
A Long Walk to Water - Lesson2 unit2A Long Walk to Water - Lesson2 unit2
A Long Walk to Water - Lesson2 unit2Terri Weiss
 
ICF Energy Efficiency in HOME Affordable Housing Manual
ICF Energy Efficiency in HOME Affordable Housing ManualICF Energy Efficiency in HOME Affordable Housing Manual
ICF Energy Efficiency in HOME Affordable Housing ManualICF_HCD
 
'The university as a hackerspace'
'The university as a hackerspace''The university as a hackerspace'
'The university as a hackerspace'Joss Winn
 

Andere mochten auch (20)

Anuario Jaye
Anuario JayeAnuario Jaye
Anuario Jaye
 
Version spaces
Version spacesVersion spaces
Version spaces
 
25et_Bulgaria
25et_Bulgaria25et_Bulgaria
25et_Bulgaria
 
Christmas in croatia eng
Christmas in croatia engChristmas in croatia eng
Christmas in croatia eng
 
RCD CDHO - EE in HOME Workshop
RCD CDHO - EE in HOME WorkshopRCD CDHO - EE in HOME Workshop
RCD CDHO - EE in HOME Workshop
 
Diploma de Innovación Educativa con Tecnologías Emergentes
Diploma de Innovación Educativa con Tecnologías EmergentesDiploma de Innovación Educativa con Tecnologías Emergentes
Diploma de Innovación Educativa con Tecnologías Emergentes
 
ailehekimliği
ailehekimliğiailehekimliği
ailehekimliği
 
Honey Bee by Journey
Honey Bee by JourneyHoney Bee by Journey
Honey Bee by Journey
 
Thinking about Thinking
Thinking about ThinkingThinking about Thinking
Thinking about Thinking
 
Báo Cáo Thương Mại Điện Tử VN - 2006
Báo Cáo Thương Mại Điện Tử VN - 2006Báo Cáo Thương Mại Điện Tử VN - 2006
Báo Cáo Thương Mại Điện Tử VN - 2006
 
新聞整理五則
新聞整理五則新聞整理五則
新聞整理五則
 
2010 I Rendementbijeenkomst
2010 I Rendementbijeenkomst2010 I Rendementbijeenkomst
2010 I Rendementbijeenkomst
 
Inbound Marketing Cookbook
Inbound Marketing CookbookInbound Marketing Cookbook
Inbound Marketing Cookbook
 
Womens Day Of Learning
Womens Day Of LearningWomens Day Of Learning
Womens Day Of Learning
 
Weblin20080826
Weblin20080826Weblin20080826
Weblin20080826
 
Hay vida antes del Community Manager
Hay vida antes del Community ManagerHay vida antes del Community Manager
Hay vida antes del Community Manager
 
A Long Walk to Water - Lesson2 unit2
A Long Walk to Water - Lesson2 unit2A Long Walk to Water - Lesson2 unit2
A Long Walk to Water - Lesson2 unit2
 
ICF Energy Efficiency in HOME Affordable Housing Manual
ICF Energy Efficiency in HOME Affordable Housing ManualICF Energy Efficiency in HOME Affordable Housing Manual
ICF Energy Efficiency in HOME Affordable Housing Manual
 
'The university as a hackerspace'
'The university as a hackerspace''The university as a hackerspace'
'The university as a hackerspace'
 
NanoA
NanoANanoA
NanoA
 

Ähnlich wie What stakeholders really think of eLearning. Quality through self-evaluation.

Meta-review of recognition of learning in LMS and MOOCs - Ruth Cobos
Meta-review of recognition of learning in LMS and MOOCs - Ruth CobosMeta-review of recognition of learning in LMS and MOOCs - Ruth Cobos
Meta-review of recognition of learning in LMS and MOOCs - Ruth CoboseMadrid network
 
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 versionBenita Williams
 
REAP Assessment/Feedback Principles and Examples
REAP Assessment/Feedback Principles and ExamplesREAP Assessment/Feedback Principles and Examples
REAP Assessment/Feedback Principles and ExamplesMartin Hawksey
 
Success Factors of Designing Quality Online Learning ASAR 2023.pdf
Success Factors of Designing Quality Online Learning ASAR 2023.pdfSuccess Factors of Designing Quality Online Learning ASAR 2023.pdf
Success Factors of Designing Quality Online Learning ASAR 2023.pdfJohnson Ong Chee Bin
 
A process oriented approach for modelling on line Learning Environments
A process oriented approach for modelling on line Learning EnvironmentsA process oriented approach for modelling on line Learning Environments
A process oriented approach for modelling on line Learning EnvironmentsBaker Khader Abdallah, PMP
 
Evaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course EvaluationEvaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course EvaluationJulia Parra
 
Online course evaluation
Online course evaluation Online course evaluation
Online course evaluation rozyckit
 
How educators value data analytics about their moocs (1)
How educators value data analytics about their moocs (1)How educators value data analytics about their moocs (1)
How educators value data analytics about their moocs (1)davinia.hl
 
Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities Reggie Cruz
 
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...Alaa Sadik
 
Lessons from 10 years of E-xcellence quality reviews for e-learning
Lessons from 10 years of E-xcellence quality reviews for e-learningLessons from 10 years of E-xcellence quality reviews for e-learning
Lessons from 10 years of E-xcellence quality reviews for e-learningEADTU
 
Guidelines and recommendations for successful Implementation of OCW in mobili...
Guidelines and recommendations for successful Implementation of OCW in mobili...Guidelines and recommendations for successful Implementation of OCW in mobili...
Guidelines and recommendations for successful Implementation of OCW in mobili...The Open Education Consortium
 
Programme design
Programme designProgramme design
Programme designTony Mays
 
Evaluation of Training Final Presentation
Evaluation of Training Final PresentationEvaluation of Training Final Presentation
Evaluation of Training Final Presentationsrajece
 
Improving the quality of e-learning courses in Higher Education
Improving the quality of e-learning courses in Higher EducationImproving the quality of e-learning courses in Higher Education
Improving the quality of e-learning courses in Higher EducationSusana Lemos
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...BlackboardEMEA
 
Quality e learning_africa_2013
Quality e learning_africa_2013Quality e learning_africa_2013
Quality e learning_africa_2013Brenda Mallinson
 

Ähnlich wie What stakeholders really think of eLearning. Quality through self-evaluation. (20)

Inspection and technology workshop
Inspection and technology workshopInspection and technology workshop
Inspection and technology workshop
 
Meta-review of recognition of learning in LMS and MOOCs - Ruth Cobos
Meta-review of recognition of learning in LMS and MOOCs - Ruth CobosMeta-review of recognition of learning in LMS and MOOCs - Ruth Cobos
Meta-review of recognition of learning in LMS and MOOCs - Ruth Cobos
 
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version
2. Evaluation design of the cofimvaba ict4 red initiative - Bridge 2014 version
 
REAP Assessment/Feedback Principles and Examples
REAP Assessment/Feedback Principles and ExamplesREAP Assessment/Feedback Principles and Examples
REAP Assessment/Feedback Principles and Examples
 
Success Factors of Designing Quality Online Learning ASAR 2023.pdf
Success Factors of Designing Quality Online Learning ASAR 2023.pdfSuccess Factors of Designing Quality Online Learning ASAR 2023.pdf
Success Factors of Designing Quality Online Learning ASAR 2023.pdf
 
A process oriented approach for modelling on line Learning Environments
A process oriented approach for modelling on line Learning EnvironmentsA process oriented approach for modelling on line Learning Environments
A process oriented approach for modelling on line Learning Environments
 
Assessment 2 feb sarah davies
Assessment 2 feb sarah daviesAssessment 2 feb sarah davies
Assessment 2 feb sarah davies
 
Evaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course EvaluationEvaluating Distance Education: Focus on Online Course Evaluation
Evaluating Distance Education: Focus on Online Course Evaluation
 
Online course evaluation
Online course evaluation Online course evaluation
Online course evaluation
 
How educators value data analytics about their moocs (1)
How educators value data analytics about their moocs (1)How educators value data analytics about their moocs (1)
How educators value data analytics about their moocs (1)
 
Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities Development of Proposed Computer Program for Quarterly Assessments Activities
Development of Proposed Computer Program for Quarterly Assessments Activities
 
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
 
Lessons from 10 years of E-xcellence quality reviews for e-learning
Lessons from 10 years of E-xcellence quality reviews for e-learningLessons from 10 years of E-xcellence quality reviews for e-learning
Lessons from 10 years of E-xcellence quality reviews for e-learning
 
Tip model
Tip modelTip model
Tip model
 
Guidelines and recommendations for successful Implementation of OCW in mobili...
Guidelines and recommendations for successful Implementation of OCW in mobili...Guidelines and recommendations for successful Implementation of OCW in mobili...
Guidelines and recommendations for successful Implementation of OCW in mobili...
 
Programme design
Programme designProgramme design
Programme design
 
Evaluation of Training Final Presentation
Evaluation of Training Final PresentationEvaluation of Training Final Presentation
Evaluation of Training Final Presentation
 
Improving the quality of e-learning courses in Higher Education
Improving the quality of e-learning courses in Higher EducationImproving the quality of e-learning courses in Higher Education
Improving the quality of e-learning courses in Higher Education
 
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...TLC2016 - Assessment Journey: a programme to enhance the educational experien...
TLC2016 - Assessment Journey: a programme to enhance the educational experien...
 
Quality e learning_africa_2013
Quality e learning_africa_2013Quality e learning_africa_2013
Quality e learning_africa_2013
 

What stakeholders really think of eLearning. Quality through self-evaluation.

  • 1. What stakeholders really think of eLearning. Quality through self-evaluation. Deborah Arnold, Vidéoscop-Université Nancy 2, France This project has been funded with support from the European Commission. This communication reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
  • 2.
  • 3. How to design sound-self-evaluation questionnaires
  • 6. Scenarios for implementing SEVAQ+What are wegoing to cover?
  • 7.
  • 8. A Lifelong Learning Programme KA4 Project (2009-2010) “Dissemination and exploitation of results”
  • 9. Support for improving the quality and attractiveness of Vocational Education and Training (VET)
  • 10.
  • 11. Analyse results with easy-to-interpret data.
  • 12. Improve the quality of our courses.
  • 13. Teachers and trainers can gather feedback on what learners really think of their learning experience.
  • 14. Training managers can get the full picture by comparing responses from the different stakeholders involved.
  • 15. Organisations can use the results of SEVAQ+ to benchmark against others.
  • 16.
  • 17. 2nd conceptual model: the EFQM model © EFQM European Foundation for Quality Management A management model for total quality (all processes, all actors) Each domain acts in interaction with all the others
  • 18.
  • 19. A wider scope of processes: the learning processes + all the design processes of the provider A wider target of users: the learner + the other stakeholders interested in the delivery of the offer Two distinctive contexts: e-learning in VET (as before) + e-learning in HE SEVAQ+: extending the approach Object E-learning design Learning process Teacher/ trainer User Manager TGs VET HE Context
  • 20. The extension of SEVAQ+ Managers Trainers Providers Learners + stakeholders+ contexts (HE and VET) + EFQM domains+Kirkpatrick levels
  • 21. Sub-criterion a Sub-criterion b Statements Sub-criterionc Sub-criteriond Sub-criterione 208 statements723 statements 38 sub-criteria99 Sub-criteria Resources Criterion 1 Criterion 2 Activities Criterion 3 Criterion 4 Results SEVAQ 1SEVAQ + 17 Criteria22 Criteria The structure of the SEVAQ+ questionnaires
  • 22. EFQM & Kirkpatrick applied EFQM Kirkpatrick 1 & 2 EFQM Kirkpatrick 3
  • 23. Testing SEVAQ+: Step 1 - getting started SEVAQ+ demos: http://www.sevaq-plus.preau.ccip.fr/demo/demo_1/sevaqplus_demo.html
  • 24. Step 2: design and implement questionnaires Demo 1 Demo 2a Demo 2b Demo 3 Demo 4
  • 25. Interpreting results: Histograms Question 247 : You knew every week (or day) what you were expected to do.
  • 26. Interpreting results: radar graphs Improvement needed Sub-criteria with results under the mean 37 : Time management [ 2.49 ] 41 : Blended approach [ 2.59 ] 79 : Levels of overall knowledge outcomes  [ 2.62 ] 86 : Learning management [ 2.41 ] 88 : Self-motivation [ 2.55 ] Improvement less or not needed Sub-criteria with results above the mean 18 : Pedagogical aspects of learning content [ 2.76 ] 20 : Technical requirements [ 3.04 ] 22 : Instructional design [ 2.77 ] 38 : Navigation and resource options [ 2.84 ] 84 : Awareness of learning preferences [ 2.72 ] Mean value for the evaluation = 2.7
  • 27. Interpreting results: table Summary table of critical questions by giving the percentage of persons quoting the question as important and giving a bad evaluation. A question is consider to be critical when its score is above 40% and very critical when its score is 60% and above.
  • 29.
  • 30. Leading to over 16 000 potential testers (58% HE / 42% VET)
  • 31. 7 local and national seminars in FR, PL, LT and IT
  • 32. 3 international workshops (Valencia, Oeiras & Budapest) with EDEN & EFQUEL
  • 33. 1500 current testers (more end Jan with end of semester evaluations)
  • 37.
  • 40.
  • 41. Join us < Facebook: SEVAQ+ www.sevaq.eu LinkedIn: Evaluation of training and courses
  • 42.
  • 43. User evaluation – ongoing till end January 2011
  • 45. Join the Delphi expert group: March – June 2011
  • 46.
  • 48. Rolf Reinhardt (EFQUEL)And all the SEVAQ+ partners! www.sevaq.eu