SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
The value of measurement in
research practice:
Evaluating ICT training in
education

Francesca Fanni, Izak van Zyl, Isabella Rega, and Lorenzo Cantoni
New Media in Education Laboratory (NewMinE Lab), Università della
Svizzera italiana, Lugano, Switzerland
Isabella Rega
Isabella.rega@usi.ch
Objectives
• to describe the use of a blended approach in analysing the
  impact of ICTs in education.
  • quantitative (based on questionnaire data) measurements
  • qualitative (based on interview data) measurements
• to show how each may complement the other
Self-Efficacy (SE) Construct
People’s judgment of their capabilities to organize and execute
   courses of action required to attain designated types of
                       performances.
                                                   Bandura, 1995

• 4 main sources
  •   mastery experiences,
  •   vicarious experiences,
  •   social persuasion,
  •   and emotional states.
Computer SE (CSE) & Teacher SE
(TSE)
                               CSE
an individual perception of his or her ability to use computers in
                 the accomplishment of a task
                                        Compeau & Higgins, 1995

                            TSE
  Judgment of his or her capabilities to bring about desired
 outcomes of student engagement and learning, even among
     those students who may be difficult or unmotivated
                                                  Bandura, 1995
The Sample and the Measurements
• Group A: 42 teachers - Rosmead and Zimasa
• Group B: 68 teachers - Vukukhanye, Blossom,
  Thembani and Moshesh
           Group A                     Group B
• Quantitative Approach     • Quantitative Approach
  • July 2009 - beginning     • July 2009
  • January 2010 - middle     • January 2010
  • May 2010 – end            • --


• Qualitative Approach      • Qualitative Approach
  • February/April 2010       • June/August 2010
Quantitative Results/1
                     Group A
   8
   7
   6
   5
   4
   3
   2
   1
   0
         July 2009    January 2010   May 2010
   TSE       7.2          6.7           7
   CSE       5.7          6.1          6.3
Quantitative Results/2
                Group B
  8
  7
  6
  5
  4
  3
  2
  1
  0
        July 2009         January 2010
  TSE       7.2               6.9
  CSE       5.7               5.7
10
                                                             15
                                                                  20
                                                                       25
                                                                            30




                                0
                                      5
    internal psychology (A)
    internal psychology (B)


   student engagement (A)
   student engagement (B)


classroom management (A)
classroom management (B)


instructional strategies (A)
 instructional strategies (B)


            preparation (A)
            preparation (B)


                  admin (A)
                  admin (B)
                                                                                 Mastery Experience Positive




           personal use (A)
                                                                                                               Qualitative Results/1




           personal use (B)


                 general (A)
                 general (B)


                support (A)
                 support (B)
                                    ACTUAL
                                             POSSIBLE
0
                                         10
                                                        20
                                                             30
                                                                  40
                                                                       50
                                                                            60
    internal psychology (A)
    internal psychology (B)


   student engagement (A)
   student engagement (B)


classroom management (A)
classroom management (B)


instructional strategies (A)
 instructional strategies (B)


           personal use (A)
           personal use (B)


        technical issues (A)
                                                                                                               Qualitative Results/2




        technical issues (B)
                                                                                 Negative Mastery Experience




                 general (A)
                 general (B)


                support (A)
                 support B)
                                    ACTUAL
                                             POSSIBLE
Qualitative Results/3
           Vicarious Experience Positive
  60


  50


  40


  30


  20                                       POSSIBLE
                                           ACTUAL
  10


  0
Qualitative Results/4
           Vicarious Experience Negative
   60

   50

   40

   30

   20
                                           POSSIBLE
   10                                      ACTUAL

    0
Hints on Complementarity
• Quantitative results
   • Group A:
       • CSE slightly increased, TSE stable.
       • No correlation between CSE and TSE.
       • CSE and TSE starting values: high


• Qualitative results:
   • High starting CSE value:
       • Group B: already using technologies in a variety of ways : to engage their students
         in learning activities, to manage their classes, to design and deliver their
         instructional strategies, for lesson preparation, and to perform administrative tasks
       • Group A started using more technologies within their working activities, featuring
         many usages from the realm of possible to the realm of actual and increasing their
         perceptions of mastery experiences in ICT.
   • No correlation between CSE and TSE
       • It is not a matter of not adoption, teachers are in fact using ICTs (for various
         purposes), but cannot explicitly relate this to their perceptions of being better
         educators
THANK YOU!




Isabella Rega
Isabella.rega@usi.ch

Weitere ähnliche Inhalte

Ähnlich wie CIRN Conference: MELISSA

Past awesome final
Past awesome finalPast awesome final
Past awesome final
rafontech
 
Think like an isd 2013
Think like an isd 2013Think like an isd 2013
Think like an isd 2013
A Cutler
 
Curriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South AfricaCurriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South Africa
Education Moving Up Cc.
 
Case study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final versionCase study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final version
Parasuram K
 
OPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered DesignOPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered Design
Bill Jerome
 

Ähnlich wie CIRN Conference: MELISSA (20)

Past awesome final
Past awesome finalPast awesome final
Past awesome final
 
Career launch fg2010
Career launch  fg2010Career launch  fg2010
Career launch fg2010
 
SAPA Provincial Presentation 2011
SAPA Provincial Presentation 2011SAPA Provincial Presentation 2011
SAPA Provincial Presentation 2011
 
Think like an isd 2013
Think like an isd 2013Think like an isd 2013
Think like an isd 2013
 
OCAD U Teaching Expo 2015
OCAD U Teaching Expo 2015OCAD U Teaching Expo 2015
OCAD U Teaching Expo 2015
 
DL resourcing talk 2012
DL resourcing talk 2012DL resourcing talk 2012
DL resourcing talk 2012
 
Witbank Circuit Strategic Planning
Witbank Circuit Strategic PlanningWitbank Circuit Strategic Planning
Witbank Circuit Strategic Planning
 
Icem&siie 2011 peer-assessment
Icem&siie 2011 peer-assessmentIcem&siie 2011 peer-assessment
Icem&siie 2011 peer-assessment
 
CCE and Grading System @ Agra
CCE and Grading System @ AgraCCE and Grading System @ Agra
CCE and Grading System @ Agra
 
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
LAS Training and Instruction Librarian’s Group - Learning Outcomes How Can W...
 
Curriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South AfricaCurriculum Management for Senior Management Teams in South Africa
Curriculum Management for Senior Management Teams in South Africa
 
Portfolios in self assessment
Portfolios in self assessmentPortfolios in self assessment
Portfolios in self assessment
 
Instructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning HandoutsInstructional Strategies for Blended Learning Handouts
Instructional Strategies for Blended Learning Handouts
 
Theory of change
Theory of changeTheory of change
Theory of change
 
UP ACE MTL Unit 1 Session 3
UP ACE MTL Unit 1   Session 3UP ACE MTL Unit 1   Session 3
UP ACE MTL Unit 1 Session 3
 
The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)The Pearls and Perils of For-Profit Education (Deborah Riemer)
The Pearls and Perils of For-Profit Education (Deborah Riemer)
 
Case study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final versionCase study_GUVI_Workshop_Final version
Case study_GUVI_Workshop_Final version
 
OPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered DesignOPEN Kickoff: OLI Learner Centered Design
OPEN Kickoff: OLI Learner Centered Design
 
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
NCCET December Webinar - Restructuring Continuing Education and Corporate Tra...
 
NEASC Presentation on TASC
NEASC Presentation on TASCNEASC Presentation on TASC
NEASC Presentation on TASC
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 

CIRN Conference: MELISSA

  • 1. The value of measurement in research practice: Evaluating ICT training in education Francesca Fanni, Izak van Zyl, Isabella Rega, and Lorenzo Cantoni New Media in Education Laboratory (NewMinE Lab), Università della Svizzera italiana, Lugano, Switzerland
  • 3. Objectives • to describe the use of a blended approach in analysing the impact of ICTs in education. • quantitative (based on questionnaire data) measurements • qualitative (based on interview data) measurements • to show how each may complement the other
  • 4. Self-Efficacy (SE) Construct People’s judgment of their capabilities to organize and execute courses of action required to attain designated types of performances. Bandura, 1995 • 4 main sources • mastery experiences, • vicarious experiences, • social persuasion, • and emotional states.
  • 5. Computer SE (CSE) & Teacher SE (TSE) CSE an individual perception of his or her ability to use computers in the accomplishment of a task Compeau & Higgins, 1995 TSE Judgment of his or her capabilities to bring about desired outcomes of student engagement and learning, even among those students who may be difficult or unmotivated Bandura, 1995
  • 6. The Sample and the Measurements • Group A: 42 teachers - Rosmead and Zimasa • Group B: 68 teachers - Vukukhanye, Blossom, Thembani and Moshesh Group A Group B • Quantitative Approach • Quantitative Approach • July 2009 - beginning • July 2009 • January 2010 - middle • January 2010 • May 2010 – end • -- • Qualitative Approach • Qualitative Approach • February/April 2010 • June/August 2010
  • 7. Quantitative Results/1 Group A 8 7 6 5 4 3 2 1 0 July 2009 January 2010 May 2010 TSE 7.2 6.7 7 CSE 5.7 6.1 6.3
  • 8. Quantitative Results/2 Group B 8 7 6 5 4 3 2 1 0 July 2009 January 2010 TSE 7.2 6.9 CSE 5.7 5.7
  • 9. 10 15 20 25 30 0 5 internal psychology (A) internal psychology (B) student engagement (A) student engagement (B) classroom management (A) classroom management (B) instructional strategies (A) instructional strategies (B) preparation (A) preparation (B) admin (A) admin (B) Mastery Experience Positive personal use (A) Qualitative Results/1 personal use (B) general (A) general (B) support (A) support (B) ACTUAL POSSIBLE
  • 10. 0 10 20 30 40 50 60 internal psychology (A) internal psychology (B) student engagement (A) student engagement (B) classroom management (A) classroom management (B) instructional strategies (A) instructional strategies (B) personal use (A) personal use (B) technical issues (A) Qualitative Results/2 technical issues (B) Negative Mastery Experience general (A) general (B) support (A) support B) ACTUAL POSSIBLE
  • 11. Qualitative Results/3 Vicarious Experience Positive 60 50 40 30 20 POSSIBLE ACTUAL 10 0
  • 12. Qualitative Results/4 Vicarious Experience Negative 60 50 40 30 20 POSSIBLE 10 ACTUAL 0
  • 13. Hints on Complementarity • Quantitative results • Group A: • CSE slightly increased, TSE stable. • No correlation between CSE and TSE. • CSE and TSE starting values: high • Qualitative results: • High starting CSE value: • Group B: already using technologies in a variety of ways : to engage their students in learning activities, to manage their classes, to design and deliver their instructional strategies, for lesson preparation, and to perform administrative tasks • Group A started using more technologies within their working activities, featuring many usages from the realm of possible to the realm of actual and increasing their perceptions of mastery experiences in ICT. • No correlation between CSE and TSE • It is not a matter of not adoption, teachers are in fact using ICTs (for various purposes), but cannot explicitly relate this to their perceptions of being better educators