SlideShare ist ein Scribd-Unternehmen logo
1 von 26
A Trust-based Social Recommender
for Teachers
Soude Fazeli, PhD candidate
Dr. Hendrik Drachsler
Dr. Francis Brouns
Prof. Dr. Peter Sloep




 page 1
The doctoral study is funded by

• NELLL
(Netherlands Laboratory for Lifelong Learning at the OUNL)


• Open Discovery Space (ODS)
 A socially-powered, multilingual
 open learning infrastructure
 to boost the adaptation of
 eLearning Resources in Europe



Run-time: 2011-2015

 page 2
A social space for teachers




                      Learning Networks?

page 3
page 4
Recommender systems?


page 5
A proposed recommender system for teachers




       page 6
Based on the framework proposed by Manouselis &
Costopoulou (2007)
Supported tasks

•   Find Novel resources
     • (Recker et al, 2003), (Lemire et al, 2005), (Rafaeli et al,
         2005), (Tang & McCalla, 2005), (Drachsler et al, 2009)


•   Find peers
     • (Beham et al, 2010), (Recker et al, 2003)


•   For more examples, please refer to
     • Manouselis N., Drachsler H., Verbert K., Duval E. (2012).
         Recommender Systems for Learning book, Springer.



page 7
User model

•   History-based models and user-item ratings matrix
•   Ontology
•   TEL variables: knowledge level, interests, goals and tasks, and
    background knowledge
•   Capturing social data with help of a standard specification:
     • FOAF
     • CAM
     • Annotation scheme (In the context of Organic.Edunet)


page 8
A proposed recommender system for teachers




       page 9
Based on the framework proposed by Manouselis &
Costopoulou (2007)
Similarity




               Sparsity!

page 10
(Golbeck, 2009; Kamvar et al., 2003; Ziegler & Golbeck, 2007;
 Massa & Avesani, 2004; Lathia et al., 2008; Fazeli et al., 2010)
page 11
Trust in recommender systems

•   Trustworthy users == like-minded users
•   Assuming that trust is transitive
     • (if A trusts B and B trusts C, then A trusts C)
•   Inter-user trust phenomena helps us to infer a relationship
    between users




                               Alice                              Bob




page 12                                        Carol
A social recommender system:
T-index approach
(Fazeli et al., 2010)

•   Creates trust relationships between users
     •    Based on the ratings information
•   Proposes T-index concept
     • To measure trustworthiness of users
     • To improve the process of finding the nearest neighbours
•   Inspired on the H-index
     •    Used to evaluate the publications of an author
•   Based on results, T-index improves structure of trust networks of users



page 13
Social data
page 14
•   RQ1: How can the sparsity problem within
    educational datasets be solved by using inter-user
    trust relationships which originally come from the
    social data of users?

•   RQ2: How can teachers’ networks be made to
    evolve by the use of social data?

    page 15
Proposed research


1.   Requirement analysis
           •   Literature review
           •   Interview study
2.   Dataset-driven study
3.   User evaluation study
4.   Pilot study




 page 16
1. Requirement analysis

  •   Goal
       • Investigating the teachers’ main needs and requirements
  •   Method
       • Nominal group technique (NGT)
       • 18 teachers (novices, experts, mentors and supervising teachers) from the
         Limburg area, the Netherlands
       • Inviting teachers to cluster the generated ideas by WebSort
       • Survey on use of social media by teachers
  •   Description
       • “What kind of support do you need to provide innovative teaching at your
         school?"
       • Writing down the ideas, discussion, clustering, ranking the ideas
  •   Expected outcomes
       • An inventory list of teachers’ needs and requirements
       • A framework to identify suitable recommender systems’ strategies for our
  page 17 target   users
Proposed research


1.   Requirement analysis
           •   Literature review
           •   Interview study
2.   Dataset-driven study
3.   User evaluation study
4.   Pilot study




 page 18
2. Dataset study

  •   Goal
       • To find out the most suitable recommender system algorithm for teachers
  •   Method
       • An offline empirical study of candidate algorithms (T-index, Pearson, Slope-
            one, Tanimoto)
       •    TravelWell, Organic.Edunet, eTwinning (TELeurope, Mace, Openscout)
  •   Variables to be measured
       • Prediction accuracy, coverage, and F1
  •   Expected outcomes
       • If the T-index approach can help to deal with the sparse data in the used
            datasets
        •   Which of the recommender system algorithms suits teachers best


      (Verbert et al., 2011)

  page 19
Proposed research


1.   Requirement analysis
           •   Literature review
           •   Interview study
2.   Dataset-driven study
3.   User evaluation study
4.   Pilot study




 page 20
3. User evaluation study

  •   Goal
       • To study users’ satisfaction
  •   Method
       • Questionnaire
       • Pre and post test of knowledge gain
  •   Variables to be measured
       • Interestingness and value-addedness (Tang & McCalla, 2009)
       • Prediction accuracy, coverage, and F1 measures
  •   Expected outcomes
       • Initial feedback by end-users on users’ satisfaction as an input for pilot study




  page 21
Proposed research


1.   Requirement analysis
           •   Literature review
           •   Interview study
2.   Dataset-driven study
3.   User evaluation study
4.   Pilot study




 page 22
4. Pilot study
  •   Goal
       • To deploy the final release
       • To test it under realistic operational conditions with the end-users
  •   Method
       • Evaluating performance of the designed recommender system algorithm
       • Study the structure of the teachers’ networks
  •   Variables to be measured
       • Prediction accuracy and coverage
       • Effectiveness in terms of total number of visited, bookmarked, or rated
            learning objects for two groups of users
       •    Indegree distribution to study how the structure of teachers’ networks changes
  •   Expected outcomes
       • Empirical data on prediction accuracy and coverage
       • The visualization of teachers’ networks


  page 23
Conclusion

• The aim is to support teachers to find the most
    suitable content or people
•   Recommender systems as a solution
•   How to overcome the sparsity problem by use of
    social data




    page 24
Ongoing and Further work

 •   Requirement analysis
      • Data collection (done)
            • Teachers from the Netherlands
            • European teachers in an Open Discovery Space Summer School, Greece
      •    Publishing the results as an extensive requirement analysis for teachers all
           over the Europe (in progress)


 •   Data set study
      • Testing data sets with users’ ratings (successfully done)
      • Testing data sets based on implicit users’ feedback (tags, bookmarks,
           comments, blogs, etc) (in progress)




 page 25
Soude Fazeli
PhD candidate
Open University of the Netherlands
Centre for Learning Sciences and Technologies
(CELSTEC) PO-Box 2960
6401 DL Heerlen, The Netherlands
email: soude.fazeli@ou.nl



  page 26

Weitere ähnliche Inhalte

Was ist angesagt?

Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014
Stian Håklev
 
OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis
OER Hub
 

Was ist angesagt? (20)

How to benchmark quality in MOOCs - the OpenupEd label
How to benchmark quality in MOOCs  - the OpenupEd labelHow to benchmark quality in MOOCs  - the OpenupEd label
How to benchmark quality in MOOCs - the OpenupEd label
 
Open Research into Open Education: The Role of Mapping and Curation
Open Research into Open Education: The Role of Mapping and CurationOpen Research into Open Education: The Role of Mapping and Curation
Open Research into Open Education: The Role of Mapping and Curation
 
Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014Open Learning Analytics panel at Open Education Conference 2014
Open Learning Analytics panel at Open Education Conference 2014
 
Evidence of OER Impact
Evidence of OER ImpactEvidence of OER Impact
Evidence of OER Impact
 
Learning Analytics: Seeking new insights from educational data
Learning Analytics: Seeking new insights from educational dataLearning Analytics: Seeking new insights from educational data
Learning Analytics: Seeking new insights from educational data
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
A Learning Analytics Approach
A Learning Analytics ApproachA Learning Analytics Approach
A Learning Analytics Approach
 
Open approaches to OER impact research
Open approaches to OER impact research Open approaches to OER impact research
Open approaches to OER impact research
 
The Impact of Open Textbooks in the USA and South Africa: When? Why? How?
The Impact of Open Textbooks in the USA and South Africa: When? Why? How?The Impact of Open Textbooks in the USA and South Africa: When? Why? How?
The Impact of Open Textbooks in the USA and South Africa: When? Why? How?
 
Case sStudy
Case sStudyCase sStudy
Case sStudy
 
Some Thoughts on Learning Analytics and Educational Data Mining
Some Thoughts on Learning Analytics and Educational Data MiningSome Thoughts on Learning Analytics and Educational Data Mining
Some Thoughts on Learning Analytics and Educational Data Mining
 
Blackboard Learning Analytics Research Update
Blackboard Learning Analytics Research UpdateBlackboard Learning Analytics Research Update
Blackboard Learning Analytics Research Update
 
OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis
 
OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis
 
OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis OER Impact: Collaboration, Evidence, Synthesis
OER Impact: Collaboration, Evidence, Synthesis
 
Educational Data Mining in Program Evaluation: Lessons Learned
Educational Data Mining in Program Evaluation: Lessons LearnedEducational Data Mining in Program Evaluation: Lessons Learned
Educational Data Mining in Program Evaluation: Lessons Learned
 
Grand challenges for the Educational Data Mining and Learning Sciences Commun...
Grand challenges for the Educational Data Mining and Learning Sciences Commun...Grand challenges for the Educational Data Mining and Learning Sciences Commun...
Grand challenges for the Educational Data Mining and Learning Sciences Commun...
 
Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016
 
SHEILA project: Panel on capacity building
SHEILA project: Panel on capacity buildingSHEILA project: Panel on capacity building
SHEILA project: Panel on capacity building
 
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...2017 ProSPER.Net Young Researchers' School  ‘Water Security For Sustainable D...
2017 ProSPER.Net Young Researchers' School ‘Water Security For Sustainable D...
 

Ähnlich wie RecSysTEL2012 slides

Recommendations for Open Online Education: An Algorithmic Study
Recommendations for Open Online Education:  An Algorithmic StudyRecommendations for Open Online Education:  An Algorithmic Study
Recommendations for Open Online Education: An Algorithmic Study
Hendrik Drachsler
 
Learning design and learning analytics
Learning design and learning analyticsLearning design and learning analytics
Learning design and learning analytics
Rebecca Ferguson
 
Conole tel methodologies
Conole tel methodologiesConole tel methodologies
Conole tel methodologies
Grainne Conole
 
14.30 kurilovas bireniene
14.30 kurilovas bireniene14.30 kurilovas bireniene
14.30 kurilovas bireniene
progettoacariss
 
Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011
natcenslides
 

Ähnlich wie RecSysTEL2012 slides (20)

Requirements for Learning Analytics
Requirements for Learning AnalyticsRequirements for Learning Analytics
Requirements for Learning Analytics
 
Recommendations for Open Online Education: An Algorithmic Study
Recommendations for Open Online Education:  An Algorithmic StudyRecommendations for Open Online Education:  An Algorithmic Study
Recommendations for Open Online Education: An Algorithmic Study
 
LAK15 panel - European Perspectives
 LAK15 panel - European Perspectives LAK15 panel - European Perspectives
LAK15 panel - European Perspectives
 
European Perspectives on Learning Analytics: LAK15 LACE panel
European Perspectives on Learning Analytics: LAK15 LACE panelEuropean Perspectives on Learning Analytics: LAK15 LACE panel
European Perspectives on Learning Analytics: LAK15 LACE panel
 
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
 
Learning design and learning analytics
Learning design and learning analyticsLearning design and learning analytics
Learning design and learning analytics
 
Empowering the Instructor with Learning Analytics
Empowering the Instructor with Learning AnalyticsEmpowering the Instructor with Learning Analytics
Empowering the Instructor with Learning Analytics
 
Conole tel methodologies
Conole tel methodologiesConole tel methodologies
Conole tel methodologies
 
Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining
 
14.30 kurilovas bireniene
14.30 kurilovas bireniene14.30 kurilovas bireniene
14.30 kurilovas bireniene
 
Mapping & Curation in OER Impact Research #altc
Mapping & Curation in OER Impact Research #altcMapping & Curation in OER Impact Research #altc
Mapping & Curation in OER Impact Research #altc
 
Jatkoseminaari Nissinen
Jatkoseminaari NissinenJatkoseminaari Nissinen
Jatkoseminaari Nissinen
 
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
EMMA Summer School - Rebecca Ferguson - Learning design and learning analytic...
 
Big Data for Student Learning
Big Data for Student LearningBig Data for Student Learning
Big Data for Student Learning
 
Learning analytics futures: a teaching perspective
Learning analytics futures: a teaching perspectiveLearning analytics futures: a teaching perspective
Learning analytics futures: a teaching perspective
 
Websci 2018
Websci 2018Websci 2018
Websci 2018
 
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...
 
Rss Oct 2011 Mixed Modes Pres0
Rss Oct 2011 Mixed Modes Pres0Rss Oct 2011 Mixed Modes Pres0
Rss Oct 2011 Mixed Modes Pres0
 
Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011
 
Kbsi15 trieste dk-ak
Kbsi15 trieste dk-akKbsi15 trieste dk-ak
Kbsi15 trieste dk-ak
 

Kürzlich hochgeladen

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 

RecSysTEL2012 slides

  • 1. A Trust-based Social Recommender for Teachers Soude Fazeli, PhD candidate Dr. Hendrik Drachsler Dr. Francis Brouns Prof. Dr. Peter Sloep page 1
  • 2. The doctoral study is funded by • NELLL (Netherlands Laboratory for Lifelong Learning at the OUNL) • Open Discovery Space (ODS) A socially-powered, multilingual open learning infrastructure to boost the adaptation of eLearning Resources in Europe Run-time: 2011-2015 page 2
  • 3. A social space for teachers Learning Networks? page 3
  • 6. A proposed recommender system for teachers page 6 Based on the framework proposed by Manouselis & Costopoulou (2007)
  • 7. Supported tasks • Find Novel resources • (Recker et al, 2003), (Lemire et al, 2005), (Rafaeli et al, 2005), (Tang & McCalla, 2005), (Drachsler et al, 2009) • Find peers • (Beham et al, 2010), (Recker et al, 2003) • For more examples, please refer to • Manouselis N., Drachsler H., Verbert K., Duval E. (2012). Recommender Systems for Learning book, Springer. page 7
  • 8. User model • History-based models and user-item ratings matrix • Ontology • TEL variables: knowledge level, interests, goals and tasks, and background knowledge • Capturing social data with help of a standard specification: • FOAF • CAM • Annotation scheme (In the context of Organic.Edunet) page 8
  • 9. A proposed recommender system for teachers page 9 Based on the framework proposed by Manouselis & Costopoulou (2007)
  • 10. Similarity Sparsity! page 10
  • 11. (Golbeck, 2009; Kamvar et al., 2003; Ziegler & Golbeck, 2007; Massa & Avesani, 2004; Lathia et al., 2008; Fazeli et al., 2010) page 11
  • 12. Trust in recommender systems • Trustworthy users == like-minded users • Assuming that trust is transitive • (if A trusts B and B trusts C, then A trusts C) • Inter-user trust phenomena helps us to infer a relationship between users Alice Bob page 12 Carol
  • 13. A social recommender system: T-index approach (Fazeli et al., 2010) • Creates trust relationships between users • Based on the ratings information • Proposes T-index concept • To measure trustworthiness of users • To improve the process of finding the nearest neighbours • Inspired on the H-index • Used to evaluate the publications of an author • Based on results, T-index improves structure of trust networks of users page 13
  • 15. RQ1: How can the sparsity problem within educational datasets be solved by using inter-user trust relationships which originally come from the social data of users? • RQ2: How can teachers’ networks be made to evolve by the use of social data? page 15
  • 16. Proposed research 1. Requirement analysis • Literature review • Interview study 2. Dataset-driven study 3. User evaluation study 4. Pilot study page 16
  • 17. 1. Requirement analysis • Goal • Investigating the teachers’ main needs and requirements • Method • Nominal group technique (NGT) • 18 teachers (novices, experts, mentors and supervising teachers) from the Limburg area, the Netherlands • Inviting teachers to cluster the generated ideas by WebSort • Survey on use of social media by teachers • Description • “What kind of support do you need to provide innovative teaching at your school?" • Writing down the ideas, discussion, clustering, ranking the ideas • Expected outcomes • An inventory list of teachers’ needs and requirements • A framework to identify suitable recommender systems’ strategies for our page 17 target users
  • 18. Proposed research 1. Requirement analysis • Literature review • Interview study 2. Dataset-driven study 3. User evaluation study 4. Pilot study page 18
  • 19. 2. Dataset study • Goal • To find out the most suitable recommender system algorithm for teachers • Method • An offline empirical study of candidate algorithms (T-index, Pearson, Slope- one, Tanimoto) • TravelWell, Organic.Edunet, eTwinning (TELeurope, Mace, Openscout) • Variables to be measured • Prediction accuracy, coverage, and F1 • Expected outcomes • If the T-index approach can help to deal with the sparse data in the used datasets • Which of the recommender system algorithms suits teachers best (Verbert et al., 2011) page 19
  • 20. Proposed research 1. Requirement analysis • Literature review • Interview study 2. Dataset-driven study 3. User evaluation study 4. Pilot study page 20
  • 21. 3. User evaluation study • Goal • To study users’ satisfaction • Method • Questionnaire • Pre and post test of knowledge gain • Variables to be measured • Interestingness and value-addedness (Tang & McCalla, 2009) • Prediction accuracy, coverage, and F1 measures • Expected outcomes • Initial feedback by end-users on users’ satisfaction as an input for pilot study page 21
  • 22. Proposed research 1. Requirement analysis • Literature review • Interview study 2. Dataset-driven study 3. User evaluation study 4. Pilot study page 22
  • 23. 4. Pilot study • Goal • To deploy the final release • To test it under realistic operational conditions with the end-users • Method • Evaluating performance of the designed recommender system algorithm • Study the structure of the teachers’ networks • Variables to be measured • Prediction accuracy and coverage • Effectiveness in terms of total number of visited, bookmarked, or rated learning objects for two groups of users • Indegree distribution to study how the structure of teachers’ networks changes • Expected outcomes • Empirical data on prediction accuracy and coverage • The visualization of teachers’ networks page 23
  • 24. Conclusion • The aim is to support teachers to find the most suitable content or people • Recommender systems as a solution • How to overcome the sparsity problem by use of social data page 24
  • 25. Ongoing and Further work • Requirement analysis • Data collection (done) • Teachers from the Netherlands • European teachers in an Open Discovery Space Summer School, Greece • Publishing the results as an extensive requirement analysis for teachers all over the Europe (in progress) • Data set study • Testing data sets with users’ ratings (successfully done) • Testing data sets based on implicit users’ feedback (tags, bookmarks, comments, blogs, etc) (in progress) page 25
  • 26. Soude Fazeli PhD candidate Open University of the Netherlands Centre for Learning Sciences and Technologies (CELSTEC) PO-Box 2960 6401 DL Heerlen, The Netherlands email: soude.fazeli@ou.nl page 26