9. Evaluation Study I Important Results: The application of up to 50% stopwords and the identification of the ideal number of dimensions to retain in LSA are important factors for the application of LSA with smaller corpora
10. Evaluation Study II Table 1: Confusion Matrix for LSA as classifier for “meaningful” content (n=504) 424 12 Irrelevant 40 28 Relevant LSA rating Irrelevant Relevant Human rating
11. Evaluation Study II AUC (Area under the ROC curve) value= .81 (95% CI, Std Err. = 0.0262)
12.
13. Architecture of the Placement Web-Service Iduser = Integer Learninggoal = Array (Strings) EventType On request. Format DATA Fields Frequency 2-dimensional array of floats. Each UoL with its calculated cosine values. Iduser=xx Return a list of UoL annotated with cosine values Get getPositionValues Output Input Description Method Name Placement Web-Service Interface (API)
14. Role of the Placement Web-Service in the TENCompetence infrastructure Drachsler, Herder, Kärger, Kalz 2008 Curriculum Planner Navigation Web Service Preference Engine Placement Web Service Curriculum -based Service Preference -based Service Navigation -based Service Positioning -based Service SOAP SOAP LPath creator LPath Provider Learner metadata Learning Paths getLocation(UoL) getLocations(UoLs) createLearningPath, getLearningPath(ID) Hybrid Personalizer Configuration Framework Units Of Learning Metadata
15. Contact Thank you for your attention! Questions? Marco Kalz, M.A. Centre for Learning Sciences and Technologies Open University of the Netherlands P. O. Box 2960 6401 DL Heerlen, The Netherlands [email_address] Presentation will be at http://dspace.ou.nl & http://slideshare.net/mkalz
Hinweis der Redaktion
More specifically, it addresses the placement problem in informal learning settings in which there is no clear and structured information on the individual learning resources available, a scenario that is in increasing demand in professional learning
In our state of the art analysis we have seen that LSA is on the one hand successfully used in several educational applications but on the other hand most implementations work with much larger text corpora as we expect to have in learning networks. Another constraint for our experiment was that most of the experiments are done the englisch text corpora. Since we were planning to develop we-services for the learning environments of the Open University of the Netherlands we have used Dutch text corpora For this purpose we first did a methodological study to see if LSA can discriminate between similar and dissimilar documents.
After a review of existing solution we have developed a web-service around several LSA libraries. This web-service can import documents, preprocess them with weighting, stopwords etc., execute the SVD and finally query document to document comparison.
In the TENCompetence project we have developed a so call hybrid personalization prototype. This prototype combines so called “top-down”-approaches using metadata/ontologies with “bottom-up”methods like LSA and collaborative filtering.