Your SlideShare is downloading. ×
Next Practices for OER Quality Evaluation | Lisa Petrides
Nächste SlideShare
Wird geladen in ...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Next Practices for OER Quality Evaluation | Lisa Petrides


Published on

Keynote at the Learning Analytics and Knowledge conference (LAK 2013), Leuven, Belgium - for the Learning Object Analytics for Collections, Repositories & Federations workshop, by Lisa Petrides, ...

Keynote at the Learning Analytics and Knowledge conference (LAK 2013), Leuven, Belgium - for the Learning Object Analytics for Collections, Repositories & Federations workshop, by Lisa Petrides, entitled "Next Practices for OER Quality Evaluation: Using Analytics to Support Continuous Improvement"

Published in: Bildung, Technologie

0 Kommentare
0 Gefällt mir
  • Hinterlassen Sie den ersten Kommentar

  • Be the first to like this

Keine Downloads
Bei Slideshare
Aus Einbettungen
Anzahl an Einbettungen
Gefällt mir
Einbettungen 0
No embeds

Inhalte melden
Als unangemessen gemeldet Als unangemessen melden
Als unangemessen melden

Wählen Sie Ihren Grund, warum Sie diese Präsentation als unangemessen melden.

No notes for slide


  • 1. Next Practices for OER QualityEvaluation: Using Analytics toSupport ContinuousImprovementLAK 2013 - Learning Object Analytics forCollections, Repositories & FederationsApril 9, 20134.9.13Lisa Petrides, Ph.D.ISKME 2013:
  • 2. ISKME (Institute for the Study of KnowledgeManagement in Education)Research, tools and services to advance teaching and learning• Study (research)• Open (open knowledge networks)• Build (training and design)
  • 3. OER
  • 4. Open Author
  • 5. OpenKey drivers and next practicesNext practices:OER evaluation toolsCustom analytics00Uncertainty aroundimplementation ofnew learningstandardsDecreases ineducationfundingNew learningstandardsIncreaseddemand foranalyticsrelated to theuse of onlineresources
  • 6. Analytics – For What PurposeFrom resource discovery to improved teaching and learning• What resourceusage patterns canand should betracked and shared?• How can paradatasupport resourceand technologyimprovements?• Which resourcesare learnersspending time on?• How do usagepatterns map toassessmentoutcomes?• Are resourcesmeeting learningstandards? If yes,how? If no, why not?• What factors makeresources reusable byteachers/learners?• What makes anexemplary resourceexemplary?LearningRegistryNSDL schema forparadata exchangeSite-specificinitatives**Examples include: Open High School Utah, Carnegie Mellon OLI, edX and othersISKME –OER Commons• How can wesupport resourcediscovery throughshared metadataand paradatastandards?KeyquestionsResourcediscoveryTechnologyand resourceimprovementsCurriculumimprovementsTargetoutcomesEnhanced teachingand learning practices;Curriculumimprovements
  • 7. OER Quality EvaluationEQuIP tool for evaluating resources on alignment to state standardsRubric dimensions:1.Alignment to the depth ofthe CCSS (Common Core StateStandards)2.Key shifts in the CCSS3.Instructional supports4.Assessment5.Overal rating for thelesson/unit
  • 8. OER Quality EvaluationAchieve tool for evaluating resources on quality dimensionsRubric dimensions:1.Quality of explanation ofthe subject matter2.Utility of the materialsdesigned to support teaching3.Quality of assessments4.Quality of technologicalinteractivity5.Quality of instructional andpractice exercises6.Opportunities for deeperlearning
  • 9. Analytics Use CaseSupporting teacher professional development around finding,creating, evaluating and aligning resources• Are my teachers finding the resources they need?• Are they reaching our district’s goals for identifyingand evaluating resources?• What activities do teachers need more support in?• Where should I focus my professional developmentefforts with my teachers?• Are teachers able to see what dimensions of aresource need to be improved for it to beconsidered exemplary?Project leaders, districtadministrators, and statecurriculum developersworking with teachers toidentify quality resourcesthat are aligned tolearning standardsKey Questions the Analytics Help to Answer
  • 10. • What distinguishes resources with high ratings from those with lowratings?• What is it that makes a resource exemplary?• What factors contribute to the use and reuse of resources byteachers?• How can we encourage the creation of high quality resourcesthrough our tools and supports?Key Questions the Analytics Help to Answer (for ISKME)Analytics Use CaseSupporting improvements on learning resources
  • 11. Example Dashboard ViewResources by evaluation scoresQuality ofexplanation ofsubject matterQuality oftechnologicalinteractivity
  • 12. Example Dashboard ViewEvaluation activities by userMichael SanderJessalyn KatonaMarta LevyWilliam DonovanAvery MitchellSam OlssonChris SengesIndicates whethergoals for evaluating(or tagging) resourceshave been met
  • 13. Example ReportUser comments on evaluated resources• All qualitativecomments can beexported to a csvfile for contentanalysis• Comments canprovide insightinto neededimprovements tothe resource, whatis good about theresource, andways the resourcecan be used in theclassroom
  • 14. Next Phase Custom AnalyticsExamples of additional data we are collecting through Open AuthorOpen Author Analytics Indicator of….# of subheadings by resource Whether resources can be broken into smaller parts.How “modular” is the resource collection?# of external URLs by resource Whether resources are being combined with otherresources. How “remixable” are the resources?# of versions of a resource by theoriginal author; # of versions by otherothersHow many derivatives are being made of the resources,and by whom? Are resources in the collectionadaptable?Reasons provided by users forchanging an existing resourceWhy and how resources are changed.What makes a resource adaptable?
  • 15. What This All MeansContinuous improvement of resources toward enhanced learningIf one of our hyptheses is correct that…Resources with the highest overall qualityrating on our Achieve rubric are also found tohave:•The highest rating on dimension 5: Quality ofinstructional and practice exercises•More subheadings than other resources(more modular)•More external URLs than other resources(more remixable)•More versions created (more reusable)•ISKME builds prompts into Open Author toencourage the creation of resources that havethese components•This leads to the creation of new resourcesthat potentially better meet learningstandards and teaching needs•The newly created resources are thenanalyzed through the analytics•This creates a continuous cycle of resourceand tool enhancement, towards improvedteaching and learningThis could lead to…
  • 16. Lisa Petrides, PresidentEmail: lisa@iskme.orgTwitter: @lpetridesInstitute for the Study of KnowledgeManagement in EducationHalf Moon Bay, California