SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Downloaden Sie, um offline zu lesen
Survey Instrument Validity
OERdifferentiation.com
ROER4D & GO-GN Research - Research Track
(Aspen) – 10:30 - Thursday, 23 April 2015
Dutra, Judith, and Daryono
George (statistics support)
Banff - April - 2015
OER4D project
Survey Instrument Validity
Validation of a survey instrument to understand the current users and
potential user of Open Education Resources (OER) in Global South
 Although we observe a growth of OER in Global South, we have identified a
concern with its use, especially in comparison with the Global North. The
difference between Global North and Global South education may arise
through a combination of several cultural, demographic, socioeconomic, and
political factors.
 Recognition of OER differences as a big issue, may lead scholars, policy
makers, and the public to understand the potential of the OER to improve
everyday life for those on the margins of society and to achieve greater social
equity and empowerment.
 Our purpose is to develop and validate an instrument to understand
the current and potential users of Open Education Resources (OER) in Post-
secondary Education in the Global South.
The process of development of the
instrument consists of the following six steps:
1-
Defining the
construct
2 –
Item development
and judgment
3 – Designing the
survey
5 – Data collection4 – Pilot study5 - Wrap-up
Step one: Defining the construct
 Review of the literature was centered on what influences the current and
potential users of OER.
 The four constructs emerged from the literature:
 Individual characteristics,
 Education institution characteristics,
 OER proficiency (Creation, Use, Modify, Remix, and Share)
 and perceived outcomes of OER.
Step two – Item development and
judgment
 The item development process had each construct with several questions derived from the
literature ,previous OER surveys, and question harmonisation process done by ROER4D
group.
 Upon completion of the item development process, we recruited a set of 34 experts to assess
the instrument’s content and face validity. We scaled all questions within each of the two
main constructs using 5-level Likert scale. Majority (75.5%) of members of the experts group
have 6 or more years of education experience, 53% have distance education experience, and
at least of 31 years old.
 The selection of qualified experts is an important part of the instrument process to
determine the appropriate number of questions to fully explore each construct. This avoids
research bias on selecting item development.
 The expert group also provided comments and feedback regarding each question. We
instructed the experts to determine to what extent do the items represented the constructs
using a 5-point Likert scale.
 Only the most collectively agreed items and/or with literature support were included in the
next version of the instrument.
Step three: Designing and conducting
studies to develop a survey
 After securing face and content validity, the instrument contained 26/30
questions on student/instructor version. The final instrument is hosted on
SurveyMonkey server and was ready for use in English, Spanish, Bahasa
(Indonesia) and Portuguese language. The hard copy option was available for
several countries.
 We designed the format of the survey, so participants could edit their own
survey responses or finish it later in case of internet connection loss.
 Additional information to support the results will be collected using
interviews and secondary data by Local Coordinators (LC).
Step four: Pilot study
 The main idea is to identify errors in a survey’s form and presentations. It
allows us to redesign some problems before it is used.
 After the pilot test, the 78 respondents provided consistent suggestions to
improve the instrument. One major suggestions was adopted: Use Education
Resources (ER) instead of OER and then ask for the use of the license. Without
a clear understanding of OER by the respondents, no conclusion can be made
for OER.
 The improvements were made, and additional pilot test (second) was done
with minor revisions.
 Time to complete the survey was also collected by the instrument server.
Step five: Data collection Plan
 Education Institution in each region. The selected nine countries are Brazil, Chile, Colombia, Ghana,
South Africa, Kenya, India, Indonesia, and Malaysia. There is a region coordinator for each region
responsible of three countries with four LC each. Each LC is in charge to collect the data from one
education institution. Each LC will collect 210 completed surveys. The total number of completed
questionnaire will be around 7,560. A random sample will used where every eligible student or
instructor should have an equal, non zero chance of being included (Threats to Internal validity).
 After ethical clearance, the LC has to follow the data collection plan with random collection.
Initially, he/she sent the list of all classes within their campus to the global coordinator. The global
coordinator will return do the LC a random ordered list of 30 classes to be surveyed. From that list,
the LC would select only 10 classes with 30 or more students and permission to survey the students
granted by the instructor. The LC should send the list of all students, from each of the 10 classes
selected, to the Global coordinator. The Global coordinator, with support from the statistician,
sends to LC a list of 30 ordered random list of students. Only 20 students should be surveyed for
each class using online server or hard copy. All the instructors from the 10 selected class, should also
be surveyed.
 To support the discussion on the results, a special survey with open-nded questions about the
institution were designed to be responded by the local coordinator.
 Surveymonkey , skype (gotomeeting), and Basecamp were used to manage the project with 39
collaborators around the world.
Step Six: Finalizing a survey
 We plan to use EFA - Exploratory Factor analysis – and assess survey reliability
to validate the instrument after the data collection in order to improve the
instrument validity. We expect that this instrument may be used by the OER
community.
 The process of developing and validating an instrument proposed may
enhance the quality of information derived from the data collected and help
to improve the education in Global South and reduce the difference between
Global North and Global South education.
 All the finding will be available online with open license after the end of the
project in November 2015. An online data extraction tool will also be
available.
Initial results ...
Thank you
Judith, Daryono, and Dutra (dutra@usp.br)
August 2014

Weitere ähnliche Inhalte

Was ist angesagt?

Data-Driven Development (D3) and Evaluation of Enskill English
Data-Driven Development (D3) and Evaluation of Enskill EnglishData-Driven Development (D3) and Evaluation of Enskill English
Data-Driven Development (D3) and Evaluation of Enskill EnglishLewisJohnson34
 
Online Reading Comprehension Assessment
Online Reading Comprehension AssessmentOnline Reading Comprehension Assessment
Online Reading Comprehension AssessmentGreg Mcverry
 
ROER4D - Short overview for Open Education Week 13 March 2015
ROER4D - Short overview for Open Education Week 13 March 2015ROER4D - Short overview for Open Education Week 13 March 2015
ROER4D - Short overview for Open Education Week 13 March 2015ROER4D
 
Acadly at Reimagine Education 2017
Acadly at Reimagine Education 2017Acadly at Reimagine Education 2017
Acadly at Reimagine Education 2017Vaibhav Vashisht
 
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...OEPScotland
 
Open Educational Resources Impact in Community Colleges
Open Educational Resources Impact in Community CollegesOpen Educational Resources Impact in Community Colleges
Open Educational Resources Impact in Community CollegesRobert Farrow
 
Presentation usdoe abt project
Presentation usdoe abt projectPresentation usdoe abt project
Presentation usdoe abt projectapicciano
 
Evalution In Et
Evalution In EtEvalution In Et
Evalution In Etu065932
 

Was ist angesagt? (9)

Challenge-based gamification as a teaching’Open Educational Innovation strate...
Challenge-based gamification as a teaching’Open Educational Innovation strate...Challenge-based gamification as a teaching’Open Educational Innovation strate...
Challenge-based gamification as a teaching’Open Educational Innovation strate...
 
Data-Driven Development (D3) and Evaluation of Enskill English
Data-Driven Development (D3) and Evaluation of Enskill EnglishData-Driven Development (D3) and Evaluation of Enskill English
Data-Driven Development (D3) and Evaluation of Enskill English
 
Online Reading Comprehension Assessment
Online Reading Comprehension AssessmentOnline Reading Comprehension Assessment
Online Reading Comprehension Assessment
 
ROER4D - Short overview for Open Education Week 13 March 2015
ROER4D - Short overview for Open Education Week 13 March 2015ROER4D - Short overview for Open Education Week 13 March 2015
ROER4D - Short overview for Open Education Week 13 March 2015
 
Acadly at Reimagine Education 2017
Acadly at Reimagine Education 2017Acadly at Reimagine Education 2017
Acadly at Reimagine Education 2017
 
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...
Awareness of OER and OEP in Scottish Higher Education Institutions Survey Res...
 
Open Educational Resources Impact in Community Colleges
Open Educational Resources Impact in Community CollegesOpen Educational Resources Impact in Community Colleges
Open Educational Resources Impact in Community Colleges
 
Presentation usdoe abt project
Presentation usdoe abt projectPresentation usdoe abt project
Presentation usdoe abt project
 
Evalution In Et
Evalution In EtEvalution In Et
Evalution In Et
 

Ähnlich wie Survey Instrument Validity - OER Project

Survey Instrument Validity OERdifferentiation.com
Survey Instrument Validity OERdifferentiation.comSurvey Instrument Validity OERdifferentiation.com
Survey Instrument Validity OERdifferentiation.comOpen Education Consortium
 
The role of monitoring and evaluation in six South African reading programmes...
The role of monitoring and evaluation in six South African reading programmes...The role of monitoring and evaluation in six South African reading programmes...
The role of monitoring and evaluation in six South African reading programmes...Mlungisi Zuma
 
Evanouski Evaluation Proposal
Evanouski Evaluation ProposalEvanouski Evaluation Proposal
Evanouski Evaluation Proposalloraevanouski
 
Markus id project 1
Markus id project 1Markus id project 1
Markus id project 1erinmarkus
 
Module 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentModule 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentMichael Kenny
 
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...Global OER Graduate Network
 
PPT 4 Educo's Final Evaluation.pptx
PPT 4 Educo's Final Evaluation.pptxPPT 4 Educo's Final Evaluation.pptx
PPT 4 Educo's Final Evaluation.pptxRatulNath6
 
Methods Of Data Collection
Methods Of Data CollectionMethods Of Data Collection
Methods Of Data CollectionTiffany Miller
 
Holder request for proposal
Holder request for proposalHolder request for proposal
Holder request for proposalbsudenise
 
Taking advantage of openness: understanding the variety of perspectives on op...
Taking advantage of openness: understanding the variety of perspectives on op...Taking advantage of openness: understanding the variety of perspectives on op...
Taking advantage of openness: understanding the variety of perspectives on op...OER Hub
 
Methods Of Collecting Data For Nursing Research
Methods Of Collecting Data For Nursing ResearchMethods Of Collecting Data For Nursing Research
Methods Of Collecting Data For Nursing ResearchMichelle Love
 
Instruments for measuring public satisfaction with the education
Instruments for measuring public satisfaction with the educationInstruments for measuring public satisfaction with the education
Instruments for measuring public satisfaction with the educationEmad Mohammed Sindi
 
Development of an Electronic Decision Support tool to optimize performance du...
Development of an Electronic Decision Support tool to optimize performance du...Development of an Electronic Decision Support tool to optimize performance du...
Development of an Electronic Decision Support tool to optimize performance du...INSPIRE_Network
 
LEARNING MEDIA ASSESSMENT
LEARNING MEDIA ASSESSMENTLEARNING MEDIA ASSESSMENT
LEARNING MEDIA ASSESSMENTeadvisor
 
Literature Review on
Literature Review onLiterature Review on
Literature Review onNadia Ayman
 
programme evaluation by priyadarshinee pradhan
programme evaluation by priyadarshinee pradhanprogramme evaluation by priyadarshinee pradhan
programme evaluation by priyadarshinee pradhanPriya Das
 
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptx
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptxONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptx
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptxNestorCapina
 
MET_Gathering_Feedback_Practioner_Brief
MET_Gathering_Feedback_Practioner_BriefMET_Gathering_Feedback_Practioner_Brief
MET_Gathering_Feedback_Practioner_BriefPaul Fleischman
 

Ähnlich wie Survey Instrument Validity - OER Project (20)

Survey Instrument Validity OERdifferentiation.com
Survey Instrument Validity OERdifferentiation.comSurvey Instrument Validity OERdifferentiation.com
Survey Instrument Validity OERdifferentiation.com
 
The role of monitoring and evaluation in six South African reading programmes...
The role of monitoring and evaluation in six South African reading programmes...The role of monitoring and evaluation in six South African reading programmes...
The role of monitoring and evaluation in six South African reading programmes...
 
Evanouski Evaluation Proposal
Evanouski Evaluation ProposalEvanouski Evaluation Proposal
Evanouski Evaluation Proposal
 
Markus id project 1
Markus id project 1Markus id project 1
Markus id project 1
 
Module 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course contentModule 2: Needs Analysis Dima course content
Module 2: Needs Analysis Dima course content
 
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...
OER LEARNING DESIGN GUIDELINES FOR BRAZILIAN K-12 TEACHERS SUPPORTING THE DEV...
 
PPT 4 Educo's Final Evaluation.pptx
PPT 4 Educo's Final Evaluation.pptxPPT 4 Educo's Final Evaluation.pptx
PPT 4 Educo's Final Evaluation.pptx
 
256-gamification
256-gamification256-gamification
256-gamification
 
Methods Of Data Collection
Methods Of Data CollectionMethods Of Data Collection
Methods Of Data Collection
 
Holder request for proposal
Holder request for proposalHolder request for proposal
Holder request for proposal
 
Taking advantage of openness: understanding the variety of perspectives on op...
Taking advantage of openness: understanding the variety of perspectives on op...Taking advantage of openness: understanding the variety of perspectives on op...
Taking advantage of openness: understanding the variety of perspectives on op...
 
CSI Updates
CSI UpdatesCSI Updates
CSI Updates
 
Methods Of Collecting Data For Nursing Research
Methods Of Collecting Data For Nursing ResearchMethods Of Collecting Data For Nursing Research
Methods Of Collecting Data For Nursing Research
 
Instruments for measuring public satisfaction with the education
Instruments for measuring public satisfaction with the educationInstruments for measuring public satisfaction with the education
Instruments for measuring public satisfaction with the education
 
Development of an Electronic Decision Support tool to optimize performance du...
Development of an Electronic Decision Support tool to optimize performance du...Development of an Electronic Decision Support tool to optimize performance du...
Development of an Electronic Decision Support tool to optimize performance du...
 
LEARNING MEDIA ASSESSMENT
LEARNING MEDIA ASSESSMENTLEARNING MEDIA ASSESSMENT
LEARNING MEDIA ASSESSMENT
 
Literature Review on
Literature Review onLiterature Review on
Literature Review on
 
programme evaluation by priyadarshinee pradhan
programme evaluation by priyadarshinee pradhanprogramme evaluation by priyadarshinee pradhan
programme evaluation by priyadarshinee pradhan
 
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptx
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptxONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptx
ONLIN-E-Orientation-on_SGC-Functionality-Assessment-tool_.pptx
 
MET_Gathering_Feedback_Practioner_Brief
MET_Gathering_Feedback_Practioner_BriefMET_Gathering_Feedback_Practioner_Brief
MET_Gathering_Feedback_Practioner_Brief
 

Kürzlich hochgeladen

How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxPurva Nikam
 
How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17Celine George
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlDr. Bruce A. Johnson
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustVani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustSavipriya Raghavendra
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Dr. Asif Anas
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17Celine George
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxraviapr7
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...M56BOOKSTORE PRODUCT/SERVICE
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxheathfieldcps1
 
Protein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxProtein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxvidhisharma994099
 

Kürzlich hochgeladen (20)

How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptx
 
How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 
EBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting BlEBUS5423 Data Analytics and Reporting Bl
EBUS5423 Data Analytics and Reporting Bl
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational TrustVani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
Vani Magazine - Quarterly Magazine of Seshadripuram Educational Trust
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptx
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Finals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quizFinals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quiz
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptx
 
Protein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptxProtein Structure - threading Protein modelling pptx
Protein Structure - threading Protein modelling pptx
 

Survey Instrument Validity - OER Project

  • 1. Survey Instrument Validity OERdifferentiation.com ROER4D & GO-GN Research - Research Track (Aspen) – 10:30 - Thursday, 23 April 2015 Dutra, Judith, and Daryono George (statistics support) Banff - April - 2015 OER4D project
  • 2. Survey Instrument Validity Validation of a survey instrument to understand the current users and potential user of Open Education Resources (OER) in Global South  Although we observe a growth of OER in Global South, we have identified a concern with its use, especially in comparison with the Global North. The difference between Global North and Global South education may arise through a combination of several cultural, demographic, socioeconomic, and political factors.  Recognition of OER differences as a big issue, may lead scholars, policy makers, and the public to understand the potential of the OER to improve everyday life for those on the margins of society and to achieve greater social equity and empowerment.  Our purpose is to develop and validate an instrument to understand the current and potential users of Open Education Resources (OER) in Post- secondary Education in the Global South.
  • 3. The process of development of the instrument consists of the following six steps: 1- Defining the construct 2 – Item development and judgment 3 – Designing the survey 5 – Data collection4 – Pilot study5 - Wrap-up
  • 4. Step one: Defining the construct  Review of the literature was centered on what influences the current and potential users of OER.  The four constructs emerged from the literature:  Individual characteristics,  Education institution characteristics,  OER proficiency (Creation, Use, Modify, Remix, and Share)  and perceived outcomes of OER.
  • 5. Step two – Item development and judgment  The item development process had each construct with several questions derived from the literature ,previous OER surveys, and question harmonisation process done by ROER4D group.  Upon completion of the item development process, we recruited a set of 34 experts to assess the instrument’s content and face validity. We scaled all questions within each of the two main constructs using 5-level Likert scale. Majority (75.5%) of members of the experts group have 6 or more years of education experience, 53% have distance education experience, and at least of 31 years old.  The selection of qualified experts is an important part of the instrument process to determine the appropriate number of questions to fully explore each construct. This avoids research bias on selecting item development.  The expert group also provided comments and feedback regarding each question. We instructed the experts to determine to what extent do the items represented the constructs using a 5-point Likert scale.  Only the most collectively agreed items and/or with literature support were included in the next version of the instrument.
  • 6. Step three: Designing and conducting studies to develop a survey  After securing face and content validity, the instrument contained 26/30 questions on student/instructor version. The final instrument is hosted on SurveyMonkey server and was ready for use in English, Spanish, Bahasa (Indonesia) and Portuguese language. The hard copy option was available for several countries.  We designed the format of the survey, so participants could edit their own survey responses or finish it later in case of internet connection loss.  Additional information to support the results will be collected using interviews and secondary data by Local Coordinators (LC).
  • 7. Step four: Pilot study  The main idea is to identify errors in a survey’s form and presentations. It allows us to redesign some problems before it is used.  After the pilot test, the 78 respondents provided consistent suggestions to improve the instrument. One major suggestions was adopted: Use Education Resources (ER) instead of OER and then ask for the use of the license. Without a clear understanding of OER by the respondents, no conclusion can be made for OER.  The improvements were made, and additional pilot test (second) was done with minor revisions.  Time to complete the survey was also collected by the instrument server.
  • 8. Step five: Data collection Plan  Education Institution in each region. The selected nine countries are Brazil, Chile, Colombia, Ghana, South Africa, Kenya, India, Indonesia, and Malaysia. There is a region coordinator for each region responsible of three countries with four LC each. Each LC is in charge to collect the data from one education institution. Each LC will collect 210 completed surveys. The total number of completed questionnaire will be around 7,560. A random sample will used where every eligible student or instructor should have an equal, non zero chance of being included (Threats to Internal validity).  After ethical clearance, the LC has to follow the data collection plan with random collection. Initially, he/she sent the list of all classes within their campus to the global coordinator. The global coordinator will return do the LC a random ordered list of 30 classes to be surveyed. From that list, the LC would select only 10 classes with 30 or more students and permission to survey the students granted by the instructor. The LC should send the list of all students, from each of the 10 classes selected, to the Global coordinator. The Global coordinator, with support from the statistician, sends to LC a list of 30 ordered random list of students. Only 20 students should be surveyed for each class using online server or hard copy. All the instructors from the 10 selected class, should also be surveyed.  To support the discussion on the results, a special survey with open-nded questions about the institution were designed to be responded by the local coordinator.  Surveymonkey , skype (gotomeeting), and Basecamp were used to manage the project with 39 collaborators around the world.
  • 9. Step Six: Finalizing a survey  We plan to use EFA - Exploratory Factor analysis – and assess survey reliability to validate the instrument after the data collection in order to improve the instrument validity. We expect that this instrument may be used by the OER community.  The process of developing and validating an instrument proposed may enhance the quality of information derived from the data collected and help to improve the education in Global South and reduce the difference between Global North and Global South education.  All the finding will be available online with open license after the end of the project in November 2015. An online data extraction tool will also be available.
  • 11. Thank you Judith, Daryono, and Dutra (dutra@usp.br) August 2014