SlideShare ist ein Scribd-Unternehmen logo
1 von 26
Downloaden Sie, um offline zu lesen
Quantitative Research Methodologies (2/6):
Research Design and Validity
Prof. Dr. Hora Tjitra & Dr. He Quan
www.SinauOnline.com
2
Research Team
Research Program: Complex
Problem Solving (CPS)
Hora Tjitra, HE Quan, LIU
Manxia, SHI Wei, ZHANG Qi, YU
Zhaoyang, WANG Huiqi
Project Team Leader
Complex Problem Solving Research project
Project Team Member
The Police Bureau, Huzhou
Project Team Member
Zhongcai Group, Hangzhou
Phd. Candidate, Zhejiang University
Industry and Organization Psychology
Bachelor Degree, Zhejiang University
Industry and Organization Psychology
3
Complex Problem Solving Stories
Economy
Environment
Technology
Education
Improve The
Well Being Of
Citizens in
One Nation
Politics
Social
The Moral Issue aroused by the
Biological Technology
Overexploiting The Underground
Water in Beijing City
4
CPS Theoretical Framework
CPS Research Design
Observation System
• Group Interaction
• Decision Making Process
Syntex System Data
• Corporate Results
• Group Knowledge
• Group Decisions
Questionnaire
• Quantitative Data
Interview Coaching
• Group Reflection
SYNTEX
• Computer Business Simulation
• Managing Complex Situations
Multi-Methods
Approach
AmericaChina IndonesiaGermany France Japan
Cross-Cultural
Perspective
6
Background Information and Experimental Process
Participants
Make decisions by themselves for company
every month, for example the products order
and the material purchasing.
The Task
3-persons cooperate, 54 persons divided in 18
groups, the students coming from Zhejiang
University
Program
Display
7
Product
Quality
The system structure behind Syntex business simulation
Material
Storage
Purchasing
Materials
Employee
Satisfaction
Market
Demand
HR
Performance
Product
Storage
Advertisement
Salary
Pricing Policy
Production
Order
Recruitment Social
Fund
Product
Manufacture
Product Sales Company
Income
Season /
Weather
Competitor
Price / Quality
Purchasing
+
-
- -
+
+
+
+
+
+
+
+
+
Employee
Number
Oval represents the control variable, rectangle: system variable,
‘+’means active influence,’ –’mean negative influence .
Company
Assets
Maintenance
Machine /
Diesel
Leadership
HR
Work Load
Lay-off
Exchange
Resign
+
-
+
-
+
+
+
-
Number and
Assortment
Sale
PriorityMan.
Priority
and
• Bank Account
• Material Storage
• Product Storage
• Machine, Diesel
8
The differences between “best” and “worst” groups
The Performance=100*[2*Z(capital)+Z(number)+Z(satisfaction)]/4
Sorting the groups by score, selecting higher 8 groups as best groups, lower 8 groups as worst groups. ( t(14)=4.34, p=.001 )
Z=0Normal Distribution
The change of capital during 12 months:
Better groups can increase the capital
The size of the company : better groups hire
more people than worse
The change of employees’ satisfaction: both groups
can’t manage very well, worse groups are worse
9
Information and Decision Making Difference
Best groupsBest groups Worst groupsWorst groups
Variables M SD M SD
Number of questions, total 124 29.76 123 20.71
Number of decisions, total 55 11.01 61 13.63
MANOVA( Repeated
Measure)
Information Decision
Condition F(1/14)=.00 p=.95 F(1/14)=1.02 p=.33
Month F(5.69/79.72)=7.06 p=.00 F(8.51/69.18)=3.67 p=.00
Interaction F(5.69/79.72)=1.31 p=.26 F(8.51/69.18)=1.29 p=.25
10
The Analyzing Perspectives from the Data
AmericaChina IndonesiaGermany France Japan
3.Cross-Cultural Perspective
1.CPS Process Perspective
How do groups explore and manage the system?
What is the difference between the best and worst groups in cognitive
perspectives
2.Group Interaction
Perspective
How do group member discuss and inquire the information?
How do group member support each other?
11
Variables Used in Experimentation
Dependent
Variable
Independent
Variable
Variable
…One of the antecedent conditions
manipulated by the experimenter
…The response of the organism; the variable
that measures the influence the independent
variable
…Any characteristic or phenomenon that can vary
across organisms, situations, or environments
12
Three Main Research Designs
Using Experimental Approach
A design in which the influence of extraneous variables is
controlled for while the influence of the independent variable is
tested
Research design: The outline, plan, or strategy used to investigate the research problem
A research design in which an experimental procedure is applied
but all extraneous variables are not controlled
Experimental
design
Quasi-
Experimental
design
Single-case
design
A research design in which a single groups of individuals is used
to investigate the influence of a treatment condition
13
Experimental Design
• the experimental and the control groups‘
posttest scores are compared to assess
the influence of the treatment condition
X
Y2
Y1
treatment measure
Posttest only design Pretest-posttest design
• the treatment effect is assesses by the
difference between the experimental and
control groups‘ pre- and posttest scores
X
Y2
Y1
treatment measurePremeasure
Y
Y
14
Quasi-Experimental Design
Nonequivalent comparison
group design
Interrupted time-series
design
• The results obtained from nonequivalent
experimental and control groups are
compared
Premeasure treatment measure
Y
Y
X Y1
Y2
• A treatment effect is assessed by
comparing the pattern of pre- and posttest
scores of one group of research
participants
X Y
treatment measurePremeasure
Y Y Y
15
Basic Types of Designs for Case Studies
CONTEXT
Case
CONTEXT
Case
CONTEXT
Case
CONTEXT
Case
CONTEXT
Case
single-case designs multiple-case designs
holistic
(single-
unit of
analysis)
CONTEXT
Case
Embedded
Unit of
Analysis 1
Embedded
Unit of
Analysis 1
CONTEXT
Case
CONTEXT
Case
CONTEXT
Case
CONTEXT
Case
embedded
(multiple
units of
analysis)
SOURCE: COSMOS Corporation
16
Research Validity
... the best available approximation to the truth or falsity of
propositions, incl. propositions about cause
1. Is there a relationship between two variables ?
2. Given that there is a relationship, is it plausibly causal from one operational
variables to the other or would the same relationship have been obtained in the
absence of any treatments of any kind ?
3. Given that the relationship is plausibly causal and is reasonably known to be
from one variable to another, what are the particular cause and effect constructs
involved in the relationship ?
4. Given that there probably a causal relationship from construct A to construct B,
how generalizable is this relationship across persons, settings, and times ?
17
Four Types of Validities
... Validity of the inference made about whether the
independent and dependent variables co-vary
... Validity of the inference that independent and
dependent variables are causally related
... Validity of the inference about the higher-order
constructs from the operations used to represent
them
... Validity of the inference about whether the causal
relationship holds over people, setting, treatment
variable, measurement variables, and time
Statistical Conclusion
Validity
Internal Validity
Construct Validity
External Validity
18
Internal Validity
... a relationship between two variables is causal or that the absence of a relationship implies
the absence of cause.
A
Causes / Treatments /
Independent Variables
B
Effects / Outcomes /
Dependent Variables
C2
Comparison / Experimental /
Control Units
C1
Extraneous Forces /
Controlled Setting
1. Is there a relationship between A & B ?
2. Is there a causal relationship from A to B ?
3. Is there any other reason that could
also caused B apart from A ?
19
Internal Validity - Threats
... Validity with which statements can be made about whether there is a causal relationship from
one variable to another in the form in which the variables were manipulated or measured.
• History
... an event which takes place between the
pretest and posttest.
• Maturation
... the respondent‘s growing older, wiser,
stronger, more experienced, and the like
between the pretest and posttest.
• Instrumentation
... a change in the measuring instruments
(e.g. observer learning effects)
• Testing
... Changes in person’s score on the
second administration of a test as a result
of previously having taken the test
... is a threat when an observed effect might be due to ...
• Regression artifact
... The tendency for extreme scores to
become less extreme on a second
assessment
• Attrition
... Some people do not show up for the
study or do not complete it
• Selection
... The choice of participants for the
various treatment groups is based on
different criteria
• Additive and interactive effects
... The combined effect of several threats
to internal validity
20
... the approximate validity with which we can make generalizations about high-order
constructs from research operations.
Construct Validity of Causes and Effects
A
Independent Variables
B
Effects / Outcomes /
Dependent Variables
Causes / Treatments
C2A
Independent Variables
C2B
Effects / Outcomes /
Dependent Variables
Manipulated Group 1
Control Group
C3A
Independent Variables
C3B
Effects / Outcomes /
Dependent Variables
Placebo
Manipulated Group 2
21
Construct Validity - Threats
• Inadequate Preoperational Explication of Constructs
…the choice of operations should depend on the result of a conceptual analysis of the
essential features of a construct (e.g. Aggression).
• Mono-Operation/ Method Bias
…many experiments are designed to have only one exemplar of a particular possible
cause, and some have just one measure to represent each of the possible effect
constructs.
• Reactive Self-report Changes
... it is possible that the treatments effects are due to the respondents being willing to
present themselves to experimenters in ways that would lead to favorable evaluation.
• Experimenter Effects
... which indicates that experimenter‘s attitudes/expectancies can bias the data obtained.
• Treatment Diffusion
…individuals in one treatment group receive some or all of another group’s treatment
• Restricted Generalizability Across Constructs
…sometimes treatments will affect dependent variables quiet differently, implying a positive
effect on some construct and an unintended negative effect on another
22
... the presumed causal relationship can be generalized to and across alternate measures of the
cause and effect and across different types of persons, settings, and times. (1)
External Validity
... the approximate validity with which conclusions are drawn about the generalizability of a
causal relationship to and across populations of persons, settings, and times. (2)
1. Definition of the Target Populations
(persons, settings, or times)
2. Samples to Represent
These Populations
Types of Samples / Populations:
1. Target Populations
2. Formally Representative samples
that correspondent to known
populations
3. Sample Actually Achieved (in Field
Research)
4. Achieved Populations
23
The categories of the external validity
... The extent to which the results of a study can be
generalized to the larger population
Population Validity
... The extent to which the results of a study can be
generalized across settings or environmental conditions
Ecological Validity
... The extent to which the results of a study can be
generalized to the larger population
Temporal Validity
... The generallizability of results across different but related
dependent variables
Outcome Validity
Treatment Variation
Validity
... The generalizability of results across variation of the
treatment
24
External Validity - Threats
• Interaction of Selection and Treatment
In which categories of persons can a cause effect relationship be generalized?
• Interactions of Setting and Treatment
Can a causal relationship obtained in a factory be obtained in a military camp or an
university campus?
• Interaction of History and Treatment
To which period in the past and future can a particular causal relationship be
generalized?
25
The literatures
Altschuler, L., Sussman,N.M., & Kachur, E. (2003). Assessing changes
in intercultural sensitivity among physician trainees using the
intercultural development inventory. International Journal of
Intercultural Relations, 27(4), 387–401.
Leclerc, D., & Martin, J.N. (2004).Tour guide communication
competence: French, German and American tourists'
perceptions. International Journal of Intercultural Relations(4),
28,181-200.
Palthe, J. (2004).The relative importance of antecedents to
cross-cultural adjustment: implications for managing a global
workforce. International Journal of Intercultural Relations, 28(1), 37-59.
Strohschneider, S., & Guess, D. (1999). The Fate of the Moros: A
Cross-cultural Exploration of Strategies in Complex and
Dynamic Decision Making. International Journal of Psychology,34(4),
235-252
@ Tjitra,2010
Thanks You
Any comments & questions
are welcome
Contact me at hora_t@sianuonline.com
26
www.SinauOnline.com

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Variables
VariablesVariables
Variables
 
Variables in research
Variables in researchVariables in research
Variables in research
 
Pilot study
Pilot studyPilot study
Pilot study
 
Hypotheses
HypothesesHypotheses
Hypotheses
 
Pilot study
Pilot studyPilot study
Pilot study
 
EXPERIMENTAL RESEARCH DESIGN
EXPERIMENTAL RESEARCH DESIGNEXPERIMENTAL RESEARCH DESIGN
EXPERIMENTAL RESEARCH DESIGN
 
Experimental Research Design - Meaning, Characteristics and Classification
Experimental Research Design - Meaning, Characteristics and ClassificationExperimental Research Design - Meaning, Characteristics and Classification
Experimental Research Design - Meaning, Characteristics and Classification
 
Quasi Experimental Method
Quasi Experimental MethodQuasi Experimental Method
Quasi Experimental Method
 
Pilot study
Pilot studyPilot study
Pilot study
 
Non experimental design
Non experimental designNon experimental design
Non experimental design
 
Validity & reliability seminar
Validity & reliability seminarValidity & reliability seminar
Validity & reliability seminar
 
Experimental research design
Experimental research designExperimental research design
Experimental research design
 
Descriptive research
Descriptive researchDescriptive research
Descriptive research
 
Variable
VariableVariable
Variable
 
Validity & reliability
Validity & reliabilityValidity & reliability
Validity & reliability
 
Pilot study-research
Pilot study-researchPilot study-research
Pilot study-research
 
Experimental Design
Experimental DesignExperimental Design
Experimental Design
 
Reliability
ReliabilityReliability
Reliability
 
RESEARCH POPULATION
RESEARCH POPULATIONRESEARCH POPULATION
RESEARCH POPULATION
 
Experimental research design
Experimental research designExperimental research design
Experimental research design
 

Andere mochten auch

Threats to internal and external validity
Threats to internal and external validityThreats to internal and external validity
Threats to internal and external validityrodsazon
 
Quantitative Research: Surveys and Experiments
Quantitative Research: Surveys and ExperimentsQuantitative Research: Surveys and Experiments
Quantitative Research: Surveys and ExperimentsMartin Kretzer
 
18 experimental and quasi-experimental research
18   experimental and quasi-experimental research18   experimental and quasi-experimental research
18 experimental and quasi-experimental researchmissbinarystar
 
Validity and reliability of questionnaires
Validity and reliability of questionnairesValidity and reliability of questionnaires
Validity and reliability of questionnairesVenkitachalam R
 
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...Hora Tjitra
 
Excellence through Culture, Talent and Change: Introduction to our Services
Excellence through Culture, Talent and Change: Introduction to our ServicesExcellence through Culture, Talent and Change: Introduction to our Services
Excellence through Culture, Talent and Change: Introduction to our ServicesHora Tjitra
 
Experimental
ExperimentalExperimental
Experimentalwawaaa789
 
평가도구의 질 판단기준(타당도)
평가도구의 질 판단기준(타당도)평가도구의 질 판단기준(타당도)
평가도구의 질 판단기준(타당도)Chae2
 
Measurement and Reliability Test (updated in March 2011)
Measurement and Reliability Test (updated in March 2011)Measurement and Reliability Test (updated in March 2011)
Measurement and Reliability Test (updated in March 2011)Hora Tjitra
 
Quantitative designs
Quantitative designsQuantitative designs
Quantitative designsCarla Piper
 
3.4 types of validity
3.4 types of validity3.4 types of validity
3.4 types of validityA M
 
Experimentalresearch[1]
Experimentalresearch[1]Experimentalresearch[1]
Experimentalresearch[1]annedalonzo
 
Research Method for Business chapter 4
Research Method for Business chapter 4Research Method for Business chapter 4
Research Method for Business chapter 4Mazhar Poohlah
 
Advanced Biostatistics - Simplified
Advanced Biostatistics - SimplifiedAdvanced Biostatistics - Simplified
Advanced Biostatistics - SimplifiedMohammed Alhefzi
 
Experiments
ExperimentsExperiments
ExperimentsTha UOey
 
Grp presentation chap 13
Grp presentation chap 13Grp presentation chap 13
Grp presentation chap 13Azura Zaki
 
Experimental Design
Experimental DesignExperimental Design
Experimental Designcoachsmb05
 
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)Hora Tjitra
 

Andere mochten auch (20)

Threats to internal and external validity
Threats to internal and external validityThreats to internal and external validity
Threats to internal and external validity
 
Quantitative Research: Surveys and Experiments
Quantitative Research: Surveys and ExperimentsQuantitative Research: Surveys and Experiments
Quantitative Research: Surveys and Experiments
 
18 experimental and quasi-experimental research
18   experimental and quasi-experimental research18   experimental and quasi-experimental research
18 experimental and quasi-experimental research
 
Validity and reliability of questionnaires
Validity and reliability of questionnairesValidity and reliability of questionnaires
Validity and reliability of questionnaires
 
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...
Intercultural Competence - The 10th Biennial Conference of AASP | Tjitra 2013...
 
Excellence through Culture, Talent and Change: Introduction to our Services
Excellence through Culture, Talent and Change: Introduction to our ServicesExcellence through Culture, Talent and Change: Introduction to our Services
Excellence through Culture, Talent and Change: Introduction to our Services
 
Experimental
ExperimentalExperimental
Experimental
 
평가도구의 질 판단기준(타당도)
평가도구의 질 판단기준(타당도)평가도구의 질 판단기준(타당도)
평가도구의 질 판단기준(타당도)
 
Measurement and Reliability Test (updated in March 2011)
Measurement and Reliability Test (updated in March 2011)Measurement and Reliability Test (updated in March 2011)
Measurement and Reliability Test (updated in March 2011)
 
Quantitative designs
Quantitative designsQuantitative designs
Quantitative designs
 
3.4 types of validity
3.4 types of validity3.4 types of validity
3.4 types of validity
 
Experimentalresearch[1]
Experimentalresearch[1]Experimentalresearch[1]
Experimentalresearch[1]
 
Research Method for Business chapter 4
Research Method for Business chapter 4Research Method for Business chapter 4
Research Method for Business chapter 4
 
Advanced Biostatistics - Simplified
Advanced Biostatistics - SimplifiedAdvanced Biostatistics - Simplified
Advanced Biostatistics - Simplified
 
Experiments
ExperimentsExperiments
Experiments
 
Grp presentation chap 13
Grp presentation chap 13Grp presentation chap 13
Grp presentation chap 13
 
Prof. dr. Rolf Fasting
Prof. dr. Rolf Fasting Prof. dr. Rolf Fasting
Prof. dr. Rolf Fasting
 
Experimental Design
Experimental DesignExperimental Design
Experimental Design
 
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)
Best Practices in 
Quantitative Cross-Cultural Research (updated in March 2011)
 
HR Analytics & HR Tools 02
HR Analytics & HR Tools 02HR Analytics & HR Tools 02
HR Analytics & HR Tools 02
 

Ähnlich wie Research Design and Validity

PPWNov13- Day 2 keynote- S.Sridharan- U Toronto
PPWNov13- Day 2 keynote- S.Sridharan- U TorontoPPWNov13- Day 2 keynote- S.Sridharan- U Toronto
PPWNov13- Day 2 keynote- S.Sridharan- U TorontoAg4HealthNutrition
 
Quantitative methodology part two.compressed 2
Quantitative methodology part two.compressed 2Quantitative methodology part two.compressed 2
Quantitative methodology part two.compressed 2Maria Sanchez
 
Identifying Salient Factors That Affected CRM Process At...
Identifying Salient Factors That Affected CRM Process At...Identifying Salient Factors That Affected CRM Process At...
Identifying Salient Factors That Affected CRM Process At...Tracy Huang
 
The correlation between a companys advertising independent variabl.pdf
The correlation between a companys advertising independent variabl.pdfThe correlation between a companys advertising independent variabl.pdf
The correlation between a companys advertising independent variabl.pdffootstatus
 
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxRunning Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxtoltonkendal
 
Evaluating Revalidation: Lessons from the Evaluation of Complex Interventions
Evaluating Revalidation: Lessons from  the Evaluation of Complex Interventions  Evaluating Revalidation: Lessons from  the Evaluation of Complex Interventions
Evaluating Revalidation: Lessons from the Evaluation of Complex Interventions IAMRAreval2015
 
1_Q2-PRACTICAL-RESEARCH.pptx
1_Q2-PRACTICAL-RESEARCH.pptx1_Q2-PRACTICAL-RESEARCH.pptx
1_Q2-PRACTICAL-RESEARCH.pptxGeraldRefil3
 
Thesis Defense - Tommy May
Thesis Defense - Tommy MayThesis Defense - Tommy May
Thesis Defense - Tommy MayTommy May
 
Optimization Of Processing Parameters By Using Taguchi Method
Optimization Of Processing Parameters By Using Taguchi MethodOptimization Of Processing Parameters By Using Taguchi Method
Optimization Of Processing Parameters By Using Taguchi MethodJulie Gonzalez
 
Implicit Stereotyping And Evaluation
Implicit Stereotyping And EvaluationImplicit Stereotyping And Evaluation
Implicit Stereotyping And EvaluationChristina Valadez
 
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docxfelicidaddinwoodie
 
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventKey Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventMEASURE Evaluation
 
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptxJessaMaeGastar1
 
Marketing Experimentation - Part I
Marketing Experimentation - Part IMarketing Experimentation - Part I
Marketing Experimentation - Part IMinha Hwang
 
Experimental Research (GROUP 2)
Experimental Research (GROUP 2)Experimental Research (GROUP 2)
Experimental Research (GROUP 2)ekinrashid
 
Experimental research
Experimental researchExperimental research
Experimental researchdabneyluang
 
Experimental research
Experimental researchExperimental research
Experimental researchizzajalil
 

Ähnlich wie Research Design and Validity (20)

Presentation development impact analysis
Presentation   development impact analysisPresentation   development impact analysis
Presentation development impact analysis
 
PPWNov13- Day 2 keynote- S.Sridharan- U Toronto
PPWNov13- Day 2 keynote- S.Sridharan- U TorontoPPWNov13- Day 2 keynote- S.Sridharan- U Toronto
PPWNov13- Day 2 keynote- S.Sridharan- U Toronto
 
Quantitative methodology part two.compressed 2
Quantitative methodology part two.compressed 2Quantitative methodology part two.compressed 2
Quantitative methodology part two.compressed 2
 
Identifying Salient Factors That Affected CRM Process At...
Identifying Salient Factors That Affected CRM Process At...Identifying Salient Factors That Affected CRM Process At...
Identifying Salient Factors That Affected CRM Process At...
 
The correlation between a companys advertising independent variabl.pdf
The correlation between a companys advertising independent variabl.pdfThe correlation between a companys advertising independent variabl.pdf
The correlation between a companys advertising independent variabl.pdf
 
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docxRunning Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
Running Head REPLY TO OPINION 5.1 FOR KIMBRILEE SCHMITZ 1REPLY.docx
 
Evaluating Revalidation: Lessons from the Evaluation of Complex Interventions
Evaluating Revalidation: Lessons from  the Evaluation of Complex Interventions  Evaluating Revalidation: Lessons from  the Evaluation of Complex Interventions
Evaluating Revalidation: Lessons from the Evaluation of Complex Interventions
 
1_Q2-PRACTICAL-RESEARCH.pptx
1_Q2-PRACTICAL-RESEARCH.pptx1_Q2-PRACTICAL-RESEARCH.pptx
1_Q2-PRACTICAL-RESEARCH.pptx
 
Thesis Defense - Tommy May
Thesis Defense - Tommy MayThesis Defense - Tommy May
Thesis Defense - Tommy May
 
Optimization Of Processing Parameters By Using Taguchi Method
Optimization Of Processing Parameters By Using Taguchi MethodOptimization Of Processing Parameters By Using Taguchi Method
Optimization Of Processing Parameters By Using Taguchi Method
 
Implicit Stereotyping And Evaluation
Implicit Stereotyping And EvaluationImplicit Stereotyping And Evaluation
Implicit Stereotyping And Evaluation
 
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx
1PPA 670 Public Policy AnalysisBasic Policy Terms an.docx
 
Research Design new.ppt
Research Design new.pptResearch Design new.ppt
Research Design new.ppt
 
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual EventKey Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
Key Issues in Impact Evaluation: A MEET and GEMNet-Health Virtual Event
 
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
#1 Characteristics, Strengths, Weaknesses, Kinds of.pptx
 
Experimental design
Experimental designExperimental design
Experimental design
 
Marketing Experimentation - Part I
Marketing Experimentation - Part IMarketing Experimentation - Part I
Marketing Experimentation - Part I
 
Experimental Research (GROUP 2)
Experimental Research (GROUP 2)Experimental Research (GROUP 2)
Experimental Research (GROUP 2)
 
Experimental research
Experimental researchExperimental research
Experimental research
 
Experimental research
Experimental researchExperimental research
Experimental research
 

Mehr von Hora Tjitra

GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018
GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018
GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018Hora Tjitra
 
GI Net 13 - Journey of Telkom CorpU | Telkom Indonesia
GI Net 13 - Journey of Telkom CorpU | Telkom IndonesiaGI Net 13 - Journey of Telkom CorpU | Telkom Indonesia
GI Net 13 - Journey of Telkom CorpU | Telkom IndonesiaHora Tjitra
 
GI Net 13 - LTD The Chief Learning Officer | Tjitra
GI Net 13 - LTD  The Chief Learning Officer | TjitraGI Net 13 - LTD  The Chief Learning Officer | Tjitra
GI Net 13 - LTD The Chief Learning Officer | TjitraHora Tjitra
 
Be Global - 5th APIO | Mercu Buana University 20131005
Be Global - 5th APIO | Mercu Buana University 20131005Be Global - 5th APIO | Mercu Buana University 20131005
Be Global - 5th APIO | Mercu Buana University 20131005Hora Tjitra
 
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08Hora Tjitra
 
GI Net 12 - Building Indonesian Global Leaders | Unilever Indonesia
GI Net 12 - Building Indonesian Global Leaders | Unilever IndonesiaGI Net 12 - Building Indonesian Global Leaders | Unilever Indonesia
GI Net 12 - Building Indonesian Global Leaders | Unilever IndonesiaHora Tjitra
 
GI Net 12 - Building Global Indonesian Leaders by Systematic Learning
GI Net 12 - Building Global Indonesian Leaders by Systematic LearningGI Net 12 - Building Global Indonesian Leaders by Systematic Learning
GI Net 12 - Building Global Indonesian Leaders by Systematic LearningHora Tjitra
 
GI Net 11 - The Global Indonesian Surviving The Crisis in Global Talent
GI Net 11 - The Global Indonesian Surviving The Crisis in Global TalentGI Net 11 - The Global Indonesian Surviving The Crisis in Global Talent
GI Net 11 - The Global Indonesian Surviving The Crisis in Global TalentHora Tjitra
 
Komparasi Kepemimpinan Efektif di Dunia Bisnis
Komparasi Kepemimpinan Efektif di Dunia BisnisKomparasi Kepemimpinan Efektif di Dunia Bisnis
Komparasi Kepemimpinan Efektif di Dunia BisnisHora Tjitra
 
GI Net 10 - Ensuring Sustainability in Organizational Transformation
GI Net 10 - Ensuring Sustainability in Organizational TransformationGI Net 10 - Ensuring Sustainability in Organizational Transformation
GI Net 10 - Ensuring Sustainability in Organizational TransformationHora Tjitra
 
GI Net 10 - Business Roles in Sustainable Development
GI Net 10 - Business Roles in Sustainable DevelopmentGI Net 10 - Business Roles in Sustainable Development
GI Net 10 - Business Roles in Sustainable DevelopmentHora Tjitra
 
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013 Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013 Hora Tjitra
 
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013Hora Tjitra
 
GI Net 9 - Servant Leadership Leading With Heart
GI Net 9 - Servant Leadership Leading With HeartGI Net 9 - Servant Leadership Leading With Heart
GI Net 9 - Servant Leadership Leading With HeartHora Tjitra
 
Flyer Master of Psychology Atma Jaya Catholic University of Indonesia
Flyer Master of Psychology Atma Jaya Catholic University of IndonesiaFlyer Master of Psychology Atma Jaya Catholic University of Indonesia
Flyer Master of Psychology Atma Jaya Catholic University of IndonesiaHora Tjitra
 
Artikel Majalah Quality Januari 2013
Artikel Majalah Quality Januari 2013Artikel Majalah Quality Januari 2013
Artikel Majalah Quality Januari 2013Hora Tjitra
 
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"Hora Tjitra
 
GI Net 7 - Global mind, local act: The art of change leadership
GI Net 7 - Global mind, local act: The art of change leadershipGI Net 7 - Global mind, local act: The art of change leadership
GI Net 7 - Global mind, local act: The art of change leadershipHora Tjitra
 
201210 HC Magazine: HR & Social Media (Portal HR)
201210 HC Magazine: HR & Social Media (Portal HR)201210 HC Magazine: HR & Social Media (Portal HR)
201210 HC Magazine: HR & Social Media (Portal HR)Hora Tjitra
 
Global Indonesian Network (GI-Net): Introduction
Global Indonesian Network (GI-Net): IntroductionGlobal Indonesian Network (GI-Net): Introduction
Global Indonesian Network (GI-Net): IntroductionHora Tjitra
 

Mehr von Hora Tjitra (20)

GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018
GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018
GI Net Invitation - Be Global: Local Wisdom, Global Excellence, July 17th, 2018
 
GI Net 13 - Journey of Telkom CorpU | Telkom Indonesia
GI Net 13 - Journey of Telkom CorpU | Telkom IndonesiaGI Net 13 - Journey of Telkom CorpU | Telkom Indonesia
GI Net 13 - Journey of Telkom CorpU | Telkom Indonesia
 
GI Net 13 - LTD The Chief Learning Officer | Tjitra
GI Net 13 - LTD  The Chief Learning Officer | TjitraGI Net 13 - LTD  The Chief Learning Officer | Tjitra
GI Net 13 - LTD The Chief Learning Officer | Tjitra
 
Be Global - 5th APIO | Mercu Buana University 20131005
Be Global - 5th APIO | Mercu Buana University 20131005Be Global - 5th APIO | Mercu Buana University 20131005
Be Global - 5th APIO | Mercu Buana University 20131005
 
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08
Asian Leadership Across Borders - SAPIC 2013 UAD | Tjitra 2013.08
 
GI Net 12 - Building Indonesian Global Leaders | Unilever Indonesia
GI Net 12 - Building Indonesian Global Leaders | Unilever IndonesiaGI Net 12 - Building Indonesian Global Leaders | Unilever Indonesia
GI Net 12 - Building Indonesian Global Leaders | Unilever Indonesia
 
GI Net 12 - Building Global Indonesian Leaders by Systematic Learning
GI Net 12 - Building Global Indonesian Leaders by Systematic LearningGI Net 12 - Building Global Indonesian Leaders by Systematic Learning
GI Net 12 - Building Global Indonesian Leaders by Systematic Learning
 
GI Net 11 - The Global Indonesian Surviving The Crisis in Global Talent
GI Net 11 - The Global Indonesian Surviving The Crisis in Global TalentGI Net 11 - The Global Indonesian Surviving The Crisis in Global Talent
GI Net 11 - The Global Indonesian Surviving The Crisis in Global Talent
 
Komparasi Kepemimpinan Efektif di Dunia Bisnis
Komparasi Kepemimpinan Efektif di Dunia BisnisKomparasi Kepemimpinan Efektif di Dunia Bisnis
Komparasi Kepemimpinan Efektif di Dunia Bisnis
 
GI Net 10 - Ensuring Sustainability in Organizational Transformation
GI Net 10 - Ensuring Sustainability in Organizational TransformationGI Net 10 - Ensuring Sustainability in Organizational Transformation
GI Net 10 - Ensuring Sustainability in Organizational Transformation
 
GI Net 10 - Business Roles in Sustainable Development
GI Net 10 - Business Roles in Sustainable DevelopmentGI Net 10 - Business Roles in Sustainable Development
GI Net 10 - Business Roles in Sustainable Development
 
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013 Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013
Indonesia the Next Great Exporter of Leadership Talent?, HQ Asia Issue 5/ 2013
 
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013
Peran Pelatihan dalam Organisasi, HC Magazine Jan-Feb 2013
 
GI Net 9 - Servant Leadership Leading With Heart
GI Net 9 - Servant Leadership Leading With HeartGI Net 9 - Servant Leadership Leading With Heart
GI Net 9 - Servant Leadership Leading With Heart
 
Flyer Master of Psychology Atma Jaya Catholic University of Indonesia
Flyer Master of Psychology Atma Jaya Catholic University of IndonesiaFlyer Master of Psychology Atma Jaya Catholic University of Indonesia
Flyer Master of Psychology Atma Jaya Catholic University of Indonesia
 
Artikel Majalah Quality Januari 2013
Artikel Majalah Quality Januari 2013Artikel Majalah Quality Januari 2013
Artikel Majalah Quality Januari 2013
 
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"
Suara Pembaruan: "Kepemimpinan Etis dalam Perubahan"
 
GI Net 7 - Global mind, local act: The art of change leadership
GI Net 7 - Global mind, local act: The art of change leadershipGI Net 7 - Global mind, local act: The art of change leadership
GI Net 7 - Global mind, local act: The art of change leadership
 
201210 HC Magazine: HR & Social Media (Portal HR)
201210 HC Magazine: HR & Social Media (Portal HR)201210 HC Magazine: HR & Social Media (Portal HR)
201210 HC Magazine: HR & Social Media (Portal HR)
 
Global Indonesian Network (GI-Net): Introduction
Global Indonesian Network (GI-Net): IntroductionGlobal Indonesian Network (GI-Net): Introduction
Global Indonesian Network (GI-Net): Introduction
 

Kürzlich hochgeladen

Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.raviapr7
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptxSandy Millin
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...Nguyen Thanh Tu Collection
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationMJDuyan
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRATanmoy Mishra
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxMYDA ANGELICA SUAN
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and stepobaje godwin sunday
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17Celine George
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxKatherine Villaluna
 

Kürzlich hochgeladen (20)

Personal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdfPersonal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdf
 
Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive Education
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptx
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and step
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptx
 

Research Design and Validity

  • 1. Quantitative Research Methodologies (2/6): Research Design and Validity Prof. Dr. Hora Tjitra & Dr. He Quan www.SinauOnline.com
  • 2. 2 Research Team Research Program: Complex Problem Solving (CPS) Hora Tjitra, HE Quan, LIU Manxia, SHI Wei, ZHANG Qi, YU Zhaoyang, WANG Huiqi Project Team Leader Complex Problem Solving Research project Project Team Member The Police Bureau, Huzhou Project Team Member Zhongcai Group, Hangzhou Phd. Candidate, Zhejiang University Industry and Organization Psychology Bachelor Degree, Zhejiang University Industry and Organization Psychology
  • 3. 3 Complex Problem Solving Stories Economy Environment Technology Education Improve The Well Being Of Citizens in One Nation Politics Social The Moral Issue aroused by the Biological Technology Overexploiting The Underground Water in Beijing City
  • 5. CPS Research Design Observation System • Group Interaction • Decision Making Process Syntex System Data • Corporate Results • Group Knowledge • Group Decisions Questionnaire • Quantitative Data Interview Coaching • Group Reflection SYNTEX • Computer Business Simulation • Managing Complex Situations Multi-Methods Approach AmericaChina IndonesiaGermany France Japan Cross-Cultural Perspective
  • 6. 6 Background Information and Experimental Process Participants Make decisions by themselves for company every month, for example the products order and the material purchasing. The Task 3-persons cooperate, 54 persons divided in 18 groups, the students coming from Zhejiang University Program Display
  • 7. 7 Product Quality The system structure behind Syntex business simulation Material Storage Purchasing Materials Employee Satisfaction Market Demand HR Performance Product Storage Advertisement Salary Pricing Policy Production Order Recruitment Social Fund Product Manufacture Product Sales Company Income Season / Weather Competitor Price / Quality Purchasing + - - - + + + + + + + + + Employee Number Oval represents the control variable, rectangle: system variable, ‘+’means active influence,’ –’mean negative influence . Company Assets Maintenance Machine / Diesel Leadership HR Work Load Lay-off Exchange Resign + - + - + + + - Number and Assortment Sale PriorityMan. Priority and • Bank Account • Material Storage • Product Storage • Machine, Diesel
  • 8. 8 The differences between “best” and “worst” groups The Performance=100*[2*Z(capital)+Z(number)+Z(satisfaction)]/4 Sorting the groups by score, selecting higher 8 groups as best groups, lower 8 groups as worst groups. ( t(14)=4.34, p=.001 ) Z=0Normal Distribution The change of capital during 12 months: Better groups can increase the capital The size of the company : better groups hire more people than worse The change of employees’ satisfaction: both groups can’t manage very well, worse groups are worse
  • 9. 9 Information and Decision Making Difference Best groupsBest groups Worst groupsWorst groups Variables M SD M SD Number of questions, total 124 29.76 123 20.71 Number of decisions, total 55 11.01 61 13.63 MANOVA( Repeated Measure) Information Decision Condition F(1/14)=.00 p=.95 F(1/14)=1.02 p=.33 Month F(5.69/79.72)=7.06 p=.00 F(8.51/69.18)=3.67 p=.00 Interaction F(5.69/79.72)=1.31 p=.26 F(8.51/69.18)=1.29 p=.25
  • 10. 10 The Analyzing Perspectives from the Data AmericaChina IndonesiaGermany France Japan 3.Cross-Cultural Perspective 1.CPS Process Perspective How do groups explore and manage the system? What is the difference between the best and worst groups in cognitive perspectives 2.Group Interaction Perspective How do group member discuss and inquire the information? How do group member support each other?
  • 11. 11 Variables Used in Experimentation Dependent Variable Independent Variable Variable …One of the antecedent conditions manipulated by the experimenter …The response of the organism; the variable that measures the influence the independent variable …Any characteristic or phenomenon that can vary across organisms, situations, or environments
  • 12. 12 Three Main Research Designs Using Experimental Approach A design in which the influence of extraneous variables is controlled for while the influence of the independent variable is tested Research design: The outline, plan, or strategy used to investigate the research problem A research design in which an experimental procedure is applied but all extraneous variables are not controlled Experimental design Quasi- Experimental design Single-case design A research design in which a single groups of individuals is used to investigate the influence of a treatment condition
  • 13. 13 Experimental Design • the experimental and the control groups‘ posttest scores are compared to assess the influence of the treatment condition X Y2 Y1 treatment measure Posttest only design Pretest-posttest design • the treatment effect is assesses by the difference between the experimental and control groups‘ pre- and posttest scores X Y2 Y1 treatment measurePremeasure Y Y
  • 14. 14 Quasi-Experimental Design Nonequivalent comparison group design Interrupted time-series design • The results obtained from nonequivalent experimental and control groups are compared Premeasure treatment measure Y Y X Y1 Y2 • A treatment effect is assessed by comparing the pattern of pre- and posttest scores of one group of research participants X Y treatment measurePremeasure Y Y Y
  • 15. 15 Basic Types of Designs for Case Studies CONTEXT Case CONTEXT Case CONTEXT Case CONTEXT Case CONTEXT Case single-case designs multiple-case designs holistic (single- unit of analysis) CONTEXT Case Embedded Unit of Analysis 1 Embedded Unit of Analysis 1 CONTEXT Case CONTEXT Case CONTEXT Case CONTEXT Case embedded (multiple units of analysis) SOURCE: COSMOS Corporation
  • 16. 16 Research Validity ... the best available approximation to the truth or falsity of propositions, incl. propositions about cause 1. Is there a relationship between two variables ? 2. Given that there is a relationship, is it plausibly causal from one operational variables to the other or would the same relationship have been obtained in the absence of any treatments of any kind ? 3. Given that the relationship is plausibly causal and is reasonably known to be from one variable to another, what are the particular cause and effect constructs involved in the relationship ? 4. Given that there probably a causal relationship from construct A to construct B, how generalizable is this relationship across persons, settings, and times ?
  • 17. 17 Four Types of Validities ... Validity of the inference made about whether the independent and dependent variables co-vary ... Validity of the inference that independent and dependent variables are causally related ... Validity of the inference about the higher-order constructs from the operations used to represent them ... Validity of the inference about whether the causal relationship holds over people, setting, treatment variable, measurement variables, and time Statistical Conclusion Validity Internal Validity Construct Validity External Validity
  • 18. 18 Internal Validity ... a relationship between two variables is causal or that the absence of a relationship implies the absence of cause. A Causes / Treatments / Independent Variables B Effects / Outcomes / Dependent Variables C2 Comparison / Experimental / Control Units C1 Extraneous Forces / Controlled Setting 1. Is there a relationship between A & B ? 2. Is there a causal relationship from A to B ? 3. Is there any other reason that could also caused B apart from A ?
  • 19. 19 Internal Validity - Threats ... Validity with which statements can be made about whether there is a causal relationship from one variable to another in the form in which the variables were manipulated or measured. • History ... an event which takes place between the pretest and posttest. • Maturation ... the respondent‘s growing older, wiser, stronger, more experienced, and the like between the pretest and posttest. • Instrumentation ... a change in the measuring instruments (e.g. observer learning effects) • Testing ... Changes in person’s score on the second administration of a test as a result of previously having taken the test ... is a threat when an observed effect might be due to ... • Regression artifact ... The tendency for extreme scores to become less extreme on a second assessment • Attrition ... Some people do not show up for the study or do not complete it • Selection ... The choice of participants for the various treatment groups is based on different criteria • Additive and interactive effects ... The combined effect of several threats to internal validity
  • 20. 20 ... the approximate validity with which we can make generalizations about high-order constructs from research operations. Construct Validity of Causes and Effects A Independent Variables B Effects / Outcomes / Dependent Variables Causes / Treatments C2A Independent Variables C2B Effects / Outcomes / Dependent Variables Manipulated Group 1 Control Group C3A Independent Variables C3B Effects / Outcomes / Dependent Variables Placebo Manipulated Group 2
  • 21. 21 Construct Validity - Threats • Inadequate Preoperational Explication of Constructs …the choice of operations should depend on the result of a conceptual analysis of the essential features of a construct (e.g. Aggression). • Mono-Operation/ Method Bias …many experiments are designed to have only one exemplar of a particular possible cause, and some have just one measure to represent each of the possible effect constructs. • Reactive Self-report Changes ... it is possible that the treatments effects are due to the respondents being willing to present themselves to experimenters in ways that would lead to favorable evaluation. • Experimenter Effects ... which indicates that experimenter‘s attitudes/expectancies can bias the data obtained. • Treatment Diffusion …individuals in one treatment group receive some or all of another group’s treatment • Restricted Generalizability Across Constructs …sometimes treatments will affect dependent variables quiet differently, implying a positive effect on some construct and an unintended negative effect on another
  • 22. 22 ... the presumed causal relationship can be generalized to and across alternate measures of the cause and effect and across different types of persons, settings, and times. (1) External Validity ... the approximate validity with which conclusions are drawn about the generalizability of a causal relationship to and across populations of persons, settings, and times. (2) 1. Definition of the Target Populations (persons, settings, or times) 2. Samples to Represent These Populations Types of Samples / Populations: 1. Target Populations 2. Formally Representative samples that correspondent to known populations 3. Sample Actually Achieved (in Field Research) 4. Achieved Populations
  • 23. 23 The categories of the external validity ... The extent to which the results of a study can be generalized to the larger population Population Validity ... The extent to which the results of a study can be generalized across settings or environmental conditions Ecological Validity ... The extent to which the results of a study can be generalized to the larger population Temporal Validity ... The generallizability of results across different but related dependent variables Outcome Validity Treatment Variation Validity ... The generalizability of results across variation of the treatment
  • 24. 24 External Validity - Threats • Interaction of Selection and Treatment In which categories of persons can a cause effect relationship be generalized? • Interactions of Setting and Treatment Can a causal relationship obtained in a factory be obtained in a military camp or an university campus? • Interaction of History and Treatment To which period in the past and future can a particular causal relationship be generalized?
  • 25. 25 The literatures Altschuler, L., Sussman,N.M., & Kachur, E. (2003). Assessing changes in intercultural sensitivity among physician trainees using the intercultural development inventory. International Journal of Intercultural Relations, 27(4), 387–401. Leclerc, D., & Martin, J.N. (2004).Tour guide communication competence: French, German and American tourists' perceptions. International Journal of Intercultural Relations(4), 28,181-200. Palthe, J. (2004).The relative importance of antecedents to cross-cultural adjustment: implications for managing a global workforce. International Journal of Intercultural Relations, 28(1), 37-59. Strohschneider, S., & Guess, D. (1999). The Fate of the Moros: A Cross-cultural Exploration of Strategies in Complex and Dynamic Decision Making. International Journal of Psychology,34(4), 235-252
  • 26. @ Tjitra,2010 Thanks You Any comments & questions are welcome Contact me at hora_t@sianuonline.com 26 www.SinauOnline.com