SlideShare ist ein Scribd-Unternehmen logo
1 von 38
Experimental Design
Data analysis
GROUP 5
PAIRED T-TEST
PRESENTER: TRAN THI NGAN GIANG
Introduction
A paired t-test is used to compare two population means where you have two samples in which
observations in one sample can be paired with observations in the other sample.
For example:
A diagnostic test was made before studying a particular module and then again after completing
the module. We want to find out if, in general, our teaching leads to improvements in students’
knowledge/skills.
First, we see the descriptive statistics for
both variables.




   The post-test mean scores are higher.
Next, we see the correlation between
the two variables.




    There is a strong positive correlation. People who did well on the pre-test
   also did well on the post-test.
Finally, we see the T, degrees of
freedom, and significance.
  Our significance is .053
  If the significance value is less than .05, there
  is a significant difference.
  If the significance value is greater than. 05,
  there is no significant difference.
  Here, we see that the significance value is
  approaching significance, but it is not a
  significant difference. There is no difference
  between pre- and post-test scores. Our test
  preparation course did not help!
INDEPENDENT SAMPLES
T-TESTS
PRESENTER: DINH QUOC MINH DANG
Outline
    1. Introduction
    2. Hypothesis for the independent t-test
    3. What do you need to run an independent t-test?
    4. Formula
    5. Example (Calculating + Reporting)
Introduction
The independent t-test, also called the two sample t-test or
student's t-test is an inferential statistical test that determines
whether there is a statistically significant difference between the
means in two unrelated groups.
Hypothesis for the independent t-test
The null hypothesis for the independent t-test is that the population means from the
two unrelated groups are equal:
H0: u1 = u2
In most cases, we are looking to see if we can show that we can reject the null
hypothesis and accept the alternative hypothesis, which is that the population means
are not equal:
HA: u1 ≠ u2
To do this we need to set a significance level (alpha) that allows us to either reject or
accept the alternative hypothesis. Most commonly, this value is set at 0.05.
What do you need to run an
independent t-test?
In order to run an independent t-test you need the
following:
  1. One independent, categorical variable that has two levels.
  2. One dependent variable
Formula


          M: mean (the average score of the group)
          SD: Standard Deviation
          N: number of scores in each group
          Exp: Experimental Group
          Con: Control Group
Formula
Example
Example
Effect Size
Reporting the Result of an
Independent T-Test
When reporting the result of an independent t-test, you
need to include the t-statistic value, the degrees of freedom
(df) and the significance value of the test (P-value). The
format of the test result is: t(df) = t-statistic, P = significance
value.
Example result (APA Style)
An independent samples T-test is presented the same as the one-sample t-test:
                             t(75) = 2.11, p = .02 (one –tailed), d = .48


           Degrees of
           freedom      Value of
                        statistic                      Include if test is   Effect size if
                                     Significance of   one-tailed           available
                                     statistic


Example: Survey respondents who were employed by the federal, state, or local government
had significantly higher socioeconomic indices (M = 55.42, SD = 19.25) than survey
respondents who were employed by a private employer (M = 47.54, SD = 18.94) , t(255) =
2.363, p = .01 (one-tailed).
Analysis of Variance
(ANOVA)
PRESENTER : MINH SANG
Introduction
We already learned about the chi square test for independence, which is useful for data that is
measured at the nominal or ordinal level of analysis.
If we have data measured at the interval level, we can compare two or more population groups
in terms of their population means using a technique called analysis of variance, or ANOVA.
Completely randomized design
Population 1      Population 2…..       Population k
Mean =   1        Mean =   2    ….      Mean =     k
Variance=     2   Variance=     2   … Variance =        2
             1                 2                       k


 We want to know something about how the populations compare.
Do they have the same mean? We can collect random samples from
each population, which gives us the following data.
Completely randomized design
Mean = M1         Mean = M2    ..…   Mean = Mk
Variance=s12      Variance=s22 ….    Variance = sk2
N1 cases          N2 cases     ….    Nk cases


Suppose we want to compare 3 college majors in a business school
 by the average annual income people make 2 years after graduation.
 We collect the following data (in $1000s) based on random surveys.
Completely randomized design
Accounting   Marketing   Finance
27                  23             48
22                  36             35
33                  27             46
25                  44             36
38                  39             28
29                  32             29
Completely randomized design
Can the dean conclude that there are differences among the major’s incomes?

Ho :   1=   2=   3
HA:    1     2       3


In this problem we must take into account:
1) The variance between samples, or the actual differences by major.
 This is called the sum of squares for treatment (SST).
Completely randomized design
2) The variance within samples, or the variance of incomes within a single major.
 This is called the sum of squares for error (SSE).
Recall that when we sample, there will always be a chance of getting something
 different than the population. We account for this through #2, or the SSE.
F-Statistic
For this test, we will calculate a F statistic, which is used to compare variances.
F = SST/(k-1)
  SSE/(n-k)
SST=sum of squares for treatment
SSE=sum of squares for error
k = the number of populations
N = total sample size
F-statistic
Intuitively, the F statistic is:
F = explained variance
unexplained variance
Explained variance is the difference between majors
Unexplained variance is the difference based on random sampling for each group
(see Figure 10-1, page 327)
Calculating SST
SST = ni(Mi - )2
  = grand mean or =    Mi/k or the sum of all values for all groups divided by
total sample size
Mi = mean for each sample
k= the number of populations
Calculating SST
By major
Accounting        M1=29, n1=6
Marketing         M2=33.5, n2=6
Finance           M3=37, n3=6
  = (29+33.5+37)/3 = 33.17
SST = (6)(29-33.17)2 + (6)(33.5-33.17)2 + (6)(37-33.17)2 = 193
Calculating SST
Note that when M1 = M2 = M3, then SST=0 which would support the null
hypothesis.
In this example, the samples are of equal size, but we can also run this analysis
 with samples of varying size also.
Calculating SSE
SSE = (Xit – Mi)2
In other words, it is just the variance for each sample added together.
SSE = (X1t – M1)2 + (X2t – M2)2 +
         (X3t – M3)2
SSE = [(27-29)2 + (22-29)2 +…+ (29-29)2]
       + [(23-33.5)2 + (36-33.5)2 +…]
       + [(48-37)2 + (35-37)2 +…+ (29-37)2]
SSE = 819.5
Statistical Output
When you estimate this information in a computer program, it will
typically be presented in a table as follows:
Source of   df    Sum of       Mean            F-ratio
Variation         squares      squares
Treatment   k-1   SST          MST=SST/(k-1)   F=MST
Error       n-k   SSE          MSE=SSE/(n-k)     MSE
Total       n-1   SS=SST+SSE
Calculating F for our example
F = 193/2
 819.5/15
F = 1.77
Our calculated F is compared to the critical value using the F-distribution with
F   , k-1, n-k degrees   of freedom
k-1 (numerator df)
n-k (denominator df)
The Results
For 95% confidence ( =.05), our critical F is 3.68 (averaging across the values at
 14 and 16
In this case, 1.77 < 3.68 so we must accept the null hypothesis.
The dean is puzzled by these results because just by eyeballing the data, it looks
 like finance majors make more money.
The Results
Many other factors may determine the salary level, such as GPA. The dean
decides to collect new data selecting one student randomly from each major
with the following average grades.
New data
Average Accounting       Marketing    Finance M(b)
A+                  41           45           51     M(b1)=45.67
A                   36           38           45     M(b2)=39.67
B+                  27           33           31     M(b3)=30.83
B                   32           29           35     M(b4)=32
C+                  26           31           32     M(b5)=29.67
C                   23           25           27     M(b6)=25
          M(t)1=30.83    M(t)2=33.5   M(t)3=36.83


    = 33.72
Randomized Block Design
Now the data in the 3 samples are not independent, they are matched by GPA
levels. Just like before, matched samples are superior to unmatched samples
because they provide more information. In this case, we have added a factor
that may account for some of the SSE.
Two way ANOVA
Now SS(total) = SST + SSB + SSE
Where SSB = the variability among blocks, where a block is a matched group of
observations from each of the populations
We can calculate a two-way ANOVA to test our null hypothesis. We will talk about
this next week.

Weitere ähnliche Inhalte

Was ist angesagt?

MEASURESOF CENTRAL TENDENCY
MEASURESOF CENTRAL TENDENCYMEASURESOF CENTRAL TENDENCY
MEASURESOF CENTRAL TENDENCYRichelle Saberon
 
Measurement of central tendency
Measurement of central tendencyMeasurement of central tendency
Measurement of central tendencyBabatundeAdeyemi7
 
Empirics of standard deviation
Empirics of standard deviationEmpirics of standard deviation
Empirics of standard deviationAdebanji Ayeni
 
3.3 Measures of relative standing and boxplots
3.3 Measures of relative standing and boxplots3.3 Measures of relative standing and boxplots
3.3 Measures of relative standing and boxplotsLong Beach City College
 
Central Tendency - Overview
Central Tendency - Overview Central Tendency - Overview
Central Tendency - Overview Sr Edith Bogue
 
Measures of central tendency
Measures of central tendencyMeasures of central tendency
Measures of central tendencykreshajay
 
Measures of central tendency
Measures of central tendencyMeasures of central tendency
Measures of central tendencyNadeem Uddin
 
Measure OF Central Tendency
Measure OF Central TendencyMeasure OF Central Tendency
Measure OF Central TendencyIqrabutt038
 
Dr digs central tendency
Dr digs central tendencyDr digs central tendency
Dr digs central tendencydrdig
 
Topic 8a Basic Statistics
Topic 8a Basic StatisticsTopic 8a Basic Statistics
Topic 8a Basic StatisticsYee Bee Choo
 
Mean, Median, Mode: Measures of Central Tendency
Mean, Median, Mode: Measures of Central Tendency Mean, Median, Mode: Measures of Central Tendency
Mean, Median, Mode: Measures of Central Tendency Jan Nah
 

Was ist angesagt? (19)

3.1 Measures of center
3.1 Measures of center3.1 Measures of center
3.1 Measures of center
 
MEASURESOF CENTRAL TENDENCY
MEASURESOF CENTRAL TENDENCYMEASURESOF CENTRAL TENDENCY
MEASURESOF CENTRAL TENDENCY
 
Central Tendency
Central TendencyCentral Tendency
Central Tendency
 
Introduction to the t-test
Introduction to the t-testIntroduction to the t-test
Introduction to the t-test
 
Measurement of central tendency
Measurement of central tendencyMeasurement of central tendency
Measurement of central tendency
 
Empirics of standard deviation
Empirics of standard deviationEmpirics of standard deviation
Empirics of standard deviation
 
Chap07 interval estimation
Chap07 interval estimationChap07 interval estimation
Chap07 interval estimation
 
ECONOMETRICS I ASA
ECONOMETRICS I ASAECONOMETRICS I ASA
ECONOMETRICS I ASA
 
Measures of Variation
Measures of Variation Measures of Variation
Measures of Variation
 
3.3 Measures of relative standing and boxplots
3.3 Measures of relative standing and boxplots3.3 Measures of relative standing and boxplots
3.3 Measures of relative standing and boxplots
 
Central Tendency - Overview
Central Tendency - Overview Central Tendency - Overview
Central Tendency - Overview
 
Measures of central tendency
Measures of central tendencyMeasures of central tendency
Measures of central tendency
 
Measures of central tendency
Measures of central tendencyMeasures of central tendency
Measures of central tendency
 
Measure OF Central Tendency
Measure OF Central TendencyMeasure OF Central Tendency
Measure OF Central Tendency
 
Dr digs central tendency
Dr digs central tendencyDr digs central tendency
Dr digs central tendency
 
Topic 8a Basic Statistics
Topic 8a Basic StatisticsTopic 8a Basic Statistics
Topic 8a Basic Statistics
 
Zscores
ZscoresZscores
Zscores
 
Mean, Median, Mode: Measures of Central Tendency
Mean, Median, Mode: Measures of Central Tendency Mean, Median, Mode: Measures of Central Tendency
Mean, Median, Mode: Measures of Central Tendency
 
Module 2 statistics
Module 2   statisticsModule 2   statistics
Module 2 statistics
 

Andere mochten auch

Statr session 19 and 20
Statr session 19 and 20Statr session 19 and 20
Statr session 19 and 20Ruru Chowdhury
 
How skewness in option prices affected Madoff strategy
How skewness in option prices affected Madoff strategyHow skewness in option prices affected Madoff strategy
How skewness in option prices affected Madoff strategyGaetan Lion
 
Unpaired t Test Family
Unpaired t Test FamilyUnpaired t Test Family
Unpaired t Test FamilyGaetan Lion
 
Experimental Design | Statistics
Experimental Design | StatisticsExperimental Design | Statistics
Experimental Design | StatisticsTransweb Global Inc
 
Compression Springs | Mechenical Engineering
Compression Springs | Mechenical EngineeringCompression Springs | Mechenical Engineering
Compression Springs | Mechenical EngineeringTransweb Global Inc
 
Multicolinearity
MulticolinearityMulticolinearity
MulticolinearityPawan Kawan
 
Nonparametric hypothesis testing methods
Nonparametric hypothesis testing methodsNonparametric hypothesis testing methods
Nonparametric hypothesis testing methodsGaetan Lion
 
Simple (and Simplistic) Introduction to Econometrics and Linear Regression
Simple (and Simplistic) Introduction to Econometrics and Linear RegressionSimple (and Simplistic) Introduction to Econometrics and Linear Regression
Simple (and Simplistic) Introduction to Econometrics and Linear RegressionPhilip Tiongson
 
Quantitative method compare means test (independent and paired)
Quantitative method compare means test (independent and paired)Quantitative method compare means test (independent and paired)
Quantitative method compare means test (independent and paired)Keiko Ono
 
Anova and T-Test
Anova and T-TestAnova and T-Test
Anova and T-TestAD Sarwar
 
Parametric tests
Parametric testsParametric tests
Parametric testsheena45
 
HFS3283 paired t tes-t and anova
HFS3283 paired t tes-t and anovaHFS3283 paired t tes-t and anova
HFS3283 paired t tes-t and anovawajihahwafa
 
Null hypothesis for paired sample t-test
Null hypothesis for paired sample t-testNull hypothesis for paired sample t-test
Null hypothesis for paired sample t-testKen Plummer
 
Data and its types by adeel
Data and its types by adeelData and its types by adeel
Data and its types by adeelAyaan Adeel
 
Reporting a paired sample t test
Reporting a paired sample t testReporting a paired sample t test
Reporting a paired sample t testKen Plummer
 

Andere mochten auch (20)

Statr session 19 and 20
Statr session 19 and 20Statr session 19 and 20
Statr session 19 and 20
 
SIGIR2016
SIGIR2016SIGIR2016
SIGIR2016
 
How skewness in option prices affected Madoff strategy
How skewness in option prices affected Madoff strategyHow skewness in option prices affected Madoff strategy
How skewness in option prices affected Madoff strategy
 
Unpaired t Test Family
Unpaired t Test FamilyUnpaired t Test Family
Unpaired t Test Family
 
Paired t Test
Paired t TestPaired t Test
Paired t Test
 
Parametric tests
Parametric testsParametric tests
Parametric tests
 
Experimental Design | Statistics
Experimental Design | StatisticsExperimental Design | Statistics
Experimental Design | Statistics
 
Compression Springs | Mechenical Engineering
Compression Springs | Mechenical EngineeringCompression Springs | Mechenical Engineering
Compression Springs | Mechenical Engineering
 
Lecture 06
Lecture 06Lecture 06
Lecture 06
 
Multicolinearity
MulticolinearityMulticolinearity
Multicolinearity
 
Nonparametric hypothesis testing methods
Nonparametric hypothesis testing methodsNonparametric hypothesis testing methods
Nonparametric hypothesis testing methods
 
Simple (and Simplistic) Introduction to Econometrics and Linear Regression
Simple (and Simplistic) Introduction to Econometrics and Linear RegressionSimple (and Simplistic) Introduction to Econometrics and Linear Regression
Simple (and Simplistic) Introduction to Econometrics and Linear Regression
 
Quantitative method compare means test (independent and paired)
Quantitative method compare means test (independent and paired)Quantitative method compare means test (independent and paired)
Quantitative method compare means test (independent and paired)
 
Anova and T-Test
Anova and T-TestAnova and T-Test
Anova and T-Test
 
Parametric tests
Parametric testsParametric tests
Parametric tests
 
HFS3283 paired t tes-t and anova
HFS3283 paired t tes-t and anovaHFS3283 paired t tes-t and anova
HFS3283 paired t tes-t and anova
 
Null hypothesis for paired sample t-test
Null hypothesis for paired sample t-testNull hypothesis for paired sample t-test
Null hypothesis for paired sample t-test
 
Density Function | Statistics
Density Function | StatisticsDensity Function | Statistics
Density Function | Statistics
 
Data and its types by adeel
Data and its types by adeelData and its types by adeel
Data and its types by adeel
 
Reporting a paired sample t test
Reporting a paired sample t testReporting a paired sample t test
Reporting a paired sample t test
 

Ähnlich wie Experimental design data analysis (20)

Anova by Hazilah Mohd Amin
Anova by Hazilah Mohd AminAnova by Hazilah Mohd Amin
Anova by Hazilah Mohd Amin
 
Hypothesis Test _Two-sample t-test, Z-test, Proportion Z-test
Hypothesis Test _Two-sample t-test, Z-test, Proportion Z-testHypothesis Test _Two-sample t-test, Z-test, Proportion Z-test
Hypothesis Test _Two-sample t-test, Z-test, Proportion Z-test
 
Independent samples t-test
Independent samples t-testIndependent samples t-test
Independent samples t-test
 
Quality Engineering material
Quality Engineering materialQuality Engineering material
Quality Engineering material
 
ANOVA.pptx
ANOVA.pptxANOVA.pptx
ANOVA.pptx
 
One way anova
One way anovaOne way anova
One way anova
 
Stat2013
Stat2013Stat2013
Stat2013
 
Measurement of central tendency
Measurement of central tendencyMeasurement of central tendency
Measurement of central tendency
 
Measure of Central Tendency
Measure of Central TendencyMeasure of Central Tendency
Measure of Central Tendency
 
Lesson 1 06 using the mean to measure central tendency
Lesson 1 06 using the mean to measure central tendency Lesson 1 06 using the mean to measure central tendency
Lesson 1 06 using the mean to measure central tendency
 
Analyzing experimental research data
Analyzing experimental research dataAnalyzing experimental research data
Analyzing experimental research data
 
Chapter 11 Psrm
Chapter 11 PsrmChapter 11 Psrm
Chapter 11 Psrm
 
Statistics
StatisticsStatistics
Statistics
 
Z and t_tests
Z and t_testsZ and t_tests
Z and t_tests
 
Lesson06_new
Lesson06_newLesson06_new
Lesson06_new
 
Chap09 2 sample test
Chap09 2 sample testChap09 2 sample test
Chap09 2 sample test
 
classmar16.ppt
classmar16.pptclassmar16.ppt
classmar16.ppt
 
classmar16.ppt
classmar16.pptclassmar16.ppt
classmar16.ppt
 
5.DATA SUMMERISATION.ppt
5.DATA SUMMERISATION.ppt5.DATA SUMMERISATION.ppt
5.DATA SUMMERISATION.ppt
 
The two sample t-test
The two sample t-testThe two sample t-test
The two sample t-test
 

Mehr von metalkid132

Qualitative research method
Qualitative research methodQualitative research method
Qualitative research methodmetalkid132
 
Problem (how to form good research question)
Problem (how to form good research question)Problem (how to form good research question)
Problem (how to form good research question)metalkid132
 
Literature review
Literature reviewLiterature review
Literature reviewmetalkid132
 
Experimental design
Experimental designExperimental design
Experimental designmetalkid132
 
Quantitative reseach method
Quantitative reseach methodQuantitative reseach method
Quantitative reseach methodmetalkid132
 
Chapter 8 (guidelines and communication strategies for disclosure)
Chapter 8 (guidelines and communication strategies for disclosure)Chapter 8 (guidelines and communication strategies for disclosure)
Chapter 8 (guidelines and communication strategies for disclosure)metalkid132
 
Chapter 7 (communication in the stages of relationships)
Chapter 7 (communication in the stages of relationships)Chapter 7 (communication in the stages of relationships)
Chapter 7 (communication in the stages of relationships)metalkid132
 
Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)metalkid132
 
Chapter 5 (what is listening + types)
Chapter 5 (what is listening + types)Chapter 5 (what is listening + types)
Chapter 5 (what is listening + types)metalkid132
 
Chapter 4 (types of non verbal communication)
Chapter 4 (types of non verbal communication)Chapter 4 (types of non verbal communication)
Chapter 4 (types of non verbal communication)metalkid132
 
Chapter 3 (use language that makes your messages memorable)
Chapter 3 (use language that makes your messages memorable)Chapter 3 (use language that makes your messages memorable)
Chapter 3 (use language that makes your messages memorable)metalkid132
 
Chapter 2 (perception of others)
Chapter 2 (perception of others)Chapter 2 (perception of others)
Chapter 2 (perception of others)metalkid132
 
Chapter 9 (social friendship groups)
Chapter 9 (social friendship groups)Chapter 9 (social friendship groups)
Chapter 9 (social friendship groups)metalkid132
 
Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)metalkid132
 

Mehr von metalkid132 (16)

Qualitative research method
Qualitative research methodQualitative research method
Qualitative research method
 
Problem (how to form good research question)
Problem (how to form good research question)Problem (how to form good research question)
Problem (how to form good research question)
 
Literature review
Literature reviewLiterature review
Literature review
 
Experimental design
Experimental designExperimental design
Experimental design
 
Apa style
Apa styleApa style
Apa style
 
Action research
Action researchAction research
Action research
 
Quantitative reseach method
Quantitative reseach methodQuantitative reseach method
Quantitative reseach method
 
Chapter 8 (guidelines and communication strategies for disclosure)
Chapter 8 (guidelines and communication strategies for disclosure)Chapter 8 (guidelines and communication strategies for disclosure)
Chapter 8 (guidelines and communication strategies for disclosure)
 
Chapter 7 (communication in the stages of relationships)
Chapter 7 (communication in the stages of relationships)Chapter 7 (communication in the stages of relationships)
Chapter 7 (communication in the stages of relationships)
 
Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)
 
Chapter 5 (what is listening + types)
Chapter 5 (what is listening + types)Chapter 5 (what is listening + types)
Chapter 5 (what is listening + types)
 
Chapter 4 (types of non verbal communication)
Chapter 4 (types of non verbal communication)Chapter 4 (types of non verbal communication)
Chapter 4 (types of non verbal communication)
 
Chapter 3 (use language that makes your messages memorable)
Chapter 3 (use language that makes your messages memorable)Chapter 3 (use language that makes your messages memorable)
Chapter 3 (use language that makes your messages memorable)
 
Chapter 2 (perception of others)
Chapter 2 (perception of others)Chapter 2 (perception of others)
Chapter 2 (perception of others)
 
Chapter 9 (social friendship groups)
Chapter 9 (social friendship groups)Chapter 9 (social friendship groups)
Chapter 9 (social friendship groups)
 
Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)Chapter 6 (intercultural communication competence)
Chapter 6 (intercultural communication competence)
 

Experimental design data analysis

  • 3. Introduction A paired t-test is used to compare two population means where you have two samples in which observations in one sample can be paired with observations in the other sample. For example: A diagnostic test was made before studying a particular module and then again after completing the module. We want to find out if, in general, our teaching leads to improvements in students’ knowledge/skills.
  • 4. First, we see the descriptive statistics for both variables. The post-test mean scores are higher.
  • 5. Next, we see the correlation between the two variables. There is a strong positive correlation. People who did well on the pre-test also did well on the post-test.
  • 6. Finally, we see the T, degrees of freedom, and significance. Our significance is .053 If the significance value is less than .05, there is a significant difference. If the significance value is greater than. 05, there is no significant difference. Here, we see that the significance value is approaching significance, but it is not a significant difference. There is no difference between pre- and post-test scores. Our test preparation course did not help!
  • 8. Outline 1. Introduction 2. Hypothesis for the independent t-test 3. What do you need to run an independent t-test? 4. Formula 5. Example (Calculating + Reporting)
  • 9. Introduction The independent t-test, also called the two sample t-test or student's t-test is an inferential statistical test that determines whether there is a statistically significant difference between the means in two unrelated groups.
  • 10. Hypothesis for the independent t-test The null hypothesis for the independent t-test is that the population means from the two unrelated groups are equal: H0: u1 = u2 In most cases, we are looking to see if we can show that we can reject the null hypothesis and accept the alternative hypothesis, which is that the population means are not equal: HA: u1 ≠ u2 To do this we need to set a significance level (alpha) that allows us to either reject or accept the alternative hypothesis. Most commonly, this value is set at 0.05.
  • 11. What do you need to run an independent t-test? In order to run an independent t-test you need the following: 1. One independent, categorical variable that has two levels. 2. One dependent variable
  • 12. Formula M: mean (the average score of the group) SD: Standard Deviation N: number of scores in each group Exp: Experimental Group Con: Control Group
  • 17. Reporting the Result of an Independent T-Test When reporting the result of an independent t-test, you need to include the t-statistic value, the degrees of freedom (df) and the significance value of the test (P-value). The format of the test result is: t(df) = t-statistic, P = significance value.
  • 18. Example result (APA Style) An independent samples T-test is presented the same as the one-sample t-test: t(75) = 2.11, p = .02 (one –tailed), d = .48 Degrees of freedom Value of statistic Include if test is Effect size if Significance of one-tailed available statistic Example: Survey respondents who were employed by the federal, state, or local government had significantly higher socioeconomic indices (M = 55.42, SD = 19.25) than survey respondents who were employed by a private employer (M = 47.54, SD = 18.94) , t(255) = 2.363, p = .01 (one-tailed).
  • 20. Introduction We already learned about the chi square test for independence, which is useful for data that is measured at the nominal or ordinal level of analysis. If we have data measured at the interval level, we can compare two or more population groups in terms of their population means using a technique called analysis of variance, or ANOVA.
  • 21. Completely randomized design Population 1 Population 2….. Population k Mean = 1 Mean = 2 …. Mean = k Variance= 2 Variance= 2 … Variance = 2 1 2 k We want to know something about how the populations compare. Do they have the same mean? We can collect random samples from each population, which gives us the following data.
  • 22. Completely randomized design Mean = M1 Mean = M2 ..… Mean = Mk Variance=s12 Variance=s22 …. Variance = sk2 N1 cases N2 cases …. Nk cases Suppose we want to compare 3 college majors in a business school by the average annual income people make 2 years after graduation. We collect the following data (in $1000s) based on random surveys.
  • 23. Completely randomized design Accounting Marketing Finance 27 23 48 22 36 35 33 27 46 25 44 36 38 39 28 29 32 29
  • 24. Completely randomized design Can the dean conclude that there are differences among the major’s incomes? Ho : 1= 2= 3 HA: 1 2 3 In this problem we must take into account: 1) The variance between samples, or the actual differences by major. This is called the sum of squares for treatment (SST).
  • 25. Completely randomized design 2) The variance within samples, or the variance of incomes within a single major. This is called the sum of squares for error (SSE). Recall that when we sample, there will always be a chance of getting something different than the population. We account for this through #2, or the SSE.
  • 26. F-Statistic For this test, we will calculate a F statistic, which is used to compare variances. F = SST/(k-1) SSE/(n-k) SST=sum of squares for treatment SSE=sum of squares for error k = the number of populations N = total sample size
  • 27. F-statistic Intuitively, the F statistic is: F = explained variance unexplained variance Explained variance is the difference between majors Unexplained variance is the difference based on random sampling for each group (see Figure 10-1, page 327)
  • 28. Calculating SST SST = ni(Mi - )2 = grand mean or = Mi/k or the sum of all values for all groups divided by total sample size Mi = mean for each sample k= the number of populations
  • 29. Calculating SST By major Accounting M1=29, n1=6 Marketing M2=33.5, n2=6 Finance M3=37, n3=6 = (29+33.5+37)/3 = 33.17 SST = (6)(29-33.17)2 + (6)(33.5-33.17)2 + (6)(37-33.17)2 = 193
  • 30. Calculating SST Note that when M1 = M2 = M3, then SST=0 which would support the null hypothesis. In this example, the samples are of equal size, but we can also run this analysis with samples of varying size also.
  • 31. Calculating SSE SSE = (Xit – Mi)2 In other words, it is just the variance for each sample added together. SSE = (X1t – M1)2 + (X2t – M2)2 + (X3t – M3)2 SSE = [(27-29)2 + (22-29)2 +…+ (29-29)2] + [(23-33.5)2 + (36-33.5)2 +…] + [(48-37)2 + (35-37)2 +…+ (29-37)2] SSE = 819.5
  • 32. Statistical Output When you estimate this information in a computer program, it will typically be presented in a table as follows: Source of df Sum of Mean F-ratio Variation squares squares Treatment k-1 SST MST=SST/(k-1) F=MST Error n-k SSE MSE=SSE/(n-k) MSE Total n-1 SS=SST+SSE
  • 33. Calculating F for our example F = 193/2 819.5/15 F = 1.77 Our calculated F is compared to the critical value using the F-distribution with F , k-1, n-k degrees of freedom k-1 (numerator df) n-k (denominator df)
  • 34. The Results For 95% confidence ( =.05), our critical F is 3.68 (averaging across the values at 14 and 16 In this case, 1.77 < 3.68 so we must accept the null hypothesis. The dean is puzzled by these results because just by eyeballing the data, it looks like finance majors make more money.
  • 35. The Results Many other factors may determine the salary level, such as GPA. The dean decides to collect new data selecting one student randomly from each major with the following average grades.
  • 36. New data Average Accounting Marketing Finance M(b) A+ 41 45 51 M(b1)=45.67 A 36 38 45 M(b2)=39.67 B+ 27 33 31 M(b3)=30.83 B 32 29 35 M(b4)=32 C+ 26 31 32 M(b5)=29.67 C 23 25 27 M(b6)=25 M(t)1=30.83 M(t)2=33.5 M(t)3=36.83 = 33.72
  • 37. Randomized Block Design Now the data in the 3 samples are not independent, they are matched by GPA levels. Just like before, matched samples are superior to unmatched samples because they provide more information. In this case, we have added a factor that may account for some of the SSE.
  • 38. Two way ANOVA Now SS(total) = SST + SSB + SSE Where SSB = the variability among blocks, where a block is a matched group of observations from each of the populations We can calculate a two-way ANOVA to test our null hypothesis. We will talk about this next week.