SlideShare a Scribd company logo
1 of 42
Proportion Testing Chris Connors, Ph.D. Jay Armstrong, MSc., M.C.E. October 2, 2009 Statistics Symposium
Applied Statistics in Business, Healthcare, Pharmaceuticals, Education,and Industry
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis Tests: What we are covering? Continuous Data Attribute Data 1 sample t-test : Δ mean from known test mean 2 sample t-test:  Δ mean between 2 independent sample means Paired t-test:  Δ mean between 2 dependent sample means  One Way ANOVA : At least 1 sample mean Δ  between 3 or more samples Kruskal Wallis & Mood’s Median: At least 1 sample median Δ  between 3 or more samples F-test, Levene’s test, & Bartlett’s test: At least 1 sample standard deviation Δ  between 3 or more samples Correlation/Regression/DOE:  2 or more factors are correlated/  Predictor affects the sampled process 1 proportion test:  A sample proportion Δ against a known value  2 proportion test:  Proportions from the two samples are different  Chi Square test:  At least one sample proportion Δ from others:
Scavenger Hunt ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Statistical Decision: Setting up your risk level ,[object Object],[object Object],[object Object],[object Object],The probability of a Type I error is designated by the Greek letter alpha (  ) and is called the Type I error rate; the probability of a Type II error (the Type II error rate) is designated by the Greek letter beta (ß). A Type II error is only an error in the sense that an opportunity to reject the null hypothesis correctly was lost. It is not an error in the sense that an incorrect conclusion was drawn since no conclusion is drawn when the null hypothesis is not rejected.
Six Sigma DMAIC method: Hypothesis Tests ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Measure Define Control Improve Analyze
6S Black Belt Level of Cognition for Hypothesis Testing *1= learned, 2= know, 3 = used, 4 = taught Topic Level of Cognition My Development Introduction to Statistical Comparisons 2* Normality and Transformation 2 Correlation Analysis 3 Regression Analysis 3 Introduction to Multiple Linear Regression 1 t-tests 3 ANOVA 3 1 and 2 proportion test 3 Chi-Square Analysis 3 Binary Logistic Regression 1
6S BB Level of Cognition for Hypothesis Testing *1= learned, 2= know, 3 = used, 4 = taught Topic Level of Cognition My Development Introduction Experimental Design 2* Background on Experimental design 2 DOE Designs and terminology 2 Full Factorial design 2 Half factorial designs 2 Robust Designs 2 Checklists for designing and conducting DOE BBC exercise: DOE Simulation 2 Results of DOE Simulation 2
The Business Approach Proportion Tests ,[object Object],Statistical Problem Statistical Problem Business Problem Business Solution Decision Statistical Solution Potential Root Causes Identified Root Causes Verified
Selecting the Right Statistical Tool Discrete Discrete Continuous Proportion Tests Logistic  Regression t test ANOVA DOE Correlation Regression X Y Continuous
Determine if a statistically significant difference of proportion exists between: - A sample and a target - Two independent samples - Two samples or less Tests of Proportion Use samples to make inferences about population proportions 1 Proportion Test 1 Sample Comparing Proportions 2 Proportion Test Chi-Square Test More Than 2 Samples 2 Samples
Proportion Test Approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
One Tail or Two Tails: Placing the Alpha Risk
Useful Discrete Distributions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Binomial - key facts Useful fact:  has approximately a normal distribution when n is large (more than 25 or 30) and  np  and  n( 1 -p)  are not too small (say >5).
Binomial - Normal Approximation
Histogram: n=20
Histogram: n=100
Sample Size ,[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis testing - terms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis testing steps ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis tests are either one tailed or two tail tests Fail to Reject H 0 Reject H 0 1% or 5%  significance level Fail to Reject H 0 Reject H 0 One tail test  - Answers only ONE question - is the test statistic  less than or greater than the known distribution Fail to Reject H 0 Reject H 0 Reject H 0 Two tailed test  – Only asks if the test statistic is different from the known distribution – H A  usually has “not equal to” in the wording 2.5% significance level 2.5% significance level
Clinical Testing  One-tailed example by hand ,[object Object],[object Object],[object Object],[object Object]
Clinical Testing  One-tailed example by hand ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Test of Independence ,[object Object],[object Object],Rows: adverse  Columns: drug new  old  All n  90  80  170 y  210  120  330 All  300  200  500 Cell Contents:  Count Fisher's exact test: P-Value =  0.0265193
Regulatory Compliance Documentation  Sample Size: Minitab
The Business Approach 1-Proportion Test Statistical Problem Statistical Problem Business Problem Business Solution Decision Statistical Solution Potential Root Causes Identified Root Causes Verified
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Regulatory Compliance Documentation Example
[object Object],[object Object],[object Object],[object Object],Regulatory Compliance Documentation Example - Hypothesis
[object Object],Compliance Documentation Example – Minitab Commands target
Compliance Documentation  Example – Minitab Results What’s our interpretation?  Test and CI for One Proportion  Test of p = 0.5 vs p > 0.5 95% Lower  Exact Sample  X  N  Sample p  Bound  P-Value 1  74  130  0.569231  0.493309  0.068
Regulatory Compliance Documentation  Sample Size ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Business Approach 2-Proportion Test Statistical Problem Statistical Problem Business Problem Business Solution Decision Statistical Solution Potential Root Causes Identified Root Causes Verified
Analysis of Proportions for Workload Balance Jack Lairdieson, MBB, Vanguard Interpret as an Interval Plot for Multiple Proportions Total  Region 5  Region 6  Region 3  Region 1  Region 3  Region 2
The Workload Balance (WLB) metrics were being discussed at a regional meeting.  The Region 1 representative scoffed at the Region 2 representative that the Region 2’s “In-range” WLB performance metrics were at the “bottom of the barrel”. The Region 2 representative quickly responded, “Really, Region 1 is no better than Region 2.” Once back to the office the concerned Region 1 representative gave the following Workload Balance data to a Black Belt. WLB Stats In-Range Staff Region 1    663  1411 Region 2   141   353 Should Region 1 be concerned about his conclusion? What is the null hypothesis? Workload Balance Example
[object Object],[object Object],[object Object],[object Object],Workload Balance Example - Hypothesis
[object Object],[object Object],Workload Balance Example – Minitab Commands
Workload Balance Example – Minitab Results Session Window Output What’s our interpretation?  What Hypothesis did we choose to test? Is the sample size a concern?  Test and CI for Two Proportions  Sample  X  N  Sample p 1  663  1411  0.469880 2  141  353  0.399433 Difference = p (1) - p (2) Estimate for difference:  0.0704461 95% lower bound for difference:  0.0223190 Test for difference = 0 (vs > 0):  Z = 2.41  P-Value = 0.008
Sample Size: Minitab ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
References ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Six Sigma Links Six Sigma Motorola, Inc. - Motorola University Six Sigma - What is Six Sigma? i Six Sigma - Six Sigma Quality Resources for Achieving Six Sigma Results General Electric : Our Company : What is Six Sigma? Quality American Society for Quality - ASQ TQM Virtual  CoursePack SPC Press - Home Statistics http://www. statsoft .com/textbook/ stathome .html Penn State Statistical Education Resource Kit--Overview of Statistics Data Statistics Video Course The Sofia Open Content Initiative - Elementary Statistics Resource: Learning Math: Data Analysis, Statistics, and Probability Lean Six Sigma Kaizen and Lean Manufacturing Consulting: Gemba Research - | Kaizen Products Conquering Complexity, Fast Innovation, Lean Six Sigma Quality. George Group Consulting Six Sigma Training Book LEAN.org - Lean Enterprise Institute| Lean Production| Lean Manufacturing| LEI| Lean Services| Lean Enterprise Training Course| Lean Consumption| Lean Resources| Lean Experts| Lean Healthcare| Lean in Healthcare| Training on Lean Manufacturing| Lean Business   Excel Statistics Add on http://www.qimacros.com/

More Related Content

What's hot

Basics of statistics
Basics of statisticsBasics of statistics
Basics of statisticsGaurav Kr
 
Presentation on Hypothesis Test by Ashik Amin Prem
Presentation on Hypothesis Test by Ashik Amin PremPresentation on Hypothesis Test by Ashik Amin Prem
Presentation on Hypothesis Test by Ashik Amin PremAshikAminPrem
 
Hypothesis testing1
Hypothesis testing1Hypothesis testing1
Hypothesis testing1HanaaBayomy
 
Lecture2 hypothesis testing
Lecture2 hypothesis testingLecture2 hypothesis testing
Lecture2 hypothesis testingo_devinyak
 
Review Z Test Ci 1
Review Z Test Ci 1Review Z Test Ci 1
Review Z Test Ci 1shoffma5
 
Testing Of Hypothesis
Testing Of HypothesisTesting Of Hypothesis
Testing Of HypothesisSWATI SINGH
 
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...The Stockker
 
Testing of hypotheses
Testing of hypothesesTesting of hypotheses
Testing of hypothesesRajThakuri
 
Hypothesis testing and p-value, www.eyenirvaan.com
Hypothesis testing and p-value, www.eyenirvaan.comHypothesis testing and p-value, www.eyenirvaan.com
Hypothesis testing and p-value, www.eyenirvaan.comEyenirvaan
 
HYPOTHESIS TESTING
HYPOTHESIS TESTINGHYPOTHESIS TESTING
HYPOTHESIS TESTINGAmna Sheikh
 
Z test
Z testZ test
Z testkagil
 
Lect w7 t_test_amp_chi_test
Lect w7 t_test_amp_chi_testLect w7 t_test_amp_chi_test
Lect w7 t_test_amp_chi_testRione Drevale
 
Hypothesis testing an introduction
Hypothesis testing an introductionHypothesis testing an introduction
Hypothesis testing an introductionGeetika Gulyani
 

What's hot (20)

Basics of statistics
Basics of statisticsBasics of statistics
Basics of statistics
 
Presentation on Hypothesis Test by Ashik Amin Prem
Presentation on Hypothesis Test by Ashik Amin PremPresentation on Hypothesis Test by Ashik Amin Prem
Presentation on Hypothesis Test by Ashik Amin Prem
 
Hypothesis testing Part1
Hypothesis testing Part1Hypothesis testing Part1
Hypothesis testing Part1
 
Hypothesis testing1
Hypothesis testing1Hypothesis testing1
Hypothesis testing1
 
Lecture2 hypothesis testing
Lecture2 hypothesis testingLecture2 hypothesis testing
Lecture2 hypothesis testing
 
Review Z Test Ci 1
Review Z Test Ci 1Review Z Test Ci 1
Review Z Test Ci 1
 
Test for proportion
Test for proportionTest for proportion
Test for proportion
 
Hypothesis testing
Hypothesis testingHypothesis testing
Hypothesis testing
 
Hypothesis testing
Hypothesis testingHypothesis testing
Hypothesis testing
 
Testing Of Hypothesis
Testing Of HypothesisTesting Of Hypothesis
Testing Of Hypothesis
 
Testing of Hypothesis
Testing of Hypothesis Testing of Hypothesis
Testing of Hypothesis
 
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...
Research methodology - Estimation Theory & Hypothesis Testing, Techniques of ...
 
Testing of hypotheses
Testing of hypothesesTesting of hypotheses
Testing of hypotheses
 
Hypothesis testing and p-value, www.eyenirvaan.com
Hypothesis testing and p-value, www.eyenirvaan.comHypothesis testing and p-value, www.eyenirvaan.com
Hypothesis testing and p-value, www.eyenirvaan.com
 
HYPOTHESIS TESTING
HYPOTHESIS TESTINGHYPOTHESIS TESTING
HYPOTHESIS TESTING
 
Z test
Z testZ test
Z test
 
Hypothesis testing
Hypothesis testingHypothesis testing
Hypothesis testing
 
Hypothesis
HypothesisHypothesis
Hypothesis
 
Lect w7 t_test_amp_chi_test
Lect w7 t_test_amp_chi_testLect w7 t_test_amp_chi_test
Lect w7 t_test_amp_chi_test
 
Hypothesis testing an introduction
Hypothesis testing an introductionHypothesis testing an introduction
Hypothesis testing an introduction
 

Viewers also liked

B.4 tests for proportions
B.4  tests for proportionsB.4  tests for proportions
B.4 tests for proportionsUlster BOCES
 
How to conclude online experiments in python
How to conclude online experiments in pythonHow to conclude online experiments in python
How to conclude online experiments in pythonVolodymyr Kazantsev
 
About testing the hypothesis of equality of two bernoulli
About testing the hypothesis of equality of two bernoulliAbout testing the hypothesis of equality of two bernoulli
About testing the hypothesis of equality of two bernoulliAlexander Decker
 
Reporting a two sample z test for proportions
Reporting a two sample z test for proportionsReporting a two sample z test for proportions
Reporting a two sample z test for proportionsKen Plummer
 
Introduction to hypothesis testing ppt @ bec doms
Introduction to hypothesis testing ppt @ bec domsIntroduction to hypothesis testing ppt @ bec doms
Introduction to hypothesis testing ppt @ bec domsBabasab Patil
 
Hypothesis testing ppt final
Hypothesis testing ppt finalHypothesis testing ppt final
Hypothesis testing ppt finalpiyushdhaker
 
Hypothesis testing; z test, t-test. f-test
Hypothesis testing; z test, t-test. f-testHypothesis testing; z test, t-test. f-test
Hypothesis testing; z test, t-test. f-testShakehand with Life
 

Viewers also liked (10)

B.4 tests for proportions
B.4  tests for proportionsB.4  tests for proportions
B.4 tests for proportions
 
How to conclude online experiments in python
How to conclude online experiments in pythonHow to conclude online experiments in python
How to conclude online experiments in python
 
About testing the hypothesis of equality of two bernoulli
About testing the hypothesis of equality of two bernoulliAbout testing the hypothesis of equality of two bernoulli
About testing the hypothesis of equality of two bernoulli
 
Hypothesis testng
Hypothesis testngHypothesis testng
Hypothesis testng
 
Hypothesis testing
Hypothesis testingHypothesis testing
Hypothesis testing
 
Reporting a two sample z test for proportions
Reporting a two sample z test for proportionsReporting a two sample z test for proportions
Reporting a two sample z test for proportions
 
Introduction to hypothesis testing ppt @ bec doms
Introduction to hypothesis testing ppt @ bec domsIntroduction to hypothesis testing ppt @ bec doms
Introduction to hypothesis testing ppt @ bec doms
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
 
Hypothesis testing ppt final
Hypothesis testing ppt finalHypothesis testing ppt final
Hypothesis testing ppt final
 
Hypothesis testing; z test, t-test. f-test
Hypothesis testing; z test, t-test. f-testHypothesis testing; z test, t-test. f-test
Hypothesis testing; z test, t-test. f-test
 

Similar to What So Funny About Proportion Testv3

Hypothesis Testing Definitions A statistical hypothesi.docx
Hypothesis Testing  Definitions A statistical hypothesi.docxHypothesis Testing  Definitions A statistical hypothesi.docx
Hypothesis Testing Definitions A statistical hypothesi.docxwilcockiris
 
Hypothesis Testing in Six Sigma
Hypothesis Testing in Six SigmaHypothesis Testing in Six Sigma
Hypothesis Testing in Six SigmaBody of Knowledge
 
Telesidang 4 bab_8_9_10stst
Telesidang 4 bab_8_9_10ststTelesidang 4 bab_8_9_10stst
Telesidang 4 bab_8_9_10ststNor Ihsan
 
Basics of Hypothesis testing for Pharmacy
Basics of Hypothesis testing for PharmacyBasics of Hypothesis testing for Pharmacy
Basics of Hypothesis testing for PharmacyParag Shah
 
Statistics pres 3.31.2014
Statistics pres 3.31.2014Statistics pres 3.31.2014
Statistics pres 3.31.2014tjcarter
 
Testing of Hypothesis combined with tests.pdf
Testing of Hypothesis combined with tests.pdfTesting of Hypothesis combined with tests.pdf
Testing of Hypothesis combined with tests.pdfRamBk5
 
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesis
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesisTesting of Hypothesis, p-value, Gaussian distribution, null hypothesis
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesissvmmcradonco1
 
ME SP 11 Q4 1602 PS.pptx
ME SP 11 Q4 1602 PS.pptxME SP 11 Q4 1602 PS.pptx
ME SP 11 Q4 1602 PS.pptxTinCabos
 
Unit 9b. Sample size estimation.ppt
Unit 9b. Sample size estimation.pptUnit 9b. Sample size estimation.ppt
Unit 9b. Sample size estimation.pptshakirRahman10
 
Research Sample size by Dr Allah Yar Malik
Research Sample size by Dr Allah Yar MalikResearch Sample size by Dr Allah Yar Malik
Research Sample size by Dr Allah Yar Malikhuraismalik
 

Similar to What So Funny About Proportion Testv3 (20)

Stat topics
Stat topicsStat topics
Stat topics
 
Hypo
HypoHypo
Hypo
 
Hypothesis Testing Definitions A statistical hypothesi.docx
Hypothesis Testing  Definitions A statistical hypothesi.docxHypothesis Testing  Definitions A statistical hypothesi.docx
Hypothesis Testing Definitions A statistical hypothesi.docx
 
Hypothesis Testing in Six Sigma
Hypothesis Testing in Six SigmaHypothesis Testing in Six Sigma
Hypothesis Testing in Six Sigma
 
Telesidang 4 bab_8_9_10stst
Telesidang 4 bab_8_9_10ststTelesidang 4 bab_8_9_10stst
Telesidang 4 bab_8_9_10stst
 
Tests of significance
Tests of significanceTests of significance
Tests of significance
 
312320.pptx
312320.pptx312320.pptx
312320.pptx
 
Basics of Hypothesis testing for Pharmacy
Basics of Hypothesis testing for PharmacyBasics of Hypothesis testing for Pharmacy
Basics of Hypothesis testing for Pharmacy
 
Thesigntest
ThesigntestThesigntest
Thesigntest
 
Hypothesis testing
Hypothesis testingHypothesis testing
Hypothesis testing
 
Statistics pres 3.31.2014
Statistics pres 3.31.2014Statistics pres 3.31.2014
Statistics pres 3.31.2014
 
Testing of Hypothesis combined with tests.pdf
Testing of Hypothesis combined with tests.pdfTesting of Hypothesis combined with tests.pdf
Testing of Hypothesis combined with tests.pdf
 
Basics of Hypothesis Testing
Basics of Hypothesis TestingBasics of Hypothesis Testing
Basics of Hypothesis Testing
 
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesis
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesisTesting of Hypothesis, p-value, Gaussian distribution, null hypothesis
Testing of Hypothesis, p-value, Gaussian distribution, null hypothesis
 
Spss session 1 and 2
Spss session 1 and 2Spss session 1 and 2
Spss session 1 and 2
 
ME SP 11 Q4 1602 PS.pptx
ME SP 11 Q4 1602 PS.pptxME SP 11 Q4 1602 PS.pptx
ME SP 11 Q4 1602 PS.pptx
 
Hypothsis testing
Hypothsis testingHypothsis testing
Hypothsis testing
 
Unit 9b. Sample size estimation.ppt
Unit 9b. Sample size estimation.pptUnit 9b. Sample size estimation.ppt
Unit 9b. Sample size estimation.ppt
 
Research Sample size by Dr Allah Yar Malik
Research Sample size by Dr Allah Yar MalikResearch Sample size by Dr Allah Yar Malik
Research Sample size by Dr Allah Yar Malik
 
Sampling theory
Sampling theorySampling theory
Sampling theory
 

Recently uploaded

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 

What So Funny About Proportion Testv3

  • 1. Proportion Testing Chris Connors, Ph.D. Jay Armstrong, MSc., M.C.E. October 2, 2009 Statistics Symposium
  • 2. Applied Statistics in Business, Healthcare, Pharmaceuticals, Education,and Industry
  • 3.
  • 4. Hypothesis Tests: What we are covering? Continuous Data Attribute Data 1 sample t-test : Δ mean from known test mean 2 sample t-test: Δ mean between 2 independent sample means Paired t-test: Δ mean between 2 dependent sample means One Way ANOVA : At least 1 sample mean Δ between 3 or more samples Kruskal Wallis & Mood’s Median: At least 1 sample median Δ between 3 or more samples F-test, Levene’s test, & Bartlett’s test: At least 1 sample standard deviation Δ between 3 or more samples Correlation/Regression/DOE: 2 or more factors are correlated/ Predictor affects the sampled process 1 proportion test: A sample proportion Δ against a known value 2 proportion test: Proportions from the two samples are different Chi Square test: At least one sample proportion Δ from others:
  • 5.
  • 6.
  • 7.
  • 8. 6S Black Belt Level of Cognition for Hypothesis Testing *1= learned, 2= know, 3 = used, 4 = taught Topic Level of Cognition My Development Introduction to Statistical Comparisons 2* Normality and Transformation 2 Correlation Analysis 3 Regression Analysis 3 Introduction to Multiple Linear Regression 1 t-tests 3 ANOVA 3 1 and 2 proportion test 3 Chi-Square Analysis 3 Binary Logistic Regression 1
  • 9. 6S BB Level of Cognition for Hypothesis Testing *1= learned, 2= know, 3 = used, 4 = taught Topic Level of Cognition My Development Introduction Experimental Design 2* Background on Experimental design 2 DOE Designs and terminology 2 Full Factorial design 2 Half factorial designs 2 Robust Designs 2 Checklists for designing and conducting DOE BBC exercise: DOE Simulation 2 Results of DOE Simulation 2
  • 10.
  • 11. Selecting the Right Statistical Tool Discrete Discrete Continuous Proportion Tests Logistic Regression t test ANOVA DOE Correlation Regression X Y Continuous
  • 12. Determine if a statistically significant difference of proportion exists between: - A sample and a target - Two independent samples - Two samples or less Tests of Proportion Use samples to make inferences about population proportions 1 Proportion Test 1 Sample Comparing Proportions 2 Proportion Test Chi-Square Test More Than 2 Samples 2 Samples
  • 13.
  • 14. One Tail or Two Tails: Placing the Alpha Risk
  • 15.
  • 16. Binomial - key facts Useful fact: has approximately a normal distribution when n is large (more than 25 or 30) and np and n( 1 -p) are not too small (say >5).
  • 17. Binomial - Normal Approximation
  • 20.
  • 21.
  • 22.
  • 23. Hypothesis tests are either one tailed or two tail tests Fail to Reject H 0 Reject H 0 1% or 5% significance level Fail to Reject H 0 Reject H 0 One tail test - Answers only ONE question - is the test statistic less than or greater than the known distribution Fail to Reject H 0 Reject H 0 Reject H 0 Two tailed test – Only asks if the test statistic is different from the known distribution – H A usually has “not equal to” in the wording 2.5% significance level 2.5% significance level
  • 24.
  • 25.
  • 26.
  • 27. Regulatory Compliance Documentation Sample Size: Minitab
  • 28. The Business Approach 1-Proportion Test Statistical Problem Statistical Problem Business Problem Business Solution Decision Statistical Solution Potential Root Causes Identified Root Causes Verified
  • 29.
  • 30.
  • 31.
  • 32. Compliance Documentation Example – Minitab Results What’s our interpretation? Test and CI for One Proportion Test of p = 0.5 vs p > 0.5 95% Lower Exact Sample X N Sample p Bound P-Value 1 74 130 0.569231 0.493309 0.068
  • 33.
  • 34. The Business Approach 2-Proportion Test Statistical Problem Statistical Problem Business Problem Business Solution Decision Statistical Solution Potential Root Causes Identified Root Causes Verified
  • 35. Analysis of Proportions for Workload Balance Jack Lairdieson, MBB, Vanguard Interpret as an Interval Plot for Multiple Proportions Total Region 5 Region 6 Region 3 Region 1 Region 3 Region 2
  • 36. The Workload Balance (WLB) metrics were being discussed at a regional meeting. The Region 1 representative scoffed at the Region 2 representative that the Region 2’s “In-range” WLB performance metrics were at the “bottom of the barrel”. The Region 2 representative quickly responded, “Really, Region 1 is no better than Region 2.” Once back to the office the concerned Region 1 representative gave the following Workload Balance data to a Black Belt. WLB Stats In-Range Staff Region 1 663 1411 Region 2 141 353 Should Region 1 be concerned about his conclusion? What is the null hypothesis? Workload Balance Example
  • 37.
  • 38.
  • 39. Workload Balance Example – Minitab Results Session Window Output What’s our interpretation? What Hypothesis did we choose to test? Is the sample size a concern? Test and CI for Two Proportions Sample X N Sample p 1 663 1411 0.469880 2 141 353 0.399433 Difference = p (1) - p (2) Estimate for difference: 0.0704461 95% lower bound for difference: 0.0223190 Test for difference = 0 (vs > 0): Z = 2.41 P-Value = 0.008
  • 40.
  • 41.
  • 42. Six Sigma Links Six Sigma Motorola, Inc. - Motorola University Six Sigma - What is Six Sigma? i Six Sigma - Six Sigma Quality Resources for Achieving Six Sigma Results General Electric : Our Company : What is Six Sigma? Quality American Society for Quality - ASQ TQM Virtual CoursePack SPC Press - Home Statistics http://www. statsoft .com/textbook/ stathome .html Penn State Statistical Education Resource Kit--Overview of Statistics Data Statistics Video Course The Sofia Open Content Initiative - Elementary Statistics Resource: Learning Math: Data Analysis, Statistics, and Probability Lean Six Sigma Kaizen and Lean Manufacturing Consulting: Gemba Research - | Kaizen Products Conquering Complexity, Fast Innovation, Lean Six Sigma Quality. George Group Consulting Six Sigma Training Book LEAN.org - Lean Enterprise Institute| Lean Production| Lean Manufacturing| LEI| Lean Services| Lean Enterprise Training Course| Lean Consumption| Lean Resources| Lean Experts| Lean Healthcare| Lean in Healthcare| Training on Lean Manufacturing| Lean Business Excel Statistics Add on http://www.qimacros.com/

Editor's Notes

  1. 17/06/10
  2. 17/06/10
  3. 17/06/10 Notes:
  4. 17/06/10 In this example, we are not looking at an Input-Output relationship, rather we are investigating the relationship of two different inputs, both of which are discrete variables. If we look to where the X-discrete row intersects the Y-discrete column, we find that Chi-square is a tool available for this type of data analysis.
  5. 17/06/10 Notes:
  6. 17/06/10 This is used when you have 2 outcome possibilities; fail/pass, yes/no, bad/good, etc… You need to be able to estimate the probability of success in the population to calculate the expected number of successes you expect to encounter in a random sample of the population.
  7. 17/06/10
  8. 17/06/10 To do this in minitab go to: calc>probability distributions>binomial.. … then select cumulative probability, with number of trials =750; probability of success=.03 and input constant=12
  9. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  10. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  11. 17/06/10 Notes:
  12. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  13. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  14. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  15. 17/06/10
  16. 17/06/10 Notes:
  17. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  18. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  19. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  20. 17/06/10 You can construct this graph using MINITAB. Open the file t test.mpj. Select Stat>Basic Statistics>2-Sample t. Select Samples in different columns. Click in First block, then double-click on Customer Service. Click in Second block, then double-click on Marketing. Click Options, then set Alternative to Not Equal, and Confidence Interval to 95.0. Click OK. Click Graphs, then select Boxplots. Click OK. Click OK.
  21. 17/06/10