Submit Search
Upload
04 regression
•
Download as PPT, PDF
•
3 likes
•
5,113 views
Firas Husseini
Follow
Quantitative Analysis for Management, 11e (Render)
Read less
Read more
Business
Report
Share
Report
Share
1 of 75
Download now
Recommended
05 forecasting
05 forecasting
Firas Husseini
Slides for ch05
Slides for ch05
Firas Husseini
Linear regression
Linear regression
Karishma Chaudhary
Chap11 simple regression
Chap11 simple regression
Judianto Nugroho
Statistics-Regression analysis
Statistics-Regression analysis
Rabin BK
The Normal Distribution and Other Continuous Distributions
The Normal Distribution and Other Continuous Distributions
Yesica Adicondro
Multiple regression presentation
Multiple regression presentation
Carlo Magno
Binomial probability distributions ppt
Binomial probability distributions ppt
Tayab Ali
Recommended
05 forecasting
05 forecasting
Firas Husseini
Slides for ch05
Slides for ch05
Firas Husseini
Linear regression
Linear regression
Karishma Chaudhary
Chap11 simple regression
Chap11 simple regression
Judianto Nugroho
Statistics-Regression analysis
Statistics-Regression analysis
Rabin BK
The Normal Distribution and Other Continuous Distributions
The Normal Distribution and Other Continuous Distributions
Yesica Adicondro
Multiple regression presentation
Multiple regression presentation
Carlo Magno
Binomial probability distributions ppt
Binomial probability distributions ppt
Tayab Ali
multiple regression
multiple regression
Priya Sharma
Post-optimal analysis of LPP
Post-optimal analysis of LPP
RAVI PRASAD K.J.
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Sharlaine Ruth
Probability distribution 2
Probability distribution 2
Nilanjan Bhaumik
Simple Linear Regression
Simple Linear Regression
Yesica Adicondro
Chap05 discrete probability distributions
Chap05 discrete probability distributions
Uni Azza Aunillah
Rsh qam11 ch04 ge
Rsh qam11 ch04 ge
Firas Husseini
Render 03 Quantitative analysis for management
Render 03 Quantitative analysis for management
Franchezka Pegollo
Regression analysis.
Regression analysis.
sonia gupta
Regression analysis
Regression analysis
Dr.ammara khakwani
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Mayur Rahangdale
Linear regression
Linear regression
vermaumeshverma
Chapter 4 - multiple regression
Chapter 4 - multiple regression
Tauseef khan
Chap14 multiple regression model building
Chap14 multiple regression model building
Uni Azza Aunillah
Simple linear regression
Simple linear regression
Avjinder (Avi) Kaler
Regression Analysis
Regression Analysis
Salim Azad
Method of least square
Method of least square
Somya Bagai
Chapter 06
Chapter 06
Tuul Tuul
Regression
Regression
Warda Chaudhry
Regression analysis
Regression analysis
Shameer P Hamsa
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
JustinXerri
2.1 regression
2.1 regression
Manish Gupta
More Related Content
What's hot
multiple regression
multiple regression
Priya Sharma
Post-optimal analysis of LPP
Post-optimal analysis of LPP
RAVI PRASAD K.J.
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Sharlaine Ruth
Probability distribution 2
Probability distribution 2
Nilanjan Bhaumik
Simple Linear Regression
Simple Linear Regression
Yesica Adicondro
Chap05 discrete probability distributions
Chap05 discrete probability distributions
Uni Azza Aunillah
Rsh qam11 ch04 ge
Rsh qam11 ch04 ge
Firas Husseini
Render 03 Quantitative analysis for management
Render 03 Quantitative analysis for management
Franchezka Pegollo
Regression analysis.
Regression analysis.
sonia gupta
Regression analysis
Regression analysis
Dr.ammara khakwani
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Mayur Rahangdale
Linear regression
Linear regression
vermaumeshverma
Chapter 4 - multiple regression
Chapter 4 - multiple regression
Tauseef khan
Chap14 multiple regression model building
Chap14 multiple regression model building
Uni Azza Aunillah
Simple linear regression
Simple linear regression
Avjinder (Avi) Kaler
Regression Analysis
Regression Analysis
Salim Azad
Method of least square
Method of least square
Somya Bagai
Chapter 06
Chapter 06
Tuul Tuul
Regression
Regression
Warda Chaudhry
Regression analysis
Regression analysis
Shameer P Hamsa
What's hot
(20)
multiple regression
multiple regression
Post-optimal analysis of LPP
Post-optimal analysis of LPP
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Probability distribution 2
Probability distribution 2
Simple Linear Regression
Simple Linear Regression
Chap05 discrete probability distributions
Chap05 discrete probability distributions
Rsh qam11 ch04 ge
Rsh qam11 ch04 ge
Render 03 Quantitative analysis for management
Render 03 Quantitative analysis for management
Regression analysis.
Regression analysis.
Regression analysis
Regression analysis
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Linear Regression Analysis method of Forecasting ,:- Management principle and...
Linear regression
Linear regression
Chapter 4 - multiple regression
Chapter 4 - multiple regression
Chap14 multiple regression model building
Chap14 multiple regression model building
Simple linear regression
Simple linear regression
Regression Analysis
Regression Analysis
Method of least square
Method of least square
Chapter 06
Chapter 06
Regression
Regression
Regression analysis
Regression analysis
Similar to 04 regression
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
JustinXerri
2.1 regression
2.1 regression
Manish Gupta
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
LynellBull52
Bba 3274 qm week 6 part 1 regression models
Bba 3274 qm week 6 part 1 regression models
Stephen Ong
Tbs910 regression models
Tbs910 regression models
Stephen Ong
Quantitative Analysis for Management new ppt
Quantitative Analysis for Management new ppt
krrish242
161783709 chapter-04-answers
161783709 chapter-04-answers
BookStoreLib
161783709 chapter-04-answers
161783709 chapter-04-answers
Firas Husseini
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
hildredzr1di
Regression analysis
Regression analysis
Srikant001p
lanen_5e_ch05_student.ppt
lanen_5e_ch05_student.ppt
SURAJITDASBAURI
multiple regression model building
multiple regression model building
Yesica Adicondro
Modules Linear Algebra Drills
Modules Linear Algebra Drills
Daniel Bragais
Fst ch3 notes
Fst ch3 notes
David Tchozewski
Pat05 ppt 0105
Pat05 ppt 0105
wzuri
SupportVectorRegression
SupportVectorRegression
Daniel K
Exploring Support Vector Regression - Signals and Systems Project
Exploring Support Vector Regression - Signals and Systems Project
Surya Chandra
Chap12 simple regression
Chap12 simple regression
Uni Azza Aunillah
Lecture 14.ppt
Lecture 14.ppt
TanvirIslam461642
STA003_WK4_L.pptx
STA003_WK4_L.pptx
MAmir23
Similar to 04 regression
(20)
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
2.1 regression
2.1 regression
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
Bba 3274 qm week 6 part 1 regression models
Bba 3274 qm week 6 part 1 regression models
Tbs910 regression models
Tbs910 regression models
Quantitative Analysis for Management new ppt
Quantitative Analysis for Management new ppt
161783709 chapter-04-answers
161783709 chapter-04-answers
161783709 chapter-04-answers
161783709 chapter-04-answers
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Regression analysis
Regression analysis
lanen_5e_ch05_student.ppt
lanen_5e_ch05_student.ppt
multiple regression model building
multiple regression model building
Modules Linear Algebra Drills
Modules Linear Algebra Drills
Fst ch3 notes
Fst ch3 notes
Pat05 ppt 0105
Pat05 ppt 0105
SupportVectorRegression
SupportVectorRegression
Exploring Support Vector Regression - Signals and Systems Project
Exploring Support Vector Regression - Signals and Systems Project
Chap12 simple regression
Chap12 simple regression
Lecture 14.ppt
Lecture 14.ppt
STA003_WK4_L.pptx
STA003_WK4_L.pptx
More from Firas Husseini
Ali M Fadel CV
Ali M Fadel CV
Firas Husseini
Transportation problems1
Transportation problems1
Firas Husseini
Slides for ch08
Slides for ch08
Firas Husseini
Slides for ch07
Slides for ch07
Firas Husseini
Slides for ch06
Slides for ch06
Firas Husseini
Rsh qam11 ch10 ge
Rsh qam11 ch10 ge
Firas Husseini
Rsh qam11 ch09 ge
Rsh qam11 ch09 ge
Firas Husseini
Rsh qam11 ch08 ge
Rsh qam11 ch08 ge
Firas Husseini
Rsh qam11 ch07 ge
Rsh qam11 ch07 ge
Firas Husseini
Rsh qam11 ch06 ge
Rsh qam11 ch06 ge
Firas Husseini
Rsh qam11 ch05 ge
Rsh qam11 ch05 ge
Firas Husseini
Rsh qam11 ch03
Rsh qam11 ch03
Firas Husseini
Rsh qam11 ch03 ge
Rsh qam11 ch03 ge
Firas Husseini
Rsh qam11 ch02
Rsh qam11 ch02
Firas Husseini
Rsh qam11 ch01
Rsh qam11 ch01
Firas Husseini
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02
Firas Husseini
Render03 140622012601-phpapp02 (1)
Render03 140622012601-phpapp02 (1)
Firas Husseini
Render01edited 121120194704-phpapp02
Render01edited 121120194704-phpapp02
Firas Husseini
Render 09
Render 09
Firas Husseini
Quantitativeanalysisfordecisionmaking 13427543542352-phpapp02-120719222252-ph...
Quantitativeanalysisfordecisionmaking 13427543542352-phpapp02-120719222252-ph...
Firas Husseini
More from Firas Husseini
(20)
Ali M Fadel CV
Ali M Fadel CV
Transportation problems1
Transportation problems1
Slides for ch08
Slides for ch08
Slides for ch07
Slides for ch07
Slides for ch06
Slides for ch06
Rsh qam11 ch10 ge
Rsh qam11 ch10 ge
Rsh qam11 ch09 ge
Rsh qam11 ch09 ge
Rsh qam11 ch08 ge
Rsh qam11 ch08 ge
Rsh qam11 ch07 ge
Rsh qam11 ch07 ge
Rsh qam11 ch06 ge
Rsh qam11 ch06 ge
Rsh qam11 ch05 ge
Rsh qam11 ch05 ge
Rsh qam11 ch03
Rsh qam11 ch03
Rsh qam11 ch03 ge
Rsh qam11 ch03 ge
Rsh qam11 ch02
Rsh qam11 ch02
Rsh qam11 ch01
Rsh qam11 ch01
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02 (1)
Render03 140622012601-phpapp02 (1)
Render01edited 121120194704-phpapp02
Render01edited 121120194704-phpapp02
Render 09
Render 09
Quantitativeanalysisfordecisionmaking 13427543542352-phpapp02-120719222252-ph...
Quantitativeanalysisfordecisionmaking 13427543542352-phpapp02-120719222252-ph...
Recently uploaded
Organizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
Seta Wicaksana
HomeRoots Pitch Deck | Investor Insights | April 2024
HomeRoots Pitch Deck | Investor Insights | April 2024
Hector Del Castillo, CPM, CPMM
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
NadhimTaha
Power point presentation on enterprise performance management
Power point presentation on enterprise performance management
VaishnaviGunji
Putting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptx
Cynthia Clay
New 2024 Cannabis Edibles Investor Pitch Deck Template
New 2024 Cannabis Edibles Investor Pitch Deck Template
CannaBusinessPlans
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
hemanthkumar470700
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
tarushabhavsar
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
DUBAI (+971)581248768 BUY ABORTION PILLS IN ABU dhabi...Qatar
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
meghakumariji156
Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for Viewing
Nauman Safdar
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
daisycvs
Lucknow Housewife Escorts by Sexy Bhabhi Service 8250092165
Lucknow Housewife Escorts by Sexy Bhabhi Service 8250092165
meghakumariji156
Famous Olympic Siblings from the 21st Century
Famous Olympic Siblings from the 21st Century
rwgiffor
Rice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna Exports
Shree Krishna Exports
BeMetals Investor Presentation_May 3, 2024.pdf
BeMetals Investor Presentation_May 3, 2024.pdf
DerekIwanaka1
Structuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdf
laloo_007
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
allensay1
Recently uploaded
(20)
Organizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
HomeRoots Pitch Deck | Investor Insights | April 2024
HomeRoots Pitch Deck | Investor Insights | April 2024
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
joint cost.pptx COST ACCOUNTING Sixteenth Edition ...
Power point presentation on enterprise performance management
Power point presentation on enterprise performance management
Putting the SPARK into Virtual Training.pptx
Putting the SPARK into Virtual Training.pptx
New 2024 Cannabis Edibles Investor Pitch Deck Template
New 2024 Cannabis Edibles Investor Pitch Deck Template
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
Over the Top (OTT) Market Size & Growth Outlook 2024-2030
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investors
Marel Q1 2024 Investor Presentation from May 8, 2024
Marel Q1 2024 Investor Presentation from May 8, 2024
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
!~+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUD...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Escorts in Nungambakkam Phone 8250092165 Enjoy 24/7 Escort Service Enjoy Your...
Mckinsey foundation level Handbook for Viewing
Mckinsey foundation level Handbook for Viewing
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
The Abortion pills for sale in Qatar@Doha [+27737758557] []Deira Dubai Kuwait
Lucknow Housewife Escorts by Sexy Bhabhi Service 8250092165
Lucknow Housewife Escorts by Sexy Bhabhi Service 8250092165
Famous Olympic Siblings from the 21st Century
Famous Olympic Siblings from the 21st Century
Rice Manufacturers in India | Shree Krishna Exports
Rice Manufacturers in India | Shree Krishna Exports
BeMetals Investor Presentation_May 3, 2024.pdf
BeMetals Investor Presentation_May 3, 2024.pdf
Structuring and Writing DRL Mckinsey (1).pdf
Structuring and Writing DRL Mckinsey (1).pdf
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
Al Mizhar Dubai Escorts +971561403006 Escorts Service In Al Mizhar
04 regression
1.
© 2008 Prentice-Hall,
Inc. Chapter 4 To accompany Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Power Point slides created by Jeff Heyl Regression Models © 2009 Prentice-Hall, Inc.
2.
© 2009 Prentice-Hall,
Inc. 4 – 2 Learning Objectives 1. Identify variables and use them in a regression model 2. Develop simple linear regression equations from sample data and interpret the slope and intercept 3. Compute the coefficient of determination and the coefficient of correlation and interpret their meanings 4. Interpret the F-test in a linear regression model 5. List the assumptions used in regression and use residual plots to identify problems After completing this chapter, students will be able to:After completing this chapter, students will be able to:
3.
© 2009 Prentice-Hall,
Inc. 4 – 3 Learning Objectives 6. Develop a multiple regression model and use it to predict 7. Use dummy variables to model categorical data 8. Determine which variables should be included in a multiple regression model 9. Transform a nonlinear function into a linear one for use in regression 10. Understand and avoid common mistakes made in the use of regression analysis After completing this chapter, students will be able to:After completing this chapter, students will be able to:
4.
© 2009 Prentice-Hall,
Inc. 4 – 4 Chapter Outline 4.1 Introduction 4.2 Scatter Diagrams 4.3 Simple Linear Regression 4.4 Measuring the Fit of the Regression Model 4.5 Using Computer Software for Regression 4.6 Assumptions of the Regression Model
5.
© 2009 Prentice-Hall,
Inc. 4 – 5 Chapter Outline 4.7 Testing the Model for Significance 4.8 Multiple Regression Analysis 4.9 Binary or Dummy Variables 4.10 Model Building 4.11 Nonlinear Regression 4.12 Cautions and Pitfalls in Regression Analysis
6.
© 2009 Prentice-Hall,
Inc. 4 – 6 Introduction Regression analysisRegression analysis is a very valuable tool for a manager Regression can be used to Understand the relationship between variables Predict the value of one variable based on another variable Examples Determining best location for a new store Studying the effectiveness of advertising dollars in increasing sales volume
7.
© 2009 Prentice-Hall,
Inc. 4 – 7 Introduction The variable to be predicted is called the dependent variabledependent variable Sometimes called the response variableresponse variable The value of this variable depends on the value of the independent variableindependent variable Sometimes called the explanatoryexplanatory or predictor variablepredictor variable Independent variable Dependent variable Independent variable = +
8.
© 2009 Prentice-Hall,
Inc. 4 – 8 Scatter Diagram Graphing is a helpful way to investigate the relationship between variables A scatter diagramscatter diagram or scatter plotscatter plot is often used The independent variable is normally plotted on the X axis The dependent variable is normally plotted on the Y axis
9.
© 2009 Prentice-Hall,
Inc. 4 – 9 Triple A Construction Triple A Construction renovates old homes They have found that the dollar volume of renovation work is dependent on the area payroll TRIPLE A’S SALES ($100,000’s) LOCAL PAYROLL ($100,000,000’s) 6 3 8 4 9 6 5 4 4.5 2 9.5 5 Table 4.1
10.
© 2009 Prentice-Hall,
Inc. 4 – 10 Triple A Construction Figure 4.1 12 – 10 – 8 – 6 – 4 – 2 – 0 – Sales($100,000) Payroll ($100 million) | | | | | | | | 0 1 2 3 4 5 6 7 8
11.
© 2009 Prentice-Hall,
Inc. 4 – 11 Simple Linear Regression where Y = dependent variable (response) X = independent variable (predictor or explanatory) β0 = intercept (value of Y when X = 0) β1 = slope of the regression line ε = random error Regression models are used to test if there is a relationship between variables (predict sales based on payroll) There is some random error that cannot be predicted εββ ++= XY 10
12.
© 2009 Prentice-Hall,
Inc. 4 – 12 Simple Linear Regression True values for the slope and intercept are not known so they are estimated using sample data XbbY 10 +=ˆ where Y = dependent variable (response) X = independent variable (predictor or explanatory) b0 = intercept (value of Y when X = 0) b1 = slope of the regression line ^
13.
© 2009 Prentice-Hall,
Inc. 4 – 13 Triple A Construction Triple A Construction is trying to predict sales based on area payroll Y = Sales X = Area payroll The line chosen in Figure 4.1 is the one that minimizes the errors Error = (Actual value) – (Predicted value) YYe ˆ−=
14.
© 2009 Prentice-Hall,
Inc. 4 – 14 Least Squares Regression Errors can be positive or negative so the average error could be zero even though individual errors could be large. Least squares regression minimizes the sum of the squared errors. Payroll Line Fit Plot 0 2 4 6 8 10 0 2 4 6 8 Payroll ($100.000,000's) Sales ($100,000)
15.
© 2009 Prentice-Hall,
Inc. 4 – 15 Triple A Construction For the simple linear regression model, the values of the intercept and slope can be calculated using the formulas below XbbY 10 +=ˆ valuesof(mean)average X n X X == ∑ valuesof(mean)average Y n Y Y == ∑ ∑ ∑ − −− = 21 )( ))(( XX YYXX b XbYb 10 −=
16.
© 2009 Prentice-Hall,
Inc. 4 – 16 Triple A Construction Y X (X – X)2 (X – X)(Y – Y) 6 3 (3 – 4)2 = 1 (3 – 4)(6 – 7) = 1 8 4 (4 – 4)2 = 0 (4 – 4)(8 – 7) = 0 9 6 (6 – 4)2 = 4 (6 – 4)(9 – 7) = 4 5 4 (4 – 4)2 = 0 (4 – 4)(5 – 7) = 0 4.5 2 (2 – 4)2 = 4 (2 – 4)(4.5 – 7) = 5 9.5 5 (5 – 4)2 = 1 (5 – 4)(9.5 – 7) = 2.5 ΣY = 42 Y = 42/6 = 7 ΣX = 24 X = 24/6 = 4 Σ(X – X)2 = 10 Σ(X – X)(Y – Y) = 12.5 Table 4.2 Regression calculations
17.
© 2009 Prentice-Hall,
Inc. 4 – 17 Triple A Construction 4 6 24 6 === ∑ X X 7 6 42 6 === ∑Y Y 251 10 512 21 . . )( ))(( == − −− = ∑ ∑ XX YYXX b 24251710 =−=−= ))(.(XbYb Regression calculations XY 2512 .ˆ +=Therefore
18.
© 2009 Prentice-Hall,
Inc. 4 – 18 Triple A Construction 4 6 24 6 === ∑ X X 7 6 42 6 === ∑Y Y 251 10 512 21 . . )( ))(( == − −− = ∑ ∑ XX YYXX b 24251710 =−=−= ))(.(XbYb Regression calculations XY 2512 .ˆ +=Therefore sales = 2 + 1.25(payroll) If the payroll next year is $600 million 000950$or5962512 ,.)(.ˆ =+=Y
19.
© 2009 Prentice-Hall,
Inc. 4 – 19 Measuring the Fit of the Regression Model Regression models can be developed for any variables X and Y How do we know the model is actually helpful in predicting Y based on X? We could just take the average error, but the positive and negative errors would cancel each other out Three measures of variability are SST – Total variability about the mean SSE – Variability about the regression line SSR – Total variability that is explained by the model
20.
© 2009 Prentice-Hall,
Inc. 4 – 20 Measuring the Fit of the Regression Model Sum of the squares total 2 )(∑ −= YYSST Sum of the squared error ∑ ∑ −== 22 )ˆ( YYeSSE Sum of squares due to regression ∑ −= 2 )ˆ( YYSSR An important relationship SSESSRSST +=
21.
© 2009 Prentice-Hall,
Inc. 4 – 21 Measuring the Fit of the Regression Model Y X (Y – Y)2 Y (Y – Y)2 (Y – Y)2 6 3 (6 – 7)2 = 1 2 + 1.25(3) = 5.75 0.0625 1.563 8 4 (8 – 7)2 = 1 2 + 1.25(4) = 7.00 1 0 9 6 (9 – 7)2 = 4 2 + 1.25(6) = 9.50 0.25 6.25 5 4 (5 – 7)2 = 4 2 + 1.25(4) = 7.00 4 0 4.5 2 (4.5 – 7)2 = 6.25 2 + 1.25(2) = 4.50 0 6.25 9.5 5 (9.5 – 7)2 = 6.25 2 + 1.25(5) = 8.25 1.5625 1.563 ∑(Y – Y)2 = 22.5 ∑(Y – Y)2 = 6.875 ∑(Y – Y)2 = 15.625 Y = 7 SST = 22.5 SSE = 6.875 SSR = 15.625 ^ ^^ ^^ Table 4.3
22.
© 2009 Prentice-Hall,
Inc. 4 – 22 Sum of the squares total 2 )(∑ −= YYSST Sum of the squared error ∑ ∑ −== 22 )ˆ( YYeSSE Sum of squares due to regression ∑ −= 2 )ˆ( YYSSR An important relationship SSR – explained variability SSE – unexplained variability SSESSRSST += Measuring the Fit of the Regression Model For Triple A Construction SST = 22.5 SSE = 6.875 SSR = 15.625
23.
© 2009 Prentice-Hall,
Inc. 4 – 23 Measuring the Fit of the Regression Model Figure 4.2 12 – 10 – 8 – 6 – 4 – 2 – 0 – Sales($100,000) Payroll ($100 million) | | | | | | | | 0 1 2 3 4 5 6 7 8 Y = 2 + 1.25X ^ Y – Y Y – Y ^ YY – Y ^
24.
© 2009 Prentice-Hall,
Inc. 4 – 24 Coefficient of Determination The proportion of the variability in Y explained by regression equation is called the coefficient ofcoefficient of determinationdetermination The coefficient of determination is r2 SST SSE SST SSR r −== 12 For Triple A Construction 69440 522 625152 . . . ==r About 69% of the variability in Y is explained by the equation based on payroll (X)
25.
© 2009 Prentice-Hall,
Inc. 4 – 25 Correlation Coefficient The correlation coefficientcorrelation coefficient is an expression of the strength of the linear relationship It will always be between +1 and –1 The correlation coefficient is r 2 rr = For Triple A Construction 8333069440 .. ==r
26.
© 2009 Prentice-Hall,
Inc. 4 – 26 Correlation Coefficient * * * * (a) Perfect Positive Correlation: r = +1 X Y * * * * (c) No Correlation: r = 0 X Y * * * * * * * ** * (d) Perfect Negative Correlation: r = –1 X Y * * * * * * * * * (b) Positive Correlation: 0 < r < 1 X Y * * * * * * * Figure 4.3
27.
© 2009 Prentice-Hall,
Inc. 4 – 27 Using Computer Software for Regression Program 4.1A
28.
© 2009 Prentice-Hall,
Inc. 4 – 28 Using Computer Software for Regression Program 4.1B
29.
© 2009 Prentice-Hall,
Inc. 4 – 29 Using Computer Software for Regression Program 4.1C
30.
© 2009 Prentice-Hall,
Inc. 4 – 30 Using Computer Software for Regression Program 4.1D
31.
© 2009 Prentice-Hall,
Inc. 4 – 31 Using Computer Software for Regression Program 4.1D Correlation coefficient is called Multiple R in Excel
32.
© 2009 Prentice-Hall,
Inc. 4 – 32 Assumptions of the Regression Model 1. Errors are independent 2. Errors are normally distributed 3. Errors have a mean of zero 4. Errors have a constant variance If we make certain assumptions about the errors in a regression model, we can perform statistical tests to determine if the model is useful A plot of the residuals (errors) will often highlight any glaring violations of the assumption
33.
© 2009 Prentice-Hall,
Inc. 4 – 33 Residual Plots A random plot of residuals Figure 4.4A Error X
34.
© 2009 Prentice-Hall,
Inc. 4 – 34 Residual Plots Nonconstant error variance Errors increase as X increases, violating the constant variance assumption Figure 4.4B Error X
35.
© 2009 Prentice-Hall,
Inc. 4 – 35 Residual Plots Nonlinear relationship Errors consistently increasing and then consistentlyErrors consistently increasing and then consistently decreasing indicate that the model is not lineardecreasing indicate that the model is not linear Figure 4.4C Error X
36.
© 2009 Prentice-Hall,
Inc. 4 – 36 Estimating the Variance Errors are assumed to have a constant variance (σ 2 ), but we usually don’t know this It can be estimated using the meanmean squared errorsquared error (MSEMSE), s2 1 2 −− == kn SSE MSEs where n = number of observations in the sample k = number of independent variables
37.
© 2009 Prentice-Hall,
Inc. 4 – 37 Estimating the Variance For Triple A Construction 71881 4 87506 116 87506 1 2 . .. == −− = −− == kn SSE MSEs We can estimate the standard deviation, s This is also called the standard error of thestandard error of the estimateestimate or the standard deviation of thestandard deviation of the regressionregression 31171881 .. === MSEs
38.
© 2009 Prentice-Hall,
Inc. 4 – 38 Testing the Model for Significance When the sample size is too small, you can get good values for MSE and r2 even if there is no relationship between the variables Testing the model for significance helps determine if the values are meaningful We do this by performing a statistical hypothesis test
39.
© 2009 Prentice-Hall,
Inc. 4 – 39 Testing the Model for Significance We start with the general linear model εββ ++= XY 10 If β1 = 0, the null hypothesis is that there is nono relationship between X and Y The alternate hypothesis is that there isis a linear relationship (β1 ≠ 0) If the null hypothesis can be rejected, we have proven there is a relationship We use the F statistic for this test
40.
© 2009 Prentice-Hall,
Inc. 4 – 40 Testing the Model for Significance The F statistic is based on the MSE and MSR k SSR MSR = where k = number of independent variables in the model The F statistic is MSE MSR F = This describes an F distribution with degrees of freedom for the numerator = df1 = k degrees of freedom for the denominator = df2 = n – k – 1
41.
© 2009 Prentice-Hall,
Inc. 4 – 41 Testing the Model for Significance If there is very little error, the MSE would be small and the F-statistic would be large indicating the model is useful If the F-statistic is large, the significance level (p-value) will be low, indicating it is unlikely this would have occurred by chance So when the F-value is large, we can reject the null hypothesis and accept that there is a linear relationship between X and Y and the values of the MSE and r2 are meaningful
42.
© 2009 Prentice-Hall,
Inc. 4 – 42 Steps in a Hypothesis Test 1. Specify null and alternative hypotheses 010 =β:H 011 ≠β:H 2. Select the level of significance (α). Common values are 0.01 and 0.05 3. Calculate the value of the test statistic using the formula MSE MSR F =
43.
© 2009 Prentice-Hall,
Inc. 4 – 43 Steps in a Hypothesis Test 4. Make a decision using one of the following methods a) Reject the null hypothesis if the test statistic is greater than the F-value from the table in Appendix D. Otherwise, do not reject the null hypothesis: 21 ifReject dfdfcalculated FF ,,α> kdf =1 12 −−= kndf b) Reject the null hypothesis if the observed significance level, or p-value, is less than the level of significance (α). Otherwise, do not reject the null hypothesis: )( statistictestcalculatedvalue- >= FPp α<value-ifReject p
44.
© 2009 Prentice-Hall,
Inc. 4 – 44 Triple A Construction Step 1.Step 1. H0: β1 = 0 (no linear relationship between X and Y) H1: β1 ≠ 0 (linear relationship exists between X and Y)Step 2.Step 2. Select α = 0.05 625015 1 625015 . . === k SSR MSR 099 71881 625015 . . . === MSE MSR F Step 3.Step 3. Calculate the value of the test statistic
45.
© 2009 Prentice-Hall,
Inc. 4 – 45 Triple A Construction Step 4.Step 4. Reject the null hypothesis if the test statistic is greater than the F-value in Appendix D df1 = k = 1 df2 = n – k – 1 = 6 – 1 – 1 = 4 The value of F associated with a 5% level of significance and with degrees of freedom 1 and 4 is found in Appendix D F0.05,1,4 = 7.71 Fcalculated = 9.09 Reject H0 because 9.09 > 7.71
46.
© 2009 Prentice-Hall,
Inc. 4 – 46 F = 7.71 0.05 9.09 Triple A Construction Figure 4.5 We can conclude there is a statistically significant relationship between X and Y The r2 value of 0.69 means about 69% of the variability in sales (Y) is explained by local payroll (X)
47.
© 2009 Prentice-Hall,
Inc. 4 – 47 r2 coefficient of determination The F-test determines whether or not there is a relationship between the variables. r2 (coefficient of determination) is the best measure of the strength of the prediction relationship between the X and Y variables. • Values closer to 1 indicate a strong prediction relationship. • Good regression models have a low significance level for the F-test and high r2 value.
48.
© 2009 Prentice-Hall,
Inc. 4 – 48 Coefficient Hypotheses Statistical tests of significance can be performed on the coefficients. The null hypothesis is that the coefficient of X (i.e., the slope of the line) is 0 i.e., X is not useful in predicting Y P values are the observed significance level and can be used to test the null hypothesis. Values less than 5% negate the null hypothesis and indicate that X is useful in predicting Y For a simple linear regression, the test of the regression coefficients gives the same information as the F-test.
49.
© 2009 Prentice-Hall,
Inc. 4 – 49 Analysis of Variance (ANOVA) Table When software is used to develop a regression model, an ANOVA table is typically created that shows the observed significance level (p-value) for the calculated F value This can be compared to the level of significance (α) to make a decision DF SS MS F SIGNIFICANCE Regression k SSR MSR = SSR/k MSR/MSE P(F > MSR/MSE) Residual n - k - 1 SSE MSE = SSE/(n - k - 1) Total n - 1 SST Table 4.4
50.
© 2009 Prentice-Hall,
Inc. 4 – 50 ANOVA for Triple A Construction Because this probability is less than 0.05, we reject the null hypothesis of no linear relationship and conclude there is a linear relationship between X and Y Program 4.1D (partial) P(F > 9.0909) = 0.0394
51.
© 2009 Prentice-Hall,
Inc. 4 – 51 Multiple Regression Analysis Multiple regression modelsMultiple regression models are extensions to the simple linear model and allow the creation of models with several independent variables Y = β0 + β1X1 + β2X2 + … + βkXk + ε where Y = dependent variable (response variable) Xi = ith independent variable (predictor or explanatory variable) β0 = intercept (value of Y when all Xi = 0) βI = coefficient of the ith independent variable k = number of independent variables ε = random error
52.
© 2009 Prentice-Hall,
Inc. 4 – 52 Multiple Regression Analysis To estimate these values, a sample is taken the following equation developed kk XbXbXbbY ++++= ...ˆ 22110 where = predicted value of Y b0 = sample intercept (and is an estimate of β0) bi = sample coefficient of the ith variable (and is an estimate of βi) Yˆ
53.
© 2009 Prentice-Hall,
Inc. 4 – 53 Jenny Wilson Realty Jenny Wilson wants to develop a model to determine the suggested listing price for houses based on the size and age of the house kk XbXbXbbY ++++= ...ˆ 22110 where = predicted value of dependent variable (selling price) b0 = Y intercept X1 and X2 = value of the two independent variables (square footage and age) respectively b1 and b2 = slopes for X1 and X2 respectively Yˆ She selects a sample of houses that have sold recently and records the data shown in Table 4.5
54.
© 2009 Prentice-Hall,
Inc. 4 – 54 Jenny Wilson Realty SELLING PRICE ($) SQUARE FOOTAGE AGE CONDITION 95,000 1,926 30 Good 119,000 2,069 40 Excellent 124,800 1,720 30 Excellent 135,000 1,396 15 Good 142,000 1,706 32 Mint 145,000 1,847 38 Mint 159,000 1,950 27 Mint 165,000 2,323 30 Excellent 182,000 2,285 26 Mint 183,000 3,752 35 Good 200,000 2,300 18 Good 211,000 2,525 17 Good 215,000 3,800 40 Excellent 219,000 1,740 12 Mint Table 4.5
55.
© 2009 Prentice-Hall,
Inc. 4 – 55 Jenny Wilson Realty Program 4.2 21 289944146631 XXY −+=ˆ
56.
© 2009 Prentice-Hall,
Inc. 4 – 56 Evaluating Multiple Regression Models Evaluation is similar to simple linear regression models The p-value for the F-test and r2 are interpreted the same The hypothesis is different because there is more than one independent variable The F-test is investigating whether all the coefficients are equal to 0
57.
© 2009 Prentice-Hall,
Inc. 4 – 57 Evaluating Multiple Regression Models To determine which independent variables are significant, tests are performed for each variable 010 =β:H 011 ≠β:H The test statistic is calculated and if the p-value is lower than the level of significance (α), the null hypothesis is rejected
58.
© 2009 Prentice-Hall,
Inc. 4 – 58 Jenny Wilson Realty The model is statistically significant The p-value for the F-test is 0.002 r2 = 0.6719 so the model explains about 67% of the variation in selling price (Y) But the F-test is for the entire model and we can’t tell if one or both of the independent variables are significant By calculating the p-value of each variable, we can assess the significance of the individual variables Since the p-value for X1 (square footage) and X2 (age) are both less than the significance level of 0.05, both null hypotheses can be rejected
59.
© 2009 Prentice-Hall,
Inc. 4 – 59 Binary or Dummy Variables BinaryBinary (or dummydummy or indicatorindicator) variables are special variables created for qualitative data A dummy variable is assigned a value of 1 if a particular condition is met and a value of 0 otherwise The number of dummy variables must equal one less than the number of categories of the qualitative variable
60.
© 2009 Prentice-Hall,
Inc. 4 – 60 Jenny Wilson Realty Jenny believes a better model can be developed if she includes information about the condition of the property X3 = 1 if house is in excellent condition = 0 otherwise X4 = 1 if house is in mint condition = 0 otherwise Two dummy variables are used to describe the three categories of condition No variable is needed for “good” condition since if both X3 and X4 = 0, the house must be in good condition
61.
© 2009 Prentice-Hall,
Inc. 4 – 61 Jenny Wilson Realty Program 4.3
62.
© 2009 Prentice-Hall,
Inc. 4 – 62 Jenny Wilson Realty Program 4.3 Model explains about 90% of the variation in selling price F-value indicates significance Low p-values indicate each variable is significant 4321 369471623396234356658121 XXXXY ,,,.,ˆ ++−+=
63.
© 2009 Prentice-Hall,
Inc. 4 – 63 Model Building The best model is a statistically significant model with a high r2 and few variables As more variables are added to the model, the r2 -value usually increases For this reason, the adjustedadjusted rr22 value is often used to determine the usefulness of an additional variable The adjusted r2 takes into account the number of independent variables in the model When variables are added to the model, the value of r2 can never decrease; however, the adjusted r2 may decrease.
64.
© 2009 Prentice-Hall,
Inc. 4 – 64 Model Building SST SSE SST SSR −== 12 r The formula for r2 The formula for adjusted r2 )/(SST )/(SSE 1 1 1Adjusted 2 − −− −= n kn r As the number of variables increases, the adjusted r2 gets smaller unless the increase due to the new variable is large enough to offset the change in k
65.
© 2009 Prentice-Hall,
Inc. 4 – 65 Model Building It is tempting to keep adding variables to a model to try to increase r2 The adjusted r2 will decrease if additional independent variables are not beneficial. As the number of variables (k) increases, n-k-1 decreases. This causes SSE/(n-k-1) to increase which in turn decreases the adjusted r2 unless the extra variable causes a significant decrease in SSE The reduction in error (and SSE) must be sufficient to offset the change in k
66.
© 2009 Prentice-Hall,
Inc. 4 – 66 Model Building In general, if a new variable increases the adjusted r2 , it should probably be included in the model In some cases, variables contain duplicate information When two independent variables are correlated, they are said to be collinearcollinear (e.g., monthly salary(e.g., monthly salary expenses and annual salary expenses)expenses and annual salary expenses) When more than two independent variables are correlated, multicollinearitymulticollinearity exists When multicollinearity is present, hypothesis tests for the individual coefficients are not valid but the model may still be useful
67.
© 2009 Prentice-Hall,
Inc. 4 – 67 Nonlinear Regression In some situations, variables are not linear Transformations may be used to turn a nonlinear model into a linear model * * ** ** * * * Linear relationship Nonlinear relationship * * ** ** * * ** *
68.
© 2009 Prentice-Hall,
Inc. 4 – 68 Colonel Motors The engineers want to use regression analysis to improve fuel efficiency They have been asked to study the impact of weight on miles per gallon (MPG) MPG WEIGHT (1,000 LBS.) MPG WEIGHT (1,000 LBS.) 12 4.58 20 3.18 13 4.66 23 2.68 15 4.02 24 2.65 18 2.53 33 1.70 19 3.09 36 1.95 19 3.11 42 1.92 Table 4.6
69.
© 2009 Prentice-Hall,
Inc. 4 – 69 Colonel Motors Figure 4.6A 45 – 40 – 35 – 30 – 25 – 20 – 15 – 10 – 5 – 0 – | | | | | 1.00 2.00 3.00 4.00 5.00 MPG Weight (1,000 lb.) Linear model 110 XbbY +=ˆ
70.
© 2009 Prentice-Hall,
Inc. 4 – 70 Colonel Motors Program 4.4 A useful model with a small F-test for significance and a good r2 value
71.
© 2009 Prentice-Hall,
Inc. 4 – 71 Colonel Motors Figure 4.6B 45 – 40 – 35 – 30 – 25 – 20 – 15 – 10 – 5 – 0 – | | | | | 1.00 2.00 3.00 4.00 5.00 MPG Weight (1,000 lb.) Nonlinear model 2 210 weightweight )()(MPG bbb ++=
72.
© 2009 Prentice-Hall,
Inc. 4 – 72 Colonel Motors The nonlinear model is a quadratic model The easiest way to work with this model is to develop a new variable 2 2 weight)(=X This gives us a model that can be solved with linear regression software 22110 XbXbbY ++=ˆ
73.
© 2009 Prentice-Hall,
Inc. 4 – 73 Colonel Motors Program 4.5 A better model with a smaller F-test for significance and a larger adjusted r2 value 21 43230879 XXY ...ˆ +−=
74.
© 2009 Prentice-Hall,
Inc. 4 – 74 Cautions and Pitfalls If the assumptions are not met, the statistical test may not be valid Correlation does not necessarily mean causation Your annual salary and the price of cars may be correlated but one does not cause the other Multicollinearity makes interpreting coefficients problematic, but the model may still be good Using a regression model beyond the range of X is questionable, the relationship may not hold outside the sample data
75.
© 2009 Prentice-Hall,
Inc. 4 – 75 Cautions and Pitfalls t-tests for the intercept (b0) may be ignored as this point is often outside the range of the model A linear relationship may not be the best relationship, even if the F-test returns an acceptable value A nonlinear relationship can exist even if a linear relationship does not Just because a relationship is statistically significant doesn't mean it has any practical value
Download now