SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Copyright © 2008, SAS Institute Inc. All rights reserved.
Practical Design for
Discrete Choice
Experiments
Bradley Jones, SAS Institute
August 13, 2008
Copyright © 2008, SAS Institute Inc. All rights reserved.
DEMA 2008, August 2008,
Cambridge
2
 Respondents indicate the alternative they prefer most in
each choice set
 Alternatives are called profiles
 Each profile is a combination of attribute levels
 Choice sets typically consist of two, three or four profiles
Discrete Choice Experiment Setup
Copyright © 2008, SAS Institute Inc. All rights reserved.
Example: Marketing a new laptop computer
Attributes Levels
Hard Drive 40 GB 80 GB
Speed 1.5 GHz 2.0 GHz
Battery Life 4 hours6 hours
Price $1,000 $1,200 $1,500
DEMA 2008, August 2008,
Cambridge
3
Copyright © 2008, SAS Institute Inc. All rights reserved.
Sample Choice Set
Hard Disk Speed Battery Price
40Gig 1.5GHz 6hours $1,000
40Gig 2.0GHz 4hours $1,500
Check the box for the laptop you prefer.
Profile 1
Profile 2
4DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
5
multinomial logit model
based on the random utilities model
where xjs represents the attribute levels and β is the set of
parameter values
probability of choosing alternative j in choice set s
Statistical model
ε′= +js js jsU xβ
=1
option chosen
in choice set
js
ts
js J
t
j e
p
s e
′
′
 
= ÷
  ∑
xβ
xβ
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
D criterion - minimize the determinant of the variance matrix of
the estimators:
( )( )1
det −
M Xβ,
Design optimality criterion
DEMA 2008, August 2008,
Cambridge
6
Equivalently – maximize the determinant of the
information matrix, M.
Copyright © 2008, SAS Institute Inc. All rights reserved.
7
Bayesian optimal designs:
• construct a prior distribution for the parameters
• find design that performs best on average
• Sándor & Wedel (2001, 2002, 2005)
Dependence on the unknown parameter, β
( ) ( ) ( ) ( )( )
1
,
S
s s s s s
s=
′ ′= −∑M Xβ X P β p β p β X
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Design for Nonlinear Models
To design an informative experiment …..
You need to know something about the response function …..
And about the parameter values.
8DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian D-Optimal Design
Bayesian ideas are natural to cope with the fact that
the information matrix, M, depends on β.
Chaloner and Larntz (1986) developed a Bayesian D-
Optimality criterion:
Φ(d) = ∫ log det [M(β;d)] p(β) dβ
9DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Computing Bayesian D-Optimal Designs
A major impediment to Bayesian D-optimal design
has been COMPUTATIONAL.
The integral over β can be VERY SLOW.
It must be computed MANY TIMES in the course of
finding an optimal design.
10DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian Computations
Gotwalt, Jones and Steinberg (2007) use a quadrature
method, due to Mysovskikh.
This method is guaranteed to exactly integrate all
polynomials up to 5th degree and all odd-degree
monomials.
With p parameters, it requires just O(p2) function evaluations.
11DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature
Assume a normal prior with independence.
• Center the integral about the prior mean.
• Scale each variable by its standard deviation.
• Integrate over distance from the prior mean and, at
each distance, over a spherical shell.
12DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature continued…
Radial integral: Generalized Gauss-LaGuerre
quadrature, with an extra point at the origin.
Spherical integrals: The Mysovskikh quadrature
scheme.
13DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Spherical integral
A simplex, its edge midpoints on the sphere, and
the inverses of all of these points.
Simplex point weights: p(7-p)/2(p+1)2(p+2).
Mid-point weights: 2(p-1)2/p(p+1)2(p+2).
14DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Simplex point
Mid-point
Each point is both a simplex
point and a mid-point.
All weights equal1/6.
Quadrature points in two dimensions
15DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Study Description
16 Respondents – 8 developers 8 sales & marketing
9 Male 7 Female
2 Surveys with 6 choice sets in each
Respondents were assigned randomly to surveys
blocked by job function
16DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Software Demonstration
17DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Conclusions
1) Discrete Choice Conjoint Experiments require design
methods for nonlinear models.
2) D-Optimal Bayesian designs reduce the dependence
of the design on the unknown parameters.
3) New quadrature methods make computation of these
designs much faster.
4) Commercial software makes carrying out such
studies simple and efficient.
18DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
References
Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press.
Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero
Ordinate,” Mathematics ofComputation, 19, 287-296.
Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304.
Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete
choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L.,
eds. Amsterdam: JAI Press, 93-117.
Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings
accepted at Technometrics.
Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307-
317.
McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New
York: Academic Press, 105-142.
Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs,
Technometrics 37: 60-69.
Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical
Association 92: 664-674.
Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research
38: 430-444.
19DEMA 2008, August 2008,
Cambridge

Weitere ähnliche Inhalte

Andere mochten auch

Manuel & diana trips
Manuel & diana tripsManuel & diana trips
Manuel & diana trips
varo99
 
Language presentation
Language presentationLanguage presentation
Language presentation
melodyschool
 
Pre production power point
Pre production power pointPre production power point
Pre production power point
ecsmedia
 
Angle shots
Angle shotsAngle shots
Angle shots
ecsmedia
 
Christmas!
Christmas!Christmas!
Christmas!
K8lin
 
Sosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessaSosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessa
Hannu Kuusela
 
Healthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectivaHealthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectiva
cecisromania
 
Pre production power pont`
Pre production power pont`Pre production power pont`
Pre production power pont`
ecsmedia
 
Eurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod defEurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod def
Irecoop Toscana
 
The doula advantage in Vietnamese
The doula advantage in VietnameseThe doula advantage in Vietnamese
The doula advantage in Vietnamese
doulaSON
 
Behaviorism slideshow Group 4
Behaviorism slideshow Group 4Behaviorism slideshow Group 4
Behaviorism slideshow Group 4
markyd2010
 

Andere mochten auch (20)

Manuel & diana trips
Manuel & diana tripsManuel & diana trips
Manuel & diana trips
 
Ipc overview
Ipc overviewIpc overview
Ipc overview
 
Pda charleston 2010
Pda charleston 2010Pda charleston 2010
Pda charleston 2010
 
Language presentation
Language presentationLanguage presentation
Language presentation
 
Pre production power point
Pre production power pointPre production power point
Pre production power point
 
Angle shots
Angle shotsAngle shots
Angle shots
 
Why Social Media?
Why Social Media?Why Social Media?
Why Social Media?
 
Christmas!
Christmas!Christmas!
Christmas!
 
Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)
 
Sosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessaSosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessa
 
Healthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectivaHealthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectiva
 
Pre production power pont`
Pre production power pont`Pre production power pont`
Pre production power pont`
 
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
 
Personal Leadership rev 1
Personal Leadership rev 1Personal Leadership rev 1
Personal Leadership rev 1
 
Eurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod defEurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod def
 
Guardians of the Leads Webinar
Guardians of the Leads WebinarGuardians of the Leads Webinar
Guardians of the Leads Webinar
 
Кашинка
КашинкаКашинка
Кашинка
 
20031009 053-002
20031009 053-00220031009 053-002
20031009 053-002
 
The doula advantage in Vietnamese
The doula advantage in VietnameseThe doula advantage in Vietnamese
The doula advantage in Vietnamese
 
Behaviorism slideshow Group 4
Behaviorism slideshow Group 4Behaviorism slideshow Group 4
Behaviorism slideshow Group 4
 

Ähnlich wie upload test

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
Anubhav Jain
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...
aimsnist
 

Ähnlich wie upload test (20)

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testing
 
Srikanta Mishra
Srikanta MishraSrikanta Mishra
Srikanta Mishra
 
Vldb14
Vldb14Vldb14
Vldb14
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1
 
Staad pro
Staad proStaad pro
Staad pro
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD Models
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep models
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradient
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design Problems
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 01
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic Hashing
 
Real Time Geodemographics
Real Time GeodemographicsReal Time Geodemographics
Real Time Geodemographics
 
Licentiate Defense Slide
Licentiate Defense SlideLicentiate Defense Slide
Licentiate Defense Slide
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...
 

Mehr von sahilsahoo85 (20)

sigproc-sp.pdf
sigproc-sp.pdfsigproc-sp.pdf
sigproc-sp.pdf
 
CHANGELOG.txt
CHANGELOG.txtCHANGELOG.txt
CHANGELOG.txt
 
testing_7.ppt
testing_7.ppttesting_7.ppt
testing_7.ppt
 
testing_6.ppt
testing_6.ppttesting_6.ppt
testing_6.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_4.ppt
testing_4.ppttesting_4.ppt
testing_4.ppt
 
testing_3.ppt
testing_3.ppttesting_3.ppt
testing_3.ppt
 
testing_2.ppt
testing_2.ppttesting_2.ppt
testing_2.ppt
 
testing_1.ppt
testing_1.ppttesting_1.ppt
testing_1.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
questionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtquestionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txt
 
ccccccc.ppt
ccccccc.pptccccccc.ppt
ccccccc.ppt
 
testing.ppt
testing.ppttesting.ppt
testing.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
upload test2
upload test2upload test2
upload test2
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Kürzlich hochgeladen (20)

What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 

upload test

  • 1. Copyright © 2008, SAS Institute Inc. All rights reserved. Practical Design for Discrete Choice Experiments Bradley Jones, SAS Institute August 13, 2008
  • 2. Copyright © 2008, SAS Institute Inc. All rights reserved. DEMA 2008, August 2008, Cambridge 2  Respondents indicate the alternative they prefer most in each choice set  Alternatives are called profiles  Each profile is a combination of attribute levels  Choice sets typically consist of two, three or four profiles Discrete Choice Experiment Setup
  • 3. Copyright © 2008, SAS Institute Inc. All rights reserved. Example: Marketing a new laptop computer Attributes Levels Hard Drive 40 GB 80 GB Speed 1.5 GHz 2.0 GHz Battery Life 4 hours6 hours Price $1,000 $1,200 $1,500 DEMA 2008, August 2008, Cambridge 3
  • 4. Copyright © 2008, SAS Institute Inc. All rights reserved. Sample Choice Set Hard Disk Speed Battery Price 40Gig 1.5GHz 6hours $1,000 40Gig 2.0GHz 4hours $1,500 Check the box for the laptop you prefer. Profile 1 Profile 2 4DEMA 2008, August 2008, Cambridge
  • 5. Copyright © 2008, SAS Institute Inc. All rights reserved. 5 multinomial logit model based on the random utilities model where xjs represents the attribute levels and β is the set of parameter values probability of choosing alternative j in choice set s Statistical model ε′= +js js jsU xβ =1 option chosen in choice set js ts js J t j e p s e ′ ′   = ÷   ∑ xβ xβ DEMA 2008, August 2008, Cambridge
  • 6. Copyright © 2008, SAS Institute Inc. All rights reserved. D criterion - minimize the determinant of the variance matrix of the estimators: ( )( )1 det − M Xβ, Design optimality criterion DEMA 2008, August 2008, Cambridge 6 Equivalently – maximize the determinant of the information matrix, M.
  • 7. Copyright © 2008, SAS Institute Inc. All rights reserved. 7 Bayesian optimal designs: • construct a prior distribution for the parameters • find design that performs best on average • Sándor & Wedel (2001, 2002, 2005) Dependence on the unknown parameter, β ( ) ( ) ( ) ( )( ) 1 , S s s s s s s= ′ ′= −∑M Xβ X P β p β p β X DEMA 2008, August 2008, Cambridge
  • 8. Copyright © 2008, SAS Institute Inc. All rights reserved. Design for Nonlinear Models To design an informative experiment ….. You need to know something about the response function ….. And about the parameter values. 8DEMA 2008, August 2008, Cambridge
  • 9. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian D-Optimal Design Bayesian ideas are natural to cope with the fact that the information matrix, M, depends on β. Chaloner and Larntz (1986) developed a Bayesian D- Optimality criterion: Φ(d) = ∫ log det [M(β;d)] p(β) dβ 9DEMA 2008, August 2008, Cambridge
  • 10. Copyright © 2008, SAS Institute Inc. All rights reserved. Computing Bayesian D-Optimal Designs A major impediment to Bayesian D-optimal design has been COMPUTATIONAL. The integral over β can be VERY SLOW. It must be computed MANY TIMES in the course of finding an optimal design. 10DEMA 2008, August 2008, Cambridge
  • 11. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian Computations Gotwalt, Jones and Steinberg (2007) use a quadrature method, due to Mysovskikh. This method is guaranteed to exactly integrate all polynomials up to 5th degree and all odd-degree monomials. With p parameters, it requires just O(p2) function evaluations. 11DEMA 2008, August 2008, Cambridge
  • 12. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature Assume a normal prior with independence. • Center the integral about the prior mean. • Scale each variable by its standard deviation. • Integrate over distance from the prior mean and, at each distance, over a spherical shell. 12DEMA 2008, August 2008, Cambridge
  • 13. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature continued… Radial integral: Generalized Gauss-LaGuerre quadrature, with an extra point at the origin. Spherical integrals: The Mysovskikh quadrature scheme. 13DEMA 2008, August 2008, Cambridge
  • 14. Copyright © 2008, SAS Institute Inc. All rights reserved. Spherical integral A simplex, its edge midpoints on the sphere, and the inverses of all of these points. Simplex point weights: p(7-p)/2(p+1)2(p+2). Mid-point weights: 2(p-1)2/p(p+1)2(p+2). 14DEMA 2008, August 2008, Cambridge
  • 15. Copyright © 2008, SAS Institute Inc. All rights reserved. Simplex point Mid-point Each point is both a simplex point and a mid-point. All weights equal1/6. Quadrature points in two dimensions 15DEMA 2008, August 2008, Cambridge
  • 16. Copyright © 2008, SAS Institute Inc. All rights reserved. Study Description 16 Respondents – 8 developers 8 sales & marketing 9 Male 7 Female 2 Surveys with 6 choice sets in each Respondents were assigned randomly to surveys blocked by job function 16DEMA 2008, August 2008, Cambridge
  • 17. Copyright © 2008, SAS Institute Inc. All rights reserved. Software Demonstration 17DEMA 2008, August 2008, Cambridge
  • 18. Copyright © 2008, SAS Institute Inc. All rights reserved. Conclusions 1) Discrete Choice Conjoint Experiments require design methods for nonlinear models. 2) D-Optimal Bayesian designs reduce the dependence of the design on the unknown parameters. 3) New quadrature methods make computation of these designs much faster. 4) Commercial software makes carrying out such studies simple and efficient. 18DEMA 2008, August 2008, Cambridge
  • 19. Copyright © 2008, SAS Institute Inc. All rights reserved. References Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press. Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero Ordinate,” Mathematics ofComputation, 19, 287-296. Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304. Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L., eds. Amsterdam: JAI Press, 93-117. Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings accepted at Technometrics. Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307- 317. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New York: Academic Press, 105-142. Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs, Technometrics 37: 60-69. Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical Association 92: 664-674. Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research 38: 430-444. 19DEMA 2008, August 2008, Cambridge