4. Is a survey the right research method? Yes No I know a lot about the topic I need to summarize the findings in numerical format I donât need a lot of detail and nuance I need to generalize the results to the population I need to predict the likelihood of a certain thing happening I want to measure incremental change I donât really know much about the topic I donât need to summarize the findings in numerical format I need to communicate a lot of detail and nuance Iâm interested in case study information Iâm not planning on predicting the likelihood of anything I donât need to measure any change
5. Is it time to do a survey? Clear idea of all possible questions and answers? Formulated all questions and possible answers? Yes Do a survey Yes No Pilot test the questions Yes No Discovered questions and answers through Qual research? Do more Qual research No
6. Asking good questions Mutually exclusive and exhaustive No overlap between answers All possible answers No double-barreled questions Wrong: âWhat do you think about our response times and customer service?â Right: âWhat is your opinion of our response time?â Focus on opinions or beliefs of participants Wrong: âHow usable is our Web site?â Right: âWhat are usersâ opinions of the siteâs look and feel?â Close-ended is best Cuts down on analysis time Demographic questions at the end
7. Sampling and its implications Probability Sample Non-probability Sample You can predict the likelihood of any single person being selected to participate Has some randomized element to it Allows for you to compare your findings to what you would expect with pure random events Allows for prediction of accuracy Allows for generalizing to the population at large Can use inferential techniques You cannot predict the likelihood of any person participating Has no random element to it Cannot be used to predict future likelihood of anything Cannot be used to generalize to the population at large Still provides some insight, particularly if you ask everyone in a group the same question Does not allow to estimate the accuracy of the results Cannot use inferential techniques
8. The lay of the land: descriptive statistics Summarizes the responses What is the most âtypicalâ response? Mean Mode Median How much variation is there between responses? Standard deviation Inter-quartile range
9. Predicting behavior: inferential statistics Infers or predicts future behavior Which respondents are more likely to⊠Cross-tabulation Which factors most influence Behavior Satisfaction etc
10. The tools you need Online Survey Tool Statistical Analysis Software
11. The skills you need Knowledge of the topic Ability to write good questions Familiarity with the survey tool Some basic knowledge of statistics A framework for writing the report Important to write the outline of the final report before you start!
12. The payoff youâll get âMore men are dissatisfied with the checkout process.â âYounger users are much more unhappy with customer service that older users.â âHigher-income individuals are the most unlikely to recommend this site to friends and family.â
13. What you wonât learn⊠Why arenât people coming to our site? How can we innovate on our current design? Why donât people finish the checkout process? What are the main characteristics of the people who donât come to our site?