SlideShare ist ein Scribd-Unternehmen logo
1 von 30
It’s hard to understand people
How to get and make sense of qualitative insights


Johanna Kollmann - @johannakoll
Imperial College London, 20 November 2012




                                     Photo by NASA JSC Photo: http://www.flickr.com/photos/nasa_jsc_photo/7257865176
(Some) research methods (yeah we have a lot)
               Quantitative          Qualitative



             Surveys              Contextual inquiry
Generative   Interviews           Mental models
                                  Interviews
                                  Diary studies


             Automated card sort Usability testing
             Surveys               Moderated card sort
Evaluative   Automated studies Wizard of Oz
             Analytics
             A/B Testing
             Multi-variant testing


                                          Adapted from figures by Janice Fraser, Nate Bolt, Christian Rohrer
Before you leave the building
Plan who to talk to where about what and why


                     Photo by angelamaphone http://www.flickr.com/photos/angelamaphone/2663422833//
What topics shall the interview cover?

                                 Dieting
  Buying food

                                                      Exercise

                Preparing food



   Eating out
                                     Busy lifestyle


                    Struggles
Prompts rather than set questions

 Day-in-a-life (today, yesterday)
 Decide what to eat
 Last time on a diet
 How active (want vs. do)
 Preparing food for oneself
 Preparing food for family/friends
Have a ‘softball question’ ready


 Please tell me a little bit about your
         cooking this week.




                                          Could you tell me about the last
                                            dish you prepared yourself?
Photo by TheeErin: http://www.flickr.com/photos/theeerin/4729019845/
Out in the wild
Ask open questions – don’t lead

                YAY           NAY
                • Who         • Did
                • What        • Have
                • When        • Are
                • Where       • Were
                • Why         • Will
                • How

                                       Were you trying to do A or B?

What were you trying to do?
Some great all-purpose questions

• Has there ever been a time when you had x experience?
• Could you tell me about that?
• What was great about that?
• What was awful about that?
• Why did you do that?
• And then, what happened?
• If you had a magic wand, what would you make the situation be like?




                                                                        By Janice Fraser
Do’s and don’ts


                  Photo by Hilde Skjølberg http://www.flickr.com/photos/hebe/3004800079/
Do
Be the learner, not the expert
Ask naïve questions
Ask for specific stories
Allow people time to think
Listen!
Take notes or record
Take photos or collect artefacts




                                   Photo by Tomas Hellberg http://www.flickr.com/photos/tomhe/35312882/
Don’t
Be an interrogator
Ask questions that sound like blame, or argumentative
Ask for solutions
Try to solve problems during the interview
Ask what features people want
Ask people to imagine theoretical situations




                                               Photo by G Meyer http://www.flickr.com/photos/kainet/144703613/
Making sense of what you saw and heard
Photos taken at DesignJam London events by Rachel Winch and falkowata
Source: http://www.uie.com/articles/research_to_personas/
Business Model Canvas
Human activity systems
Soft Systems Methodology



                           Peter Checkland
Leverage points…

…places within a complex system where a small shift in
one thing can produce big changes in everything.
…are often counterintuitive.
Rich Picture




1. Construction of the Humber Bridge (adapted from Stewart and
Fortune, 1994) © The Open University




                                                                 2. Distance Learning Situation © Wood-Harper et al, Information
                                                                 Systems Definition: The Multiview Approach, Blackwell Scientific
                                                                 Publications 1985
Rich Picture elements


Stakeholders


Worldview


Connections


Conflicts




                        2. Distance Learning Situation © Wood-Harper et al, Information
                        Systems Definition: The Multiview Approach, Blackwell Scientific
                        Publications 1985
Resources
Notes from my Leancamp session on this topic http://johannakoll.posterous.com/ux-research-tips-
for-customer-development-not
Mental Models by Indi Young
Storytelling for User Experience by Whitney Quesenbery & Kevin Brooks
Remote Research by Nate Bolt & Tony Tulathimutte
Undercover User Experience by Cennydd Bowles
Designing for the Digital Age by Kim Goodwin
LUXr resources and materials by Janice Fraser (http://www.slideshare.net/clevergirl/) and Lane Halley
(http://www.slideshare.net/LaneHalley/)
Articles on User Interface Engineering (http://www.uie.com/browse/usability_testing/)
The intuitive mind is a sacred gift and the rational mind is a
faithful servant. We have created a society that honors the
servant and has forgotten the gift.

We will not solve the problems of the world from the same
level of thinking we were at when we created them. More
than anything else, this new century demands new thinking:

We must change our materially based analyses of the world
around us to include broader, more multidimensional
perspectives.

~Albert Einstein

Weitere ähnliche Inhalte

Was ist angesagt?

How To Improve Your Blog's Image With Images - From Podcamp Boston 2011
How To Improve Your Blog's Image With Images - From Podcamp Boston 2011How To Improve Your Blog's Image With Images - From Podcamp Boston 2011
How To Improve Your Blog's Image With Images - From Podcamp Boston 2011Tom Catalini
 
Hunter Stroh's PPP Slides
Hunter Stroh's PPP SlidesHunter Stroh's PPP Slides
Hunter Stroh's PPP SlidesHunter_Stroh
 
Science Experiments on Tablets
Science Experiments on TabletsScience Experiments on Tablets
Science Experiments on TabletsMonica Burns
 
Bringing Geography Back From the Dead [CCSS presentation]
Bringing Geography Back From the Dead [CCSS presentation]Bringing Geography Back From the Dead [CCSS presentation]
Bringing Geography Back From the Dead [CCSS presentation]Kishari Sing
 
As coursework powerpoint
As coursework powerpointAs coursework powerpoint
As coursework powerpointFrancis Gilbert
 
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshopMaking Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshopGene Golovchinsky
 
The Mini Report Protocol
The Mini Report ProtocolThe Mini Report Protocol
The Mini Report ProtocolJon Corippo
 
Nikole Cipriano Visual resume
Nikole Cipriano Visual resumeNikole Cipriano Visual resume
Nikole Cipriano Visual resumenikoleskye
 

Was ist angesagt? (10)

How To Improve Your Blog's Image With Images - From Podcamp Boston 2011
How To Improve Your Blog's Image With Images - From Podcamp Boston 2011How To Improve Your Blog's Image With Images - From Podcamp Boston 2011
How To Improve Your Blog's Image With Images - From Podcamp Boston 2011
 
Induction
InductionInduction
Induction
 
Hunter Stroh's PPP Slides
Hunter Stroh's PPP SlidesHunter Stroh's PPP Slides
Hunter Stroh's PPP Slides
 
Science Experiments on Tablets
Science Experiments on TabletsScience Experiments on Tablets
Science Experiments on Tablets
 
Go for IT
Go for ITGo for IT
Go for IT
 
Bringing Geography Back From the Dead [CCSS presentation]
Bringing Geography Back From the Dead [CCSS presentation]Bringing Geography Back From the Dead [CCSS presentation]
Bringing Geography Back From the Dead [CCSS presentation]
 
As coursework powerpoint
As coursework powerpointAs coursework powerpoint
As coursework powerpoint
 
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshopMaking Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
Making Sense Of Twitter Search - Ignite talk at CHI 2010 Microblogging workshop
 
The Mini Report Protocol
The Mini Report ProtocolThe Mini Report Protocol
The Mini Report Protocol
 
Nikole Cipriano Visual resume
Nikole Cipriano Visual resumeNikole Cipriano Visual resume
Nikole Cipriano Visual resume
 

Andere mochten auch

сзш №133 табір веселкова країна презентація 1 зміни
сзш №133 табір веселкова країна презентація 1 змінисзш №133 табір веселкова країна презентація 1 зміни
сзш №133 табір веселкова країна презентація 1 зміниshkola133
 
A comparison of the curriculums of the majors
A comparison of the curriculums of the majorsA comparison of the curriculums of the majors
A comparison of the curriculums of the majorssthela22
 
О необходимости разработки стратегии развития систем принятия решения в банке
О необходимости разработки стратегии развития систем принятия решения в банкеО необходимости разработки стратегии развития систем принятия решения в банке
О необходимости разработки стратегии развития систем принятия решения в банкеIhor Voloshyn
 

Andere mochten auch (7)

Education ture
Education            tureEducation            ture
Education ture
 
Ronin Media Digital Credentials
Ronin Media Digital CredentialsRonin Media Digital Credentials
Ronin Media Digital Credentials
 
Camtasia 1
Camtasia 1 Camtasia 1
Camtasia 1
 
Mc kinsey 7 s
Mc kinsey 7 sMc kinsey 7 s
Mc kinsey 7 s
 
сзш №133 табір веселкова країна презентація 1 зміни
сзш №133 табір веселкова країна презентація 1 змінисзш №133 табір веселкова країна презентація 1 зміни
сзш №133 табір веселкова країна презентація 1 зміни
 
A comparison of the curriculums of the majors
A comparison of the curriculums of the majorsA comparison of the curriculums of the majors
A comparison of the curriculums of the majors
 
О необходимости разработки стратегии развития систем принятия решения в банке
О необходимости разработки стратегии развития систем принятия решения в банкеО необходимости разработки стратегии развития систем принятия решения в банке
О необходимости разработки стратегии развития систем принятия решения в банке
 

Ähnlich wie ICStartup 3: customer development

How to get more than opinions: Interview techniques and advice
How to get more than opinions: Interview techniques and adviceHow to get more than opinions: Interview techniques and advice
How to get more than opinions: Interview techniques and advicejohanna kollmann
 
Researching people: using questionnaires and interviews
Researching people: using questionnaires and interviewsResearching people: using questionnaires and interviews
Researching people: using questionnaires and interviewsJenna Condie
 
Access services keynote bromberg 2015
Access services keynote bromberg 2015Access services keynote bromberg 2015
Access services keynote bromberg 2015Peter Bromberg
 
Activities for citizen science at science centers
Activities for citizen science at science centersActivities for citizen science at science centers
Activities for citizen science at science centersCitizenScience.org
 
Strassmann.creativity.in.research
Strassmann.creativity.in.researchStrassmann.creativity.in.research
Strassmann.creativity.in.researchJoanStrassmann
 
Classroom makeover day 1
Classroom makeover day 1Classroom makeover day 1
Classroom makeover day 1Liz Fogarty
 
Classroom Makeover Day 1
Classroom Makeover Day 1Classroom Makeover Day 1
Classroom Makeover Day 1Liz Fogarty
 
The Relationship Between Content and Innovation
The Relationship Between Content and InnovationThe Relationship Between Content and Innovation
The Relationship Between Content and InnovationMichael Coghlan
 
Too Much Info Agls Slides
Too Much Info Agls SlidesToo Much Info Agls Slides
Too Much Info Agls SlidesSarah Cohen
 
What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?Peter Jeschofnig
 
The OERu from the inside out and the outside in
The OERu from the inside out and the outside inThe OERu from the inside out and the outside in
The OERu from the inside out and the outside inwitthaus
 
sicsa-phd2016
sicsa-phd2016sicsa-phd2016
sicsa-phd2016turingfan
 
Blag your way in Qualitative Research
Blag your way in Qualitative ResearchBlag your way in Qualitative Research
Blag your way in Qualitative ResearchJason Rutter
 
Privacy Considerations in Online and Mobile Photo Sharing
Privacy Considerations in Online and Mobile Photo SharingPrivacy Considerations in Online and Mobile Photo Sharing
Privacy Considerations in Online and Mobile Photo Sharingmor
 
Multigenre Research & Composition: AASL 2011
Multigenre Research & Composition: AASL 2011Multigenre Research & Composition: AASL 2011
Multigenre Research & Composition: AASL 2011Elizabeth Friese
 
Innovation startups passion and life ver 3 (final)
Innovation startups passion and life ver 3 (final)Innovation startups passion and life ver 3 (final)
Innovation startups passion and life ver 3 (final)Upstarts.tv
 
Champlain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationChamplain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationMichelle Miller
 

Ähnlich wie ICStartup 3: customer development (20)

How to get more than opinions: Interview techniques and advice
How to get more than opinions: Interview techniques and adviceHow to get more than opinions: Interview techniques and advice
How to get more than opinions: Interview techniques and advice
 
Researching people: using questionnaires and interviews
Researching people: using questionnaires and interviewsResearching people: using questionnaires and interviews
Researching people: using questionnaires and interviews
 
Access services keynote bromberg 2015
Access services keynote bromberg 2015Access services keynote bromberg 2015
Access services keynote bromberg 2015
 
Activities for citizen science at science centers
Activities for citizen science at science centersActivities for citizen science at science centers
Activities for citizen science at science centers
 
Strassmann.creativity.in.research
Strassmann.creativity.in.researchStrassmann.creativity.in.research
Strassmann.creativity.in.research
 
Classroom makeover day 1
Classroom makeover day 1Classroom makeover day 1
Classroom makeover day 1
 
Google is NOT a Verb
Google is NOT a VerbGoogle is NOT a Verb
Google is NOT a Verb
 
Classroom Makeover Day 1
Classroom Makeover Day 1Classroom Makeover Day 1
Classroom Makeover Day 1
 
The Relationship Between Content and Innovation
The Relationship Between Content and InnovationThe Relationship Between Content and Innovation
The Relationship Between Content and Innovation
 
Too Much Info Agls Slides
Too Much Info Agls SlidesToo Much Info Agls Slides
Too Much Info Agls Slides
 
What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?What is Critical Thinking, and How to Teach It?
What is Critical Thinking, and How to Teach It?
 
The OERu from the inside out and the outside in
The OERu from the inside out and the outside inThe OERu from the inside out and the outside in
The OERu from the inside out and the outside in
 
sicsa-phd2016
sicsa-phd2016sicsa-phd2016
sicsa-phd2016
 
Escaping Datageddon
Escaping DatageddonEscaping Datageddon
Escaping Datageddon
 
Blag your way in Qualitative Research
Blag your way in Qualitative ResearchBlag your way in Qualitative Research
Blag your way in Qualitative Research
 
Privacy Considerations in Online and Mobile Photo Sharing
Privacy Considerations in Online and Mobile Photo SharingPrivacy Considerations in Online and Mobile Photo Sharing
Privacy Considerations in Online and Mobile Photo Sharing
 
Multigenre Research & Composition: AASL 2011
Multigenre Research & Composition: AASL 2011Multigenre Research & Composition: AASL 2011
Multigenre Research & Composition: AASL 2011
 
Innovation startups passion and life ver 3 (final)
Innovation startups passion and life ver 3 (final)Innovation startups passion and life ver 3 (final)
Innovation startups passion and life ver 3 (final)
 
U K O L N Feb 08
U K O L N  Feb 08U K O L N  Feb 08
U K O L N Feb 08
 
Champlain College LILAC 2010 Presentation
Champlain College LILAC 2010 PresentationChamplain College LILAC 2010 Presentation
Champlain College LILAC 2010 Presentation
 

ICStartup 3: customer development

  • 1. It’s hard to understand people How to get and make sense of qualitative insights Johanna Kollmann - @johannakoll Imperial College London, 20 November 2012 Photo by NASA JSC Photo: http://www.flickr.com/photos/nasa_jsc_photo/7257865176
  • 2. (Some) research methods (yeah we have a lot) Quantitative Qualitative Surveys Contextual inquiry Generative Interviews Mental models Interviews Diary studies Automated card sort Usability testing Surveys Moderated card sort Evaluative Automated studies Wizard of Oz Analytics A/B Testing Multi-variant testing Adapted from figures by Janice Fraser, Nate Bolt, Christian Rohrer
  • 3. Before you leave the building
  • 4. Plan who to talk to where about what and why Photo by angelamaphone http://www.flickr.com/photos/angelamaphone/2663422833//
  • 5.
  • 6.
  • 7. What topics shall the interview cover? Dieting Buying food Exercise Preparing food Eating out Busy lifestyle Struggles
  • 8. Prompts rather than set questions Day-in-a-life (today, yesterday) Decide what to eat Last time on a diet How active (want vs. do) Preparing food for oneself Preparing food for family/friends
  • 9. Have a ‘softball question’ ready Please tell me a little bit about your cooking this week. Could you tell me about the last dish you prepared yourself?
  • 10. Photo by TheeErin: http://www.flickr.com/photos/theeerin/4729019845/
  • 11. Out in the wild
  • 12. Ask open questions – don’t lead YAY NAY • Who • Did • What • Have • When • Are • Where • Were • Why • Will • How Were you trying to do A or B? What were you trying to do?
  • 13. Some great all-purpose questions • Has there ever been a time when you had x experience? • Could you tell me about that? • What was great about that? • What was awful about that? • Why did you do that? • And then, what happened? • If you had a magic wand, what would you make the situation be like? By Janice Fraser
  • 14. Do’s and don’ts Photo by Hilde Skjølberg http://www.flickr.com/photos/hebe/3004800079/
  • 15. Do Be the learner, not the expert Ask naïve questions Ask for specific stories Allow people time to think Listen! Take notes or record Take photos or collect artefacts Photo by Tomas Hellberg http://www.flickr.com/photos/tomhe/35312882/
  • 16. Don’t Be an interrogator Ask questions that sound like blame, or argumentative Ask for solutions Try to solve problems during the interview Ask what features people want Ask people to imagine theoretical situations Photo by G Meyer http://www.flickr.com/photos/kainet/144703613/
  • 17. Making sense of what you saw and heard
  • 18.
  • 19. Photos taken at DesignJam London events by Rachel Winch and falkowata
  • 22.
  • 23. Human activity systems Soft Systems Methodology Peter Checkland
  • 24. Leverage points… …places within a complex system where a small shift in one thing can produce big changes in everything. …are often counterintuitive.
  • 25. Rich Picture 1. Construction of the Humber Bridge (adapted from Stewart and Fortune, 1994) © The Open University 2. Distance Learning Situation © Wood-Harper et al, Information Systems Definition: The Multiview Approach, Blackwell Scientific Publications 1985
  • 26. Rich Picture elements Stakeholders Worldview Connections Conflicts 2. Distance Learning Situation © Wood-Harper et al, Information Systems Definition: The Multiview Approach, Blackwell Scientific Publications 1985
  • 27.
  • 28.
  • 29. Resources Notes from my Leancamp session on this topic http://johannakoll.posterous.com/ux-research-tips- for-customer-development-not Mental Models by Indi Young Storytelling for User Experience by Whitney Quesenbery & Kevin Brooks Remote Research by Nate Bolt & Tony Tulathimutte Undercover User Experience by Cennydd Bowles Designing for the Digital Age by Kim Goodwin LUXr resources and materials by Janice Fraser (http://www.slideshare.net/clevergirl/) and Lane Halley (http://www.slideshare.net/LaneHalley/) Articles on User Interface Engineering (http://www.uie.com/browse/usability_testing/)
  • 30. The intuitive mind is a sacred gift and the rational mind is a faithful servant. We have created a society that honors the servant and has forgotten the gift. We will not solve the problems of the world from the same level of thinking we were at when we created them. More than anything else, this new century demands new thinking: We must change our materially based analyses of the world around us to include broader, more multidimensional perspectives. ~Albert Einstein

Hinweis der Redaktion

  1. Non-leading interviews allow you to capture what a person is thinking in their terms, with their structure and vocabulary intact. Indi deliberately writes prompts rather than interview questions. Also easier to parse quickly. if you go for a non-directed interview using prompts, make sure everybody in your team has a shared understanding of the intent behind each topic. Janice calls this topic map.
  2. Non-leading interviews allow you to capture what a person is thinking in their terms, with their structure and vocabulary intact. Indi deliberately writes prompts rather than interview questions. Also easier to parse quickly. if you go for a non-directed interview using prompts, make sure everybody in your team has a shared understanding of the intent behind each topic. Janice calls this topic map.
  3. begin interviews with a 'softball' question - a question that is simple to answer and puts the participant at ease. 
  4. Be careful with WHY. ‘How did you know that X?’ ‘What were you thinking at the moment when X?’ This does not interrupt the recounting process. So ‘tell me how it was that you came to be looking for this site that day’ does the work of ‘why were you looking... ?If you’ve made people comfortable, Why should be ok.
  5. Manage expectations
  6. what we saw/heard – what it means – why it matters
  7. BM channels = connections
  8. Map out connections – Rich Picture
  9. examples: eg hard system = thermostat, motherboard. soft system = game of poker, soccer game, meeting, healthcare.
  10. Worldview is a concept for empathyConsider:- roles that people adopt in the situation (which may be formally recognised or quite informal); the norms which govern people’s behaviour; and the values they espouse.- political aspects of the situation, in other words recognition of the different interests that are represented and how these different interests are accommodated.