SlideShare ist ein Scribd-Unternehmen logo
1 von 32
Downloaden Sie, um offline zu lesen
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution
(And Not The Story!)
Mike Sherman & Davina Stanley
September 2021
Sponsors
Communication
Creating Better
Research Reports
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Mike Sherman & Davina Stanley
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
5
Very
4
3
2
1
0
Not
Very
Market
Research
Human
Resources
Information
Services
Marketing
Finance and
Accounting
How useful is the information?
In The 1990s CEOs Didn’t Value
Market Research
In 2019 Only 30% Of Report Recipients
Rated Reports Very Good or Excellent
7% 6%
28% 26%
32%
28%
23%
28%
7% 8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
n=98
In 2021 The Results Are Similarly Poor
(But Slightly Improved)
Source: NewMR “Quality of Market Research Reports” survey, March 2019 and Summer 2021, “How would you describe the quality of that report?”
n=130
n=98
2019 2021
30% 36%
7% 6%
27% 26%
32%
28%
23%
28%
7% 8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Report Creators Didn’t Recognize The
Problem - 2019
7%
1%
28%
7%
33%
24%
23%
47%
7%
20%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
Report Receivers Report Creators
n=382
n=98
37
point
gap
They Still Don’t - 2021
2% 0%
6%
0%
26%
6%
28%
23%
28%
46%
8%
23%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
33
point
gap
Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “How would you describe the quality of that report?”
Report Receivers Report Creators
n=361
n=130
Gap Exists In Other Industries
20%
4%
56%
44%
24%
49%
0% 3%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Poor Good Very Good Outstanding
Source: Clarity Client Survey, summer 2021“How would you describe the quality of that report?”
n=122
n=46
Authors
Audience
28
point
gap
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Everybody Agrees What Is
Important
Report Receivers (n=130)
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Report Creators (n=361)
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “Which of the following do you think are most important for an ‘Excellent’ report?”
Biology Is Part Of The Problem
2%
of body weight
20%
of calorie burn
So Is The Curse Of Knowledge
3 Bad (But Common) Examples
1. The “War and Peace” Report
2. The Data Drop Report
3. The Agatha Christie Report
“Many researchers are
still uncomfortable with
providing clear, concise
recommendations.”
- Marjolein Van
Nieuwkasteele, former
Head of Insights, Philips,
Research World, April 2005
These Are Long Standing
Problems
Source: Research World, April 2005, pages 13-14
In what ways was the report poor?
• “Presentation was a large 100pp pdf (with typos!) that
didn’t provide easily shareable insights to distribute to
other stakeholders”
• “Too many slides, difficult navigation”
• “Too much info on each page. Too many huge tables”
• “Volume of data presented overwhelmed non research
trained stakeholders”
• “Fantastic work, but likely too long to be truly
accessible”
Reports Are “Too Long” …
Source: NewMR “Quality of Market Research Reports” survey, Summer 2021, “In what ways was the report poor/good?”
REPORT RECEIVERS
In what ways was the report poor?
• “Very dense & difficult to surface the so what?”
• “The recommendations didn’t speak to some of the
key challenges we’re facing as an organization”
• “Overly descriptive of data rather than what we
learned and what the implications are. Structure
followed the questionnaire design rather than a
narrative answering the business questions”
• “Only report the findings but can’t interpret the data”
… And Lack Insights
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
REPORT RECEIVERS
What is most important for making a report
excellent?
• “Answers the business issues”
• “Clearly answers the questions the stakeholders
want answers to”
• “Provocative or has a point of view”
• “Identifies clear action steps, shows patterns, going
beyond just observations”
Clients Want Answers!
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
REPORT RECEIVERS
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
The Hole, Not The Drill: Why
Reporting Should Focus On The
Solution (And Not The Story!)
Provide A Clear Message That Adds Value
Before – 640 words After – 266 words
Focus On Outcomes, Not Inputs
Convey Your Main Insights As An
Elevator Pitch
1. Main issue
2. Hypothesis
3. Next steps
Love it! How Do We Implement It?
Coonawarra Storyboard – Short Deck
What it is
Executive summary: for
a presentation
Where it came from
Tracker Tracker Tracker
E
X
A
M
P
L
E
Make A Strawman For Your Messages Early
90 mins prep
Fast decision
> From 15 hours prep and
no decision to …
> From 90-min. detailed
discussion to …
2 questions
8 minutes
> From red penning multiple
lengthy drafts to …
30-minute briefing
1 quick review
Focus On Both Clarity AND Productivity
There Is An Opportunity To Use Your Time
Envelope Wisely
The old envelope
Key
messages
Materials
Analysis
Time
Your new one
Analysis
Storyline
Communication
materials
Have a complete draft storyline
half way through your time
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a solution focus.
3. Concise, synthesized reports will improve client
satisfaction.
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Q & A
Ray Poynter
Davina Stanley
Mike Sherman
Sponsors
Communication

Weitere ähnliche Inhalte

Was ist angesagt?

Communications Measurement presentation
Communications Measurement presentationCommunications Measurement presentation
Communications Measurement presentationspindocbp
 
Monitoring your brand
Monitoring your brandMonitoring your brand
Monitoring your brandRob Howard
 
90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy90-Minute Guru: Communication Strategy
90-Minute Guru: Communication StrategyMer Joyce
 
Social media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignSocial media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignArun Nair
 
Scottish comms network paul njoku - 14 and 15 may 2014
Scottish comms network   paul njoku - 14 and 15 may 2014Scottish comms network   paul njoku - 14 and 15 may 2014
Scottish comms network paul njoku - 14 and 15 may 2014Jane Robson
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetJessica Walter
 
Checklist Communication Strategy Development
Checklist Communication Strategy DevelopmentChecklist Communication Strategy Development
Checklist Communication Strategy DevelopmentEwen Le Borgne
 
I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1Ronny Braunstein
 
Developing your Internal Communications Strategy
Developing your Internal Communications StrategyDeveloping your Internal Communications Strategy
Developing your Internal Communications Strategyrozhendley
 
Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.CharityComms
 
The Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenThe Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenMobile Surveys Inc.
 
Improving Internal Communications
Improving Internal CommunicationsImproving Internal Communications
Improving Internal CommunicationsGranicus
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx PresentationMediabistro
 
Sample Presentation Final
Sample Presentation FinalSample Presentation Final
Sample Presentation FinalDavidGraunke
 
1.3 baer eng why is disseminating important astana november 2009
1.3 baer eng why is disseminating important   astana november 20091.3 baer eng why is disseminating important   astana november 2009
1.3 baer eng why is disseminating important astana november 2009Petteri Baer
 
Simplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder CommunicationSimplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder Communicationmhough
 

Was ist angesagt? (20)

Communications Measurement presentation
Communications Measurement presentationCommunications Measurement presentation
Communications Measurement presentation
 
Monitoring your brand
Monitoring your brandMonitoring your brand
Monitoring your brand
 
90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy
 
Social media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignSocial media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaign
 
Scottish comms network paul njoku - 14 and 15 may 2014
Scottish comms network   paul njoku - 14 and 15 may 2014Scottish comms network   paul njoku - 14 and 15 may 2014
Scottish comms network paul njoku - 14 and 15 may 2014
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your target
 
Checklist Communication Strategy Development
Checklist Communication Strategy DevelopmentChecklist Communication Strategy Development
Checklist Communication Strategy Development
 
I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1
 
Developing your Internal Communications Strategy
Developing your Internal Communications StrategyDeveloping your Internal Communications Strategy
Developing your Internal Communications Strategy
 
Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.
 
The Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenThe Lean Data Field Guide by Acumen
The Lean Data Field Guide by Acumen
 
Developing a communication strategy
Developing a communication strategyDeveloping a communication strategy
Developing a communication strategy
 
1415 track 2 richardson
1415 track 2 richardson1415 track 2 richardson
1415 track 2 richardson
 
Customer FAQs
Customer FAQsCustomer FAQs
Customer FAQs
 
Improving Internal Communications
Improving Internal CommunicationsImproving Internal Communications
Improving Internal Communications
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx Presentation
 
Sample Presentation Final
Sample Presentation FinalSample Presentation Final
Sample Presentation Final
 
1.3 baer eng why is disseminating important astana november 2009
1.3 baer eng why is disseminating important   astana november 20091.3 baer eng why is disseminating important   astana november 2009
1.3 baer eng why is disseminating important astana november 2009
 
Top tips
Top tipsTop tips
Top tips
 
Simplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder CommunicationSimplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder Communication
 

Ähnlich wie The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!)

Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Ray Poynter
 
Meeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukMeeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukIgor Bronovskyy
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010AgileCoach.net
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...AGILEMinds
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customerJean-François Nguyen
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017Robin Norton
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017Robin Norton
 
Your VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarYour VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarFuturelab
 
What do people really think about today’s market research reports?
What do people really think about today’s market research reports?What do people really think about today’s market research reports?
What do people really think about today’s market research reports?Ray Poynter
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.mResearcher
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...Frank Strong
 
Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback UK
 
Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback UK
 
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...PractiTest
 
Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Steve Urquhart
 
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionRecruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionMaia Josebachvili
 
How to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackHow to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackNaomi Karten
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsConvertML. ai
 

Ähnlich wie The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!) (20)

Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)
 
Meeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukMeeting customerexpectations - Seredyuk
Meeting customerexpectations - Seredyuk
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customer
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
Your VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarYour VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it Webinar
 
What do people really think about today’s market research reports?
What do people really think about today’s market research reports?What do people really think about today’s market research reports?
What do people really think about today’s market research reports?
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
 
Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...
 
Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"
 
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
 
Business Storytelling
Business Storytelling Business Storytelling
Business Storytelling
 
Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)
 
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionRecruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
 
How to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackHow to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction Feedback
 
SMPS 2011
SMPS 2011 SMPS 2011
SMPS 2011
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data Analytics
 

Mehr von Ray Poynter

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsRay Poynter
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolRay Poynter
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaRay Poynter
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarRay Poynter
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRRay Poynter
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of BeliefsRay Poynter
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesRay Poynter
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023Ray Poynter
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AIRay Poynter
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?Ray Poynter
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...Ray Poynter
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...Ray Poynter
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysRay Poynter
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTRay Poynter
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysRay Poynter
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthRay Poynter
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchRay Poynter
 

Mehr von Ray Poynter (20)

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and Findings
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis tool
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from Yasna
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So Far
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMR
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPT
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business Growth
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer research
 

Kürzlich hochgeladen

Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
TEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxTEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxruthvilladarez
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Dust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEDust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEaurabinda banchhor
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxElton John Embodo
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 

Kürzlich hochgeladen (20)

Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
TEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docxTEACHER REFLECTION FORM (NEW SET........).docx
TEACHER REFLECTION FORM (NEW SET........).docx
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Dust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSEDust Of Snow By Robert Frost Class-X English CBSE
Dust Of Snow By Robert Frost Class-X English CBSE
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docx
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 

The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!)

  • 1. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) Mike Sherman & Davina Stanley September 2021
  • 3. Creating Better Research Reports The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) Mike Sherman & Davina Stanley
  • 4. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity
  • 6. In 2019 Only 30% Of Report Recipients Rated Reports Very Good or Excellent 7% 6% 28% 26% 32% 28% 23% 28% 7% 8% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” n=98
  • 7. In 2021 The Results Are Similarly Poor (But Slightly Improved) Source: NewMR “Quality of Market Research Reports” survey, March 2019 and Summer 2021, “How would you describe the quality of that report?” n=130 n=98 2019 2021 30% 36% 7% 6% 27% 26% 32% 28% 23% 28% 7% 8% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent
  • 8. Report Creators Didn’t Recognize The Problem - 2019 7% 1% 28% 7% 33% 24% 23% 47% 7% 20% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” Report Receivers Report Creators n=382 n=98 37 point gap
  • 9. They Still Don’t - 2021 2% 0% 6% 0% 26% 6% 28% 23% 28% 46% 8% 23% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent 33 point gap Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “How would you describe the quality of that report?” Report Receivers Report Creators n=361 n=130
  • 10. Gap Exists In Other Industries 20% 4% 56% 44% 24% 49% 0% 3% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Poor Good Very Good Outstanding Source: Clarity Client Survey, summer 2021“How would you describe the quality of that report?” n=122 n=46 Authors Audience 28 point gap
  • 11. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 12. Everybody Agrees What Is Important Report Receivers (n=130) 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Report Creators (n=361) 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “Which of the following do you think are most important for an ‘Excellent’ report?”
  • 13. Biology Is Part Of The Problem 2% of body weight 20% of calorie burn
  • 14. So Is The Curse Of Knowledge
  • 15. 3 Bad (But Common) Examples 1. The “War and Peace” Report 2. The Data Drop Report 3. The Agatha Christie Report
  • 16. “Many researchers are still uncomfortable with providing clear, concise recommendations.” - Marjolein Van Nieuwkasteele, former Head of Insights, Philips, Research World, April 2005 These Are Long Standing Problems Source: Research World, April 2005, pages 13-14
  • 17. In what ways was the report poor? • “Presentation was a large 100pp pdf (with typos!) that didn’t provide easily shareable insights to distribute to other stakeholders” • “Too many slides, difficult navigation” • “Too much info on each page. Too many huge tables” • “Volume of data presented overwhelmed non research trained stakeholders” • “Fantastic work, but likely too long to be truly accessible” Reports Are “Too Long” … Source: NewMR “Quality of Market Research Reports” survey, Summer 2021, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 18. In what ways was the report poor? • “Very dense & difficult to surface the so what?” • “The recommendations didn’t speak to some of the key challenges we’re facing as an organization” • “Overly descriptive of data rather than what we learned and what the implications are. Structure followed the questionnaire design rather than a narrative answering the business questions” • “Only report the findings but can’t interpret the data” … And Lack Insights Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 19. What is most important for making a report excellent? • “Answers the business issues” • “Clearly answers the questions the stakeholders want answers to” • “Provocative or has a point of view” • “Identifies clear action steps, shows patterns, going beyond just observations” Clients Want Answers! Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 20. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 21. Provide A Clear Message That Adds Value Before – 640 words After – 266 words
  • 22. Focus On Outcomes, Not Inputs
  • 23. Convey Your Main Insights As An Elevator Pitch 1. Main issue 2. Hypothesis 3. Next steps
  • 24. Love it! How Do We Implement It?
  • 25. Coonawarra Storyboard – Short Deck What it is Executive summary: for a presentation Where it came from Tracker Tracker Tracker E X A M P L E
  • 26. Make A Strawman For Your Messages Early
  • 27. 90 mins prep Fast decision > From 15 hours prep and no decision to … > From 90-min. detailed discussion to … 2 questions 8 minutes > From red penning multiple lengthy drafts to … 30-minute briefing 1 quick review Focus On Both Clarity AND Productivity
  • 28. There Is An Opportunity To Use Your Time Envelope Wisely The old envelope Key messages Materials Analysis Time Your new one Analysis Storyline Communication materials Have a complete draft storyline half way through your time
  • 29. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 30.
  • 31. Q & A Ray Poynter Davina Stanley Mike Sherman