Chadwick Martin Bailey's Rich Schreuer and Amy Modini share best practices and case studies from their years conducting product and service development research across verticals.
You'll learn:
* Which of the latest trade-off techniques work best for product and service development research
* The role of brand in product and service development research
* Steps to ensure the information is used once a project is complete
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Innovations in Product and Service Development Research
1. Best Practices for Product/Service Development Research Innovative Techniques and Examples
2. Today’s Webinar Who is Chadwick Martin Bailey? Today’s Speakers Innovations in Product/Service Development research Q & A (please enter questions into the webex Q & A feature and we’ll answer them at the end) 2
3. Chadwick Martin Bailey:Company Facts Founded in 1984 60 Employees Headquartered in Boston Global, Full-service Provider Fully Dedicated Retail, Healthcare, eCommerce, Technology, Financial Services, and Travel and Hospitality Practices Sweet Spot: when you want a supplier who will provide original ideas, not just a response to an RFP 3
4. Our Clients: We Partner with Leaders in a Range of Industries 4
8. Key Steps in the Product Development Process 8 5. Business Analysis 4. Strategy 3. Concept Testing 6. Product Configuration 2. Concept Development 7. Market Testing 1. Idea Generation 8. Marketing
18. Traditional Idea Generation Methods Are Lacking Many companies: Focus on incremental improvements, not groundbreaking ideas Rely heavily on engineering for new product/service and product/service refinement ideas Fail to adapt to changing market conditions Focus more on the what than the why Taking a multi-method, multi-source approach helps: Understand the issues people are facing surrounding your offerings, not just the offerings themselves Hear customers and prospects as they talk amongst each other, and directly to you Focus on solving problems and meeting goals 11
19. There is No Shortage of Sources and Methods To Utilize 12
20. In Qualitative Alone, the Past 4 Years has Shown Huge Growth in Tools and Techniques 13
21. Multi-Method, Multi- Source: Combining Methods From Traditional and Non-Traditional Sources Gives You a Clearer Picture 14
22. For Example, Combining “Listening” with Primary Research Helps Gather and Evaluate Ideas 15
23. Social Media “listening” Mines Traditional, Online, and Social Sources to Extract Meaning and Deliver Insights Select the content sources and search terms Train the algorithm with examples for each category 1. 3. 2. Choose the categories the posts represent Monitor summarizes online conversation 4. 16
24. Problem Analysis: Focus on Solving Problems Customer-centric: makes the voice of the customer part of the development process Rating Index: focuses developers on consumer needs that are most urgent/common Competitive Differentiation: Identifies opportunities for compelling and distinctive positioning against alternatives One Rock, Many Birds: Can be leveraged into many other areas, such as sales, marketing, communications, and market positioning 17
25. Problem Analysis: Focus on Solving Problems 18 Hotel Guests Likelihood to Stay Again Frequency (%8-10) Intensity (%8-10)
28. Concepts Need to Be Evaluated Based on Customer and Business Goals Customers: What are customers and prospects trying to achieve? Where are there gaps? Where is incremental improvement appropriate vs. wholesale changes? Business: What would make this offering a “success”? What limitations do we have in developing, servicing, and selling? How does this fit with our brand?
29. Maximum Difference Scaling is a Great Way to Measure Appeal This approach is especially useful because it: Derives the preferences of respondents, rather than asks it Eliminates halo effects Can handle a large number of features 22
30. A New Approach: Anchored (Dual-Choice) MaxDiff In Anchored MaxDiff, we ask respondents to make best/worst choices… We then ask a follow-up question for each task that is used to set a true 0 threshold level through the use of dual-response questions. 23
31. Stated Preference Rarely Discriminates A Discounts on gas B Deposit to a savings or investment account C Money towards utilities bill D Gift cards E Money towards your mortgage F APR discounts G Interest rebates H Discounts at selected retailers I Travel rewards for use with a variety of carriers J Bonus miles/points after spending a certain amount K Travel upgrades or discounts (hotels, rental cars) L Frequent flyer miles for a specific airline M Online mall N Money towards school tuition O Tickets to events and shows P Donation to a charity/school Q Donation to reduce carbon footprint Appeal of Features (%8-10) 24
32. But Employing a Trade-off Technique (Such as Max-Diff) Ensures Differentiation A Discounts on gas B Deposit to a savings or investment account C Money towards utilities bill D Gift cards E Money towards your mortgage F APR discounts G Interest rebates H Discounts at selected retailers I Travel rewards for use with a variety of carriers J Bonus miles/points after spending a certain amount K Travel upgrades or discounts (hotels, rental cars) L Frequent flyer miles for a specific airline M Online mall N Money towards school tuition O Tickets to events and shows P Donation to a charity/school Q Donation to reduce carbon footprint Desired Features IChart displays the mean appeal (importance) score for each item. Maximum Difference utilities are converted into ratio-scaled probabilities that sum to 100 across the items. Thus an item with a score of 8 is twice as important as an item with a score of 4. The dotted line represents the average (5.9). NTERPRET WITH CARE – MEAN VALUES HIDE HETEROGENEITY OF PREFERENCE AND ARE SKEWED BY OUTLIERS. 25
35. Traditional Product Configuration Methods Are Lacking Typically, companies follow one of these processes: Use best guess, and go to test market Develop concepts based on an internal model, then go to test market Rely on slight changes to a competitively successful product Conduct focus groups to refine existing concepts Trade-off modeling such as Discrete Choice and Adaptive Choice help: Predict market share under competitive situations Identify dollar value of product features Optimize product configuration for key sub-groups Segment market based on unique configurations Identify price/demand curve 28
37. Adaptive Choice-Based Conjoint is Going Further ACBC is an innovative approach to trade-off modeling because it adapts to respondent choices in order to collect better data Captures more information from the respondent for more stable individual level estimates Allows us to better analyze smaller sample sizes Is more effective in situations where pricing is a critical objective Based on respondent feedback, we find it provides more engaging interviews and respondents like this method better than standard choice models 30
38. Adaptive Choice-Based Conjoint is Going Further ACBC consists of multiple stages: Build-Your-Own (BYO) task “Near Neighbor” concepts Determine “must haves” and “unacceptables” Choice Tournament 31
39.
40. Security: Card features designed to ensure that no one except the legitimate card holder can use the card to make purchases or cash withdrawals
54. HIGH Discloses all info up front Guided throughout process Specialist available 24/7 Beats national average on rates AWARENESS Work with same specialist TRUST CUSTOMER SERVICE Close loan at your location Highest security standards on the web Low rate guarantee / cash back LOW COST LOW HIGH LOW IMPORTANCE Prioritize Messaging Based on Brand Support AND the Impact on Loyalty 36
55. In Summary: Best Practices of Product and Service Development Research At Each Stage Idea Generation: Use a multi-method, multi-source approach to listen to the market and gather ideas for concept testing Concept Testing: Test concepts in terms of how they meet both customer and business goals Product Configuration: Use sophisticated trade-off modeling (such as Dual Choice Discrete Choice and Adaptive Choice) to develop the optimal set of features, benefits, and tiers Marketing: Evaluate messaging holistically in terms of relevance, appeal and brand fit 37
56. Questions? See some of these approaches from a respondent perspective by going through the trade-off technique demos at:http://www.cmbinfo.com/why-cmb/analytics/ Follow us on twitter @cmbinfo , Read our blog at blog.cmbinfo.com or become a fan on Facebook
Hinweis der Redaktion
There are many effective methods to use in product development research:Each has its particular advantagesSo it’s important to use the right method in the right situationThe following are several methods we frequently use. Each has specific pros and cons, but all share several important advantages: They Emulate the Real World:In real life, people don’t evaluate the importance of individual features or attributes. They make choices between/among products. The more closely research emulates this process, the more accurate the findings will be. Derived vs. Stated Preference: What people say they prefer, and what they actually choose when given the chance, are often not the same thing. Usefulness of Findings:These methods can be used to inform the widest variety of decisions – from product development to operations to sales, marketing, and advertising.
We recently used a combination of social media “listening” with the Crimson Hexagon Tool, Focus groups, and ideation sessions to understand why people had soured on a long-running television series and test ideas for improvement.
There are a lot of good tools out there – all of which really require a combination of monitoring and interpretation. We have tested a bunch of tools and prefer Crimson Hexagon because:Unique, proprietary approach to finding “patterns in the dots”Monitors “filter out noise,” selecting relevant sources and ignoring irrelevant crap!User develops categories that matter
Anchored MaxDiff is a new approach to Maximum Difference Scaling that enables a true “0” threshold to be computed through the use of dual-response questions. Standard MaxDiff items are purely relative – the zero point is arbitrarily selected by holding out one item during estimation; all other items are estimated relative to that item – so the zero point normally has no interpretive meaning. In Anchored MaxDiff, we not only ask respondents to make best/worst choices, we also ask a follow-up question for each task that is used to set a true 0 threshold level, in this case:All four statements would make you want to increase fittings for the companyNone of the four statements would make you want to increase fittings for the companySome of the four statements would make you want to increase fittings for the company, and some would not