How to build a good quality product is not a new topic. Proper usage of methodologies, processes, practices, collaboration techniques can yield amazing results for the team, the organisation, and for the end-users of your product. While there is a lot of emphasis on the processes and practices side, one aspect that is still spoken about "loosely" - is the feedback loop from your end-users to making better decisions. SO, What is this feedback loop? Is it a myth? How do you measure it? Is there a "magic" formula to understand this data received? How to you add value to your product using this data? In this interactive session, we will use a case study of a B2C entertainment-domain product (having millions of consumers) as an example to understand and also answer the following questions: - The importance of knowing your Consumers - How do you know your product is working well? - How do you know your Consumers are engaged with your product? - Can you draw inferences and patterns from the data to reach of point of being able to make predictions on Consumer behaviour, before making any code change? More details on this topic can be found here - https://essenceoftesting.blogspot.com/2018/03/measuring-consumer-quality-feedback-loop.html

1. Measuring Consumer Quality
The Missing Feedback Loop
Anand Bagmar
Software Quality Evangelist, Essence Of Testing
@BagmarAnand

2. About Me
@BagmarAnand
EssenceOfTesting.com

3. What do you expect
from this session?
@BagmarAnand

4. Which roles is this topic
relevant to?
@BagmarAnand

5. QA as a Gatekeeper
QA as an Advocate / Enabler
@BagmarAnand

6. QA
NOT a Scavenger – is an
Enabler
@BagmarAnand

7. QA
NOT a Scavenger – is an
Enabler
Collaboration (Communication)
@BagmarAnand

8. QA
NOT a Scavenger – is an
Enabler
Collaboration (Communication)
Questioning
@BagmarAnand

9. QA
NOT a Scavenger – is an
Enabler
Collaboration (Communication)
Questioning
Risks
@BagmarAnand

10. QA
NOT a Scavenger – is an
Enabler
Collaboration (Communication)
Questioning
Risks
Preventing Defects @BagmarAnand

11. https://pxhere.com/en/photo/1175227 @BagmarAnand

12. The Feedback Loop
@BagmarAnand

13. Build
Features
@BagmarAnand

14. Build
Measure
Metrics
Features
@BagmarAnand

15. Build
Measure
Metrics
Baseline
Features
@BagmarAnand

16. Build
Measure
Metrics
Baseline
Analyze
Features
@BagmarAnand

17. Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Features
@BagmarAnand

18. Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
Features
@BagmarAnand

19. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
@BagmarAnand

20. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand

21. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand

22. Some examples
@BagmarAnand

23. Product
@BagmarAnand

24. How well do you know your Product?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html @BagmarAnand

25. Know your Product
Intent
http://www.thebluediamondgallery.com/wooden-tile/p/product.html @BagmarAnand

26. Intent Use cases
http://www.thebluediamondgallery.com/wooden-tile/p/product.html @BagmarAnand
Know your Product

27. Intent Use cases
Value
http://www.thebluediamondgallery.com/wooden-tile/p/product.html @BagmarAnand
Know your Product

28. Intent Use cases
Value On-Track?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html @BagmarAnand
Know your Product

29. Users
@BagmarAnand

30. Who are your Product’s Users?
https://pixabay.com/en/user-green-worker-job-employee-309996/ @BagmarAnand

31. Understand your Users
Profile
https://pixabay.com/en/user-green-worker-job-employee-309996/ @BagmarAnand

32. Profile Location
https://pixabay.com/en/user-green-worker-job-employee-309996/ @BagmarAnand
Understand your Users

33. Profile
Culture
Languages
Location
https://pixabay.com/en/user-green-worker-job-employee-309996/ @BagmarAnand
Understand your Users

34. Profile
Culture
Languages
Location
Hobbies
Habits
https://pixabay.com/en/user-green-worker-job-employee-309996/ @BagmarAnand
Understand your Users

35. Measure & Learn
@BagmarAnand

36. Measure
@BagmarAnand

37. Measure
Analytics
@BagmarAnand

38. Measure
Analytics
Crashes (Client / Server-side)
@BagmarAnand

39. Measure
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
@BagmarAnand

40. Measure
@BagmarAnand
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
Errors / Logs

41. Learn
@BagmarAnand

42. Learn
Infer (with context)
@BagmarAnand

43. Learn
Infer (with context)
Pivot / Preserve
@BagmarAnand

44. Predict!
@BagmarAnand

45. Predict!
Is your learning and understanding deep
enough to make predictions of outcomes?
@BagmarAnand

46. Understanding, Measuring and Building
Consumer Quality
https://essenceoftesting.blogspot.com/2017/12/under
standing-measuring-and-building.html
Reference
@BagmarAnand

47. Thank you!
@BagmarAnand
EssenceOfTesting.com