Slides from my talk on Measuring Consumer Quality - The Missing Feedback Loop - delivered at PSTC 2018

1. Measuring Consumer Quality
The Missing Feedback Loop
@BagmarAnand
Anand Bagmar
Software Quality Evangelist
Essence Of Testing

2. About Me
EssenceOfTesting.com
@BagmarAnand

3. What do you expect
from this session?
@BagmarAnand

4. Which roles is this topic
relevant to?
@BagmarAnand

5. QA as a Gatekeeper
QA as an Advocate / Enabler
@BagmarAnand

6. QA IS NOT a Scavenger
QA IS an Enabler
@BagmarAnand

7. QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
@BagmarAnand

8. QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
@BagmarAnand

9. QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
Risk Identification & Mitigation
@BagmarAnand

10. QA IS NOT a Scavenger
QA IS an Enabler
Collaboration (Communication)
Questioning
Risk Identification & Mitigation
Preventing Defects
@BagmarAnand

11. https://pxhere.com/en/photo/1175227
@BagmarAnand

12. The Feedback Loop
@BagmarAnand

13. Build
Features
@BagmarAnand

14. Build
Measure
Metrics
Features
@BagmarAnand

15. Build
Measure
Metrics
Baseline
Features
@BagmarAnand

16. Build
Measure
Metrics
Baseline
Analyze
Features
@BagmarAnand

17. Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Features
@BagmarAnand

18. Build
MeasureLearn
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
Features
@BagmarAnand

19. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis
@BagmarAnand

20. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand

21. Build
MeasureLearn
Experiments
MetricsPivot / Preserve
Baseline
Analyze
Hypothesis The
Feedback
Loop
@BagmarAnand

22. Some examples
@BagmarAnand

23. Product
@BagmarAnand

24. How well do you know your Product?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
@BagmarAnand

25. Know your Product
Intent
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
@BagmarAnand

26. Intent Use cases
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand

27. Intent Use cases
Value
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand

28. Intent Use cases
Value On-Track?
http://www.thebluediamondgallery.com/wooden-tile/p/product.html
Know your Product
@BagmarAnand

29. Users
@BagmarAnand

30. Who are your Product’s Users?
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand

31. Understand your Users
Profile
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand

32. Profile Location
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand

33. Profile
Culture
Languages
Location
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand

34. Profile
Culture
Languages
Location
Hobbies
Habits
Understand your Users
https://pixabay.com/en/user-green-worker-job-employee-309996/
@BagmarAnand

35. Measure & Learn
@BagmarAnand

36. Measure
@BagmarAnand

37. Measure
Analytics
@BagmarAnand

38. Measure
Analytics
Crashes (Client / Server-side)
@BagmarAnand

39. Measure
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
@BagmarAnand

40. Measure
Analytics
Crashes (Client / Server-side)
Reviews / Ratings
Errors / Logs
@BagmarAnand

41. Learn
@BagmarAnand

42. Learn
Infer (with context)
@BagmarAnand

43. Learn
Infer (with context)
Pivot / Preserve
@BagmarAnand

44. Predict!
@BagmarAnand

45. Predict!
Is your learning and understanding deep
enough to make predictions of outcomes?
@BagmarAnand

46. Understanding, Measuring and Building Consumer Quality
https://essenceoftesting.blogspot.com/2017/12/understanding-
measuring-and-building.html
Reference
@BagmarAnand

47. Thank you!
EssenceOfTesting.com
@BagmarAnand