Among the traits that distinguish a good team from a great team is their ability to innovate. Despite the rhetoric in favor of innovation, most organizations are stuck in an implementation mindset, stifling creativity, excellence, and the resultant innovation. The experimentation mindset frees us from self-imposed constraints, allowing us to continually learn and improve. In this session, we'll talk about how we learn as individuals and how we learn as organizations. We'll take a look at some examples of the experimentation mindset happening in the agile community today and we'll talk about how you can foster such a mindset in your own organization.

1. #adchi / #ExperimentationMindset / @DocOnDev
The Experimentation Mindset

2. #adchi / #ExperimentationMindset / @DocOnDev
Doc Norton, CEO
doc@wearecto2.com
@DocOnDev
@adchi / #ExperimentationMindset / @DocOnDev

3. #adchi / #ExperimentationMindset / @DocOnDev
Mindset

4. #adchi / #ExperimentationMindset / @DocOnDev
A simple experiment

5. #adchi / #ExperimentationMindset / @DocOnDev
Two Groups

6. #adchi / #ExperimentationMindset / @DocOnDev
Small Difference; Big Result

7. #adchi / #ExperimentationMindset / @DocOnDev
Mindset
the ideas and attitudes with which a person approaches a situation

8. #adchi / #ExperimentationMindset / @DocOnDev
fixed growth

9. #adchi / #ExperimentationMindset / @DocOnDev
Dreyfus Model of skills acquisition

10. #adchi / #ExperimentationMindset / @DocOnDev
Novice

11. #adchi / #ExperimentationMindset / @DocOnDev
Advanced Beginner

12. #adchi / #ExperimentationMindset / @DocOnDev
Competent

13. #adchi / #ExperimentationMindset / @DocOnDev
Proficient

14. #adchi / #ExperimentationMindset / @DocOnDev
Expert

15. #adchi / #ExperimentationMindset / @DocOnDev
Where are you?

16. #adchi / #ExperimentationMindset / @DocOnDev
Most think they’re Expert

17. #adchi / #ExperimentationMindset / @DocOnDev
most stay at Proficient

18. #adchi / #ExperimentationMindset / @DocOnDev
From Implementation

19. #adchi / #ExperimentationMindset / @DocOnDev
Implementation Mindset get it right
A+

20. #adchi / #ExperimentationMindset / @DocOnDev
to experimentation

21. #adchi / #ExperimentationMindset / @DocOnDev
experimentation Mindset explore different ways

22. #adchi / #ExperimentationMindset / @DocOnDev
experimentation Mindset explore different ways

23. #adchi / #ExperimentationMindset / @DocOnDev
but in a typical company…

24. #adchi / #ExperimentationMindset / @DocOnDev
telephone sales

25. #adchi / #ExperimentationMindset / @DocOnDev
Follow the script
This will
be
great!

26. #adchi / #ExperimentationMindset / @DocOnDev
It wasn’t Great
Ptolemy
Janet
Raphael
Susan
Kathy
Tommy
Doc
Chris P.
Weekly Sales Rankings

27. #adchi / #ExperimentationMindset / @DocOnDev
Watch The Master
my name is ____________________ …Hello (sir/madam),

28. #adchi / #ExperimentationMindset / @DocOnDev
Watch The Master
my name is ____________________ …Pat MichaelsGood Day!

29. #adchi / #ExperimentationMindset / @DocOnDev
Experiment

30. #adchi / #ExperimentationMindset / @DocOnDev
experiment

31. #adchi / #ExperimentationMindset / @DocOnDev
experiment

32. #adchi / #ExperimentationMindset / @DocOnDev
experiment

33. #adchi / #ExperimentationMindset / @DocOnDev
top in sales!
Doc
Ptolemy
Janet
Kathy
Tommy
Raphael
Susan
Andy
Weekly Sales Rankings

34. #adchi / #ExperimentationMindset / @DocOnDev
8 week review

35. #adchi / #ExperimentationMindset / @DocOnDev
not the feedback I expected

36. #adchi / #ExperimentationMindset / @DocOnDev
My last day

37. #adchi / #ExperimentationMindset / @DocOnDev
Best Practices

38. #adchi / #ExperimentationMindset / @DocOnDev
Implementation Mindset get it right
A+

39. #adchi / #ExperimentationMindset / @DocOnDev
Single Loop
Assumptions Actions Outcomes
Get it Right

40. #adchi / #ExperimentationMindset / @DocOnDev
The Dark Side

41. #adchi / #ExperimentationMindset / @DocOnDev
double Loop
Assumptions Actions Outcomes
Get it Right
Explore Different Ways

42. #adchi / #ExperimentationMindset / @DocOnDev
best practices

43. #adchi / #ExperimentationMindset / @DocOnDev
leading practices

44. #adchi / #ExperimentationMindset / @DocOnDev
from implementation to experimentation

45. #adchi / #ExperimentationMindset / @DocOnDev
experimentation

46. #adchi / #ExperimentationMindset / @DocOnDev
experimentation

47. #adchi / #ExperimentationMindset / @DocOnDev
split (a/B) + Multivariate

48. #adchi / #ExperimentationMindset / @DocOnDev
Cumulative Flow

49. #adchi / #ExperimentationMindset / @DocOnDev
velocity trends

50. #adchi / #ExperimentationMindset / @DocOnDev
code quality

51. #adchi / #ExperimentationMindset / @DocOnDev
employee engagement

52. #adchi / #ExperimentationMindset / @DocOnDev
team joy

53. #adchi / #ExperimentationMindset / @DocOnDev
Retrospectives

54. #adchi / #ExperimentationMindset / @DocOnDev
refine their process

55. #adchi / #ExperimentationMindset / @DocOnDev
Orientation + On-Boarding

56. #adchi / #ExperimentationMindset / @DocOnDev
Interest Leagues

57. #adchi / #ExperimentationMindset / @DocOnDev
hackathons

58. #adchi / #ExperimentationMindset / @DocOnDev
mentorships

59. #adchi / #ExperimentationMindset / @DocOnDev
360 / peer reviews

60. #adchi / #ExperimentationMindset / @DocOnDev
managers institutionalize procedure
- Gabe Newell

61. #adchi / #ExperimentationMindset / @DocOnDev
being open about [pay] breeds trust
- Leo Widrich

62. #adchi / #ExperimentationMindset / @DocOnDev
managers [are] mentors
- Kevin Goldsmith

63. #adchi / #ExperimentationMindset / @DocOnDev
four things

64. #adchi / #ExperimentationMindset / @DocOnDev
know your purpose; challenge assumptions

65. #adchi / #ExperimentationMindset / @DocOnDev
make failure
acceptable
– Henry Ford
“Failure is simply the opportunity to
begin again, this time more intelligently.”

66. think big… start small… .

67. #adchi / #ExperimentationMindset / @DocOnDev
be intolerant of mediocrity

68. #adchi / #ExperimentationMindset / @DocOnDev
keep experimenting
Assumptions Actions Outcomes
Get it Right
Explore Different Ways

69. Thank
You!

70. #adchi / #ExperimentationMindset / @DocOnDev
The Experimentation Mindset

71. #adchi / #ExperimentationMindset / @DocOnDev
• Mad Scientist - https://www.flickr.com/photos/dzingeek/4587871752/
sizes/o/
• Stages of Growth - http://superkoopatroopa.deviantart.com/art/Terri-
Growth-chart-125875917
• Elephant and Mother - http://upload.wikimedia.org/wikipedia/
commons/7/75/
Baby_asian_elephant_(with_his_mother)_born_in_the_Lao_Elephant_
Conservation_Center_in_Sayaboury.jpg Phone Script - http://
www.docstoc.com/docs/6629075/Sample-Sales-Script
• Phones -
• http://www.enumclawsda.org/uploads/
1/3/3/9/13391741/1971539_orig.gif?119
• http://4.bp.blogspot.com/-qASUt2T7C7o/ULvJ8HVU3LI/
AAAAAAAAACw/LufW5HYhCyM/s1600/Tel%C3%A8fon+fixe
+antic.png
• https://c2.staticflickr.com/8/7443/8758001086_2692f91620_h.jpg
• http://cdn2.hubspot.net/hub/147894/file-270530761-jpg/images/
phone-large.jpg
• Mob Programming - https://techblog.betclicgroup.com/wp-content/
uploads/2014/09/mob-programming-1-1024.jpg
• Spotify Matrix - http://blog.kevingoldsmith.com/wp-content/uploads/
2014/03/Screen-Shot-2013-11-09-at-7.30.08-AM-1024x644.png
• a/b | multivariate testing - https://www.dynamicyield.com/wp-content/
uploads/2014/05/testing.jpg
• Hackathon - https://m2.behance.net/rendition/pm/22070355/disp/
f4d62818fcb09d43722a945486ca5300.png
• Things - http://41.media.tumblr.com/
d721f204c69de1b5a6a4899429430c9e/
tumblr_n52o0matip1snioclo1_1280.jpg, http://cdn.instructables.com/
FIT/POMF/HKJTCKRQ/FITPOMFHKJTCKRQ.LARGE.jpg, http://
shadowgrail.deviantart.com/art/Rock-of-Ages-83993992, http://
vo5.deviantart.com/art/Fantastic-Four-163610854
Images

72. #adchi / #ExperimentationMindset / @DocOnDev
• Students Test - https://img.washingtonpost.com/rf/image_1484w/
2010-2019/WashingtonPost/2014/09/17/Others/Images/
2014-09-17/DSC_54171410973389.jpg?
uuid=h6VsJD6MEeSkMLgqPme3Yg
• Woody Zuill - https://pbs.twimg.com/media/
A8NKQ9lCQAAdA7h.jpg
• Code Quality (WTF) - http://www.sonarqube.org/wp-content/
uploads/2009/09/wtfm.jpg
• 360 Feedback - http://screencrush.com/442/files/2012/07/360-
review.jpg
• Test Tube - http://fc09.deviantart.net/fs70/i/2010/018/2/1/
Vector_Test_Tube_by_Algerianoo.jpg
• No Estimates - https://twitter.com/NoEstimates
• Tesla - https://c2.staticflickr.com/
4/3006/2932363100_5bf7ff5820_b.jpg
• Smiley - https://blogs.dal.ca/csc/files/2012/07/MP900443129.jpg
• Dilbert - http://www.stephenshapiro.com/images/dilbert-bp.gif
• Manager’s Office - https://www.flickr.com/photos/islespunkfan/
8281372547/sizes/l
• Bad review - http://media.benefitspro.com/benefitspro/article/
2014/02/06/negative%20reviews.jpg
• Captain my Captain - http://startupeers.co/wp-content/uploads/
2014/08/o-captain-e1407919367905.jpg
• Vader in Suit - http://fc06.deviantart.net/fs71/f/2011/179/a/a/
darth_vader_by_iamthedarthvader-d3k9n2h.jpg
• League - https://oliverwillis.com/wp-content/uploads/2015/08/
league-of-legends.jpg
• Mentorship - http://humancapitalist.com/wordpress/wp-content/
uploads/2013/11/canstockphoto15167410.jpg
more images

73. #adchi / #ExperimentationMindset / @DocOnDev
• Dreyfus Model of Skills Acquisition - http://en.wikipedia.org/
wiki/Dreyfus_model_of_skill_acquisition, http://
files.eric.ed.gov/fulltext/ED384695.pdf#page=130, https://
www.dropbox.com/s/px1d5orrtjm5d5i/ADA084551.pdf?dl=0
• Learning through experimentation - http://lifehacker.com/
5985565/how-and-why-to-intentionally-set-yourself-up-for-
failure
• HBR: Collective Genius - http://hbr.org/2014/06/collective-
genius/ar/1
• How Organizations Learn - http://www.areteadventures.com/
articles/the_challenge_of_entering_the_green_room.pdf
• Argyris: Teaching Smart People how to Learn - http://hbr.org/
1991/05/teaching-smart-people-how-to-learn/ar/1, http://
pds8.egloos.com/pds/200805/20/87/
chris_argyris_learning.pdf
• Argyris: Double Loop Learning in Organizations - http://
hbr.org/1977/09/double-loop-learning-in-organizations/ar/3
• A/B Testing and the Experimentation Culture - https://
hbr.org/2014/02/ab-testing-and-the-benefits-of-an-
experimentation-culture/
• Enlightened Experimentation - https://hbr.org/2001/02/
enlightened-experimentation-the-new-imperative-for-
innovation/ar/4
• Argyris: Single-Loop and Double-Loop Learning in Research
on Decision Making - https://
093#1c5e28761e25b79cfc10de03f5a188778a0.googledrive
.com/host/0B_RO2ClD0V7AZHpWRS1mNUc2d1k/argyris.pdf
• Ed Batista Blog - http://www.edbatista.com/2008/05/double-
loop.html
Reference Material

74. #adchi / #ExperimentationMindset / @DocOnDev
• Lean Change - http://www.lean.org/LeanPost/
Posting.cfm?LeanPostId=225
• Scaling Up Excellence - http://www.amazon.com/
Scaling-up-Excellence-Hayagreeva-Rao-ebook/
dp/B00EGMQIDG
• Start With Why - http://www.amazon.com/Start-
Why-Leaders-Inspire-Everyone-ebook/dp/
B002Q6XUE4/
• Leading Change - http://www.amazon.com/gp/
product/0875847471/
• Woody Zuill - https://twitter.com/woodyzuill, http://
zuill.us/WoodyZuill/
• Mob Programming and No Estimates - http://
www.infoq.com/interviews/zuill-mob-programming
• Democratizing Experimentation - https://hbr.org/
2011/04/8-ways-to-democratize-experime/
• Failing by Design - https://hbr.org/2011/04/failing-
by-design/ar/1
• Smart Business Experiments - https://hbr.org/
2011/03/a-step-by-step-guide-to-smart-business-
experiments/ar/1
• Evidence Based Management - https://hbr.org/
2006/01/evidence-based-management/ar/5
more reference material

75. #adchi / #ExperimentationMindset / @DocOnDev
• Buffer Transparency - http://
www.fastcompany.com/3024306/bottom-
line/why-this-startup-made-their-salaries-
radically-transparent
• Buffer Transparency Fail - http://
www.fastcompany.com/3050682/lessons-
learned/why-our-transparent-feedback-
experiment-failed
• Valve - https://blog.inf.ed.ac.uk/sapm/
2014/03/14/management-at-valve-an-
analysis-of-management-practices-at-valve-
software/
• Valve Handbook - https://
www.valvesoftware.com/company/
Valve_Handbook_LowRes.pdf
• Spotify White Paper - https://
dl.dropboxusercontent.com/u/1018963/
Articles/SpotifyScaling.pdf
• Kevin Goldsmith on Spotify - http://
blog.kevingoldsmith.com/2014/03/14/
thoughts-on-emulating-spotifys-matrix-
organization-in-other-companies/
yet more reference material