23. On pace to do 400 - 500 sessions a year
Everything user-facing gets tested (at different stages)
Test 5 days a week (mo, tu, wed, th, fri)
Set up tests prior to knowing what will be tested
Recruit participants from community and through
craigslist
Anyone can request to have something tested
Follow each session with discussion & notes/video
http://www.flickr.com/photos/cjcam/2662387745/lightbox/There’s such a temptation to test that it absolves you of creative integrality and responsibility. More importantly you start chasing meaningless wins. One of the hardest lessons is learning what to test and what not to test. We don’t have a crystal ball. So how do you think about it.
Wins that give a little fuel for the mission AND are on route to the goal – usually related to business vital signs - adoption, revenue
Wins that give a little fuel for the mission AND are on route to the goal – usually related to business vital signs - adoption, revenue
Break thru win
Break thru win
Meaningless wins. That’s the problem with lean. We spend lots of times validating assumptions that don’t matter. Ironic, because I got into lean cause it helps you focus on what matter most.
Here’s the diagram of our testing setup with the changes I’ve just mentionedThere’s the user in the testing room, and me next to them with my laptop We’re running GTM, and I can monitor that, take notes and IM on my laptop Teams of developers now sit at their desks and watch the test on their own computers through the power of GoToMeeting, while the audio comes through their speakers (hopefully they are wearing earphones so they are not sharing the session with the whole office)
Meaningless wins. That’s the problem with lean. We spend lots of times validating assumptions that don’t matter. Ironic, because I got into lean cause it helps you focus on what matter most. Next time you hear speed to launch as the reason to do something… think of will
Wins that give a little fuel for the mission AND are on route to the goal – usually related to business vital signs - adoption, revenueIf we can find a $20 in our pocket we’ll take it. But not if we spend $50 to get it.