SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
W1	
  
Test	
  Management	
  
10/4/17	
  11:30	
  
The	
  Lean	
  Startup	
  Method:	
  Its	
  Value	
  for	
  
Testers	
  
Presented	
  by:	
  
Lee	
  Copeland	
  
	
  TechWell	
  Corp.	
  
Brought	
  to	
  you	
  by:	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  
 
Lee	
  Copeland	
  
TechWell	
  Corp.	
  
	
  
With	
  more	
  than	
  forty	
  years	
  of	
  experience	
  as	
  an	
  information	
  systems	
  professional	
  
at	
  commercial	
  and	
  nonprofit	
  organizations,	
  Lee	
  Copeland	
  has	
  held	
  technical	
  and	
  
managerial	
  positions	
  in	
  applications	
  development,	
  software	
  testing,	
  and	
  software	
  
process	
  improvement.	
  At	
  TechWell,	
  Lee	
  has	
  developed	
  and	
  taught	
  numerous	
  
training	
  courses	
  on	
  software	
  development	
  and	
  testing	
  issues,	
  and	
  is	
  a	
  sought-­‐
after	
  speaker	
  at	
  software	
  conferences	
  in	
  the	
  United	
  States	
  and	
  abroad.	
  He	
  is	
  the	
  
author	
  of	
  the	
  popular	
  reference	
  book,	
  A	
  Practitioner’s	
  Guide	
  to	
  Software	
  Test	
  
Design.	
  
	
  
2	
  
3	
  
Lee Copeland
TechWell
lee@techwell.com
@grandpacopeland
Testing Lessons
from Lean Startups
4	
  4	
  
Topics
•  The Dismal Record of Startups
•  Eric Ries
•  Foundations of Lean Startup
•  What Value for Testers?
3	
  
5	
  5	
  
The Dismal Record of Startups
•  A startup is an organization
created to deliver a new
product or service under
conditions of extreme
uncertainty
6	
  6	
  
The Dismal Record of Startups
•  Shikhar Ghosh of the Harvard Business School
reported these statistics:
–  95% of startups will fall short
of their financial projections
–  80% will fail to meet their
projected return on investment
–  40% will cease operations with
investors losing everything
4	
  
7	
  7	
  
The Dismal Record of Startups
•  The #1 cause of failure = No Market for their
Product
•  It’s a great product or service that no one
wants to buy
8	
  8	
  
Eric Ries
•  An entrepreneur with an
impressive track record
–  Product to connect students
with … employers
–  Product to let people play in
a 3D virtual world
5	
  
9	
  9	
  
Eric Ries
•  Ries discovered that under conditions of
extreme uncertainty, classical management
methods do not bring success
‒  When we lack knowledge – we gather more
information
‒  When we lack alignment – we give more
detailed instructions
‒  When outcomes are not what we expected –
we impose more detailed controls
10	
  10	
  
Eric Ries
•  He formulated the Lean
Startup methodology
based on his and others’
experiences
6	
  
11	
  11	
  
Foundations of Lean Startup
1.  Customer Development
2.  Build-Measure-Learn (BML) Loop
3.  Minimum Viable Product (MVP)
4.  Validated Learning
5.  One Metric That Matters (OMTM)
12	
  12	
  
1. Customer Development
•  Learning and discovering who a company’s
initial customers will be, and what markets they
are in, requires a separate, distinct, and parallel
process from Product Development
― Steve Blank
7	
  
13	
  13	
  
2. Build-Measure-Learn Loop
In rapid iterations
Persevere or Pivot?
•  GOAL:
14	
  14	
  
3. Minimum Viable Product (MVP)
8	
  
•  The MVP is that version of the product that
enables a full turn of the Build-Measure-Learn
loop with a minimum amount of effort and the
least amount of development time
15	
  15	
  
3. Minimum Viable Product (MVP)
•  The minimum viable product lacks many
features that may prove essential later on – and
that’s OK
16	
  16	
  
3. Minimum Viable Product (MVP)
(Final product)(Minimum
viable product)
9	
  
17	
  17	
  
4. Validated Learning
•  Validated learning is “the process of
demonstrating empirically that the team has
discovered valuable truths about the present
and future business prospects”
18	
  18	
  
5. One Metric That Matters (OMTM)
•  Most metrics gathered by organizations are
“vanity metrics.” They make us feel good (or
look good), but don’t really show progress
toward our goal
Number of
customers
Cost to obtain
each new
customer
Number of
customers
actually using
the product
10	
  
19	
  19	
  
5. One Metric That Matters (OMTM)
•  The One Metric That Matters measures the one
most important thing at the present state of the
startup
20	
  20	
  
The Lean Startup Methodology
What Value for Testers?
11	
  
21	
  21	
  
What Value for Testers?
•  As software testers, we are rarely part of an
entrepreneurial startup team
•  Are there lessons for us from the Lean Startup
methodology?
22	
  22	
  
1. Customer Development
•  Ask:
–  Who are our customers?
–  What are their problems
our testing solves?
–  Do our customers perceive
these problems as
important?
–  Are they willing to pay for
our testing services?
12	
  
23	
  23	
  
1. Customer Development
•  Customer Development suggests that we
should identify the “customers” of our
TESTING SERVICES:
–  Developers
–  Users
–  Management
And serve THEM, not our testing process
24	
  24	
  
1. Customer Development
•  Or this could be our future …
Largest dot-com
flop in history
Raised $375 million
in first public
offering on revenue
of $395,000 and net
losses of $50
million
13	
  
25	
  25	
  
2. Build-Measure-Learn Loop
•  BML loop is equivalent to the Exploratory
Testing loop
This	
  is	
  
where	
  
we	
  start	
  
Not	
  here!	
  
26	
  26	
  
3. Minimal Viable Product (MVP)
•  The idea of an MVP
suggests we could
start with a Minimal
Viable Set of Tests
•  Don’t strive for
“completeness” from
the beginning
•  Add additional tests
as the need becomes
apparent and
warranted
Learn	
  what	
  your	
  
customers	
  want/
need/value	
  
14	
  
27	
  27	
  
4. Validated Learning
“It isn't what we don't
know that gives us
trouble, it's what we
know that ain't so”
Will Rogers
American Humorist
28	
  28	
  
4. Validated Learning
•  The Lean Startup
methodology suggests
running frequent
experiments to determine
customer response
•  As testers, we can run
frequent tests to determine
both system capabilities
and customer satisfaction
15	
  
29	
  29	
  
5. One Metric That Matters
30	
  30	
  
5. One Metric That Matters
•  Is your metrics program an example of
“success theatre”?
16	
  
31	
  31	
  
5. One Metric That Matters
•  Replace the dozens of vanity metrics …
–  Test cases planned
–  Test cases implemented
–  Test cases executed
–  Test cases passed
–  Test cases failed
–  …
32	
  32	
  
5. One Metric That Matters
•  … with one that is truly indicative of something
vital
17	
  
33	
  33	
  
5. One Metric That Matters
•  Does your metric
–  Measure your success at improving quality?
–  Directly relate to product success?
–  Tie to real customers of your service?
–  Help you determine what to do next?
Ivory Madison, “Bonfire of the Vanity Metrics”
34	
  34	
  
In Conclusion
•  The Lean Startup methodology has many
insights to offer to software testers
•  Become familiar with its precepts. Adopt its
ideas for your testing
18	
  
35	
  35	
  
Thanks
Tạm biệt từ Việt NamGood bye from Viet Nam
36	
  36	
  
One Final Bit of Advice
Be Open to Serendipity
“Finding something good
without looking for it”

Weitere ähnliche Inhalte

Was ist angesagt?

The Future of Testing
The Future of TestingThe Future of Testing
The Future of TestingPaul Gerrard
 
Niels Malotaux - Help We Have a QA Problem!
Niels Malotaux -  Help We Have a QA Problem!Niels Malotaux -  Help We Have a QA Problem!
Niels Malotaux - Help We Have a QA Problem!TEST Huddle
 
Kristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatKristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatTEST Huddle
 
From good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteFrom good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteEd Wu
 
Boost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingBoost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingApplause
 
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...Verhaert Masters in Innovation
 
Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Rob Crowley
 
Kelly stephen product launch vs escape
Kelly stephen   product launch vs escapeKelly stephen   product launch vs escape
Kelly stephen product launch vs escapeProductCamp SoCal
 
Hans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateHans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateTEST Huddle
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Teemu Karvonen
 
Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career JanBask Training
 
What is Customer Validation
What is Customer ValidationWhat is Customer Validation
What is Customer ValidationCentercode
 
Key Success Factors in New Product Efforts
Key Success Factors in New Product EffortsKey Success Factors in New Product Efforts
Key Success Factors in New Product EffortsAtul Setlur
 
Challenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChallenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChandan Patary
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation MethodologyQuang Ngoc
 
Help we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGHelp we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGInstitut Lean France
 

Was ist angesagt? (20)

The Future of Testing
The Future of TestingThe Future of Testing
The Future of Testing
 
Niels Malotaux - Help We Have a QA Problem!
Niels Malotaux -  Help We Have a QA Problem!Niels Malotaux -  Help We Have a QA Problem!
Niels Malotaux - Help We Have a QA Problem!
 
Kristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's SeatKristian Fischer - Put Test in the Driver's Seat
Kristian Fischer - Put Test in the Driver's Seat
 
Martijn Beijk & Charles Goodall
Martijn Beijk & Charles GoodallMartijn Beijk & Charles Goodall
Martijn Beijk & Charles Goodall
 
From good to great emetrics_dc_keynote
From good to great emetrics_dc_keynoteFrom good to great emetrics_dc_keynote
From good to great emetrics_dc_keynote
 
Boost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX TestingBoost Your Intelligent Assistants with UX Testing
Boost Your Intelligent Assistants with UX Testing
 
William "RED" Davidson Presentation
William "RED" Davidson Presentation William "RED" Davidson Presentation
William "RED" Davidson Presentation
 
Rich Mironov Presentation
Rich Mironov PresentationRich Mironov Presentation
Rich Mironov Presentation
 
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...Innovation day 2012   11. luc van goethem & frederik wouters - verhaert -  'r...
Innovation day 2012 11. luc van goethem & frederik wouters - verhaert - 'r...
 
Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)Metrics - You are what you measure (DevOps Perth)
Metrics - You are what you measure (DevOps Perth)
 
Kelly stephen product launch vs escape
Kelly stephen   product launch vs escapeKelly stephen   product launch vs escape
Kelly stephen product launch vs escape
 
Hans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to AutomateHans-Henrik Olesen - What to Automate and What not to Automate
Hans-Henrik Olesen - What to Automate and What not to Automate
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)Innovation Experiment Systems Practices (ICSOB 2015)
Innovation Experiment Systems Practices (ICSOB 2015)
 
Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career Top 15 reasons to choose qa testing as career
Top 15 reasons to choose qa testing as career
 
What is Customer Validation
What is Customer ValidationWhat is Customer Validation
What is Customer Validation
 
Key Success Factors in New Product Efforts
Key Success Factors in New Product EffortsKey Success Factors in New Product Efforts
Key Success Factors in New Product Efforts
 
Challenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type projectChallenges with measuring quality for agile distributed research type project
Challenges with measuring quality for agile distributed research type project
 
Odoo Implementation Methodology
Odoo Implementation MethodologyOdoo Implementation Methodology
Odoo Implementation Methodology
 
Help we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by INGHelp we are doing Lean but we are not improving by ING
Help we are doing Lean but we are not improving by ING
 

Ähnlich wie The Lean Startup Method: Its Value for Testers

The Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersThe Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersJosiah Renaudin
 
E101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementE101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementJon E Worren
 
EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)Thomas Squeo
 
Разработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоРазработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоCOMAQA.BY
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Ron Lazaro
 
ProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProduct Excellence
 
Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Marketing Technology
 
Build Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineBuild Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineSalesforce Admins
 
Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Rae Davies
 
Creating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderCreating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderProduct School
 
Lean start up bootcamp 1 introduction
Lean start up bootcamp 1   introductionLean start up bootcamp 1   introduction
Lean start up bootcamp 1 introductionJames Cracknell
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Edmund FOng
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation OrchestraOptimizely
 
Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launchjhassemer
 
Lean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasLean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasgistinitiative
 

Ähnlich wie The Lean Startup Method: Its Value for Testers (20)

The Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for TestersThe Lean Startup Method and Its Value for Testers
The Lean Startup Method and Its Value for Testers
 
E101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial managementE101 october 24 2012 entrepreneurial management
E101 october 24 2012 entrepreneurial management
 
Lean startup
Lean startup Lean startup
Lean startup
 
EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)EIS-PM-Devt-Services-Boot Camp_Combined (1)
EIS-PM-Devt-Services-Boot Camp_Combined (1)
 
Разработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон СеменченкоРазработка эффективной тестовой стратегии, Антон Семенченко
Разработка эффективной тестовой стратегии, Антон Семенченко
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
 
ProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoftProductX2014 Neta haiby.microsoft
ProductX2014 Neta haiby.microsoft
 
Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015Motarme Customer Development Workshop for Trinity Launchbox July 2015
Motarme Customer Development Workshop for Trinity Launchbox July 2015
 
Build Innovation into Your Admin Routine
Build Innovation into Your Admin RoutineBuild Innovation into Your Admin Routine
Build Innovation into Your Admin Routine
 
Lean UX principles
Lean UX principlesLean UX principles
Lean UX principles
 
Agile metrics at-pmi bangalore
Agile metrics at-pmi bangaloreAgile metrics at-pmi bangalore
Agile metrics at-pmi bangalore
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016Construction Future Wales Performance Management (Benchmarking) 2016
Construction Future Wales Performance Management (Benchmarking) 2016
 
Creating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product LeaderCreating Irresistible Products in 4 Steps by Google Product Leader
Creating Irresistible Products in 4 Steps by Google Product Leader
 
Lean start up bootcamp 1 introduction
Lean start up bootcamp 1   introductionLean start up bootcamp 1   introduction
Lean start up bootcamp 1 introduction
 
Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2Ericriesleanstartuppresentationforweb2
Ericriesleanstartuppresentationforweb2
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
 
BFBM(1-2016) Startup with mvp
 BFBM(1-2016) Startup with mvp BFBM(1-2016) Startup with mvp
BFBM(1-2016) Startup with mvp
 
Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launch
 
Lean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvasLean startup, customer development, and the business model canvas
Lean startup, customer development, and the business model canvas
 

Mehr von TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayTechWell
 

Mehr von TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Kürzlich hochgeladen

Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfDrew Moseley
 
Best Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITBest Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITmanoharjgpsolutions
 
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesAmazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesKrzysztofKkol1
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf31events.com
 
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...OnePlan Solutions
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringHironori Washizaki
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsChristian Birchler
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxRTS corp
 
2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shardsChristopher Curtin
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorTier1 app
 
Large Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLarge Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLionel Briand
 
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfExploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfkalichargn70th171
 
Osi security architecture in network.pptx
Osi security architecture in network.pptxOsi security architecture in network.pptx
Osi security architecture in network.pptxVinzoCenzo
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Cizo Technology Services
 
Strategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsStrategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsJean Silva
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprisepreethippts
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesVictoriaMetrics
 
Not a Kubernetes fan? The state of PaaS in 2024
Not a Kubernetes fan? The state of PaaS in 2024Not a Kubernetes fan? The state of PaaS in 2024
Not a Kubernetes fan? The state of PaaS in 2024Anthony Dahanne
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalLionel Briand
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogueitservices996
 

Kürzlich hochgeladen (20)

Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdf
 
Best Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh ITBest Angular 17 Classroom & Online training - Naresh IT
Best Angular 17 Classroom & Online training - Naresh IT
 
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilitiesAmazon Bedrock in Action - presentation of the Bedrock's capabilities
Amazon Bedrock in Action - presentation of the Bedrock's capabilities
 
Sending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdfSending Calendar Invites on SES and Calendarsnack.pdf
Sending Calendar Invites on SES and Calendarsnack.pdf
 
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
Tech Tuesday - Mastering Time Management Unlock the Power of OnePlan's Timesh...
 
Machine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their EngineeringMachine Learning Software Engineering Patterns and Their Engineering
Machine Learning Software Engineering Patterns and Their Engineering
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
 
2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards2024 DevNexus Patterns for Resiliency: Shuffle shards
2024 DevNexus Patterns for Resiliency: Shuffle shards
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryError
 
Large Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and RepairLarge Language Models for Test Case Evolution and Repair
Large Language Models for Test Case Evolution and Repair
 
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdfExploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
Exploring Selenium_Appium Frameworks for Seamless Integration with HeadSpin.pdf
 
Osi security architecture in network.pptx
Osi security architecture in network.pptxOsi security architecture in network.pptx
Osi security architecture in network.pptx
 
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
Global Identity Enrolment and Verification Pro Solution - Cizo Technology Ser...
 
Strategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsStrategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero results
 
Odoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 EnterpriseOdoo 14 - eLearning Module In Odoo 14 Enterprise
Odoo 14 - eLearning Module In Odoo 14 Enterprise
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 Updates
 
Not a Kubernetes fan? The state of PaaS in 2024
Not a Kubernetes fan? The state of PaaS in 2024Not a Kubernetes fan? The state of PaaS in 2024
Not a Kubernetes fan? The state of PaaS in 2024
 
Precise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive GoalPrecise and Complete Requirements? An Elusive Goal
Precise and Complete Requirements? An Elusive Goal
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogue
 

The Lean Startup Method: Its Value for Testers

  • 1. W1   Test  Management   10/4/17  11:30   The  Lean  Startup  Method:  Its  Value  for   Testers   Presented  by:   Lee  Copeland    TechWell  Corp.   Brought  to  you  by:   350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/  
  • 2.   Lee  Copeland   TechWell  Corp.     With  more  than  forty  years  of  experience  as  an  information  systems  professional   at  commercial  and  nonprofit  organizations,  Lee  Copeland  has  held  technical  and   managerial  positions  in  applications  development,  software  testing,  and  software   process  improvement.  At  TechWell,  Lee  has  developed  and  taught  numerous   training  courses  on  software  development  and  testing  issues,  and  is  a  sought-­‐ after  speaker  at  software  conferences  in  the  United  States  and  abroad.  He  is  the   author  of  the  popular  reference  book,  A  Practitioner’s  Guide  to  Software  Test   Design.    
  • 3. 2   3   Lee Copeland TechWell lee@techwell.com @grandpacopeland Testing Lessons from Lean Startups 4  4   Topics •  The Dismal Record of Startups •  Eric Ries •  Foundations of Lean Startup •  What Value for Testers?
  • 4. 3   5  5   The Dismal Record of Startups •  A startup is an organization created to deliver a new product or service under conditions of extreme uncertainty 6  6   The Dismal Record of Startups •  Shikhar Ghosh of the Harvard Business School reported these statistics: –  95% of startups will fall short of their financial projections –  80% will fail to meet their projected return on investment –  40% will cease operations with investors losing everything
  • 5. 4   7  7   The Dismal Record of Startups •  The #1 cause of failure = No Market for their Product •  It’s a great product or service that no one wants to buy 8  8   Eric Ries •  An entrepreneur with an impressive track record –  Product to connect students with … employers –  Product to let people play in a 3D virtual world
  • 6. 5   9  9   Eric Ries •  Ries discovered that under conditions of extreme uncertainty, classical management methods do not bring success ‒  When we lack knowledge – we gather more information ‒  When we lack alignment – we give more detailed instructions ‒  When outcomes are not what we expected – we impose more detailed controls 10  10   Eric Ries •  He formulated the Lean Startup methodology based on his and others’ experiences
  • 7. 6   11  11   Foundations of Lean Startup 1.  Customer Development 2.  Build-Measure-Learn (BML) Loop 3.  Minimum Viable Product (MVP) 4.  Validated Learning 5.  One Metric That Matters (OMTM) 12  12   1. Customer Development •  Learning and discovering who a company’s initial customers will be, and what markets they are in, requires a separate, distinct, and parallel process from Product Development ― Steve Blank
  • 8. 7   13  13   2. Build-Measure-Learn Loop In rapid iterations Persevere or Pivot? •  GOAL: 14  14   3. Minimum Viable Product (MVP)
  • 9. 8   •  The MVP is that version of the product that enables a full turn of the Build-Measure-Learn loop with a minimum amount of effort and the least amount of development time 15  15   3. Minimum Viable Product (MVP) •  The minimum viable product lacks many features that may prove essential later on – and that’s OK 16  16   3. Minimum Viable Product (MVP) (Final product)(Minimum viable product)
  • 10. 9   17  17   4. Validated Learning •  Validated learning is “the process of demonstrating empirically that the team has discovered valuable truths about the present and future business prospects” 18  18   5. One Metric That Matters (OMTM) •  Most metrics gathered by organizations are “vanity metrics.” They make us feel good (or look good), but don’t really show progress toward our goal Number of customers Cost to obtain each new customer Number of customers actually using the product
  • 11. 10   19  19   5. One Metric That Matters (OMTM) •  The One Metric That Matters measures the one most important thing at the present state of the startup 20  20   The Lean Startup Methodology What Value for Testers?
  • 12. 11   21  21   What Value for Testers? •  As software testers, we are rarely part of an entrepreneurial startup team •  Are there lessons for us from the Lean Startup methodology? 22  22   1. Customer Development •  Ask: –  Who are our customers? –  What are their problems our testing solves? –  Do our customers perceive these problems as important? –  Are they willing to pay for our testing services?
  • 13. 12   23  23   1. Customer Development •  Customer Development suggests that we should identify the “customers” of our TESTING SERVICES: –  Developers –  Users –  Management And serve THEM, not our testing process 24  24   1. Customer Development •  Or this could be our future … Largest dot-com flop in history Raised $375 million in first public offering on revenue of $395,000 and net losses of $50 million
  • 14. 13   25  25   2. Build-Measure-Learn Loop •  BML loop is equivalent to the Exploratory Testing loop This  is   where   we  start   Not  here!   26  26   3. Minimal Viable Product (MVP) •  The idea of an MVP suggests we could start with a Minimal Viable Set of Tests •  Don’t strive for “completeness” from the beginning •  Add additional tests as the need becomes apparent and warranted Learn  what  your   customers  want/ need/value  
  • 15. 14   27  27   4. Validated Learning “It isn't what we don't know that gives us trouble, it's what we know that ain't so” Will Rogers American Humorist 28  28   4. Validated Learning •  The Lean Startup methodology suggests running frequent experiments to determine customer response •  As testers, we can run frequent tests to determine both system capabilities and customer satisfaction
  • 16. 15   29  29   5. One Metric That Matters 30  30   5. One Metric That Matters •  Is your metrics program an example of “success theatre”?
  • 17. 16   31  31   5. One Metric That Matters •  Replace the dozens of vanity metrics … –  Test cases planned –  Test cases implemented –  Test cases executed –  Test cases passed –  Test cases failed –  … 32  32   5. One Metric That Matters •  … with one that is truly indicative of something vital
  • 18. 17   33  33   5. One Metric That Matters •  Does your metric –  Measure your success at improving quality? –  Directly relate to product success? –  Tie to real customers of your service? –  Help you determine what to do next? Ivory Madison, “Bonfire of the Vanity Metrics” 34  34   In Conclusion •  The Lean Startup methodology has many insights to offer to software testers •  Become familiar with its precepts. Adopt its ideas for your testing
  • 19. 18   35  35   Thanks Tạm biệt từ Việt NamGood bye from Viet Nam 36  36   One Final Bit of Advice Be Open to Serendipity “Finding something good without looking for it”