SlideShare ist ein Scribd-Unternehmen logo
1 von 41
Downloaden Sie, um offline zu lesen
Introduction to Bugs Measurement
by V. Novostavsky
Yes, it’s about metrics
TOC

• What we’re talking about
• Why it's good, and when it’s evil
• “Easy way”
Definition
• Distance function
  – from “anything” to numbers :)
Metrics in life: School
Metrics in life: Traders
Metrics in life: dou.ua
… in testing


– Usually we measure bugs
  • because there’re a lot of bugs 




  We can measure barely anything in testing, but that’s another story…
… in testing

– Number of open bugs
– Bugs per module
– Bugs reopened
– Bugs posted in a week
– Bugs rejected / accepted
– A lot of other stuff…
… in testing

– Number of open bugs
– Bugs per module
– Bugs reopened
– Bugs posted in a week
– Bugs rejected / accepted
– A lot of other stuff…
Why it's important
• tester's job is info support for the project
Why it's important
• tester's job is info support for the project
• more and diverse info -> better conclusions ->
  easier decisions
Why it's important
• tester's job is info support for the project
• more and diverse info -> better conclusions ->
  easier decisions
• metrics are facts, operate with facts, not blah-
  blah-blah
Why it's important
• tester's job is info support for the project
• more and diverse info -> better conclusions ->
  easier decisions
• metrics are facts, operate with facts, not blah-
  blah-blah
• example: “big” manager
Why it's important
• tester's job is info support for the project
• more and diverse info -> better conclusions ->
  easier decisions
• metrics are facts, operate with facts, not blah-
  blah-blah
• example: “big” manager

• NOTE: don't judge too quickly!
Example



500 open bugs this week…
         A lot of?
Example
Example



More bugs in a module…
   Does it mean it’s worse?
Example
Example



Less bugs this week…
      Is it good?
Example
Top issues
Top issues
• time waste!
Top issues
• time waste!




• wrong conclusions and politics!
Top issues
• time waste!
make it easier to generate metrics


• wrong conclusions and politics!
Top issues
• time waste!
make it easier to generate metrics


• wrong conclusions and politics!
make it clear what they mean
“Easy way”
• Step 1: choose correct metrics for you
“Easy way”
• Step 1: choose correct metrics for you
  – Not so easy!
“Easy way”
• Step 2: ensure everybody gets what they
  mean
“Easy way”
• Step 3: automate them (+ use SQL)
“Easy way”
• Step 4: be prepared for change requests
“Easy way”
• Step 5: use often
“Easy way”
• Step 6: publish online
“Easy way”
• Step 6: publish online
  – Publish charts!
“Easy way”
1.   choose correct metrics for you
2.   ensure everybody gets what they mean
3.   automate them
4.   be prepared for change requests
5.   use regularly
6.   publish online
Example: my metrics
• No classic test cases & project is not big
  – Bug metrics only

• Custom bugtracker
  – No access to DB

• 2 metrics - weekly
  – Open bugs: Trend in time
  – Open bugs: By modules
Example: tools
• MS XLS –> MS SQL
Example: tools
• MS XLS –> MS SQL




• Google Docs
Example: my trender
Example: my rollup
Thanks!


 Q&A

Weitere ähnliche Inhalte

Was ist angesagt?

Many Changes Little Fun
Many Changes Little Fun Many Changes Little Fun
Many Changes Little Fun Anton Weiss
 
Engineering Change
Engineering ChangeEngineering Change
Engineering ChangeKellan
 
Testing for everyone agile yorkshire
Testing for everyone agile yorkshireTesting for everyone agile yorkshire
Testing for everyone agile yorkshireAdy Stokes
 
My personal experiment on QS and IoT for Motivation
My personal experiment on QS and IoT for MotivationMy personal experiment on QS and IoT for Motivation
My personal experiment on QS and IoT for MotivationCharalampos Doukas
 
Agile bodensee - Agile Testing: Bug prevention vs. bug detection
Agile bodensee - Agile Testing: Bug prevention vs. bug detectionAgile bodensee - Agile Testing: Bug prevention vs. bug detection
Agile bodensee - Agile Testing: Bug prevention vs. bug detectionMichael Palotas
 
The good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo softThe good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo softXBOSoft
 
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...Vickie Evans
 
Getting better all the time – and Fast! How Agile drives marketing excellence
Getting better all the time – and Fast! How Agile drives marketing excellence Getting better all the time – and Fast! How Agile drives marketing excellence
Getting better all the time – and Fast! How Agile drives marketing excellence Angela Bates
 
Learn to Code: SXSX 2012
Learn to Code: SXSX 2012Learn to Code: SXSX 2012
Learn to Code: SXSX 2012Nate Westheimer
 
Purity vs Pragmatism
Purity vs PragmatismPurity vs Pragmatism
Purity vs PragmatismJeff Gothelf
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of TestingHo Chi Minh City Software Testing Club
 

Was ist angesagt? (15)

Many Changes Little Fun
Many Changes Little Fun Many Changes Little Fun
Many Changes Little Fun
 
The 7 Days Open Source Challenge
The 7 Days Open Source ChallengeThe 7 Days Open Source Challenge
The 7 Days Open Source Challenge
 
Engineering Change
Engineering ChangeEngineering Change
Engineering Change
 
Testing for everyone agile yorkshire
Testing for everyone agile yorkshireTesting for everyone agile yorkshire
Testing for everyone agile yorkshire
 
Create your mvp
Create your mvpCreate your mvp
Create your mvp
 
My personal experiment on QS and IoT for Motivation
My personal experiment on QS and IoT for MotivationMy personal experiment on QS and IoT for Motivation
My personal experiment on QS and IoT for Motivation
 
Agile bodensee - Agile Testing: Bug prevention vs. bug detection
Agile bodensee - Agile Testing: Bug prevention vs. bug detectionAgile bodensee - Agile Testing: Bug prevention vs. bug detection
Agile bodensee - Agile Testing: Bug prevention vs. bug detection
 
The good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo softThe good, the bad, and the metrics webinar hosted by xbo soft
The good, the bad, and the metrics webinar hosted by xbo soft
 
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...
RISE Austin 2013 - Show me the Money! Timesaving (and jaw-dropping) productiv...
 
Getting better all the time – and Fast! How Agile drives marketing excellence
Getting better all the time – and Fast! How Agile drives marketing excellence Getting better all the time – and Fast! How Agile drives marketing excellence
Getting better all the time – and Fast! How Agile drives marketing excellence
 
Learn to Code: SXSX 2012
Learn to Code: SXSX 2012Learn to Code: SXSX 2012
Learn to Code: SXSX 2012
 
Five UX Myths to Avoid
Five UX Myths to AvoidFive UX Myths to Avoid
Five UX Myths to Avoid
 
Doing monitoring right
Doing monitoring rightDoing monitoring right
Doing monitoring right
 
Purity vs Pragmatism
Purity vs PragmatismPurity vs Pragmatism
Purity vs Pragmatism
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
 

Ähnlich wie Introduction to bugs measurement

Mal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingMal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingandytinkham
 
No More Excuses: Create a testing plan with no traffic, time, or budget
No More Excuses: Create a testing plan with no traffic, time, or budgetNo More Excuses: Create a testing plan with no traffic, time, or budget
No More Excuses: Create a testing plan with no traffic, time, or budgetNTEN
 
ACC presentation for QA Club Kiev
ACC presentation for QA Club KievACC presentation for QA Club Kiev
ACC presentation for QA Club KievNikita Knysh
 
Artur Suchwalko “What are common mistakes in Data Science projects and how to...
Artur Suchwalko “What are common mistakes in Data Science projects and how to...Artur Suchwalko “What are common mistakes in Data Science projects and how to...
Artur Suchwalko “What are common mistakes in Data Science projects and how to...Lviv Startup Club
 
No More Excuses. Create a Testing Plan with No Traffic, Time, or Budget
No More Excuses.  Create a Testing Plan with No Traffic, Time, or BudgetNo More Excuses.  Create a Testing Plan with No Traffic, Time, or Budget
No More Excuses. Create a Testing Plan with No Traffic, Time, or BudgetNTEN
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtcGerieOwen
 
Lean conference 2014 Open Market - how we have benefited from the application...
Lean conference 2014 Open Market - how we have benefited from the application...Lean conference 2014 Open Market - how we have benefited from the application...
Lean conference 2014 Open Market - how we have benefited from the application...Invest Northern Ireland
 
Customer Feedback: the missing piece of the Agile puzzle
Customer Feedback: the missing piece of the Agile puzzleCustomer Feedback: the missing piece of the Agile puzzle
Customer Feedback: the missing piece of the Agile puzzleskierkowski
 
Agile for Me- CodeStock 2009
Agile for Me- CodeStock 2009Agile for Me- CodeStock 2009
Agile for Me- CodeStock 2009Adrian Carr
 
Session-Based Test Management
Session-Based Test ManagementSession-Based Test Management
Session-Based Test Managementcaltonhill
 
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...COMAQA.BY
 
Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? SQALab
 
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHubSOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHubDevOpsDays Tel Aviv
 
PI Boot Camp 2015.06 Participant Packet
PI Boot Camp 2015.06 Participant PacketPI Boot Camp 2015.06 Participant Packet
PI Boot Camp 2015.06 Participant PacketMike Rudolf
 
Why do you think your DevOps works.
Why do you think your DevOps works.Why do you think your DevOps works.
Why do you think your DevOps works.Borys Drozhak
 
Lean Startup Introduction - EFYI'16 - Slides
Lean Startup Introduction - EFYI'16 - SlidesLean Startup Introduction - EFYI'16 - Slides
Lean Startup Introduction - EFYI'16 - SlidesGregory Prokopski
 
Nondeterministic Software for the Rest of Us
Nondeterministic Software for the Rest of UsNondeterministic Software for the Rest of Us
Nondeterministic Software for the Rest of UsTomer Gabel
 

Ähnlich wie Introduction to bugs measurement (20)

Mal12 qa tand-automatedtesting
Mal12 qa tand-automatedtestingMal12 qa tand-automatedtesting
Mal12 qa tand-automatedtesting
 
Lean Startup 301
Lean Startup 301Lean Startup 301
Lean Startup 301
 
No More Excuses: Create a testing plan with no traffic, time, or budget
No More Excuses: Create a testing plan with no traffic, time, or budgetNo More Excuses: Create a testing plan with no traffic, time, or budget
No More Excuses: Create a testing plan with no traffic, time, or budget
 
ACC presentation for QA Club Kiev
ACC presentation for QA Club KievACC presentation for QA Club Kiev
ACC presentation for QA Club Kiev
 
Artur Suchwalko “What are common mistakes in Data Science projects and how to...
Artur Suchwalko “What are common mistakes in Data Science projects and how to...Artur Suchwalko “What are common mistakes in Data Science projects and how to...
Artur Suchwalko “What are common mistakes in Data Science projects and how to...
 
No More Excuses. Create a Testing Plan with No Traffic, Time, or Budget
No More Excuses.  Create a Testing Plan with No Traffic, Time, or BudgetNo More Excuses.  Create a Testing Plan with No Traffic, Time, or Budget
No More Excuses. Create a Testing Plan with No Traffic, Time, or Budget
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
 
Lean conference 2014 Open Market - how we have benefited from the application...
Lean conference 2014 Open Market - how we have benefited from the application...Lean conference 2014 Open Market - how we have benefited from the application...
Lean conference 2014 Open Market - how we have benefited from the application...
 
Customer Feedback: the missing piece of the Agile puzzle
Customer Feedback: the missing piece of the Agile puzzleCustomer Feedback: the missing piece of the Agile puzzle
Customer Feedback: the missing piece of the Agile puzzle
 
Agile for Me- CodeStock 2009
Agile for Me- CodeStock 2009Agile for Me- CodeStock 2009
Agile for Me- CodeStock 2009
 
Session-Based Test Management
Session-Based Test ManagementSession-Based Test Management
Session-Based Test Management
 
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...
Vivien Ibironke Ibiyemi. Comaqa Spring 2018. Enhance your Testing Skills With...
 
Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you?
 
Cerias talk on testing and evaluation
Cerias talk on testing and evaluationCerias talk on testing and evaluation
Cerias talk on testing and evaluation
 
Intro to TDD
Intro to TDDIntro to TDD
Intro to TDD
 
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHubSOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
SOLVING MLOPS FROM FIRST PRINCIPLES, DEAN PLEBAN, DagsHub
 
PI Boot Camp 2015.06 Participant Packet
PI Boot Camp 2015.06 Participant PacketPI Boot Camp 2015.06 Participant Packet
PI Boot Camp 2015.06 Participant Packet
 
Why do you think your DevOps works.
Why do you think your DevOps works.Why do you think your DevOps works.
Why do you think your DevOps works.
 
Lean Startup Introduction - EFYI'16 - Slides
Lean Startup Introduction - EFYI'16 - SlidesLean Startup Introduction - EFYI'16 - Slides
Lean Startup Introduction - EFYI'16 - Slides
 
Nondeterministic Software for the Rest of Us
Nondeterministic Software for the Rest of UsNondeterministic Software for the Rest of Us
Nondeterministic Software for the Rest of Us
 

Introduction to bugs measurement

Hinweis der Redaktion

  1. Poll