Code Coverage - A Dump Metric by Thomas Rothe

1. DevOpsDays Jakarta 2020
Code Coverage – A Dump Metric
by Thomas Rothe
BRI Corporate University, March 12th 2020

2. CODE COVERAGE – A DUMP METRIC
For Code Quality Thomas Rothe

3. Enterprise DevOps Coach
Thomas Rothe

4. Code Coverage is not a bad metric
- It's just a dump one!

5. Fixing (and finding) bugs late is costly

6. Code Coverage
Is a measure used in software testing. It describes the degree to
which the source code of a program has been tested.
https://en.wikipedia.org/wiki/Code_coverage

7. SourcecodeUnitTestCC

8. SourcecodeUnitTestCC

9. The Sneaky Developer The Metric Lovin’ Manager

10. SourcecodeUnitTestCC

11. SourcecodeUnitTestCC

12. Why?
Why do we need Code Coverage
____________________________________________
To Ensure Quality
Minimize Bugs/Defects
Early detection of flaws
Avoid Cost due to Rework and Delay
Higher Confidence
Everyone Happy

13. Software Negligence & Testing Coverage, Cem Kraner, 1995
The question is, what's wrong with this argument?

14. The Tragedy
of 100%
Code Coverage

15. How to reach 100% Code Coverage
____________________________________________
Every line of source code covered
Every underlying dependency is covered
Every possible representative input is covered
Every branch, condition and statement is covered
Every unexpected and error case is covered

16. Journey to Success ….

17. Do we really need 100% Code Coverage?
____________________________________________
Every high risk area is covered
Every Sprint we increase our test suite and coverage
Every test is valuable

18. Program
Mutant 1
Mutant 2
Mutant 3
Test
Suite
4. Compare
Test
Suite
Same
Same
Different
(“killed”)
1. Test
3. Test
Test Outputs
Test Outputs
2. Mutation
Operation
Adequacy:
= #Different / total
= 1/3
= 33%
Mutation Testing
Reruns unit tests against modified version of your code

19. The Good
Developer

20. linkedin.com/in/throthe/
thomas.rothe@devops.co.id
Thank You

21. DevOpsDays Jakarta 2020
Venue Sponsor

22. DevOpsDays Jakarta 2020
Platinum Sponsors

23. DevOpsDays Jakarta 2020
Gold Sponsors

24. DevOpsDays Jakarta 2020
Silver Sponsors

25. DevOpsDays Jakarta 2020
University Partners

26. DevOpsDays Jakarta 2020
Community Partners

27. DevOpsDays Jakarta 2020
Media Partners

28. Stay Connected
@IDDevOps @IDDevOps @IDDevOps
DevOps Indonesia
DevOps Indonesia DevOps Indonesia

29. THANK YOU !
Alone We are smart, together We are brilliant