Presented in CMPUT664 , Wi '12 in UofAlberta

1. Automatic Identification of Bug-
Introducing Changes
Kim, Zimmermann, Pan, Whitehead
Presented By**:
Arnamoy Bhattacharyya
University of Alberta
**some slides are taken from the presentation of Nicolas Bettenburg

3. Control Development
Multi User Access
Change History
Capture Problems
Multi User Access
Error History

5. Bug Report #5612 reports an error
Error fixed in version 0.13
Commit Message in 0.13 : "Fixed Bug #5612"

6. Finding changes that have repaired a bug
searching for keywords such as "Fixed" or "Bug"
searching for references to bug reports
like “#42233”

7. when?
who?

10. 1: public void bar() { 1: public void foo() { 1: public void foo() {
2: // print report 2: // print report 2: // print out report
3: if (report == null) { 3: if (report == null) 3: if (report != null)
4: println(report); 4: { 4: {
5: } 5: println(report); 5: println(report);
6: } 6: } 6: }
7: } 7. }
Revision 0.11 Revision 0.12 Revision 0.13

11. 1: public void bar() { 1: public void foo() { 1: public void foo() {
2: // print report 2: // print report 2: // print out report
3: if (report == null) { 3: if (report == null) 3: if (report != null)
4: println(report); 4: { 4: {
5: 5: println(report); 5: println(report);
6: } 6: } 6: }
7: }
Revision 0.11 Revision 0.12 Revision 0.13
Running diff tool between 0.12 and 0.13

12. 1: public void bar() { 0.12 sam 1: public void foo() { public void foo() {
2: // print report 0.11 kim 2: // print report // print out report
3: if (report == null) { 0.12 sam 3: if (report == null) 3: if (report != null)
4: println(report); 0.12 sam 4: { 4: {
5: } 0.11 kim 5: println(report); 5: println(report);
6: } 0.11 kim 6: } 6: }
0.11 kim 7: } 7: }
Revision 0.11 Revision 0.12 Revision 0.13
$ cvs annotate –r 0.12 Foo.java

13. 1: public void bar() { 0.12 sam 1: public void foo() { public void foo() {
2: // print report 0.11 kim 2: // print report // print out report
3: if (report == null) { 0.12 sam 3: if (report == null) 3: if (report != null)
4: println(report); 0.12 sam 4: { 4: {
5: } 0.11 kim 5: println(report); 5: println(report);
6: } 0.11 kim 6: } 6: }
0.11 kim 7: } 7: }
Revision 0.11 Revision 0.12 Revision 0.13
Not Necessary Not
Necessary but WRONG Necessary

15. Use Annotation Graphs

16. 1: public void bar() { 1: public void foo() { 1: public void foo() {
2: // print report 2: // print report 2: // print out report
3: if (report == null) { 3: if (report == null) 3: if (report != null)
4: println(report); 4: { 4: {
5:} 5: println(report); 5: println(report);
6: } 6: } 6: }
7: } 7. }
Revision 0.11 Revision 0.12 Revision 0.13

17. 1: public void bar() { 1: public void foo() { 1: public void foo() {
2: // print report 2: // print report 2: // print out report
3: if (report == null) { 3: if (report == null) 3: if (report != null)
4: println(report); 4: { 4: {
5: 5: println(report); 5: println(report);
6: } 6: ----- 6: }
7: }
Revision 0.11 Revision 0.12 Revision 0.13
Detect
function name
Find Bug Inducing
changes
Change

19. 4.1. Using Annotation Graph
False Positive - Indicated as Bug Inducing Change but actually not
False Negative- NOT Indicated as Bug Inducing Change but
actually is one

20. 4.2. Non Behavior Changes
1. Comments
2. Changes to source code format
3. Addition/removal of blank lines
1: public void bar() { 1: public void bar() {
2: if (report == null) { 2: // print report Addition of comment
3: println(report); 3: if (report == null)
4: } 4: { Change of Source code format
5: println(report);
6: Addition of Blank Lines
7: }

21. Ignoring Blank Lines and Comments
removes 14%~20% of false positives

22. Ignoring Source Code Format Changes
removes 18%~25% of false positives and 13%~14% of false
negatives.

23. 4.4. Remove Fix Revision Outliers

24. most of the changes are method name and parameter name changes
ignoring outlier revisions removes 7%~16% of false positives

25. possible that we are ignoring changes are real bug-fixes

26. 4.5. Manual Fix Hunk Verification
how many bug-fix hunks are true bug-fixes???

28. Not perfect BUT Close Enough!!

32. Train Data

33. Help HATARI