MSc Presentation

S E C O A Tool for Semantic Test Coverage Speaker: Jeroen Mengerink Committee: Mariëlle Stoelinga Axel Belinfante Michael Weber

Contents ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Goals ,[object Object],[object Object]

Semantic Coverage (1) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic Coverage (2) ,[object Object],[object Object],[object Object],Coverage = #coverage items exercised Total # of coverage items * 100%

Semantic Coverage (3) ,[object Object],[object Object]

Example (1) Error weights are an indication of the severity of an error. (0, espresso!, 1) (0, coffee!, 1) (0, cappuccino!, 1) (1, cappuccino!, 1) (1, delta!, 1) (2, delta!, 1)

Example (2) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Example (3) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Absolute Coverage Algorithm (1) Absolute coverage Fault automaton Discount function (optional) Test (suite) Coverage value

Absolute Coverage Algorithm (2) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],r ( a i , s ) otherwise α ( s , a i , δ ( s , a i )) · ac( t i , δ ( s , a i ) if a i 2 δ ( s ) {

Absolute Coverage Algorithm (3) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Introduction to S E C O (1) Test selection Select best test Select best n tests Select best test suite Coverage Absolute coverage Total coverage Relative coverage Auxiliary Merge

Introduction to S E C O (2) Specification Value Key (2, button?, 2) (2, coffee!, 0) (2, espresso!, 0) (2, cappuccino!, 0) s 2 (1, button?, 2) (1, coffee!, 0) (1, espresso!, 0) s 1 (0, delta!, 0) (0, button?, 1) s 0

Absolute Coverage with S E C O (1) Absolute coverage Specification Error file Discount file (optional) Test (suite) Double

Absolute Coverage with S E C O (2) ,[object Object],[object Object],[object Object],[object Object]

Semantic vs. Mutant Coverage (1) Mutant Mutant coverage = # incorrect mutants detected total # of incorrect mutants * 100% Specification

Semantic vs. Mutant Coverage (2) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic vs. Mutant Coverage (3) 100.0% 55.8% 5.997 50 20 16 100.0% 54.0% 5.804 25 20 15 100.0% 47.0% 5.046 10 20 14 100.0% 42.3% 4.546 5 20 13 100.0% 55.4% 5.954 50 10 12 100.0% 52.1% 5.594 25 10 11 100.0% 49.6% 5.324 10 10 10 85.7% 46.0% 4.940 5 10 9 71.4% 52.4% 5.625 50 5 8 71.4% 51.9% 5.575 25 5 7 71.4% 46.2% 4.963 10 5 6 71.4% 40.3% 4.325 5 5 5 42.9% 35.4% 3.800 50 2 4 42.9% 35.4% 3.800 25 2 3 42.9% 35.4% 3.800 10 2 2 42.9% 35.4% 3.800 5 2 1 Mutant coverage Relative coverage Absolute coverage #tests depth Test suite

Semantic vs. Mutant Coverage (4) ,[object Object],[object Object],[object Object],100.0% 55.8% 20 100.0% 54.0% 20 100.0% 47.0% 20 100.0% 42.3% 20 100.0% 55.4% 10 100.0% 52.1% 10 100.0% 49.6% 10 85.7% 46.0% 10 71.4% 52.4% 5 71.4% 51.9% 5 71.4% 46.2% 5 71.4% 40.3% 5 42.9% 35.4% 2 42.9% 35.4% 2 42.9% 35.4% 2 42.9% 35.4% 2 Mutant coverage Relative coverage depth

Conclusions ,[object Object],[object Object],[object Object],[object Object]

MSc Presentation

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie MSc Presentation

Ähnlich wie MSc Presentation (20)

MSc Presentation