1. Real
Time
Trend
&
Failure
Analysis
using
Test
Trend
Analyzer
(TTA)
Anand
Bagmar
Aasawaree
Deshmukh

2. Reality
in
Organiza.ons

4. Product
1
Product
3
Product
2
Product
4

6. Test
Trend
Analyzer
(TTA)

7. TTA
–
Test
Trend
Analyzer
-­‐
Vision
• A
single
point,
visual
solu0on
to
gauge
the
health
of
your
product
por:olio
using
Test
Automa.on
results
by
means
of
–
– Compara.ve
views
– Trends
analysis
– Failure
analysis
• and
providing
– Drill-­‐down
reports
– Customizable
reports
• So
that
– Different
stakeholders
can
get
single
click
view
of
the
health
status
and
poten.al
issues
– A
project
team
can
decide
if
automa.on
is
useful
or
not.
–
automated
data
colla.on
and
trending
to
avoid
manual
data
aggrega.on
and
interpreta.on
• With
the
stakeholders
being
–
–
–
–
Developers
QA
QA
Leads
/
Manager
/
Directors
Tech-­‐Ops

8. Collect
Test
Run
data
in
TTA
• Automa.c
Upload
• Manual
Upload

9. CI
Integra.on
Test
Framework
Job(s)
Triggered

10. CI
job
triggered
Build
Tool
Test
Command
Clean
/
Compile
/
Setup
Run
Tests
Return
to
CI

11. CI
job
triggered
Build
Tool
Ant
/
Maven
/
Gradle
/
Test
Command
Make
/
Rake
…
Clean
/
Compile
/
Setup
xUnit
/
testNG
/
…
Run
Tests
Java
/
C#
/
Perl
/
Python
/
Ruby
…
Send
results
to
TTA
Return
to
CI
GO
/
Hudson
/
Jenkins
/
Bamboo
/
..

19. For
Different
Sub
–
Projects
Tests
Summary
%
of
Tests
Passed
%
of
Tests
Failed
%
of
Errors
90
89
74
67
10
3
Project
1
12
5
Project
2
8
4
Project
3
2
8
Project
4

20. Test
Status
for
a
Single
Project
Project-­‐ABC
10%
2%
%
of
tests
passed
%
of
tests
failed
88%
%
of
tests
not
completed

21. For
Tech-­‐Ops
/
IT
Machine
U0liza0on
for
Test
Execu0on
No.
of
hours
12
10
8
6
4
2
0
Project
1
Project
2
Project
3
Machine
1
10
4
2
Machine
2
12
8
4
Machine
3
6
0
9
Machine
4
7
9
5

22. How
to
use
TTA
• Copyright
2013
ThoughtWorks,
Inc.
• Distributed
under
the
Apache
2.0
License
• Available
on
github
at:
– hdps://github.com/anandbagmar/da
• Instruc.ons
available
on
github
wiki
at:
– hdps://github.com/anandbagmar/da/wiki

24. • Contact:
– Send
an
email
to
da@thoughtworks.com
– @BagmarAnand
Copyright
2013
ThoughtWorks,
Inc.
Apache
2.0
License