Automated software testing is considered critical for software development organizations. It can save time by performing repetitive but necessary tasks, which are already in place, or some testing that is difficult to perform manually. It saves money as well because a time savings means cost savings. Automated testing can also improve accuracy performing the same steps precisely every time it is executed. More importantly, it can find defects in early stages so that we can quickly respond to them. In this talk, we first discuss our practical experience on using automated testing in our project. We present our process and tools to make test automation possible. Lastly, we discuss 7 deadly sins of automated testing.

1. Practical Experience in Automated
Testing at Pronto Marketing
Poomjai Saeyong ft. Kan Ouivirach, PhD
Thailand Practical Software Engineering Conference 2013

2. Speakers
Poomjai Saeyong
Kan Ouivirach, PhD
Agile Tester at Pronto Marketing
Research and Development Engineer
at Pronto Marketing

4. Agile Testing
Automated
Testing at Pronto
Marketing?
Why
Automated
Testing?
Sins of
Automation

5. Agile Testing

6. What is Agile Testing?
“Agile testing involves all members of a cross-functional
Agile team, with special expertise contributed by testers, to
ensure delivering the business value desired by the customer
at frequent intervals, working at a sustainable pace.”
-- Wikipedia

7. Haruka Miyashita

11. Why Automated Testing?

16. Benefits
● Test faster
● Consistency
● Able to run over and over again with less
overhead (save time and money)
● Improve accuracy, less human error
● Increase test coverage

17. Automated Testing at
Pronto Marketing

18. Automated Testing Tools We Use
● Continuous Integration (CI)
○ Buildbot
● Unit Test
○ PHPUnit with WordPress Unit Tests http://core.
trac.wordpress.org/browser/tests
● Functional Test
○ Selenium + Lettuce

19. Continuous Integration Process

20. Buildbot for Continuous Integration
at Pronto Marketing

21. PHPUnit with WordPress Unit Tests

22. Functional Test
+

23. Selenium
http://seleniumhq.org

24. Lettuce
http://lettuce.it

26. Current Problems We Found
● Test scripts are too fast.
○ No problem for PHPUnit
○ Big problem for Selenium + Lettuce
● Language we use in the features are too
low level.
● Higher level language would cause a lot of
duplicated and complicated steps.

27. Trade Off

28. Sins of Automated Testing
● Flawed comparison between manual test
and automation
● Loving the UI so much that all tests are
executed through the UI
● Too lazy to maintain automated tests

29. Thank You
boss@prontomarketing.com
kan@prontomarketing.com

30. Credits
●
●
Content from
○ http://www.methodsandtools.com/archive/archive.php?id=33
○ http://www.agileengineeringdesign.com/2012/01/7-deadly-sins-ofautomated-software-testing/
Images from
○ https://plus.google.com/+BrunoOliveira/posts/MGxauXypb1Y
○ http://www.ranorex.com/blog/integrating-ranorex-automation-injenkins-continuous-integration-process
○ http://www.33rdsquare.com/
○ http://www.greenfieldbelser.com/