Functional Tests Automation with Robot Framework. Slides from a talk given at softShake 2013.

1. Functional Tests
Automation
with Robot Framework
Laurent Bristiel
nov 2013

2. Target audience
testers over developers
products over projects
application/web over mobile
Agile over traditional

3. What tests?
End 2 End
Component Tests
Unit Tests
Exploratory
Tests

4. Why automation?
lazy
cautious
wise

5. When to automate?
before development
during development
after development

6. What tool?

7. Robot Framework
Generic framework for tests automation
Open Source - Apache 2.0 licence
Sponsored by Nokia Siemens Networks
Written in Python
Current version 2.8.1 (june 2013)
Several approach of tests

8. Architecture
a test case is a file
a test case is a suite of
keywords with arguments
Keywords are builtin, written in
Python or in Java
Robot execute the keywords
until it reaches an exception
If exception, test case is failed,
otherwise it is passed
command line results
and html report
log file

9. Architecture
Librairies
SUT

10. Keyword-driven

11. data-driven

12. behaviour-driven (BDD)

13. LIVE CODING
checking files

14. LIVE CODING
checking through REST API

15. LIVE CODING
checking through web UI

16. Feedback
Moody’s : 800 tests on 5 products
Finance, C++, SQL, Windows
Robot used by technical and functional QA
XLS spreadsheets used as tests config
ForgeRock : 400 tests on 3 products
Identity, Java, BD, JSON, REST, Linux, Mac, backbone.js
Heteregeous tests on multi-plateforms (OS, BD, Java...)
Performance optimization with multi-levels setup/teardown

17. Good points
lightweight, simple, fast
easy to read tests
can be used by non-technical QA
unique entry point for heterogeneous tests
many Python libraries available

18. Limitations
Robot DSL can seem restricted
Custom IDE (RIDE) not working well on Mac
Tests are so easy to write they can be dirty code
!
Might be too optimistic to expect products and dev
teams to write or maintain tests
QA might end up isolated on their own framework

19. Bonus
Jenkins Plugin
Maven Plugin
IDE Plugin (Eclipse,Vim, Textmate)
Active mailing list

20. Functional Tests Automation
with Robot Framework
Thanks
Questions?
laurent.bristiel.com
http:/
/robotframework.org
laurent@bristiel.com