Presentation of Test Automation at Rakuten Travel

1. Test Automation at Rakuten Travel
Apr 24, 2019
Clint Cayetano, Chilun Chiang
Travel Product Management Dept.
Rakuten, Inc.

2. 2
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

3. 3
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

4. 4
About Us
Sharon
• Joined Rakuten Travel in 2016
• 3 years experience in Software Quality Assurance Testing
• Likes watching movies and playing games
Clint
• Joined Rakuten Travel in 2016
• More than 10 years in Product Development and Testing
• Likes travelling and reading non-fiction books

5. 5
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

6. 6

7. 7
Make people happy with Travel
(Travelers & Partners)

8. 8
Develop
Test
Defect
Discovery
High Quality
Products

9. 9
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

10. 10
Benefits
24/7
Less
Resource
ROI
Reusable
Code
Early
Feedback
Reliable

11. 11
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

12. 12
Evolution
Simple Data
Driven with
Selenium
Data Driven
with
Cucumber
(Excel File
Based)
Data Driven
with Robotium
and TestNG
(CSV Based)
for Android
Data Driven
with TestNG
for WebUI
Data Driven
with TestNG
for WebUI,
Android, IOS
& API

13. 13
Roles
Test
Management
Development
Coordination Operation

14. 14
Roles
Test
Management
Development
Coordination Operation
• Code Review
• Communication
• Overall
Responsibility
• Test Scenario
Design
• Project Schedule
Management
• Test
Implementation
• Framework
Update
• Monitoring
• Bug Ticket
Creation

15. 15
Overall Process
Requirements
Analysis
Test Scenario
Creation
Review
Test
Development
Code Review
Test
Execution
Defect
Detection and
Reporting

16. 16
Development

17. 17
Code
Static Code Analysis
•
Code Review
•
Version Control
•
FindBugsCheckstyleSonarlint
Bitbucket
git

18. 18
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

19. 19
Testware Overview
Core
Executor Reporter
Testcase
Test Data
Test
Runner
API Driver
UI Driver
Dictionary
Reporter

20. 20
Test Data Generation
Test Data
Generator
Test Data Model
API Test Data
Reference
Data
3
21

21. 21
Testcase Generation
Combination
Generator
Test Pattern
Test Case
Generator
Reference
Data
Test Case
(graphml)

22. 22
Continuous Integration
We started to integrate our automated test with CI in Travel starting with API tests.

23. 23
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

24. 24
Test Report
Dictionary
UI Test Automation
Reference
Data
Testcases
Testware
Java
TestNG
NGINX
Execution
Jenkins
Selenium
MongoDB

25. 25
getDictionaryData(Key,Language)
Data Dictionary
Data Dictionary is used for Format and Term Testing.
Test
Parameter
There is an error in the user ID /
password, or it is not register
ユーザID・パスワードに誤りがある
か、登録されていません
Test

26. 26
UI Test Automation Challenges
Deployment Cycle on
Automation Test Environment
Element Locator
Develop
Deploy
Test
Develop
Deploy
Test
Develop
Deploy
Test

27. 27
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

28. 28
Test Report
API Test Automation
Testcases
Testware
Java
TestNG
Apache HTTP
NGINX
Execution
Jenkins

29. 29
API Test Automation Challenges
Request Response
Request Response
Test framework from scratch Generically create request/reference response

30. 30
1.Introduction
2.Rakuten Travel
3.Benefits
4.Team
5.Testware Overview
6.UI Test Automation
7.API Test Automation
8.Conclusion

31. 31
In conclusion, the test automation partly failed.
UI tests were suspended but the API tests are being used.
The reasons are:
1) Testcase Quality
The testcase quality was low. We focused on quantity rather than quality and we have separate
testcases from manual testers. The generated testcases were many, so it took a lot of time to
execute and maintain.
2) Progression Test Automation
We developed progression testing with lack of proper information and lack of organization.
3) End-to-End Scenario
The developed test automation were end-to-end scenario based. Whenever there is failure at any
point during the test, the test will fail.

32. 32
We are
Improving
the test automation at Rakuten Travel.
If you are interested, please approach us!

33. 33
Thank You!