An introduction to Test Armada's Mocking Service, Midway

1. Himanshu Jain
October 23, 2018
Introduction to Midway
E X P E R I E N C E T O O L S
CUSTO M ER
E X P E R I E N C E T O O L S
DEVELOPER
Test Armada Mocking Service

2. Introduction
Himanshu Jain
Senior EngineeringManager
WalmartLabs
EMAIL: hjain@walmartlabs.com

3. Agenda
• What is Midway?
• What makes Midway Unique?
• Case Study: Walmart Front-end Test Automation
• Interesting Facts
• Q&A

4. Test Armada’s Open Source Mocking Solution that allows mocking of
REST services for faster development and reliable test execution by
eliminating false-negatives.
What is Midway?

5. What makes Midway unique?
MIMIC SMOCKS MIDWAY
Variants
HTTPS Support
UI Interface
Mock Server States
Global Plugins
Proxy Mode
Multi-Platform
Mock from Containers
Drop-and-Respond
Mock Data Sharing
Swagger Integration
Dynamic Data Transportation
Parallel Sessions
FEATURES

6. Case Study
Walmart Front-end
Test Automation

7. Test Execution Challenges
Only 32 test cases could be run in parallel on a VM
LONG TEST CYCLES
~ 100 VMs needed to run roughly 300,000 tests daily.
HUGE HARDWARE COST
Average PR jobs took 4+ hours for 800 tests for one
browser.
LIMITED BROWSER TESTING

8. Test Setup: 32 Max Parallel Tests Limitation

9. Parallel Sessions

10. Test Setup After Parallel Sessions

11. Impact
BEFORE
• Max 32 Tests per VM
• 25+ minutes with 4 servers each to
execute 400 test cases.
• 200+ Tests per VM
• Under 10 minutes with 1 server to
execute 400 test cases.
AFTER
VS
REDUCING HARDWARE
COSTS BY
RESULT
10X

12. Impact
196M Rest APIs
Mocked
80%
Reduction in
Test
Flakiness
50%Test Execution
Time Savings
30%
Reduction in
External
Services
Downtime
Midway

13. Q&A

14. Contact Us
@testarmada
github.com/testarmada
http://www.testarmada.io