The presentation on HikeRunner: Load Test Framework was done during #ATAGTR2017, one of the largest global testing conference. All copyright belongs to the author.
Author and presenter : Harsh Verma
2. Agile Testing Alliance Global Testing Retreat 2017
Indian Messaging App
● Launched globally in December 2012
● 100m+ users
● 40 billion + messages per month
● iOS/Android
Based in
● Bengaluru
● New Delhi
What we do at Hike?
3. Agile Testing Alliance Global Testing Retreat 2017
Why Load Test Hike ?
● 100+ Millions users, 40 billion+ messages per
month
● To mimic user journey based on analytics data
● To cover all permutations of user flows
● To scale infra systems based on results
● To find performance degradation point of Hike
services
Our Solution : HikeRunner
4. Agile Testing Alliance Global Testing Retreat 2017
Metrics we take into consideration ?
● Throughput
● CPU Utilization
● Memory Consumption
● Network Bandwidth
● Latency
● Load Average on system
5. Agile Testing Alliance Global Testing Retreat 2017
HikeRunner: LoadTest Framework
HikeRunner: In-house Load Test Framework to mock
user journey based on data from analytics system.
● Mimic Real Time Scenarios
● Vertically load test any service
● Robust and easily scalable
● Can be used for soak testing
● Benchmark(releases), throughput
● Help in finding bottleneck in system
What it does:
12. Agile Testing Alliance Global Testing Retreat 2017
Our Key Takeaways:
● Mocking user journey based on analytics help us finding bottleneck
points, performance degradation at various layers of db/cache/service
● Assertion scripts are useful to find threshold point and generate alerts
● Infrastructure scalability can be taken into consideration based on load
generated results
● Disk Utilization and archiving of generated component logs.