1. Why you should have an API performance strategy in place before the holiday rush 2. The effects of API performance on theuser’s experience 3. Challenges simulating load and themetrics that matter most in API performance

1. @SmartBear #HolidayAPISpeed
Preparing for Holiday Performance, API edition

2. @SmartBear #HolidayAPISpeed
This session is being recorded. We’ll
send it to you via email.
Tweet questions using
#HolidayAPISpeed
You can also ask questions in the right
chat panel. We’ll address them at the
end.
Answer our quick survey after the
webinar!
•
•
•
•
Housekeeping
2

3. @SmartBear #HolidayAPISpeed
Our Speakers
3
Mark Tomlinson
API Performance Consultant
PerfBytes, STP Radio
@mtomlins
Paul Bruce
API Product Manager
SmartBear Software
@PaulsBruce
Michael Punsky
President & Load Testing Guru
at FTL Metrics
@mpunsky

4. @SmartBear #HolidayAPISpeed
Why you should have an API performance
strategy in place before the holiday rush
Challenges simulating load and the
metrics that matter most in API performance
API Performance in action!
Takeaways and Q&A
1.
2.
3.
4.
5.
What we’ll cover today
4
The effects of API performance on the
user’s experience

5. @SmartBear #HolidayAPISpeed
Webinar Attendee Statistics
0%
61%
39%
How important is API Performance
to your organization?
Not important at
all
Growing
importance
Very important
30%
70%
0%
How much API Load testing do
you do today?
None
Some
Extensive
39% of attendees for this webinar responded that API
performance is “very important,” and yet 30% responded that they
are doing NO load testing at all.

6. @SmartBear #HolidayAPISpeed
• New & unanticipated workloads
• Unknowns will soon be known
• Data patterns change
• Preparation before, not after
API Performance during the Holiday Season

7. @SmartBear #HolidayAPISpeed
Daily volumes vs. holiday peaks

8. @SmartBear #HolidayAPISpeed
Amazon, Aug 2013, 40mins, $5m
Mins of downtime * avg. revenue / min
= downtime losses
Third party downtime affects everyone
API performance affects mobile & web apps
Case in point: the cost of downtime

9. @SmartBear #HolidayAPISpeed
What’s at risk?

10. @SmartBear #HolidayAPISpeed
Nike+ FuelBand
Fitbit
Jawbone UP24
Amazon Nest
Phillips Hue
Internet-connected TVs
The 2014 Gadget Craze
All of them
use APIs!

11. @SmartBear #HolidayAPISpeed
Hate to make you wait...but...
Back-end “latch” time on middle-tier resources
After two seconds, you’re only a swipe away
 Mobile uninstall
 New browser tab to competitor
 Wait time allows for distraction from UX
goals
Effects of slow APIs on UX

12. @SmartBear #HolidayAPISpeed
What kind of tests do you really need?
How do real conditions differ from testing efforts?
What are your expectations?
How do you set your performance goals?
 What’s your one-x load?
 Which multiples of one-x impact your business?
 Where & why do multiples of one-x occur?
What it looks like to simulate…

13. @SmartBear #HolidayAPISpeed
Common (web / mobile / API)
 Total round-trip time on individual calls
 Failures that the simulation elicited
 Server metrics (effect of load on resources)
Web-specific metrics
 Page, ATF (perceived user metrics)
 UX and Interaction workflows
API-specific metrics
 Throughput: TPS, BPS, queued (arrival)
Metrics: traditional vs. API data

14. @SmartBear #HolidayAPISpeed
Identify critical real-world workflows
Isolate the critical waypoints (API transactions)
Test parts & the whole, not just either/or
Sharing the results
 API Monitoring to API development teams
 Load test results with Ops
 Summarizing results to management
Putting the customer experience 1st

15. @SmartBear #HolidayAPISpeed
API
Focus on API Performance
Load Testing
in
Performance Monitoring
in

16. @SmartBear #HolidayAPISpeed
Better to find out now than later
What you’re losing
 Revenue
 Consumers
 Brand trust
Automating makes room in the schedule
Not everything is a priority; base it on data
What if we don’t have the time?

17. @SmartBear #HolidayAPISpeed
 API Providers: SLA is a promise not to be broken
 API Consumers: 3rd party problems are your problems too
 Decision-makers: Visibility on API performance is critical
to have before the holiday rush
 Developers: fast, regular performance checks help to
keep your backlog clean
 Testers: Load testing makes you a rock star
Key takeaways

18. @SmartBear #HolidayAPISpeed
Thank you to our experts!
Mark Tomlinson
PerfBytes, STP Radio
Michael J. Punsky
FTL Metrics, SmartBear

19. @SmartBear #HolidayAPISpeed
Q & A
Try API Load Testing For Free
FREE TRIAL