RUM experts share their perspectives! On the heels of SOASTA’s acquisition of LogNormal and mPulse product announcement at Velocity in London, we’re introducing our team and hosting a discussion with the experts on real user measurement. While RUM offerings have driven a lot of buzz lately, this preferred method of measurement for web — and now mobile — performance got its start early in this decade’s performance movement. Join us for a round table discussion on the importance that RUM has played and continues to play for development, test, operations and marketing professionals. This panel will be moderated by Cliff Crocker, SOASTA VP of Product Management. Panelists: Buddy Brewer – Former CEO of LogNormal, now SOASTA VP of Engineering Philip Tellis – Former CIO of LogNormal, now SOASTA Chief Architect Aaron Kulick – Founder of the SF WebPerf group and current guerrilla engineer on the Big Fast Data team @WalmartLabs

1. Presents
Real User
Measurement
Past, Present &
Future
Webinar © 2012 SOASTA. All rights reserved. 1

2. Real user measurement – then and now…and….
TODAY’S PRESENTERS
Aaron Kulick: – Speed Freak @WalmartLabs - @GoFastWeb
Buddy Brewer: VP Engineering, SOASTA - @bbrewer
Phillip Tellis: Chief Architect, SOASTA - @bluesmoon
Cliff Crocker: VP Product Management, SOASTA mPulse - @cliffcrocker
Agenda:
• Roundtable discussion
• Moderated QA with Panelists
Questions:
Submit in the question box during event
© 2012 SOASTA. All rights reserved. October 30, 2012 2

3. Cliff Crocker Buddy Brewer Philip Tellis Aaron Kulick
• VP Product • VP Engineering • Chief Architect • Guerilla Engineer
SOASTA SOASTA SOASTA @WalmartLabs
• Real User • Co-founder of • Co-founder of • Founder SF Web
Measurement LogNormal LogNormal Perf Meetup and
(mPulse) • @bbrewer • @bluesmoon Web Perf Days
• @cliffcrocker • @GoFastWeb

4. Internet Explorer 6
© 2012 SOASTA. All rights reserved. October 30, 2012 4

5. Internet Explorer 7, 8
Chrome 1, 2, 3
Firefox 2, 3
iPhone 1st Gen, 3G
© 2012 SOASTA. All rights reserved. October 30, 2012 5

6. Chrome 4, 5, 6, 7, 8, 9, 10,
11, 12, 13, 14, 15, 16, 17,18, 19
Internet Explorer 9
iPhone 3GS,
4, 4S, 5
Firefox 4, 5, 6, 7, 8, 9, 10,
11, 12, 13, 14, 15, 16
Android Cupcake, Donut, Éclair, Froyo,
Gingerbread, Honeycomb, Jelly Bean
iPad 1, 2, 3, 4, Mini
© 2012 SOASTA. All rights reserved. October 30, 2012 6

7. • When we speak about performance, we're really talking about
latency
• Humans have measured latency for as long as we've known large
distances
© 2012 SOASTA. All rights reserved. October 30, 2012 7

8. • “How long does it take to get a package from NY to SF?”
• “How fast can a man run 100 metres?”
• “What's the fastest laptime at the Indy 500?”
© 2012 SOASTA. All rights reserved. October 30, 2012 8

9. In general, fast things excite us and slow things frustrate us.
© 2012 SOASTA. All rights reserved. October 30, 2012 9

10. So what should we measure, and how should we measure it?
© 2012 SOASTA. All rights reserved. October 30, 2012 10

11. • The traditional way is to use robots
• This is good to tell us about infrastructure - but what we really care
about is user experience
© 2012 SOASTA. All rights reserved. October 30, 2012 11

12. That's akin to asking a Robot to drive Route 66 and tell you if it was
exciting or boring
… and you have to do this with 374 different cars!
© 2012 SOASTA. All rights reserved. October 30, 2012 12

13. So let's bring out the RUM!
© 2012 SOASTA. All rights reserved. October 30, 2012 13

14. • Measure the real experience of a real user
• How fast was their experience?
• Were they engaged, did they take out their credit cards, do they
stick around?
© 2012 SOASTA. All rights reserved. October 30, 2012 14

15. A Brief History of RUM …
© 2012 SOASTA. All rights reserved. October 30, 2012 15

16. At a Yahoo! internal hack day, Steve Souders built a
JavaScript tool to measure page load time within the browser.
© 2012 SOASTA. All rights reserved. October 30, 2012 16

17. Several Improvements were made:
• Bandwidth measurements added
• Creation of Yslow
• 100s of billions of datapoints were analysed (a tiny sample of Yahoo!’s
traffic at the time)
© 2012 SOASTA. All rights reserved. October 30, 2012 17

18. Steve Souders open sources Episodes
• http://stevesouders.com/episodes/paper.php
WhitePages.com published jiffy
• http://code.google.com/p/jiffy-web/
© 2012 SOASTA. All rights reserved. October 30, 2012 18

19. Yahoo! open sourced the JavaScript library, called
boomerang, under the BSD license
• http://lognormal.github.com/boomerang/doc/
At the same time (on the same day actually), Internet Explorer 9
beta announced support for the Navigation Timing API.
• http://www.w3.org/TR/navigation-timing/
© 2012 SOASTA. All rights reserved. October 30, 2012 19

20. Let's talk a bit about NavTiming
• Exposes network level timing details to JavaScript
• DNS lookup, TCP connect, SSL handshake, First Byte time, and more
• For a given web request, you can tell exactly where the time was spent
• Supported by IE >= 9, Chrome >=6, Firefox >=7
• No exposure into rendering times
© 2012 SOASTA. All rights reserved. October 30, 2012 20

22. The level of detail available in NavTiming made RUM performance
data comparable to what you'd get from a bot.
boomerang integrates well with it, and works around browser bugs
when needed
© 2012 SOASTA. All rights reserved. October 30, 2012 22

23. Buddy and I started LogNormal to pull in data from boomerang,
analyze it, and present it back to site owners in a useful way.
© 2012 SOASTA. All rights reserved. October 30, 2012 23

24. In 2012, the area has exploded with many new companies getting in to
the playing field
LogNormal is now part of SOASTA and the product is called mPulse
© 2012 SOASTA. All rights reserved. October 30, 2012 24

25. At SOASTA, we'd like mPulse to look deeper into the human aspect of
web and mobile performance
© 2012 SOASTA. All rights reserved. October 30, 2012 25

26. © 2012 SOASTA. All rights reserved. October 30, 2012 26

28. Real User Measurement and the ‘Tribe’
http://sfwebperf.org
@SFWebPerf
http://webperfdays.org
@WebPerfDays

29. Thinking beyond the current horizon, where do you see real user
measurement over the next 10 years?
© 2012 SOASTA. All rights reserved. October 30, 2012 29

30. Q&A
Source: Flickr –
jamescridland
Listen to Your Users

31. Thank You!
Next Webinar: Nov. 15, 2010 - 10 a.m. PST
“Automated Testing & Continuous Integration in the Cloud”
* Kohsuke Kawaguchi – Jenkins CI creator & SOASTA TouchTest mobile CI demo *
Register at www.soasta.com/knowledge-center/webinars
Contact Us: mPulse@soasta.com
Contact SOASTA:
www.soasta.com
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
© 2012 SOASTA. All rights reserved. October 30, 2012 31