UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
MeasureWorks - Tying web performance to analytics
1. Who cares about customer
experience?
A Complete
Web Monitoring
perspective
Web Analytics Conference 2010
in collaboration with MeasureWorks
2. “Hard” data
Analytics Usability Performability
(what did they (how did they (could they do
do on the interact with what they
site?) it?) wanted to?)
Complete Web Monitoring
Community VoC Competition
(what were (what were (what are they
they saying?) their up to?)
motivations?)
“Soft” data
41. Figure 3 Interactive user productivity versus computer response time for human-intensive
interactions for system A
E 600
-
3
T -" INTERACTIVE USER PRODUCTIVITY (IUP)
w
-HUMAN-INTENSIVE COMPONENT OF IUP
7 MEASURED DATA (HUMAN-INTENSIVE
E 500 -
A
z " COMPONENT)
U
E
-
w
E 0
>
-
>
- -
400
3
n
F
2
0
0
300 -
200 -
100 -
0
0- I 1 I I I
0 1 2 3 4 5
COMPUTER RESPONSE TIME (SI
(1981) A. J. Thadhani, IBM Systems Journal, Volume 20, number 4
48. Shopzilla had another angle
• Big, high-traffic site • 16 month re-engineering
• 100M impressions a day • Page load from 6 seconds to
1.2
• 8,000 searches a second
• 20-29M unique visitors a • Uptime from 99.65% to
month 99.97%
• 100M products • 10% of previous hardware
needs
http://en.oreilly.com/velocity2009/public/schedule/detail/7709
57. ATTENTION ENGAGEMENT CONVERSION
NEW
SEARCH VISITO
ES RS
GROWT CONVERSI
TWEETS
NUMB
H
PAGE ON
ER TIME RATE
S
MENTI PER
ON x
OF SITE
ONS VISIT ORDER
VISITS
LOSS VALUE
ADS BOUN
CE
SEEN
RATE
59. VISITOR STRANGELOOP WEB
ACCELERATOR SERVER
Decide
whether
to optimize
Normal
Accelerat
Receive content
page
Insert
Process
scripts Optimize? segment
marker
Send
analytic Unacceler
GOOGLE
ANALYTICS
63. % visits marked “new”
% of visits that had no returning cookie
14
11
7 13,61%
10,85%
4
0
Optimized Unoptimized
Visitor experience
64. That means...
9000
Value Number of visits
6750
4500 7.582
4.095
2250
923 645
0
Optimized Unoptimized
65. Average time on site
31
Time on site (minutes)
23
16 30,17
23,83
8
0
Optimized Unoptimized
Visitor experience
66. Pages per visit
16
Average pages seen
12
8 15,64
11,04
4
0
Optimized Unoptimized
Visitor experience
67. Conversion rate
and order value
20
Difference due to optimization
15
10
16,07
5
5,51
0
Conversion rate Order value
68. This is just one case
LOTS
# OF
VISITS
OPTIMIZED
0
0 VISITOR LATENCY 10,000
Different visitors
experienced different
69. With one outcome
LOTS
# OF
VISITS
21.58%
BETTER
0
0 VISITOR LATENCY 10,000
Right now we have a single
experiment, and a single
70. With one outcome
LOTS
Best 5% Worst 5%
# OF
VISITS
21.58%
BETTER
0
0 VISITOR LATENCY 10,000
Visitors who were optimized
fall into a range – the 5th to
71. Lots of different results
LOTS 24%
18%
$ PER 14%
12%
DAY
9.5%
0
0 VISITOR LATENCY 10,000
If we have several
experiments, we can
72. You have your own curve
LOTS
$ PER
DAY
0
0 VISITOR LATENCY 10,000
Every web business has a
curve like this hidden inside