Walmart pagespeed-slide

Bitsytask
BitsytaskCEO um Bitsytask
Real User Monitoring
@Walmarthttp://www.destructoid.com
Presentation Schedule
• Cliff - 10-20m on RUM
• Aaron – 10-20m on Monitoring in real-time
• Balaji – 10-20m on Correlating RUM and Business Analytics
• Final Q&A
Cliff Crocker
- Performance
- Reliability
- Platform & Site Analytics
Twitter: @cliffcrocker
shhhh…..
• We are not the
fastest retail site
on the internet
today.
IE 8 – Web Page Test Comp
Index – Item Page Performance
11s – Fully Loaded time
4
What gets measured, gets done…
• Before we start to optimize – see where our pain is
and prepare to measure for success.
• You never go on a diet without first stepping on the
scale…
5
Source: Flickr
Synthetic Monitoring
Pros
– Technology is great
– Real Browsers (IE, Chrome,
FF)
– Built in Alerting
– Charting/Trending
– Waterfall analysis
– Screen shots & headers
– Object level detail
Cons
– False Positives
– Impossible/impractical to
measure everything
– Fixed number of browser/OS
combinations
– Simulated bandwidth
constraints at best
– Too few data points for
statistical relevance
6
~2.2% of Global Internet
usage - Thanksgiving this year
7
• If only those users
could tell us about their
site experience…
8
Source: Flickr
Enter boomerang.js - https://github.com/yahoo/boomerang
boomerang.js with NavTiming (thanks Buddy & Phil)
• Doc Complete, Page Response, Page Processing, TTFB, DNS, Connect & more
• Cookie data (for parent domain)
• Location (geolookup on IP)
• Referrer
• User Agent
• Anything else you want to stuff into the beacon
+
9
Source: Flickr
10
Start with a url group (i.e. ‘Item Page’)
Find offenders that
have the most
impact
Identify usage patterns for browsers
(Chrome and Safari users more
active on weekends)
12
13
What we found scared us…
Home Page Performance – Jan 2012
14
Set some goals and SLAs
• Focus on ‘Page Processing Time’ First
– see Golden Rule – 80% of time spent here (more like 90% for Walmart)
• Look at backend & network response time SLAs later
• Use 95th
Percentile
• Set Achievable SLAs
• Revisit Monthly
• Celebrate Wins!
15
Case Study: Item Page
• Problem:
– Page takes ~24s for slowest 5% of users
• Too many elements
• Slow third party modules
• Several other pagespeed ‘no-nos’
• Goal: Meet SLA for February
– 20s (95th
percentile)
• Approach:
– Scrum team dedicated to perf optimization for 1 sprint
– Team pools resources and ideas - focuses on biggest bang
16
Success!
8s off the 95th
%tile
17
Success!
2.7s under February SLA
18
RUM in Near Real Time
BEACON
SERVER
BEACON
SERVERCLIENTCLIENT INTERNETINTERNET
MAGIC SMOKE
How boomerang.js Works
1. client downloads JavaScript payload
2. client sends RUM payload to beacon
3. beacon server responds with HTTP 204
WHO CARES!WHO CARES!
20
Aaron Kulick
- Performance
- Founder: SF & SV Web Performance Group
http://www.sfwebperf.org
Twitter: @GoFastWeb
WHO AM I?
Configuring boomerang.js is EASY
Getting Actionable Data Is HARD
22
Where’s the data?
The initial incarnation of RUM @ WMT leveraged Akamai at the edge.
• data reliability issues
• data availability issues
• data “freshness” issues
It works… for certain values of work
Source: Flickr
Source: Flickr
23
HUBBLEHUBBLE
Enter Hubble
JETTYJETTY
DURABLE QUEUEDURABLE QUEUE
APACHE FLUME NGAPACHE FLUME NG
HDFSHDFS UDPUDP
HADOOPHADOOP
24
REAL TIMEREAL TIME
The Bridge Between Then and Now
• Etsy/StatsD - https://github.com/etsy/statsd
– Timers
– Counters
– Simple Aggregation
• Min, Max, Mean, Median, 95th
Percentile
• Whisper, Carbon & Graphite - https://launchpad.net/graphite
– Scalable Realtime Graphing
– RRD-like Storage Requirements + Federated Option
– Supports Irregular Updates
The Now Bits
HUBBLEHUBBLE
UDPUDP
StatsDStatsD
AGGREGATION
Graphite
+
Whisper
Graphite
+
Whisper
UDP/TCPUDP/TCP
STORAGE
+
DISPLAY
• Fixed some calculation problems in Etsy/StatsD
• Added median calculation for timers
• Incorporated multiple flush interval patches
Pretty Pictures
RAW DATA FORMAT
uswmt.all.t_page.upper_95(9289.0),1329259510,1329260710,10|15904.0,9184.0,9125.0,12736.0,11735.0,16776.0,8484.0,
10839.0,14620.0,7579.0,8871.0,8240.0,12390.0,5211.0,10301.0,24784.0,9410.0,16554.0,9609.0,11871.0,12751.0,9797.0,
11003.0,15962.0,7953.0,7707.0,4181.0,11616.0,11746.0,12814.0,10566.0,24782.0,18303.0,20904.0,7718.0,8531.0,7312.0,
9614.0,8749.0,11671.0,5989.0,9832.0,10592.0,11611.0,16946.0,18858.0,14360.0,15927.0,10470.0,10140.0,11307.0,9739.0,
9772.0,9875.0,13641.0,11626.0,14758.0,6529.0,11727.0,10194.0,8003.0,10639.0,7297.0,9891.0,10312.0,12497.0,11557.0,
11406.0,12456.0,12939.0,11029.0,10813.0,11737.0,10618.0,14128.0,16879.0,15865.0,6255.0,14605.0,8861.0,27425.0,
10948.0,19666.0,7185.0,13266.0,13156.0,15111.0,13110.0,15151.0,8666.0,16775.0,10110.0,10387.0,17274.0,22183.0,
8937.0,13168.0,12267.0,11891.0,9635.0,10446.0,8129.0,9550.0,9229.0,8375.0,8657.0,11119.0,6799.0,9094.0,21952.0,
14989.0,16828.0,9001.0,13444.0,10332.0,13609.0,9266.0,13349.0,11546.0,9289.0
uswmt.all.t_page.median(1844.0),1329259510,1329260710,10|4165.0,2333.5,2073.5,2584.0,2547.0,2627.5,2401.0,1575.0,
2170.0,1169.0,1970.0,1838.0,2083.0,5211.0,2496.0,3242.5,1541.0,1437.5,1928.0,1971.0,1776.0,3108.0,2010.5,2044.0,2325.5,
2640.0,1733.0,3924.0,2629.0,1867.5,1782.0,2370.5,2921.0,4783.0,2260.0,1340.0,3256.0,2297.0,2565.0,1874.0,2000.0,2483.5,
2705.5,2432.0,1809.0,2826.0,2204.0,2695.0,1045.0,1615.5,2250.0,2387.0,1562.5,1998.0,2512.0,2139.0,1482.0,2138.5,2100.0,
2583.0,2652.0,3277.0,2549.0,1755.0,2196.5,2766.0,2989.5,3638.0,3034.0,3615.5,2650.5,5207.5,3023.0,1941.0,1918.5,1768.0,
3048.0,1522.5,2710.0,1392.0,2402.0,2005.0,3246.0,1383.0,1880.0,2398.0,1833.0,2579.0,2052.0,2622.0,2089.0,1102.0,1296.0,
3339.0,2132.5,2831.0,3466.0,2131.0,2026.0,2754.0,3228.5,1000.0,2075.0,2011.5,2428.0,4019.5,2788.0,1665.0,1968.0,2695.5,
2873.0,1752.0,2314.5,1766.0,2971.0,3091.5,2205.5,3033.0,2476.0,1844.0
27
The Work Tomorrow…
The Good
•Metric Throughput
•Commodity Storage
•Commodity Infrastructure
The Bad
•More Metric Throughput
•Calculation Complexity
•Web Sockets (pretty)
•Metric Fan-out
28
WATCH THIS SPACE
29
Is Page Performance a Factor of
Site Conversion? And how big is
it?
February, 2012
v
s
31
Walmart.com - Fun Facts
• Reach
–Millions of Shoppers/week.
–Billions of page requests/year - Spikes up to 1500%
–Billions of internal product search volumes/year
• Scale
–Millions of active product SKUs + Market Place
–Millions of pages indexed in search engines
• Complexity
–1/4th
of page contents served by partners, affiliates and Marketplace
–Multiple departments, 10+ checkout paths
Page Performance & Site Conversion – Feb 2012
32
So, how do you monitor?...
Page Performance & Site Conversion – Feb 2012
33
Few Industry Benchmarks…
• Factoid 1: Large eCommerce site extensively A/B
tested page performance and published a study
showing 100 millisecond delay = 1% drop in revenue
• Factoid 2: Search Engines A/B tested performance
and found that a 500 millisecond delay caused a 20%
drop in traffic.
• Factoid 3: In an experiment across multiple retailers,
a 1 second delay caused a 7% decline in conversion
Page Performance & Site Conversion – Feb 2012
34
So, how big is it for Walmart.com?
Page Performance & Site Conversion – Feb 2012
35
Agenda
• Phase 1 – Baseline Measurement - Impact of Site
Performance on Conversion, Bounce rates &
Revenue
• Phase 2 - Targets for Page Performance
• Phase 3 – Optimization Results
• Key Highlights & Takeaways
Page Performance & Site Conversion – Feb 2012
36
Agenda
• Phase 1 – Baseline Measurement - Impact of Site
Performance on Conversion, Bounce rates &
Revenue
• Phase 2 – Targets for Page Performance
• Phase 3 – Optimization Results
• Key Highlights & Takeaways
Page Performance & Site Conversion – Feb 2012
37
Impact of site performance on overall site conversion rate….
Baseline – 1 in 2 site visits had response time > 4 seconds
* Sharp decline in conversion rate as average site load time increases from 1 to 4 seconds
* Overall average site load time is lower for the converted population (3.22 Seconds) than the non-
converted population (6.03 Seconds)
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
38
@ Page level….
Page load time is lower for Buyers compared to Non-Buyers
* The Page load time is highest for certain pages - 6.38 secs when there was a conversion and
8.06 where there was no conversion.
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
39
@ Department level….
Department load time is lower for Buyers compared to Non-Buyers
* Key Categories has 2-3 seconds difference b/w buyer Vs non-buyer
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
40
What about bounce?
Page Bounce Rate Vs Response Time
* Key pages have high bounce rates which correlates with high T_Page as well
* Significant difference ( up to 9secs) in T_Page between bounced and non-bounced for landing
pages.
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
41
Bounce rates @ department level….
Department Bounce Rate Vs Response Time
* High T_Page for key pages (up to 19.82s) and key department making Bounce rate significantly
higher
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
42
Agenda
• Phase 1 – Baseline Measurement - Impact of Site
Performance on Conversion, Bounce rates &
Revenue
• Phase 2 - Targets for Page Performance
• Phase 3 – Optimization Results
• Key Highlights & Takeaways
Page Performance & Site Conversion – Feb 2012
43
Phase 2 – Targets for Page Performance……
Conversion & Bounce Rate Impacts Drives Prioritization
Note: Load Time here is the time taken from head of the page to page ready (T_Page)
Page Performance & Site Conversion – Feb 2012
44
Agenda
• Phase 1 – Baseline Measurement - Impact of Site
Performance on Conversion, Bounce rates &
Revenue
• Phase 2 - Targets for Page Performance
• Phase 3 – Optimization Results
• Key Highlights & Takeaways
Page Performance & Site Conversion – Feb 2012
45
Phase 3 – Success Story….
First Win….and yes conversion had positive improvements…
Page Performance & Site Conversion – Feb 2012
46
• Page speed matters for site conversion!
• Monitor real user performance in a “Big Data” way!!
• Every 1s improvement = Up to 2% increase in CVR
• 100ms improvement = Up to 1% incremental revenue
• SEO benefits for entry pages and reduce bounces
• Test & Learn - Target segments and run A/B Tests focused on
improving page performance
Key Highlights
Page Performance & Site Conversion – Feb 2012
We’re Hiring for Everything!!!!
47
Source: Flickr
http://www.walmartlabs.com/open-positions/
https://walmartstores.com/careers/apply/?ba=eCom
@cliffcrocker or @GoFastWeb
1 von 47

Recomendados

Walmart Web Performance Circa 2013 von
Walmart Web Performance Circa 2013Walmart Web Performance Circa 2013
Walmart Web Performance Circa 2013Cliff Crocker
758 views47 Folien
Site Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa von
Site Reliability Engineering (SRE) - Tech Talk by Keet SugathadasaSite Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa
Site Reliability Engineering (SRE) - Tech Talk by Keet SugathadasaKeet Sugathadasa
450 views26 Folien
What Is User Research by Dropbox Product Manager von
What Is User Research by Dropbox Product ManagerWhat Is User Research by Dropbox Product Manager
What Is User Research by Dropbox Product ManagerProduct School
356 views27 Folien
The Alfresco ECM 1 Billion Document Benchmark on AWS and Aurora - Benchmark ... von
The Alfresco ECM 1 Billion Document Benchmark on AWS and Aurora  - Benchmark ...The Alfresco ECM 1 Billion Document Benchmark on AWS and Aurora  - Benchmark ...
The Alfresco ECM 1 Billion Document Benchmark on AWS and Aurora - Benchmark ...Symphony Software Foundation
11.4K views22 Folien
SRE 101 (Site Reliability Engineering) von
SRE 101 (Site Reliability Engineering)SRE 101 (Site Reliability Engineering)
SRE 101 (Site Reliability Engineering)Hussain Mansoor
397 views15 Folien
Make Work Visible - Unmask Capacity Killing WIP von
Make Work Visible - Unmask Capacity Killing WIPMake Work Visible - Unmask Capacity Killing WIP
Make Work Visible - Unmask Capacity Killing WIPDominica DeGrandis
1.7K views34 Folien

Más contenido relacionado

Was ist angesagt?

How to Build Complex Calls to APIs (Without Writing Any Code) von
How to Build Complex Calls to APIs (Without Writing Any Code)How to Build Complex Calls to APIs (Without Writing Any Code)
How to Build Complex Calls to APIs (Without Writing Any Code)Safe Software
1.8K views50 Folien
Prioritisation techniques tutorial Agile Cambridge 2019 von
Prioritisation techniques tutorial Agile Cambridge 2019Prioritisation techniques tutorial Agile Cambridge 2019
Prioritisation techniques tutorial Agile Cambridge 2019Mariapaola Sorrentino
360 views44 Folien
Microservices Architecture for e-Commerce von
Microservices Architecture for e-CommerceMicroservices Architecture for e-Commerce
Microservices Architecture for e-CommerceDivante
29K views122 Folien
When will it be done? (Lean Agile Forecasting) von
When will it be done? (Lean Agile Forecasting)When will it be done? (Lean Agile Forecasting)
When will it be done? (Lean Agile Forecasting)Rodrigo Vieira
922 views47 Folien
Taking advantage of Prometheus relabeling von
Taking advantage of Prometheus relabelingTaking advantage of Prometheus relabeling
Taking advantage of Prometheus relabelingJulien Pivotto
21.6K views43 Folien
The Black Magic of Engineering Management von
The Black Magic of Engineering ManagementThe Black Magic of Engineering Management
The Black Magic of Engineering ManagementAdam Christian
113.2K views38 Folien

Was ist angesagt?(20)

How to Build Complex Calls to APIs (Without Writing Any Code) von Safe Software
How to Build Complex Calls to APIs (Without Writing Any Code)How to Build Complex Calls to APIs (Without Writing Any Code)
How to Build Complex Calls to APIs (Without Writing Any Code)
Safe Software1.8K views
Microservices Architecture for e-Commerce von Divante
Microservices Architecture for e-CommerceMicroservices Architecture for e-Commerce
Microservices Architecture for e-Commerce
Divante29K views
When will it be done? (Lean Agile Forecasting) von Rodrigo Vieira
When will it be done? (Lean Agile Forecasting)When will it be done? (Lean Agile Forecasting)
When will it be done? (Lean Agile Forecasting)
Rodrigo Vieira922 views
Taking advantage of Prometheus relabeling von Julien Pivotto
Taking advantage of Prometheus relabelingTaking advantage of Prometheus relabeling
Taking advantage of Prometheus relabeling
Julien Pivotto21.6K views
The Black Magic of Engineering Management von Adam Christian
The Black Magic of Engineering ManagementThe Black Magic of Engineering Management
The Black Magic of Engineering Management
Adam Christian113.2K views
Navigating the Workday Analytics and Reporting Ecosystem von Workday, Inc.
Navigating the Workday Analytics and Reporting EcosystemNavigating the Workday Analytics and Reporting Ecosystem
Navigating the Workday Analytics and Reporting Ecosystem
Workday, Inc.861 views
Atlassian confluence WIKI를 활용한 공유와 협업 환경 구성 von KwangSeob Jeong
Atlassian confluence WIKI를 활용한 공유와 협업 환경 구성Atlassian confluence WIKI를 활용한 공유와 협업 환경 구성
Atlassian confluence WIKI를 활용한 공유와 협업 환경 구성
KwangSeob Jeong22K views
Site reliability engineering - Lightning Talk von Michae Blakeney
Site reliability engineering - Lightning TalkSite reliability engineering - Lightning Talk
Site reliability engineering - Lightning Talk
Michae Blakeney237 views
Gutenberg and Headless WordPress.pdf von WP Engine
Gutenberg and Headless WordPress.pdfGutenberg and Headless WordPress.pdf
Gutenberg and Headless WordPress.pdf
WP Engine1.1K views
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021) von WSO2
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
Workflows in WSO2 API Manager - WSO2 API Manager Community Call (12/15/2021)
WSO2475 views
Limited WIP Meeting presentation - The Phoenix Project book review von Rudiger Wolf
Limited WIP Meeting presentation - The Phoenix Project book reviewLimited WIP Meeting presentation - The Phoenix Project book review
Limited WIP Meeting presentation - The Phoenix Project book review
Rudiger Wolf9.2K views
Accelerator Workshop "Before" von Yvonne Shek
Accelerator Workshop "Before"Accelerator Workshop "Before"
Accelerator Workshop "Before"
Yvonne Shek2.9K views
Scrum Prioritization Techniques PowerPoint Presentation Slides von SlideTeam
Scrum Prioritization Techniques PowerPoint Presentation SlidesScrum Prioritization Techniques PowerPoint Presentation Slides
Scrum Prioritization Techniques PowerPoint Presentation Slides
SlideTeam140 views
Integrating Splunk into your Spring Applications von Damien Dallimore
Integrating Splunk into your Spring ApplicationsIntegrating Splunk into your Spring Applications
Integrating Splunk into your Spring Applications
Damien Dallimore11.3K views

Similar a Walmart pagespeed-slide

Web Performance Optimization (WPO) von
Web Performance Optimization (WPO)Web Performance Optimization (WPO)
Web Performance Optimization (WPO)Betclic Everest Group Tech Team
2.3K views26 Folien
Mage uk-2013-1345-chris-wells-131030120920-phpapp01 von
Mage uk-2013-1345-chris-wells-131030120920-phpapp01Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01Karla Mae Tejon
298 views31 Folien
The Importance of Site Performance and Simple Steps to Achieve It von
The Importance of Site Performance and Simple Steps to Achieve ItThe Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve ItNexcess.net LLC
2.1K views31 Folien
Real-World Performance Budgets [PerfNow 2022] von
Real-World Performance Budgets [PerfNow 2022]Real-World Performance Budgets [PerfNow 2022]
Real-World Performance Budgets [PerfNow 2022]Tammy Everts
963 views103 Folien
201601007 Limelight - Hui Qin Teoh von
201601007 Limelight - Hui Qin Teoh201601007 Limelight - Hui Qin Teoh
201601007 Limelight - Hui Qin TeohHui Qin Teoh, PMP®
141 views27 Folien
MeasureWorks - Why people hate to wait for your website to load (and how to f... von
MeasureWorks - Why people hate to wait for your website to load (and how to f...MeasureWorks - Why people hate to wait for your website to load (and how to f...
MeasureWorks - Why people hate to wait for your website to load (and how to f...MeasureWorks
2.3K views147 Folien

Similar a Walmart pagespeed-slide(20)

Mage uk-2013-1345-chris-wells-131030120920-phpapp01 von Karla Mae Tejon
Mage uk-2013-1345-chris-wells-131030120920-phpapp01Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Karla Mae Tejon298 views
The Importance of Site Performance and Simple Steps to Achieve It von Nexcess.net LLC
The Importance of Site Performance and Simple Steps to Achieve ItThe Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve It
Nexcess.net LLC2.1K views
Real-World Performance Budgets [PerfNow 2022] von Tammy Everts
Real-World Performance Budgets [PerfNow 2022]Real-World Performance Budgets [PerfNow 2022]
Real-World Performance Budgets [PerfNow 2022]
Tammy Everts963 views
MeasureWorks - Why people hate to wait for your website to load (and how to f... von MeasureWorks
MeasureWorks - Why people hate to wait for your website to load (and how to f...MeasureWorks - Why people hate to wait for your website to load (and how to f...
MeasureWorks - Why people hate to wait for your website to load (and how to f...
MeasureWorks2.3K views
Lean Six Sigma Green Belt Certification 1 von Fred Zuercher
Lean Six Sigma Green Belt Certification 1Lean Six Sigma Green Belt Certification 1
Lean Six Sigma Green Belt Certification 1
Fred Zuercher452 views
Metrics, metrics everywhere (but where the heck do you start?) von Tammy Everts
Metrics, metrics everywhere (but where the heck do you start?)Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
Tammy Everts8.7K views
Metrics, Metrics Everywhere (but where the heck do you start?) von SOASTA
Metrics, Metrics Everywhere (but where the heck do you start?)Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
SOASTA4.3K views
Metrics, Metrics Everywhere (but where the heck do you start?) von SOASTA
Metrics, Metrics Everywhere (but where the heck do you start?)Metrics, Metrics Everywhere (but where the heck do you start?)
Metrics, Metrics Everywhere (but where the heck do you start?)
SOASTA 245 views
improving the performance of Rails web Applications von John McCaffrey
improving the performance of Rails web Applicationsimproving the performance of Rails web Applications
improving the performance of Rails web Applications
John McCaffrey1.6K views
Windy cityrails performance_tuning von John McCaffrey
Windy cityrails performance_tuningWindy cityrails performance_tuning
Windy cityrails performance_tuning
John McCaffrey1.7K views
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa... von John McCaffrey
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...
Ruby on Rails Performance Tuning. Make it faster, make it better (WindyCityRa...
John McCaffrey7.6K views
Enterprise mobilelogix overview von MobileLogix
Enterprise mobilelogix overviewEnterprise mobilelogix overview
Enterprise mobilelogix overview
MobileLogix339 views
Case study migration from cm13 to cm14 - Oracle Primavera P6 Collaborate 14 von p6academy
Case study migration from cm13 to cm14 - Oracle Primavera P6 Collaborate 14Case study migration from cm13 to cm14 - Oracle Primavera P6 Collaborate 14
Case study migration from cm13 to cm14 - Oracle Primavera P6 Collaborate 14
p6academy1.3K views
Ahead of the Curve: How 23andMe Improved UX with Performance Edge von Optimizely
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeAhead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Optimizely357 views
British American Tobacco GP Upgrade von Cedar Consulting
British American Tobacco GP UpgradeBritish American Tobacco GP Upgrade
British American Tobacco GP Upgrade
Cedar Consulting1.2K views
Demystifying Website Performance and Its Impact on Revenue von section_io
Demystifying Website Performance and Its Impact on RevenueDemystifying Website Performance and Its Impact on Revenue
Demystifying Website Performance and Its Impact on Revenue
section_io532 views
A Designer's Guide to Web Performance von Kevin Mandeville
A Designer's Guide to Web PerformanceA Designer's Guide to Web Performance
A Designer's Guide to Web Performance
Kevin Mandeville1.3K views

Más de Bitsytask

Lehman Brothers ALT-A Mortgage Docs, December 18, 2006 von
Lehman Brothers ALT-A Mortgage Docs, December 18, 2006Lehman Brothers ALT-A Mortgage Docs, December 18, 2006
Lehman Brothers ALT-A Mortgage Docs, December 18, 2006Bitsytask
2.1K views17 Folien
BNC Subprime Mortgage Ratesheet 7-2006 von
BNC Subprime Mortgage Ratesheet 7-2006BNC Subprime Mortgage Ratesheet 7-2006
BNC Subprime Mortgage Ratesheet 7-2006Bitsytask
1.3K views1 Folie
Impac libor option arm 2nd matrix von
Impac libor option arm 2nd matrixImpac libor option arm 2nd matrix
Impac libor option arm 2nd matrixBitsytask
673 views1 Folie
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-... von
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...Bitsytask
2K views1 Folie
Countrywide Option Arm Loans (Negative Amortization) July 26 2006 von
Countrywide Option Arm Loans (Negative Amortization) July 26 2006Countrywide Option Arm Loans (Negative Amortization) July 26 2006
Countrywide Option Arm Loans (Negative Amortization) July 26 2006Bitsytask
1K views7 Folien
Lehman Brothers ALT-A mortgage outline August 18 2006 von
Lehman Brothers ALT-A mortgage outline August 18 2006Lehman Brothers ALT-A mortgage outline August 18 2006
Lehman Brothers ALT-A mortgage outline August 18 2006Bitsytask
1.8K views13 Folien

Más de Bitsytask(20)

Lehman Brothers ALT-A Mortgage Docs, December 18, 2006 von Bitsytask
Lehman Brothers ALT-A Mortgage Docs, December 18, 2006Lehman Brothers ALT-A Mortgage Docs, December 18, 2006
Lehman Brothers ALT-A Mortgage Docs, December 18, 2006
Bitsytask2.1K views
BNC Subprime Mortgage Ratesheet 7-2006 von Bitsytask
BNC Subprime Mortgage Ratesheet 7-2006BNC Subprime Mortgage Ratesheet 7-2006
BNC Subprime Mortgage Ratesheet 7-2006
Bitsytask1.3K views
Impac libor option arm 2nd matrix von Bitsytask
Impac libor option arm 2nd matrixImpac libor option arm 2nd matrix
Impac libor option arm 2nd matrix
Bitsytask673 views
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-... von Bitsytask
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...
New Century Subprime Mortgage Matrix (Stated Doc / 80%, 550 FICO, 50% DTI) 7-...
Bitsytask2K views
Countrywide Option Arm Loans (Negative Amortization) July 26 2006 von Bitsytask
Countrywide Option Arm Loans (Negative Amortization) July 26 2006Countrywide Option Arm Loans (Negative Amortization) July 26 2006
Countrywide Option Arm Loans (Negative Amortization) July 26 2006
Bitsytask1K views
Lehman Brothers ALT-A mortgage outline August 18 2006 von Bitsytask
Lehman Brothers ALT-A mortgage outline August 18 2006Lehman Brothers ALT-A mortgage outline August 18 2006
Lehman Brothers ALT-A mortgage outline August 18 2006
Bitsytask1.8K views
Credit Suisse sellers guide (secondary market) August 2006 von Bitsytask
Credit Suisse sellers guide (secondary market) August 2006Credit Suisse sellers guide (secondary market) August 2006
Credit Suisse sellers guide (secondary market) August 2006
Bitsytask1.5K views
GMAC Mortgage Underwriting Guidelines 9-11-2006 von Bitsytask
GMAC Mortgage Underwriting Guidelines 9-11-2006GMAC Mortgage Underwriting Guidelines 9-11-2006
GMAC Mortgage Underwriting Guidelines 9-11-2006
Bitsytask4.4K views
Operation Ajax Declassified PDF 7 of 9 von Bitsytask
Operation Ajax Declassified PDF 7 of 9Operation Ajax Declassified PDF 7 of 9
Operation Ajax Declassified PDF 7 of 9
Bitsytask528 views
Operation Ajax Declassified PDF 6 of 9 von Bitsytask
Operation Ajax Declassified PDF 6 of 9Operation Ajax Declassified PDF 6 of 9
Operation Ajax Declassified PDF 6 of 9
Bitsytask659 views
Operation Ajax Declassified PDF 5 of 9 von Bitsytask
Operation Ajax Declassified PDF 5 of 9Operation Ajax Declassified PDF 5 of 9
Operation Ajax Declassified PDF 5 of 9
Bitsytask300 views
Operation Ajax Declassified PDF 5 of 9 von Bitsytask
Operation Ajax Declassified PDF 5 of 9Operation Ajax Declassified PDF 5 of 9
Operation Ajax Declassified PDF 5 of 9
Bitsytask313 views
Operation Ajax Declassified PDF 3 of 9 von Bitsytask
Operation Ajax Declassified PDF 3 of 9Operation Ajax Declassified PDF 3 of 9
Operation Ajax Declassified PDF 3 of 9
Bitsytask595 views
Operation Ajax Declassified PDF 2 of 9 von Bitsytask
Operation Ajax Declassified PDF 2 of 9Operation Ajax Declassified PDF 2 of 9
Operation Ajax Declassified PDF 2 of 9
Bitsytask424 views
Operation Ajax Declassified PDF 1 of 9 von Bitsytask
Operation Ajax Declassified PDF 1 of 9Operation Ajax Declassified PDF 1 of 9
Operation Ajax Declassified PDF 1 of 9
Bitsytask435 views
Operation Ajax Declassified PDF Appendix E von Bitsytask
Operation Ajax Declassified PDF Appendix EOperation Ajax Declassified PDF Appendix E
Operation Ajax Declassified PDF Appendix E
Bitsytask289 views
Operation Ajax Declassified PDF Appendix D von Bitsytask
Operation Ajax Declassified PDF Appendix DOperation Ajax Declassified PDF Appendix D
Operation Ajax Declassified PDF Appendix D
Bitsytask376 views
Operation Ajax Declassified PDF Appendix B von Bitsytask
Operation Ajax Declassified PDF Appendix BOperation Ajax Declassified PDF Appendix B
Operation Ajax Declassified PDF Appendix B
Bitsytask309 views
Operation Ajax Declassified PDF 9 of 9 von Bitsytask
Operation Ajax Declassified PDF 9 of 9Operation Ajax Declassified PDF 9 of 9
Operation Ajax Declassified PDF 9 of 9
Bitsytask281 views
the crypto republic von Bitsytask
the crypto republicthe crypto republic
the crypto republic
Bitsytask303 views

Último

From social media to generative media (3).pptx von
From social media to generative media (3).pptxFrom social media to generative media (3).pptx
From social media to generative media (3).pptxMark Carrigan
88 views28 Folien
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab... von
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...RAHUL PAL
53 views26 Folien
Thanksgiving!.pdf von
Thanksgiving!.pdfThanksgiving!.pdf
Thanksgiving!.pdfEnglishCEIPdeSigeiro
637 views17 Folien
BUSINESS ETHICS MODULE 1 UNIT I_A.pdf von
BUSINESS ETHICS MODULE 1 UNIT I_A.pdfBUSINESS ETHICS MODULE 1 UNIT I_A.pdf
BUSINESS ETHICS MODULE 1 UNIT I_A.pdfDr Vijay Vishwakarma
106 views25 Folien
Interaction of microorganisms with Insects.pptx von
Interaction of microorganisms with Insects.pptxInteraction of microorganisms with Insects.pptx
Interaction of microorganisms with Insects.pptxMicrobiologyMicro
49 views14 Folien

Último(20)

From social media to generative media (3).pptx von Mark Carrigan
From social media to generative media (3).pptxFrom social media to generative media (3).pptx
From social media to generative media (3).pptx
Mark Carrigan88 views
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab... von RAHUL PAL
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...
Research Methodology (M. Pharm, IIIrd Sem.)_UNIT_IV_CPCSEA Guidelines for Lab...
RAHUL PAL53 views
Interaction of microorganisms with Insects.pptx von MicrobiologyMicro
Interaction of microorganisms with Insects.pptxInteraction of microorganisms with Insects.pptx
Interaction of microorganisms with Insects.pptx
Pharmaceutical Analysis PPT (BP 102T) von yakshpharmacy009
Pharmaceutical Analysis PPT (BP 102T) Pharmaceutical Analysis PPT (BP 102T)
Pharmaceutical Analysis PPT (BP 102T)
yakshpharmacy009121 views
Artificial Intelligence and The Sustainable Development Goals (SDGs) Adoption... von BC Chew
Artificial Intelligence and The Sustainable Development Goals (SDGs) Adoption...Artificial Intelligence and The Sustainable Development Goals (SDGs) Adoption...
Artificial Intelligence and The Sustainable Development Goals (SDGs) Adoption...
BC Chew55 views
What is Digital Transformation? von Mark Brown
What is Digital Transformation?What is Digital Transformation?
What is Digital Transformation?
Mark Brown56 views
Ask The Expert! Nonprofit Website Tools, Tips, and Technology.pdf von TechSoup
 Ask The Expert! Nonprofit Website Tools, Tips, and Technology.pdf Ask The Expert! Nonprofit Website Tools, Tips, and Technology.pdf
Ask The Expert! Nonprofit Website Tools, Tips, and Technology.pdf
TechSoup 68 views
Geology of Ethiopia and the Horn Chapter 2 GeES 1011.pptx von behailugetu
Geology of Ethiopia and the Horn Chapter 2 GeES 1011.pptxGeology of Ethiopia and the Horn Chapter 2 GeES 1011.pptx
Geology of Ethiopia and the Horn Chapter 2 GeES 1011.pptx
behailugetu104 views
Education of marginalized and socially disadvantages segments.pptx von GarimaBhati5
Education of marginalized and socially disadvantages segments.pptxEducation of marginalized and socially disadvantages segments.pptx
Education of marginalized and socially disadvantages segments.pptx
GarimaBhati559 views
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating... von Taste
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...
Creative Restart 2023: Christophe Wechsler - From the Inside Out: Cultivating...
Taste39 views

Walmart pagespeed-slide

  • 2. Presentation Schedule • Cliff - 10-20m on RUM • Aaron – 10-20m on Monitoring in real-time • Balaji – 10-20m on Correlating RUM and Business Analytics • Final Q&A
  • 3. Cliff Crocker - Performance - Reliability - Platform & Site Analytics Twitter: @cliffcrocker
  • 4. shhhh….. • We are not the fastest retail site on the internet today. IE 8 – Web Page Test Comp Index – Item Page Performance 11s – Fully Loaded time 4
  • 5. What gets measured, gets done… • Before we start to optimize – see where our pain is and prepare to measure for success. • You never go on a diet without first stepping on the scale… 5 Source: Flickr
  • 6. Synthetic Monitoring Pros – Technology is great – Real Browsers (IE, Chrome, FF) – Built in Alerting – Charting/Trending – Waterfall analysis – Screen shots & headers – Object level detail Cons – False Positives – Impossible/impractical to measure everything – Fixed number of browser/OS combinations – Simulated bandwidth constraints at best – Too few data points for statistical relevance 6
  • 7. ~2.2% of Global Internet usage - Thanksgiving this year 7
  • 8. • If only those users could tell us about their site experience… 8 Source: Flickr
  • 9. Enter boomerang.js - https://github.com/yahoo/boomerang boomerang.js with NavTiming (thanks Buddy & Phil) • Doc Complete, Page Response, Page Processing, TTFB, DNS, Connect & more • Cookie data (for parent domain) • Location (geolookup on IP) • Referrer • User Agent • Anything else you want to stuff into the beacon + 9 Source: Flickr
  • 10. 10
  • 11. Start with a url group (i.e. ‘Item Page’) Find offenders that have the most impact
  • 12. Identify usage patterns for browsers (Chrome and Safari users more active on weekends) 12
  • 13. 13
  • 14. What we found scared us… Home Page Performance – Jan 2012 14
  • 15. Set some goals and SLAs • Focus on ‘Page Processing Time’ First – see Golden Rule – 80% of time spent here (more like 90% for Walmart) • Look at backend & network response time SLAs later • Use 95th Percentile • Set Achievable SLAs • Revisit Monthly • Celebrate Wins! 15
  • 16. Case Study: Item Page • Problem: – Page takes ~24s for slowest 5% of users • Too many elements • Slow third party modules • Several other pagespeed ‘no-nos’ • Goal: Meet SLA for February – 20s (95th percentile) • Approach: – Scrum team dedicated to perf optimization for 1 sprint – Team pools resources and ideas - focuses on biggest bang 16
  • 17. Success! 8s off the 95th %tile 17
  • 19. RUM in Near Real Time
  • 20. BEACON SERVER BEACON SERVERCLIENTCLIENT INTERNETINTERNET MAGIC SMOKE How boomerang.js Works 1. client downloads JavaScript payload 2. client sends RUM payload to beacon 3. beacon server responds with HTTP 204 WHO CARES!WHO CARES! 20
  • 21. Aaron Kulick - Performance - Founder: SF & SV Web Performance Group http://www.sfwebperf.org Twitter: @GoFastWeb WHO AM I?
  • 22. Configuring boomerang.js is EASY Getting Actionable Data Is HARD 22
  • 23. Where’s the data? The initial incarnation of RUM @ WMT leveraged Akamai at the edge. • data reliability issues • data availability issues • data “freshness” issues It works… for certain values of work Source: Flickr Source: Flickr 23
  • 24. HUBBLEHUBBLE Enter Hubble JETTYJETTY DURABLE QUEUEDURABLE QUEUE APACHE FLUME NGAPACHE FLUME NG HDFSHDFS UDPUDP HADOOPHADOOP 24 REAL TIMEREAL TIME
  • 25. The Bridge Between Then and Now • Etsy/StatsD - https://github.com/etsy/statsd – Timers – Counters – Simple Aggregation • Min, Max, Mean, Median, 95th Percentile • Whisper, Carbon & Graphite - https://launchpad.net/graphite – Scalable Realtime Graphing – RRD-like Storage Requirements + Federated Option – Supports Irregular Updates
  • 26. The Now Bits HUBBLEHUBBLE UDPUDP StatsDStatsD AGGREGATION Graphite + Whisper Graphite + Whisper UDP/TCPUDP/TCP STORAGE + DISPLAY • Fixed some calculation problems in Etsy/StatsD • Added median calculation for timers • Incorporated multiple flush interval patches
  • 27. Pretty Pictures RAW DATA FORMAT uswmt.all.t_page.upper_95(9289.0),1329259510,1329260710,10|15904.0,9184.0,9125.0,12736.0,11735.0,16776.0,8484.0, 10839.0,14620.0,7579.0,8871.0,8240.0,12390.0,5211.0,10301.0,24784.0,9410.0,16554.0,9609.0,11871.0,12751.0,9797.0, 11003.0,15962.0,7953.0,7707.0,4181.0,11616.0,11746.0,12814.0,10566.0,24782.0,18303.0,20904.0,7718.0,8531.0,7312.0, 9614.0,8749.0,11671.0,5989.0,9832.0,10592.0,11611.0,16946.0,18858.0,14360.0,15927.0,10470.0,10140.0,11307.0,9739.0, 9772.0,9875.0,13641.0,11626.0,14758.0,6529.0,11727.0,10194.0,8003.0,10639.0,7297.0,9891.0,10312.0,12497.0,11557.0, 11406.0,12456.0,12939.0,11029.0,10813.0,11737.0,10618.0,14128.0,16879.0,15865.0,6255.0,14605.0,8861.0,27425.0, 10948.0,19666.0,7185.0,13266.0,13156.0,15111.0,13110.0,15151.0,8666.0,16775.0,10110.0,10387.0,17274.0,22183.0, 8937.0,13168.0,12267.0,11891.0,9635.0,10446.0,8129.0,9550.0,9229.0,8375.0,8657.0,11119.0,6799.0,9094.0,21952.0, 14989.0,16828.0,9001.0,13444.0,10332.0,13609.0,9266.0,13349.0,11546.0,9289.0 uswmt.all.t_page.median(1844.0),1329259510,1329260710,10|4165.0,2333.5,2073.5,2584.0,2547.0,2627.5,2401.0,1575.0, 2170.0,1169.0,1970.0,1838.0,2083.0,5211.0,2496.0,3242.5,1541.0,1437.5,1928.0,1971.0,1776.0,3108.0,2010.5,2044.0,2325.5, 2640.0,1733.0,3924.0,2629.0,1867.5,1782.0,2370.5,2921.0,4783.0,2260.0,1340.0,3256.0,2297.0,2565.0,1874.0,2000.0,2483.5, 2705.5,2432.0,1809.0,2826.0,2204.0,2695.0,1045.0,1615.5,2250.0,2387.0,1562.5,1998.0,2512.0,2139.0,1482.0,2138.5,2100.0, 2583.0,2652.0,3277.0,2549.0,1755.0,2196.5,2766.0,2989.5,3638.0,3034.0,3615.5,2650.5,5207.5,3023.0,1941.0,1918.5,1768.0, 3048.0,1522.5,2710.0,1392.0,2402.0,2005.0,3246.0,1383.0,1880.0,2398.0,1833.0,2579.0,2052.0,2622.0,2089.0,1102.0,1296.0, 3339.0,2132.5,2831.0,3466.0,2131.0,2026.0,2754.0,3228.5,1000.0,2075.0,2011.5,2428.0,4019.5,2788.0,1665.0,1968.0,2695.5, 2873.0,1752.0,2314.5,1766.0,2971.0,3091.5,2205.5,3033.0,2476.0,1844.0 27
  • 28. The Work Tomorrow… The Good •Metric Throughput •Commodity Storage •Commodity Infrastructure The Bad •More Metric Throughput •Calculation Complexity •Web Sockets (pretty) •Metric Fan-out 28
  • 30. Is Page Performance a Factor of Site Conversion? And how big is it? February, 2012 v s
  • 31. 31 Walmart.com - Fun Facts • Reach –Millions of Shoppers/week. –Billions of page requests/year - Spikes up to 1500% –Billions of internal product search volumes/year • Scale –Millions of active product SKUs + Market Place –Millions of pages indexed in search engines • Complexity –1/4th of page contents served by partners, affiliates and Marketplace –Multiple departments, 10+ checkout paths Page Performance & Site Conversion – Feb 2012
  • 32. 32 So, how do you monitor?... Page Performance & Site Conversion – Feb 2012
  • 33. 33 Few Industry Benchmarks… • Factoid 1: Large eCommerce site extensively A/B tested page performance and published a study showing 100 millisecond delay = 1% drop in revenue • Factoid 2: Search Engines A/B tested performance and found that a 500 millisecond delay caused a 20% drop in traffic. • Factoid 3: In an experiment across multiple retailers, a 1 second delay caused a 7% decline in conversion Page Performance & Site Conversion – Feb 2012
  • 34. 34 So, how big is it for Walmart.com? Page Performance & Site Conversion – Feb 2012
  • 35. 35 Agenda • Phase 1 – Baseline Measurement - Impact of Site Performance on Conversion, Bounce rates & Revenue • Phase 2 - Targets for Page Performance • Phase 3 – Optimization Results • Key Highlights & Takeaways Page Performance & Site Conversion – Feb 2012
  • 36. 36 Agenda • Phase 1 – Baseline Measurement - Impact of Site Performance on Conversion, Bounce rates & Revenue • Phase 2 – Targets for Page Performance • Phase 3 – Optimization Results • Key Highlights & Takeaways Page Performance & Site Conversion – Feb 2012
  • 37. 37 Impact of site performance on overall site conversion rate…. Baseline – 1 in 2 site visits had response time > 4 seconds * Sharp decline in conversion rate as average site load time increases from 1 to 4 seconds * Overall average site load time is lower for the converted population (3.22 Seconds) than the non- converted population (6.03 Seconds) Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 38. 38 @ Page level…. Page load time is lower for Buyers compared to Non-Buyers * The Page load time is highest for certain pages - 6.38 secs when there was a conversion and 8.06 where there was no conversion. Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 39. 39 @ Department level…. Department load time is lower for Buyers compared to Non-Buyers * Key Categories has 2-3 seconds difference b/w buyer Vs non-buyer Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 40. 40 What about bounce? Page Bounce Rate Vs Response Time * Key pages have high bounce rates which correlates with high T_Page as well * Significant difference ( up to 9secs) in T_Page between bounced and non-bounced for landing pages. Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 41. 41 Bounce rates @ department level…. Department Bounce Rate Vs Response Time * High T_Page for key pages (up to 19.82s) and key department making Bounce rate significantly higher Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 42. 42 Agenda • Phase 1 – Baseline Measurement - Impact of Site Performance on Conversion, Bounce rates & Revenue • Phase 2 - Targets for Page Performance • Phase 3 – Optimization Results • Key Highlights & Takeaways Page Performance & Site Conversion – Feb 2012
  • 43. 43 Phase 2 – Targets for Page Performance…… Conversion & Bounce Rate Impacts Drives Prioritization Note: Load Time here is the time taken from head of the page to page ready (T_Page) Page Performance & Site Conversion – Feb 2012
  • 44. 44 Agenda • Phase 1 – Baseline Measurement - Impact of Site Performance on Conversion, Bounce rates & Revenue • Phase 2 - Targets for Page Performance • Phase 3 – Optimization Results • Key Highlights & Takeaways Page Performance & Site Conversion – Feb 2012
  • 45. 45 Phase 3 – Success Story…. First Win….and yes conversion had positive improvements… Page Performance & Site Conversion – Feb 2012
  • 46. 46 • Page speed matters for site conversion! • Monitor real user performance in a “Big Data” way!! • Every 1s improvement = Up to 2% increase in CVR • 100ms improvement = Up to 1% incremental revenue • SEO benefits for entry pages and reduce bounces • Test & Learn - Target segments and run A/B Tests focused on improving page performance Key Highlights Page Performance & Site Conversion – Feb 2012
  • 47. We’re Hiring for Everything!!!! 47 Source: Flickr http://www.walmartlabs.com/open-positions/ https://walmartstores.com/careers/apply/?ba=eCom @cliffcrocker or @GoFastWeb