SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Downloaden Sie, um offline zu lesen
Measured	
  Availability	
  and	
  
Performance	
  
	
  
	
  
Sanjay	
  Singh	
  
singh.sanjay@yahoo.com	
  
Agenda	
  
•  FCI	
  –	
  Failed	
  Customer	
  Interac@on	
  
•  TP	
  –	
  Top	
  Percen@le	
  
•  RUM	
  
•  RUM	
  with	
  SPA	
  
Availability	
  and	
  Down@me	
  
FCI	
  
•  FCI	
  is	
  Failed	
  Customer	
  Interac@on	
  which	
  is	
  
measured	
  for	
  a	
  par@cular	
  page/workflow.	
  
– A	
  customer	
  interac@on	
  can	
  be	
  page	
  view,	
  form	
  
submission,	
  etc.	
  In	
  HTTP	
  terms,	
  customer’s	
  
interac@ons	
  are	
  GET/POST	
  request.	
  
– If	
  the	
  page	
  response	
  is	
  not	
  as	
  per	
  the	
  expected	
  
behavior	
  of	
  the	
  applica@on,	
  then	
  it’s	
  a	
  failed	
  
customer	
  interac@on.	
  
How	
  is	
  FCI	
  calculated	
  ?	
  
•  FCI	
  is	
  calculated	
  on	
  per	
  page	
  basis.	
  If	
  page	
  
execu@on	
  is	
  not	
  as	
  per	
  the	
  expected	
  behavior,	
  
then	
  it	
  is	
  counted	
  as	
  failure.	
  
•  Iden@fy	
  all	
  failure	
  cases	
  and	
  log	
  it	
  
appropriately	
  on	
  the	
  server	
  with	
  user	
  session’s	
  
info.	
  
Performance	
  
•  As	
  per	
  Google	
  –	
  
•  Increasing	
  web	
  search	
  latency	
  100	
  to	
  400	
  ms	
  reduces	
  the	
  daily	
  number	
  of	
  searches	
  
per	
  user	
  by	
  0.2%	
  to	
  0.6%.	
  	
  	
  
•  Users	
  do	
  fewer	
  searches	
  the	
  longer	
  they	
  are	
  exposed.	
  	
  
•  For	
  longer	
  delays,	
  the	
  loss	
  of	
  searches	
  persists	
  even	
  aYer	
  latency	
  returns	
  to	
  
previous	
  levels.	
  
Performance	
  Measurement	
  
•  Top	
  Percen-le	
  (TP)	
  is	
  a	
  method	
  to	
  find	
  
minimum	
  @me	
  	
  in	
  which	
  (X)	
  amount	
  of	
  
requests	
  were	
  served.	
  
– Example:	
  If	
  the	
  TP90	
  of	
  a	
  page	
  is	
  2	
  sec,	
  then	
  it	
  
means	
  90%	
  of	
  the	
  requests	
  were	
  served	
  within	
  2	
  
seconds.	
  
RUM	
  with	
  SPA	
  
•  What	
  is	
  RUM?	
  
–  RUM	
  =	
  Real	
  User	
  Monitoring,	
  is	
  the	
  actual	
  measure	
  of	
  how	
  long	
  a	
  page	
  
took	
  to	
  render	
  and	
  become	
  usable	
  for	
  a	
  real	
  user.	
  It	
  is	
  the	
  measure	
  of	
  
a	
  page’s	
  speed	
  by	
  measuring	
  the	
  @me	
  it	
  takes	
  for	
  "PAGE	
  READY"	
  state,	
  
and	
  not	
  only	
  the	
  @me	
  it	
  took	
  for	
  data	
  to	
  be	
  downloaded.	
  
•  Web	
  is	
  moving	
  towards	
  Single	
  Page	
  Architecture	
  
•  Most	
  of	
  Exis@ng	
  tools	
  stop	
  at	
  the	
  onLoad()	
  and	
  are	
  not	
  sufficient	
  to	
  get	
  the	
  
real	
  measure	
  of	
  the	
  end	
  user	
  performance	
  and	
  cannot	
  tell	
  the	
  PAGE	
  
READY	
  state	
  
•  SPA	
  world	
  -­‐	
  most	
  of	
  the	
  processing	
  starts	
  when	
  onLoad()	
  ends	
  
•  Need	
  to	
  measure	
  processing	
  @me	
  for	
  various	
  user	
  ac@ons	
  heavy	
  on	
  the	
  
client	
  side	
  
Measured	
  Availability	
  using	
  NewRelic	
  
RUM	
  
9	
  
Web	
  Servers	
  
With	
  NewRelic	
  agents	
  
MA	
  reads	
  metrics	
  from	
  
NewRelic	
  insights	
  
NewRelic	
  Plugin	
  sends	
  
page	
  load	
  9me,	
  url,	
  
success	
  code	
  to	
  NewRelic	
  
servers	
  
Customer	
  interac9ons	
  
with	
  Web	
  servers.	
  
Web	
  servers	
  respond	
  to	
  
customer’s	
  requests	
  
along	
  with	
  NewRelic	
  
RUM	
  plugin.	
  
Measured	
  
Availability	
  
Dashboard	
  
Customer	
  
Browser	
  
Measured	
  Availability	
  Formulae	
  
	
  	
  
	
  
	
  
	
  
10	
  
NOTE:	
   “Outage”	
   is	
   number	
   of	
   transac@ons	
   that	
   were	
   impacted	
   during	
   planned	
   or	
  
unplanned	
  down@me.	
  
MA(%)=
(TotalTransactions−(ServerErrors+SlowTrasanctions+Outage))
TotalTransactions
×100
Thank	
  You!	
  
Singh.sanjay@yahoo.com	
  
+91.96633.72266	
  	
  

Weitere ähnliche Inhalte

Andere mochten auch

New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods 111...
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods  111...New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods  111...
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods 111...
David Kent
 
DevOps/Flow workshop for agile india 2015
DevOps/Flow workshop for agile india 2015DevOps/Flow workshop for agile india 2015
DevOps/Flow workshop for agile india 2015
Yuval Yeret
 
Devops the Microsoft Way
Devops the Microsoft WayDevops the Microsoft Way
Devops the Microsoft Way
Patrick Chanezon
 
DevOps monitoring: Feedback loops in enterprise environments
DevOps monitoring: Feedback loops in enterprise environmentsDevOps monitoring: Feedback loops in enterprise environments
DevOps monitoring: Feedback loops in enterprise environments
Jonah Kowall
 

Andere mochten auch (19)

How to design a great dashboard (Hebrew)
How to design a great dashboard (Hebrew)How to design a great dashboard (Hebrew)
How to design a great dashboard (Hebrew)
 
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods 111...
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods  111...New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods  111...
New Relic Future Stack 2015 - Step 1 in our quest for DevOps at US Foods 111...
 
DevconTLV 2014 (Jan) - DIY DevOps
DevconTLV 2014 (Jan) - DIY DevOpsDevconTLV 2014 (Jan) - DIY DevOps
DevconTLV 2014 (Jan) - DIY DevOps
 
Customer Ops: DevOps <3 customer support
Customer Ops: DevOps <3 customer supportCustomer Ops: DevOps <3 customer support
Customer Ops: DevOps <3 customer support
 
Survey on article extraction and comment monitoring techniques
Survey on article extraction and comment monitoring techniquesSurvey on article extraction and comment monitoring techniques
Survey on article extraction and comment monitoring techniques
 
DevOps at Obama for America(2012) and the DNC (DevOps Days NYC Jan 2013)
DevOps at Obama for America(2012) and the DNC (DevOps Days NYC Jan 2013)DevOps at Obama for America(2012) and the DNC (DevOps Days NYC Jan 2013)
DevOps at Obama for America(2012) and the DNC (DevOps Days NYC Jan 2013)
 
Practical Monitoring Techniques
Practical Monitoring TechniquesPractical Monitoring Techniques
Practical Monitoring Techniques
 
Which watcher watches CloudWatch
Which watcher watches CloudWatch Which watcher watches CloudWatch
Which watcher watches CloudWatch
 
5 Ways ITSM can Support DevOps, an ITSM Academy Webinar
5 Ways ITSM can Support DevOps, an ITSM Academy Webinar5 Ways ITSM can Support DevOps, an ITSM Academy Webinar
5 Ways ITSM can Support DevOps, an ITSM Academy Webinar
 
DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis
 
DevOps/Flow workshop for agile india 2015
DevOps/Flow workshop for agile india 2015DevOps/Flow workshop for agile india 2015
DevOps/Flow workshop for agile india 2015
 
Devoxx 2014 monitoring
Devoxx 2014 monitoringDevoxx 2014 monitoring
Devoxx 2014 monitoring
 
Run IT Support the DevOps Way
Run IT Support the DevOps WayRun IT Support the DevOps Way
Run IT Support the DevOps Way
 
Jelastic - DevOps PaaS Business with Docker Support for Service Providers
Jelastic - DevOps PaaS Business with Docker Support for Service ProvidersJelastic - DevOps PaaS Business with Docker Support for Service Providers
Jelastic - DevOps PaaS Business with Docker Support for Service Providers
 
Paris Devops - Monitoring And Feature Toggle Pattern With JMX
Paris Devops - Monitoring And Feature Toggle Pattern With JMXParis Devops - Monitoring And Feature Toggle Pattern With JMX
Paris Devops - Monitoring And Feature Toggle Pattern With JMX
 
Devops the Microsoft Way
Devops the Microsoft WayDevops the Microsoft Way
Devops the Microsoft Way
 
DevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft AzureDevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft Azure
 
DevOps monitoring: Feedback loops in enterprise environments
DevOps monitoring: Feedback loops in enterprise environmentsDevOps monitoring: Feedback loops in enterprise environments
DevOps monitoring: Feedback loops in enterprise environments
 
VIZBI 2015 Tutorial: Cytoscape, IPython, Docker, and Reproducible Network Dat...
VIZBI 2015 Tutorial: Cytoscape, IPython, Docker, and Reproducible Network Dat...VIZBI 2015 Tutorial: Cytoscape, IPython, Docker, and Reproducible Network Dat...
VIZBI 2015 Tutorial: Cytoscape, IPython, Docker, and Reproducible Network Dat...
 

Ähnlich wie Measured availability - Sanjay Singh - DevOps Bangalore meetup March 28th 2015

Benefits of developing single page web applications using angular js
Benefits of developing single page web applications using angular jsBenefits of developing single page web applications using angular js
Benefits of developing single page web applications using angular js
Harbinger Systems - HRTech Builder of Choice
 
Real User Experience Insight External
Real User Experience Insight ExternalReal User Experience Insight External
Real User Experience Insight External
oracleonthebrain
 
performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdf
MAshok10
 

Ähnlich wie Measured availability - Sanjay Singh - DevOps Bangalore meetup March 28th 2015 (20)

Slow pages lose users
Slow pages lose usersSlow pages lose users
Slow pages lose users
 
Getting start with Performance Testing
Getting start with Performance Testing Getting start with Performance Testing
Getting start with Performance Testing
 
Optimize application performance - Mumbai Seminar
Optimize application performance - Mumbai Seminar Optimize application performance - Mumbai Seminar
Optimize application performance - Mumbai Seminar
 
Applications manager 1 - Middle East Workshop
Applications manager 1 - Middle East WorkshopApplications manager 1 - Middle East Workshop
Applications manager 1 - Middle East Workshop
 
Delivering the right end user experience with your application performance
Delivering the right end user experience with your application performanceDelivering the right end user experience with your application performance
Delivering the right end user experience with your application performance
 
Real User Monitoring (RUM)
Real User Monitoring (RUM)Real User Monitoring (RUM)
Real User Monitoring (RUM)
 
Benefits of developing single page web applications using angular js
Benefits of developing single page web applications using angular jsBenefits of developing single page web applications using angular js
Benefits of developing single page web applications using angular js
 
Web Performance is a KPI
Web Performance is a KPIWeb Performance is a KPI
Web Performance is a KPI
 
Ria for online banking domain
Ria for online banking domainRia for online banking domain
Ria for online banking domain
 
web analytics overview
web analytics overviewweb analytics overview
web analytics overview
 
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
ATAGTR2017 Unified APM: The new age performance monitoring for production sys...
 
[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance Testing[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance Testing
 
Article by Marlabs Bangalore employee receives international recognition!
Article by Marlabs Bangalore employee receives international recognition!Article by Marlabs Bangalore employee receives international recognition!
Article by Marlabs Bangalore employee receives international recognition!
 
Web Page Speed - A Most Important Feature
Web Page Speed - A Most Important FeatureWeb Page Speed - A Most Important Feature
Web Page Speed - A Most Important Feature
 
Closing the door on application performance problems
Closing the door on application performance problemsClosing the door on application performance problems
Closing the door on application performance problems
 
Real User Experience Insight External
Real User Experience Insight ExternalReal User Experience Insight External
Real User Experience Insight External
 
Five performance factors you need to know about in 2018
Five performance factors you need to know about in 2018Five performance factors you need to know about in 2018
Five performance factors you need to know about in 2018
 
performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdf
 
Create seamless customer experiences
Create seamless customer experiencesCreate seamless customer experiences
Create seamless customer experiences
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
 

Kürzlich hochgeladen

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Kürzlich hochgeladen (20)

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 

Measured availability - Sanjay Singh - DevOps Bangalore meetup March 28th 2015

  • 1. Measured  Availability  and   Performance       Sanjay  Singh   singh.sanjay@yahoo.com  
  • 2. Agenda   •  FCI  –  Failed  Customer  Interac@on   •  TP  –  Top  Percen@le   •  RUM   •  RUM  with  SPA  
  • 4. FCI   •  FCI  is  Failed  Customer  Interac@on  which  is   measured  for  a  par@cular  page/workflow.   – A  customer  interac@on  can  be  page  view,  form   submission,  etc.  In  HTTP  terms,  customer’s   interac@ons  are  GET/POST  request.   – If  the  page  response  is  not  as  per  the  expected   behavior  of  the  applica@on,  then  it’s  a  failed   customer  interac@on.  
  • 5. How  is  FCI  calculated  ?   •  FCI  is  calculated  on  per  page  basis.  If  page   execu@on  is  not  as  per  the  expected  behavior,   then  it  is  counted  as  failure.   •  Iden@fy  all  failure  cases  and  log  it   appropriately  on  the  server  with  user  session’s   info.  
  • 6. Performance   •  As  per  Google  –   •  Increasing  web  search  latency  100  to  400  ms  reduces  the  daily  number  of  searches   per  user  by  0.2%  to  0.6%.       •  Users  do  fewer  searches  the  longer  they  are  exposed.     •  For  longer  delays,  the  loss  of  searches  persists  even  aYer  latency  returns  to   previous  levels.  
  • 7. Performance  Measurement   •  Top  Percen-le  (TP)  is  a  method  to  find   minimum  @me    in  which  (X)  amount  of   requests  were  served.   – Example:  If  the  TP90  of  a  page  is  2  sec,  then  it   means  90%  of  the  requests  were  served  within  2   seconds.  
  • 8. RUM  with  SPA   •  What  is  RUM?   –  RUM  =  Real  User  Monitoring,  is  the  actual  measure  of  how  long  a  page   took  to  render  and  become  usable  for  a  real  user.  It  is  the  measure  of   a  page’s  speed  by  measuring  the  @me  it  takes  for  "PAGE  READY"  state,   and  not  only  the  @me  it  took  for  data  to  be  downloaded.   •  Web  is  moving  towards  Single  Page  Architecture   •  Most  of  Exis@ng  tools  stop  at  the  onLoad()  and  are  not  sufficient  to  get  the   real  measure  of  the  end  user  performance  and  cannot  tell  the  PAGE   READY  state   •  SPA  world  -­‐  most  of  the  processing  starts  when  onLoad()  ends   •  Need  to  measure  processing  @me  for  various  user  ac@ons  heavy  on  the   client  side  
  • 9. Measured  Availability  using  NewRelic   RUM   9   Web  Servers   With  NewRelic  agents   MA  reads  metrics  from   NewRelic  insights   NewRelic  Plugin  sends   page  load  9me,  url,   success  code  to  NewRelic   servers   Customer  interac9ons   with  Web  servers.   Web  servers  respond  to   customer’s  requests   along  with  NewRelic   RUM  plugin.   Measured   Availability   Dashboard   Customer   Browser  
  • 10. Measured  Availability  Formulae             10   NOTE:   “Outage”   is   number   of   transac@ons   that   were   impacted   during   planned   or   unplanned  down@me.   MA(%)= (TotalTransactions−(ServerErrors+SlowTrasanctions+Outage)) TotalTransactions ×100
  • 11. Thank  You!   Singh.sanjay@yahoo.com   +91.96633.72266