SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Monitoring of distributed app
hosted in Azure App Service
Alexander Laysha,
Chief Software Engineer at EPAM Systems
Agenda
• Overview of Monitoring in Azure
• App Service Monitoring: App Insights & Azure Portal
• App Service Monitoring : Stream Analytics & Power BI
• App Service Monitoring : Advanced approach
Monitoring in Azure: Non-Compute Resources
Monitoring in Azure: Compute Resources
Azure monitoring offerings
• Azure Insights (Platform) Monitoring
• Application Insights
• Log Analytics
DEMO #1
Audit logs, metrics & diagnostics on Azure Portal
Primitive Distributed Architecture
Azure Web App
(1-N instances)
Actor Azure Web Job
(1-N instances)
Queue
Load balancer
ActivityId ActivityId
ActivityId
Monitoring: App Insights & Azure Portal
Azure Web Job
(1-N instances)
Azure Web App
(1-N instances)
Queue
ActivityId ActivityId
Azure App Insights
Microsoft Azure Resource Metrics
Continues
Export
Azure Storage
Blobs
DEMO #2
Ambient Context Implementation &
Monitoring of App Service based on App Insights and Azure Portal
Existing Challenges
• Minimal chart auto-refresh time is 5 mins
• Total data rate for App Insights is limited
500 dp/s, exceptions to 50 dp/s
• Total data points for App Insights per month are limited
50M/month
• Limited support for Live Metrics Stream
no data store, no additional charts, no configuration, no custom data, can’t be pinned on dashboard
• Not all App Insights charts be pinned on dashboard
• Retention period
7 days for raw data and 90 days for aggregated data
• Delay between data sending and displaying
Delay between data sending and displaying
Custom Metric Custom Event
Single Request Multiple (500) Requests Single Request
# Delay, s # Delay, s # Delay, s
1 98 1 70 1 107
2 105 2 58 2 136
3 143 3 68 3 103
4 93 4 83 4 137
5 127 5 80 5 114
6 108 6 95 6 106
7 138 7 52 7 108
8 118 8 80 8 123
9 134 9 80 9 128
10 117 10 56 10 133
Average 118 Average 72 Average 120
Monitoring: Stream Analytics & PowerBI
Metrics Collector Web Job
Azure Insights REST API
Azure App Insights
Metrics & Events Storage
Includes exported diagnostics from
Azure Resources
Azure Stream Analytics Power BI
REST API
FIFO Retention Policy
Processed MetricsRaw Metrics
Resource
Metrics
DEMO #3
Monitoring of App Service based on Stream Analytics and Power BI
Existing challenges
• Azure Stream Analytics creates FIFO dataset by default
Each table in FIFO dataset stores up to 200,000 rows
• Azure Stream Analytics doesn’t support multiple PowerBI outputs to
the same dataset
One dataset & one table for each PowerBI output
• A table with none retention police can store up to 5,000,000 rows
Power BI REST API doesn’t provide the ability to clear table partly
• Delay between sending data to App Insights and exporting
Delay between data sending and exporting
Metric Custom Event
Single Request Single Request
# Delay, s # Delay, s
1 141 1 144
2 153 2 156
3 154 3 159
4 142 4 139
5 159 5 162
6 163 6 135
7 160 7 163
8 150 8 153
9 162 9 135
10 139 10 143
Average 152 Average 149
Monitoring: Advanced approach
PowerBI
REST API or
External Analysis Storage
(DirectQuery)
Metrics Collector Web Job Azure Insights REST API
Azure Web Job
Azure Web App
Other Sources
Diagnostics Logs, Azure Storage Analytics, etc.
3rd Party or Custom Monitoring
Event Hub Azure Function
DEMO #4
Monitoring of App Service based on Event Hub
Q&A
Join us in FB: https://www.facebook.com/groups/AzureBelarus

Weitere ähnliche Inhalte

Was ist angesagt?

Kill the fail whale for your API
Kill the fail whale for your APIKill the fail whale for your API
Kill the fail whale for your API
3scale
 
App & API Monitoring: Building a 5-Star Reputation for your Apps
App & API Monitoring: Building a 5-Star Reputation for your AppsApp & API Monitoring: Building a 5-Star Reputation for your Apps
App & API Monitoring: Building a 5-Star Reputation for your Apps
Apigee | Google Cloud
 

Was ist angesagt? (20)

Azure API Management - Global Azure Bootcamp 2019
Azure API Management - Global Azure Bootcamp 2019Azure API Management - Global Azure Bootcamp 2019
Azure API Management - Global Azure Bootcamp 2019
 
Developer Services: Making Developers Successful
Developer Services: Making Developers SuccessfulDeveloper Services: Making Developers Successful
Developer Services: Making Developers Successful
 
The API Lifecycle, from pre-production testing to post-production monitoring
The API Lifecycle, from pre-production testing to post-production monitoringThe API Lifecycle, from pre-production testing to post-production monitoring
The API Lifecycle, from pre-production testing to post-production monitoring
 
Edge API BaaS Deep-Dive: Streamline app development
Edge API BaaS Deep-Dive: Streamline app developmentEdge API BaaS Deep-Dive: Streamline app development
Edge API BaaS Deep-Dive: Streamline app development
 
Adapt or Die DevJam: San Francisco, Sept 27 2016
Adapt or Die DevJam: San Francisco, Sept 27 2016Adapt or Die DevJam: San Francisco, Sept 27 2016
Adapt or Die DevJam: San Francisco, Sept 27 2016
 
API Management Platform Technical Evaluation Framework
API Management Platform Technical Evaluation FrameworkAPI Management Platform Technical Evaluation Framework
API Management Platform Technical Evaluation Framework
 
Apigee Edge Overview and Roadmap
Apigee Edge Overview and RoadmapApigee Edge Overview and Roadmap
Apigee Edge Overview and Roadmap
 
Webcast: Apigee Edge Product Demo
Webcast: Apigee Edge Product DemoWebcast: Apigee Edge Product Demo
Webcast: Apigee Edge Product Demo
 
KPIs CDOs Should Know & Love (webcast)
KPIs CDOs Should Know & Love (webcast)KPIs CDOs Should Know & Love (webcast)
KPIs CDOs Should Know & Love (webcast)
 
Monitoring Solutions for APIs
Monitoring Solutions for APIsMonitoring Solutions for APIs
Monitoring Solutions for APIs
 
Pivotal + Apigee Workshop (June 4th, 2019)
Pivotal + Apigee Workshop (June 4th, 2019)Pivotal + Apigee Workshop (June 4th, 2019)
Pivotal + Apigee Workshop (June 4th, 2019)
 
API workshop by AWS and 3scale
API workshop by AWS and 3scaleAPI workshop by AWS and 3scale
API workshop by AWS and 3scale
 
Adapt or Die: Serverless Microservices
Adapt or Die: Serverless MicroservicesAdapt or Die: Serverless Microservices
Adapt or Die: Serverless Microservices
 
We built this city: Behind the scenes of Apigee Edge
We built this city: Behind the scenes of Apigee EdgeWe built this city: Behind the scenes of Apigee Edge
We built this city: Behind the scenes of Apigee Edge
 
Kill the fail whale for your API
Kill the fail whale for your APIKill the fail whale for your API
Kill the fail whale for your API
 
API Design Workflows
API Design WorkflowsAPI Design Workflows
API Design Workflows
 
APIsBerlin 3scale Data for a Web of APIs
APIsBerlin 3scale Data for a Web of APIs APIsBerlin 3scale Data for a Web of APIs
APIsBerlin 3scale Data for a Web of APIs
 
Analytics Services: Measuring Anything, Anywhere...
Analytics Services: Measuring Anything, Anywhere...Analytics Services: Measuring Anything, Anywhere...
Analytics Services: Measuring Anything, Anywhere...
 
Webcast: Apigee Edge Product Demo
Webcast: Apigee Edge Product DemoWebcast: Apigee Edge Product Demo
Webcast: Apigee Edge Product Demo
 
App & API Monitoring: Building a 5-Star Reputation for your Apps
App & API Monitoring: Building a 5-Star Reputation for your AppsApp & API Monitoring: Building a 5-Star Reputation for your Apps
App & API Monitoring: Building a 5-Star Reputation for your Apps
 

Ähnlich wie Monitoring of distributed app hosted in Azure App Service

Ähnlich wie Monitoring of distributed app hosted in Azure App Service (20)

Cloud monitoring with Applications Manager
Cloud monitoring with Applications ManagerCloud monitoring with Applications Manager
Cloud monitoring with Applications Manager
 
Deep-Dive to Application Insights
Deep-Dive to Application Insights Deep-Dive to Application Insights
Deep-Dive to Application Insights
 
DevOps > CI + CD. A web developer's introduction to Application Insights
DevOps > CI + CD.  A web developer's introduction to Application InsightsDevOps > CI + CD.  A web developer's introduction to Application Insights
DevOps > CI + CD. A web developer's introduction to Application Insights
 
Monitoring advanced Azure PaaS workloads in the enterprise - Level: 200
Monitoring advanced Azure PaaS workloads in the enterprise - Level: 200Monitoring advanced Azure PaaS workloads in the enterprise - Level: 200
Monitoring advanced Azure PaaS workloads in the enterprise - Level: 200
 
Azure Application insights - An Introduction
Azure Application insights - An IntroductionAzure Application insights - An Introduction
Azure Application insights - An Introduction
 
Applications Performance Monitoring with Applications Manager part 1
Applications Performance Monitoring with Applications Manager part 1Applications Performance Monitoring with Applications Manager part 1
Applications Performance Monitoring with Applications Manager part 1
 
Performance monitoring in a DevOps World
Performance monitoring in a DevOps WorldPerformance monitoring in a DevOps World
Performance monitoring in a DevOps World
 
FAUG Jyväskylä 28.5.2019 - Azure Monitoring
FAUG Jyväskylä 28.5.2019 - Azure MonitoringFAUG Jyväskylä 28.5.2019 - Azure Monitoring
FAUG Jyväskylä 28.5.2019 - Azure Monitoring
 
SQL Bits 2018 | Best practices for Power BI on implementation and monitoring
SQL Bits 2018 | Best practices for Power BI on implementation and monitoring SQL Bits 2018 | Best practices for Power BI on implementation and monitoring
SQL Bits 2018 | Best practices for Power BI on implementation and monitoring
 
Analytics in Power Platform: What are my options?
Analytics in Power Platform: What are my options?Analytics in Power Platform: What are my options?
Analytics in Power Platform: What are my options?
 
Different monitoring options for cloud native integration solutions
Different monitoring options for cloud native integration solutionsDifferent monitoring options for cloud native integration solutions
Different monitoring options for cloud native integration solutions
 
Service quality monitoring system architecture
Service quality monitoring system architectureService quality monitoring system architecture
Service quality monitoring system architecture
 
Debugging and Interacting with Production Applications - MS Online Tech Forum
Debugging and Interacting with Production Applications - MS Online Tech ForumDebugging and Interacting with Production Applications - MS Online Tech Forum
Debugging and Interacting with Production Applications - MS Online Tech Forum
 
Modernizing Cloud and Hyperconverged Infrastructure monitoring
Modernizing Cloud and Hyperconverged Infrastructure monitoringModernizing Cloud and Hyperconverged Infrastructure monitoring
Modernizing Cloud and Hyperconverged Infrastructure monitoring
 
Monitor Cloud Resources using Alerts & Insights
Monitor Cloud Resources using Alerts & InsightsMonitor Cloud Resources using Alerts & Insights
Monitor Cloud Resources using Alerts & Insights
 
Azure Monitoring Overview
Azure Monitoring OverviewAzure Monitoring Overview
Azure Monitoring Overview
 
Azure saturday pn 2018
Azure saturday pn 2018Azure saturday pn 2018
Azure saturday pn 2018
 
Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...
Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...
Aprenda mais sobre sua aplicação e seus usuários com Application Insights (DN...
 
Azure Low Lands 2018: Monitoring real life Azure applications when to use wha...
Azure Low Lands 2018: Monitoring real life Azure applications when to use wha...Azure Low Lands 2018: Monitoring real life Azure applications when to use wha...
Azure Low Lands 2018: Monitoring real life Azure applications when to use wha...
 
Going Serverless with Azure Functions #1 - Introduction to Azure Functions
Going Serverless with Azure Functions #1 - Introduction to Azure FunctionsGoing Serverless with Azure Functions #1 - Introduction to Azure Functions
Going Serverless with Azure Functions #1 - Introduction to Azure Functions
 

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

Monitoring of distributed app hosted in Azure App Service

  • 1. Monitoring of distributed app hosted in Azure App Service Alexander Laysha, Chief Software Engineer at EPAM Systems
  • 2. Agenda • Overview of Monitoring in Azure • App Service Monitoring: App Insights & Azure Portal • App Service Monitoring : Stream Analytics & Power BI • App Service Monitoring : Advanced approach
  • 3. Monitoring in Azure: Non-Compute Resources
  • 4. Monitoring in Azure: Compute Resources
  • 5. Azure monitoring offerings • Azure Insights (Platform) Monitoring • Application Insights • Log Analytics
  • 6. DEMO #1 Audit logs, metrics & diagnostics on Azure Portal
  • 7. Primitive Distributed Architecture Azure Web App (1-N instances) Actor Azure Web Job (1-N instances) Queue Load balancer ActivityId ActivityId ActivityId
  • 8. Monitoring: App Insights & Azure Portal Azure Web Job (1-N instances) Azure Web App (1-N instances) Queue ActivityId ActivityId Azure App Insights Microsoft Azure Resource Metrics Continues Export Azure Storage Blobs
  • 9. DEMO #2 Ambient Context Implementation & Monitoring of App Service based on App Insights and Azure Portal
  • 10. Existing Challenges • Minimal chart auto-refresh time is 5 mins • Total data rate for App Insights is limited 500 dp/s, exceptions to 50 dp/s • Total data points for App Insights per month are limited 50M/month • Limited support for Live Metrics Stream no data store, no additional charts, no configuration, no custom data, can’t be pinned on dashboard • Not all App Insights charts be pinned on dashboard • Retention period 7 days for raw data and 90 days for aggregated data • Delay between data sending and displaying
  • 11. Delay between data sending and displaying Custom Metric Custom Event Single Request Multiple (500) Requests Single Request # Delay, s # Delay, s # Delay, s 1 98 1 70 1 107 2 105 2 58 2 136 3 143 3 68 3 103 4 93 4 83 4 137 5 127 5 80 5 114 6 108 6 95 6 106 7 138 7 52 7 108 8 118 8 80 8 123 9 134 9 80 9 128 10 117 10 56 10 133 Average 118 Average 72 Average 120
  • 12. Monitoring: Stream Analytics & PowerBI Metrics Collector Web Job Azure Insights REST API Azure App Insights Metrics & Events Storage Includes exported diagnostics from Azure Resources Azure Stream Analytics Power BI REST API FIFO Retention Policy Processed MetricsRaw Metrics Resource Metrics
  • 13. DEMO #3 Monitoring of App Service based on Stream Analytics and Power BI
  • 14. Existing challenges • Azure Stream Analytics creates FIFO dataset by default Each table in FIFO dataset stores up to 200,000 rows • Azure Stream Analytics doesn’t support multiple PowerBI outputs to the same dataset One dataset & one table for each PowerBI output • A table with none retention police can store up to 5,000,000 rows Power BI REST API doesn’t provide the ability to clear table partly • Delay between sending data to App Insights and exporting
  • 15. Delay between data sending and exporting Metric Custom Event Single Request Single Request # Delay, s # Delay, s 1 141 1 144 2 153 2 156 3 154 3 159 4 142 4 139 5 159 5 162 6 163 6 135 7 160 7 163 8 150 8 153 9 162 9 135 10 139 10 143 Average 152 Average 149
  • 16. Monitoring: Advanced approach PowerBI REST API or External Analysis Storage (DirectQuery) Metrics Collector Web Job Azure Insights REST API Azure Web Job Azure Web App Other Sources Diagnostics Logs, Azure Storage Analytics, etc. 3rd Party or Custom Monitoring Event Hub Azure Function
  • 17. DEMO #4 Monitoring of App Service based on Event Hub
  • 18. Q&A
  • 19. Join us in FB: https://www.facebook.com/groups/AzureBelarus