Presented at TechDays Sweden on 25.10.2017. Modern applications leverage a variety of services, and often span across onpremises, public cloud, IaaS and PaaS. Monitoring these environments is different from traditional systems. We have more and more data available from the platfrom with the likes of ARM Activity Logs, Azure Monitor, MOMS and Application Insights. With a massive amount of signal and noise being generated in all these systems, how do we get our arms around what is happening? How will I know if my application uptime is impacted? Are my servers handling the load? Are my integrations still running as they should? How many users are impacted by the incident and what is the root cause? Come and hear how to answer these questions as I walk through what actionable monitoring means in Azure applications. We will cover recent updates to the platform and tooling. After the session, you’ll have deeper understanding of end-to-end monitoring techniques in Azure solutions. http://tdswe.se/

2. Monitoring advanced PaaS workloads
in the enterprise
Karl-Gustav Ots
Managing Consultant, Kompozure AB
@fincooper

3. • Cloud and cybersecurity consultant
• Trainer and international speaker
• Patented inventor
• Working on Azure since 2011
Karl-Gustav Ots @ Kompozure

4. Agenda
• End-to-end monitoring, what and why?
• Recent updates
• Available tooling
After the session, you’ll have an overview of Azure E2E monitoring
options, whether you’re an IT Professional of a Developer.

5. Why end-to-end monitoring?
• By E2E I mean full-stack and
actionable monitoring of:
• Application
• Infrastucture
• Platform
• Out of scope:
• Billing
• Having E2E monitoring
infrastructure in place helps
you track :
• Health
• Performance
• Security
• SLA
• Benefits:
• Know how your application
performs
• Understand how users use
your app
• Fix issues and bugs faster

7. End-to-end monitoring helps to find out
Is my
application UP
or DOWN?
Is my
application
crashing?
What exactly
happened?
Is my
application
fast enough?
Is my server
able to handle
the load?
Is it Azure or
just me?
What is the
root cause?
How many
people are
impacted?

8. Azure Monitoring scene
Application
Insights
Azure Monitor Azure Health
ARM Activity
Logs
System Center
Operations
Manager
Operations
Management
Suite
Log Analytics
Network
Watcher
PowerBI
Secure Devops
Kit for Azure
(AzSDK)
Security
Center

9. Azure Monitor:
consolidated pipeline for
all monitoring data from
Azure services. It gives
you access to
performance metrics and
events that describe the
operation of the Azure
infrastructure and any
Azure services you are
using.
Application Insights:
application performance
monitoring and user analytics.
It monitors the code you've
written and applications
you've deployed on Azure or
on premises/other clouds
Log Analytics:
ingestion of log and
metric data from Azure
services (via Azure
Monitor), Azure VMs, and
on premises or other
cloud infrastructure and
offers flexible log search
and out-of-the box
analytics on top of this
data. It

10. Azure Monitor

11. Azure Monitor
• Built-In monitoring support for all Azure resources
• Out-of-the-box Resource Metrics, such as:
• Total active connections on Azure DB for MySQL
• Number of throttling errors for IoT hub
• Alert rules to get notified & take automated actions
• Exposed as an API

12. Recent Updates
• Application Insights is now Generally Available
• Also in Europe
• ARM Activity Logs Generally Available
• Azure Monitor Generally Available
• Azure Health and Planned Maintenance
• Log Analytics migration from Elastic Search and SOLR to Kusto
query language

13. Recent Updates (Ignite)
• Azure Monitor ITSM support
• System Center Service Manager, Service Now, Provance, Cherwell
• New Azure Monitor Alert engine
• Near-real time monitoring
• New UI for Application Insights and Azure Monitor
• Application Insights Failure Diagnostics

14. Demo

15. Azure Monitor:
consolidated pipeline for
all monitoring data from
Azure services. It gives
you access to
performance metrics and
events that describe the
operation of the Azure
infrastructure and any
Azure services you are
using.
Application Insights:
application performance
monitoring and user analytics.
It monitors the code you've
written and applications
you've deployed on Azure or
on premises/other clouds
Log Analytics:
ingestion of log and
metric data from Azure
services (via Azure
Monitor), Azure VMs, and
on premises or other
cloud infrastructure and
offers flexible log search
and out-of-the box
analytics on top of this
data. It

16. Application Insights

17. Application Insights Application Map
• Maps your application component dependencies
• Monitoring of load, performance, failures and alerts, at
component level
• You can drill down to a speific Azure Monitor or Azure Service
diagnostic view, such as SQL Database Advisor
• Helps you spot the problemmatic component more easily

19. Application insights Web test alerts
Availability test
• You can test any website
• Up to 16 Azure locations supported
• Not just HTTP response: can be configured to require certain
content to be retrieved (welcome text, image etc)

22. Application insights Web test alerts
Recorded step tests
• Session recording with Visual Studio or browser
• Timing and random number input
• Authentication with SAML or AAD

23. Application Insights Machine Learning alerts
• Failure Anomalies.
• Performance
Anomalies.

25. Application Insights
PowerBI pack
• Combine metrics from multiple
applications in one portal for self-service
BI
• Premade visualizations for active users,
page views, sessions, browser and OS
version, and geographic distribution of
users in a map

26. Azure Monitor:
consolidated pipeline for
all monitoring data from
Azure services. It gives
you access to
performance metrics and
events that describe the
operation of the Azure
infrastructure and any
Azure services you are
using.
Application Insights:
application performance
monitoring and user analytics.
It monitors the code you've
written and applications
you've deployed on Azure or
on premises/other clouds
Log Analytics:
ingestion of log and
metric data from Azure
services (via Azure
Monitor), Azure VMs, and
on premises or other
cloud infrastructure and
offers flexible log search
and out-of-the box
analytics on top of this
data. It

27. Log Analytics

28. Log Analytics
• Operation Management Suite (OMS) provides several infrastructure
monitoring capabilities out of the box:
• Network Performance Monitoring
• Storage, compute and Microsoft middleware performance
• With OMS, you can use the Kusto query engine to search trough
your System Center logs or syslog.
• You can ask e.g. for data on all unhealthy network links
• Or status of disk usage and patching for all VMs
• You can also bring all Application Insights telemetry into OMS
search logs!

29. Demo

30. Log Analytics connectivity
• Input
• Application Insights
• Azure Platform
• Azure Active Directory Audit logs, Azure Activity Logs, Azure Security Center Alerts,
most Azure Resource Provider's Logs
• Windows or Linux Virtual Machine logs
• System Center logs
• ITSM tools: System Center Service Manager, ServiceNow, Provance, and
Cherwell
• Output
• Azure Log Integration : Anywhere ☺

31. Azure Audit logs in PowerBI

33. OMS Service Map
• Built on the BlueStripe acquisition
• Automatically maps dependencies of your Windows or Linux VMs
• Shows connections between servers, ports and processes
• You need to install an agent
• Use Service map to gather a holistic SLA view on your IaaS
appications
• Drill down to machine level to see OMS performance monitoring data
• Think Application Map for infra!

35. SCOM

36. Azure end-to-end Monitoring
IaaS PaaS
Performance
monitoring
Operations Management
Suite
Application Insights
Dependency
mapping
OMS Service Map App insights Application
Map
Alerts and Health Azure Monitor Azure Monitor
Visualization PowerBi, Portal Dashboard
and SDK
PowerBI, Portal Dashboard
and SDK
SCOM visibility Azure Management Pack Application Insights
Management Pack

37. Further reading
• Patterns & Practices article on Monitoring:
• https://docs.microsoft.com/en-us/azure/monitoring-and-diagnostics/
• Logic App that posts a message to a Slack channel when an Azure alert fires:
• https://github.com/Azure/azure-quickstart-templates/tree/master/201-alert-to-slack-with-logic-
app
• Set up alerts automatically using PowerShell
• https://docs.microsoft.com/en-us/azure/application-insights/app-insights-powershell-alerts
• Provision alerts from Secure DevOps kit for Azure:
• https://github.com/azsdk/azsdk-docs/blob/master/01-Subscription-
Security/Readme.md#azsdk-suscription-activity-alerts
• Ignite Sessions:
• Analyze & Debug applications across your DevOps workflow with Azure Application Insights
• Manage and optimize your cloud spend with Azure Cost Management by Cloudyn
• Monitoring, diagnosing and debugging with Azure networking

38. Thank you!
Please do not forget to evaluate the
session before you leave by using our
Lollipolls!