Advances in technology are enabling a data and information revolution, and managing the network that moves all that data requires the right technology stack. It’s all about finding the right data at the right time for CenturyLink, creators of one of the largest networks in the world. See how CenturyLink has evolved their Network Management System and how Elastic plays a big part in their evolving platform. Learn how they address issues like volume, variety, and velocity of data being generated by disparate network devices and how they are creating simple yet scalable solutions to find the right data at the right time.

1. 1
The Elastic Evolution of CenturyLink’s
Network Management System
Shane Davies
October 30, 2018

2. 2

3. 3
Responsible for
Service Assurance
advanced analytics
Shane Davies
Sr. Software Architect at CenturyLink

4. 4
Devices
Network Devices
covering the globe
What does our environment look like today
Distinct Alerts
Average Distinct
Alerts Daily
Transaction
Average
Transactions Daily
300K 1M 11M

5. 5
Before we had to support
this there was…

6. 6
Initial Network Management System
Network
Probes
Rules
Display

7. 7
Growth through acquisition
How our environment changed

8. 8
After the first few Acquisitions
Display

9. 9
We tried this …
Display
Messaging Bus
Display
Struggling database performance
Complicated Queries

10. 10
Our plan in around 2010

11. 11
Today
Elasticsearch
Primary Data Center (10 nodes)
Backup Data Center (10 nodes)
Hadoop Ecosystem
KafkaRedis
Messaging
Queue
Custom UI

12. 12
Outages on our
Monitoring Platform
Greatly improved
Stability
TODAY
Production Defects
Simplifies our
development
Users
Almost a thousand
users
0 0 1K

13. 13
NOW THAT WE
UNDERSTAND WHAT IS
POSSIBLE

14. 14
Conceptual Architectural Target
Data Adapters
Event Ingestion
Normalization, Polling and Enriching
Automation
Workflow, Notifications, Assisted Automations and
Remediations
Streaming and Analytical Marts, Big-Data
Enrichment, correlation, situations, Machine Learning, AI, Indexing
Historical Processing
Historical situations
Machine Learning
Analytics and Automation Services (REST and Message)
Weather
Power
Network
Fault
Configuration
Tickets
Changes
Logs
Orders
Telemetry
Knowledge
Etc.
Performance
Utilization
APM
User Interface
Real-time Correlation, Collaboration, Dashboards, Rule Input, etc.
Kibana
Logstash
Elasticsearch
Custom UI
Beats
Custom UI

15. 15
"aggs":{
"2":{
"geohash_grid":{
"field":"aServiceLocation",
"precision":3
},
"aggs":{
"unique_count":{
"cardinality":{
"field":"IdNumber"
}
},
"center_location":{
"geo_centroid":{
"field":"aServiceLocation"
}
}
}
}
}
Beyond just alarming
Geo clustering and better insights