SlideShare a Scribd company logo
1 of 18
Download to read offline
Use Case: Monitoring /
Observability
Balaji Palani - Sr. Director of Product Management,
InfluxData
Brian Gilmore - Director of IoT and Emerging
Technologies, InfluxData
Connect Learn Build
Hear from and meet developers
from the InfluxDB Community
Be inspired by use cases from
our partners and InfluxDB engineers
Learn best practices that will
help you build great experiences
for your projects
In this fireside chat, Balaji and Brian discuss the
evolution of the monitoring and observability industry,
the role that InfluxDB plays and a look at how one
customer is using InfluxDB in their solution.
Balaji Palani
Sr. Director of Product
Management, InfluxData
Balaji Palani is the Senior
Director of Product
Management focused on
InfluxDB Cloud. He is
passionate about building
powerful cloud products
that help Developers
achieve the fastest time to
awesome.
Use Case: Monitoring /
Observability
Brian Gilmore
Director of IoT and Emerging
Technologies, InfluxData
Brian Gilmore is Director
of IoT and Emerging
Technology at InfluxData.
He has worked with
organizations to drive the
unification of industrial
and enterprise IoT with
machine learning, cloud,
and other technologies
Agenda
1. Evolution of monitoring
2. How customers are using InfluxDB for monitoring
3. Customer implementations
Use Case Categories
IoT Monitoring Developer Tools Real-time Analytics
Industrial
Enterprise
Consumer
DevOps
Networks
Security
Cloud
Applications
APIs
Gaming
Renewable
Energy
FinTech
Crypto
Metrics, Events, and Traces
Usually derived through sampling, usually numeric, and
typically regular in period.
Usually emitted, on-event or on-exception. Can be either
numeric or strings. Irregular period by nature.
Bundled and uniquely labeled collections of related
metrics and events related to a specific transaction or
interaction. Irregular period and explicit duration.
Metrics
Events
Traces
How They Relate
Metrics (one/sec):
Events (varied):
Traces (bundled):
12s
3s
8.26s
Condition 1
Condition 2
Condition 3
Condition 4
Trace ID: 86ef2836-58fe-4a2e-ba69-3de4596072fd
duration 37 seconds
6s
InfluxData Reference Architecture
Data Sources
Application
Workflows
Infrastructure
Insights
Telegraf
Client Libraries
HTTP
Syslog
Kubernetes
Apache Kafka
Python
Arduino
Node.js
JavaScript
Go
Data Systems
Mobile apps
Web apps
Cloud Services
Devices
Sensors
Databases
Networks
Message Queues
APIs
IoT Platforms
CRMs
InfluxDB Platform
IoT
Actions
InfluxDB
Purpose-Built Time Series Database
Visualization, Query & Task Engine
Collect
Downsample
Trigger
Alert
Transform
…
300+ Plugins
14+ Languages
…
Native Ecosystems
JMeter
NiFi
AWS Kinesis
Azure Event Hubs
GCP PubSub
Java
.NET/C#
PHP
Ruby
Vector
Fluentd
Scrapers
Native Collectors
Reference Architecture Detail
DevOps Monitoring with InfluxData
Data Sources Integrations
Applications/Services
• Web Application Infrastructure
• Containers
• Message Brokers
• Databases
• K8S
• Custom microservices
• Network Instrumentation
• Customer facing web applications
• Customer facing mobile apps
Devices/Infrastructure
• Mobile Apps
• Web Apps
• APIs
• Message Queues
• Ecosystem Devices
(Connectivity, coordination
ie Alexa)
Telegraf
• AMQP
• Active MQ
• Amazon Cloudwatch
• Amazon Kinesis
• Kafka
• Docker
• Azure Event Hub
• ExecD
• GCP Pub/Sub
• HTTP
• Jenkins
• Kernel
• Kubernetes
• MQTT Consumer
• NATS Consumer
• NGINX
• OpenTelemetry
• Redis
Client Libraries
• Java
• .NET/C#
14+ Languages
300+ Plugins
• Product quality
• Process optimization
• Code integration
• Testing and load balancing
• Deployment optimization
• Error handling
• Monitoring Analytics
• Alerting Frameworks
• Go
• JavaScript
Applications & Use Cases
InfluxDB
Purpose-Built Time Series Database
Visualization, Query & Task Engine
Collect
Transform
Downsample
Trigger Workflows
Alert
SLO PLATFORM
Translate Observability Data into Clear Action
Roadmap Decisions
Justifying Tech Investments
& Cloud Spend
On Call Alerts &
Interruptions
OBSERVABILITY
DATA SOURCES
Normalized Service Level
Objectives (SLOs) across
multiple data sources:
● Quantified Customer
Expectations
● Tech Debt & Service
Delivery Risks
● Define Clear Trade-offs in
Service Management
Deployment
Optimization
Reference Architecture
DevOps Monitoring with InfluxData
Error
Handling
Sources
CI/CD Pipelines
Cloud Services
Containers
Kubernetes (K8S)
Mobile apps
Web apps
Networking
System Stats (CPU,
Memory)
Microservices
InfluxDB
Purpose-Built Time Series Database
Visualization, Query & Task Engine
Telegraf
Client Libraries
• HTTP
• Syslog
• Kubernetes
• Apache Kafka
• AWS Kinesis
• Azure Event Hubs
• GCP PubSub
300+ Plugins
• Java
• Go
• .NET/C#
• JavaScript
• Node.js
• Python
• Arduino
• PHP
• Ruby
12+ Languages
Data Types
APIs
Application
performance
Metrics
Infrastructure
metrics
Business
transaction metrics
Service adoption
metrics
Collect
Transform
Downsample
Trigger Workflows
Alert
• Product quality
• Process optimization
• Code integration
• Testing and load
balancing
• Deployment
optimization
• Error handling
• Monitoring Analytics
• Alerting Frameworks
Applications &
Use Cases
Nobl9 Architecture - Black Box View
Error
Budgets
Web App
API
InfluxDB
PM & Business
Stakeholders
YAML
GUI
A
l
e
r
t
P
r
i
o
r
i
t
i
z
e
Raw SLIs
SLO Config
Ops/SREs &
Application Leads
Govern
Align
New Relic Prometheus
Datadog
Calculations
Customer Platforms and Services
App
CI/CD Web Services
Data
GitOps
SLO Based
Events &
Alerts
Graphs
Reports
Review &
Align
Review &
Align
Calculation of SLO time series
Nobl9 Calculation Architecture
● Rearchitected into custom code and Kafka
○ FIFO calculation approach
○ Maintains state, uses object storage as a
backing store
○ Scales horizontally
Processing of telemetry data (SLIs) and math
API Tier
Catalog
Ingestor
Kafka
Ingestor
Ingester
Querier
Querier
Querier (SQL)
Compacter
Compacter
Compacter
Object Store
InfluxQL
Flux
Queries
Writes
Powered by IOx
T H A N K Y O U

More Related Content

Similar to Gilmore, Palani [InfluxData] | Use Case: Monitoring / Observability | InfluxDays 2022

Similar to Gilmore, Palani [InfluxData] | Use Case: Monitoring / Observability | InfluxDays 2022 (20)

Oracle Cloud Native
Oracle Cloud NativeOracle Cloud Native
Oracle Cloud Native
 
Your Journey to Cloud-Native Begins with DevOps, Microservices, and Containers
Your Journey to Cloud-Native Begins with DevOps, Microservices, and ContainersYour Journey to Cloud-Native Begins with DevOps, Microservices, and Containers
Your Journey to Cloud-Native Begins with DevOps, Microservices, and Containers
 
Cloud Native Application Integration With APIs
Cloud Native Application Integration With APIsCloud Native Application Integration With APIs
Cloud Native Application Integration With APIs
 
The new developer experience
The new developer experienceThe new developer experience
The new developer experience
 
2022: 6 Cloud-Native App Development Trends to Transform Your Business
2022: 6 Cloud-Native App Development Trends to Transform Your Business2022: 6 Cloud-Native App Development Trends to Transform Your Business
2022: 6 Cloud-Native App Development Trends to Transform Your Business
 
Using Pivotal Cloud Foundry with Google’s BigQuery and Cloud Vision API
Using Pivotal Cloud Foundry with Google’s BigQuery and Cloud Vision APIUsing Pivotal Cloud Foundry with Google’s BigQuery and Cloud Vision API
Using Pivotal Cloud Foundry with Google’s BigQuery and Cloud Vision API
 
Evolving your Architecture to MicroServices
Evolving your Architecture to MicroServicesEvolving your Architecture to MicroServices
Evolving your Architecture to MicroServices
 
Challenges In Modern Application
Challenges In Modern ApplicationChallenges In Modern Application
Challenges In Modern Application
 
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONIBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
 
Bluemix - Overview & Benefits
Bluemix - Overview & BenefitsBluemix - Overview & Benefits
Bluemix - Overview & Benefits
 
IBM Bluemix Overview
IBM Bluemix OverviewIBM Bluemix Overview
IBM Bluemix Overview
 
Bluemixoverview
BluemixoverviewBluemixoverview
Bluemixoverview
 
How does IBM Bluemix work?
How does IBM Bluemix work?How does IBM Bluemix work?
How does IBM Bluemix work?
 
Platform governance, gestire un ecosistema di microservizi a livello enterprise
Platform governance, gestire un ecosistema di microservizi a livello enterprisePlatform governance, gestire un ecosistema di microservizi a livello enterprise
Platform governance, gestire un ecosistema di microservizi a livello enterprise
 
Confluent Partner Tech Talk with Reply
Confluent Partner Tech Talk with ReplyConfluent Partner Tech Talk with Reply
Confluent Partner Tech Talk with Reply
 
What is IBM Bluemix , Une nouvelle façon de coder , dans le cloud
What is IBM Bluemix , Une nouvelle façon de coder , dans le cloudWhat is IBM Bluemix , Une nouvelle façon de coder , dans le cloud
What is IBM Bluemix , Une nouvelle façon de coder , dans le cloud
 
Building what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructureBuilding what's next with google cloud's powerful infrastructure
Building what's next with google cloud's powerful infrastructure
 
Bluemix DevOps Meetup
Bluemix DevOps MeetupBluemix DevOps Meetup
Bluemix DevOps Meetup
 
Moving Beyond Migration: Reinventing Process in the Cloud
Moving Beyond Migration: Reinventing Process in the CloudMoving Beyond Migration: Reinventing Process in the Cloud
Moving Beyond Migration: Reinventing Process in the Cloud
 
Delivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing ChoreoDelivering New Digital Experiences Fast - Introducing Choreo
Delivering New Digital Experiences Fast - Introducing Choreo
 

More from InfluxData

How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
InfluxData
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
InfluxData
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
InfluxData
 

More from InfluxData (20)

Announcing InfluxDB Clustered
Announcing InfluxDB ClusteredAnnouncing InfluxDB Clustered
Announcing InfluxDB Clustered
 
Best Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow EcosystemBest Practices for Leveraging the Apache Arrow Ecosystem
Best Practices for Leveraging the Apache Arrow Ecosystem
 
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
How Bevi Uses InfluxDB and Grafana to Improve Predictive Maintenance and Redu...
 
Power Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDBPower Your Predictive Analytics with InfluxDB
Power Your Predictive Analytics with InfluxDB
 
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
How Teréga Replaces Legacy Data Historians with InfluxDB, AWS and IO-Base
 
Build an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING StackBuild an Edge-to-Cloud Solution with the MING Stack
Build an Edge-to-Cloud Solution with the MING Stack
 
Meet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using RustMeet the Founders: An Open Discussion About Rewriting Using Rust
Meet the Founders: An Open Discussion About Rewriting Using Rust
 
Introducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud DedicatedIntroducing InfluxDB Cloud Dedicated
Introducing InfluxDB Cloud Dedicated
 
Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB Gain Better Observability with OpenTelemetry and InfluxDB
Gain Better Observability with OpenTelemetry and InfluxDB
 
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
How a Heat Treating Plant Ensures Tight Process Control and Exceptional Quali...
 
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...How Delft University's Engineering Students Make Their EV Formula-Style Race ...
How Delft University's Engineering Students Make Their EV Formula-Style Race ...
 
Introducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage EngineIntroducing InfluxDB’s New Time Series Database Storage Engine
Introducing InfluxDB’s New Time Series Database Storage Engine
 
Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena Start Automating InfluxDB Deployments at the Edge with balena
Start Automating InfluxDB Deployments at the Edge with balena
 
Understanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage EngineUnderstanding InfluxDB’s New Storage Engine
Understanding InfluxDB’s New Storage Engine
 
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDBStreamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
Streamline and Scale Out Data Pipelines with Kubernetes, Telegraf, and InfluxDB
 
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
Ward Bowman [PTC] | ThingWorx Long-Term Data Storage with InfluxDB | InfluxDa...
 
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
Scott Anderson [InfluxData] | New & Upcoming Flux Features | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts | InfluxDays 2022
 
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
Steinkamp, Clifford [InfluxData] | Welcome to InfluxDays 2022 - Day 2 | Influ...
 
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
Steinkamp, Clifford [InfluxData] | Closing Thoughts Day 1 | InfluxDays 2022
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 

Gilmore, Palani [InfluxData] | Use Case: Monitoring / Observability | InfluxDays 2022

  • 1.
  • 2. Use Case: Monitoring / Observability Balaji Palani - Sr. Director of Product Management, InfluxData Brian Gilmore - Director of IoT and Emerging Technologies, InfluxData
  • 3. Connect Learn Build Hear from and meet developers from the InfluxDB Community Be inspired by use cases from our partners and InfluxDB engineers Learn best practices that will help you build great experiences for your projects
  • 4. In this fireside chat, Balaji and Brian discuss the evolution of the monitoring and observability industry, the role that InfluxDB plays and a look at how one customer is using InfluxDB in their solution. Balaji Palani Sr. Director of Product Management, InfluxData Balaji Palani is the Senior Director of Product Management focused on InfluxDB Cloud. He is passionate about building powerful cloud products that help Developers achieve the fastest time to awesome. Use Case: Monitoring / Observability Brian Gilmore Director of IoT and Emerging Technologies, InfluxData Brian Gilmore is Director of IoT and Emerging Technology at InfluxData. He has worked with organizations to drive the unification of industrial and enterprise IoT with machine learning, cloud, and other technologies
  • 5. Agenda 1. Evolution of monitoring 2. How customers are using InfluxDB for monitoring 3. Customer implementations
  • 6. Use Case Categories IoT Monitoring Developer Tools Real-time Analytics Industrial Enterprise Consumer DevOps Networks Security Cloud Applications APIs Gaming Renewable Energy FinTech Crypto
  • 7. Metrics, Events, and Traces Usually derived through sampling, usually numeric, and typically regular in period. Usually emitted, on-event or on-exception. Can be either numeric or strings. Irregular period by nature. Bundled and uniquely labeled collections of related metrics and events related to a specific transaction or interaction. Irregular period and explicit duration. Metrics Events Traces
  • 8. How They Relate Metrics (one/sec): Events (varied): Traces (bundled): 12s 3s 8.26s Condition 1 Condition 2 Condition 3 Condition 4 Trace ID: 86ef2836-58fe-4a2e-ba69-3de4596072fd duration 37 seconds 6s
  • 9. InfluxData Reference Architecture Data Sources Application Workflows Infrastructure Insights Telegraf Client Libraries HTTP Syslog Kubernetes Apache Kafka Python Arduino Node.js JavaScript Go Data Systems Mobile apps Web apps Cloud Services Devices Sensors Databases Networks Message Queues APIs IoT Platforms CRMs InfluxDB Platform IoT Actions InfluxDB Purpose-Built Time Series Database Visualization, Query & Task Engine Collect Downsample Trigger Alert Transform … 300+ Plugins 14+ Languages … Native Ecosystems JMeter NiFi AWS Kinesis Azure Event Hubs GCP PubSub Java .NET/C# PHP Ruby Vector Fluentd Scrapers Native Collectors
  • 10. Reference Architecture Detail DevOps Monitoring with InfluxData Data Sources Integrations Applications/Services • Web Application Infrastructure • Containers • Message Brokers • Databases • K8S • Custom microservices • Network Instrumentation • Customer facing web applications • Customer facing mobile apps Devices/Infrastructure • Mobile Apps • Web Apps • APIs • Message Queues • Ecosystem Devices (Connectivity, coordination ie Alexa) Telegraf • AMQP • Active MQ • Amazon Cloudwatch • Amazon Kinesis • Kafka • Docker • Azure Event Hub • ExecD • GCP Pub/Sub • HTTP • Jenkins • Kernel • Kubernetes • MQTT Consumer • NATS Consumer • NGINX • OpenTelemetry • Redis Client Libraries • Java • .NET/C# 14+ Languages 300+ Plugins • Product quality • Process optimization • Code integration • Testing and load balancing • Deployment optimization • Error handling • Monitoring Analytics • Alerting Frameworks • Go • JavaScript Applications & Use Cases InfluxDB Purpose-Built Time Series Database Visualization, Query & Task Engine Collect Transform Downsample Trigger Workflows Alert
  • 11.
  • 12. SLO PLATFORM Translate Observability Data into Clear Action Roadmap Decisions Justifying Tech Investments & Cloud Spend On Call Alerts & Interruptions OBSERVABILITY DATA SOURCES Normalized Service Level Objectives (SLOs) across multiple data sources: ● Quantified Customer Expectations ● Tech Debt & Service Delivery Risks ● Define Clear Trade-offs in Service Management
  • 13. Deployment Optimization Reference Architecture DevOps Monitoring with InfluxData Error Handling Sources CI/CD Pipelines Cloud Services Containers Kubernetes (K8S) Mobile apps Web apps Networking System Stats (CPU, Memory) Microservices InfluxDB Purpose-Built Time Series Database Visualization, Query & Task Engine Telegraf Client Libraries • HTTP • Syslog • Kubernetes • Apache Kafka • AWS Kinesis • Azure Event Hubs • GCP PubSub 300+ Plugins • Java • Go • .NET/C# • JavaScript • Node.js • Python • Arduino • PHP • Ruby 12+ Languages Data Types APIs Application performance Metrics Infrastructure metrics Business transaction metrics Service adoption metrics Collect Transform Downsample Trigger Workflows Alert • Product quality • Process optimization • Code integration • Testing and load balancing • Deployment optimization • Error handling • Monitoring Analytics • Alerting Frameworks Applications & Use Cases
  • 14.
  • 15. Nobl9 Architecture - Black Box View Error Budgets Web App API InfluxDB PM & Business Stakeholders YAML GUI A l e r t P r i o r i t i z e Raw SLIs SLO Config Ops/SREs & Application Leads Govern Align New Relic Prometheus Datadog Calculations Customer Platforms and Services App CI/CD Web Services Data GitOps SLO Based Events & Alerts Graphs Reports Review & Align Review & Align
  • 16. Calculation of SLO time series Nobl9 Calculation Architecture ● Rearchitected into custom code and Kafka ○ FIFO calculation approach ○ Maintains state, uses object storage as a backing store ○ Scales horizontally Processing of telemetry data (SLIs) and math
  • 18. T H A N K Y O U