Datadog- Monitoring In Motion

•

4 gefällt mir•1,418 views

C

Cloud Native Apps SF

Challenges in monitoring Kubernetes and Containers

Monitoring In Motion
Challenges in Monitoring Kubernetes & Containers
Cloud Native SF Meetup
Feb 25, 2016
Ilan Rabinovitch
Director, Community
Datadog

About Me
● Long time Datadog user.
● Prior to Datadog built automation and
monitoring tooling at Ooyala and
Edmunds.com
● SCALE and TXLF Co-Founder
Ilan Rabinovitch
Datadog
ilan@datadoghq.com
@irabinovitch

Agenda
• Monitoring 101 - Crash Course
• Challenges in Monitoring Dynamic Infrastructure
• Demo Time
• Questions?

Monitoring Everything

@honest_update on Twitter

Quick Overview of Datadog
• Monitoring for modern applications.
• Time series storage of metrics and events.
• Trending, alerting and anomaly detection.
• Hundreds of integrations out of the box.

Monitoring 101: Categorization
More at: http://goo.gl/t1Rgcg

Monitoring 101: Focus on symptoms
More at: http://goo.gl/t1Rgcg

Recurse until you find root cause.
More at: http://goo.gl/t1Rgcg

Container Monitoring Challenges

https://www.datadoghq.com/docker-adoption/

Operational Complexity
•Average containers per host: N
(N=4, 10/2015)
•N-times as many “hosts” to manage
•Affects everything

Operational Complexity: Scale
100
instances
400
containers

Operational Complexity: Scale
160
metrics per host
640
metrics per host

Operational Complexity: Scale
100
instances
64,000
metrics

Host Centric vs Service Centric

Host Centric vs Service Centric

Query Based Monitoring
…
… …

•Use tags, labels, etc on your hosts and metrics.
•Pull in existing labels from your infrastructure (Region, Docker Images,
K8S Tags..)
Query Based Monitoring
By using tags, auto-adapt!

Where is my application running ?
What’s the total throughput of App X ?
What’s its response time per tag ? (pod, version, DC)
What’s the distribution of 5xx from Nginx per pod ?

Auto Discovery

Docker API Kubelet API
Monitoring Agent
Container
A O A O
A
O
Application Container
Off-The-Shelf Application (Redis,
PostgreSQL, …)
Containers List
Metadata
Additional Metadata
(Pod names, RC, …)
Config Backend
Integration Configurations
Host Level
Metrics

Some Pictures
Dashboards and Metrics Alerts
Sharing

Demo time

Weitere ähnliche Inhalte

Was ist angesagt?

Inside the InfluxDB storage engine

Inside the InfluxDB storage engine

Inside the InfluxDB storage engine

Api observability

Api observability

Api observability

Building an Observability platform with ClickHouse

Building an Observability platform with ClickHouse

Building an Observability platform with ClickHouse

Producer Performance Tuning for Apache Kafka

Producer Performance Tuning for Apache Kafka

Producer Performance Tuning for Apache Kafka

Server monitoring using grafana and prometheus

Server monitoring using grafana and prometheus

Server monitoring using grafana and prometheus

Kubernetes at Datadog the very hard way

Kubernetes at Datadog the very hard way

Kubernetes at Datadog the very hard way

Laurent Bernaille

Discover how observability and OpenTelemetry offer unprecedented solutions for both CI/CD administrators and dev teams to troubleshoot CI platforms and solve much more problems thanks to a vibrant community and a growing ecosystem. We will see with real life CI/CD pipelines using Jenkins, Maven, and Ansible how OpenTelemetry offers unprecedented solutions to troubleshoot software delivery pipelines. How the open source and standard nature of OpenTelemetry enables the emergence of a vibrant ecosystem of OpenTelemetry aware CI/CD tools to observe the entire software supply chain and help DevOps teams solve problems that go way beyond the observability use cases we have in mind. https://community.cncf.io/events/details/cncf-cloud-native-canada-presents-november-2021-eastern-canadian-cncf-meetup-kubernetes-123-release-update-and-cicd-observability/

Embracing Observability in CI/CD with OpenTelemetry

Embracing Observability in CI/CD with OpenTelemetry

Embracing Observability in CI/CD with OpenTelemetry

Cyrille Le Clerc

The Patterns of Distributed Logging and Containers

The Patterns of Distributed Logging and Containers

The Patterns of Distributed Logging and Containers

SATOSHI TAGOMORI

Airflow at lyft for Airflow summit 2020 conference

Airflow at lyft for Airflow summit 2020 conference

Airflow at lyft for Airflow summit 2020 conference

InfluxDB is the purpose-built time series platform. Its high ingest capability makes it perfect for collecting, storing and analyzing time-stamped data from sensors — down to the nanosecond. The InfluxDB platform has everything developers need: the data collection agent, the database, visualization tools, and data querying and scripting language. Join this webinar as Brian Gilmore provides a product overview; he will also deep-dive with some helpful tips and ticks. Stick around for a live demo and Q&A time. Join this webinar as Brian Gilmore dives into: The basics of time series data and applications A platform overview — learn about InfluxDB, Telegraf, and Flux InfluxDB use case examples — start collecting data at the edge and use your preferred IoT protocol (i.e. MQTT)

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Fluentd v1.0 in a nutshell

Fluentd v1.0 in a nutshell

Fluentd v1.0 in a nutshell

Everyone wants observability into their system, but find themselves with too many vendors and tools, each with its own API, SDK, agent and collectors. In this talk I will present OpenTelemetry, an ambitious open source project with the promise of a unified framework for collecting observability data. With OpenTelemetry you could instrument your application in a vendor-agnostic way, and then analyze the telemetry data in your backend tool of choice, whether Prometheus, Jaeger, Zipkin, or others. I will cover the current state of the various projects of OpenTelemetry (across programming languages, exporters, receivers, protocols), some of which not even GA yet, and provide useful guidance on how to get started with it.

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

DevOpsDays Tel Aviv

Every day Netflix streams 125 million hours of video to 80 million subscribers in 130 countries. Delivering new features daily at a global scale requires an engineering-oriented culture that moves fast and innovates faster. The developer tools team at Netflix faces unique technical and cultural challenges deploying tools designed for a wide audience to teams with very specific needs. In this talk we’ll explore: The forces that drive a centralized team in a decentralized organization. The diverse needs of our very technical user base. The pace of innovation and the ever-constant need for change. The complexities of support and automation that facilitates the process. Products covered: Bitbucket

DevTools at Netflix: Culture, Speed & Innovation

DevTools at Netflix: Culture, Speed & Innovation

DevTools at Netflix: Culture, Speed & Innovation

PromQL Deep Dive - The Prometheus Query Language

PromQL Deep Dive - The Prometheus Query Language

PromQL Deep Dive - The Prometheus Query Language

Monitoring containerised apps creates a whole new set of challenges that traditional monitoring systems struggle with. In this talk, Brice Fernandes from Weaveworks will introduce and demo the open source Prometheus monitoring toolkit and its integration with Kubernetes. After this talk, you'll be able to use Prometheus to monitor your microservices on a Kubernetes cluster. We'll cover: - An introduction to Kubernetes to manage containers; - The monitoring maturity model; - An overview of whitebox and blackbox monitoring; - Monitoring with Prometheus; - Using PromQL (the Prometheus Query Language) to monitor your app in a dynamic system

Monitoring kubernetes with prometheus

Monitoring kubernetes with prometheus

Monitoring kubernetes with prometheus

Brice Fernandes

In this training webinar, Samantha Wang will walk you through the basics of Telegraf. Telegraf is the open source server agent which is used to collect metrics from your stacks, sensors and systems. It is InfluxDB’s native data collector that supports nearly 300 inputs and outputs. Learn how to send data from a variety of systems, apps, databases and services in the appropriate format to InfluxDB. Discover tips and tricks on how to write your own plugins. The know-how learned here can be applied to a multitude of use cases and sectors. This one-hour session will include the training and time for live Q&A.

Intro to Telegraf

Intro to Telegraf

Intro to Telegraf

****UPDATE: Project is now open sourced at https://www.github.com/industrydive/fileflow**** From Pydata DC 2016 Description Data warehousing and analytics projects can, like ours, start out small - and fragile. With an organically growing mess of scripts glued together and triggered by cron jobs hiding on different servers, we needed better plumbing. After perusing the data pipelining landscape, we landed on Airflow, an Apache incubating batch processing pipelining and scheduler tool from Airbnb. Abstract The power of any reporting tool breaks based on the data behind it, so when our data warehousing process got too big for its humble origins, we searched for something better. After testing out several options such as Drake, Pydoit, Luigi, AWS Data Pipeline, and Pinball, we landed on Airflow, an Apache incubating batch processing pipelining and scheduler tool originating from Airbnb, that provides the benefits of pipeline construction as directed acyclic graphs (DAGs), along with a scheduler that can handle alerting, retries, callbacks and more to make your pipeline robust. This talk will discuss the value of DAG based pipelines for data processing workflows, highlight useful features in all of the pipelining projects we tested, and dive into some of the specific challenges (like time travel) and successes (like time travel!) we’ve experienced using Airflow to productionize our data engineering tasks. By the end of this talk, you will learn - pros and cons of several Python-based/Python-supporting data pipelining libraries - the design paradigm behind Airflow, an Apache incubating data pipelining and scheduling service, and what it is good for - some epic fails to avoid and some epic wins to emulate from our experience porting our data engineering tasks to a more robust system - some quick-start tips for implementing Airflow at your organization.

How I learned to time travel, or, data pipelining and scheduling with Airflow

How I learned to time travel, or, data pipelining and scheduling with Airflow

How I learned to time travel, or, data pipelining and scheduling with Airflow

Slides from my presentation on distributed tracing, explaining what is latency and why it matters. We took a look at openzipkin and its concepts like how the core annotations works, what are tags/logs, etc. Followed by a demo application created using golang and java (spring boot , spring cloud sleuth zipkin) . You can find source code here https://github.com/nklmish/go-distributed-tracing-demo https://github.com/nklmish/java-distributed-tracing-demo

Distributed tracing - get a grasp on your production

Distributed tracing - get a grasp on your production

Distributed tracing - get a grasp on your production

Log analysis using elk

Log analysis using elk

Log analysis using elk

Red Hat OpenShift Operators - Operators ABC

Red Hat OpenShift Operators - Operators ABC

Red Hat OpenShift Operators - Operators ABC

Was ist angesagt? (20)

Inside the InfluxDB storage engine

Inside the InfluxDB storage engine

Inside the InfluxDB storage engine

Api observability

Api observability

Api observability

Building an Observability platform with ClickHouse

Building an Observability platform with ClickHouse

Building an Observability platform with ClickHouse

Producer Performance Tuning for Apache Kafka

Producer Performance Tuning for Apache Kafka

Producer Performance Tuning for Apache Kafka

Server monitoring using grafana and prometheus

Server monitoring using grafana and prometheus

Server monitoring using grafana and prometheus

Kubernetes at Datadog the very hard way

Kubernetes at Datadog the very hard way

Kubernetes at Datadog the very hard way

Embracing Observability in CI/CD with OpenTelemetry

Embracing Observability in CI/CD with OpenTelemetry

Embracing Observability in CI/CD with OpenTelemetry

The Patterns of Distributed Logging and Containers

The Patterns of Distributed Logging and Containers

The Patterns of Distributed Logging and Containers

Airflow at lyft for Airflow summit 2020 conference

Airflow at lyft for Airflow summit 2020 conference

Airflow at lyft for Airflow summit 2020 conference

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Best Practices: How to Analyze IoT Sensor Data with InfluxDB

Fluentd v1.0 in a nutshell

Fluentd v1.0 in a nutshell

Fluentd v1.0 in a nutshell

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

THE STATE OF OPENTELEMETRY, DOTAN HOROVITS, Logz.io

DevTools at Netflix: Culture, Speed & Innovation

DevTools at Netflix: Culture, Speed & Innovation

DevTools at Netflix: Culture, Speed & Innovation

PromQL Deep Dive - The Prometheus Query Language

PromQL Deep Dive - The Prometheus Query Language

PromQL Deep Dive - The Prometheus Query Language

Monitoring kubernetes with prometheus

Monitoring kubernetes with prometheus

Monitoring kubernetes with prometheus

Intro to Telegraf

Intro to Telegraf

Intro to Telegraf

How I learned to time travel, or, data pipelining and scheduling with Airflow

How I learned to time travel, or, data pipelining and scheduling with Airflow

How I learned to time travel, or, data pipelining and scheduling with Airflow

Distributed tracing - get a grasp on your production

Distributed tracing - get a grasp on your production

Distributed tracing - get a grasp on your production

Log analysis using elk

Log analysis using elk

Log analysis using elk

Red Hat OpenShift Operators - Operators ABC

Red Hat OpenShift Operators - Operators ABC

Red Hat OpenShift Operators - Operators ABC

Andere mochten auch

Scaling monitoring with Datadog

Scaling monitoring with Datadog

Scaling monitoring with Datadog

Containerization (à la Docker) is increasing the elastic nature of cloud infrastructure by an order of magnitude. If you have adopted Docker, or are considering it, you are probably facing questions like: - How many containers can you run on a given Amazon EC2 instance type? - Which metric should you look at to measure contention? - How do you manage fleets of containers at scale? Datadog’s CTO, Alexis Lê-Quôc, presents the challenges and benefits of running Docker containers at scale. Alexis explains how to use quantitative performance patterns to monitor your infrastructure at the new level of magnitude and increased complexity introduced by containerization.

Running & Monitoring Docker at Scale

Running & Monitoring Docker at Scale

Running & Monitoring Docker at Scale

When running any amount of systems, gaining visibility into what they are doing can be a non-trivial matter. Starting on the path to monitoring can prove bumpy, and if you don’t measure, you don’t know. In this session, Michael Fiedler, Director of TechOps, will speak on personal experience with scalability, deployment, and monitoring challenges prior to using Datadog - and how that changed. He will cover how to get started, and examples of where monitoring the company's platform with Datadog provided the guiding light towards the team solving scalability problems.

Why Visibility into Your Stack Matters

Why Visibility into Your Stack Matters

Why Visibility into Your Stack Matters

Amazon Web Services

Lifting the Blinds: Monitoring Windows Server 2012

Lifting the Blinds: Monitoring Windows Server 2012

Lifting the Blinds: Monitoring Windows Server 2012

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2l2Rr6L. Doug Daniels discusses the cloud-based platform they have built at DataDog and how it differs from a traditional datacenter-based analytics stack. He walks through the decisions they have made at each layer, covers the pros and cons of these decisions and discusses the tooling they have built. Filmed at qconsf.com. Doug Daniels is a Director of Engineering at Datadog, where he works on high-scale data systems for monitoring, data science, and analytics. Prior to joining Datadog, he was CTO at Mortar Data and an architect and developer at Wireless Generation, where he designed data systems to serve more than 4 million students in 49 states.

Elastic Data Analytics Platform @Datadog

Elastic Data Analytics Platform @Datadog

Elastic Data Analytics Platform @Datadog

Think you have big data? What about high availability requirements? At DataDog we process billions of data points every day including metrics and events, as we help the world monitor the their applications and infrastructure. Being the world’s monitoring system is a big responsibility, and thanks to Redis we are up to the task. Join us as we discuss how the DataDog team monitors and scales Redis to power our SaaS based monitoring offering. We will discuss our usage and deployment patterns, as well as dive into monitoring best practices for production Redis workloads

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

[Jaws tokyo] last minutes update- datadog

[Jaws tokyo] last minutes update- datadog

[Jaws tokyo] last minutes update- datadog

Naotaka Jay HOTTA

Andere mochten auch (7)

Scaling monitoring with Datadog

Scaling monitoring with Datadog

Scaling monitoring with Datadog

Running & Monitoring Docker at Scale

Running & Monitoring Docker at Scale

Running & Monitoring Docker at Scale

Why Visibility into Your Stack Matters

Why Visibility into Your Stack Matters

Why Visibility into Your Stack Matters

Lifting the Blinds: Monitoring Windows Server 2012

Lifting the Blinds: Monitoring Windows Server 2012

Lifting the Blinds: Monitoring Windows Server 2012

Elastic Data Analytics Platform @Datadog

Elastic Data Analytics Platform @Datadog

Elastic Data Analytics Platform @Datadog

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog

[Jaws tokyo] last minutes update- datadog

[Jaws tokyo] last minutes update- datadog

[Jaws tokyo] last minutes update- datadog

Ähnlich wie Datadog- Monitoring In Motion

DockerCon EU 2015: Monitoring Docker

DockerCon EU 2015: Monitoring Docker

DockerCon EU 2015: Monitoring Docker

10 tips for Cloud Native Security

10 tips for Cloud Native Security

10 tips for Cloud Native Security

Karthik Gaekwad

State of the Stack v4 - OpenStack in All It's Glory

State of the Stack v4 - OpenStack in All It's Glory

State of the Stack v4 - OpenStack in All It's Glory

DevOps is powering the computing environments of tomorrow. When properly configured, the Splunk platform allows us to gain real-time visibility into the velocity, quality, and business impact of DevOps-driven application delivery across all roles, departments, process, and systems. Splunk can be used by DevOps practitioners to provide continuous integration/deployment and the real-time feedback to help the organization with their operational intelligence. Join us for a exciting talk about Splunk’s current approach to DevOps, and for examples of how Splunk is being used by customers today to transform DevOps initiatives.

DevOps Powered by Splunk

DevOps Powered by Splunk

DevOps Powered by Splunk

This presentation shows how to be a pragmatic Android programmer by showing real examples of applications/products developed in BQ attending to three important topics: - Why and how to implement a pragmatic CLEAN architecture with a custom dependency injection framework and ReactiveX features. - Why and how to implement unit, integration, view and smoke tests in every CLEAN layer and what tools should be used. - Why and how to implement pragmatic Continuous Development/Testing/Integration/Delivery by showing several tricks, plugins and snippets that you could use as a daily basis.

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

Daniel Gallego Vico

DevSecOps in a cloudnative world

DevSecOps in a cloudnative world

DevSecOps in a cloudnative world

Karthik Gaekwad

Modern DevOps with Spinnaker - Olga Kundzich

Modern DevOps with Spinnaker - Olga Kundzich

Modern DevOps with Spinnaker - Olga Kundzich

Containers and microservices are two of the fastest-growing trends in technology, enabled by a modern approach to software development and deployment called DevOps. This talk will delve into the increasingly mainstream trend of DevOps, the Docker and containers ecosystem including current enterprise adoption, and how they combine to form a new style of software architecture dubbed microservices. We'll close by looking at real-world examples of containers and microservices architectures at leading-edge companies.

Microservices 101: From DevOps to Docker and beyond

Microservices 101: From DevOps to Docker and beyond

Microservices 101: From DevOps to Docker and beyond

Donnie Berkholz

Drupalcon Sessions about Devops

Drupalcon Sessions about Devops

Drupalcon Sessions about Devops

From 0 to DevOps in 80 Days Link to the webinar replay: https://info.dynatrace.com/apm_dtm_ops_17q3_wc_from_enterprise_tocloud_native_na_registration.html “Innovate or die” may sound extreme, but it’s the only way to thrive in today’s ever competitive market. Bernd Greifeneder, CTO of Dynatrace, wanted to ensure that the company was relevant 5 years from now so he formed an internal incubator with one goal: transform Dynatrace into a Cloud Native DevOps organization. The incubator focused on what the company needed to do in order to integrate nascent cloud technologies so that they wouldn’t be left in the dust when the inevitable tipping point to cloud arrives. Transforming into a cloud native company would allow for rapid release cycles and provide an embedded feedback loop. The Results: Dynatrace now has a 99.998% availability of SaaS Service and can deploy changes within an hour if necessary. In parallel, a new SaaS and managed offering is released every 2 weeks with 170 production updates per day. Watch this recorded webinar as Bernd Greifeneder shares the lessons learned moving Dynatrace from an on-prem company to one that is cloud native. Bernd discusses: • The driving factors that led to the transformation • The goals that were set back in 2011 towards the engineering team • How to sell such a transformation project in a large enterprise organization • How to support this multi-year project from top down without impacting regular operations • What's next on the innovator's mind

From 0 to DevOps in 80 Days [Webinar Replay]

From 0 to DevOps in 80 Days [Webinar Replay]

From 0 to DevOps in 80 Days [Webinar Replay]

Ship code like a keptn

Ship code like a keptn

Ship code like a keptn

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Tampere Docker meetup - Happy 5th Birthday Docker

Tampere Docker meetup - Happy 5th Birthday Docker

Tampere Docker meetup - Happy 5th Birthday Docker

At GOTO Amsterdam in 2019 I presented how to create an effective cloud native developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I'll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. In this talk, you will: - Learn why the core tenets of continuous delivery -- speed and safety -- must be considered in all parts of the cloud native SDLC - Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis - Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) - Explore the importance of cultivating an effective cloud platform and associated team of experts - Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

Cloud native development without the toil

Cloud native development without the toil

Cloud native development without the toil

Ambassador Labs

At GOTO Amsterdam in 2019 I presented how to create an effective cloud native developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I'll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. Join this talk to: Learn why the core tenets of continuous delivery -- speed and safety -- must be considered in all parts of the cloud native SDLC Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) Explore the importance of cultivating an effective cloud platform and associated team of experts Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

At a previous JAX event I talked about effective cloud native Java developer workflow. Two years later and many new developer technologies have come and gone, but I still hear daily from cloud developers about the pain and friction associated with building, debugging, and deploying to the cloud. In this talk I’ll share my latest learning on how to bring the fun and productivity back into delivering Kubernetes-based software. Join this talk to: Learn why the core tenets of continuous delivery — speed and safety — must be considered in all parts of the cloud native SDLC Explore how cloud native coding benefits from thinking separately about the inner development loop, continuous integration, continuous deployment, observability, and analysis Understand how cloud native best practices and tooling fit together. Learn about artifact syncing (e.g. Skaffold), dev environment bridging (e.g. Telepresence), GitOps (e.g. Argo), and observability-focused monitoring (e.g. Prometheus, Jaeger) Explore the importance of cultivating an effective cloud platform and associated team of experts Walk away with an overview of tools that can help you develop and debug effectively when using Kubernetes

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

Containers and Microservices for Realists

Containers and Microservices for Realists

Containers and Microservices for Realists

Oracle Developers

Containers and microservices for realists

Containers and microservices for realists

Containers and microservices for realists

Karthik Gaekwad

Ähnlich wie Datadog- Monitoring In Motion (20)

DockerCon EU 2015: Monitoring Docker

DockerCon EU 2015: Monitoring Docker

DockerCon EU 2015: Monitoring Docker

10 tips for Cloud Native Security

10 tips for Cloud Native Security

10 tips for Cloud Native Security

State of the Stack v4 - OpenStack in All It's Glory

State of the Stack v4 - OpenStack in All It's Glory

State of the Stack v4 - OpenStack in All It's Glory

DevOps Powered by Splunk

DevOps Powered by Splunk

DevOps Powered by Splunk

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

Droidcon Spain 2016 - The Pragmatic Android Programmer: from hype to reality

DevSecOps in a cloudnative world

DevSecOps in a cloudnative world

DevSecOps in a cloudnative world

Modern DevOps with Spinnaker - Olga Kundzich

Modern DevOps with Spinnaker - Olga Kundzich

Modern DevOps with Spinnaker - Olga Kundzich

Microservices 101: From DevOps to Docker and beyond

Microservices 101: From DevOps to Docker and beyond

Microservices 101: From DevOps to Docker and beyond

Drupalcon Sessions about Devops

Drupalcon Sessions about Devops

Drupalcon Sessions about Devops

From 0 to DevOps in 80 Days [Webinar Replay]

From 0 to DevOps in 80 Days [Webinar Replay]

From 0 to DevOps in 80 Days [Webinar Replay]

Ship code like a keptn

Ship code like a keptn

Ship code like a keptn

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Continuous Delivery to the Cloud: Automate Thru Production with CI + Spinnaker

Tampere Docker meetup - Happy 5th Birthday Docker

Tampere Docker meetup - Happy 5th Birthday Docker

Tampere Docker meetup - Happy 5th Birthday Docker

Cloud native development without the toil

Cloud native development without the toil

Cloud native development without the toil

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

GOTOpia 2/2021 "Cloud Native Development Without the Toil: An Overview of Pra...

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Cloud and Network Transformation using DevOps methodology : Cisco Live 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

Docker Usage Patterns - Meetup Docker Paris - November, 10th 2015

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

JAX London 2021: Jumpstart Your Cloud Native Development: An Overview of Prac...

Containers and Microservices for Realists

Containers and Microservices for Realists

Containers and Microservices for Realists

Containers and microservices for realists

Containers and microservices for realists

Containers and microservices for realists

Kürzlich hochgeladen

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

AWS Community Day CPH - Three problems of Terraform

AWS Community Day CPH - Three problems of Terraform

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

The Digital Insurer

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

HTML Injection Attacks: Impact and Mitigation Strategies

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Principled Technologies

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

Kürzlich hochgeladen (20)

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

presentation ICT roal in 21st century education

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

AWS Community Day CPH - Three problems of Terraform

AWS Community Day CPH - Three problems of Terraform

AWS Community Day CPH - Three problems of Terraform

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Manulife - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

HTML Injection Attacks: Impact and Mitigation Strategies

HTML Injection Attacks: Impact and Mitigation Strategies

HTML Injection Attacks: Impact and Mitigation Strategies

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Datadog- Monitoring In Motion

1. Monitoring In Motion Challenges in Monitoring Kubernetes & Containers Cloud Native SF Meetup Feb 25, 2016 Ilan Rabinovitch Director, Community Datadog

2. About Me ● Long time Datadog user. ● Prior to Datadog built automation and monitoring tooling at Ooyala and Edmunds.com ● SCALE and TXLF Co-Founder Ilan Rabinovitch Datadog ilan@datadoghq.com @irabinovitch

3. Agenda • Monitoring 101 - Crash Course • Challenges in Monitoring Dynamic Infrastructure • Demo Time • Questions?

4. Monitoring Everything

5.

6. @honest_update on Twitter

7. Quick Overview of Datadog • Monitoring for modern applications. • Time series storage of metrics and events. • Trending, alerting and anomaly detection. • Hundreds of integrations out of the box.

8. Monitoring 101: Categorization More at: http://goo.gl/t1Rgcg

9.

10. Monitoring 101: Focus on symptoms More at: http://goo.gl/t1Rgcg

11. Recurse until you find root cause. More at: http://goo.gl/t1Rgcg

12. Container Monitoring Challenges

13. https://www.datadoghq.com/docker-adoption/

14.

15.

16. Operational Complexity •Average containers per host: N (N=4, 10/2015) •N-times as many “hosts” to manage •Affects everything

17. Operational Complexity: Scale 100 instances 400 containers

18. Operational Complexity: Scale 160 metrics per host 640 metrics per host

19. Operational Complexity: Scale 100 instances 64,000 metrics

20.

21. Host Centric vs Service Centric

22. Host Centric vs Service Centric

23. Query Based Monitoring … … …

24. •Use tags, labels, etc on your hosts and metrics. •Pull in existing labels from your infrastructure (Region, Docker Images, K8S Tags..) Query Based Monitoring By using tags, auto-adapt!

25. Where is my application running ? What’s the total throughput of App X ? What’s its response time per tag ? (pod, version, DC) What’s the distribution of 5xx from Nginx per pod ?

26. Auto Discovery

27. Docker API Kubelet API Monitoring Agent Container A O A O A O Application Container Off-The-Shelf Application (Redis, PostgreSQL, …) Containers List Metadata Additional Metadata (Pod names, RC, …) Config Backend Integration Configurations Host Level Metrics

28. Some Pictures Dashboards and Metrics Alerts Sharing