Where's My Message? with David Navalho & Ricardo Henriques
Melden
HostedbyConfluentFolgen
2. Jun 2023•0 gefällt mir•112 views
Where's My Message? with David Navalho & Ricardo Henriques
2. Jun 2023•0 gefällt mir•112 views
Downloaden Sie, um offline zu lesen
Melden
Technologie
"Deploying and actively operating Kafka smoothly can be a daunting task. We've helped build systems from simple to complex, from data migration to near real-time streaming frameworks, from single clusters to multiple levels of self service. Multiple paths can lead to a successful deployment - this talk isn't about those. We will be sharing our experience about what comes after: what happens once data starts flowing in your system. And just how can we gain confidence everything is working correctly? Join us on a journey where we will share our hard-earned experience, as well as just how to tackle that dread question which just seems to keep popping up: ""where's my message?"" Did it ever reach Kafka? Can Kafka really lose a message? Is Kafka down? Expect to leave this session with additional knowledge, better operational solutions under your belt, ready to tackle your tenants and able of finding just where that ""lost message"" whereabouts are."
HostedbyConfluentFolgen
Recomendados
Go - A Key Language in Enterprise Application Development?C4Media
ApacheCon NA 2011 reportKoji Kawamura
OpenFaaS - zero serverless in 60 seconds anywhere with case-studiesAlex Ellis
Devopsdays State of the Union Amsterdam 2014 John Willis
Devops kc meetup_5_20_2013Aaron Blythe
Ionic in 30Ionic Framework
Más contenido relacionado
Similar a Where's My Message? with David Navalho & Ricardo Henriques
DevOps-ing the MainframeDevOps.com
Introduction to Cassandra and CQL for Java developersJulien Anguenot
Monkeys in Lab Coats: Applying Failure Testing Research @NetflixC4Media
Open-Source Project Tools for Corporate Projects?Bertrand Delacretaz
NLJUG speaker academy 2023 - session 1Bert Jan Schrijver
Your Goat Anti-Fragiled My SnowFlake! Demystifying DevOps JargonClinton Wolfe
Más de HostedbyConfluent
Chill, Distill, No Overkill: Best Practices to Stress Test Kafka with Siva Ku...HostedbyConfluent
Manage Consistent Configurations Across Multiple Kafka Environments with Naga...HostedbyConfluent
The Cost of Kafka’s High Availability on Cloud with Geetha AnneHostedbyConfluent
Case-Study: Building Real-Time Applications at Scale-Cyclist Crash Detection ...HostedbyConfluent
Migrating Your System to the Different Kafka Platforms Available wtih Bhavesh...HostedbyConfluent
Eliminating the Double Write Problem in Apache Kafka Using the Outbox Pattern...HostedbyConfluent
Último
Empowering City ClerksOnBoard
h2 meet pdf test.pdfJohnLee971654
Uber Clone Script - Keys to Understanding the Ride Hailing IndustryeSiteWorld TechnoLabs Pvt. Ltd.
Need for Speed: Removing speed bumps in API ProjectsŁukasz Chruściel
CamundaCon NYC 2023 Keynote - Shifting into overdrive with process orchestrationBernd Ruecker
Privacy in the era of quantum computersSpeck&Tech
Where's My Message? with David Navalho & Ricardo Henriques
- 1. Where’s My Message? David Navalho and Ricardo Henriques
- 2. David Navalho Head of Core Technologies Ricardo Henriques Lead DevOps Introduction
- 5. Incident Report OMG! Kafka is Down! Un-Sync Back-and-Forth Communication Broken Phone Time Consuming
- 6. Dashboards OMG! Kafka is Down! The end of Development and Deployment is not the end of Tests! Share Knowledge Incidents Knowledge Base
- 7. Kafka is Slow! Gonna get a cuppa, anyone?
- 9. Kafka is Slow! Dashboards Tests Share Knowledge Incidents Knowledge Base Reports Performance Tests
- 10. My topic is empty! Where are my messages?!
- 11. My topic is empty!
- 12. My topic is empty!
- 13. My topic is empty!
- 14. My topic is empty! Topics, Consumers, ACL, Connectors, … Resources information Centralised Logging Developer Knowledge Base Searchable Self-troubleshooting
- 15. Kafka deleted my messages! What?!
- 16. Kafka deleted my messages!
- 17. Kafka deleted my messages!
- 18. Kafka deleted my messages!
- 19. Kafka deleted my messages!
- 20. Kafka deleted my messages! Topic: retention: 7 days created: 4 months
- 21. Kafka deleted my messages! Topic: retention: 7 days created: 4 months Topic: retention: 7 days created: 4 months
- 22. Kafka deleted my messages! Topic: retention: 7 days created: 4 months Topic: retention: 7 days created: 4 months
- 23. Kafka deleted my messages! Topic: retention: 7 days created: 4 months Sink: created: 4 months Source: created: 4 months Topic: retention: 7 days created: 4 months
- 24. Kafka deleted my messages! Replicator: 7 days Topic: retention: 7 days created: 4 months Sink: created: 4 months Source: created: 4 months Topic: retention: 7 days created: 4 months
- 25. Kafka deleted my messages! Topics, Consumers, ACL, Connectors, … Resources information + history Search capabilities Lineage Knowledge Bases Keys, Messages, Headers Keep updating! Track connections, ownership
- 26. Where’s my message? When all else fails…
- 32. Where’s my message? Who owns/controls what Governance Build Trust Knowledge Bases Engage Keep updating! New Automations and Dashboards Learn the Use Cases to provide faster results
- 33. Recap and QA
- 34. Recap and QA Who owns/controls what Governance Build Trust Engage Keep updating! Dashboards Tests Reports Tailored views Share Status Broaden the scope outside development lifecycle Share Knowledge Centralised Logging Searchable Labs Experiment is key! If we spend all our time troubleshooting, our platform isn't improving but rather decaying!
- 35. Thank you Reach out! David Navalho Head of Core Technologies Ricardo Henriques Lead DevOps david-navalho ricardo7aires