Discover how observability and OpenTelemetry offer unprecedented solutions for both CI/CD administrators and dev teams to troubleshoot CI platforms and solve much more problems thanks to a vibrant community and a growing ecosystem. We will see with real life CI/CD pipelines using Jenkins, Maven, and Ansible how OpenTelemetry offers unprecedented solutions to troubleshoot software delivery pipelines. How the open source and standard nature of OpenTelemetry enables the emergence of a vibrant ecosystem of OpenTelemetry aware CI/CD tools to observe the entire software supply chain and help DevOps teams solve problems that go way beyond the observability use cases we have in mind. https://community.cncf.io/events/details/cncf-cloud-native-canada-presents-november-2021-eastern-canadian-cncf-meetup-kubernetes-123-release-update-and-cicd-observability/

1. Embracing Observability in CI/CD
with OpenTelemetry
Cyrille Le Clerc
Director of Product Management

2. Cyrille Le Clerc
● Product Manager @ Elastic
● Ex CloudBees / Jenkins
● Open source contributor at night
○ Jenkins Otel plugin
○ Maven Otel extension

3. Agenda
● Why Observability for CI/CD
● Demo
● What is OpenTelemetry
● Observability Capabilities
● Troubleshooting
● Demo
● Use cases
● Community
● Getting started
● Learn more

4. Why Observability for CI/CD
● Is business critical
● Requires continuous changes
● Requires high & dynamic scalability
● Is hard to keep up & running
⇒ Tension: stability vs. innovation
● Combines many tools from many
ecosystems
● World of “unknown unknowns”

5. ● Is business critical
● Requires continuous changes
● Requires high & dynamic scalability
● Is hard to keep up & running
⇒ tension: stability vs. innovation
● Combines many tools from many
ecosystems
● World of “unknown unknowns”
Why Observability for CI/CD

6. Solution based on
● Open standard to connect
communities and ecosystems
● Traces: model CI/CD pipelines
● Metrics and dashboards: MTTF…
● Logs: traceability and
troubleshooting
OpenTelemetry to the rescue of CI/CD!
Why Observability for CI/CD

7. ● Demo Jenkins Maven OpenTelemetry
Demo

8. ● CNCF project
● Standardisation of observability and monitoring
○ Semantic conventions (ie. common schema)
○ APIs
○ Protocol
○ Implementations: SDKs, agents and collector
● Unification
○ All layers: infrastructure, application, and user experience
○ All signals: traces, metrics, and logs
What is
OpenTelemetry

9. Leverage capabilities of Observability tools
● Look at individual builds, at pipelines, or
broader
● Slice and dice in any dimension
● Use automated anomaly detection
● Use monitoring
● Use alerting
CI/CD Observability
Capabilities

10. Troubleshooting build agent issues
● E.g. network, dynamic provisioning...
● Impact only one pipeline, or everybody?
CI/CD
Troubleshooting
Agent Allocation: Linux
Github checkout

11. ● Demo Jenkins Maven OpenTelemetry
● Verify on one build
● Slice and dice in any dimension
Demo

12. ●
Demo architecture

13. ● Monitor & troubleshoot CI/CD
platforms
● Troubleshoot pipelines
● Optimize pipelines, flaky tests...
● Developer education
● Software delivery process
monitoring
● Cost accounting
● ...
Growing number of
use cases

14. ● CI platforms: Jenkins,
ConcourseCI
● Build tools: Maven
● Unit tests: go test, Junit,
Selenium
● Deployment: Ansible
● Swiss Army knife: otel-cli
● ...
Growing community

15. ● Choose an Observability
backend
● [install an OpenTelemetry
Collector]
● Add plugins / extensions to your
CI/CD & DevOps tools
Getting started

16. ● Integrations
○ Jenkins OpenTelemetry
○ Concourse CI OpenTelemetry
○ Maven OpenTelemetry
○ Ansible OpenTelemetry
○ otel-cli for shell integrations
● Videos, podcasts and presentation
○ Ship It! Podcast - OpenTelemetry in your
CI/CD
○ DevOps World 2021: Embracing Observability
in Jenkins with OpenTelemetry
○ DevOps World 2021: Observing the CI/CD in
Practice
○ Tracing Your Jenkins Pipelines With
OpenTelemetry and Jaeger
Learn more

17. Questions?