Apache Pulsar is a cloud-native, distributed messaging and streaming platform. Apache SkyWalking is a popular application performance monitoring tool for distributed systems, specially designed for microservices, cloud-native, and container-based (Docker, K8s) architectures. When Apache SkyWalking meets Apache Pulsar, what will happen next? As we all know, message tracing is a good way that helps engineers troubleshoot problems related to messages publishing and receiving. In this talk, Sheng Wu and Penghui Li will walk through the features of Apache SkyWalking and Apache Pulsar, and run one step-by-step demo showing how to track Apache Pulsar messages by Apache SkyWalking.

1. Pulsar Virtual Summit Europe 2021
Tracking Apache Pulsar Messages
with Apache SkyWalking

2. Pulsar Virtual Summit Europe 2021

3. Pulsar Virtual Summit Europe 2021

4. Pulsar Virtual Summit Europe 2021
Tracing

5. Pulsar Virtual Summit Europe 2021

6. Pulsar Virtual Summit Europe 2021

7. Pulsar Virtual Summit Europe 2021

8. Pulsar Virtual Summit Europe 2021

9. Pulsar Virtual Summit Europe 2021
Logging

10. Pulsar Virtual Summit Europe 2021

11. Pulsar Virtual Summit Europe 2021

12. Pulsar Virtual Summit Europe 2021

13. Pulsar Virtual Summit Europe 2021

14. Pulsar Virtual Summit Europe 2021

15. Pulsar Virtual Summit Europe 2021

16. Pulsar Virtual Summit Europe 2021
Show How SkyWalking works with Pulsar

17. Pulsar Virtual Summit Europe 2021
- Publish messages
- Publish receipt
- Consume messages
- Consume message with listener mode
- Acknowledge messages (not supported yet)
- Negative acknowledgement (not supported yet)
Tracing Pulsar Messages

18. Pulsar Virtual Summit Europe 2021
Tracing Pulsar Messages

19. Pulsar Virtual Summit Europe 2021
- 2.2.x
- 2.3.x
- 2.4.x
- 2.5.x
- 2.6.x
- 2.7.x
Supported Pulsar version

20. Pulsar Virtual Summit Europe 2021
Enable the skywalking agent
-javaagent:/{skywalking_home}/agent/skywalking-agent.jar
-DSW_AGENT_NAME=<your-application-name>
More details to see
https://skywalking.apache.org/docs/skywalking-java/latest/en/setup/service
-agent/java-agent/readme/#setup-java-agent

21. Pulsar Virtual Summit Europe 2021
Introduce the demo
https://github.com/streamnative/skywalking-pulsar-demo
A simple web application for generating data to a topic and simulate 3
consumers to receive data from the topic with 3 different subscriptions
- The application start a web servlet with port 8088
- Exposing a REST endpoint for generating data (/demo/generate-data)
- The producer inside the application publishes a message once the
endpoint get called
- 3 consumers continues to consume data from the topic

22. Pulsar Virtual Summit Europe 2021
Introduce the demo
https://github.com/streamnative/skywalking-pulsar-demo

23. Pulsar Virtual Summit Europe 2021
Introduce the demo
https://github.com/streamnative/skywalking-pulsar-demo

24. Pulsar Virtual Summit Europe 2021
Introduce the demo
https://github.com/streamnative/skywalking-pulsar-demo

25. Pulsar Virtual Summit Europe 2021
Log integration
https://github.com/streamnative/skywalking-pulsar-demo

26. Pulsar Virtual Summit Europe 2021
Demo time ...
https://github.com/streamnative/skywalking-pulsar-demo
- Trace integration
- Log integration

27. Pulsar Virtual Summit Europe 2021
More in the future?
- Use Pulsar transport all SkyWalking data to server side
- Metrics of Pulsar server. Prometheus instrumented metrics could be
shipped into SkyWalking.
- Server logs collecting and analyze.
- Dashboards for Pulsar server clusters.

28. Pulsar Virtual Summit Europe 2021
Thank You