This document presents ways to optimize Java application code that applies the Producer Consumer design pattern for use with Microservices, showcasing real-world examples from our own experience with Dynatrace server code, and presenting specific ideas, guidelines, and techniques that can be applied to architecting Java applications for improved modularity.

1. 1 #DynatraceCOMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Asad Ali, @AsadThoughts
Java-Based Microservices

2. 2 #DynatraceCOMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Topics
• Overview of Producer Consumer
Pattern
• Usage of Producer Consumer Pattern
@ Dynatrace AppMon
• Microservices & Producer Consumer
Pattern

3. 3 #Dynatrace
Producer Consumer 2
Consumer 1
Consumer N
Work Queue
Producer Consumer Pattern

4. 4 #Dynatrace
Producer Consumer 2
Consumer 1
Consumer N
Collection
Work Queue
Producer Consumer Pattern

5. 5 #DynatraceCOMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Producer Consumer @
Dynatrace AppMon

6. 6 #Dynatrace
Dynatrace AppMon Architecture
Java/
.NET
PurePath
Collector
dynaTrace
Server
Web Server/
PHP
C++, VB,
ADK
MQ/ESB

7. 7 #Dynatrace
Metrics sent by agents
Visits

8. 8 #Dynatrace
Producer Consumer 2
Consumer 1
Consumer N
Visit Store Collection
Work QueueCorrelation Engine
Real Time Analyzer
Producer Consumer Within AppMon

9. 9 #Dynatrace
Producer Consumer 2
Consumer 1
Consumer N
Visit Store Collection
Work Queue
Work Queue
Getting Full
Problem Symptom

10. 10 #Dynatrace
Individual Transaction View

11. 11 #Dynatrace
Individual Transaction View

12. 12 #Dynatrace
46 threads are in
Wait state
Thread Dump Analysis

13. 13 #Dynatrace
Performance Report

14. 14 #Dynatrace
Code Snippet
public synchronized void add(Visit visit) {
Objects.requireNonNull(visit);
super.add(visit);
}
public synchronized Visit get(int visitId) {
return super.get(visitId);
}

15. 15 #Dynatrace
Code Snippet
public synchronized void add(Visit visit) {
Objects.requireNonNull(visit);
super.add(visit);
}
public synchronized Visit get(int visitId) {
return super.get(visitId);
}
Exclusive lock on visit
store caused consumers
to wait on each other

16. 16 #Dynatrace
Optimized Code
public Visit get(int visitId) {
final ReadLock readLock = rrwl.readLock();
readLock.lock();
try {
return super.get(visitId);
} finally {
readLock.unlock();
}
}

17. 17 #Dynatrace
Optimized Code
public void add(Visit visit) {
Objects.requireNonNull(visit);
final WriteLock writeLock = rrwl.writeLock();
writeLock.lock();
try {
size.incrementAndGet();
super.add(visit);
} finally {
writeLock.unlock();
}
}

18. 18 #Dynatrace
Performance Report - Optimized

19. 19 #Dynatrace
Performance Report - Optimized

20. 20 #Dynatrace
Individual Transaction View - Optimized

21. 21 #Dynatrace
Individual Transaction View - Optimized

22. 22 #Dynatrace

23. 23 #Dynatrace
Lesson #1
Analyze response time of your
transactions

24. 24 #Dynatrace
Lesson #2
Parallelize reads

25. 25 #Dynatrace
Lesson #3
Compare before and after
response time and throughput

26. 26 #Dynatrace
Microservices & Producer
Consumer Pattern

27. 27 #Dynatrace
Producer Consumer 2
Consumer 1
Consumer N
Work Queue
Producer Consumer Pattern

28. 28 #Dynatrace
JVM1
JVM
Producer
JMS
Producer Consumer With Microservices
Consumer 1
JVM2
Consumer 2
JVMn
Consumer N

29. 29 #Dynatrace
Producer Consumer With Microservices
JMS JVM1
Consumer 1
JVM
Producer
JVM2
Consumer 2
JVMn
Consumer N

30. 30 #Dynatrace
Monolithic Application

31. 31 #Dynatrace
2.68s Load Time
Monolithic Application

32. 32 #Dynatrace
2.68s Load Time
94.09% CPU
Bound
Monolithic Application

33. 33 #Dynatrace
Can‘t scale vertically endlessly!
2.68s Load Time
94.09% CPU
Bound
Monolithic Application

34. 34 #Dynatrace
Frontend
to Cloud
Scale Backend
in Containers!
Service Approach

35. 35 #Dynatrace
Go Live - 7am

36. 36 #Dynatrace
Go Live - 12pm

37. 37 #Dynatrace
What Went Wrong?

38. 38 #Dynatrace
26.7s Load Time
5kB Payload
Single Search Query End-to-End

39. 39 #Dynatrace
26.7s Load Time
5kB Payload
33! Service Calls
99kB - 3kB for each call!
Single Search Query End-to-End

40. 40 #Dynatrace
26.7s Load Time
5kB Payload
33! Service Calls
99kB - 3kB for each call!
Architecture Violation
Direct access to DB from frontend service
Single Search Query End-to-End

41. 41 #Dynatrace
26.7s Load Time
5kB Payload
33! Service Calls
99kB - 3kB for each call!
171!Total SQL Count
Architecture Violation
Direct access to DB from frontend service
Single Search Query End-to-End

42. 42 #Dynatrace
The Fixed End-to-End Use Case
“Re-Architect” vs “Migrate” to Service-Orientation
2.5s (vs 26.7)
5kB Payload

43. 43 #Dynatrace
The Fixed End-to-End Use Case
“Re-Architect” vs “Migrate” to Service-Orientation
2.5s (vs 26.7)
5kB Payload
1! (vs 33!) Service Call
5kB (vs 99) Payload!

44. 44 #Dynatrace
The Fixed End-to-End Use Case
“Re-Architect” vs “Migrate” to Service-Orientation
2.5s (vs 26.7)
5kB Payload
1! (vs 33!) Service Call
5kB (vs 99) Payload!
3!(vs 177) Total
SQL Count

45. 45 #Dynatrace

46. 46 #Dynatrace
Lesson #1
JMS JVM1
Consumer 1
JVM
Producer
JVM2
Consumer 2
JVMn
Consumer N
Pay attention to dependencies
when using Microservices

47. 47 #Dynatrace
Lesson #2
Measure inter-tier communication
time for every transaction

48. 48 #Dynatrace
Asad Ali
Product Specialist
@AsadThoughts
http://blog.dynatrace.com
http://bit.ly/dtpersonal

49. 49 #Dynatrace
Over To You
• Power of producer consumer pattern
• Parallelize your reads
• Measure before and after
• Affect of Inter-tier communication in
Microservices
• Do not ignore dependencies