KCD Italy presentation

1. Cloud Native resiliency patterns
from the ground up
Ana-Maria Mihalceanu

2. Hello! I am Ana
Java Champion, Certified Architect
Developer Advocate @ RedHat
“Control” enthusiast
@ammbra1508

3. ”Delay is the deadliest form of
denial.”
@ammbra1508
C. Northcote Parkinson

4. What is resilience?
@ammbra1508
Normal Behaviour
Faulty Behaviour
Unexpected event occurs
Unexpected
condition occurs
Degraded Mode
Behaviour
Feedback control mitigates
malfunction
Recovery control restores expected behaviour
Detection control recognizes malfunction

5. What is resilience?
@ammbra1508
Normal Behaviour
Faulty Behaviour
Unexpected event occurs
Unexpected
condition occurs
Degraded Mode
Behaviour
Feedback control mitigates
malfunction
Recovery control restores expected behaviour
Detection control recognizes malfunction

6. Where to start?
@ammbra1508
Source: https://martinfowler.com/bliki/CircuitBreaker.html

7. Resilience is in details
@ammbra1508

8. Using Proxies for
Infrastructure Resilience
@ammbra1508

9. Available Patterns
@ammbra1508
Load Balancing Circuit breaking,
retries and deadlines
Load Shedding
Service
discovery

10. Locality load balancing and Failover
@ammbra1508

11. Locality load balancing and Failover
@ammbra1508

12. Circuit breaker with Istio
@ammbra1508

13. Failover with Skupper
@ammbra1508

14. ” Load shedding drops some proportion of
load by dropping traffic as the server
approaches overload conditions.”
@ammbra1508
source: Site Reliability Engineering book

15. Rate limiting with TokenBucket
@ammbra1508

16. Rate limiting with TokenBucket
@ammbra1508

17. Rate limiting with TokenBucket
@ammbra1508

18. Rate limiting with TokenBucket
@ammbra1508

19. Concurrency Control based on
request priority
@ammbra1508

20. Concurrency Control based on
request priority
@ammbra1508

21. Tailor Autoscaling
@ammbra1508

22. Interplay autoscaling with load shedding
@ammbra1508
Autoscaling condition
Workload increases
Load shedding reduces
resource stress
Increased
traffic
continues
Load shedding
stops
Yes
No
Trigger
autoscaling

23. @ammbra1508
Code made available at
https://github.com/ammbra/resilience

24. Extra Resources
@ammbra1508

25. dn.dev/istio-istiobook dn.dev/k8spatterns1

26. Download