The document provides an overview and summary of a presentation titled "Camel riders in the cloud" given at Red Hat DevNation Live in March 2018. The presenter is a senior principal software engineer at Red Hat and long-time committer to the Apache Camel project. The presentation discusses how Apache Camel can be used for distributed integration in microservices and containerized architectures running in the cloud. It outlines best practices for running Camel in containers, including keeping Camel components small, stateless, and using configuration management. Fault tolerance, health checks, Enterprise Integration Patterns, and distributed tracing are also covered.

1. Camel riders in the cloud
Red Hat DevNation Live
March 2018

2. About me
● Senior Principal Software Engineer at Red Hat
● 9 years as full time Apache Camel committer
● Author of Camel in Action books
● Based in Denmark, Europe Blog:
http://www.davsclaus.com
Twitter: @davsclaus
Linkedin: davsclaus
E-Mail: cibsen@redhat.com

3. System Integration

4. Integration Framework

5. PATTERN BASED INTEGRATION
200+
COMPONENTS
Batch, messaging,
web services, cloud,
APIs, and more ...
BUILT-IN DATA
TRANSFORMATION
JSON, XML, HL7,
YAML, SOAP, Java,
CSV, and more ...
INTUITIVE
ROUTING
Develop
integrations
quickly in Java or
XML.
ENTERPRISE
INTEGRATION
PATTERNS
Build integrations
using enterprise best
practices.
Create, connect,
and compose APIs
with ease.
NATIVE REST
SUPPORT
Apache Camel, a powerful pattern-based integration engine with a comprehensive
set of connectors and data formats to tackle any integration problem.

6. Enterprise Integration Patterns

7. Enterprise Integration Patterns

8. Camel Routes
from("file:data/inbox")
.to("jms:queue:order");
<route>
<from uri="file:data/inbox"/>
<to uri="jms:queue:order"/>
</route>
Java DSL
XML DSL

9. Camel Architecture

10. Camel runs everywhere
Application Servers Linux Containers

11. Camel connects everything
Legacy Systems
● File
● FTP
● JMS
● JDBC
● SQL
● TCP/UDP
● Mail
● HDFS
● JPA
● MongoDB
● ...
Public Cloud
● AWS
○ S3
○ SQS
○ Kinesis
○ ...
● Google
○ Bigquery
○ Pubsub
● Azure
○ Blob
○ Queue
● Box /
Dropbox
● Facebook
● Linkedin
● Salesforce
● SAP
● ServiceNowIoT
● CoAP
● MQTT
● PubNub
SaaS

13. +

14. +
+

15. +
+
+

16. +
+
+
=

17. What about Camel in the Cloud?

18. Monolith
MyApp
@burrsutter

19. Microservices
@burrsutter

20. Microservices
@burrsutter

21. Microservices
@burrsutter

22. Microservices
@burrsutter

23. Microservices
@burrsutter

24. Microservices
@burrsutter

25. Network of Services
@burrsutter

26. Container
JVM
Service C
Microservices == Distributed Computing
@burrsutter
Container
JVM
Service B
Container
JVM
Service A

27. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Microservices'ilities
@burrsutter

28. @burrsutter

29. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Microservices'ilities + Kubernetes
@burrsutter

30. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Microservices'ilities + OpenShift
@burrsutter

31. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Microservices'ilities + Istio
@burrsutter

32. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Microservices'ilities + 3scale
@burrsutter

33. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
But where is Camel?
@burrsutter

34. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
But where is Camel?
@burrsutter
embedded in
your (Java)
services

35. Container
JVM
Service C
Microservices == Distributed Integration
@burrsutter
Container
JVM
Service B
Container
JVM
Service A

36. Container
JVM
Service C
Microservices == Distributed Integration
@burrsutter
Container
JVM
Service B
Container
JVM
Service A
Legacy

37. 37
THE THREE PILLARS OF AGILE INTEGRATION
Key foundational capabilities needed by today’s enterprises
DISTRIBUTED
INTEGRATION
-LIGHTWEIGHT
-PATTERN BASED
-EVENT ORIENTED
-COMMUNITY SOURCED
CONTAINERS
- CLOUD NATIVE SOLUTIONS
-LEARN ARTIFACTS,
INDIVIDUALLY DEPLOYABLE
- CONTAINER BASED
SCALING AND HIGH
AVAILABILITY
APIs
-WELL DEFINED, REUSABLE,
AND WELL MANAGED
END-POINTS
-ECOSYSTEM LEVERAGE
FLEXIBILITY SCALABILITY RE-USABILITY

38. Camel in the cloud

39. Best Practice - Small in Size
● Camel is light-weight
○ (camel-core 4mb)
● Add only Camel component you need
● Single fat-jar via
○ Spring Boot
○ WildFly-Swarm
○ Vert.X
○ etc.

40. Best Practice - Stateless
● Favour stateless applications
● If state is needed:
○ Data-grid
■ camel-infinispan
■ camel-hazelcast
■ camel-ignite
■ ...
○ Database
■ camel-sql
■ camel-jpa
■ ...
○ Kubernetes Stateful-set

41. Best Practice - Configuration Management
● Kubernetes ConfigMap
○ Inject via ENV
○ Inject via files
● Kubernetes Secrets
○ Inject via ENV
○ Inject via files
○ Inject via files on classpath
$ oc get cm -o yaml my-configmap
apiVersion: v1
data:
fallback: I still got no response
kind: ConfigMap

42. Best Practice - Fault Tolerant
● Camel Retry
○ onException
○ errorHandler
● Camel Hystrix
○ circuit breaker

43. Best Practice - Fault Tolerant
● Camel Retry
○ onException
○ errorHandler
Thundering Herd Problem

44. Best Practice - Health Checks
● Health Checks
○ camel-spring-boot actuator
○ wildfly-swarm monitor
● Readiness Probe
○ Kubernetes
● Liveness Probe
○ Kubernetes

45. ● Works anywhere
Best Practice - EIP Patterns

46. EIP Cloud Patterns Service Call
from("timer")
.serviceCall("hello-service");
Plugins
● Kubernetes
● Ribbon
● Consul
● Etcd
● Zookeeper

47. EIP Cloud Patterns Hystrix EIP
from("timer:foo")
.hystrix()
.to("http:myservice")
.onFallback()
.to("bean:fallback")
.end()

48. EIP Cloud Patterns Distributed
Tracing

49. MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity
Usable Camel capabilities
@burrsutter
Camel Retry
Camel Hystrix
Camel Zipkin
Camel OpenTracing
Camel Rest / Rest DSL
Camel
Connectors

50. Demo Time

51. Basic Demo

52. More Information
● Slides and Demo source code:
https://github.com/davsclaus/camel-riders-in-the-cloud
● Apache Camel website:
http://camel.apache.org
● Best "What is Apache Camel" article:
https://dzone.com/articles/open-source-integration-apache
● My blog:
http://www.davsclaus.com
● DevNation Live
https://developers.redhat.com/devnationlive

53. Camel in Action 2nd edition
● Discount code (40%):
ctwdevnatlive18
(ordering from Manning)
● Free samples of the book:
https://developers.redhat.com/books/selections-camel-action
https://www.manning.com/books/camel-in-action-second-edition

54. Q & A