Data exchanges between companies increase a lot. The number of applications which must be integrated increases, too. The interfaces use different technologies, protocols and data formats. Nevertheless, the integration of these applications shall be modeled in a standardized way, realized efficiently and supported by automatic tests. Three integration frameworks are available in the JVM environment, which fulfil these requirements: Apache Camel, Spring Integration and Mule. They implement the well-known Enteprise Integration Patterns (EIP) and therefore offers a standardized, domain-specific language to integrate applications. These Integration Frameworks can be used in almost every integration project within the JVM environment - no matter which technologies, transport protocols or data formats are used. All integration projects can be realized in a consistent way without redundant boilerplate code. This session shows and compares the three alternatives and discusses their pros and cons. Besides, a recommendation will be given when to use a more powerful Enterprise Service Bus (ESB) instead of one of these frameworks.

1. Spoilt for Choice –
Which Integration Framework to choose?
Kai
Wähner
kwaehner@talend.com
@KaiWaehner
www.kai-­‐waehner.de
3/5/13
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

2. Kai Wähner
Main Tasks
Requirements Engineering
Enterprise Architecture Management
Business Process Management
Architecture and Development of Applications
Service-oriented Architecture
Integration of Legacy Applications
Cloud Computing
Big Data
Contact
Consulting Email: kwaehner@talend.com
Developing Blog: www.kai-waehner.de/blog
Coaching Twitter: @KaiWaehner
Speaking
Social Networks: Xing, LinkedIn
Writing
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

3. Key Messages
Do not reinvent the „integration wheel“!
There are some good frameworks for integration!
Often, an ESB is the better choice!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

4. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

5. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

6. Growing IT infrastructure everywhere!
• Applications
• Interfaces
• Technologies
• Products
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

7. Heterogeneity
Host à Client / Server à SOA à Cloud à Big Data à ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

8. Spaghetti solutions
„point-to-point hell“
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

9. The solution: application integration
All roads
lead to Rome ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

10. Writing glue code?
AmazonS3
s3
=
new
AmazonS3Client(new
Proper>esCreden>als(
S3Sample.class.getResourceAsStream("AwsCreden>als.proper>es")));
String
bucketName
=
"my-­‐first-­‐s3-­‐bucket-­‐"
+
UUID.randomUUID();
String
key
=
"MyObjectKey";
try
{
s3.createBucket(bucketName);
s3.putObject(new
PutObjectRequest(bucketName,
key,
createSampleFile()));
S3Object
object
=
s3.getObject(new
GetObjectRequest(bucketName,
key));
ObjectLis>ng
objectLis>ng
=
s3.listObjects(new
ListObjectsRequest()
.withBucketName(bucketName)
.withPrefix("My"));
s3.deleteObject(bucketName,
key);
s3.deleteBucket(bucketName);
}
catch
(AmazonServiceExcep>on
ase)
{
//
error
handling...
}
catch
(AmazonClientExcep>on
ace)
{
//
error
handling...
}
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

11. Wishes for integrators
• Standardized Modeling
• Efficient Realization
• Automatic Testing
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

12. Enteprise Integration Patterns
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

13. Enterprise Integration Patterns
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

14. Enterprise Integration Patterns
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

15. Alternatives for application integration
Enterprise
Integra>on
Suite
Integration Service
Bus
Framework
Complexity
of Integration
Low High
Spring Integration vs. Mule vs. Apache Camel
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

16. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

17. Integration Frameworks
Integration vs. Mule ESB vs.
implement
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

18. Comparison Criteria
•
Open
source
•
Basic
concepts
/
architecture
•
Testability
•
Commercial
support
•
Error
handling
•
Monitoring
•
Enterprise
readiness
•
Developer-­‐centric
vs.
designer-­‐centric
•
Expandability
•
Deployment
•
Popularity
•
Tool
support
•
Connec>vity
•
Domain
specific
language
(DSL)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

19. Similarities
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

20. Connectivity
Integration
of different
Technologies
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

21. Domain specific language
„A
domain-­‐specific
language
(DSL)
is
a
programming
language
or
specifica9on
language
dedicated
to
a
par9cular
problem
domain,
a
par9cular
problem
representa9on
technique,
and
/
or
a
par9cular
solu9on
technique.“
Wikipedia
Internal DSL
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

22. Architecture
hip://java.dzone.com/ar>cles/apache-­‐camel-­‐integra>on
(Exemplarily: Apache Camel => Concepts are all the same, only different names)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

23. Deployment
Standalone Application Server
Web Container
Spring Container
OSGi
Cloud
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

24. Enterprise readiness
• Maturity
• Transactions
• Concurrency
• Error handling
• Monitoring
• Testability
• Tooling
• Commercial Support
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

25. Licensing
Integration vs. Mule ESB vs.
Apache
License
Common
Public
Apache
License
Airibu>on
License
(CPAL)
aien>on:
more
restric>ve!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

26. Commercial support
Integration vs. Mule ESB vs.
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

27. Tooling
STS Integration Graph (for Spring Integration) Mule Studio (for Mule ESB)
Fuse IDE (for Apache Camel) Talend ESB (for Apache Camel)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

28. Comparison Criteria
•
Open
source
•
Basic
concepts
/
architecture
•
Testability
•
Commercial
support
•
Error
handling
•
Monitoring
•
Enterprise
readiness
•
Developer-­‐centric
vs.
designer-­‐centric
•
Expandability
•
Deployment
Focus •
Popularity
•
Tool
support
•
Connec>vity
•
Domain
specific
language
(DSL)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

29. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

30. Connectivity
AMQP
Feed
File
FTP(S)
GemFire
HTTP
TCP
UDP
JDBC
JMS
Mail
MongoDB
Redis
RMI
SFTP
Stream
Twitter
Web Service
XML
XMPP ... easy to create own connectors using a template!
„Some more“
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

31. Domain specific language
(Not production-ready yet)
XML
(Not production-ready yet)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

32. Code example (XML DSL)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

33. Code example (Scala DSL)
hip://blog.springsource.org/2012/03/05/introducing-­‐spring-­‐integra>on-­‐scala-­‐dsl/
hip://blog.springsource.org/2012/03/05/introducing-­‐spring-­‐integra>on-­‐scala-­‐dsl/
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

34. Live demo
Spring Integration in Action
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

35. Tooling: STS Integration Graph
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

36. Tooling: STS Integration Graph
Pro
• Visual designer for Spring Integration flows
• Vice versa editing (code generation vs. coding by hand)
• Open source (part of Spring IDE at github)
• Perfect for usage in Spring projects (which use Spring Tool Suite)
• Simple Eclipse plugin – „just Spring Integration“
Contra
• Simple Eclipse plugin – there are no „ESB add-ons“
• Non-intuitive usability
• Unclear diagrams
• Immature (e.g. missing documentation, problems with code examples)
• No unified platform (integration, bpm, etc.)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

37. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

38. Mule ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

39. Deployment as web app or standalone
hip://www.mulesol.org/documenta>on/display/MULE3USER/Embedding+Mule+in+a+Java+Applica>on+or+Webapp
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

40. Connectivity
AS400
Data
Queue
Abdera
Amazon
SQS
Atom
Amazon
S3
jBPM
Base64
encoded
Authorize.net
CICS
CTG
Byte
arrays
Apple
Push
CXF
CSV
Bit.ly
Email
Encrypted
CMIS
FTP
Hibernate
HTTP/S
Legs4Mule
GZIP
CyberSource
IMAP/S
Hex
Strings
Facebook
HTML/
XHTML
Flickr
Java
Objects
HBase
Servlet
Magento
SFTP
SMTP/S
SOAP
JSON
STDIO
EDI
TCP
COBOL
Copybook
UDP
XML
VM
Many further connectors +
XMPP
easy to create own connectors
WebSphere
MQ
WSDL
via Maven archetypes
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

41. Connectivity
Several B2B connectors available, especially for:
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

42. Missing OSGi support
„OSGi
adds
another
complexity
to
building
applica9ons.
[...]
OSGi
is
a
great
specifica9on
for
middleware
vendors,
but
a
terrible
specifica9on
for
the
end
user.“
Ross
Mason,
MuleSol,
November
2010
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

43. Domain specific language
XML
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

44. Code example (XML DSL – no alternative)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

45. Live demo
Mule in Action
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

46. Tooling: Mule Studio
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

47. Tooling: Mule Studio
Pro
• Visual Designer for Mule Flows
• Visual „live monitoring“
• Vice versa editing (code generation vs. coding by hand)
• Intuitive GUI
Contra
• Proprietary
• Subscription required for enterprise features (such as monitoring)
• No unified platform (integration, bpm, etc.)
Reminder: „Open source“ does NOT mean „for free“!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

48. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

49. Connectivity (most connectors!)
LDAP
XSLT
TCP
SQL
SMTP
JMS
Netty
Jetty
RMI
FTP
Lucene
JDBC EJB
Twitter
Bean-Validation
MQ
IRC
JMX
Quartz
CXF
RSS
AMQP
jclouds
Atom
AWS
Akka
HTTP
File
Many further components +
easy to create own components
MongoDB
via Maven archetypes
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

50. Connectivity
Many B2B connectors available (Talend ESB only), for example:
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

51. Domain specific language
XML
(Not production-ready yet)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

52. Code example (XML DSL)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

53. Code example (Java DSL)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

54. Community à Camel rocks!
Mailing Lists?
Forums?
Blogs?
Articles?
Conference talks?
ESBs?
Professionals?
Jobs?
Knowledge?
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

55. Live demo
Apache Camel in Action
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

56. Tooling: Fuse IDE
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

57. Tooling: RedHat / JBoss + FuseSource
JBoss ESB, Switchyard, Fuse ESB
Roadmap:
hip://www.redhat.com/promo/jboss_integra>on_week/
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

58. Tooling: Fuse IDE
Pro
• Visual designer for Camel routes
• Visual „live monitoring“ (for debugging, browsing, tracing)
• Vice versa editing (code generation vs. coding by-hand)
• Intuitive GUI
• Now open sourced (after acquisition of Red Hat)
Contra
• Unsure future ?
• Subscription required for enterprise features (such as monitoring)
• No unified platform (integration, bpm, etc.)
Reminder: „Open source“ does NOT mean „for free“!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

59. Tooling: Talend ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

60. Tooling: Talend ESB
Pro
• Visual Designer for Camel routes
• Visual „live monitoring“ (for debugging, browsing, tracing)
• Open source
• Zero Coding (you can also write custom code, of course)
• Unified platform (for ESB, DI, BPM, Big Data, Data Quality, MDM)
• GUI palette for Camel components (instead of writing endpoint URIs)
Contra
• No vice versa code editing (only code generation)
• Full ESB, not just Camel tooling (may be bad in a few use cases)
• Subscription required for enterprise features (such as monitoring)
Reminder: „Open source“ does NOT mean „for free“!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

61. Agenda
• Application Integration
• Integration Frameworks
• Spring Integration
• Mule
• Apache Camel
• And the Winner is ...
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

62. ... all three integration frameworks
Integration
Mule ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

63. When to use which integration framework?
Integration
Mule ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

64. When to use which integration framework?
• Spring Projects
• „Typical“ JVM Technologies
(File, JMS, REST, SOAP, ...)
• No additional Framework wanted
Integration
Mule ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

65. When to use which integration framework?
Integration
• One of its
B2B connectors is required
(and it is not available in Camel)
Mule ESB
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

66. When to use which integration framework?
Integration
Mule ESB
• In all other cases
(largest community, great DSLs,
most connectors)
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

67. ... after you have learned the differences
Hmm...
Actually,
when
should
I
use
an
integra>on
framework?
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

68. Alternatives for application integration
Enterprise
Integra>on
Suite
Integration Service
Bus
Framework
Complexity
of Integration
Low High
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

69. When to use an integration framework?
Enterprise
Integra>on
Suite
Integration Service
Bus
Framework
Complexity
of Integration
Low High
INTEGRATION
Connectivity
Routing
Transformation
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

70. When to use an Enterprise Service Bus?
Enterprise
Integra>on
Suite
Integration Service
Bus
Framework
Complexity
of Integration
Low High
INTEGRATION
Connectivity Tooling
Routing
Transformation
©
Talend
2013
+ Monitoring
Support
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

71. When to use an integration suite?
Enterprise
Integra>on
Suite
Integration Service
Bus
Framework
Complexity
of Integration
Low High
BUSINESS PROCESS MGT.
INTEGRATION BIG DATA / MDM
Connectivity Tooling REGISTRY / REPOSITORY
Transformation
Routing
©
Talend
2013
+ Monitoring
Support + RULES ENGINE
„YOU NAME IT“
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

72. Talend Unified Platform
Data Data
Big Data Quality Integration MDM ESB BPM
¾ Commercial
license
¾ Subscrip>on
model
¾ Support
included
¾ Open
source
license
¾ Free
of
charge
Big Data Data
Data Quality Integration MDM ESB
¾ Op>onal
support
¾ Based on open source
projects such as
Eclipse or Apache
Camel, CXF, Hadoop
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

73. ESB vendor == integration suite vendor?
Proprietary
Open Source
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

74. ESB vendor == integration suite vendor?
ESB BPM Big Data
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

75. Custom combination of ESB, BPM, etc.?
• A lot of glue code
• Testing
• Bugfixing
• No support
Some other people already had
the problems you would have!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

76. Did you get the key messages?
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

77. Key messages
Do not reinvent the „integration wheel“!
There are some good frameworks for integration!
Often, an ESB is the better choice!
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

78. Did you get the key messages?
©
Talend
2013
“Spoilt
for
Choice
–
How
to
choose
the
right
Integra>on
Framework”
by
Kai
Wähner

79. Thank you for your attention. Questions?
KAI WÄHNER
kwaehner@talend.com
www.kai-waehner.de
LinkedIn / Xing
@KaiWaehner