By attending this webinar, you will be able to learn from the product developers on what WSO2 Enterprise Integrator 7.1.0 is, and what features it brings in to cater to integration with seamless developer experience. Key features include: - Support for both centralized ESB and microservices-based deployments - Streaming ETL support with CDC, file scraping, flow monitoring and more - New observability solution based on Grafana, Prometheus, Jaeger, and Loki - A CI/CD pipeline using Docker, Jenkins, Kubernetes and more - New connectors for CSV transformation, Azure Data Lake and more - Improvements to WSO2 Integration Studio (Tooling) UI and connector configuration view On-demand webinar: https://wso2.com/library/webinars/wso2-enterprise-integrator-7-1-0-release/

1. WSO2 Enterprise Integrator 7.1.0 Release
August 12, 2020

2. Hello!
Sasikala Kottegoda
sasikala@wso2.com
Associate Technical Lead
Sajith Ravindra
Technical Lead
sajithr@wso2.com
Prabushi Samarakoon
prabushis@wso2.com
Associate Technical Lead

3. 3
Agenda
● Support for both centralized ESB and microservices based deployments
● Observability solution based on Grafana, Prometheus, Jaeger, and Loki
● CI/CD pipeline using Docker, Jenkins, Kubernetes and more
● New connectors for CSV transformation, Azure Data Lake along with 20+
revamped connectors
● Improvements to WSO2 Integration Studio (Tooling) UI and Connector
configuration view
● Streaming ETL support with CDC, file scraping and flow monitoring

4. WSO2 Enterprise Integrator

5. WSO2 Enterprise Integrator 7.1.0
5
Integration Studio
Enterprise Integrator
Streaming IntegratorMicro Integrator
Streaming Integrator Tooling
Microservices
Data Integration
SaaS Integration
SOA
File Integration
Streaming ETL
Event Stream Integration

6. Advanced Integration with WSO2 Micro
Integrator 1.2

7. Support for Both Centralized and Container Deployments
7

8. Centralized Deployments
● Introduction of RDBMS-based coordination among nodes
● Enhanced integrator dashboard
● Support for hot deployment
8

9. Introduction of RDBMS-based coordination among nodes
9

10. Clustering and Coordination
● Just a simple configuration to enable clustering
● Coordination made possible by different resolvers
10
[[datasource]]
id = "WSO2_COORDINATION_DB"
url= "jdbc:mysql://localhost:3306/clusterdb"
username="root"
password="root"
driver="com.mysql.jdbc.Driver"
[task_handling]
resolver_class = "org.wso2.micro.integrator.ntask.coordination.task.resolver.RoundRobinResolver"

11. Enhanced Integrator Dashboard
11

12. Enhanced Integrator Dashboard - View Log Files
12

13. Enhanced Integrator Dashboard - Log Configuration
13

14. Enhanced Integrator Dashboard - User Management
14

15. Support for Hot Deployment
● Intended for development
● Enabled by default
● Disabled in the Docker image to support immutability
15
[server]
hot_deployment = true

16. Optimizations for Container Deployments
● Introduction of readiness probe
● Support for Docker/Kubernetes secrets
● Revamped vault experience
● Docker images for Centos and Ubuntu, Docker for Dashboard
16

17. Observability Solution Based on Renowned Technologies
Support for monitoring statistics, tracing and logs using
Prometheus, Jaeger and Loki along with Grafana
17

18. Monitoring Statistics with Prometheus and Grafana
18

19. Analyzing Logs with FluentBit, Loki and Grafana
19

20. Tracing with Jaeger
20

21. Other Improvements
● Revamped RabbitMQ experience
● Transaction counter for services
● Read/write support for user stores
● Dynamic log4j configuration
● Swagger definition generation for data services
● Improvements for the CLI
● Many more...
21
https://github.com/wso2/micro-integrator/releases/tag/v1.2.0

22. Integration Studio 7.1.0

23. Packaging
23
Integration Studio
mi-monitoring-
dashboard
WSO2 MI Monitoring
Dashboard 1.2.0
runtime
WSO2 Micro
Integrator 1.2.0
apache-maven
Apache Maven 3.6.3
jdk-home
AdoptOpen JDK
1.8.0_252

24. CICD with Integration Studio
● Integration Project
24
● Maven Profiles
⦿ Default profile
⦾ Integration artifacts
⦿ Docker profile
⦾ Integration artifacts + Docker
modules
⦿ Kubernetes profile
⦾ Integration artifacts + Kubernetes
modules
⦿ Solution profile
⦾ Integration artifacts + Docker
modules + Kubernetes modules

25. Embedded Server - WSO2 Micro Integrator 1.2.0
● Test/Debug Synapse artifacts
● Artifact hot deployment
● TOML-based configurations
● Custom configurations via editor
25

26. Embedded Server - Monitoring
26
1
4
3
2

27. Connector Improvements
● CSV (New)
● Email (New)
● Salesforce
● Amazon S3
● Kafka
27
● Revamped
properties view
● Externalizable
connection
configuration

28. Revamped Getting Started
●
28
Categorized samples
Search with keywords

29. Revamped Editors
29
New data services editor theme Editor user guide

30. Revamped Editors
30
AI data mapper user confirmation

31. UX Improvements
31
New updater
Customer feedback

32. Other Improvements
● JSON/XML array support for datamapper
● Capability to push images to a remote repository via Docker project
● Cipher tool support for Docker project
● Template testing support for Synapse Unit Testing Framework
● Detailed failure analysis for unit test failures
● HTTP status code and HTTP version assertion support
● JSON/Text payload assertion support for sequence testing
● Input/output mapping generation capability for data services
● YAML editor support
● OnError attribute support for template sequence
● API creation with YAML API definition
● And, many more…
32
https://github.com/wso2/devstudio-tooling-ei

33. Streaming ETL (Extract, Transform,
Load) with Streaming Integrator

34. Event-centric integration is re-emerging as an
integration approach, driven by the popularity of
event-driven architectures and streaming data
platforms
- Choosing Between Data, Application and Event-Centric Integration Styles, Gartner,
November, 2019

35. Streaming Integrator
35

36. What’s New?
● Theme: “Streaming Integrator as an effective tool for Streaming ETL”
● Tooling enhancements for quick development with “no-code”
● Data flow monitoring allowing users to drill down to granular details starting
from a birds-eye-view
● In-built support for error capturing and event replay to achieve zero data loss
● Extension installation assistant to eliminate manual copying of connectors and
it’s dependencies
● New connectors
⦿ Azure Data Lake
⦿ Change data capture support for MongoDB
⦿ File system event listener
36

37. Streaming ETL Task Wizard
● Build an ETL flow in a matter of minutes with no-code
● A step-by-step self-guided wizard
37

38. Streaming ETL Flow Monitoring
● Dashboards providing stats and figures on streaming data pipelines at
different levels
38

39. Event Replay and Error Store
● Lets users replay data items that has failed to process or publish due to errors
39

40. Easy Extension Installation
● Let users install extensions/connectors with a single command
⦿ Not required to download and copy third-party dependencies manually
40

41. Question Time!
41

42. wso2.com
Thanks!