Are you new to IBM Integration Bus? Do you want to know how to configure, administer and monitor your nodes? Do you want to make it easier on yourself when deploying your message flow applications across multiple servers? Would you like to keep a record of all of the messages which flow through your applications? Would you like to know how you can configure a Continuous Integration and Deployment pipeline for you IIB integrations? If so come along and find out about how to administer and monitor your IBM Integration Bus environment.
The presentation will first cover the basics of administering and monitoring your Integration Nodes. Looking at the available commands and their options, as well as the most recent V10 improvements, including enhancements to the product runtime, covering the extended webui, policy, Integration Toolkit, command line, and programmatic front-ends.
Using the basics learnt initially, this session will then take a look at how you build a Continuous Integration pipeline using technologies such as git, Ant & Jenkins to programmatically configure your Nodes, create, build and test your integrations, and then deploy them to production.
2. Notices and Disclaimers
⢠Copyright Š 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from
IBM.
⢠U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.
⢠Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial
publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS
IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS
INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and
services are warranted according to the terms and conditions of the agreements under which they are provided.
⢠Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.
⢠Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have
used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.
⢠References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which
IBM operates or does business.
⢠Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and
discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their
specific situation.
⢠It is the customerâs responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of
any relevant laws and regulatory requirements that may affect the customerâs business and any actions the customer may need to take to comply with such laws. IBM does not
provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law
3
3. Notices and Disclaimers Conât.
⢠Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or
other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the
accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM
products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or
the ability of any such third-party products to interoperate with IBMâs products. IBM EXPRESSLY DISCLAIMSALL WARRANTIES,
EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND
FITNESS FORA PARTICULAR PURPOSE.
⢠The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM
patents, copyrights, trademarks or other intellectual property right.
⢠IBM, the IBM logo, ibm.com,AsperaŽ, Bluemix, Blueworks Live, CICS, Clearcase, CognosŽ, DOORSŽ, EmptorisŽ, Enterprise
Document Management Systemâ˘, FASPÂŽ, FileNetÂŽ, Global Business Services ÂŽ, Global Technology Services ÂŽ, IBM
ExperienceOneâ˘, IBM SmartCloudÂŽ, IBM Social BusinessÂŽ, Information on Demand, ILOG, MaximoÂŽ, MQIntegratorÂŽ,
MQSeriesÂŽ, NetcoolÂŽ, OMEGAMON, OpenPower, PureAnalyticsâ˘, PureApplicationÂŽ, pureClusterâ˘, PureCoverageÂŽ,
PureDataÂŽ, PureExperienceÂŽ, PureFlexÂŽ, pureQueryÂŽ, pureScaleÂŽ, PureSystemsÂŽ, QRadarÂŽ, RationalÂŽ, RhapsodyÂŽ, Smarter
CommerceÂŽ, SoDA, SPSS, Sterling CommerceÂŽ, StoredIQ, TealeafÂŽ, TivoliÂŽ, TrusteerÂŽ, UnicaÂŽ, urban{code}ÂŽ, Watson,
WebSphereÂŽ, WorklightÂŽ, X-ForceÂŽ and System zÂŽ Z/OS, are trademarks of International Business Machines Corporation,
registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A
current list of IBM trademarks is available on the Web at "Copyright and trademark information" at:
www.ibm.com/legal/copytrade.shtml.
4
8. Integration Explorer
⢠Management option designed for administrators
⢠Plug-in to MQ Explorer
⢠Extra features
â Create/Manage Configurable Services
â Performance Views
â Group integration nodes
â Administration Log
â Administration Queue
â Manage statistics & tracing
â Replaced in v10 with
Web UI
9. ⢠A wide selection of tools for scripting actions
⢠Requires a configured environment
â mqsicommandconsole (Windows)
â mqsiprofile (Linux/UNIX)
â JCL or ISPF (z/OS)
⢠Most commands work against local or remote integration nodes
⢠New âIIBâ command in V10
Command line tools
BIP1121I: Creates an integration server.
Syntax:
mqsicreateexecutiongroup integrationNodeSpec -e integrationServerName [-w timeoutSecs] [-v traceFileName]
Command options:
'integrationNodeSpec' is one of:
(a) 'integrationNodeName' : Name of a locally defined integration node
(b) '-n integrationNodeFileName' : File containing remote integration node connection parameters (*.broker)
(c) '[integrationNodeName] -i ipAddress -p port' : hostname and port of a remote integration node. 'integrationNodeName' optional for validation.
(d) '[integrationNodeName] -i uri' : uri for the remote integration node in the form tcp://[<user>[:<password>]@]<host>:<port>
If a user name and password are supplied, any URI Reserved characters in the password must be percent-encoded.
'-e integrationServerName' name of the new integration server
'-w timeoutSecs' maximum number of seconds to wait for the integration server to be created (default is 60)
'-v traceFileName' send verbose internal trace to the specified file.
10. Integration API (CMP)
⢠Java interface that enables the administration tools
⢠Use for custom administration requirements
⢠Fully documented and samples available
⢠WMB v8 and later allows you to create and edit message flows too
â Build your entire system programmatically!
11. Web Visualisation and Analytics
§ A comprehensive tool for web management
â Manage all integration resources from zero-footprint client
â Analyze integration performance in real-time
â Supported on a variety of browsers: IE10, Firefox, SafariâŚ
â Complements MQ Explorer and WAS Admin consoles
§ Managing Integration Resources
â View top-level integration node properties
â Add/remove/change integration servers
â Start/Stop integration data flows
â Role based access to control usage
â Advanced options include data replay, policy & monitoring
â Exploits underlying public REST/JSON API
§ Integration Performance Analysis
â Operational experience; no developer intervention required
⢠New and existing flows can exploit without change
â Many metrics of integration flow available in real-time
⢠CPU & I/O time shown by default in integration analyzer
⢠Other metrics include thread, data sizes, errorsâŚ
â Flexible display includes data tables and flow profile
⢠Drill down to understand detailed behaviour
â Exploits underlying MQTT web sockets technology
⢠Asynchronous notification at low CPU cost
13. V10 Web UI Administration Improvements
⢠IIB Web UI becomes the primary means ofruntime administration
â Browser approach is lightweightand universal
â Integration Bus Explorer no longer provided as partof IIBv10
⢠Programmatic intervention using public Java and RESTAPIs
⢠Integration Bus Explorer admin capabilities re-located
â Policy Set configuration moved to the IIB Toolkit
â ExportPort Configuration for external HTTP listeners in Web UI
â Integration Server Create,Rename and Delete added to Web UI
â BAR file deploymentadded to Web UI
14
14. Understanding integration node behaviour
⢠The tools include a lot of information that is useful to the administrator
â Administration log, Message flow and resource statistics
â Warnings when features that affect performance are enabled
â Activity Log â New in V10.0.0.4
⢠Use this information to understand recent configuration changes
â How the integration server is performing, connected endpoints, etc.
15. Significant Tool changes in V10
⢠Single install package and single installed component
â Unit test integration node automatically started with IIB development tool
â Can create additional integration nodes as required
⢠No longer any MQ pre-requisite
â All existing MQ use-cases still work (and now support remote MQ connections)
â All administration done through the web UI rather than the Integration Explorer
â Remote administration commands need to point at the integration nodeâs administration port rather than the queue
manager
⢠New âIIB Consoleâ
â e.g. iib tools, iib help
â All mqsi* commands continue to work
(noting remote administration caveat above)
17. Controlling Integrations with Policy
⢠Integration Workload Management
â Provide intelligentmechanisms to control processing speed
â Most common scenario is to reduce back-end server load
â Design allows more policy-based processing over time
â Can be applied to new or existing integration data flows
⢠Policy defines threshold limits and relevant actions
â Set thresholds for integration data flow throughput
â Specify actions at threshold,for example:
⢠NOTIFY: Higher (or lower) than threshold generates publication
⢠DELAY: Excessive workload will have latency added to shape throughput
⢠Web Console used to manage WLM policy
â Sophisticated behaviour controllable by broker WLM policy
â Workload can be managed across classes ofmessage flows (e.g.batch vs. online)
â Policies stored in local registry,and dynamically configurable
â Developer can also specify limits as integration data flow properties
18
0
20
40
60
80
100
120
140
160
180
200
0
20
40
60
80
100
120
140
160
180
200
0
20
40
60
80
100
120
140
160
180
200
18. Optimizing and tuning
⢠The tools allow you to modify the configuration operationally
⢠These tweaks more efficient to make than modifying message flows
⢠Encourage developers to create message flows that enable operational tweaks to be made
â User-defined properties, Configurable Services, User-defined configurable services, Policies
19. Common Administrative Tasks
⢠Planning and configuration
â Bringing a new integration node online
â Making an integration node highly available
â Planning for disaster recovery
â Securing an integration node
⢠Managing integration nodes
â Deployment and redeployment
â Understanding behaviour
â Optimizing and tuning
â Migration
â Maintenance
21. Scripting and Automation
⢠General approaches for IIB provisioning
â Creating and configuring brokers manually
â Use of commandline tools from within scripts (e.g. shell scripts, Jenkins,
Ant, MavenâŚ)
â Hypervisor images for deployment directlyon publicor private cloud
â Use of technologies such as Chef and Puppet for all environments
â Container technologiese.g.: Docker
⢠IIB Docker containers can now be used in production!
⢠Choose an approach that enables your environment to be
reproduced easily <project>
<target name=âdeployâ>
<cvs command=âcheckoutâ ⌠/>
<mqsipackagebar ⌠/>
<mqsiapplybaroverride ⌠/>
<mqsideploy ⌠/>
</target>
</project>
22. Continuous Delivery - Demo
⢠Following components
â RHEL7.1
â IIB V10 Runtime with Node created and started
â IIB V10 Toolkitwith Git client installed
â Git repository
â Jenkins
â PerfHarness â http://ibm.biz/PerfHarness
23
24. Continuous Delivery - Demo
Time for a Demo
25
Further information available at:
https://developer.ibm.com/integration/blog/2015/10/02/continuous-build-and-deploy-automation-with-ibm-integration-bus-v10-using-ant-git-and-jenkins/
25. Continuous Delivery
⢠Demo only covered the subset of whatâs possible
â Unit Test
â ComponentTesting
â System Testing
⢠Many different system test possibilities using the existing administration tools
â Complete end to end testing includingnode creation
â Provisioning to the cloud
â Use the API to access FlowExerciserdata
⢠Possible to run against cut-down installation
26
26. Alternative Technologies
⢠Swiss National Train system â GitHub
â https://github.com/SchweizerischeBundesbahnen/iib-maven-plugin
⢠Apache - IIB9 Maven Build Lifecycle
â http://www.vadosity.com/maven/
⢠https://github.com/ot4i-cookbooks/ibm_integration_bus
27
27. MacOS
⢠IIB Toolkit is currently available on Windows & Linux
⢠New IIB on MacOS available via the V10 Open Beta program.
â https://ibm.biz/iibopenbeta
⢠Limited runtime capability
⢠Can connectand administerremote nodes.
28
28. This was Session 18863. The rest of the week âŚâŚ
Day Monday Tuesday Wednesday Thursday Friday
8:30 Nobody Uses Files Any More
Do They? New Technologies
for Old Technology, File
Processing in MQ MFT and IIB
Room 225D
Common Problems and Problem
Determination for MQ z/OS
MQ and CICS - Integration
Options andCosts
Room 302B
10:00 Introduction toMQ - Can
MQ Really Make My Life
Easier?
Introduction totheNew MQ
Appliance
DevOps : Using z/OSMF to
Provision MQ for z/OS
MQ for z/OS: The Insider Story MQ for z/OS, UsingandAbusing
New Hardware and the New v8
Features
11:15 Introduction toIBM
Integration Bus onz/OS
MQ Security Bootcamp:
Understanding SSL/TLS Principles -
Taking You from Beginner toExpert,
Part 2 of 3
MQ Labs - Room 303A
OR
Giving It the Beans: UsingIBM MQ as
the Messaging Provider for JEE
Applications in IBM WebSphere
ApplicationServer
13:45 What's New in the
Messaging Family - MQ v8
and More [z/OS &
Distributed]
Thoughts on MQ Architecture &
Design
DevOps : IIB Administration for
Continuous Delivery and DevOps
Room 304B
15:15 What's New in IBM
Integration Bus and IIBon
Cloud
IBM Integration Bus MQ flexibility
[z/OS & Distributed]
MQ Security Bootcamp:
Security Features Deep Dive -
Securing your Enterprise,Part 3
of 3
IBM MQ: Are z/OS & Distributed
Platforms LikeOil & Water?
OR
DevOps : EmpoweringtheDelivery of
Data Centre Operations Through
Increased Automation andCloud
[Distributed] Room 304B
16:30 MQ Security Bootcamp:
Securing MQ from End to
End, Part 1 of 3
Digging into theMQ SMF Data Programming with PCF
Messages
Monitoring and AuditingMQ