SlideShare ist ein Scribd-Unternehmen logo
1 von 10
Downloaden Sie, um offline zu lesen
Batch Processing in mule
By,
Harish Kumar
Batch Processing
Mule possesses the ability to process messages in batches.
Within an application, you can initiate a batch job which is a block of
code that splits messages into individual records, performs actions upon
each record, then reports on the results and potentially pushes the
processed output to other systems or queues.
Batch processing is particularly useful when working with the following
scenarios:

Integrating data sets, small or large, streaming or not, to parallel
process records.

Synchronizing data sets between business applications, such as
syncing contacts between NetSuite and Salesforce and causing "near
real-time" data integration.

Extracting, transforming and loading (ETL) information into a target
system, such as uploading data from a flat file (CSV) to Hadoop.

Handling large quantities of incoming data from an API into a legacy
system.
Batch Job:
Batch job is a top-level element in Mule which exists outside all Mule
flows. Batch jobs split large messages into records which processes
asynchronously in a batch job.
A batch job contains one or more batch steps which, in turn, contain any
number of message processors that act upon records as they move
through the batch job. During batch processing, you can use record
variables and MEL expressions to enrich, route or otherwise act upon
records.
Batch Job Insatnce:
whenever a Mule flow executes a batch job. Mule creates the batch
job instance in the Load and Dispatch phase. Every batch job instance is
identified internally using a unique String known as batch job instance id.
Phase Configuration
Input optional
Load and Dispatch implicit, not exposed in
a Mule application
Process required
On Complete optional
Batch Processing Phases:

Input:
The first phase, Input, is an optional part of the batch job configuration
and is designed to Triggering Batch Jobs via an inbound connector,
and/or accommodate any transformations or adjustments to a message
payload before Mule begins processing it as a batch.

Load and Dispatch:
The second phase, Load and Dispatch, is implicit and performs all the
"behind the scenes" work to create a batch job instance. Essentially,
this is the phase during which Mule turns a serialized message
payload into a collection of records for processing as a batch. You
don’t need to configure anything for this activity to occur, though it is
useful to understand the tasks Mule completes during this phase.

Process:
Mule begins asynchronous processing of the records in the batch. Within
this required phase, each record moves through the message
processors in the first batch step, then is sent back to the original
queue while it waits to be processed by the second batch step and so
on until every record has passed through every batch step.

Only one queue exists and records are picked out of it for each batch
step, processed, and then sent back to it each record keeps track of
what stages it has been processed through while it sits on this queue.
Note that a batch job instance does not wait for all its queued records
to finish processing in one batch step before pushing any of them to
the next batch step.

On Complete:
we can optionally configure Mule to create a report or summary of the
records it processed for the particular batch job instance. This phase
exists to give system administrators and developers some insight into
which records failed so as to address any issues that might exist with
the input data.

After Mule executes the entire batch job, the output becomes a batch
job result object (BatchJobResult).

you have two options for working with the output.
− Create a report
− Reference the batch job result object

Batch Processing Terminology:
we have term in batch processing.
Batch,Batch Commit,Batch Job,Batch Job Instance,Batch Job
Result,Batch Message Processor,Batch Phase,Batch Step,Record

Batch Elements:
− Batch,Batch Commit,Batch Reference,Batch Threading Profile,
Record Variable.
− In Batch Threading Profile, we have some attributes.
PoolExhaustedAction,maxThreadsActive,maxThreadsIdle,
threadTTL,threadWaitTimeout,maxBufferSize

BatchJobResult Processing Statistics:
batchJobInstanceId,elapsedTimeInMillis,failedOnCompletePhase,fail
edOnInputPhase,failedOnLoadingPhase,failedRecords,inputPhase
Exception,loadedRecords,loadingPhaseException,onCompletePha
seException,processedRecords,successfulRecords,totalRecords.

Handling Failures During Batch Processing:
Mule has three options for handling a record-level error.

Finish processing

Continue processing

Continue processing based on limit

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (19)

Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 
Mule batch introduction
Mule batch introductionMule batch introduction
Mule batch introduction
 
Java spring batch
Java spring batchJava spring batch
Java spring batch
 
Spring batch in action
Spring batch in actionSpring batch in action
Spring batch in action
 
Spring batch
Spring batchSpring batch
Spring batch
 
Mule batch
Mule batchMule batch
Mule batch
 
M batching
M batchingM batching
M batching
 
Mule enricher component
Mule enricher component Mule enricher component
Mule enricher component
 
Mulebatch
MulebatchMulebatch
Mulebatch
 
Functional reactive programming
Functional reactive programmingFunctional reactive programming
Functional reactive programming
 
Mule transformers
Mule transformersMule transformers
Mule transformers
 
Mule enricher
Mule enricher Mule enricher
Mule enricher
 
Reactive programming
Reactive programmingReactive programming
Reactive programming
 
Mule with data weave
Mule with data weaveMule with data weave
Mule with data weave
 
Mule splitters
Mule splittersMule splitters
Mule splitters
 
Flink Forward Berlin 2017: Boris Lublinsky, Stavros Kontopoulos - Introducing...
Flink Forward Berlin 2017: Boris Lublinsky, Stavros Kontopoulos - Introducing...Flink Forward Berlin 2017: Boris Lublinsky, Stavros Kontopoulos - Introducing...
Flink Forward Berlin 2017: Boris Lublinsky, Stavros Kontopoulos - Introducing...
 
Elements in a muleflow
Elements in a muleflowElements in a muleflow
Elements in a muleflow
 
Online Datastage training
Online Datastage trainingOnline Datastage training
Online Datastage training
 
Rails DB migrations
Rails DB migrationsRails DB migrations
Rails DB migrations
 

Andere mochten auch (20)

#speakgeek - Pragmatic Batch Process Management & Developer Testing
#speakgeek - Pragmatic Batch Process Management & Developer Testing#speakgeek - Pragmatic Batch Process Management & Developer Testing
#speakgeek - Pragmatic Batch Process Management & Developer Testing
 
Batch processing
Batch processingBatch processing
Batch processing
 
Batch Process Analytics
Batch Process Analytics Batch Process Analytics
Batch Process Analytics
 
Process control
Process control Process control
Process control
 
Dynamic Process Modeling
Dynamic Process ModelingDynamic Process Modeling
Dynamic Process Modeling
 
Batch process conrol
Batch process conrol Batch process conrol
Batch process conrol
 
C4f Batch Or Continuous
C4f Batch Or ContinuousC4f Batch Or Continuous
C4f Batch Or Continuous
 
Odata batch processing
Odata batch processingOdata batch processing
Odata batch processing
 
Batch processing
Batch processingBatch processing
Batch processing
 
Presentation Q10
Presentation Q10Presentation Q10
Presentation Q10
 
Continuos and batch process
Continuos and batch processContinuos and batch process
Continuos and batch process
 
Continuous and batch culture
Continuous and batch cultureContinuous and batch culture
Continuous and batch culture
 
Process design & steps
Process design & stepsProcess design & steps
Process design & steps
 
Process design
Process design  Process design
Process design
 
4.types of manufacturing system and layouts
4.types of manufacturing system and layouts4.types of manufacturing system and layouts
4.types of manufacturing system and layouts
 
2 process-design
2 process-design2 process-design
2 process-design
 
Types of production system
Types of production systemTypes of production system
Types of production system
 
Design process
Design processDesign process
Design process
 
Product and process design
Product and process designProduct and process design
Product and process design
 
Process design
Process designProcess design
Process design
 

Ähnlich wie Batch processing

Batch processing
Batch processingBatch processing
Batch processingbapiraju
 
Runing batch job in mule
Runing batch job in muleRuning batch job in mule
Runing batch job in muleSon Nguyen
 
Mulesoft anypoint batch processing
Mulesoft anypoint batch processingMulesoft anypoint batch processing
Mulesoft anypoint batch processingakshay yeluru
 
Mule concepts
Mule conceptsMule concepts
Mule conceptsSindhu VL
 
Cleveland Meetup July 15,2021 - Advanced Batch Processing Concepts
Cleveland Meetup July 15,2021 - Advanced Batch Processing ConceptsCleveland Meetup July 15,2021 - Advanced Batch Processing Concepts
Cleveland Meetup July 15,2021 - Advanced Batch Processing ConceptsTintu Jacob Shaji
 
Ui path certificate question set 1
Ui path certificate question set 1Ui path certificate question set 1
Ui path certificate question set 1Majid Hashmi
 
Step by step lsmw tutorial
Step by step lsmw tutorialStep by step lsmw tutorial
Step by step lsmw tutorialraonivaz
 
Anypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftAnypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftJitendra Bafna
 
Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02johnbryan26
 
Munit junit test case
Munit junit test caseMunit junit test case
Munit junit test caseprudhvivreddy
 
Systemd for administrators
Systemd for administratorsSystemd for administrators
Systemd for administratorsSusant Sahani
 
Systemd for administrators
Systemd for administratorsSystemd for administrators
Systemd for administratorsSusant Sahani
 
Mule ESB Tutorial Part 2
Mule ESB Tutorial Part 2Mule ESB Tutorial Part 2
Mule ESB Tutorial Part 2Srikanth N
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processingAnand kalla
 

Ähnlich wie Batch processing (20)

Batch processing
Batch processingBatch processing
Batch processing
 
Runing batch job in mule
Runing batch job in muleRuning batch job in mule
Runing batch job in mule
 
Mule batch job
Mule batch jobMule batch job
Mule batch job
 
Mulesoft anypoint batch processing
Mulesoft anypoint batch processingMulesoft anypoint batch processing
Mulesoft anypoint batch processing
 
Mule concepts
Mule conceptsMule concepts
Mule concepts
 
Cleveland Meetup July 15,2021 - Advanced Batch Processing Concepts
Cleveland Meetup July 15,2021 - Advanced Batch Processing ConceptsCleveland Meetup July 15,2021 - Advanced Batch Processing Concepts
Cleveland Meetup July 15,2021 - Advanced Batch Processing Concepts
 
Ui path certificate question set 1
Ui path certificate question set 1Ui path certificate question set 1
Ui path certificate question set 1
 
Step by step lsmw tutorial
Step by step lsmw tutorialStep by step lsmw tutorial
Step by step lsmw tutorial
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 
Mule fundamentals
Mule fundamentalsMule fundamentals
Mule fundamentals
 
Anypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With MulesoftAnypoint Batch Processing and Polling Scope With Mulesoft
Anypoint Batch Processing and Polling Scope With Mulesoft
 
Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02
 
Munit junit test case
Munit junit test caseMunit junit test case
Munit junit test case
 
Spring batch
Spring batchSpring batch
Spring batch
 
systemd
systemdsystemd
systemd
 
Systemd for administrators
Systemd for administratorsSystemd for administrators
Systemd for administrators
 
Systemd for administrators
Systemd for administratorsSystemd for administrators
Systemd for administrators
 
Mule ESB Tutorial Part 2
Mule ESB Tutorial Part 2Mule ESB Tutorial Part 2
Mule ESB Tutorial Part 2
 
Real Time Operating Systems
Real Time Operating SystemsReal Time Operating Systems
Real Time Operating Systems
 
Mule batch processing
Mule batch processingMule batch processing
Mule batch processing
 

Mehr von Harish43

Rest service in mule
Rest service in mule Rest service in mule
Rest service in mule Harish43
 
Cache scope and strategy
Cache scope and strategy Cache scope and strategy
Cache scope and strategy Harish43
 
Mule management console installation steps
Mule management console installation stepsMule management console installation steps
Mule management console installation stepsHarish43
 
Java components in mule
Java components in muleJava components in mule
Java components in muleHarish43
 
Queues and Mule Transport Mechanisms
Queues and Mule Transport MechanismsQueues and Mule Transport Mechanisms
Queues and Mule Transport MechanismsHarish43
 
Clustering concepts
Clustering conceptsClustering concepts
Clustering conceptsHarish43
 

Mehr von Harish43 (6)

Rest service in mule
Rest service in mule Rest service in mule
Rest service in mule
 
Cache scope and strategy
Cache scope and strategy Cache scope and strategy
Cache scope and strategy
 
Mule management console installation steps
Mule management console installation stepsMule management console installation steps
Mule management console installation steps
 
Java components in mule
Java components in muleJava components in mule
Java components in mule
 
Queues and Mule Transport Mechanisms
Queues and Mule Transport MechanismsQueues and Mule Transport Mechanisms
Queues and Mule Transport Mechanisms
 
Clustering concepts
Clustering conceptsClustering concepts
Clustering concepts
 

Kürzlich hochgeladen

Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Jaydeep Chhasatia
 
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageSales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageDista
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Incrobinwilliams8624
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampVICTOR MAESTRE RAMIREZ
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadIvo Andreev
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxJoão Esperancinha
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdfMeon Technology
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfBrain Inventory
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfTobias Schneck
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesSoftwareMill
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptkinjal48
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsJaydeep Chhasatia
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmonyelliciumsolutionspun
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.Sharon Liu
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilVICTOR MAESTRE RAMIREZ
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?AmeliaSmith90
 

Kürzlich hochgeladen (20)

Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
 
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageSales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Inc
 
Deep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - DatacampDeep Learning for Images with PyTorch - Datacamp
Deep Learning for Images with PyTorch - Datacamp
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptx
 
online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdf
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdf
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
 
Salesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptxSalesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptx
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retries
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.ppt
 
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software TeamsYour Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
Your Vision, Our Expertise: TECUNIQUE's Tailored Software Teams
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
20240319 Car Simulator Plan.pptx . Plan for a JavaScript Car Driving Simulator.
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-Council
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
 

Batch processing

  • 1. Batch Processing in mule By, Harish Kumar
  • 2. Batch Processing Mule possesses the ability to process messages in batches. Within an application, you can initiate a batch job which is a block of code that splits messages into individual records, performs actions upon each record, then reports on the results and potentially pushes the processed output to other systems or queues.
  • 3. Batch processing is particularly useful when working with the following scenarios:  Integrating data sets, small or large, streaming or not, to parallel process records.  Synchronizing data sets between business applications, such as syncing contacts between NetSuite and Salesforce and causing "near real-time" data integration.  Extracting, transforming and loading (ETL) information into a target system, such as uploading data from a flat file (CSV) to Hadoop.  Handling large quantities of incoming data from an API into a legacy system.
  • 4. Batch Job: Batch job is a top-level element in Mule which exists outside all Mule flows. Batch jobs split large messages into records which processes asynchronously in a batch job. A batch job contains one or more batch steps which, in turn, contain any number of message processors that act upon records as they move through the batch job. During batch processing, you can use record variables and MEL expressions to enrich, route or otherwise act upon records. Batch Job Insatnce: whenever a Mule flow executes a batch job. Mule creates the batch job instance in the Load and Dispatch phase. Every batch job instance is identified internally using a unique String known as batch job instance id.
  • 5. Phase Configuration Input optional Load and Dispatch implicit, not exposed in a Mule application Process required On Complete optional Batch Processing Phases:
  • 6.  Input: The first phase, Input, is an optional part of the batch job configuration and is designed to Triggering Batch Jobs via an inbound connector, and/or accommodate any transformations or adjustments to a message payload before Mule begins processing it as a batch.  Load and Dispatch: The second phase, Load and Dispatch, is implicit and performs all the "behind the scenes" work to create a batch job instance. Essentially, this is the phase during which Mule turns a serialized message payload into a collection of records for processing as a batch. You don’t need to configure anything for this activity to occur, though it is useful to understand the tasks Mule completes during this phase.  Process: Mule begins asynchronous processing of the records in the batch. Within this required phase, each record moves through the message processors in the first batch step, then is sent back to the original queue while it waits to be processed by the second batch step and so on until every record has passed through every batch step.
  • 7.  Only one queue exists and records are picked out of it for each batch step, processed, and then sent back to it each record keeps track of what stages it has been processed through while it sits on this queue. Note that a batch job instance does not wait for all its queued records to finish processing in one batch step before pushing any of them to the next batch step.
  • 8.  On Complete: we can optionally configure Mule to create a report or summary of the records it processed for the particular batch job instance. This phase exists to give system administrators and developers some insight into which records failed so as to address any issues that might exist with the input data.  After Mule executes the entire batch job, the output becomes a batch job result object (BatchJobResult).  you have two options for working with the output. − Create a report − Reference the batch job result object
  • 9.  Batch Processing Terminology: we have term in batch processing. Batch,Batch Commit,Batch Job,Batch Job Instance,Batch Job Result,Batch Message Processor,Batch Phase,Batch Step,Record  Batch Elements: − Batch,Batch Commit,Batch Reference,Batch Threading Profile, Record Variable. − In Batch Threading Profile, we have some attributes. PoolExhaustedAction,maxThreadsActive,maxThreadsIdle, threadTTL,threadWaitTimeout,maxBufferSize  BatchJobResult Processing Statistics: batchJobInstanceId,elapsedTimeInMillis,failedOnCompletePhase,fail edOnInputPhase,failedOnLoadingPhase,failedRecords,inputPhase Exception,loadedRecords,loadingPhaseException,onCompletePha seException,processedRecords,successfulRecords,totalRecords.
  • 10.  Handling Failures During Batch Processing: Mule has three options for handling a record-level error.  Finish processing  Continue processing  Continue processing based on limit