This session focuses on the deeper integration of SQL Server Integration Services (SSIS) in Azure Data Factory (ADF) and the broad extensibility of Azure-SSIS Integration Runtime (IR). We will first show you how to provision Azure-SSIS IR – dedicated ADF servers for lifting & shifting SSIS packages – and extend it with custom/3rd party components. Preserving your skillsets, you can then use the familiar SQL Server Data Tools (SSDT)/SQL Server Management Studio (SSMS) to design/deploy/configure/execute/monitor your SSIS packages in the cloud just like you do on premises. Next, we will guide you to trigger/schedule SSIS package executions as first-class activities in ADF pipelines and combine/chain them with other activities, allowing you to inject/splice built-in tasks/data transformations in your ETL/ELT workflows, automatically provision Azure-SSIS IR on demand/just in time, etc. And finally, you will learn about the licensing model for ISVs to develop paid components/extensions and join the growing 3rd party ecosystem for SSIS in ADF with a few examples from our partners.
Embrace and extend first-class activity and 3rd party ecosystem for ssis in adf
1.
2.
3.
4. On-premises data sources SQL Server
OS: Windows/Linux
SCALABILITY: Scale-Out feature
EDITION: Standard/Enterprise
TOOLS: SSDT/SSMS to design/deploy/
manage/execute/monitor packages
EXTENSIBILITY: ISVs can build
components/extensions on SSIS
PRICING: Bundled w/ on-prem SQL Server
5. On-premises data sources
Azure SQL DB/Managed InstanceAzure Data FactoryCloud data sources
Cloud
On-premises
SQL Server
LIFT & SHIFT: Use Azure SQL DB/Managed
Instance (MI) to host SSISDB
SCALABILITY: Use ADF to provision a
managed cluster of Azure VMs dedicated
to run your packages – Azure-SSIS
Integration Runtime (IR)
EDITION: Standard/Enterprise
TOOLS: SSDT/SSMS + ADF app to
design/deploy/manage/execute/monitor
packages (activities)
EXTENSIBILITY: ISVs can build
components/extensions + SaaS on SSIS in
ADF via custom setup + 3rd party licensing
PRICING: Pay per hour + Azure Hybrid
Benefit (AHB) to Bring Your Own License
(BYOL)
6. On-premises data sources
Azure SQL DB/Managed Instance
VNet
Azure Data FactoryCloud data sources
Cloud
On-premises
SQL Server
HYBRID: Join Azure-SSIS IR to a VNet that is
connected to your on-prem network to
enable on-prem data access
MODERNIZATION: Schedule first-class SSIS
activities in ADF pipelines via SSMS and
chain/group them w/ other activities via
ADF app
COMPLEMENTARY: Splice/inject built-
in/custom/Open Source/3rd party SSIS tasks
and transformations in ADF pipelines
READINESS: General Availability (GA) w/
24/7 live-site support
7.
8.
9.
10.
11.
12.
13.
14.
15. Azure-SSIS IR node
Container
ISV Setup1. Specify Product Key in setup script ISV Activation Server
2. Get Activation Key by submitting Cluster ID + Product Key
Local Store
(e.g. Registry)
3. Write Activation Key
SSIS Executor
ISV Extension
4. Read Activation Key and
validate it with Cluster ID
Setup
Runtime
4. Get Cluster ID
4. Report on Node Count (Optional)
SSIS Runtime
2. Activation Key
16.
17.
18.
19.
20. Azure SQL DB
SQLPhonetics.NET TempDB
SSIS Data source SSIS Data source
Azure SQL DB
Target Server
SQLPhonetics.NET for SSIS
29. @echo off
REM Xtract IS for Azure Installation script
REM (C) Theobald Software GmbH
echo Running XtractISSetup.exe /S...
XtractISSetup.exe /S
echo %ERRORLEVEL%
We start with SSIS and ADF as two separate tools for traditional on-prem ETL and modern cloud ELT workflows, respectively. We are converging these tools to create a unified platform for Microsoft ETL/ELT services in the cloud.
We start with SSIS and ADF as two separate tools for traditional on-prem ETL and modern cloud ELT workflows, respectively. We are converging these tools to create a unified platform for Microsoft ETL/ELT services in the cloud.
We start with SSIS and ADF as two separate tools for traditional on-prem ETL and modern cloud ELT workflows, respectively. We are converging these tools to create a unified platform for Microsoft ETL/ELT services in the cloud.