SlideShare ist ein Scribd-Unternehmen logo
1 von 26
First Look to SSIS 2012
Pedro Perfeito
BI Senior Consultant, Teacher,
Developer and Passionate
www.pedrocgd.blogspot.com
pperfeito@hotmail.com
Pedro Perfeito
              Pedro Perfeito, 34 years old
              IT degre at Universidade Portucalense (UPT-Oporto, 2001)
              BI Senior Consultant at Novabase
              Participate regulary on Experts-Exchange & Fóruns Microsoft
              Master’s degree on Business Intelligence at ISCTE-IUL (Lisbon, 2009)
              Certificado mundial em Business Intelligence pela TDWI
              Invited teacher at ISCTE-IUL (BI Master) & UPT (BI Short-Master & MBA)
              Microsoft MVP (SQL BI) on 2010 and 2011
              Co-author of SQL MVP Deep Dives-2nd Edition book
              BI Blog with 5 years: www.pedrocgd.blogspot.com
              Preparing PhD on Business Intelligence


Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS 2012 Book
                                          Co-author of the book “Microsoft SQL Server
                                          2012 Integration Services: An Expert Cookbook".
                                          Expected publication on April 2012
                                          http://www.packtpub.com/microsoft-sql-server-2012-integration-
                                          services-expert-cookbook



                                            Pedro              Reza
                                            Perfeito           Rad

                                                                                Blogs:
                                                                                www.pedrocgd.blogspot.com
                                                                                www.rad.pasfu.com




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Agenda
Legacy/Package Deployment Model                  Project Deployment Model
Project Deployment Model

        Developer                         Monitoring &          Developer
        Experience                          Control             Experience
   SSDT                                   SSMS                SSDT




               DEMO                          DEMO                  DEMO
                01                            02                    03



Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Improvements and new features that will favor the
   development of SSIS projects on SQL Server Data
   Tools (SSDT)
                                                          Developer             Project
                                          Introduction                                             Conclusion
                                                         Experience I      Deployment Model



                                                                        Monitoring      Developer
                                                                        & Control      Experience II




                                                                                                                5
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Improvements and new features
        #01 Business Intelligence Development Studio (BIDS) is now SQL Server
            Data Tools (SSDT) - Visual Studio 2010
        #02 The tasks and components design are more appealing
        #03 Undo & redo is now a reality
        #04 SSIS toolbox improved
                  Wizards on Source & Destination components
                  Favorites and Common groups
                  Double-click add tasks & components to the designer

        #05 SSIS variables toolbar improved
                  Add expressions directly
                  Change the scope of a variable
        #06 Success, Failure and Progress new indicators

Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Previous
                                          Version




                                           New
                                          Version



Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Improvements and new features
        #07 Connections offline, shared or with expressions have now an indicator
            on the respective connection

        #08 Copy & paste is now easier without affecting the package layout
        #09 Just one click to add a Data Viewer to Data Flow arrow
        #10 Script component debug is now possible (Data Flow)
        #11 Data Flow column mapper
        #12 Group components under Data Flow
        #13 Cache Transform allows saving data to memory and reuse it through
        Lookup components
        #14 Zoom-In and Zoom-Out
        #15 New Expression Task

Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Improvements and new features
        #16 Flat File Source with different number of columns & embedded qualifiers
        #17 End of 4.000 characters limitation in expressions
        #18 New SSIS functions

        #19 New CDC Task and CDC Source and Transform components




        #20 New DQS Cleansing Transform component

Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
DEMO
                                           01
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
New deployment approach for SSIS Projects


                                                          Developer             Project
                                          Introduction                                             Conclusion
                                                         Experience I      Deployment Model



                                                                        Monitoring      Developer
                                                                        & Control      Experience II




                                                                                                                11
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Project Deployment Model

        - New deployment approach for SSIS Projects
        - Consider the project as a deployment unit
        - Uses a SSIS Catalog for managing the several SSIS projects

        - Under SSMS, there is a folder exclusively created to Catalog
        - All the information related with SSIS projects (under the catalog)
        is stored in a SQL database called SSISDB.




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Package vs Project Deployment Models
      Points                                      Package                            Project
      to compare...                           Deployment Model                  Deployment Model
      Deploy unit                         Package                         Project
      Deploy location                     File System ou MSDB database Integration Services Catalog
      Run-time values                     Package Configurations          Parameters
      assignment
      Location of the values to           Package Configurations          Environment Variables
      assign at run-time                  (SQL, XML...)
      Package execution                   DTExec e DTExecUI               Stored Procedures SSIS Catalog
      Logging                             Through SSIS Log Provider       Configuration is not required
                                          (sysssislog) or customization   (Just select the logging level)




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS Catalog – Folder Structure
                                                     Projects      Packages
      SSIS Catalog                        Folder
                                                                  Environment
                                                   Environments
                                                                    variable




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS Catalog – SSISDB database
                                              Executions      Executables            Operations

                                          Project          Tasks &               Register operations about
                                          Executions       Containers            SSIS catalog. (execution,
                                                                                 deploy, config...)

                                               Projects        Packages                Events

                                          Projects under   Packages under        Register SSIS events.
                                          SSIS Catalog     each Project          It depends on the
                                                                                 logging level selected

                                                             Environments

                                                           Environments of each
                                                           project. (Can have more
                                                           than one variable)

                                                               Parameters

                                                           Parameters used on each
                                                           package and/or project




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS Catalog – SSISDB tables



                                          The Logging Level defined in
                                          the SSIS catalog (or on each
                                          execution), influence which
                                          tables on SSIS Catalog will be
                                          updated




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS Catalog – Logging levels
                  None                        Basic        Performance       Verbose
          No Events                       OnError          OnError       BufferSizeTuning
                                          OnInformation    OnWarning     Diagnostic
                                          OnPostExecute                  DiagnosticEx
                                          OnPostValidate                 OnCustomEvent
                                          OnPreExecute                   OnError
                                          OnPreValidate                  OnInformation
                                          OnTaskFailed                   OnPipelinePostEndOfRowset
                                          OnWarning                      OnPipelinePostPrimeOutput
                                                                         OnPipelinePreEndOfRowset
                                                                         OnPipelinePrePrimeOutput
                                                                         OnPostExecute
                                                                         OnPostValidate
        The Logging Level defined in the SSIS catalog                    OnPreExecute
                                                                         OnPreValidate
        (or on each execution) influence the events                      OnProgress
                                                                         OnTaskFailed
        saved on each execution                                          OnWarning
                                                                         PackageEnd
                                                                         PackageStart
                                                                         PipelineComponentTime
                                                                         PipelineExecutionPlan
                                                                         PipelineExecutionTrees
                                                                         PipelineInitialization


Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
SSIS Catalog – Customization




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Project Model – New Features
        #01 Pre Built-in reports and the possibility to add customs
        #02 Manage SSIS versions (Easy to restore a previous version)
        #03 Data tap – Add data viewer without changing a package
        #04 Automatic logging and the possibility to easily identify the number of
        rows on any place under any data flow through “RowsSent” column




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Project Model – Data Tap Configuration




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
DEMO
                                           02
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Improvements and new features that will favor the
   development of SSIS projects on SQL Server Data
   Tools (SSDT) using the Project Deployment Model
                                                          Developer             Project
                                          Introduction                                             Conclusion
                                                         Experience I      Deployment Model



                                                                        Monitoring      Developer
                                                                        & Control      Experience II




                                                                                                                22
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Project Model – New Features
        #01 Parameters
        #02 Task parameterize
        #03 Execute Package Task can access parameters of the child package
        #04 New system variable with a unique and sequence identifier execution
            @[System::ServerExecutionID]
        #05 Shared Connection Managers
        #06 Execute Package Task can view and
            execute packages referenced in the project




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
DEMO
                                           03
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Business Intelligence Blog
        www.pedrocgd.blogspot.com




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
Thank you!




Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com

Weitere ähnliche Inhalte

Was ist angesagt?

SQL Server 2008 Highlights
SQL Server 2008 HighlightsSQL Server 2008 Highlights
SQL Server 2008 HighlightsIntergen
 
Session 2: SQL Server 2012 with Christian Malbeuf
Session 2: SQL Server 2012 with Christian MalbeufSession 2: SQL Server 2012 with Christian Malbeuf
Session 2: SQL Server 2012 with Christian MalbeufCTE Solutions Inc.
 
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3Naji El Kotob
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Eduardo Castro
 
Sql 2016 - What's New
Sql 2016 - What's NewSql 2016 - What's New
Sql 2016 - What's Newdpcobb
 
Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015Satwinder Khural
 
Microsoft SQL Server internals & architecture
Microsoft SQL Server internals & architectureMicrosoft SQL Server internals & architecture
Microsoft SQL Server internals & architectureKevin Kline
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfoliogaryt1953
 
SSIS coding conventions, best practices, tips and programming guidelines for ...
SSIS coding conventions, best practices, tips and programming guidelines for ...SSIS coding conventions, best practices, tips and programming guidelines for ...
SSIS coding conventions, best practices, tips and programming guidelines for ...Vishal Pawar
 
SQL Server 2016 New Features and Enhancements
SQL Server 2016 New Features and EnhancementsSQL Server 2016 New Features and Enhancements
SQL Server 2016 New Features and EnhancementsJohn Martin
 
Implementing Mobile Reports in SQL Sserver 2016 Reporting Services
Implementing Mobile Reports in SQL Sserver 2016 Reporting ServicesImplementing Mobile Reports in SQL Sserver 2016 Reporting Services
Implementing Mobile Reports in SQL Sserver 2016 Reporting ServicesAntonios Chatzipavlis
 
What's new in SQL Server 2017
What's new in SQL Server 2017What's new in SQL Server 2017
What's new in SQL Server 2017Hasan Savran
 
SQL Server 2008 New Features
SQL Server 2008 New FeaturesSQL Server 2008 New Features
SQL Server 2008 New FeaturesDan English
 
SQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesSQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesDenny Lee
 
Kaashiv SQL Server Interview Questions Presentation
Kaashiv SQL Server Interview Questions PresentationKaashiv SQL Server Interview Questions Presentation
Kaashiv SQL Server Interview Questions Presentationkaashiv1
 

Was ist angesagt? (20)

SQL Server 2016 BI updates
SQL Server 2016 BI updatesSQL Server 2016 BI updates
SQL Server 2016 BI updates
 
SQL Server 2008 Highlights
SQL Server 2008 HighlightsSQL Server 2008 Highlights
SQL Server 2008 Highlights
 
Session 2: SQL Server 2012 with Christian Malbeuf
Session 2: SQL Server 2012 with Christian MalbeufSession 2: SQL Server 2012 with Christian Malbeuf
Session 2: SQL Server 2012 with Christian Malbeuf
 
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3
Microsoft SQL Server 2012 Components and Tools (Quick Overview) - Rev 1.3
 
MS SQL SERVER 2012
MS SQL SERVER 2012MS SQL SERVER 2012
MS SQL SERVER 2012
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
 
Sql 2016 - What's New
Sql 2016 - What's NewSql 2016 - What's New
Sql 2016 - What's New
 
Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015Satwinder SQL.SSK_Brd_2015
Satwinder SQL.SSK_Brd_2015
 
Microsoft SQL Server internals & architecture
Microsoft SQL Server internals & architectureMicrosoft SQL Server internals & architecture
Microsoft SQL Server internals & architecture
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
SSIS coding conventions, best practices, tips and programming guidelines for ...
SSIS coding conventions, best practices, tips and programming guidelines for ...SSIS coding conventions, best practices, tips and programming guidelines for ...
SSIS coding conventions, best practices, tips and programming guidelines for ...
 
SQL Server 2016 New Features and Enhancements
SQL Server 2016 New Features and EnhancementsSQL Server 2016 New Features and Enhancements
SQL Server 2016 New Features and Enhancements
 
It ready dw_day3_rev00
It ready dw_day3_rev00It ready dw_day3_rev00
It ready dw_day3_rev00
 
Implementing Mobile Reports in SQL Sserver 2016 Reporting Services
Implementing Mobile Reports in SQL Sserver 2016 Reporting ServicesImplementing Mobile Reports in SQL Sserver 2016 Reporting Services
Implementing Mobile Reports in SQL Sserver 2016 Reporting Services
 
What's new in SQL Server 2017
What's new in SQL Server 2017What's new in SQL Server 2017
What's new in SQL Server 2017
 
Auditing Data Access in SQL Server
Auditing Data Access in SQL ServerAuditing Data Access in SQL Server
Auditing Data Access in SQL Server
 
SQL Server 2008 New Features
SQL Server 2008 New FeaturesSQL Server 2008 New Features
SQL Server 2008 New Features
 
Stretch db sql server 2016 (sn0028)
Stretch db   sql server 2016 (sn0028)Stretch db   sql server 2016 (sn0028)
Stretch db sql server 2016 (sn0028)
 
SQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesSQL Server Integration Services Best Practices
SQL Server Integration Services Best Practices
 
Kaashiv SQL Server Interview Questions Presentation
Kaashiv SQL Server Interview Questions PresentationKaashiv SQL Server Interview Questions Presentation
Kaashiv SQL Server Interview Questions Presentation
 

Andere mochten auch

SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration ServicesRobert MacLean
 
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...Cathrine Wilhelmsen
 
Managing and Configuring SSIS Packages
Managing and Configuring SSIS PackagesManaging and Configuring SSIS Packages
Managing and Configuring SSIS Packagesrpeterson1
 
Top 9 bi interview questions answers
Top 9 bi interview questions answersTop 9 bi interview questions answers
Top 9 bi interview questions answershudsons168
 
Data Analyst&Scientist course
Data Analyst&Scientist courseData Analyst&Scientist course
Data Analyst&Scientist courseAriella Kaszovitz
 
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)Cathrine Wilhelmsen
 
Architecture of integration services
Architecture of integration servicesArchitecture of integration services
Architecture of integration servicesSlava Kokaev
 
Sql interview questions and answers
Sql interview questions and  answersSql interview questions and  answers
Sql interview questions and answerssheibansari
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingEdureka!
 
Real time big data analytics with Storm by Ron Bodkin of Think Big Analytics
Real time big data analytics with Storm by Ron Bodkin of Think Big AnalyticsReal time big data analytics with Storm by Ron Bodkin of Think Big Analytics
Real time big data analytics with Storm by Ron Bodkin of Think Big AnalyticsData Con LA
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssisdeepakk073
 
Sql server-integration-services-ssis-step-by-step-sample-chapters
Sql server-integration-services-ssis-step-by-step-sample-chaptersSql server-integration-services-ssis-step-by-step-sample-chapters
Sql server-integration-services-ssis-step-by-step-sample-chaptersNadinKa Karimou
 
Talend Big Data Capabilities Overview
Talend Big Data Capabilities OverviewTalend Big Data Capabilities Overview
Talend Big Data Capabilities OverviewRajan Kanitkar
 

Andere mochten auch (17)

SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
 
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...
Biml for Beginners - Generating SSIS Packages with BimlScript (SQLSaturday Ex...
 
Managing and Configuring SSIS Packages
Managing and Configuring SSIS PackagesManaging and Configuring SSIS Packages
Managing and Configuring SSIS Packages
 
Top 9 bi interview questions answers
Top 9 bi interview questions answersTop 9 bi interview questions answers
Top 9 bi interview questions answers
 
Informational interview
Informational interviewInformational interview
Informational interview
 
Data Analyst&Scientist course
Data Analyst&Scientist courseData Analyst&Scientist course
Data Analyst&Scientist course
 
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)
Biml for Beginners: Speed up your SSIS development (SQLSaturday Vienna)
 
Good sql server interview_questions
Good sql server interview_questionsGood sql server interview_questions
Good sql server interview_questions
 
Ssis
SsisSsis
Ssis
 
Architecture of integration services
Architecture of integration servicesArchitecture of integration services
Architecture of integration services
 
Sql interview questions and answers
Sql interview questions and  answersSql interview questions and  answers
Sql interview questions and answers
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Real time big data analytics with Storm by Ron Bodkin of Think Big Analytics
Real time big data analytics with Storm by Ron Bodkin of Think Big AnalyticsReal time big data analytics with Storm by Ron Bodkin of Think Big Analytics
Real time big data analytics with Storm by Ron Bodkin of Think Big Analytics
 
SSIS Presentation
SSIS PresentationSSIS Presentation
SSIS Presentation
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssis
 
Sql server-integration-services-ssis-step-by-step-sample-chapters
Sql server-integration-services-ssis-step-by-step-sample-chaptersSql server-integration-services-ssis-step-by-step-sample-chapters
Sql server-integration-services-ssis-step-by-step-sample-chapters
 
Talend Big Data Capabilities Overview
Talend Big Data Capabilities OverviewTalend Big Data Capabilities Overview
Talend Big Data Capabilities Overview
 

Ähnlich wie First Look at SSIS 2012 Project Deployment Model

Microsoft SQL Server 2008 Multi-Server Management
Microsoft SQL Server 2008 Multi-Server ManagementMicrosoft SQL Server 2008 Multi-Server Management
Microsoft SQL Server 2008 Multi-Server ManagementMark Ginnebaugh
 
SSDT Workshop @ SQL Bits X (2012-03-29)
SSDT Workshop @ SQL Bits X (2012-03-29)SSDT Workshop @ SQL Bits X (2012-03-29)
SSDT Workshop @ SQL Bits X (2012-03-29)Gert Drapers
 
Jeamaire Drone’s Business Intelligence Portfolio
Jeamaire Drone’s Business Intelligence PortfolioJeamaire Drone’s Business Intelligence Portfolio
Jeamaire Drone’s Business Intelligence PortfolioHESABLE1
 
Portal Integration with SAP BusinessObjects (SDK)
Portal Integration with SAP BusinessObjects (SDK)Portal Integration with SAP BusinessObjects (SDK)
Portal Integration with SAP BusinessObjects (SDK)DMIMarketing
 
B ix press2013_v6
B ix press2013_v6B ix press2013_v6
B ix press2013_v6MILL5
 
Eclipse Developement @ Progress Software
Eclipse Developement @ Progress SoftwareEclipse Developement @ Progress Software
Eclipse Developement @ Progress Softwaresriikanthp
 
A Primer To Sybase Iq Development July 13
A Primer To Sybase Iq Development July 13A Primer To Sybase Iq Development July 13
A Primer To Sybase Iq Development July 13sparkwan
 
SqlSaturday Denmark 2017 - Automate your SSIS deployment process
SqlSaturday Denmark 2017 - Automate your SSIS deployment processSqlSaturday Denmark 2017 - Automate your SSIS deployment process
SqlSaturday Denmark 2017 - Automate your SSIS deployment processBartosz Ratajczyk
 
Satya\'s Resume
Satya\'s ResumeSatya\'s Resume
Satya\'s Resumesqlmaster
 
Database development with visual studio 2010
Database development with visual studio 2010Database development with visual studio 2010
Database development with visual studio 2010Abhimanyu Singhal
 
Azure DevOps for the Data Professional
Azure DevOps for the Data ProfessionalAzure DevOps for the Data Professional
Azure DevOps for the Data ProfessionalSarah Dutkiewicz
 
Msbi power bi_ lead
Msbi power bi_ leadMsbi power bi_ lead
Msbi power bi_ leadKota Sudhake
 
Rapid SQL Datasheet - The Intelligent IDE for SQL Development
Rapid SQL Datasheet - The Intelligent IDE for SQL DevelopmentRapid SQL Datasheet - The Intelligent IDE for SQL Development
Rapid SQL Datasheet - The Intelligent IDE for SQL DevelopmentEmbarcadero Technologies
 
VS Code and Modern Development Environment Preview
VS Code and Modern Development Environment PreviewVS Code and Modern Development Environment Preview
VS Code and Modern Development Environment PreviewRoberto Stefanetti
 
Post 1 introduction to ssis sql server integration services
Post 1 introduction to ssis sql server integration servicesPost 1 introduction to ssis sql server integration services
Post 1 introduction to ssis sql server integration servicesVijayMohan Vasu
 
Model Driven Architectures
Model Driven ArchitecturesModel Driven Architectures
Model Driven ArchitecturesLalit Kale
 

Ähnlich wie First Look at SSIS 2012 Project Deployment Model (20)

Microsoft SQL Server 2008 Multi-Server Management
Microsoft SQL Server 2008 Multi-Server ManagementMicrosoft SQL Server 2008 Multi-Server Management
Microsoft SQL Server 2008 Multi-Server Management
 
SSDT Workshop @ SQL Bits X (2012-03-29)
SSDT Workshop @ SQL Bits X (2012-03-29)SSDT Workshop @ SQL Bits X (2012-03-29)
SSDT Workshop @ SQL Bits X (2012-03-29)
 
Jeamaire Drone’s Business Intelligence Portfolio
Jeamaire Drone’s Business Intelligence PortfolioJeamaire Drone’s Business Intelligence Portfolio
Jeamaire Drone’s Business Intelligence Portfolio
 
Portal Integration with SAP BusinessObjects (SDK)
Portal Integration with SAP BusinessObjects (SDK)Portal Integration with SAP BusinessObjects (SDK)
Portal Integration with SAP BusinessObjects (SDK)
 
B ix press2013_v6
B ix press2013_v6B ix press2013_v6
B ix press2013_v6
 
Eclipse Developement @ Progress Software
Eclipse Developement @ Progress SoftwareEclipse Developement @ Progress Software
Eclipse Developement @ Progress Software
 
Lalith Thota
Lalith ThotaLalith Thota
Lalith Thota
 
A Primer To Sybase Iq Development July 13
A Primer To Sybase Iq Development July 13A Primer To Sybase Iq Development July 13
A Primer To Sybase Iq Development July 13
 
SqlSaturday Denmark 2017 - Automate your SSIS deployment process
SqlSaturday Denmark 2017 - Automate your SSIS deployment processSqlSaturday Denmark 2017 - Automate your SSIS deployment process
SqlSaturday Denmark 2017 - Automate your SSIS deployment process
 
Satya\'s Resume
Satya\'s ResumeSatya\'s Resume
Satya\'s Resume
 
Database development with visual studio 2010
Database development with visual studio 2010Database development with visual studio 2010
Database development with visual studio 2010
 
Azure DevOps for the Data Professional
Azure DevOps for the Data ProfessionalAzure DevOps for the Data Professional
Azure DevOps for the Data Professional
 
Msbi power bi_ lead
Msbi power bi_ leadMsbi power bi_ lead
Msbi power bi_ lead
 
Rapid SQL Datasheet - The Intelligent IDE for SQL Development
Rapid SQL Datasheet - The Intelligent IDE for SQL DevelopmentRapid SQL Datasheet - The Intelligent IDE for SQL Development
Rapid SQL Datasheet - The Intelligent IDE for SQL Development
 
VS Code and Modern Development Environment Preview
VS Code and Modern Development Environment PreviewVS Code and Modern Development Environment Preview
VS Code and Modern Development Environment Preview
 
Post 1 introduction to ssis sql server integration services
Post 1 introduction to ssis sql server integration servicesPost 1 introduction to ssis sql server integration services
Post 1 introduction to ssis sql server integration services
 
Naveen CV
Naveen CVNaveen CV
Naveen CV
 
Resume gunasundari dba
Resume gunasundari dbaResume gunasundari dba
Resume gunasundari dba
 
Resume gunasundari dba
Resume gunasundari dbaResume gunasundari dba
Resume gunasundari dba
 
Model Driven Architectures
Model Driven ArchitecturesModel Driven Architectures
Model Driven Architectures
 

Kürzlich hochgeladen

So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 

Kürzlich hochgeladen (20)

So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 

First Look at SSIS 2012 Project Deployment Model

  • 1. First Look to SSIS 2012 Pedro Perfeito BI Senior Consultant, Teacher, Developer and Passionate www.pedrocgd.blogspot.com pperfeito@hotmail.com
  • 2. Pedro Perfeito  Pedro Perfeito, 34 years old  IT degre at Universidade Portucalense (UPT-Oporto, 2001)  BI Senior Consultant at Novabase  Participate regulary on Experts-Exchange & Fóruns Microsoft  Master’s degree on Business Intelligence at ISCTE-IUL (Lisbon, 2009)  Certificado mundial em Business Intelligence pela TDWI  Invited teacher at ISCTE-IUL (BI Master) & UPT (BI Short-Master & MBA)  Microsoft MVP (SQL BI) on 2010 and 2011  Co-author of SQL MVP Deep Dives-2nd Edition book  BI Blog with 5 years: www.pedrocgd.blogspot.com  Preparing PhD on Business Intelligence Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 3. SSIS 2012 Book Co-author of the book “Microsoft SQL Server 2012 Integration Services: An Expert Cookbook". Expected publication on April 2012 http://www.packtpub.com/microsoft-sql-server-2012-integration- services-expert-cookbook Pedro Reza Perfeito Rad Blogs: www.pedrocgd.blogspot.com www.rad.pasfu.com Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 4. Agenda Legacy/Package Deployment Model Project Deployment Model Project Deployment Model Developer Monitoring & Developer Experience Control Experience SSDT SSMS SSDT DEMO DEMO DEMO 01 02 03 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 5. Improvements and new features that will favor the development of SSIS projects on SQL Server Data Tools (SSDT) Developer Project Introduction Conclusion Experience I Deployment Model Monitoring Developer & Control Experience II 5 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 6. Improvements and new features #01 Business Intelligence Development Studio (BIDS) is now SQL Server Data Tools (SSDT) - Visual Studio 2010 #02 The tasks and components design are more appealing #03 Undo & redo is now a reality #04 SSIS toolbox improved  Wizards on Source & Destination components  Favorites and Common groups  Double-click add tasks & components to the designer #05 SSIS variables toolbar improved  Add expressions directly  Change the scope of a variable #06 Success, Failure and Progress new indicators Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 7. Previous Version New Version Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 8. Improvements and new features #07 Connections offline, shared or with expressions have now an indicator on the respective connection #08 Copy & paste is now easier without affecting the package layout #09 Just one click to add a Data Viewer to Data Flow arrow #10 Script component debug is now possible (Data Flow) #11 Data Flow column mapper #12 Group components under Data Flow #13 Cache Transform allows saving data to memory and reuse it through Lookup components #14 Zoom-In and Zoom-Out #15 New Expression Task Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 9. Improvements and new features #16 Flat File Source with different number of columns & embedded qualifiers #17 End of 4.000 characters limitation in expressions #18 New SSIS functions #19 New CDC Task and CDC Source and Transform components #20 New DQS Cleansing Transform component Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 10. DEMO 01 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 11. New deployment approach for SSIS Projects Developer Project Introduction Conclusion Experience I Deployment Model Monitoring Developer & Control Experience II 11 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 12. Project Deployment Model - New deployment approach for SSIS Projects - Consider the project as a deployment unit - Uses a SSIS Catalog for managing the several SSIS projects - Under SSMS, there is a folder exclusively created to Catalog - All the information related with SSIS projects (under the catalog) is stored in a SQL database called SSISDB. Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 13. Package vs Project Deployment Models Points Package Project to compare... Deployment Model Deployment Model Deploy unit Package Project Deploy location File System ou MSDB database Integration Services Catalog Run-time values Package Configurations Parameters assignment Location of the values to Package Configurations Environment Variables assign at run-time (SQL, XML...) Package execution DTExec e DTExecUI Stored Procedures SSIS Catalog Logging Through SSIS Log Provider Configuration is not required (sysssislog) or customization (Just select the logging level) Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 14. SSIS Catalog – Folder Structure Projects Packages SSIS Catalog Folder Environment Environments variable Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 15. SSIS Catalog – SSISDB database Executions Executables Operations Project Tasks & Register operations about Executions Containers SSIS catalog. (execution, deploy, config...) Projects Packages Events Projects under Packages under Register SSIS events. SSIS Catalog each Project It depends on the logging level selected Environments Environments of each project. (Can have more than one variable) Parameters Parameters used on each package and/or project Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 16. SSIS Catalog – SSISDB tables The Logging Level defined in the SSIS catalog (or on each execution), influence which tables on SSIS Catalog will be updated Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 17. SSIS Catalog – Logging levels None Basic Performance Verbose No Events OnError OnError BufferSizeTuning OnInformation OnWarning Diagnostic OnPostExecute DiagnosticEx OnPostValidate OnCustomEvent OnPreExecute OnError OnPreValidate OnInformation OnTaskFailed OnPipelinePostEndOfRowset OnWarning OnPipelinePostPrimeOutput OnPipelinePreEndOfRowset OnPipelinePrePrimeOutput OnPostExecute OnPostValidate The Logging Level defined in the SSIS catalog OnPreExecute OnPreValidate (or on each execution) influence the events OnProgress OnTaskFailed saved on each execution OnWarning PackageEnd PackageStart PipelineComponentTime PipelineExecutionPlan PipelineExecutionTrees PipelineInitialization Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 18. SSIS Catalog – Customization Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 19. Project Model – New Features #01 Pre Built-in reports and the possibility to add customs #02 Manage SSIS versions (Easy to restore a previous version) #03 Data tap – Add data viewer without changing a package #04 Automatic logging and the possibility to easily identify the number of rows on any place under any data flow through “RowsSent” column Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 20. Project Model – Data Tap Configuration Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 21. DEMO 02 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 22. Improvements and new features that will favor the development of SSIS projects on SQL Server Data Tools (SSDT) using the Project Deployment Model Developer Project Introduction Conclusion Experience I Deployment Model Monitoring Developer & Control Experience II 22 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 23. Project Model – New Features #01 Parameters #02 Task parameterize #03 Execute Package Task can access parameters of the child package #04 New system variable with a unique and sequence identifier execution @[System::ServerExecutionID] #05 Shared Connection Managers #06 Execute Package Task can view and execute packages referenced in the project Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 24. DEMO 03 Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 25. Business Intelligence Blog www.pedrocgd.blogspot.com Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com
  • 26. Thank you! Copyright by Business Intelligence Blog www.pedrocgd.blogspot.com