This session was done during the SQL Saturdays #115 held in Portugal and provides a first look to the new SQL Integration Services (SSIS) version. For more details visit my blog at www.pedrocgd.blogspot.com
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
First Look at SSIS 2012 Project Deployment Model
1. First Look to SSIS 2012
Pedro Perfeito
BI Senior Consultant, Teacher,
Developer and Passionate
www.pedrocgd.blogspot.com
pperfeito@hotmail.com
2. Pedro Perfeito
Pedro Perfeito, 34 years old
IT degre at Universidade Portucalense (UPT-Oporto, 2001)
BI Senior Consultant at Novabase
Participate regulary on Experts-Exchange & Fóruns Microsoft
Master’s degree on Business Intelligence at ISCTE-IUL (Lisbon, 2009)
Certificado mundial em Business Intelligence pela TDWI
Invited teacher at ISCTE-IUL (BI Master) & UPT (BI Short-Master & MBA)
Microsoft MVP (SQL BI) on 2010 and 2011
Co-author of SQL MVP Deep Dives-2nd Edition book
BI Blog with 5 years: www.pedrocgd.blogspot.com
Preparing PhD on Business Intelligence
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
3. SSIS 2012 Book
Co-author of the book “Microsoft SQL Server
2012 Integration Services: An Expert Cookbook".
Expected publication on April 2012
http://www.packtpub.com/microsoft-sql-server-2012-integration-
services-expert-cookbook
Pedro Reza
Perfeito Rad
Blogs:
www.pedrocgd.blogspot.com
www.rad.pasfu.com
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
4. Agenda
Legacy/Package Deployment Model Project Deployment Model
Project Deployment Model
Developer Monitoring & Developer
Experience Control Experience
SSDT SSMS SSDT
DEMO DEMO DEMO
01 02 03
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
5. Improvements and new features that will favor the
development of SSIS projects on SQL Server Data
Tools (SSDT)
Developer Project
Introduction Conclusion
Experience I Deployment Model
Monitoring Developer
& Control Experience II
5
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
6. Improvements and new features
#01 Business Intelligence Development Studio (BIDS) is now SQL Server
Data Tools (SSDT) - Visual Studio 2010
#02 The tasks and components design are more appealing
#03 Undo & redo is now a reality
#04 SSIS toolbox improved
Wizards on Source & Destination components
Favorites and Common groups
Double-click add tasks & components to the designer
#05 SSIS variables toolbar improved
Add expressions directly
Change the scope of a variable
#06 Success, Failure and Progress new indicators
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
7. Previous
Version
New
Version
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
8. Improvements and new features
#07 Connections offline, shared or with expressions have now an indicator
on the respective connection
#08 Copy & paste is now easier without affecting the package layout
#09 Just one click to add a Data Viewer to Data Flow arrow
#10 Script component debug is now possible (Data Flow)
#11 Data Flow column mapper
#12 Group components under Data Flow
#13 Cache Transform allows saving data to memory and reuse it through
Lookup components
#14 Zoom-In and Zoom-Out
#15 New Expression Task
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
9. Improvements and new features
#16 Flat File Source with different number of columns & embedded qualifiers
#17 End of 4.000 characters limitation in expressions
#18 New SSIS functions
#19 New CDC Task and CDC Source and Transform components
#20 New DQS Cleansing Transform component
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
10. DEMO
01
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
11. New deployment approach for SSIS Projects
Developer Project
Introduction Conclusion
Experience I Deployment Model
Monitoring Developer
& Control Experience II
11
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
12. Project Deployment Model
- New deployment approach for SSIS Projects
- Consider the project as a deployment unit
- Uses a SSIS Catalog for managing the several SSIS projects
- Under SSMS, there is a folder exclusively created to Catalog
- All the information related with SSIS projects (under the catalog)
is stored in a SQL database called SSISDB.
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
13. Package vs Project Deployment Models
Points Package Project
to compare... Deployment Model Deployment Model
Deploy unit Package Project
Deploy location File System ou MSDB database Integration Services Catalog
Run-time values Package Configurations Parameters
assignment
Location of the values to Package Configurations Environment Variables
assign at run-time (SQL, XML...)
Package execution DTExec e DTExecUI Stored Procedures SSIS Catalog
Logging Through SSIS Log Provider Configuration is not required
(sysssislog) or customization (Just select the logging level)
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
14. SSIS Catalog – Folder Structure
Projects Packages
SSIS Catalog Folder
Environment
Environments
variable
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
15. SSIS Catalog – SSISDB database
Executions Executables Operations
Project Tasks & Register operations about
Executions Containers SSIS catalog. (execution,
deploy, config...)
Projects Packages Events
Projects under Packages under Register SSIS events.
SSIS Catalog each Project It depends on the
logging level selected
Environments
Environments of each
project. (Can have more
than one variable)
Parameters
Parameters used on each
package and/or project
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
16. SSIS Catalog – SSISDB tables
The Logging Level defined in
the SSIS catalog (or on each
execution), influence which
tables on SSIS Catalog will be
updated
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
17. SSIS Catalog – Logging levels
None Basic Performance Verbose
No Events OnError OnError BufferSizeTuning
OnInformation OnWarning Diagnostic
OnPostExecute DiagnosticEx
OnPostValidate OnCustomEvent
OnPreExecute OnError
OnPreValidate OnInformation
OnTaskFailed OnPipelinePostEndOfRowset
OnWarning OnPipelinePostPrimeOutput
OnPipelinePreEndOfRowset
OnPipelinePrePrimeOutput
OnPostExecute
OnPostValidate
The Logging Level defined in the SSIS catalog OnPreExecute
OnPreValidate
(or on each execution) influence the events OnProgress
OnTaskFailed
saved on each execution OnWarning
PackageEnd
PackageStart
PipelineComponentTime
PipelineExecutionPlan
PipelineExecutionTrees
PipelineInitialization
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
18. SSIS Catalog – Customization
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
19. Project Model – New Features
#01 Pre Built-in reports and the possibility to add customs
#02 Manage SSIS versions (Easy to restore a previous version)
#03 Data tap – Add data viewer without changing a package
#04 Automatic logging and the possibility to easily identify the number of
rows on any place under any data flow through “RowsSent” column
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
20. Project Model – Data Tap Configuration
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
21. DEMO
02
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
22. Improvements and new features that will favor the
development of SSIS projects on SQL Server Data
Tools (SSDT) using the Project Deployment Model
Developer Project
Introduction Conclusion
Experience I Deployment Model
Monitoring Developer
& Control Experience II
22
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
23. Project Model – New Features
#01 Parameters
#02 Task parameterize
#03 Execute Package Task can access parameters of the child package
#04 New system variable with a unique and sequence identifier execution
@[System::ServerExecutionID]
#05 Shared Connection Managers
#06 Execute Package Task can view and
execute packages referenced in the project
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
24. DEMO
03
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com
25. Business Intelligence Blog
www.pedrocgd.blogspot.com
Copyright by Business Intelligence Blog
www.pedrocgd.blogspot.com