Fascinate with SQL SSIS Parallel processing
•
2 likes•1,456 views
What is Parallel Processing ? Where Parallel Processing can be use ? SSIS and BI SSIS vs SQL Stored Procedure SSIS and Parallel Processing How to do SSIS Parallel Processing ? DEMO Off Topic –How to use Auto Test Script for Review and Testing Comparison of all with Time New Innovation –Parallel Processing with Continuous Serial Threading Question, Files and Links
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Fascinate with SQL SSIS Parallel processing
Similar to Fascinate with SQL SSIS Parallel processing (20)
More from Vishal Pawar
More from Vishal Pawar (20)
Recently uploaded
Recently uploaded (20)
Fascinate with SQL SSIS Parallel processing
- 2. About Me - Vishal Pawar • 8 + years of experience in Microsoft BI Stack • Microsoft BI Solution Architect in The Most Group • BI Consulting partner of Right Click Info • Professional Microsoft BI Trainer at Mentalist Network • NMUG Community Leader , Speaker • Microsoft Community Representative for Navi Mumbai region. • SQL PASS Chapter Lead for Mumbai & Navi Mumbai • MCTS: Microsoft® Certified Technology Specialist -SQL Server 2008,Business Intelligence Development and Maintenance • MCSA: Microsoft® Certified Solutions Associate • CSM: Certified Scrum Master from Scrum Alliance, US • SQL Server Expert and 3 Complex SQL tool innovator on Codplex • BE-Computer Science & Engineering , RAIT , Mumbai Univercity • MBA-Information System, Arianth College , Pune • Blogging @ http://bimentalist.com , http://sqlmentalist.com • BI Articles :: 350+ , SQL Article – 400+, SQL Script – 350+
- 3. What is Parallel Processing ? 3 Where Parallel Processing can be use ? SSIS and BI SSIS vs SQL Stored Procedure 3 4 Presentation Agenda 3 2 1 SSIS and Parallel Processing How to do SSIS Parallel Processing ? DEMO Off Topic – How to use Auto Test Script for Review and Testing 5 6 7 8 Comparison of all with Time9 New Innovation – Parallel Processing with Continuous Serial Threading10 3 3 Question, Files and Links 11
- 4. What is Parallel Processing ?
- 5. Serial processing P1 TASK 1 P2P3P4 TASK 2 TASK 3 TASK 4 At t1 At t2 At t3 At t4 Serial Processing
- 6. Parallel Processing P1P2P3P4 TASK 2TASK 3TASK 4 At t1 At t2 TASK 2
- 7. Where Parallel Processing can be use ? Can we use Parallel Processing to read text file C++ Code - http://www.cplusplus.com/reference/cstdio/fread/
- 8. SSIS and Parallel Processing
- 9. Kick of Parallel Process to save time
- 10. Architecture diagram of SQL server
- 11. SQL Server 2014 and Parallelism Will see this when we have SQL 2014
- 12. SSIS Architecture & Parallels
- 13. SSIS and BI MS BI Implementation SSIS 60% SSRS 25% SSAS 15%
- 14. SSIS vs SQL Stored Procedure Performance Features/capabilities Current skill set Complexity Extensibility Architecture of sources Data Quality Checking ETL Framework Development Time
- 15. How Banner Fact Calculation doable in SSIS Parallel Processing ? Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID P1P2P3P4 Develop SQL Statement to Run Only One Survey ID
- 16. DEMO
- 17. How Scale Mean Score doable in SSIS Parallel Processing ? Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID Develop SQL Statement to Run Only One Survey ID P1P2P3P4 Develop SQL Statement to Run Only One Survey ID All Scale mean Calculation But not required as we can calculate this using Response Matrix Calculation
- 18. Off Topic – How to use Auto Test Script for Review and Testing
- 19. Testing Possibilities and Expertise !
- 20. Example of SQL Test Script & Review of Parallel Stats Create Automated Test Script Create Review Test Script 1 2 DEMO Valid N Count Test Banner Fact Count Test
- 21. New Innovation – Parallel Processing with Continuous Serial Threading P1P2P3P4 TASK 2TASK 3TASK 4 At t1 At t2 TASK 2 Batch Of Parallel Processor Parallel Processing with Continuous Serial Threading
- 22. Show me Real Stats !
- 23. Parallel Processing with Continuous Serial Threading Stats
- 24. Comparison of all with Time SP with SQL JOB SP with Paralleled SQL JOB SSIS in SQL JOB SSIS in SQL JOB SSIS with SP in SQL JOB SSIS Parallel Processing With SQL JOB SSIS Parallel Processing With SP With SQL JOB SSIS Parallel Processing With Serial Threading SP With SQL JOB SSIS Parallel Processing With CLR With Serial Threading SP With SQL JOB SQL 2014-SSIS Parallel With CLR With Serial Threading SP With SQL JOB
- 25. Question, PPT and Visio Files and Links • SSIS – An Inside View Part 4 • SSIS Nugget: Engine Threads • Improving the Performance of the Data Flow • Designing Your SSIS Packages for Parallelism (SQL Server Video) • Too Many Sources in a Data Flow • SSIS Operational and Tuning Guide • What Is Parallel Execution In SSIS, How Many Tasks A SSIS Package Can Execute In Parallel? • SSIS How to Process Data as Fastest, Parallel , Multithreaded or in Very Efficient Way !!!