SlideShare ist ein Scribd-Unternehmen logo
1 von 48
Lecture 1 – Parallel Programming Primer CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative Commons Attribution 2.5 License.http://creativecommons.org/licenses/by/2.5
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object]
Parallel Architectures ,[object Object],CPU RAM BUS Bottlenecks
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],Processing  Unit Control Unit Interconnect Processing  Unit Processing  Unit Processing  Unit Processing  Unit
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],Processing/Control  Unit Processing/Control  Unit Processing/Control  Unit Processing/Control  Unit Interconnect
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P P P P P D D D D D O O O O O
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P P P P P P D D D O O
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P Work Pool P P P P Input queue Output queue
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P Input queue Output queue P P buffer buffer
Common Parallel Programming Models ,[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],Workstation Workstation Workstation Workstation Data P4 P3 P2 P1 send(buff1, 1024, p3) receive(buff3, 1024, p1)
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],Workstation T3 T4 T2 T1 Data SMP RAM
Parallel Programming Pitfalls ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Prelude to MapReduce ,[object Object],[object Object],[object Object]
Prelude to MapReduce ,[object Object],[object Object]
References ,[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Was ist angesagt?

Parallel algorithms
Parallel algorithmsParallel algorithms
Parallel algorithms
guest084d20
 
Content addressable-memory
Content addressable-memoryContent addressable-memory
Content addressable-memory
Saravanan Ns
 
Raminder kaur presentation_two
Raminder kaur presentation_twoRaminder kaur presentation_two
Raminder kaur presentation_two
ramikaurraminder
 
Specter - AAL
Specter - AALSpecter - AAL
Specter - AAL
PROBOTEK
 

Was ist angesagt? (20)

Instruction Set (Part 2)
Instruction Set (Part 2)Instruction Set (Part 2)
Instruction Set (Part 2)
 
Data flow architecture
Data flow architectureData flow architecture
Data flow architecture
 
sCode optimization
sCode optimizationsCode optimization
sCode optimization
 
Unit 3 part2
Unit 3 part2Unit 3 part2
Unit 3 part2
 
Data Parallel and Object Oriented Model
Data Parallel and Object Oriented ModelData Parallel and Object Oriented Model
Data Parallel and Object Oriented Model
 
Map reduce in Hadoop
Map reduce in HadoopMap reduce in Hadoop
Map reduce in Hadoop
 
Parallel algorithms
Parallel algorithmsParallel algorithms
Parallel algorithms
 
Parallel language & compilers
Parallel language & compilersParallel language & compilers
Parallel language & compilers
 
Parallel programming model
Parallel programming modelParallel programming model
Parallel programming model
 
Matlab demo
Matlab demoMatlab demo
Matlab demo
 
Content addressable-memory
Content addressable-memoryContent addressable-memory
Content addressable-memory
 
Raminder kaur presentation_two
Raminder kaur presentation_twoRaminder kaur presentation_two
Raminder kaur presentation_two
 
FME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXMFME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXM
 
Matlab for Electrical Engineers
Matlab for Electrical EngineersMatlab for Electrical Engineers
Matlab for Electrical Engineers
 
FME and Complex GML
FME and Complex GMLFME and Complex GML
FME and Complex GML
 
Matrix multiplication
Matrix multiplicationMatrix multiplication
Matrix multiplication
 
Specter - AAL
Specter - AALSpecter - AAL
Specter - AAL
 
Summer training on matlab
Summer training on matlabSummer training on matlab
Summer training on matlab
 
BSTM-MM in VISUM
BSTM-MM in VISUMBSTM-MM in VISUM
BSTM-MM in VISUM
 
Tutorial
TutorialTutorial
Tutorial
 

Andere mochten auch

Compiler Design
Compiler DesignCompiler Design
Compiler Design
Mir Majid
 
BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS
Kak Yong
 

Andere mochten auch (9)

Lec2 Mapred
Lec2 MapredLec2 Mapred
Lec2 Mapred
 
Industrial management
Industrial management Industrial management
Industrial management
 
Industrial management
Industrial managementIndustrial management
Industrial management
 
Lexical analyzer
Lexical analyzerLexical analyzer
Lexical analyzer
 
Compiler Design
Compiler DesignCompiler Design
Compiler Design
 
Compiler Chapter 1
Compiler Chapter 1Compiler Chapter 1
Compiler Chapter 1
 
Networking
NetworkingNetworking
Networking
 
Introduction to computer network
Introduction to computer networkIntroduction to computer network
Introduction to computer network
 
BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS
 

Ähnlich wie Parallel Programming Primer 1

Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming Architecture
Gabriele Modena
 
Clusters (Distributed computing)
Clusters (Distributed computing)Clusters (Distributed computing)
Clusters (Distributed computing)
Sri Prasanna
 
Parallel architecture
Parallel architectureParallel architecture
Parallel architecture
Mr SMAK
 
Parallel programming in modern world .net technics shared
Parallel programming in modern world .net technics   sharedParallel programming in modern world .net technics   shared
Parallel programming in modern world .net technics shared
IT Weekend
 

Ähnlich wie Parallel Programming Primer 1 (20)

Migration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming ModelsMigration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming Models
 
Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming Architecture
 
Chap 1(one) general introduction
Chap 1(one)  general introductionChap 1(one)  general introduction
Chap 1(one) general introduction
 
parellel computing
parellel computingparellel computing
parellel computing
 
Distributed Computing
Distributed ComputingDistributed Computing
Distributed Computing
 
Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1
 
Par com
Par comPar com
Par com
 
Parallel Computing
Parallel ComputingParallel Computing
Parallel Computing
 
Parallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptxParallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptx
 
2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semester2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semester
 
Lecture1
Lecture1Lecture1
Lecture1
 
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
 
Clusters (Distributed computing)
Clusters (Distributed computing)Clusters (Distributed computing)
Clusters (Distributed computing)
 
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
 
Parallel architecture
Parallel architectureParallel architecture
Parallel architecture
 
Parallel Computing 2007: Overview
Parallel Computing 2007: OverviewParallel Computing 2007: Overview
Parallel Computing 2007: Overview
 
Parallel programming in modern world .net technics shared
Parallel programming in modern world .net technics   sharedParallel programming in modern world .net technics   shared
Parallel programming in modern world .net technics shared
 
Parallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET TechnicsParallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET Technics
 
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTINGDYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
 
Prelim Slides
Prelim SlidesPrelim Slides
Prelim Slides
 

Mehr von mobius.cn (6)

Lec4 Clustering
Lec4 ClusteringLec4 Clustering
Lec4 Clustering
 
Lec3 Dfs
Lec3 DfsLec3 Dfs
Lec3 Dfs
 
Lec5 Pagerank
Lec5 PagerankLec5 Pagerank
Lec5 Pagerank
 
Lec1 Intro
Lec1 IntroLec1 Intro
Lec1 Intro
 
Advanced Lighting Techniques Dan Baker (Meltdown 2005)
Advanced Lighting Techniques   Dan Baker (Meltdown 2005)Advanced Lighting Techniques   Dan Baker (Meltdown 2005)
Advanced Lighting Techniques Dan Baker (Meltdown 2005)
 
Influence map
Influence mapInfluence map
Influence map
 

Parallel Programming Primer 1

  • 1. Lecture 1 – Parallel Programming Primer CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative Commons Attribution 2.5 License.http://creativecommons.org/licenses/by/2.5
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.