Par com

Parallel Processing: Architecture and System Overview Rajkumar Buyya Gri d Computing and D istributed S ystems (GRIDS) Lab . The University of Melbourne, Australia www.gridbus.org/~raj WW Grid

Serial Vs. Parallel COUNTER COUNTER 1 COUNTER 2 Q Please

Overview of the Talk ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Computing Elements Hardware Operating System Applications Programming paradigms P P P P P P   Microkernel Multi-Processor Computing System Threads Interface Process Processor Thread P

Two Eras of Computing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Sequential Era Parallel Era 1940 50 60 70 80 90 2000 2030 Commercialization R & D Commodity

History of Parallel Processing ,[object Object],[object Object],[object Object],[object Object]

Motivating Factor: Human Brain ,[object Object],[object Object],[object Object]

Why Parallel Processing? ,[object Object],[object Object],[object Object],[object Object]

Human Architecture! Growth Performance Age Growth 5 10 15 20 25 30 35 40 45 . . . . Vertical Horizontal

Computational Power Improvement No. of Processors C.P.I 1 2 . . . . Multiprocessor Uniprocessor

Why Parallel Processing? ,[object Object],[object Object]

Processing Elements Architecture

Processing Elements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SISD : A Conventional Computer ,[object Object],Ex: PCs, Workstations Processor Data Input Data Output Instructions

The MISD Architecture ,[object Object],Data Input Stream Data Output Stream Processor A Processor B Processor C Instruction Stream A Instruction Stream B Instruction Stream C

SIMD Architecture ,[object Object],[object Object],C i <= A i * B i Instruction Stream Processor A Processor B Processor C Data Input stream A Data Input stream B Data Input stream C Data Output stream A Data Output stream B Data Output stream C

[object Object],[object Object],[object Object],MIMD Architecture Processor A Processor B Processor C Data Input stream A Data Input stream B Data Input stream C Data Output stream A Data Output stream B Data Output stream C Instruction Stream A Instruction Stream B Instruction Stream C

Shared Memory MIMD machine ,[object Object],[object Object],[object Object],[object Object],[object Object],Global Memory System Processor A Processor B Processor C MEMORY BUS MEMORY BUS MEMORY BUS

Distributed Memory MIMD ,[object Object],[object Object],[object Object],[object Object],[object Object],Processor A Processor B Processor C IPC channel IPC channel MEMORY BUS MEMORY BUS MEMORY BUS Memory System A Memory System B Memory System C

Types of Parallel Systems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Laws of caution..... ,[object Object],[object Object],[object Object],[object Object],C S S P log 2 P

Caution.... ,[object Object],[object Object],[object Object]

Operating Systems for High Performance Computing

Operating Systems for PP ,[object Object],[object Object],[object Object],[object Object],[object Object]

Operating System Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Monolithic Operating System Application Programs Application Programs System Services Hardware ,[object Object],[object Object],Ex: MS-DOS User Mode Kernel Mode

Layered OS ,[object Object],[object Object],[object Object],Application Programs System Services User Mode Kernel Mode Memory & I/O Device Mgmt Hardware Process Schedule Application Programs Ex : UNIX

Traditional OS OS Designer OS Hardware User Mode Kernel Mode Application Programs Application Programs

New trend in OS design User Mode Kernel Mode Hardware Microkernel Servers Application Programs Application Programs

Microkernel/Client Server OS (for MPP Systems) ,[object Object],[object Object],[object Object],[object Object],Client Application Thread lib. File Server Network Server Display Server Microkernel Hardware Send Reply User Kernel

Few Popular Microkernel Systems ,[object Object],[object Object],[object Object],[object Object],[object Object]

Parallel Programs ,[object Object],[object Object]

Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Summary/Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Par com

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (17)

Ähnlich wie Par com

Ähnlich wie Par com (20)

Par com

Hinweis der Redaktion