An intro to parallel computing in python. There is example using mpi4py library. Mostly slide contains pictures, but hopefully the picture is describable.

1. Introduction to Parallel
Computing with Python
Doni Ramadhan

2. What is
Parallel
Computing?

3. What is MPI?

4. MPI Library for
Python

5. Pros &Cons of
MPI
Pros
• Works Concurrently
• Optimize the number
of core
• Tasks will be finished
faster
Cons
• Needs time to setup
• Depends on network
throughput
• It is harder to
program a parallel
program

6. MPI Basics and Implementation

7. Environment
Management
MPI_INIT
MPI_Comm_Size
MPI_Comm_Rank
MPI_Wtime
MPI_Finalize

8. HelloWorld.py

9. Point-to-Point
Communication

10. Point-to-Point
Implementation

11. Buffering
&
Blocking vs.
Non-Blocking
Communication

12. Order and
Fairness

13. Collective
Communication

14. Broadcast

15. Scatter

16. Gather

17. Reduce
Output:

18. Matrix
Multiplication