CHAPTER 2: Message Passing

This chapter is still a work in progress. It shows code using a library called mpi4py to demonstrate message passing. In the future the code will be runnable within this book.

The code shown here and C versions of it can be found in a GitHub repo for the CSInParallel Project. Look for the folder called Patternlets and the subfolder MPI for the C version and mpi4py for the mpi4py version. The example for the last section (forest fire simulation) can be found in Exemplars/mpi4py-examples/fire.

• 2.1 First Steps - Programming with Message Passing
  • The SPMD Pattern
  • The Master-Worker Pattern
• 2.2 Point to Point Communication
  • Send and Receive Hello World
  • Integration - First Attempt
  • Exercise - Populate an Array
  • Ring of passed messages
• 2.3 Deadlock
  • Deadlock Example
  • Visualizing Deadlock
  • Fixing Deadlock
• 2.4 Other Communication Patterns
  • Broadcast
  • Scatter and Gather
  • Reduction
  • Returning to the Array Example
• 2.5 Real World Example - Forest Fire Simulation
  • The parallel MPI version
  • Try some other cases to observe how it scales

You have attempted of activities on this page