Tutorials on Writing Parallel Code

After you have your cluster up and running, you can use these links to information about what you need to know about parallel computing and writing new parallel code.

• Introductions to Parallel Computing:

  Parallelization - learn about the issues involved in writing parallel code Getting to Know MPI - get to know the fundamental calls of MPI and build on your knowledge Parallel Zoology - compare and contrast parallel computing types: distributed, grid, and cluster computing and more Parallel Paradigm - understand what, how, and why about programming paradigms for parallel computing

• Tutorials on Writing Parallel Code:

  Parallel Knock - an exhibition of elemental message-passing in a simple parallel code Parallel Adder - a tutorial on converting a single-processor code with independent work into a simple parallel code Parallel Pascal's Triangle - a tutorial on parallelizing a propagation-style single-processor code, implementing a calculation requiring local communication

  Parallel Circle Pi - a tutorial on creating a load balancing parallel code divisible into independent work Parallel Life - a tutorial on parallelizing a propagation-style single-processor code, implementing a two-dimensional calculation requiring local communication Visualization Message-Passing with MacMPI - a tutorial on using MacMPI's monitor window to understand, debug, and optimize parallel code

• Other Resources Assisting with Parallel Code:

  Cluster Software Development Kit - download make files, project files, and code examples for a variety of different compiler and language combinations. Learn by example, pick apart these files for your use, or substitute in your own code.

  • Message-Passing Interfaces (MPIs) - find out about the message-passing libraries available for your parallel computing projects

  • Compiling the MPIs - read instructions describing how to compile your code with the message-passing libraries

  Also, Dauger Research authored the following on Apple's site:
  • Introduction to MPI Programming on Mac OS X - an Apple Developer Connection article introducing MPI and its state on Mac OS X

• and on the MacResearch site:
  • Multicore Eroding Moore's Law - an op/ed article questioning the industry's party line and highlighting the what multicore really means for the computer industry