Message Passing Interface (MPI)

A standard for parallel processing communication.
MPI (1995) C, FORTRAN
MPI-2 (1997) C, C++, FORTRAN

Based on sending messages from process to process:
Point-to-point / Collective
Blocking / Non-blocking
Process groups

Farmi Network Benchmark over LAM MPI (one chl, bonding?):