There are a lot of tutorials available on web which might be of great use to people invoved in parallel computing. Listed below are few of the links which I felt were really good. The comments next to each of the tutorials/books gives my prespective of the content and targeted audience. All the lecture notes which are included are in "book" form rather than in form of slides because our point of including these lecture notes was to help people in self study.
| Name | Comments |
|---|---|
|
Designing and Building Parallel Programs
(ISBN 0-201-57594-9; Published by Addison-Wesley) |
An excellent introductory book giving an overall picture of parallel computing to a newcomer. Highly recommended. Include a chapter on MPI giving a quick introduction to it. |
|
Parallel Computing Works
(ISBN 1-55860-253-4; Morgan Kaufmann Publishers) |
The heart of this work is a set of applications largely developed at Caltech from 1985-1990 by the Caltech Concurrent Computation Group. Gives various fields in which parallel computing is useful. |
|
18.337/6.338 Parallel Scientific Computing Lectures (MIT) |
A collection of lecture notes by Prof. Edelman. Together with SMA 5505 it constitutes an advanced interdisciplinary introduction to applied parallel computing on modern supercomputers. includeing numerical topics like nclude dense and sparse linear algebra, N-body problems, multigrid, fast-multipole, wavelets. |
|
Applications of Parallel Computing CS267 (UCB) |
This is a collection of lecture notes by Prof. J. Demmel Covers issues like architecture, programming languages applications and related algorithms. |
|
Lecture Notes for Distributed and High-Performance Computing
Course (Adelide University) |
Another set of good notes for the beginners. Explained in a pretty easy to understand layman's language. |
|
CS 594-29622 Understanding Parallel Architectures:
From Theory To Practice (UTK) |
Lecture notes by Prof. Jack Dongarra. In form of slides so might not be of much help for self study. However do take a look at Overview of Scientific Computing a postscript report by L. Fosdick and E. Jessup (UCB), giving an overview of parallel computing in various fields. Site also has lots of pointers. |
| Name | Comments |
|---|---|
|
Writing Message-Passing Parallel Programs with MPI
(Edinburgh Parallel Computing Centre) |
This constitues a short yet fairly complete introduction to MPI. From a course notes given over a two days course. The bet part of this tutorial is the high in content and interactive. Though it requires installation of few scripts as asked here . |
| MPI: from Fundamentals to Applications | A half-day tutorial by David W. Walker. Gives a good overview of the capabilities of MPI;Demonstrate some of these capabilities with detailed examples and give the rationale behind some of the design decisions. |
| MPI Tutorial Exercises From ANL | Lots and Lots of exercises, solutions and comments provided on almost all aspects of MPI by Bill Gropp who played an important role in making of MPI Standard. His books Using MPI and Using MPI-2 are essentially MPI-standard-and-tutorial-for-newbies. As ususal all the examples of the book can be downloaded from the home page of the book. |
| Maui High Performance Computing Center tutorial | Yet another detailed tutorial with lots of pictures to explain concepts |
|
MPI user's guide in C (postscript)
and (pdf) MPI user's guide in F77 and F90 (pdf only) |
This is a set of good tutorials by Peter Pacheco. Actually they are the draft for the book Parallel Programming with MPI (ISBN 1-55860-339-5 Published by Morgan Kaufmann Publishers Inc.) It is an elementry introduction to MPI.All the codes of this book are also available from book's home page. |
|
MPI: The Complete Reference
(ISBN 95-80471; Published by The MIT Press) |
A definetive documentation of MPI-Standard. It is a detailed discussion of the various issues like design philosophies of MPI. It is not a tutorial to be used by a newcomer. For people who have had some experience with MPI should surely have a look at it. Those of you looking for a books which teach you MPI should take a look at Using MPI and Parallel Programming with MPI. |
|
PVM: Parallel Virtual Machine
(ISBN 0-262-57108-0; Published by The MIT Press) |
It is a users guide and tutorial for networked parallel computing using PVM. Definetly go through the introductory chapter even if you do not use PVM. |
MPI has following two main freely available MPI implementations on UNIX (CHIMP at EPCC has been discontinued).
| Name | Comments |
|---|---|
|
Engineering a Beowulf-style Computer Cluster
(Online,Copyright Robert G. Brown, 24 May 2004) |
It is the a good starting point for those who are planning to bulid a beowulf cluster. Covers a whole lot of issues from parallel computing to building a beowulf. |
| Beowulf Documentation Project and Diskless Nodes HOW-TO document for Linux (LDP) | Unsanctioned and unfettered information on building and using Beowulf systems. |
|
Sparse: Linux cluster with diskless clients (CSIRO Marine Research, Hobart, Australia.) |
This document describes the process of setting up SPARSE - a Linux cluster with diskless clients, built with SuSE 8.0, ClusterNFS and MOSIX. Not only this it has a detailed lots of pointers to the doucuments they used to build the cluster. |