This year this class is involved in
a supercomputing productivity study.
Class Information
Tue. Thurs.: 08:0009:30, HSS 1128A.
Course Description
Interdisciplinary introduction to applied parallel computing
on modern supercomputers. Topics include applications oriented
architecture, software systems, MPI, OpenMp, CoArray Fortran, data parallel systems,
caches and vector processors, and parallel
algorithms for numerical algorithms such as linear algebra,
Nbody problems, multigrid, fast multipole, wavelets and
Fourier transforms, mesh generation, and partitioning. The
course includes a project with handson emphasis on
understanding the realities and myths of what is possible
on the world's fastest machines.
Class Schedule
Scribes:
Homeworks
Thursday, 09.23.2004

Introduction
(ppt)

Tuesday, 09.28.2004

MPI
(ppt)
Scribes:

Reading Assignment (Week 2)

Horst Simon Interview
Early Evaluation of the Cray X1 (pdf)
MPI at Argonne, MPI User's Guide (Chapters 1  3) (ps) (pdf)
OpenMP Official Site, Livermore OpenMP Tutorial (Sections 1  3.6) (link)
CoArray Fortran Official Site, read A short introduction to CoArray Fortran, skim The complete language definition, read Why not just use MPI?, read A subset easy to translate into OpenMP Fortran

Thursday, 09.30.2004

OpenMP
(ppt)
Scribes:

Tuesday, 10.05.2004

Parallel Platforms
(ppt)
Scribes:

Thursday, 10.07.2004

Matrix Matrix Multiply
(ppt)
Scribes:

Tuesday, 10.12.2004

The PRAM model
(ppt)
Scribes:

Tuesday, 10.18.2004

CoArray Fortran
(ppt)
Scribes:

Tuesday, 10.21.2004

Sources of Parallelism and Locality in Numerical Methods #1
(ppt)
Scribes:

Tuesday, 10.26.2004

Sources of Parallelism and Locality in Numerical Methods #2
(ppt)
Scribes:

Thursday, 10.28.2004

Algorithmic Techniques on a Ring of Processors
(ppt)
Scribes:

Thursday, 11.9.2004

Scheduling Theory
(pdf)
Scribes:

Thursday, 11.16.2004

Heterogeneous Load Balancing
(ppt)
Scribes:

Projects
Grading Information
10% Scribing and class participation

40% Programming homework

50% Final project

Computing Infrastructure
References
Books
Designing and Building Parallel Programs, by Ian Foster, AddisionWesley Publishing.
(Available Online)

Introduction to parallel computing : Design and Analysis of parallel algorithms, by Vipin Kumar, BenjaminCummings Publishing.

Sourcebook of Parallel Computing, Jack Dongarra, Ian Foster, et al, Morgan Kauffman Publishing.

MPI/OpenMP/CoArray Fortran Documentation
Similar Courses at Other Universities
Applied Parallel Computing, @MIT
(link)

Applications of Parallel Computers, @UC Berkeley
(link)

Parallel Numerical Algorithms, @UIUC
(link)

Interesting Links