CS290I (240B): Parallel Computing and Program Parallelization

Spring 1996, 4 units, Code 47183. MW 11:00-12:15, Engr. 1132.

Instructor:

Topics:

Parallel programming on the Meiko CS-2 and networked workstations.
Representation of parallelism, dependence analysis, program transformation.
Program and data partitioning. Memory hierarchies and data locality.
Run-time compilation.
Task scheduling, load balancing and graph partitioning.
Applications (parallel numerical linear algebra such as dense and sparse matrix computations, WWW servers).
Compilers, run-time support and libraries for high performance computing.

Handouts:

Course syllabus (Location, topics, and lecture plan) HTML.
Homework and prorgamming assignments:
Sample solutions.

Course materials:

Numerical Linear Algebra on Parallel Processors by James Demmel, 1995. To be published by SIAM. HTML.
"Designing and Building Parallel Programs". by Ian Foster. 1995, Addison-Wesley Publishing. HTML.

Other on-line references:

• Parallel Programming on the Meiko CS-2 Machine at UCSB. HTML.
• More on the Meiko CS-2 machine and getting help. HTML.
• PVM. A Users' Guide and Tutorial for Networked Parallel Computing.

Other interesting WWW sites:

• Glossary of High Performance Computing and Communication.
• NHSE Catalog of Commercial Hardware and Software Vendors. A list of parallel computing sites (supercomputer vendors, Research, etc).
• Computational science resources on the Internet.
• High Performance Scientific Computing by L. Fosdick, E. Jessup, C. Schauble, An on-line reference on high performance scientific computing. Postscript files.
• UCSB Parallel Systems Lab.

1996 CS110B: Parallel Scientific Computing.