- Weeks 1-2: Introduction. Memory hierarchy
Introduction to Parallel and High Performance Computing
(ppt,
pdf)
Parallel Architectures and Performance
(ppt,
pdf)
Caches and memory hierarchy
Part I ( pptx, pdf).
II ( ppt, pdf).
III ( ppt, pdf)
Intel SIMD programming.
( ppt, pdf)
Additional references:
- Week 3: Shared memory programming
Pthreads ( ppt,
pdf).
OpenMP (ppt, pdf).
GPU by Dr. Burak Himmetoglu
Additional references:
Pthreads,
OpenMP.
Homework 1 (Tentative)
Project Ideas.
Related slides on
tree and
similarity computation.
- Weeks 4-5: Distributed memory and cluster programming
MPI Part I
(ppt,
pdf)
Part II (ppt,
pdf).
Hadoop and MapReduce
(ppt,
pdf).
Use MapReduce at Comet (pdf)
Spark (pdf).
Use Spark at Comet (pdf)
Additional references:
Homework 2 (Due on March 1).
- Weeks 6-7: Patterns of Parallelism. Parallel Scientific Computing.
- Weeks 8-9: Data-Intensive Computing
Parallel computing and system support in data mining and search.
Parallelism in Cloud Systems
Similarity computation.
More on Spark design and implementation
Papers:
-
Optimizing Parallel Algorithms for All Pairs Similarity Search.
M. Alabduljalil, X. Tang, T. Yang, WSDM'2013.
-
Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, Ion Stoica. NSDI 2012. April 2012.
Latest papers on Spark
-
W. Zhang et. al,
Low-Cost Data Deduplication for Virtual Machine Backup in Cloud Storage .
USENIX HotStorage'2013.
Slides.
- Weeeks 9-10: Project Presentation, Query Parallelism, and Others
Project presentation slides are distributed in the newsgroup.
Query parallelism in Internet services.
Parallel matlab