Tentative Weekly References for CS240A, Winter 2013

Weekly References for CS240A (Updated every week)

Week 1: Introduction
Parallel architecture and cluster computing
Memory hierarchy and high performance computing
- Get a class account in Triton by emailing your name, UCSB email, and ssh public key with subject "CS240A ssh key" to scc@oit.ucsb.edu . Instructions on generating ssh keys can be found in http://cs.ucsb.edu/~hnielsen/cs140/ssh-keypair.html
- Slides: Introduction (ppt, pdf). Memory hierarchy (ppt, pdf)
Weeks 2-3: Programming Models
Shared memory programming with Pthreads and OpenMP.
Distributed memory programming and MPI.
Cluster computing with Hadoop and MapReduce.
Homework 1 (Due on Feb 8).
- Slides: Pthreads ( ppt, pdf). OpenMP (ppt, pdf). MPI (ppt, pdf). MapReduce (ppt, pdf)
- Tutorials on Pthreads, OpenMP, MPI, MapReduce, Hadoop/MapReduce
- Hadoop+MapReduce on Triton . Execution script example: ~tyang-ucsb/mapreduce2 on Triton.
- Paper: MapReduce: Simplified Data Processing on Large Clusters Dean and Ghemawhat. OSDI 2004.
Week 4-5: Patterns of Parallelism. Parallel Scientific Computing.
Pattern of parallelism and program transformation.
Parallel applications in computational science.
- Slides: Program Parallelization. Extra. Parallel CSE applications
Weeks 6-8: Data-Intensive Computing. Project Progress Presentation
Parallel computing and system support in data mining and search
- Parallel Boosted Regression Trees for Web Search Ranking Stephen Tyree, Kilian W. Weinberger, Kunal Agrawal and Jennifer Paykin. WWW 2011.
- Optimizing Parallel Algorithms for All Pairs Similarity Search. Slides. M. Alabduljalil, X. Tang, T. Yang, WSDM'2013.
- Incoop: MapReduce for Incremental Computations. Paper . Slides. P. Bhatotia, A. Wieder, R. R., U. A. Acar, and R. Pasquini, ACM Cloud 2011.
- A Platform for Scalable One-pass Analytics using MapReduce, B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy. SIGMOD 2011.
- PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs Slides. J. Gonzalez, Y. Low, H. Gu, D. Bickson and C. Guestrin, OSDI 2012.
Weeks 9: Parallelism in Systems and Internet Services
- Shared memory architecture (ppt, pdf)
- An Analysis of Linux Scalability to Many Cores . Slides. OSDI 2010. S. Boyd-Wickizer, A. T. Clements, Y. Mao, A. Pesterev, M. Frans Kaashoek, R. Morris, and N. Zeldovich.
Other papers
- Tradeoffs in Scalable Data Routing for Deduplication Clusters , Wei Dong, Fred Douglis, Kai Li, Hugo Patterson, Sazzala Reddy, and Philip Shilane, FAST '11: Proceedings of the 9th USENIX Conference on File and Storage Technologies, February 2011 .
- Flat Datacenter Storage E. B. Nightingale, et. al, OSDI 2012.
- Modeling the Parallel Execution of Black-Box Services Gideon Mann, Mark Sandler, Darja Krushevskaja, Sudipto Guha, Eyal Even-Dar HotCloud, Usenix (2011)
- K. Shen et. al, Neptune: Scalable Replica Management and Programming Support for Cluster-based Network Services. In Proc. of the 3rd USENIX Symposium on Internet Technologies and Systems (USITS'01), Pages 197-208, San Francisco CA, March 2001
Final week and project presentation