CSCI 338

Parallel Processing

Home | Lectures | Reading Assignments | Programming Assignments | Links | CS@Williams

Calendar

The table below lists the topics we will discuss in class and the readings associated with each topic. The calendar will be updated regularly with new readings.

Assigned readings and corresponding reading assignments should be completed before their associated class meeting.

If lecture slides are used during class, they will be posted shortly before each class. Click on the topic to access the slides (on campus only). If you are off campus, please use the proxy server. The slides and course materials are to help you with the course. Please do not post them publicly.

Date Topic/Slides Reading
[1] Sept. 5 Course overview and Concurrency
[2] Sept. 9 Processes
  • Syllabus and Unix Systems Programming (USP) Ch. 1.1-1.4, 2.1-2.5, 2.11-2.12 Reading Solns
  • Sample code
    • [3] Sept. 12 Pipes and FIFOs
  • USP Ch. 3, 4.1-4.3 Reading Solns
  • Sample code
    • [4] Sept. 16 Parallelism Overview and MPI
  • USP Ch. 4.4, 6.1-6.4, 6.8, 6.10, 8.1-8.2 Reading Solns
  • Sample code
    • [5] Sept. 19 No class. Reading on MPI
  • Intro to Parallel Programming (IPP) Ch. 1.4-1.5, 2.4.4, 2.6-2.7, 3.1-3.3 Reading Solns
    		•
    [6] Sept. 23 MPI
  • IPP Ch. 3.4, 3.7 Reading Solns
    		•
    [7] Sept. 26 Shared Memory Programming with Pthreads
  • IPP Ch. 4.1-4.8 Reading Solns
  • Sample code
    • [8] Sept. 30 Pthreads API
  • No new reading
    • [9] Oct. 3 Pthreads synchronization and MP systems
  • IPP Ch. 2.2.1-2.2.4, 2.3.4, 4.9-4.11 Reading Solns
    		•
    [10] Oct. 7 Pthreads synchronization and caches
  • No new reading
  • Sample code
    		•
    [11] Oct. 10 Caches and Cache coherence
  • Reading on Glow Reading Solns
    		•
    [--] Oct. 14-15 Reading Period
    [12] Oct. 17 Lab Session: C/gdb/valgrind/Makefiles/bash scripting
    • [13] Oct. 21 Cache coherence
    • [14] Oct. 24 Synchronization Primitives in Shared Memory Systems and Intro to GPUs
  • Programming Massively Parallel Processors (PMPP) Ch. 1.1-1.5, 2.1-2.2 Reading Solns
    		•
    [15] Oct. 28 CUDA Programs
  • PMPP Ch. 2.3-3.3 Reading Solns
    		•
    [--] Oct. 31 MIDTERM DURING CLASS
    [17] Nov. 4 GPU execution and memory resouces
  • PMPP 3.4-3.7, 4.1-4.7 Reading Solns
    		•
    [18] Nov. 7 GPU HW and Optimizing Memory Use
    • [19] Nov. 11 GPU Shared Memory and DRAM Basics
  • PMPP 5 Reading Solns
    		•
    [20] Nov. 14 MapReduce
  • MapReduce: Simplified Data Processing on Large Clusters Reading Solns
    		•
    [21] Nov. 18 Data Centers
  • The Tail at Scale
  • Heracles: Improving Resource Efficiency at Scale Reading Solns
    		•
    [22] Nov. 21 Tensor Processing Units
  • In-Datacenter Performance Analysis of a Tensor Processing Unit" Reading Solns
    		•
    [23] Nov. 25 Transactional Memory
  • Transactional Memory Reading Solns
    		•
    [--] Nov. 27 - Dec. 1 Thanksgiving Break
    [24] Dec. 2 Final project presentations
    • [25] Dec. 5 Final project presentations
    • [--] Final Project due 3rd-to-last day of final exam period