MapReduce

Master Data Structures

• For map and reduce tasks:
• state
• worker machine for non-idle tasks
• Locations of intermediate files

Preparation readings:

• http://research.google.com/archive/mapreduce-osdi04.pdf
• http://pdos.csail.mit.edu/6.824/notes/l17.txt

MapReduce examples: PangeRank and Collaborative Filtering:

• https://github.com/yaojingguo/data-mining/tree/master/PageRank