Difference between revisions of "Class meeting for 10-605 Hadoop Overview"

From Cohen Courses
Jump to navigationJump to search
 
Line 10: Line 10:
 
=== Quiz ===
 
=== Quiz ===
  
* There is no quiz today - you should instead spend the review time actually working with Hadoop on stoat.  You might also look at
+
* There is no quiz today - you should instead spend the review time actually working with Hadoop on stoat.  You might also look at this [http://www.cs.cmu.edu/~wcohen/10-605/annotated-hadoop-log.txt  annotated log of me interacting with streaming Hadoop].
this [http://www.cs.cmu.edu/~wcohen/10-605/annotated-hadoop-log.txt  annotated log of me interacting with streaming Hadoop].
 
  
 
=== Readings for the Class ===
 
=== Readings for the Class ===

Latest revision as of 10:03, 7 September 2017

This is one of the class meetings on the schedule for the course Machine Learning with Large Datasets 10-605 in Fall 2017.

Slides

Map-reduce overview:

Quiz

Readings for the Class

  • There are lots of on-line tutorials for Hadoop. The O'Reilly Book is also quite good.

Things to Remember

  • Hadoop terminology: HDFS, shards, job tracker, combiner, mapper, reducer, ...