Difference between revisions of "Class meeting for 10-405 Hadoop Overview"

From Cohen Courses
Jump to navigationJump to search
(Created page with "This is one of the class meetings on the schedule for the course Machine Learning with Large Data...")
 
Line 10: Line 10:
 
=== Quiz ===
 
=== Quiz ===
  
* There is no quiz today - you should instead spend the review time actually working with Hadoop on stoat.  You might also look at this [http://www.cs.cmu.edu/~wcohen/10-605/annotated-hadoop-log.txt  annotated log of me interacting with streaming Hadoop].
+
 
 +
* [https://qna.cs.cmu.edu/#/pages/view/244 Today's quiz]
 +
* You might also look at this [http://www.cs.cmu.edu/~wcohen/10-605/annotated-hadoop-log.txt  annotated log of me interacting with streaming Hadoop].
  
 
=== Readings for the Class ===
 
=== Readings for the Class ===

Revision as of 20:57, 28 January 2018

This is one of the class meetings on the schedule for the course Machine Learning with Large Datasets 10-405 in Spring 2018.

Slides

Map-reduce overview:

Quiz

Readings for the Class

  • There are lots of on-line tutorials for Hadoop. The O'Reilly Book is also quite good.

Things to Remember

  • Hadoop terminology: HDFS, shards, job tracker, combiner, mapper, reducer, ...