10-601 Neural networks and Deep Belief Networks

This a lecture used in the Syllabus for Machine Learning 10-601 in Fall 2014

Slides

• Ziv's lecture: Slides in pdf.
• William's slides: in Powerpoint, in PDF

Readings

• Mitchell: Ch. 4, or Bishop: Ch. 5

What You Should Know Afterward

• What functions can be expressed with multi-layer networks that a single layer cannot express
• The backpropagation algorithm, and what loss is associated with it
• In outline, how deep neural networks are trained