10-601 Topic Models

This a lecture used in the Syllabus for Machine Learning 10-601B in Spring 2016

Poll: https://piazza.com/class/ij382zqa2572hc

Slides

• Slides in PowerPoint,Slides in PDF.

Readings

• Muphy 27.1-27.3
• LDA is not covered in Mitchell. There's a nice overview paper on LDA by David Blei. It is also covered in Murphy ch 27.3 (don't read 27.3.6) and 27.4.

• Here's the code I discussed in class and some sample data.

Summary

You should know:

• what Gibbs sampling is, and how it can be used for inference in a directed graphical model.
• what graphical models are associated with supervised naive Bayes, unsupervised naive Bayes, and LDA.