10-601 Topic Models

This a lecture used in the Syllabus for Machine Learning 10-601 in Fall 2014

Slides

• Slides in PowerPoint,Slides in PDF.

Readings

• LDA is not covered in Mitchell. There's a nice overview paper on LDA by David Blei.

Summary

You should know:

• The relationships between PLSI and matrix factorization.
• what Gibbs sampling is, and how it can be used for inference in a directed graphical model.
• what the graphical models are which are associated with supervised naive Bayes, unsupervised naive Bayes, PLSI, and LDA.