Difference between revisions of "Sparse Additive Generative Models of Text"
From Cohen Courses
Jump to navigationJump to searchLine 9: | Line 9: | ||
== Methodology == | == Methodology == | ||
+ | |||
+ | |||
+ | [[File:sage.png]] | ||
+ | |||
+ | == Experimental Results == |
Revision as of 07:52, 4 October 2012
This Paper is available online [1].
Summary
Sparse Additive Generative Models of Text, or SAGE, is an interesting alternative to traditional generative models for text. The key insight of the paper is that you can model latent classes or topics as a deviation in log-frequency from a constant background distribution. It has the advantage of enforcing sparsity which the authors argue prevents over-fitting. Additionally, generative facets can be combined through addition in the log space, avoiding the need for switching variables.