Hall emnlp2008

From Cohen Courses
Revision as of 18:59, 1 April 2011 by Dyogatam (talk | contribs)
Jump to navigationJump to search

Citation

  • Title : Studying the History of Ideas Using Topic Models
  • Authors : D. Hall, D. Jurafsky, and C. D. Manning
  • Venue : EMNLP 2008

Summary

This paper uses topic models to study the development of ideas over time for papers in computational linguistics conferences. They also investigated differences and similarities among various CL conferences (ACL, EMNLP, and COLING).
Some of their findings include :

  • There is an increase in research in probabilistic models starting from late 80s (1988).
  • There is a decline in research in semantics between 1978 and 2001, and possibly trending again after 2001.
  • There is a steady increase in research in applications (MT, Speech Recognition, etc.) over time.
  • COLING is a more diverse conference compare to ACL and EMNLP, but all three are becoming broader.
  • Topics in ACL, COLING, and EMNLP conferences are converging (similarities of topics in these conferences are increasing over time).

Dataset

ACL Anthology (~12,500 papers)

Model

Instead of using dynamic topic models, they used static Topic_model (vanilla LDA) with post hoc analysis to calculate observed probability of topics in the current year.
The probability of a topic in a particular year is computed as follows:

where is the date of document d, y is the year, = y means that year()=y, and z is a topic of interest.

Experiments

  • Ran 100 topics LDA, took relevant 36 topics.
  • Seeded words for 10 more topics to improve coverage.
  • Used these 36+10 topics as priors for new 100-topics run.
  • Picked 43 topics and manually labeled them.

Results

This is only a subset of their results. There are more interesting plots in the paper.

  • Trending topics in the CL community
    • Classification, Probabilistic Models, Statistical Parsing, Statistical MT, and Lexical Semantics are trending.

Halltrend.png

  • Declining topics in the CL community
    • Semantics and Discourse are declining.

Halltdecline.png

  • NLP applications
    • They investigated whether CL is becoming more applied over time.
    • The results show gradual increase over time.

Hallapp.png