Difference between revisions of "The Topic-Perspective Model for Social Tagging Systems"

From Cohen Courses
Jump to navigationJump to search
Line 9: Line 9:
  
 
== Summary ==
 
== Summary ==
In this paper, authors propose  LDA type[http://en.wikipedia.org/wiki/Latent_Dirichlet_allocation] generative model for social annotation. Usually tags associated with a particularly URL belongs to either the content of the URL or the tagger’s perspective about the content of URL. In data mining applications, we would be  interested in separating  tags associated with the content from tagger’s perspective. In proposed generative model model, we get probability of each tag being associated with content or tagger perspective. This model improves on previously proposed models for same task where user’s perspective is not fully taken in account.  Tags associated with user perspective can help in improving personalised search.  
+
In this paper, authors propose  LDA type[http://en.wikipedia.org/wiki/Latent_Dirichlet_allocation] generative model for social tag annotation. Usually tags associated with a particularly URL belongs either to the content of the URL or the tagger’s perspective about content of the URL. In data mining applications, we would be  interested in separating  tags associated with the content from tagger’s perspective. In proposed generative model model, we get probability of each tag being associated with content and tagger perspective. In result section, authors shows that this model improves on previously proposed models for same task.  Tags associated with user perspective can help in improving personalized search.  
  
== Evaluation ==
 
  
They evaluate their methods by asking following 4 questions :
+
==Motivation for proposed model==
  - Does NF find out meaningful neighborhoods?
 
  - How close is Approximate NF to exact NF?
 
  - Can AD detect injected anomalies?
 
  - How much time these methods take to run on graphs of varying sizes?
 
  
== Discussion ==
+
1. Document is written before a tagger assigns a tag to the document so term generation process for each document should be separated from the tag generation process. They use standard LDA[http://en.wikipedia.org/wiki/Latent_Dirichlet_allocation] topic model for the term generation process of document.
This paper poses two important social problems related to bipartite social graphs and explained how those problems can be solved efficiently using random walks.
+
 +
2.When a user generates a tag for a document, it depends either on topic distribution of the document or user’s perspective. They use switch variable to decide whether the user’s perspective or the document topic is used in generation of the tag.  
  
They also claim that the neighborhoods over nodes can represent personalized clusters depending on different perspectives.
+
== Model ==
 
+
[[File:SocialTagGM.png]]
During presentation one of the audiences raised question about is anomaly detection in this paper similar to betweenness of edges defined in Kleinber's text as discussed in [[Class Meeting for 10-802 01/26/2010]]. I think they are similar. In the texbook they propose, detecting edges with high betweenness and using them to partition the graph. In this paper they first try to create neighbourhood partitions based on random walk prbabilities and which as a by product gives us nodes and edges with high betweenness value.
+
As shown in figure model is divided in two parts by dashed line. Right part shows the normal LDA generative model. Left part shows how tags are generated. To generate each tag, first an indicator variable x is generated. If x equals 1, then tag is generated using document’s topic distribution. If x is 0 then first a user perspective p is sampled using perspective distribution of user(Theta_u) then tag t is drawn from the tag distribution of perspective p. (SAI_p).
 +
Model figure.
  
 
== Related papers ==
 
== Related papers ==

Revision as of 23:49, 1 October 2012

Citation

The Topic-Perspective Model for Social Tagging Systems Caimei lu, Xiaohua Hu, Xin Chen, Jung-ran Park, TingTing He, and Zhoujun Li

Online version

http://www.pages.drexel.edu/~cl389/dataset/kdd10-lu.pdf

Summary

In this paper, authors propose LDA type[1] generative model for social tag annotation. Usually tags associated with a particularly URL belongs either to the content of the URL or the tagger’s perspective about content of the URL. In data mining applications, we would be interested in separating tags associated with the content from tagger’s perspective. In proposed generative model model, we get probability of each tag being associated with content and tagger perspective. In result section, authors shows that this model improves on previously proposed models for same task. Tags associated with user perspective can help in improving personalized search.


Motivation for proposed model

1. Document is written before a tagger assigns a tag to the document so term generation process for each document should be separated from the tag generation process. They use standard LDA[2] topic model for the term generation process of document.

2.When a user generates a tag for a document, it depends either on topic distribution of the document or user’s perspective. They use switch variable to decide whether the user’s perspective or the document topic is used in generation of the tag.

Model

SocialTagGM.png As shown in figure model is divided in two parts by dashed line. Right part shows the normal LDA generative model. Left part shows how tags are generated. To generate each tag, first an indicator variable x is generated. If x equals 1, then tag is generated using document’s topic distribution. If x is 0 then first a user perspective p is sampled using perspective distribution of user(Theta_u) then tag t is drawn from the tag distribution of perspective p. (SAI_p). Model figure.

Related papers

There has been a lot of work on anomaly detection in graphs.

  • The paper by Moonesinghe and Tan ICTAI06 finds the clusters of outlier objects by doing random walk on the weighted graph.
  • The paper by Aggarwal SIGMOD 2001 proposes techniques for projecting high dimensional data on lower dimensions to detect outliers.

Study plan

  • Article:Bipartite graph:[3]
  • Article:Anomaly detection:[4]
  • Paper:Topic sensitive pagerank:[5]
    • Paper:The PageRank Citation Ranking: Bringing Order to the Web:[6]
  • Paper:Multilevel k-way Partitioning Scheme for Irregular Graphs:[7]