Dynamic Social Network Analysis using Latent Space Models

This is one of the paper written in course Social Media Analysis 10-802 in Spring 2011

Citation

Purnamrita Sarkar, Andrew W. Moore "Dynamic Social Network Analysis using Latent Space Models"

Online Version

SIGKDD 2005

Summary

This paper address the problem of Social Network Analysis using the method of Latent Space Models. More specifically, it addresses the problem of network evolution in social network analysis, by modelling the way in which the friendships drift over time. It efficiently learns this even when n is large, by assuming that nodes represented by points in the latent space do not make large movements over time. Hence it is a latent space model developed for dynamic analysis of social networks to predict the future link structure of the graph.

This paper is generalization of static modelling in Latent Space Models to Dynamic Social Networks by allowing latent coordinates to change smoothly over time, that is, between any two discretized time steps large movements of points are improbable.

This technique is applied to NIPS data to analysis the dynamics of network evolution.

Overview of the Method

Suppose that each observed link is associated with a discrete time step, then each time step produces its own graph. Further, with the Markov assumption the latent locations at the next time step are conditionally independent of locations in all other time steps given locations in current time step. This is very similar to method to HMM models.

Let $G_{t}$ be the graph at the time step t with n nodes. Let each node at the time step t be represented in p-dimensional latent space, and let $X_{t}$ be a $n\ x\ p$ matrix where each row represents the co-ordinates of a node. The conditional independence assumption shown in the figure below and hence we have the following

${\begin{array}{lcl}X_{t}&=&{\underset {X}{\operatorname {arg\,max} }}\ P(X|G_{t},X_{t-1})\\&=&{\underset {X}{\operatorname {arg\,max} }}\ P(G_{t}|X)P(X|X_{t-1})\\\end{array}}$

Hence we need to model two probability distributions $P(G_{t}|X)$ and $P(X_{t}|X_{t-1})$. The intuition is that $P(G_{t}|X)$ is to estimate a graph such that links between pairs of entities which are far away in the latent Euclidian space are less probable and other distribution $P(X_{t}|X_{t-1})$ models the smoothness and assigns large movements of points in latent space less probable.

Model Description

Let us denote the distance between two nodes $i,j$ in the euclidean latent space as $d_{ij}$. Also, a radius parameter $r_{i}$ is introduced for every node $i$, which is learned from the data. Further, $r_{ij}$ is defined as greater of the radius of nodes $i$ and $j$. Then the probability that there is a link between nodes $i$ and $j$ is given by

$p_{ij}={\frac {1}{1+e^{(d_{ij}-r_{ij}}}}$

Therefore the probability that we observe a graph $G_{t}$ given coordinates $X_{t}$ is given by

$p(G_{t}|X_{t})=\prod _{i\sim j}p_{ij}\prod _{i\not \sim j}(1-p_{ij})$

Further, they show that it is possible to eliminate quadratic computation of the model over all pairs of links by introducing bi-quadratic kernel, hence it simplifies that two nodes have high probability of a link if their latent coordinates are within the radius of $r_{ij}$ of one another.

The transition probability $P(X_{t}|X_{t-1})$ is simply taken as Guassian in the following way. The parameter $\sigma$ controls the smoothness of transition

$X_{t}\sim N(X_{t-1},\sigma ^{2})$

Algorithm

Now that the probability distributions are estimable we need to do the optimization problem to find the right $X$ which maximizes the product of these probability distributions. First, the latent coordinates are initialized by a time-dependent variation of the classical Multidimensional Scaling