Catching and Forecasting Popular Videos on Youtube
Comments
This problem is great, but I've had previous students work with youtube data and regret it intensely. It's very noisy and hard to distill any real signals. This is especially the case for the most popular videos.
Kristina Lerman at ISI has done a lot of really nice work on this task, mostly using Digg data. Her paper with Tad Hogg is one nice example. I'd look over this line of work, and see if some of her data is available. --Wcohen 14:38, 10 October 2012 (UTC)
Overview
Have you ever considered why some videos could attract millions of views within just a few days?
Recently, research community such as Google Research begins to study the characteristics of the popular videos hoping the discovery would benefit the marketing and advertisement(YouTube Analysis). This project intents to model and predict the view pattern of popular videos with the emphasis on viral videos[1]. Specially it involves the following tasks:
- Dataset collection.
- The view growth distribution modeling based on BA model.
- Popularity prediction by Naive method such as SVM or Regression.
Team
Datasets
In Google's paper(Tom Broxton,2011), they adopt their internal datset which is unavailable for research study outside of Google. There exists a public dataset[2] consisting of 1,761 videos metadata. However, several limitations renders it inappropriate for this study.
- Most videos are NOT popular videos(Almost no viral videos).
- Information is incomplete. For example the comments and the information about the uploaded user are missing.
- Clone videos, which refers to the copy of videos uploaded by different users, are manually labeled. Therefore the dataset may not be easily scaled.
A dataset of popular YouTube videos (initially 2000~3000 videos) will be collected in this project. For each video the following information will be included:
- Metadata
- Comments
- Video and thumbnail
- Public statistics
The clone videos will be identified by an automatically approach named Near Duplicate Videos Detection [3].
Baseline Method
Though to be precise there are only few baseline methods in this line of research, the proposed method will be compared against other growth models (Gábor Szabó, 2010) and prediction methods(S. Ardon, 2012). We will also establish an navie baseline by regression or SVM on the collected dataset.
Challenges
- First public dataset on YouTube Popular videos of comprehensive information.
- Video and Thumbnail content analysis (Semantic Object Detection).
- Growth model for the view pattern of viral videos.
Related Work
[4]Tom Broxton and Yannet Interian and Jon Vaver and Mirjam Wattenhofer: Catching a viral video. Journal of Intelligent Information Systems 2011: 1-19.
[5]Youmna Borghol, Siddharth Mitra, Sebastien Ardon, Niklas Carlsson, Derek L. Eager, Anirban Mahanti: Characterizing and modelling popularity of user-generated videos. Perform. Eval. 68(11): 1037-1055 (2011)
[6]Y. Borghol, S. Ardon, N. Carlsson, D. Eager, and A. Mahanti, Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2012), Beijing, China, August 2012, to appear.
[7]Gábor Szabó, Bernardo A. Huberman: Predicting the popularity of online content. Commun. ACM 53(8): 80-88 (2010)
