Difference between revisions of "Gilbert et al., ICWSM 2010"

From Cohen Courses
Jump to navigationJump to search
(Created page with '== Citation == Authors : Eric Gilbert, Karrie Karahalios Title : Widespread Worry and the Stock Market Conference : ICWSM 2010 == Online version == Paper : [http://social.cs…')
 
Line 12: Line 12:
  
 
== Summary ==
 
== Summary ==
 +
The stock market usually reflects business fundamentals, such as corporate earnings. However, we also see many events that seem rooted in human emotion more than anything else, from “irrational exuberance” during booms to panicked sell-offs during busts. In this paper, Gilbert et al used sentiment analysis methods to build an anxiety index for LiveJournal, an active blogging community. Then, they correlated their anxiety index to the S&P 500.
  
 
== Brief description of the method ==
 
== Brief description of the method ==
 +
There are two main parts involved in predicting stock market movement base on anxiety
 +
* Boost Decision Tree
 +
* bagged complement Naive Bayes algorithm
 +
 +
After training on the data set, the author used a combination of these 2 classifiers to make predictions.
  
 
== Experimental result ==
 
== Experimental result ==
 +
The resulted predictions are tested using Granger-causal analysis, which use econometric techniques to tell whether the Anxiety Index provides useful information for projecting future stock market prices not already contained in the market itself. Statistically, this paper showed that in general moods from an online community has novel predictive information about the stock market.
  
 
== Dataset ==
 
== Dataset ==
 +
LiveJournal post stream gathered using atom listener on: [http://atom.services.livejournal.com/atom-stream.xml]

Revision as of 14:54, 6 February 2011

Citation

Authors : Eric Gilbert, Karrie Karahalios

Title : Widespread Worry and the Stock Market

Conference : ICWSM 2010

Online version

Paper : [1]
website : [2]

Summary

The stock market usually reflects business fundamentals, such as corporate earnings. However, we also see many events that seem rooted in human emotion more than anything else, from “irrational exuberance” during booms to panicked sell-offs during busts. In this paper, Gilbert et al used sentiment analysis methods to build an anxiety index for LiveJournal, an active blogging community. Then, they correlated their anxiety index to the S&P 500.

Brief description of the method

There are two main parts involved in predicting stock market movement base on anxiety

  • Boost Decision Tree
  • bagged complement Naive Bayes algorithm

After training on the data set, the author used a combination of these 2 classifiers to make predictions.

Experimental result

The resulted predictions are tested using Granger-causal analysis, which use econometric techniques to tell whether the Anxiety Index provides useful information for projecting future stock market prices not already contained in the market itself. Statistically, this paper showed that in general moods from an online community has novel predictive information about the stock market.

Dataset

LiveJournal post stream gathered using atom listener on: [3]