Difference between revisions of "10-601 Ensembles 2"

From Cohen Courses
Jump to navigationJump to search
Line 8: Line 8:
 
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich
 
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich
 
* [http://cseweb.ucsd.edu/~yfreund/papers/IntroToBoosting.pdf A Short Introduction to Boosting], Yoav Freund and Robert Schapire.
 
* [http://cseweb.ucsd.edu/~yfreund/papers/IntroToBoosting.pdf A Short Introduction to Boosting], Yoav Freund and Robert Schapire.
 +
* Optional: [http://dl.acm.org/citation.cfm?id=279960 Improved boosting algorithms using confidence-rated predictions], Robert Schapire and Yoram Singer.
  
 
===  Summary  ===
 
===  Summary  ===

Revision as of 09:52, 17 October 2013

Slides

Readings

Summary

You should understand the basic intuitions behind the analysis of boosting

  • As reducing an upper bound on error and hence fitting the training data
  • As a coordinate descent optimization of the same upper bound

You should also be aware that boosting is related to margin classifiers