Difference between revisions of "10-601 Ensembles 2"
From Cohen Courses
Jump to navigationJump to searchLine 8: | Line 8: | ||
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich | * [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich | ||
* [http://cseweb.ucsd.edu/~yfreund/papers/IntroToBoosting.pdf A Short Introduction to Boosting], Yoav Freund and Robert Schapire. | * [http://cseweb.ucsd.edu/~yfreund/papers/IntroToBoosting.pdf A Short Introduction to Boosting], Yoav Freund and Robert Schapire. | ||
+ | * Optional: [http://dl.acm.org/citation.cfm?id=279960 Improved boosting algorithms using confidence-rated predictions], Robert Schapire and Yoram Singer. | ||
=== Summary === | === Summary === |
Revision as of 09:52, 17 October 2013
Slides
- Slides in PowerPoint.
- Margin "movie" I showed in class: Margin movie.
Readings
- Ensemble Methods in Machine Learning, Tom Dietterich
- A Short Introduction to Boosting, Yoav Freund and Robert Schapire.
- Optional: Improved boosting algorithms using confidence-rated predictions, Robert Schapire and Yoram Singer.
Summary
You should understand the basic intuitions behind the analysis of boosting
- As reducing an upper bound on error and hence fitting the training data
- As a coordinate descent optimization of the same upper bound
You should also be aware that boosting is related to margin classifiers