Difference between revisions of "10-601 Ensembles 1"

From Cohen Courses
Jump to navigationJump to search
Line 7: Line 7:
 
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich
 
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich
  
=== Take home message ===
+
=== Summary  ===
  
* Overfitting
+
You should know how to implement  these ensemble methods, and what their relative advantages and disadvantages are:
** kNN
+
* Bagging
** Regression
+
* Boosting
 
+
* Stacking
* Bias-variance decomposition
+
* Multilevel Stacking
 
+
* The "bucket of models" classifier
* Structural risk minimization
 
 
 
* The battle against overfitting
 
** Cross validation
 
** Regularization
 
** Feature selection
 

Revision as of 10:19, 15 October 2013

Slides

Readings

Summary

You should know how to implement these ensemble methods, and what their relative advantages and disadvantages are:

  • Bagging
  • Boosting
  • Stacking
  • Multilevel Stacking
  • The "bucket of models" classifier