Difference between revisions of "10-601 Ensembles 1"

From Cohen Courses
Jump to navigationJump to search
(Created page with "=== Slides === * [http://www.cs.cmu.edu/~wcohen/10-601/ensembles1.ppt Slides in PowerPoint]. === Readings === *Bishop: Chap 1, 2 *Mitchell: Chap 5, 6 *[http://www.cs.cmu.ed...")
 
Line 5: Line 5:
 
=== Readings ===
 
=== Readings ===
  
−
*Bishop: Chap 1, 2
+
* [http://dl.acm.org/citation.cfm?id=743935 Ensemble Methods in Machine Learning], Tom Dietterich
−
*Mitchell: Chap 5, 6
 
−
*[http://www.cs.cmu.edu/~epxing/papers/Old_papers/feature.pdf Feature Selection in Microarray Analysis], E.P. Xing, in D.P. Berrar, W. Dubitzky and M. Granzow (Eds.), A Practical Approach to Microarray Data Analysis, Kluwer Academic Publishers, 2003.
 
−
*[http://ai.stanford.edu/~ang/papers/icml98-fs.pdf On Feature Selection: Learning with Exponentially many Irrelevant Features as Training Examples], Andrew Y. Ng. In Proceedings of the Fifteenth International Conference on Machine Learning, 1998.
 
  
 
=== Take home message ===
 
=== Take home message ===

Revision as of 10:17, 15 October 2013

Slides

Readings

Take home message

  • Overfitting
    • kNN
    • Regression
  • Bias-variance decomposition
  • Structural risk minimization
  • The battle against overfitting
    • Cross validation
    • Regularization
    • Feature selection
Retrieved from "http://curtis.ml.cmu.edu/w/courses/index.php?title=10-601_Ensembles_1&oldid=16278"