Difference between revisions of "Syllabus for Machine Learning 10-601 in Fall 2014"
From Cohen Courses
Jump to navigationJump to search(121 intermediate revisions by 11 users not shown) | |||
Line 1: | Line 1: | ||
This is the syllabus for [[Machine Learning 10-601 in Fall 2014]]. | This is the syllabus for [[Machine Learning 10-601 in Fall 2014]]. | ||
− | === Schedule === | + | === Lecture Schedule === |
{| border="1" | {| border="1" | ||
Line 8: | Line 8: | ||
! Lecture for 601-B | ! Lecture for 601-B | ||
! Topic | ! Topic | ||
− | ! | + | | Notes |
+ | ! Assignment | ||
|- | |- | ||
− | | Wed 8/27 (Ziv) || Tues 9/2 (Wm) || [[10-601 Introduction to Probability|Course Overview and Introduction to Probability]] || | + | | Wed 8/27 (Ziv) || Tues 9/2 (Wm) || [[10-601 Introduction to Probability|Course Overview and Introduction to Probability]] || || HW0: [http://www.cs.cmu.edu/~wcohen/10-601/self-assessment/Intro_ML_Self_Evaluation.pdf Self-assessment test]. This need not be turned in for a grade. |
|- | |- | ||
− | | Wed 9/3 (Ziv) || Thur 9/4 (Wm) || [[10-601 K-NN | + | | Wed 9/3 (Ziv) || Thur 9/4 (Wm) || [[10-601 Classification and K-NN|Classification and K-NN]] || || |
|- | |- | ||
− | | Mon 9/8 (Ziv) || Tues 9/9 (Wm) || | [[10-601 | + | | Mon 9/8 (Ziv) || Tues 9/9 (Wm) || | [[10-601 Decision Trees|Decision Trees and Rule Learning]] || || |
|- | |- | ||
− | | Wed 9/10 (Ziv) || Thur 9/11 (Wm) || [[10-601 Naive Bayes|The Naive Bayes algorithm]] || HW1: KNN and Decision Trees | + | | Wed 9/10 (Ziv) || Thur 9/11 (Wm) || [[10-601 Naive Bayes|The Naive Bayes algorithm]] || || [http://www.andrew.cmu.edu/user/amaurya/docs/10601/hws/hw1/ HW1: KNN and Decision Trees] [http://www.andrew.cmu.edu/user/amaurya/docs/10601/hws/hw1/hw1_solutions.pdf HW1 Solutions] - due 9/18. Jingwei Shen and Abhinav Maurya |
|- | |- | ||
− | | Mon 9/15 (Ziv) || Tues 9/16 (Wm) || [[10-601 Linear Regression|Linear Regression]] || | + | | Mon 9/15 (Ziv) || Tues 9/16 (Wm) || [[10-601 Linear Regression|Linear Regression]] || || |
|- | |- | ||
− | | Wed 9/17 (Ziv) || Thur 9/18 (Wm) || [[10-601 Logistic Regression|Logistic Regression]] || HW2: Naive Bayes, Linear Regression (Matlab Programming) - due 9/25 | + | | Wed 9/17 (Ziv) || Thur 9/18 (Wm) || [[10-601 Logistic Regression|Logistic Regression]] || || HW2: [http://www.andrew.cmu.edu/user/dbiswas/class/10601/homework/homework2/ Naive Bayes, Linear Regression (Matlab Programming)] , [http://www.andrew.cmu.edu/user/yingyan1/TA10601/Homework2_Solution.pdf Solutions] - due 9/25. Siddhartha Jain and Ying Yang |
|- | |- | ||
− | | Mon 9/22 ('''Wm''') || Tues 9/23 (Wm) || [[10-601 Perceptrons and Voted Perceptrons|The Perceptron algorithm]] || | + | | Mon 9/22 ('''Wm''') || Tues 9/23 (Wm) || [[10-601 Perceptrons and Voted Perceptrons|The Perceptron algorithm]] || || |
|- | |- | ||
− | | Wed 9/24 (Ziv) || Thur 9/25 (Wm) || Neural networks and Deep Belief Networks || HW3: Logistic Regression, Neural networks (Matlab Programming) - due 10/9 | + | | Wed 9/24 (Ziv) || Thur 9/25 (Wm) || [[10-601 Neural networks and Deep Belief Networks|Neural networks and Deep Belief Networks]] || || HW3: [http://www.andrew.cmu.edu/user/dbiswas/class/10601/homework/homework3/ Logistic Regression, Neural networks (Matlab Programming)] - due 10/9. Jin Sun and Harry Gifford |
|- | |- | ||
− | | Mon 9/29 (Ziv) || Tues 9/30 ('''Ziv''') || | + | | Mon 9/29 (Ziv) || Tues 9/30 ('''Ziv''') || [[10-601 SVMs and Margin Classifiers 1|SVMs and Margin Classifiers]] || || |
|- | |- | ||
− | | Wed 10/1 (Ziv) || Thur 10/2 ('''Ziv''') || SVMs and Margin Classifiers 2 || | + | | Wed 10/1 (Ziv) || Thur 10/2 ('''Ziv''') || [[10-601 SVMs and Margin Classifiers 2|SVMs: Duality and kernels]] || || |
|- | |- | ||
− | | Mon 10/6 (Ziv) || Tues 10/7 (Wm) || [[10-601 Evaluation|Evaluating and Comparing Classifiers Experimentally]] || | + | | Mon 10/6 (Ziv) || Tues 10/7 (Wm) || [[10-601 Evaluation|Evaluating and Comparing Classifiers Experimentally]] || || |
|- | |- | ||
− | | Wed 10/8 (Ziv) || Thus 10/9 (Wm) || [[10-601 PAC| PAC Learning]] || | + | | Wed 10/8 (Ziv) || Thus 10/9 (Wm) || [[10-601 PAC| PAC Learning]] || || HW4: [http://www.andrew.cmu.edu/user/dbiswas/class/10601/homework/homework4/ SVM, Comparing classifiers (Experiments) ]- due 10/18. Qihui (Anna) Li and Siping Ji |
|- | |- | ||
− | | Mon 10/13 (''' | + | | Mon 10/13 ('''Dalvi''', k-means) || Tues 10/14 (Ziv, agglomerative+spectral) || [[10-601 Clustering| Clustering]] || || |
|- | |- | ||
− | | Wed 10/ | + | | Wed 10/15 (Ziv, agglomerative+spectral) || Thur 10/16 ('''Dalvi''', k-means) || [[10-601 Clustering| Clustering]] || || HW5: [http://www.andrew.cmu.edu/user/yingyan1/TA10601/hw5.pdf Pac-learning (worksheet)]- due 10/25. Ying Yang and Abhinav Maurya |
|- | |- | ||
− | | Mon 10/20 ( | + | | Mon 10/20 ('''Wm''') || Tues 10/21 (Wm) || [[10-601 Bias-Variance|Bias-Variance Decomposition]] || || |
|- | |- | ||
− | | Wed 10/22 (Ziv) || Thur 10/23 (Wm) || [[10-601 | + | | Wed 10/22 (Ziv) || Thur 10/23 (Wm) || [[10-601 Ensembles|Ensemble Methods]] || |
|- | |- | ||
− | | Mon 10/27 (Ziv) || Tues 10/28 (Wm) || Review | + | | Mon 10/27 (Ziv) || Tues 10/28 (Wm) || [[10-601 Fall 2014 Review Session]] || || |
|- | |- | ||
− | | | + | | Wed 10/29 '''7pm DH 2210''' || Wed 10/29 '''7pm DH 2315'''|| '''Mid-term Exam''' || The midterm for both sections is '''7-9pm 10/29''', and there's no class Thursday 10/30. || [[Old midterm links|Old midterm links]] [http://www.cs.cmu.edu/~sj1/midterm-solutionF.pdf Current midterm solution] |
|- | |- | ||
− | | Mon 11/3 (Ziv) || Tues 11/4 ('''Ziv''') || [[10-601 GM1| | + | | Mon 11/3 (Ziv) || Tues 11/4 ('''Ziv''') || [[10-601 GM1| Bayesian networks ]] || || HW6: [http://www.cs.cmu.edu/~drsilva/files/writeup.pdf unsupervised learning] (programming) - due 11/10. Jingwei Shen and Daniel Ribeiro Silva |
|- | |- | ||
− | | Wed 11/5 (Ziv) || Thur 11/6 ('''Ziv''') || [[10-601 | + | | Wed 11/5 (Ziv) || Thur 11/6 ('''Ziv''') || [[10-601 Inference in HMMs| HMMs - inference]] || || |
|- | |- | ||
− | | Mon 11/10 (Ziv) || Tues 11/11 ('''Ziv''') || [[10-601 | + | | Mon 11/10 (Ziv) || Tues 11/11 ('''Ziv''') || [[10-601 HMMs|HMMs - learning]] || || HW7: HMMS and Graphical Models (worksheet) - due 11/17. Kuo Liu and Harry Gifford |
|- | |- | ||
− | | Wed 11/ | + | | Wed 11/12 ('''Wm''') || Thur 11/13 (Wm) || [[10-601 Matrix Factorization|PCA and Matrix Factorization]]|| ''slides to be updated'' || [http://www.cs.cmu.edu/~wcohen/10-601/project-2014/project.pdf Project Instructions] |
|- | |- | ||
− | | Mon 11/17 ('''Wm''') || Tues 11/18 (Wm) || [[10-601 | + | | Mon 11/17 ('''Wm''') || Tues 11/18 (Wm) || [[10-601 Topic Models| LDA and Network Models]] || || HW8: Topic models (worksheet, experiments with PCA code) - due 11/24. Kuo Liu and Yipei Wang. |
|- | |- | ||
− | | Wed 11/19 ('''Wm''') || Thur 11/20 (Wm)|| Semi-supervised learning || | + | | Wed 11/19 ('''Wm''') || Thur 11/20 (Wm)|| [[10-601 Semi-supervised learning|Semi-Supervised Learning]] || || |
|- | |- | ||
− | | Mon 11/24 ('''Wm''') || Tues 11/25 (Wm) || [[10-601 Big Data|Scalable Learning and Parallelization]] || | + | | Mon 11/24 ('''Wm''') || Tues 11/25 (Wm) || [[10-601 Big Data|Scalable Learning and Parallelization]] || || [http://www.cs.cmu.edu/~wcohen/10-601/project-2014/milestone1.html Submission process for MS1 Writeup] |
|- | |- | ||
− | | Wed 11/26 || Thur 11/27 ||''No class - Thanksgiving'' || | + | | Wed 11/26 || Thur 11/27 || || ''No class - Thanksgiving'' || |
|- | |- | ||
− | | | + | | Mon 12/1 ('''Wm''') || Tues 12/2 (Wm) || [[10-601 Structured Output Learning and NLP|Learning and NLP]] || || Project milestone 1 (Test one classifier per team member on the test data) |
|- | |- | ||
− | | Wed 12/3 (Ziv) || Thurs 12/4 ('''Ziv''') || | + | | Wed 12/3 (Ziv) || Thurs 12/4 ('''Ziv''') || [[10-601 HMM in biology|HMM applications in biology]] || || |
|- | |- | ||
− | | | + | | Wed 12/10|| || || || Project due (Final experiments and writeup) |
|- | |- | ||
|} | |} | ||
+ | === Recitation Schedule === | ||
+ | |||
+ | {| border="1" | ||
+ | |+ '''Schedule for Recitations for 10-601 in Fall 2014''' | ||
+ | ! Recitation Date | ||
+ | ! TAs | ||
+ | ! Topic | ||
+ | ! Notes | ||
+ | |- | ||
+ | | 09/08-09/10 || Yipei Wang and Qihui Li || Matlab Introduction || [http://www.cs.cmu.edu/~sj1/10601/Intro%20to%20Matlab.pptx Slides], [http://www.cs.cmu.edu/~sj1/10601/e1.m e1.m], [http://www.cs.cmu.edu/~sj1/10601/plot_example.m plot_example.m] | ||
+ | |- | ||
+ | | 09/15-09/17 || Jingwei Shen and Abhinav Maurya || Probability, MLE, KNN, Decision Trees || [http://www.andrew.cmu.edu/user/amaurya/docs/10601/recs/rec1/rec_prob_mle.pdf Probability & MLE], [http://www.andrew.cmu.edu/user/amaurya/docs/10601/recs/rec1/rec_entropy_all.pdf Entropy], [http://www.andrew.cmu.edu/user/amaurya/docs/10601/recs/rec1/rec_dectree_all.pdf Decision Trees], [http://www.andrew.cmu.edu/user/amaurya/docs/10601/recs/rec1/rec_knn.pdf KNN] | ||
+ | |- | ||
+ | |- | ||
+ | | 09/22-09/25 || Sid Jain and Ying Yang || Naive Bayes and linear regression || | ||
+ | [http://www.andrew.cmu.edu/user/yingyan1/TA10601/Naive_Bayes_and_Regression.pdf Slides ] | ||
+ | |- | ||
+ | | 09/29-10/03 || Jin Sun and Henry (Harry) Gifford || Math Review || [http://curtis.ml.cmu.edu/w/courses/images/1/19/Math_Review.pdf Math Review] | ||
+ | |- | ||
+ | | 09/29-10/03 || Jin Sun and Henry (Harry) Gifford || Logistic Regression and Neural Networks || [http://curtis.ml.cmu.edu/w/courses/images/b/b0/Recitation.pdf LR and NN slides] | ||
+ | |- | ||
+ | | 10/13-10/17 || Qihui Li and Daniel Ribeiro Silva || SVM and Compare Classifier || [http://curtis.ml.cmu.edu/w/courses/images/2/2e/Rec_week5_svm_compare_classifier.pdf SVM and Compare Classifiers] | ||
+ | |- | ||
+ | | 10/20-10/22 || Ying Yang and Abhinav Maurya || PAC-learning and clustering || [http://www.andrew.cmu.edu/user/yingyan1/TA10601/PAC_learning.pdf PAC-learning] [http://www.andrew.cmu.edu/user/amaurya/docs/10601/recs/rec5/slides_clustering.pdf K-Means and GMM Clustering] | ||
+ | |- | ||
+ | | 11/11-11/13 || Kuo Liu and Harry Glifford || Bayesian Networks and HMMs || [http://www.andrew.cmu.edu/user/dbiswas/class/10601/recitation/recitation7/recitation7.pdf HMMs] | ||
+ | [http://curtis.ml.cmu.edu/w/courses/images/6/6d/Gm.pdf Graphical Models] | ||
+ | |- | ||
+ | | 11/18-11/20 || Kuo Liu and Yipei Wang || SVD PCA CF LDA || [https://www.dropbox.com/s/vdjag3yvx4brdu2/recitation8.ppt?dl=0 Matrix Factorization and Topic Model] | ||
+ | |} | ||
+ | |||
+ | '''Other duties:''' | ||
+ | * Debjani Biswas, Autolab master | ||
+ | * Daniel Ribeiro Silva, Autolab master, assignments 1-4. | ||
+ | * Jin Sun, Piazza monitoring: alerting Ziv and William if there are issues and tracking TA contributions | ||
+ | * Yipei Wang and Qihui (Anna) Li: Matlab | ||
'''To other instructors''': if you'd like to use any of the materials found here, you're absolutely welcome to do so, but please acknowledge their ultimate source somewhere. | '''To other instructors''': if you'd like to use any of the materials found here, you're absolutely welcome to do so, but please acknowledge their ultimate source somewhere. |
Latest revision as of 10:37, 3 December 2014
This is the syllabus for Machine Learning 10-601 in Fall 2014.
Lecture Schedule
Lecture for 601-A | Lecture for 601-B | Topic | Notes | Assignment |
---|---|---|---|---|
Wed 8/27 (Ziv) | Tues 9/2 (Wm) | Course Overview and Introduction to Probability | HW0: Self-assessment test. This need not be turned in for a grade. | |
Wed 9/3 (Ziv) | Thur 9/4 (Wm) | Classification and K-NN | ||
Mon 9/8 (Ziv) | Tues 9/9 (Wm) | Decision Trees and Rule Learning | ||
Wed 9/10 (Ziv) | Thur 9/11 (Wm) | The Naive Bayes algorithm | HW1: KNN and Decision Trees HW1 Solutions - due 9/18. Jingwei Shen and Abhinav Maurya | |
Mon 9/15 (Ziv) | Tues 9/16 (Wm) | Linear Regression | ||
Wed 9/17 (Ziv) | Thur 9/18 (Wm) | Logistic Regression | HW2: Naive Bayes, Linear Regression (Matlab Programming) , Solutions - due 9/25. Siddhartha Jain and Ying Yang | |
Mon 9/22 (Wm) | Tues 9/23 (Wm) | The Perceptron algorithm | ||
Wed 9/24 (Ziv) | Thur 9/25 (Wm) | Neural networks and Deep Belief Networks | HW3: Logistic Regression, Neural networks (Matlab Programming) - due 10/9. Jin Sun and Harry Gifford | |
Mon 9/29 (Ziv) | Tues 9/30 (Ziv) | SVMs and Margin Classifiers | ||
Wed 10/1 (Ziv) | Thur 10/2 (Ziv) | SVMs: Duality and kernels | ||
Mon 10/6 (Ziv) | Tues 10/7 (Wm) | Evaluating and Comparing Classifiers Experimentally | ||
Wed 10/8 (Ziv) | Thus 10/9 (Wm) | PAC Learning | HW4: SVM, Comparing classifiers (Experiments) - due 10/18. Qihui (Anna) Li and Siping Ji | |
Mon 10/13 (Dalvi, k-means) | Tues 10/14 (Ziv, agglomerative+spectral) | Clustering | ||
Wed 10/15 (Ziv, agglomerative+spectral) | Thur 10/16 (Dalvi, k-means) | Clustering | HW5: Pac-learning (worksheet)- due 10/25. Ying Yang and Abhinav Maurya | |
Mon 10/20 (Wm) | Tues 10/21 (Wm) | Bias-Variance Decomposition | ||
Wed 10/22 (Ziv) | Thur 10/23 (Wm) | Ensemble Methods | ||
Mon 10/27 (Ziv) | Tues 10/28 (Wm) | 10-601 Fall 2014 Review Session | ||
Wed 10/29 7pm DH 2210 | Wed 10/29 7pm DH 2315 | Mid-term Exam | The midterm for both sections is 7-9pm 10/29, and there's no class Thursday 10/30. | Old midterm links Current midterm solution |
Mon 11/3 (Ziv) | Tues 11/4 (Ziv) | Bayesian networks | HW6: unsupervised learning (programming) - due 11/10. Jingwei Shen and Daniel Ribeiro Silva | |
Wed 11/5 (Ziv) | Thur 11/6 (Ziv) | HMMs - inference | ||
Mon 11/10 (Ziv) | Tues 11/11 (Ziv) | HMMs - learning | HW7: HMMS and Graphical Models (worksheet) - due 11/17. Kuo Liu and Harry Gifford | |
Wed 11/12 (Wm) | Thur 11/13 (Wm) | PCA and Matrix Factorization | slides to be updated | Project Instructions |
Mon 11/17 (Wm) | Tues 11/18 (Wm) | LDA and Network Models | HW8: Topic models (worksheet, experiments with PCA code) - due 11/24. Kuo Liu and Yipei Wang. | |
Wed 11/19 (Wm) | Thur 11/20 (Wm) | Semi-Supervised Learning | ||
Mon 11/24 (Wm) | Tues 11/25 (Wm) | Scalable Learning and Parallelization | Submission process for MS1 Writeup | |
Wed 11/26 | Thur 11/27 | No class - Thanksgiving | ||
Mon 12/1 (Wm) | Tues 12/2 (Wm) | Learning and NLP | Project milestone 1 (Test one classifier per team member on the test data) | |
Wed 12/3 (Ziv) | Thurs 12/4 (Ziv) | HMM applications in biology | ||
Wed 12/10 | Project due (Final experiments and writeup) |
Recitation Schedule
Recitation Date | TAs | Topic | Notes |
---|---|---|---|
09/08-09/10 | Yipei Wang and Qihui Li | Matlab Introduction | Slides, e1.m, plot_example.m |
09/15-09/17 | Jingwei Shen and Abhinav Maurya | Probability, MLE, KNN, Decision Trees | Probability & MLE, Entropy, Decision Trees, KNN |
09/22-09/25 | Sid Jain and Ying Yang | Naive Bayes and linear regression | |
09/29-10/03 | Jin Sun and Henry (Harry) Gifford | Math Review | Math Review |
09/29-10/03 | Jin Sun and Henry (Harry) Gifford | Logistic Regression and Neural Networks | LR and NN slides |
10/13-10/17 | Qihui Li and Daniel Ribeiro Silva | SVM and Compare Classifier | SVM and Compare Classifiers |
10/20-10/22 | Ying Yang and Abhinav Maurya | PAC-learning and clustering | PAC-learning K-Means and GMM Clustering |
11/11-11/13 | Kuo Liu and Harry Glifford | Bayesian Networks and HMMs | HMMs |
11/18-11/20 | Kuo Liu and Yipei Wang | SVD PCA CF LDA | Matrix Factorization and Topic Model |
Other duties:
- Debjani Biswas, Autolab master
- Daniel Ribeiro Silva, Autolab master, assignments 1-4.
- Jin Sun, Piazza monitoring: alerting Ziv and William if there are issues and tracking TA contributions
- Yipei Wang and Qihui (Anna) Li: Matlab
To other instructors: if you'd like to use any of the materials found here, you're absolutely welcome to do so, but please acknowledge their ultimate source somewhere.