Introduction to Machine Learning

10-315, Fall 2021

Carnegie Mellon University

Aarti Singh


Home Teaching Staff Lecture Schedule Recitations Homeworks

Note: this is a tentative lecture schedule that is subject to change.

Date Lecture Slides Useful links
August 30 Monday Intro to ML concepts Intro.pdf, Lecture1_inked Murphy: Sec 1.1-1.3
September 1 Wednesday Bayes classifier, Decision Boundary BayesClassifier_DecisionBoundary.pdf, Lecture2_inked.pdf Bishop: Sec 1.5
September 6 Monday Labor Day -- No class
September 8 Wednesday MLE MLE_MAP.pdf, Lecture3_inked.pdf Bishop: Sec 2.1-2.3.6, Mitchell_Ch
September 13 Monday MAP, Naive Bayes NaiveBayes.pdf, Lecture4_inked.pdf Mitchell_Ch (Secs 1-2)
September 15 Wednesday Logistic Regression LogisticRegression.pdf, Lecture5_inked.pdf Mitchell_Ch (Secs 3-5), On Discriminative and Generative Classifiers, Ng and Jordan, NIPS, 2001 (pdf)
September 20 Monday Linear regression LinearReg.pdf, Lecture6_inked.pdf Murphy: Sec 7.1-7.3
September 22 Wednesday Regularization, Nonlinear regression Regularized_LinReg.pdf, Lecture7_inked.pdf Murphy: Sec 7.5-7.6
September 27 Monday Neural networks NeuralNets.pdf, Lecture8_inked.pdf Goodfellow et al: Ch 6, Demo
September 29 Wednesday Neural networks Lecture9_inked.pdf Goodfellow et al: Ch 6
October 4 Monday Deep Convolutional Neural Networks CNN.pdf, Lecture10_inked.pdf Bishop: Sec 2.5, Goodfellow et al: Ch 9
October 6 Wednesday Decision Trees DecisionTrees, Lecture11_inked.pdf Mitchell: Ch 3
October 11 Monday Nonparametric methods - density estimation, kernel regression, Nearest neighbors nonparametric.pdf, Lecture12_inked.pdf Bishop: Sec 2.5, Notes Eduardo, Murphy: Sec 1.4
October 13 Wednesday Mid-term review Lecture13_inked.pdf
October 18 Monday Midterm Quiz (in-class)
October 20 Wednesday Support Vector Machines (hard, soft) SVM.pdf, Lecture14_inked.pdf Bishop: Sec 7.1.1-7.1.3, Sec 4.1.1, 4.1.2, Appendix E
October 25 Monday Guest lecture-data issues
October 27 Wednesday Support Vector Machines (dual) SVM_dual.pdf, Lecture15_inked.pdf Bishop: Sec 7.1.1-7.1.3, Sec 4.1.1, 4.1.2, Appendix E
November 1 Monday Kernelized SVM, Logistic and Linear Regression Dual_Kernels, Lecture16_inked.pdf Bishop: Sec 6.1, 6.2, SVMdemo, Slides 52-56 KRR Dual derivation, Welling's KRR Notes.pdf
November 3 Wednesday Boosting Boosting.pdf, Lecture17_inked.pdf Bishop: Sec 14.3
Schapire: Boosting Tutorial, Video
November 8 Monday Model selection, cross-validation ModelSel.pdf, Lecture18_inked.pdf Bishop: Sec 1.3, 3.2
November 10 Wednesday Dimensionality Reduction (PCA) Dim_Red_PCA.pdf, Lecture19_inked.pdf Bishop Ch. 12 through 12.1
November 15 Monday Clustering, Mixture models clustering.pdf, Lecture20_inked.pdf Bishop: Sec 9.1,9.2
November 17 Wednesday Expectation-Maximization EM_GMM.pdf, Lecture21_inked.pdf Bishop: Sec 9.1,9.2
November 22 Monday Learning Theory (PAC bounds) theory.pdf, Lecture22_inked.pdf Mitchell: Ch 7, Murphy: Sec 6.5.4
November 24 Wednesday Thanksgiving -- No class
November 29 Monday Final review
December 1 Wednesday Final Quiz (in-class)