Introduction to Machine Learning

10-301 + 10-601, Spring 2020
School of Computer Science
Carnegie Mellon University


Important Notes

This schedule is tentative and subject to change. Please check back often.

Lecture Videos

Lecture Polls

This is a permanent link to the current / next poll

Tentative Schedule

Date Lecture Readings Announcements

Classification

Mon, 13-Jan Lecture 1 : Course Overview
[Slides] [Whiteboard] [Video]

Wed, 15-Jan Lecture 2 : Decision Trees
[Slides] [Whiteboard] [Video]

HW1 out

Fri, 17-Jan Recitation: HW1
[Video]

Mon, 20-Jan (No Class: Martin Luther King Day)

Wed, 22-Jan Lecture 3 : Decision Trees
[Slides] [Whiteboard] [Video] [Poll]

HW1 due

HW2 out (Thu)

Fri, 24-Jan Recitation: HW2
[Video]

Mon, 27-Jan Lecture 4 : k-Nearest Neighbors
[Slides] [Whiteboard] [Video] [Poll]

Wed, 29-Jan Lecture 5 : Model Selection
[Slides] [Whiteboard] [Video] [Poll]

Fri, 31-Jan Recitation: Colab / Linear Algebra Libraries / Debugging
[Video]

Mon, 3-Feb Lecture 6 : Perceptron
[Slides] [Whiteboard] [Video] [Poll]

Linear Models

Wed, 5-Feb Lecture 7 : Linear Regression
[Slides] [Whiteboard] [Video] [Poll]
  • Linear Regression. Kevin P. Murphy (2014). Machine Learning: A Probabilistic Perspective. Chapter 7.1-7.3.

HW2 due

HW3 out (Thu)

Fri, 7-Feb Lecture 8 : Optimization for ML
[Slides] [Whiteboard] [Video] [Poll]

Mon, 10-Feb Recitation: HW3
[Video]

Wed, 12-Feb Lecture 9 : Midterm Exam Review / Logistic Regression
[Slides] [Whiteboard] [Video] [Poll]

Exam 1 practice problems out

Fri, 14-Feb (No recitation)

HW3 due

Mon, 17-Feb Lecture 10 : Multinomial Logistic Regression / Feature Engineering
[Slides] [Whiteboard] [Video] [Poll]

Tue, 18-Feb Midterm Exam 1 (7:00PM - 9:00PM) -- details will be announced on Piazza

Deep Learning

Wed, 19-Feb Lecture 11 : Regularization / Neural Networks
[Whiteboard] [Video] [Poll]

HW4 out

Fri, 21-Feb Recitation: HW4
[Video]

Mon, 24-Feb Lecture 12 : Neural Networks
[Whiteboard] [Video] [Poll]

Wed, 26-Feb Lecture 13 : Backpropagation
[Whiteboard] [Video] [Poll]

Fri, 28-Feb Lecture 14 : Deep Learning
[Whiteboard] [Video] [Poll]
  • [Optional] Deep learning. Yann LeCun, Yoshua Bengio, & Geoffrey Hinton (2015). Nature.

HW4 due

HW5 out

Mon, 2-Mar Recitation: HW5
[Video]

Learning Theory

Wed, 4-Mar Lecture 15 : Learning Theory: PAC Learning
[Whiteboard] [Video] [Poll]

Fri, 6-Mar (No class: Mid-semester break)

Mon, 9-Mar (No class: Spring break)

Wed, 11-Mar (No class: Spring break)

Fri, 13-Mar (No class: Spring break)

Mon, 16-Mar Lecture 16 : Learning Theory: PAC Learning
[Whiteboard] [Video] [Poll]

Generative Models

Wed, 18-Mar Lecture 17 : MLE/MAP
[Whiteboard] [Video] [Poll]

HW5 due

HW6 out

Fri, 20-Mar Recitation: HW6
[Video]

Graphical Models

Mon, 23-Mar Lecture 18 : Naive Bayes
[Whiteboard] [Video] [Poll]

Wed, 25-Mar Lecture 19 : Midterm Exam Review / Hidden Markov Models (Part I)
[Whiteboard] [Video] [Poll]

HW6 due

Exam 2 practice problems out (Thu)

Fri, 27-Mar (No recitation)

Mon, 30-Mar Lecture 20 : Hidden Markov Models (Part II)
[Whiteboard] [Video] [Poll]

Tue, 31-Mar Midterm Exam 2 (7:00PM - 9:00PM) -- details will be announced on Piazza

Wed, 1-Apr Lecture 21 : Bayesian Networks
[Whiteboard] [Video] [Poll]

HW7 out

Fri, 3-Apr Recitation: HW7
[Video]

Learning Paradigms

Mon, 6-Apr Lecture 22 : Reinforcement Learning: Markov Decision Processes
[Whiteboard] [Video] [Poll]

Wed, 8-Apr Lecture 23 : Reinforcement Learning: Value/Policy Iteration
[Whiteboard] [Video] [Poll]

Fri, 10-Apr Recitation: HW8
[Video]

HW7 due

HW8 out

Mon, 13-Apr Lecture 24 : Reinforcement Learning: Q-Learning
[Whiteboard] [Video] [Poll]

Wed, 15-Apr Lecture 25 : Deep Reinforcement Learning / K-Means
[Whiteboard] [Video] [Poll]

Fri, 17-Apr (No class: Spring Carnival April 16-18)

Mon, 20-Apr Lecture 26 : Dimensionality Reduction: PCA
[Whiteboard] [Video] [Poll]

Wed, 22-Apr Lecture 27 : SVMs / Kernel Methods
[Whiteboard] [Video] [Poll]

HW8 due

HW9 out

Fri, 24-Apr Recitation: HW9
[Video]

Mon, 27-Apr Lecture 28 : Ensemble Methods / Recommender Systems
[Whiteboard] [Video] [Poll]

Wed, 29-Apr Lecture 29 : Final Exam Review
[Whiteboard] [Video] [Poll]

HW9 due

Exam 3 practice problems out (Thu)

Fri, 1-May (No recitation)

May 4 - 12 Final Exam Period -- exact time/date of final exam is scheduled by the registrar