10606/607, Fall 2018
School of Computer Science
Carnegie Mellon University
This schedule is tentative and subject to change. Please check back often.
Date  Lecture  Readings  Announcements 

Preliminaries 

Mon, 27Aug  Lecture 1
:
Course Overview [Slides] 


Wed, 29Aug  Lecture 2
:
Sets [Slides] 


Fri, 31Aug 
(No Recitation) 


Mon, 3Sep 
No Class: Labor Day 


Wed, 5Sep  Lecture 3
:
Data Types; Functions [Slides] 


Fri, 7Sep 
(No Recitation) 


Linear Algebra 

Mon, 10Sep  Lecture 4
:
Vector spaces; Innerproduct spaces; Matrices [Slides] 


Wed, 12Sep  Lecture 5
:
Matrices and linear operators; Matrix Memories [Slides] 

HW1 out

Fri, 14Sep 
Recitation: HW1 (Abhilasha) 


Mon, 17Sep  Lecture 6
:
Application: Matrix Memories in High Dimensions; Linear Independence; Rank; Invertability [Slides] 


Wed, 19Sep  Lecture 7
:
Spans; Eigenvalues & Eigenvectors; Linear Eqs; Factorizations [Slides] 


Fri, 21Sep 
(No Recitation) 

HW1 due 
Matrix Calculus 

Mon, 24Sep  Lecture 8
:
Scalar Derivatives; Partial Derivatives; Vector Derivatives [Slides] 

HW2 out (Tue)

Wed, 26Sep  Lecture 9
:
Application: Vector Derivatives for Least Squares [Slides] 


Fri, 28Sep 
Recitation: HW2 (Abhinav) 


Mon, 1Oct  Lecture 10
:
Matrix Derivatives; Method of Lagrange Multipliers [Slides] 

HW2 due (Tue) 
Probability 

Wed, 3Oct 
[Quiz 1] (Lecture cancelled) 

HW3 out (Thu)

Fri, 5Oct  Lecture 11
:
Probability over Events (Watch Geoff Gordon's video lecture) [Slides] [Video] 


Mon, 8Oct 
Recitation: HW3 (Abhilasha) 


Wed, 10Oct  Lecture 12
:
[Quiz 2] Discrete Random Variables; Mean & Variance; Continuous Random Variables; Probability: Factorization (Inperson guest lecture by Abhinav) [Slides] 

HW4 out (Thu) HW3 due 
Fri, 12Oct 
Recitation: HW4 (Abhinav) 


Mon, 15Oct  Lecture 13
:
Discrete & Continuous Distributions; Multivariate Distributions; Sampling; Application: Ordinal Regression [Slides] 

HW4 due 
Wed, 17Oct 
Final Exam 6:30pm  9:30pm (Posner Hall A35) 


Fri, 19Oct 
(No Recitation: MiniI Complete) 


Date  Lecture  Readings  Announcements 

Logic & Proofs 

Mon, 22Oct  Lecture 1
:
Course Overview; Logic [Slides] 


Wed, 24Oct  Lecture 2
:
Proof Techniques [Slides] 


Fri, 26Oct 
(No Class: CMU Presidential Inauguration) 


Mon, 29Oct  Lecture 3
:
Proof Techniques; Perceptron Algorithm [Slides] 

HWA out

Wed, 31Oct  Lecture 4
:
Application: Perceptron Mistake Bound [Slides] 


Fri, 2Nov 
Recitation: HWA (Abhilasha) 


Computation 

Mon, 5Nov  Lecture 5
:
Computational Complexity [Slides] 


Wed, 7Nov  Lecture 6
:
Asymtotic Analysis Proofs [Slides] 

HWB out HWA due 
Fri, 9Nov 
(No Recitation) 


Mon, 12Nov  Lecture 7
:
Recursion; Proofs by Induction [Slides] 


Wed, 14Nov  Lecture 8
:
Proofs of Computational Complexity; Proofs of Program Correctness; Dynamic Programming [Slides] 


Fri, 16Nov 
Recitation: HWB (Abhinav) 


Mon, 19Nov  Lecture 9
:
Data Structures for ML Algorithms [Slides] 

HWB due (Tue) 
Wed, 21Nov 
No Class: Thanksgiving Break 


Fri, 23Nov 
No Class: Thanksgiving Break 


Mon, 26Nov  Lecture 10
:
[Quiz A] Application: Factor Graphs [Slides] 

HWC out

Wed, 28Nov  Lecture 11
:
Application: Variable Elimination; Profiling ML Algorithms [Slides] 


Fri, 30Nov 
Recitation: HWC / HWD (Abhilasha / Abhinav) 


Optimization 

Mon, 3Dec  Lecture 12
:
Unconstrained Optimization [Slides] 

HWD out HWC due 
Wed, 5Dec  Lecture 13
:
[Quiz B] (Guest Lecture) Constrained Optimization 


Fri, 7Dec 
(No Recitation) 

HWD due 
Thu, 13Dec 
Final Exam 5:30 PM  8:30 PM (Wean 7500) 

