LTI logo

11-711 Algorithms for NLP
Fall 2010



Detailed Class Schedule

(Posted material is subject to change; announcement will be made during the class)

Back to the main course website

Date Topic Instructor Reading Homework
Aug. 24
Introduction to NLP (slides) Lavie Allen: 1 (all);
Rich & Knight: 14.1-14.2, 15.1-15.2
 
Aug. 26
Introduction to Formal Language Theory (Notation, DFSA) (Notes) Lavie Hopcroft & Ullman: 1 (all), 2.1, 2.2  
Aug. 31
Formal Language Theory (NDFSA) Lavie Hopcroft & Ullman: 2.3, 2.4  
Sept. 2
Formal Language Theory (NDFSA-epsilon) Lavie Hopcroft & Ullman: 2.5 Hand-in guidelines; Homework 1
Sept. 3
Recitation (Equivalence of Dual-Control FSAs and DFSAs) Heafield   Exercises; Notes and solutions
Sept. 7
Formal Language Theory (REs, FSA with Output) Lavie Hopcroft & Ullman: 3.1, 3.2  
Sept. 9
Formal Language Theory (Pumping Lemma, Properties of Regular Languages) Lavie Hopcroft & Ullman: 4.1-4.3  
Sept. 14
Formal Language Theory (Context-Free Grammars) Lavie Hopcroft & Ullman: 5.1, 5.2, 5.4  
Sept. 16
Formal Language Theory (Pushdown Automata) Lavie Hopcroft & Ullman: 6.1-6.3  
Sept. 17
Recitation (Power-Set Construction and the Pumping Lemma) Heafield   Exercises; Notes and solutions
Sept. 21
Introduction to Analysis of Algorithms Slides 2009 slides Heafield   Homework 1 due: solutions. Homework 2 out.
Sept. 23
Formal Language Theory Lavie    
Sept. 28
Formal Language Theory: PDAs Lavie    
Sept. 30
Lexical Analysis and Organization Notes Frederking Allen: 2 (all), 3.7, 4.1-4.3, 9.2, 9.4  
Oct. 1
Recitation Heafield   Exercises Solutions
Oct. 5
Search Techniques and Algorithms 2009 Part I Frederking Rich & Knight: 2 (all), 3 (pp. 63-79) Homework 2 due. Solutions
Oct. 7
Morphology Notes Lavie Jurafsky and Martin, Ch. 3
OPTIONAL: Kaplan & Kay; Oflazer; Karttunen et al.
 
Oct. 8
Recitation: equivalence of empty stack and final state Heafield   Exercises Solutions
Oct. 12
More morpology Lavie    
Oct. 14
Part-of-Speech Tagging 2009 Notes Lavie Allen: 7.1-7.4;
Manning & Shuetze: Ch 10.
 
Oct. 15
Midterm Review
Lavie, Heafield
  2002 Midterm Solutions
Oct. 19
MIDTERM EXAM      
Oct. 21
Search 2009 Part II; Parsing CFLs: CYK Algorithm 2009 Notes Frederking and Lavie Hopcroft, Motwani & Ullman: 7.4 (pp. 298-302) Homework 3 Optional code
Oct. 22
Recitation Heafield   Solutions
Oct. 26
Parsing CFLs: Chart Parsing (2009 Notes) Lavie Allen: 3.4  
Oct. 28
Parsing CFLs: Earley Parsing Algorithm (2009 Notes) Lavie Earley, An Efficient Context-Free Parsing Algorithm  
Nov. 2
Parsing CFLs: LR Parsing (2009 Notes) Hanneman Hopcroft & Ullman: 10.6-10.7 (pp. 248-256) Note: Only appears in old edition of the book.
OPTIONAL: Aho, Sethi, & Ullman, 4.7
Handout 
Nov. 4
Parsing: Statistical Parsing (2009 Notes) Smith Manning & Schuetze: 11, 12;
RECOMMENDED: Charniak, Statistical Techniques for Natural Language Parsing
Homework 3 due. Solutions
Nov. 9
Parsing CFLs: GLR Parsing (2008 Notes) Lavie Tomita, An Efficient Augmented Context-Free Parsing Algorithm Homework 4 and code 
Nov. 11
Parsing: Unification Grammars (2008 Notes) Lavie Allen: 4 (all, 4.6 optional)  
Nov. 12
Recitation Heafield   Earley parsing lecture
Nov. 16
Ambiguity Resolution: Principle-Based Methods (2008 Part I, 2008 Part II) Frederking Allen: Section 6 except 6.2  
Nov. 18
Semantic Processing I (2008 Notes) Frederking Allen: 8  
Nov. 23
Semantic Processing II (2009 Notes) Frederking Allen: 8, Rich & Knight: 10.1, 10.2 Homework 4 due Solutions; Homework 5
Nov. 25
NO CLASS: Thanksgiving Break      
Nov. 30
Natural Language Generation (2008 Notes) Lavie Reiter & Dale  
Dec. 2
Final lecture: Hard Problems in NLP Carbonell   Homework 5 due. Solutions
Dec. 3
Final Review Lavie, Frederking, and Heafield    
Monday Dec. 6 1-4 pm GHC 4301
FINAL EXAM  
GOOD LUCK!
Sample final (PDF)