11-411/611: Natural Language Processing (Spring 2026)

Course Website for S'25

Place and Time: HOA 160, TR 3:30-4:50P

Instructor: Eric Nyberg

Course Description: This course is designed to be accessible to Masters and advanced undergraduate students who seek the basic skills necessary to implement practical Natural Language Processing (NLP) applications using Language Models (LMs) in specific information domains. The syllabus includes learning materials on the core concepts of NLP and LMs, and how they are applied in closed commercial systems (e.g. ChatGPT) as well as open systems (e.g. Llama, T5). Students complete a set of hands-on exercises in Python that develop skills in applying NLP for various practical problems.

Textbook: Jurafsky and Martin, "Speech and Language Processing"

Prerequisite Knowledge: Strong programming skills (in Python); A course in data structures and algorithms (or equivalent experience); A basic knowledge of probability theory and linear algebra

Course Goals: Students acquire basic knowledge of NLP approaches, including language representations, probability theory and language modeling, logistic and softmax regression, word embeddings, neural networks and large language models; and NLP tasks, such as document classification, parsing, knowledge representation and reasoning, translation, and question answering.

Grading (F'25, subject to revision):

Syllabus (S'25, subject to revision):

  1. NLP Landscape and History, Course Objectives
  2. Words and Tokens
  3. N-Gram Language Models
  4. Naive Bayes and Text Classification
  5. Logistic Regression and Text Classification
  6. Embeddings
  7. Neural Networks
  8. Large Language Models
  9. Transformers
  10. Post-Training
  11. Masked Language Models
  12. Information Retrieval and Retrieval-Augmented Generation
  13. Question Answering
  14. Machine Translation
  15. RNNs and LSTMs
  16. Sequence Labelling
  17. Syntax and Parsing
  18. Information Extraction and Coreference
  19. Semantic Role Labelling
  20. Semantics and Reasoning
  21. Natural Language Inference
  22. Ethics and NLP

Last Updated January 12, 2026