07-280 AI & ML I

Fall 2026

Overview

Key Information

Tuesday + Thursday, 11:00 am - 12:20 pm, Wean Hall (WEH) 7500

Friday afternoon, see Recitations

Amy Zhang, Percy Xu, Isha Debnath, Harrison Williams, Jessica Lee Chen, Johnny Tran, Luit Deka, Neil Purohit, Roy Park, Kate Lee, see the 280 Staff page

Grades will be collected in Canvas.
Midterms 15% (each), Final 25%, Programming/Written homework 30%, Online homework 5%, Pre-reading 5%, Participation 5%

There is no required textbook for this course. Most recommended readings will come from sources freely available online; the notable exception is the AIMA textbook, which has limited availability via CMU Library. See Schedule for details.

Students will turn in their homework electronically using Gradescope.

This course provides an integrated introduction to artificial intelligence and machine learning that bridges core AI methods with modern approaches. Students develop both theoretical mastery and practical expertise by combining foundational concepts with the construction of influential AI systems.

The curriculum covers foundational materials in search, machine learning, reinforcement learning, and probability. Students then build on these to construct detailed implementations of landmark AI systems such as AlexNet, GPT-2, and AlphaZero. This rigorous approach develops the analytical skills needed to build the future AI. Finally, as an essential component, this course will address the ethics and responsible development of AI/ML technology and products.

The course emphasizes both technical excellence and ethical considerations in AI development. It serves as the foundation for 07-380 Artificial Intelligence and Machine Learning II, which explores advanced topics, research methods, and specialized applications.

Office Hours

The calendar of office hours (and recitations) is below.

OHQueue: Link

Instructor OH by Appointment

To meet with Nihar or Aviral, please send them an email with the course number in the subject line and a brief topic of discussion in the body. If none of the available office hours meet your needs, please contact us via a private post on Piazza with a list of times that work for you to meet.

Schedule

Subject to change

Textbooks:

(AIMA) Russell, Stuart and Peter Norvig. Artificial Intelligence: A Modern Approach, 4th Edition, available via CMU Library

Bishop, Christopher. Pattern Recognition and Machine Learning, available online

Daumé III, Hal. A Course in Machine Learning, available online

(DL) Goodfellow, Ian, Yoshua Bengio, Aaron Courville. Deep Learning, available online

(MML) Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong. Mathematics for Machine Learning, available online

Mitchell, Tom. Machine Learning, available online

Murphy, Kevin P. Machine Learning: A Probabilistic Perspective, available online

(KMPA) Shaw-Taylor, John, Nello Cristianini. Kernel Methods for Pattern Analysis, available online

Dates Topic Lecture Materials
(or nearest neighbor pdf
prior to lecture)
Pre-Reading Reading (optional)
8/25 Tue 1. Introduction, AI Alignment, and Safety 07280_F26_lecture1_nihar.pdf

Notation_Guide.pdf
Math_Background.pdf
AI Alignment.pdf
Search Pre-reading
Checkpoint due 8/26 Wed, 11:59 pm
MML 2.1-3, 2.5, 2.6 and 3.1, 3.2.1, 3.3
8/27 Thu 2. Heuristic Search
9/1 Tue 3. Adversarial Search Adversarial_Search.pdf
Checkpoint due 8/31 Mon, 11:59 pm
9/3 Thu 4. Constraint Satisfaction Problems
9/8 Tue 5. ML Problem Formulation Checkpoint due 9/7 Mon, 11:59 pm
9/10 Thu 6. Decision Trees
9/15 Tue 7. Linear Regression Checkpoint due 9/14 Mon, 11:59 pm
9/17 Thu 8. Optimization
9/22 Tue 9. Logistic Regression Checkpoint due 9/21 Mon, 11:59 pm
9/24 Thu 10. Feature Engineering and Regularization
9/29 Tue 11. Neural Networks Checkpoint due 9/28 Mon, 11:59 pm
10/1 Thu 12. Backpropagation
10/6 Tue Midterm Exam 1
In-class
10/8 Thu 13. Computer Vision Checkpoint due 10/7 Wed, 11:59 pm
10/13 Tue No class: Fall Break
10/15 Thu No class: Fall Break
10/20 Tue 14. Pre-training/Transfer Learning/Fine-tuning Checkpoint due 10/20 Tue, 11:59 pm
10/22 Thu 15. MLE and Probabilistic Modeling
10/27 Tue 16. Markov Chains, N-grams, Smoothing Checkpoint due 10/26 Mon, 11:59 pm
10/29 Thu 17. Feature Learning and Word Embedding
11/3 Tue No class: Democracy Day
11/5 Thu 18. Tokenization, Position Encoding, Attention
11/10 Tue 19. Transformer LLMs Checkpoint due 11/9 Mon, 11:59 pm
11/12 Thu 20. Markov Decision Processes
11/17 Tue 21. Reinforcement Learning Checkpoint due 11/16 Mon, 11:59 pm
11/19 Thu 22. Deep Reinforcement Learning
11/24 Tue Midterm Exam 2
In-class
11/26 Thu No class: Thanksgiving Break
12/1 Tue 23. Monte Carlo Tree Search Checkpoint due 11/30 Mon, 11:59 pm
12/3 Thu 24. LLM Post Training
Study n'at
TBA Final Exam
Date & location TBA

Recitation

Recitation starts the first week of class, Friday, Aug. 28th. Recitation attendance is recommended to help solidify weekly course topics. That being said, the recitation materials published below are required content and are in scope for midterms 1 and 2. Students frequently say that recitations are one of the most important aspects of the course.

Recitation section assignments will be locked down after the third week. Until then, you may try attending different recitation sections to find the best fit for you. In the case of any over-crowded recitation sections, priority goes to students that are officially registered for that section in SIO. The process to select your final recitation assignment will be announced on Piazza as we get closer to Recitation 4.

Recitations will be on Fridays in the following individual recitation sections:


Section Time Location TAs Resources
A Friday 10:00 am - 10:50 am GHC 4301 Isha, Amy TBA
B Friday 11:00 am - 11:50 am GHC 4301 Percy, Roy TBA
C Friday 12:00 pm - 12:50 pm GHC 4301 Luit, Jessica TBA
D Friday 1:00 pm - 1:50 pm GHC 4301 Luit, Kate TBA
E Friday 2:00 pm - 2:50 pm GHC 4301 Johnny, Harrison TBA
F Friday 3:00 pm - 3:50 pm WEH 5312 Neil, Roy TBA


Dates Recitation Handout/Code
8/28 Fri Search
9/4 Fri Adversarial Search & CSPs
9/11 Fri Decision Trees
9/18 Fri Matrix Calc & Linear Regression
9/25 Fri Logistic Regression & Regularization
10/2 Fri Neural Networks
10/9 Fri PyTorch, CNNs
10/16 Fri No recitation -- Fall Break
10/23 Fri MLE, Tutorial on LaGrange Multipliers
10/30 Fri Word Embeddings
11/6 Fri Attention (but not Transformers)
11/13 Fri Transformers and MDPs
11/20 Fri RL
11/27 Fri Takehome Worksheet -- Thanksgiving Break
12/4 Fri MCTS

Assignments

There will be twelve assignments with three possible components each: programming/written/online (subject to change). Written/online assignments will involve working through algorithms presented in the class, deriving and proving mathematical results, and critically analyzing material presented in class. Programming assignments will involve writing code in Python to implement various algorithms.

There will also be weekly pre-reading assignments and associated checkpoints.

For any assignments that aren't released yet, the dates below are tentative and subject to change.

Homework due dates (Tentative)

Note: Links will be added to the table when assignments are released.
Homework Link (if released) Due Date
HW0 (online) Online 8/27 Thu, 11:59 pm
HW1 (online, written, programming) 9/3 Thu, 11:59 pm
HW2 (online, written, programming) 9/10 Thu, 11:59 pm
HW3 (online only) 9/17 Thu, 11:59 pm
HW4 (written only) 9/24 Thu, 11:59 pm
HW5 (mostly programming) 10/1 Thu, 11:59 pm
HW6 10/22 Thu, 11:59 pm
HW7: Building AlexNet 10/29 Thu, 11:59 pm
HW8 11/5 Thu, 11:59 pm
HW9 11/12 Thu, 11:59 pm
HW10: Building GPT2 11/19 Thu, 11:59 pm
HW11: Building AlphaZero 12/4 Fri, 11:59 pm

Pre-reading due dates (Tentative)

Pre-reading Link (if released) Due Date
PR1: Search Checkpoint 8/26 Wed, 11:59 pm
PR2: Adversarial Search Checkpoint 8/31 Mon, 11:59 pm
PR3: Decision Trees Checkpoint 9/7 Mon, 11:59 pm
PR4: Optimization and Linear Regression Checkpoint 9/14 Mon, 11:59 pm
PR5: Feature Engineering and Logistic Regression Checkpoint 9/21 Mon, 11:59 pm
PR6: Neural Nets Checkpoint 9/28 Mon, 11:59 pm
PR7: CNNs Checkpoint 10/7 Wed, 11:59 pm
PR8: MLE Checkpoint 10/20 Tue, 11:59 pm
PR9: Word Embeddings Checkpoint 10/26 Mon, 11:59 pm
No PR10 No Pre-reading this week N/A
PR11: MDPs Checkpoint 11/9 Mon, 11:59 pm
PR12: RL Checkpoint 11/16 Mon, 11:59 pm
PR13: MCTS Checkpoint 11/30 Mon, 11:59 pm

Course Notes

In addition to the pre-reading notes, below are course notes on some of the topics developed by the course staff over the years.

Topic Link (if released)
Math and Probability Basics 07-280 Notation Guide
Math Background
Probability Background
Discrete Probability Reference Sheet
Search & Adversarial Search Search (Pre-reading)
Adversarial Search (Pre-reading)
Search & Adversarial Search Notes
CSPs CSP Notes
Decision Trees Decision Trees (Pre-reading)
Optimization and Linear Regression Opt. and Lin. Reg. (Pre-reading)
Feature Engineering and Logistic Regression Feat. Eng. and Log. Reg. (Pre-reading)
Neural Networks Neural Networks (Pre-reading)
CNNs CNNs (Pre-reading)
MLE MLE (Pre-reading)
Word Embeddings Word Embeddings (Pre-reading)
Markov Decision Process MDP Notes
Reinforcement Learning RL Notes

Exams

The course includes two midterm exams and a final exam. The midterms will take place in lecture on Tue, Oct 6 and Tue, Nov 24. The final exam date will be announced by the university mid-semester. The final exam could be as late as Mon, Dec 14 and the makeup exam date is Tue, Dec 15. Plan any travel around exams, as exams will not be rescheduled.

Policies

Grading

Grades will be collected and reported in Canvas. Please let us know if you believe there to be an error the grade reported in Canvas.

Final scores will be composed of:

  • 15% Midterm exams (each)
  • 25% Final exam
  • 30% Programming/Written homework
  • 5% Online homework
  • 5% Pre-reading checkpoints
  • 5% Participation

Final grade

This class is not curved. However, we convert final course scores to letter grades based on grade boundaries that are determined at the end of the semester. What follows is a rough guide to how course grades will be established, not a precise formula — we will fine-tune cutoffs and other details as we see fit after the end of the course. This is meant to help you set expectations and take action if your trajectory in the class does not take you to the grade you are hoping for. So, here's a rough heuristics about the correlation between final grades and total scores:

  • A: above 90%
  • B: 80-90%
  • C: 70-80%
  • D: 60-70%

This heuristic assumes that the makeup of a student's grade is not wildly anomalous: exceptionally low overall scores on exams, programming assignments, or written assignments will be treated on a case-by-case basis and, while rare, could potentially drop a student's grade.

Precise grade cutoffs will not be discussed at any point during or after the semester.

Participation

In class, we will use a series of polls as part of an active learning technique called Peer Instruction. Your participation grade will be based on the percentage of these in-class poll questions answered:

  • 0% for 50% or less
  • 5% for 80% or greater poll participation
  • Linear scale for values in between 50% and 80%
  • Correctness of in-class polling responses will not be taken into account for participation grades.
  • If a poll is duplicated with the same question (e.g. before and after discussing with your neighbor), you should answer all of the duplicated versions as well, as they will be counted as separate polls.
  • If you have systemic/repeated technical issues, please let us know as soon as possible, so we can resolve the situation.
  • Missing polls due to absences (e.g., brief illness) from lecture or due to technical difficulties is expected occasionally, and this is why you only need to answer >= 80% of the polls to get full credit.

It is against the course academic integrity policy to answer in-class polls when you are not present in lecture. Violations of this policy will be reported as an academic integrity violation. Information about academic integrity at CMU may be found at https://www.cmu.edu/academic-integrity.

Late Policies, and Extensions, and Exceptions

Participation

  • Missing polls due to absences (e.g., brief illness) from lecture or due to technical difficulties is expected occasionally, and this is why you only need to answer >= 80% of the polls to get full credit.
  • If you must miss many lectures due to circumstances outside of your control (e.g., if you have an extended illness) please e-mail Brynn, bedmunds@andrew.cmu.edu, prior to lecture.

Pre-reading checkpoints

Pre-reading checkpoints don't have any extensions or late days. However, the lowest two checkpoints will be dropped when computing your semester score. Reasoning: We want to make sure that everyone is able to complete the pre-reading prior to lecture, so we can build on that knowledge in class; minor illness and other minor disruptive events outside of your control happen occasionally and thus dropping the lowest two scores. See below for information on rare exceptions.

Late days for written, programming, and online homework

You have a pool of 6 late days across all written, programming and online assignment types

  • Use up to two per assignment number
  • Components of an assignment with the same homework number are considered the same assignment; so e.g., if you turn in both programming and written components within 24 hours after the due date, you will use one late day, not two.
  • You may use these at your discretion, but they are intended for minor illness and other disruptive events outside of your control, and not for poor time management.
  • No need to inform us that you are using a late day; just submit it to Gradescope during the late day.
  • You are responsible to keep track of your own late days. Gradescope will not enforce the total number of late days
  • Homework submitted after these two late days or submitted by a student without any late days remaining will be given a score of 0.

Exceptions and extensions

Aside from late days, dropping the lowest checkpoints, and the 80% threshold for participation, there will be no extensions on assignments in general. If you think you really really need an extension on a particular assignment, e-mail Brynn, bedmunds@andrew.cmu.edu, as soon as possible and before the deadline. Please be aware that extensions are entirely discretionary and will be granted only in exceptional circumstances outside of your control (e.g., due to severe illness or major personal/family emergencies, but not for competitions, club-related events, or interviews). The instructors will require confirmation from your academic advisor, as appropriate.

We certainly understand that unfortunate things happen in life. However, not all unfortunate circumstances are valid reasons for an extension. Nearly all situations that make you run late on an assignment homework can be avoided with proper planning - often just starting early. Here are some examples:

  • I have so many deadlines this week: you know your deadlines ahead of time - plan accordingly.
  • It's a minute before the deadline and the network is down: you always have multiple submissions - it's not a good idea to wait for the deadline for your first submission.
  • My computer crashed and I lost everything: Use Google Drive, Dropbox, or similar system to do real-time backup - recover your files and finish your homework from a cluster machine or borrowed computer.

Collaboration Policy

We encourage you to discuss course content and assignments with your classmates. However, these discussions must be kept at a conceptual level only. You may use generative AI tools to better learn course content, but they may not be used to generate any part of your assignment submission. (Yes, these tools are awesome and you should learn how to use them well.

  • You may NOT view, share, or communicate about any artifact that will be submitted as part of an assignment. Example artifacts include, but are not limited to: code, pseudocode, diagrams, and text.
  • You may look at another student's Python error messages and discuss what the error means at a conceptual level. However, you may NOT give specific instructions to fix the error.
  • All work that you present must be your own. Thus, generative AI tools may not be used to generate any part of your assignment submission.
  • Using any external sources of code or algorithms in any way must have approval from the instructor before submitting the work. For example, you must get instructor approval before using an algorithm you found online for implementing a heuristic function in a programming assignment. The following are pre-approved exceptions:
    • Code provided by the course staff or materials, including code from the textbook
    • Documentation for permitted Python libraries

Programming component partners

The only exception to the above collaboration policy is when you share programming code directly with your programming assignment partner.

  • You are allowed to work in groups of at most two on any programming componenet of each assignment, i.e. you and one partner
  • You must still do ALL parts of written and online components on your own, including the written results and analysis from the programming component. (Naturally, you would have the same result figures if generated from the programming component).
  • You must specify your partner when you submit the programming component of each assignment
  • Once you start working with a partner on an assignment, you may not switch to another partner for that assignment
  • You may change partners between assignments. In fact, you are strongly encouraged to change partners occasionally
  • Important: You are responsible for making sure that both you AND your partner understand the work that you submit. If we discover that one partner cannot answer basic questions about the submitted work, both students in the group will be reported for an academic integrity violation.

Violations of these policies will be reported as an academic integrity violation. Information about academic integrity at CMU may be found at https://www.cmu.edu/academic-integrity. Please contact the instructor if you ever have any questions regarding academic integrity or these collaboration policies.

Accommodations for Students with Disabilities

If you have a disability and have an accommodations letter from the Disability Resources office, we encourage you to discuss your accommodations and needs with us as early in the semester as possible. We will work with you to ensure that accommodations are provided as appropriate. If you suspect that you may have a disability and would benefit from accommodations but are not yet registered with the Office of Disability Resources, we encourage you to visit their website.

Statement of Support for Students Health & Well-being

Take care of yourself. Do your best to maintain a healthy lifestyle this semester by eating well, exercising, getting enough sleep, and taking some time to relax. This will help you achieve your goals and cope with stress.
All of us benefit from support during times of struggle. There are many helpful resources available on campus and an important part of the college experience is learning how to ask for help. Asking for support sooner rather than later is almost always helpful.
If you or anyone you know experiences any academic stress, difficult life events, or feelings like anxiety or depression, we strongly encourage you to seek support. Counseling and Psychological Services (CaPS) is here to help: call 412-268-2922 and visit their website at http://www.cmu.edu/counseling/. Consider reaching out to a friend, faculty or family member you trust for help getting connected to the support that can help.
If you have questions about this or your coursework, please let us know. Thank you, and have a great semester.

Frequently Asked Questions

Question not answered here? Please fill out this form.

How does this compare to 10-301?

Both courses cover sufficient material for an intro machine learning course 07-280 includes non-ML AI techniques, while 10-301 focuses only on ML, naturally reaching a few additional ML topics.

07-280 10-301
Prereqs
(see course description for detailed course numbers)
Prereq: 15-122

Coreq: Probability

Prereq: Linear Algebra
Prereq: 15-151/Concepts
Coreq: Calc 2
Prereq: 15-122 or 15-121

Prereq: Probability

Prereq:
(Linear Algebra or Calc 3 or 151/Concepts)
Fulfills the Intro ML prereq for later ML (10-XXX) courses check_circle check_circle
Fulfills the 07-280 prereq for 07-380 AI/ML II check_circle No, but if you've already taken 10-301 (and thus can't take 07-280), email bsai@cs.cmu.edu to discuss alternative pathways for taking 07-380.
Fulfills the 07-280 requirement for the
AI Major, Additional Major, and Minor
check_circle No, but if you've already taken 10-301 (and thus can't take 07-280), email bsai@cs.cmu.edu to discuss alternative pathways for satisfying the AI Core requirements.
Fulfills the AI elective for the Computer Science Major and Additional Major check_circle check_circle
Fulfills the Intro ML requirement for the Stat/ML Major check_circle check_circle
Fulfills the Intro ML prereq for the ML Concentration Minor check_circle check_circle
Fulfills the Intro ML prereq for the 5th year ML Master's check_circle check_circle
Topics: ML fundamentals from decision trees to neural networks check_circle check_circle
Topics: Transformer networks and Large Language Models check_circle check_circle
Topics: Reinforcement Learning check_circle check_circle
Additional topics:
  • Heuristic Search
  • Adversarial Search
  • Constraint Satisfaction Problems
  • ML Parallelism/GPU Basics
  • Monte Carlo Tree Search
check_circle
Additional topics:
  • k-Nearest Neighbors
  • Perceptron Algorithm
  • ML Theory: PAC Learning
  • PCA
  • Clustering and K-means
  • Ensemble Methods: Bagging and Boosting
  • Recommender Systems
  • Maximum a Posteriori
check_circle
TA mascot 🤷 Neural the Narwhal

Why this course?

The goal is to replace the older AI and ML courses, 15-281 and 10-315, with two sequenced courses, 07-280 and 07-380, covering the breadth and depth required by the AI majors, with the first of the two courses covering core AI and ML concepts for SCS students taking only one AI course, as well as anyone at CMU who wants a good technical introduction to the field.

This restructure will provide the following benefits:

  • Flexibility to grow two AI courses
    • Adapting topics
    • Building on first course in the second course
  • Better single AI course for non-AI majors
    • First course as accessible as 15-281 is now
    • First course includes core ML topics in addition to AI breadth

Will 15-281 and 10-315 continue to be offered?

No, 15-281 and 10-315 are being retired and will not be offered in the future.

Who will teach the new courses?

The new courses will be taught by a mix of faculty, primarily from the Machine Learning and Computer Science Departments.

In Fall 2026, 07-280 will be taught by Nihar Shah (CSD/MLD) and Aviral Kumar (MLD/CSD).

How often will 07-280 and 07-380 be offered?

Both courses, 07-280 and 07-380, will be offered every semester (Fall and Spring), with 07-380 first being offered in Fall 2026.

What topics will be covered in 07-380 AI & ML II?

07-380 is designed to be more flexible in its topics from semester to semester, adapting based on our faculty's best understanding of what additional/advanced AI/ML topics students need to learn, especially those graduating with a major/minor in AI. It builds upon 07-280, so we'll be able to explore more advanced topics in greater depth, while also increasing the breadth of topics across all of AI.

Potential topics include: Deeper AI/ML Ethics, MAP, ML Theory: PAC Learning, PCA, Clustering and K-means, Ensemble Methods: Bagging and Boosting, Recommender Systems, Linear programming, Integer programming, Propositional Logic, SAT, and Logical Agents, Classical Planning, Bayes' Nets: Representation, Bayes' Nets: Inference, Bayes' Nets: Sampling, HMMs, Game Theory: Equilibrium, Game Theory: Social Choice, Vision Transformers, Variational Autoencoders, Diffusion, Text to Image Generation, Distributed Deep Learning, Optimization: RMS, Momentum, Stability, RLHF and DPO.

Are the prereq and coreqs strict requirements?

Yes, the prerequisites and corequisites are strict requirements for enrollment in 07-280.