Home About People Lectures Recitations Homework Previous

Introduction to Machine Learning (10-701)

Fall 2017

Barnabás Póczos, Ziv Bar-Joseph

School of Computer Science, Carnegie Mellon University


Machine learning studies the question of "How can we build computer programs that automatically improve their performance through experience?". This includes learning to perform many types of tasks based on many types of experience. For example, it includes robots learning to better navigate based on experience gained by roaming their environments, medical decision aids that learn to predict which therapies work best for which diseases based on data mining of historical health records, and speech recognition systems that learn to better understand your speech based on experience listening to you.

This course is designed to give PhD students a thorough grounding in the methods, mathematics and algorithms needed to do research and applications in machine learning. Students entering the class with a pre-existing working knowledge of probability, statistics and algorithms will be at an advantage, but the class has been designed so that anyone with a strong computational background can catch up and fully participate.


Note all textbooks are optional. You are not expected to purchase them.


The requirements of this course consists of participating in lectures, midterm, 5 problem sets and a final exam. The 5th problem set is a mini-project. This is a PhD level class, and the most important thing for us is that by the end of this class students understand the basic methodologies in machine learning, and be able to use them to solve real problems of modest complexity. The grading breakdown is the following:

  • 5 problem sets : 45 %
  • Final : 30 %
  • Midterm : 20 %
  • Class Participation : 5%

Homework resources and collaboration policy

Homeworks and exams may contain material that has been covered by papers and webpages. Since this is a graduate class, we expect students to want to learn and not google for answers. You should cite the materials you used.

Homeworks will be done individually: each student must hand in their own answers. It is acceptable, however, for students to collaborate in figuring out answers and helping each other solve the problems. We will be assuming that, as participants in a graduate course, you will be taking the responsibility to make sure you personally understand the solution to any work arising from such collaboration. You also must indicate on each homework with whom you collaborated.

Late homework policy

You will be allowed 2 total late days without penalty for the entire semester. You may be late by 1 day on two different homeworks or late by 2 days on one homework. Weekends and holidays are also counted as late days. Late submissions are automatically considered as using late days.

Once those days are used, you will be penalized according to the following policy:

  • Homework is worth full credit before the deadline.
  • It is worth half credit for the next 24 hours.
  • It is worth zero credit after that.

You must turn in at least n - 1 of the n homeworks, even if for zero credit, in order to pass the course.


We will not be allowing this class to be audited.


Take care of yourself. Do your best to maintain a healthy lifestyle this semester by eating well, exercising, avoiding drugs and alcohol, getting enough sleep and taking some time to relax. This will help you achieve your goals and cope with stress.

All of us benefit from support during times of struggle. You are not alone. There are many helpful resources available on campus and an important part of the college experience is learning how to ask for help. Asking for support sooner rather than later is often helpful.

If you or anyone you know experiences any academic stress, difficult life events, or feelings like anxiety or depression, we strongly encourage you to seek support. Counseling and Psychological Services (CaPS) is here to help: call 412-268-2922 and visit their website at http://www.cmu.edu/counseling/. Consider reaching out to a friend, faculty or family member you trust for help getting connected to the support that can help.

If you or someone you know is feeling suicidal or in danger of self-harm, call someone immediately, day or night: * CaPS: 412-268-2922 * Resolve Crisis Network: 888-796-8226 * If the situation is life threatening, call the police: * On campus: CMU Police: 412-268-2323 * Off campus: 911.

If you have questions about this or your coursework, please let the instructors know.

Note to people outside Carnegie Mellon University

Please feel free to reuse any of these course materials that you find of use in your own courses. We ask that you retain any copyright notices, and include written notice indicating the source of any materials you use.