E0 270 · Machine Learning

E0 270January–April 2024

Machine Learning

Department of Computer Science and Automation · Indian Institute of Science

Instructor

Prof. Ambedkar Dukkipati (ambedkar [at] iisc.ac.in)

Teaching assistants

Parag Dutta

Arpana Alka

Rahul V

A R Shaarad

Lectures

Monday and Wednesday, 11:00 AM – 12:30 PM, CSA 117 (first lecture: January 3, 2024)

Microsoft Teams

Join code: 63rvo5z

Course description

With the increasing amounts of data being generated in diverse fields such as astronomical sciences, health and life sciences, financial and economic modeling, climate modeling, market analysis, and even defense, there is an increasing need for computational methods that can automatically analyze and learn predictive models from such data.

Machine learning, the study of computer systems and algorithms that automatically improve performance by learning from data, provides such methods; indeed, machine learning techniques are already being used with success in a variety of domains, for example in computer vision to develop face recognition systems, in information retrieval to improve search results, in computational biology to discover new genes, and in drug discovery to prioritize chemical structures for screening.

This course aims to provide a sound introduction to both the theory and practice of machine learning, with the goal of giving students a strong foundation in the subject, enabling them to apply machine learning techniques to real problems, and preparing them for advanced coursework and research in machine learning and related fields.

Prerequisites

E0 232: Probability and Statistics (or an equivalent course elsewhere), with a grade of B or higher. Some background in linear algebra and optimization will also be helpful.

Evaluation

ComponentMarks
Mid-term examination20
Assignments (2 × 15, programming)30
End-term examination50
Bonus assignmentTBD

Tutorial and discussion sessions will be scheduled on an ongoing basis. Lecture notes, assignments and other course material are shared on the course's Microsoft Teams group.

Topics

#Topics
1Let there be AI; on machine learning, data and models; distance-based classifiers; basic probability
2Machine learning workflow; different types of learning; classification using Bayes rule; applications of machine learning
3Introduction to supervised learning; some foundational aspects of ML
4Linear regression; probabilistic view of linear regression; logistic regression; hyperplane-based classifiers and the perceptron
5Probabilistic view of linear regression; logistic regression; hyperplane-based classifiers and the perceptron
6Logistic regression; hyperplane-based classifiers and the perceptron
7Support vector machines; kernel methods
8Feed-forward neural networks; backpropagation; autoencoders; CNNs; RNNs
9Unsupervised learning; dimensionality reduction; k-means clustering
10Spectral clustering
11EM algorithm
12Introduction to probabilistic modeling; Markov random fields
13Monte Carlo methods; typical sets; MCMC; Gibbs sampling; MRFs with latent variables

Tutorials

#TopicsWhenTA
1Naive Bayes and Bayes decision theoryJanuaryA R Shaarad
2Linear regression and gradient descentFebruaryParag Dutta
3Support vector machines—A R Shaarad
4Perceptrons; neural networks (MLPs, CNNs); backpropagation; vanishing gradients; Kaiming initialization; batch normalization; dropoutMarchParag Dutta
5Generative modeling: GANs, VAEs and conditional VAEsAprilMohd Ayyoob

References

Recommended textbooks

Additional textbooks

Optimization textbooks

Academic honesty

As students of IISc, we expect you to adhere to the highest standards of academic honesty and integrity.

Elements of the course are designed to support your learning of the subject. Copying will not help you (in the exams or in the real world), so don't do it. If you have difficulties learning some of the topics or lack some background, try to form study groups where you can bounce off ideas with one another and try to teach each other what you understand. You're also welcome to talk to any of us and we'll be glad to help you.

If any exam/project is found to be copied, it will automatically result in a zero grade for that project and a warning note to your advisor. Any repeat instance will automatically lead to a failing grade in the course.