E0 232 · Probability and Statistics

E0 232August–December 2016

Probability and Statistics

Department of Computer Science and Automation · Indian Institute of Science

Instructor

Prof. Ambedkar Dukkipati

Teaching assistants

Mahesh Gorijala

Siddharth Agrawal

Gaurav Pandey

Lectures

Tuesday and Thursday, 2:00 – 3:30 PM, CSA 117

Announcements

Course description

This course serves as a foundational course for students who enter the computer science department for graduate studies. Most engineering students do not get formal exposure to probability in their undergraduate studies; this course is designed to fill that gap. It also emphasizes the rigorous reasoning that is essential for graduate studies in computer science.

Syllabus

Probability spaces; random variables and expectation; moment inequalities; multivariate random variables; sequences of random variables and different modes of convergence; the law of large numbers; Markov chains; maximum likelihood estimators; statistical hypothesis testing; the Neyman–Pearson lemma; exponential models.

Examinations

ExaminationDateWeight
First mid-termSeptember 2425%
Second mid-termNovember 525%
End-term—50%

Lectures

DateTopic
August 4Introduction to the course
August 9Sample and probability spaces
August 16Properties of probability measures; conditional probability and Bayes rule
August 18Continuity of probability measures
August 20Introduction to Bayes decision theory
August 23Continuity of probability measures (contd.); Bayes decision theory (contd.)
August 30Borel sigma-algebras and random variables
September 1Random variables (contd.)
September 3Probability distribution functions and functions of random variables
September 6Discrete and continuous random variables
September 8Expectation and variance
September 10Random vectors; joint, marginal and conditional distributions
September 20Independence and independent random variables
September 22Multiple random variables, independence and exchangeability
September 26Multiple random variables (contd.)
September 29Covariance and correlation coefficients
October 1Jensen's, Hölder's and Minkowski's inequalities
October 4Real sequences and convergence
October 6Almost sure convergence and convergence in probability
October 15The Borel–Cantelli lemma
October 20The weak law of large numbers
October 22Linear algebra review
October 25Linear algebra review
October 27Linear algebra review
November 3The multivariate normal distribution
November 10Markov chains (Gaurav Pandey)
November 15Markov and Chebyshev inequalities
November 17Markov chains (Gaurav Pandey)
November 22Chernoff bounds and the sampling theorem
November 24Markov chains and the central limit theorem (Gaurav Pandey)
November 26Maximum likelihood, Bayes and maximum entropy methods

References