Announcements
- Problem sheet 3 has been released; the third tutorial is on October 13, 2:00–3:30 PM, CSA 117.
- Thursday's lecture (October 13) is moved to Saturday, October 15.
- The first mid-term test will be held in rooms 252 and 254, 3:00–4:30 PM.
- Problem sheet 2 has been released.
- No lectures on Tuesday, September 13 and Thursday, September 15.
- Problem sheet 1 has been released.
- Canvas registration
- The first lecture is on August 4, 2:00–3:30 PM, CSA 117.
Course description
This course serves as a foundational course for students who enter the computer science department for graduate studies. Most engineering students do not get formal exposure to probability in their undergraduate studies; this course is designed to fill that gap. It also emphasizes the rigorous reasoning that is essential for graduate studies in computer science.
Syllabus
Probability spaces; random variables and expectation; moment inequalities; multivariate random variables; sequences of random variables and different modes of convergence; the law of large numbers; Markov chains; maximum likelihood estimators; statistical hypothesis testing; the Neyman–Pearson lemma; exponential models.
Examinations
| Examination | Date | Weight |
|---|---|---|
| First mid-term | September 24 | 25% |
| Second mid-term | November 5 | 25% |
| End-term | — | 50% |
Lectures
| Date | Topic |
|---|---|
| August 4 | Introduction to the course |
| August 9 | Sample and probability spaces |
| August 16 | Properties of probability measures; conditional probability and Bayes rule |
| August 18 | Continuity of probability measures |
| August 20 | Introduction to Bayes decision theory |
| August 23 | Continuity of probability measures (contd.); Bayes decision theory (contd.) |
| August 30 | Borel sigma-algebras and random variables |
| September 1 | Random variables (contd.) |
| September 3 | Probability distribution functions and functions of random variables |
| September 6 | Discrete and continuous random variables |
| September 8 | Expectation and variance |
| September 10 | Random vectors; joint, marginal and conditional distributions |
| September 20 | Independence and independent random variables |
| September 22 | Multiple random variables, independence and exchangeability |
| September 26 | Multiple random variables (contd.) |
| September 29 | Covariance and correlation coefficients |
| October 1 | Jensen's, Hölder's and Minkowski's inequalities |
| October 4 | Real sequences and convergence |
| October 6 | Almost sure convergence and convergence in probability |
| October 15 | The Borel–Cantelli lemma |
| October 20 | The weak law of large numbers |
| October 22 | Linear algebra review |
| October 25 | Linear algebra review |
| October 27 | Linear algebra review |
| November 3 | The multivariate normal distribution |
| November 10 | Markov chains (Gaurav Pandey) |
| November 15 | Markov and Chebyshev inequalities |
| November 17 | Markov chains (Gaurav Pandey) |
| November 22 | Chernoff bounds and the sampling theorem |
| November 24 | Markov chains and the central limit theorem (Gaurav Pandey) |
| November 26 | Maximum likelihood, Bayes and maximum entropy methods |
References
- V. K. Rohatgi and A. K. Md. Ehsanes Saleh, An Introduction to Probability and Statistics, Wiley, 2nd edition, 2000.
- A. Gut, An Intermediate Course in Probability, Springer, 2008.
- S. Ross, Introduction to Probability Models, Academic Press, 10th edition, 2010.
- D. P. Bertsekas and J. N. Tsitsiklis, Introduction to Probability, Athena Scientific, 2nd edition, 2008.