Lecture, four hours; discussion, one hour; outside study, seven hours. Enforced requisites: course 131A, Mathematics 33A. Introduction to foundations of statistical machine learning. Overview of several widely used learning algorithms including logistic and linear regression, kernel methods and support vector machine (SVM), ensemble learning methods, decisions trees and nearest neighbor classifiers. Connections to information theory through probably approximately correct (PAC) learning, stability, bias-complexity trade-off, structural risk minimization, minimum description length (MDL), and universal learning. Introduction to representation learning with topics including unsupervised learning, clustering, (non-linear) dimensionality reduction, sketching, parametric distribution estimation including Gaussian mixtures, expectation maximization, non-parametric distribution estimation, property testing and neural networks focused on distribution sampling (variational autoencoders {VAEs}, generative adversarial networks {GANs}). Discussion of reinforcement learning. Letter grading.

Review Summary

Clarity
N/A
Organization
N/A
Time
N/A
Overall
N/A

Course

Instructor
Suhas N. Diggavi
Previously taught
23W 22W 21W 20W

Previous Grades

Grade distributions not available.