CS861: Theoretical Foundations of Machine Learning

Course overview and logistics 
 CS861: Theoretical Foundations of Machine Learning Kirthi Kandasamy University of Wisconsin – Madison Fall 2023 September 6, 2023 Machine learning is popular nowadays! “A breakthrough in ML will be worth 10 Microsofts”
 – Bill Gates “ML is the new internet”
 “AI will be the best or worst thing ever for …

CS861: Theoretical Foundations of Machine Learning Read More »

NY 10013 2473, USA

Understanding Machine Learning: From Theory to Algorithms ⃝c 2014 by Shai Shalev-Shwartz and Shai Ben-David Published 2014 by Cambridge University Press. This copy is for personal use only. Not for distribution. Do not post. Please link to: http://www.cs.huji.ac.il/~shais/UnderstandingMachineLearning Please note: This copy is almost, but not entirely, identical to the printed version of the book. …

NY 10013 2473, USA Read More »

IV 13

Bandit Algorithms Tor Lattimore and Csaba Szepesv ́ari This is the (free) online edition. The content is the same as the print edition, published by Cambridge University Press, except that minor typos are corrected here. There are also font and other typographical differences that mean the page numbers do not match between the versions. Bandits, …

IV 13 Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 1 10 30 2023 Univer

CS861: Theoretical Foundations of Machine Learning Lecture 1 – 10/30/2023 University of Wisconsin–Madison, Fall 2023 Lecture 24: EXP3, Lower Bounds for adversarial bandits Lecturer: Kirthevasan Kandasamy Scribed by: Bo-Hsun Chen, Zexuan Sun Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only …

CS861: Theoretical Foundations of Machine Learning Lecture 1 10 30 2023 Univer Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 15 09 10 2023 Unive

CS861: Theoretical Foundations of Machine Learning Lecture 15 – 09/10/2023 University of Wisconsin–Madison, Fall 2023 Lecture 15: Density estimation, Lower bounds for prediction problems Lecturer: Kirthevasan Kandasamy Scribed by: Haoyue Bai, Zexuan Sun Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class …

CS861: Theoretical Foundations of Machine Learning Lecture 15 09 10 2023 Unive Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 21 10 23 2023 Unive

CS861: Theoretical Foundations of Machine Learning Lecture 21 – 10/23/2023 University of Wisconsin–Madison, Fall 2023 Lecture 21: Martingale concentration and structured bandits Lecturer: Kirthevasan Kandasamy Scribed by: Zhifeng Chen, Xinyan Wang Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with …

CS861: Theoretical Foundations of Machine Learning Lecture 21 10 23 2023 Unive Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 1 09 13 2023 Univer

CS861: Theoretical Foundations of Machine Learning Lecture 1 – 09/13/2023 University of Wisconsin–Madison, Fall 2023 Lecture 04: Rademacher Complexity & Growth Function Lecturer: Kirthevasan Kandasamy Scribed by: Yixuan Zhang, Elliot Pickens Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with …

CS861: Theoretical Foundations of Machine Learning Lecture 1 09 13 2023 Univer Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 1 2 09 06 08 2023 U

CS861: Theoretical Foundations of Machine Learning Lecture 1-2 – 09/06-08/2023 University of Wisconsin–Madison, Fall 2023 Lecture 01 & 02: PAC Learning Lecturer: Kirthevasan Kandasamy Scribed by: Albert Dorador, Michael Harding Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with the …

CS861: Theoretical Foundations of Machine Learning Lecture 1 2 09 06 08 2023 U Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 18 10 16 2023 Unive

CS861: Theoretical Foundations of Machine Learning Lecture 18 – 10/16/2023 University of Wisconsin–Madison, Fall 2023 Lecture 18: Proof for UCB (cont’d), K-armed Bandit Lower Bound Lecturer: Kirthevasan Kandasamy Scribed by: Michael Harding and Congwei Yang Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside …

CS861: Theoretical Foundations of Machine Learning Lecture 18 10 16 2023 Unive Read More »

CS861: Theoretical Foundations of Machine Learning Lecture 12 10 02 2023 Unive

CS861: Theoretical Foundations of Machine Learning Lecture 12 – 10/02/2023 University of Wisconsin–Madison, Fall 2023 Lecture 12: Fano’s method Lecturer: Kirthevasan Kandasamy Scribed by: Yuya Shimizu, Keran Chen Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal publications. They may be distributed outside this class only with the permission of …

CS861: Theoretical Foundations of Machine Learning Lecture 12 10 02 2023 Unive Read More »