Polimi CS Notes

ML Machine Learning

Contents

list of questions
List of question and appearances as 2023-06-06: Question Appearances Topic Describe and compare Ridge regression and LASSO algorithms to solve linear regression problems. 9 02_Linear_Regression…
linear models for regression
Questions Describe and compare Ridge regression and LASSO algorithms to solve linear regression problems. (8) These two regularization techniques differ from ordinary least squares because they…
linear models for classification
Questions Describe the Perceptron model and how it is trained. (1) The Perceptron algorithm is an example of online linear discriminant model. It corresponds to a two classes model: $$ y(x) = f(w^T…
bias-variance, model selection and model ensembles
Questions Describe the PCA technique and what it is used for. (3) Principal Component Analysis (PCA) is a linear dimensionality reduction technique. The idea is to project the data onto the input…
learning theory
Questions Explain what is the VC dimension of a hypothesis space and what it is used for. (6) As needed background we need to define: A dichotomy of a set $S$ is a partition of $S$ into two disjoint…
kernel methods
CS480/680 Lecture 11: Kernel Methods Questions from past exams Give the definition of valid kernel and describe how valid kernels can be built. Provide an example of a methods that uses kernels and…
Markov Decision Processes
Questions Describe the properties of the Bellman operators. (1) ... Describe the policy iteration technique for control problems on Markov Decision Processes. (3) Describe the value iteration…
reinforcement learning
Questions Describe and compare Q-learning and SARSA. (4) Describe the difference between on-policy and off-policy reinforcement learning techniques. Make an example of an on-policy algorithm and an…