Linear Models

Question 1

• Definition of Class of Linear (affine) functions and equivalent notation.
• Definition of linear model hyphothesis class.

Answer 1

….

Question 2

Linear regression:

• What is, hypothesis class, loss function and empirical risk.
• What is least squares?
• How to find the solution of the ERM problem? What if the matrix is not invertible?
• How can we use linear regression with polinomial models?

Answer 2

….

Question 3

Logistic regression:

• What is? For what is used for?
• What is its hypothesis class?
• What are the differences with halfspaces?
• What is the loss function?
• What is the ERM problem? how can be solved?

Answer 3

….

Question 4

Halfspaces:

• Definition of halfspace. When it is used?
• When data are linearly separable?
• Perceptron for halfspaces. When the algorithms stops?

Answer 4

…