what is generalisation
a general category of algorithm whereby:
this holds even if it has not seen the x before
Pro and con of supervised learning
Pro: well understood and performance is easy to measure
Con: labelling can be laborious
Pro and con of unsupervised learning
Pro: easy to implement at scale
Con: harder to understand and can only be used in specific scenarios (e.g: clustering)
Average loss
(Empirical risk)
Binary cross entropy loss
Neural network (notation)
Activation function
Deep NN
NN with multiple hidden layers
Squared lost