hyperparameter tuning

Question 1

name some hyperparameters in neural network?

Answer 1

learning rate, no of layers, no of hidden units, batch size…

Question 2

2 ways to do hyperparamters tuning?

Answer 2

try random values (dont use grid if have many hyperparams)
coarse to find: try a few to see which ranges work best then zoom in to thay range

Question 3

differences between parameters and hyperparameters?

Answer 3

params: estimated from data automatically
hyperparams: manually set, used in processes to help estimate params