Hyperparameter Tuning

Setting a learning rate

• Finding the optimal learning rate
• Learning rate scheduling
• Cyclic learning rate

Other hyperparameters you can tune:

• Number of layers
• Batch size
• Number of trees
• Number of iterations