saddle point & local minimum
It’s easy to understand in mathematics by using second derivation.
Batch & Momentum
- Movement: movement of last step minus gradient at present.
Adaptive learning rate
Classification
Quick introduction of batch normalization
Changing landscape