Stability of back propagation training algorithm for neural networks

الملخص EN

In this paper, we derive and prove the stability bounds of the momentum coefficient μ and the learning rate η of the back propagation updating rule in Artificial Neural Networks.

The theoretical upper bound of learning rate η is derived and its practical approximation is obtained.