If the network seems to be stuck, it has hit what is called a ‘local minimum’. As it approaches zero, the network will get out of the local minimum, and will shortly complete. This is because of a ‘momentum turn’ that is used in the calculation of the weights. Like […]