Although mathematically elegant, back-propagation isn't perfect. Instead consider using particle swarm optimization (PSO) to train your neural network; here's how.

Qi Xiong, Hongbo Zhang, Qiusheng Rong, Path Planning Based on Improved Particle Swarm Optimization for AUVs, Journal of Coastal Research, SPECIAL ISSUE NO. 111.

Multi-swarm optimization (MSO) is a powerful variation of particle swarm optimization. Understanding how MSO works and how to implement it can be a valuable addition to your developer toolkit.