An efficient parallel block backpropagation learning algorithm in transputer-based mesh-connected parallel computers

Learning process is essential for good performance when a neural network is applied to a practical application. The backpropagation algorithm [1] is a well-known learning method widely used in most neural networks. However. s ince the backpropagation algorithm is time-consuming, much research have be en done to speed up the process. The block backpropagation algorithm. which seems to be more efficient than the backpropagation, is recently proposed by Coetzee in [2]. In this paper, we propose an efficient parallel algorith m fur the block backpropagation method and its performance model in mesh-co nnected parallel computer systems. The proposed algorithm adopts master-sla ve model for weight broadcasting and data parallelism for computation of we ights. In order to validate our performance model. a neural network is impl emented for printed character recognition application in the TiME [3] which is a prototype parallel machine consisting of 32 transputers connected in mesh topology. It is shown that speedup by our performance model is very cl ose to that by experiments.