Pattern Classification of Back-Propagation Algorithm Using Exclusive Connecting Network

The objective of this paper is to a design of pattern classification model based on the back-propagation (BP) algorithm for decision support system. Standard BP model has done full connection of each node in the layers from input to output layers. Therefore, it takes a lot of computing time and iteration computing for good performance and less accepted error rate when we are doing some pattern generation or training the network. However, this model is using exclusive connection in between hidden layer nodes and output nodes. The advantage of this model is less number of iteration and better performance compare with standard back-propagation model. We simulated some cases of classification data and different setting of network factors (e.g. hidden layer number and nodes, number of classification and iteration). During our simulation, we found that most of simulations cases were satisfied by BP based using exclusive connection network model compared to standard BP. We expect that this algorithm can be available to identification of user face, analysis of data, mapping data in between environment data and information.

Authors:

• Insung Jung
• Gi-Nam Wang

Keywords:

• Neural network
• Back-propagation
• classification.

References:

[1] F. Rosenblatt, "A Probabilistic Model for Information Storage and
Organization in the Brain," Cornell Aeronautical Laboratory, vol. 65, pp.
386-108, 1958.
[2] R. H. Rosenblatt, "The Atlantic species of the blennioid fish genus", 1960.
[3] M. Minsky, & Papert, S., "Perceptrons: An Introduction to Computational
Geometry," The MIT Press, pp. 3, 26, 31, 33, (1969).
[4] D. E. Rumelhart, Hinton, G. E., & Williams, R. J. , " Learning
representations by backpropagating errors," Nature, vol. 323, pp.
533-536, 1986.
[5] P. J. Werbos, "Beyond Regression: New Tools for Prediction and
Analysis in the Behavioral Sciences," Unpublished doctoral dissertation
Harvard University., 1976.
[6] D. B. Parker, "Learning-Logic (Tech. Rep. Nos. TR{47)." 1985.
[7] Y. L. Cun, "Une procedure d'apprentissage pour reseau a seuil
assymetrique," Proceedings of Cognitiva, vol. 85, pp. 599-604.
[8] Richard P. Lippmann,:" An introduction to computing with neural
network", IEEE ASSP magazine, 1987, pp. 4-22.