A New High Speed Neural Model for Fast Character Recognition Using Cross Correlation and Matrix Decomposition
Neural processors have shown good results for
detecting a certain character in a given input matrix. In this paper, a
new idead to speed up the operation of neural processors for character
detection is presented. Such processors are designed based on cross
correlation in the frequency domain between the input matrix and the
weights of neural networks. This approach is developed to reduce the
computation steps required by these faster neural networks for the
searching process. The principle of divide and conquer strategy is
applied through image decomposition. Each image is divided into
small in size sub-images and then each one is tested separately by
using a single faster neural processor. Furthermore, faster character
detection is obtained by using parallel processing techniques to test the
resulting sub-images at the same time using the same number of faster
neural networks. In contrast to using only faster neural processors, the
speed up ratio is increased with the size of the input image when using
faster neural processors and image decomposition. Moreover, the
problem of local subimage normalization in the frequency domain is
solved. The effect of image normalization on the speed up ratio of
character detection is discussed. Simulation results show that local
subimage normalization through weight normalization is faster than
subimage normalization in the spatial domain. The overall speed up
ratio of the detection process is increased as the normalization of
weights is done off line.
[1] R. Klette, and Zamperon, Handbook of image processing operators, John
Wiley & Sonsltd, 1996.
[2] H. A. Rowley, S. Baluja, and T. Kanade, " Neural Network - Based Face
Detection," IEEE Trans. on Pattern Analysis and Machine Intelligence,
Vol. 20, No. 1, pp. 23-38, 1998.
[3] H. Schneiderman and T. Kanade, "Probabilistic modeling of local
appearance and spatial relationships for object recognition, " In IEEE
Conference on Computer Vision and Pattern Recognition (CVPR), pp.
45-51, SantaBarbara, CA, 1998.
[4] R. Feraud, O. Bernier, J. E. Viallet, and M. Collobert, "A Fast and
Accurate Face Detector for Indexation of Face Images," Proceedings of
the Fourth IEEE International Conference on Automatic Face and
Gesture Recognition, Grenoble, France, 28-30 March, 2000.
[5] Y. Zhu, S. Schwartz, and M. Orchard, "Fast Face Detection Using
Subspace Discriminate Wavelet Features," Proc. of IEEE Computer
Society International Conference on Computer Vision and Pattern
Recognition (CVPR'00), South Carolina, June 13 - 15, 2000, Vol.1, pp.
1636-1643.
[6] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular
Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol.
10, No. 1, 2001, pp. 47-73.
[7] S. Srisuk and W. Kurutach, "A New Robust Face Detection in Color
Images," Proc. of IEEE Computer Society International Conference on
Automatic Face and Gesture Recognition, Washington D.C., USA, May
20-21, 2002, pp. 306-311.
[8] H. M. El-Bakry, "Face detection using fast neural networks and image
decomposition," Neurocomputing Journal, Vol. 48, 2002, pp. 1039-
1046.
[9] H. M. El-Bakry, "Human Iris Detection Using Fast Cooperative Modular
Neural Networks and Image Decomposition," Machine Graphics &
Vision Journal (MG&V), Vol. 11, No. 4, 2002, pp. 498-512.
[10] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Object/Face Detection
Using Neural Networks and Fast Fourier Transform," International
Journal of Signal Processing, Vol.1, No.3, pp. 182-187, 2004.
[11] Hazem M. El-Bakry, and Qiangfu Zhao, "A Modified Cross Correlation
in the Frequency Domain for Fast Pattern Detection Using Neural
Networks," International Journal of Signal Processing, Vol.1, No.3, pp.
188-194, 2004.
[12] Hazem M. El-Bakry, and Qiangfu Zhao, "Face Detection Using Fast
Neural Processors and Image Decomposition," International Journal of
Computational Intelligence, Vol.1, No.4, pp. 313-316, 2004.
[13] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Complex Valued Time
Delay Neural Networks," International Journal of Computational
Intelligence, Vol.2, No.1, pp. 16-26, 2005.
[14] Hazem M. El-Bakry, and Qiangfu Zhao, "A Fast Neural Algorithm for
Serial Code Detection in a Stream of Sequential Data," International
Journal of Information Technology, Vol.2, No.1, pp. 71-90, 2005.
[15] H. M. El-Bakry, and Q. Zhao, "Speeding-up Normalized Neural
Networks For Face/Object Detection," Machine Graphics & Vision
Journal (MG&V), Vol. 14, No.1, 2005, pp. 29-59.
[16] H. M. El-Bakry, and Q. Zhao, "Fast Pattern Detection using Normalized
Neural Networks and Cross Correlation in the Frequency Domain,"
EURASIP Journal on Applied Signal Processing,. Special Issue on
Advances in Intelligent Vision Systems: Methods and ApplicationsÔÇö
Part I, Vol. 2005, No. 13, 1 August 2005, pp. 2054-2060.
[17] S. Ben-Yacoub, B. Fasel, and J. Luettin, "Fast Face Detection using MLP
and FFT," Proc. of the Second International Conference on Audio and
Video-based Biometric Person Authentication (AVBPA'99), 1999.
[18] B. Fasel, "Fast Multi-Scale Face Detection," IDIAP-Com 98-04, 1998.
[19] S. Ben-Yacoub, "Fast Object Detection using MLP and FFT," IDIAP-RR
11, IDIAP, 1997.
[20] James W. Cooley and John W. Tukey, "An algorithm for the machine
calculation of complex Fourier series," Math. Comput. 19, 297-301
(1965).
[21] J. P. Lewis, "Fast Normalized Cross Csorrelation", Available
from:<http://www.idiom.com/~zilla/ Papers/nvisionInterface/nip.html >
[22] H. M. El-Bakry, "Comments on Using MLP and FFT for Fast
Object/Face Detection," Proc. of IEEE IJCNN-03, Portland, Oregon, pp.
1284-1288, July, 20-24, 2003.
[23] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Object/Face
Detection," Proc. of the 30th Anniversary SOFSEM Conference on
Current Trends in Theory and Practice of Computer Science, 24-30
January, 2004, Hotel VZ MERIN, Czech Republic.
[24] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Sub-Matrix
(Object/Face) Detection," Proc. of IEEE International Symposium on
Circuits and Systems, Vancouver, Canada, 23-26 May, 2004.
[25] H. M. El-Bakry, "Fast Sub-Image Detection Using Neural Networks and
Cross Correlation in Frequency Domain," Proc. of IS 2004: 14th Annual
Canadian Conference on Intelligent Systems, Ottawa, Ontario, 6-8 June,
2004.
[26] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code
Detection in a Stream of Sequential Data," Proc. of CIC 2004
International Conference on Communications in Computing, Las Vegas,
Nevada, USA, 21-24 June, 2004.
[27] H. M. El-Bakry, "Fast Neural Networks for Object/Face Detection,"
Proc. of 5th International Symposium on Soft Computing for Industry
with Applications of Financial Engineering, June 28 - July 4, 2004,
Sevilla, Andalucia, Spain.
[28] H. M. El-Bakry, and H. Stoyan, "A Fast Searching Algorithm for Sub-
Image (Object/Face) Detection Using Neural Networks," Proc. of the 8th
World Multi-Conference on Systemics, Cybernetics and Informatics, 18-
21 July, 2004, Orlando, USA.
[29] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code
Detection in Sequential Data Using Neural Networks for
Communication Applications," Proc. of the First International
Conference on Cybernetics and Information Technologies, Systems and
Applications: CITSA 2004, 21-25 July, 2004. Orlando, Florida, USA,
Vol. IV, pp. 150-153.
[30] H. M. El-bakry, M. A. Abo-elsoud, and M. S. Kamel, "Fast Modular
Neural Networks for Human Face Detection," Proc. of IEEE-INNSENNS
International Joint Conference on Neural Networks, Como, Italy,
Vol. III, pp. 320-324, 24-27 July, 2000.
[31] H. M. El-bakry, "Fast Iris Detection using Cooperative Modular Neural
Nets," Proc. of the 6th International Conference on Soft Computing, 1-4
Oct., 2000, Japan.
[32] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular
Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol.
10, No. 1, 2001, pp. 47-73.
[33] H. M. El-bakry, "Fast Iris Detection Using Cooperative Modular Neural
Networks," Proc. of the 5th International Conference on Artificial Neural
Nets and Genetic Algorithms, pp. 201-204, 22-25 April, 2001, Prague,
Czech Republic.
[34] H. M. El-bakry, "Fast Iris Detection Using Neural Nets," Proc. of the
14th Canadian Conference on Electrical and Computer Engineering,
pp.1409-1415, 13-16 May, 2001, Canada.
[35] H. M. El-bakry, "Human Iris Detection Using Fast Cooperative Modular
Neural Nets," Proc. of INNS-IEEE International Joint Conference on
Neural Networks, pp. 577-582, 14-19 July, 2001, Washington, DC,
USA.
[36] H. M. El-bakry, "Human Iris Detection for Information Security Using
Fast Neural Nets," Proc. of the 5th World Multi-Conference on
Systemics, Cybernetics and Informatics, 22-25 July, 2001, Orlando,
Florida, USA.
[37] H. M. El-bakry, "Human Iris Detection for Personal Identification Using
Fast Modular Neural Nets," Proc. of the 2001 International Conference
on Mathematics and Engineering Techniques in Medicine and
Biological Sciences, pp. 112-118, 25-28 July, 2001, Monte Carlo Resort,
Las Vegas, Nevada, USA.
[38] H. M. El-bakry, "Human Face Detection Using Fast Neural Networks
and Image Decomposition," Proc. the fifth International Conference on
Knowledge-Based Intelligent Information & Engineering Systems, 6-8
September 2001, Osaka-kyoiku University, Kashiwara City, Japan, pp.
1330-1334.
[39] H. M. El-Bakry, "Fast Iris Detection for Personal Verification Using
Modular Neural Networks," Proc. of the International Conference on
Computational Intelligence, 1-3 Oct., 2001, Dortmund, Germany, pp.-
269-283.
[40] H. M. El-bakry, "Fast Cooperative Modular Neural Nets for Human Face
Detection," Proc. of IEEE International Conference on Image
Processing, 7-10 Oct., 2001, Thessaloniki, Greece.
[41] H. M. El-Bakry, "Fast Face Detection Using Neural Networks and Image
Decomposition," Proc. of the 6th International Computer Science
Conference, Active Media Technology, Dec. 18-20, 2001, Hong Kong -
China, pp. 205-215, 2001.
[42] H. M. El-Bakry, "Face Detection Using Fast Neural Networks and Image
Decomposition," Proc. of INNS-IEEE International Joint Conference on
Neural Networks, 14-19 May, 2002, Honolulu, Hawaii, USA.
[1] R. Klette, and Zamperon, Handbook of image processing operators, John
Wiley & Sonsltd, 1996.
[2] H. A. Rowley, S. Baluja, and T. Kanade, " Neural Network - Based Face
Detection," IEEE Trans. on Pattern Analysis and Machine Intelligence,
Vol. 20, No. 1, pp. 23-38, 1998.
[3] H. Schneiderman and T. Kanade, "Probabilistic modeling of local
appearance and spatial relationships for object recognition, " In IEEE
Conference on Computer Vision and Pattern Recognition (CVPR), pp.
45-51, SantaBarbara, CA, 1998.
[4] R. Feraud, O. Bernier, J. E. Viallet, and M. Collobert, "A Fast and
Accurate Face Detector for Indexation of Face Images," Proceedings of
the Fourth IEEE International Conference on Automatic Face and
Gesture Recognition, Grenoble, France, 28-30 March, 2000.
[5] Y. Zhu, S. Schwartz, and M. Orchard, "Fast Face Detection Using
Subspace Discriminate Wavelet Features," Proc. of IEEE Computer
Society International Conference on Computer Vision and Pattern
Recognition (CVPR'00), South Carolina, June 13 - 15, 2000, Vol.1, pp.
1636-1643.
[6] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular
Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol.
10, No. 1, 2001, pp. 47-73.
[7] S. Srisuk and W. Kurutach, "A New Robust Face Detection in Color
Images," Proc. of IEEE Computer Society International Conference on
Automatic Face and Gesture Recognition, Washington D.C., USA, May
20-21, 2002, pp. 306-311.
[8] H. M. El-Bakry, "Face detection using fast neural networks and image
decomposition," Neurocomputing Journal, Vol. 48, 2002, pp. 1039-
1046.
[9] H. M. El-Bakry, "Human Iris Detection Using Fast Cooperative Modular
Neural Networks and Image Decomposition," Machine Graphics &
Vision Journal (MG&V), Vol. 11, No. 4, 2002, pp. 498-512.
[10] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Object/Face Detection
Using Neural Networks and Fast Fourier Transform," International
Journal of Signal Processing, Vol.1, No.3, pp. 182-187, 2004.
[11] Hazem M. El-Bakry, and Qiangfu Zhao, "A Modified Cross Correlation
in the Frequency Domain for Fast Pattern Detection Using Neural
Networks," International Journal of Signal Processing, Vol.1, No.3, pp.
188-194, 2004.
[12] Hazem M. El-Bakry, and Qiangfu Zhao, "Face Detection Using Fast
Neural Processors and Image Decomposition," International Journal of
Computational Intelligence, Vol.1, No.4, pp. 313-316, 2004.
[13] Hazem M. El-Bakry, and Qiangfu Zhao, "Fast Complex Valued Time
Delay Neural Networks," International Journal of Computational
Intelligence, Vol.2, No.1, pp. 16-26, 2005.
[14] Hazem M. El-Bakry, and Qiangfu Zhao, "A Fast Neural Algorithm for
Serial Code Detection in a Stream of Sequential Data," International
Journal of Information Technology, Vol.2, No.1, pp. 71-90, 2005.
[15] H. M. El-Bakry, and Q. Zhao, "Speeding-up Normalized Neural
Networks For Face/Object Detection," Machine Graphics & Vision
Journal (MG&V), Vol. 14, No.1, 2005, pp. 29-59.
[16] H. M. El-Bakry, and Q. Zhao, "Fast Pattern Detection using Normalized
Neural Networks and Cross Correlation in the Frequency Domain,"
EURASIP Journal on Applied Signal Processing,. Special Issue on
Advances in Intelligent Vision Systems: Methods and ApplicationsÔÇö
Part I, Vol. 2005, No. 13, 1 August 2005, pp. 2054-2060.
[17] S. Ben-Yacoub, B. Fasel, and J. Luettin, "Fast Face Detection using MLP
and FFT," Proc. of the Second International Conference on Audio and
Video-based Biometric Person Authentication (AVBPA'99), 1999.
[18] B. Fasel, "Fast Multi-Scale Face Detection," IDIAP-Com 98-04, 1998.
[19] S. Ben-Yacoub, "Fast Object Detection using MLP and FFT," IDIAP-RR
11, IDIAP, 1997.
[20] James W. Cooley and John W. Tukey, "An algorithm for the machine
calculation of complex Fourier series," Math. Comput. 19, 297-301
(1965).
[21] J. P. Lewis, "Fast Normalized Cross Csorrelation", Available
from:<http://www.idiom.com/~zilla/ Papers/nvisionInterface/nip.html >
[22] H. M. El-Bakry, "Comments on Using MLP and FFT for Fast
Object/Face Detection," Proc. of IEEE IJCNN-03, Portland, Oregon, pp.
1284-1288, July, 20-24, 2003.
[23] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Object/Face
Detection," Proc. of the 30th Anniversary SOFSEM Conference on
Current Trends in Theory and Practice of Computer Science, 24-30
January, 2004, Hotel VZ MERIN, Czech Republic.
[24] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Sub-Matrix
(Object/Face) Detection," Proc. of IEEE International Symposium on
Circuits and Systems, Vancouver, Canada, 23-26 May, 2004.
[25] H. M. El-Bakry, "Fast Sub-Image Detection Using Neural Networks and
Cross Correlation in Frequency Domain," Proc. of IS 2004: 14th Annual
Canadian Conference on Intelligent Systems, Ottawa, Ontario, 6-8 June,
2004.
[26] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code
Detection in a Stream of Sequential Data," Proc. of CIC 2004
International Conference on Communications in Computing, Las Vegas,
Nevada, USA, 21-24 June, 2004.
[27] H. M. El-Bakry, "Fast Neural Networks for Object/Face Detection,"
Proc. of 5th International Symposium on Soft Computing for Industry
with Applications of Financial Engineering, June 28 - July 4, 2004,
Sevilla, Andalucia, Spain.
[28] H. M. El-Bakry, and H. Stoyan, "A Fast Searching Algorithm for Sub-
Image (Object/Face) Detection Using Neural Networks," Proc. of the 8th
World Multi-Conference on Systemics, Cybernetics and Informatics, 18-
21 July, 2004, Orlando, USA.
[29] H. M. El-Bakry, and H. Stoyan, "Fast Neural Networks for Code
Detection in Sequential Data Using Neural Networks for
Communication Applications," Proc. of the First International
Conference on Cybernetics and Information Technologies, Systems and
Applications: CITSA 2004, 21-25 July, 2004. Orlando, Florida, USA,
Vol. IV, pp. 150-153.
[30] H. M. El-bakry, M. A. Abo-elsoud, and M. S. Kamel, "Fast Modular
Neural Networks for Human Face Detection," Proc. of IEEE-INNSENNS
International Joint Conference on Neural Networks, Como, Italy,
Vol. III, pp. 320-324, 24-27 July, 2000.
[31] H. M. El-bakry, "Fast Iris Detection using Cooperative Modular Neural
Nets," Proc. of the 6th International Conference on Soft Computing, 1-4
Oct., 2000, Japan.
[32] H. M. El-Bakry, "Automatic Human Face Recognition Using Modular
Neural Networks," Machine Graphics & Vision Journal (MG&V), Vol.
10, No. 1, 2001, pp. 47-73.
[33] H. M. El-bakry, "Fast Iris Detection Using Cooperative Modular Neural
Networks," Proc. of the 5th International Conference on Artificial Neural
Nets and Genetic Algorithms, pp. 201-204, 22-25 April, 2001, Prague,
Czech Republic.
[34] H. M. El-bakry, "Fast Iris Detection Using Neural Nets," Proc. of the
14th Canadian Conference on Electrical and Computer Engineering,
pp.1409-1415, 13-16 May, 2001, Canada.
[35] H. M. El-bakry, "Human Iris Detection Using Fast Cooperative Modular
Neural Nets," Proc. of INNS-IEEE International Joint Conference on
Neural Networks, pp. 577-582, 14-19 July, 2001, Washington, DC,
USA.
[36] H. M. El-bakry, "Human Iris Detection for Information Security Using
Fast Neural Nets," Proc. of the 5th World Multi-Conference on
Systemics, Cybernetics and Informatics, 22-25 July, 2001, Orlando,
Florida, USA.
[37] H. M. El-bakry, "Human Iris Detection for Personal Identification Using
Fast Modular Neural Nets," Proc. of the 2001 International Conference
on Mathematics and Engineering Techniques in Medicine and
Biological Sciences, pp. 112-118, 25-28 July, 2001, Monte Carlo Resort,
Las Vegas, Nevada, USA.
[38] H. M. El-bakry, "Human Face Detection Using Fast Neural Networks
and Image Decomposition," Proc. the fifth International Conference on
Knowledge-Based Intelligent Information & Engineering Systems, 6-8
September 2001, Osaka-kyoiku University, Kashiwara City, Japan, pp.
1330-1334.
[39] H. M. El-Bakry, "Fast Iris Detection for Personal Verification Using
Modular Neural Networks," Proc. of the International Conference on
Computational Intelligence, 1-3 Oct., 2001, Dortmund, Germany, pp.-
269-283.
[40] H. M. El-bakry, "Fast Cooperative Modular Neural Nets for Human Face
Detection," Proc. of IEEE International Conference on Image
Processing, 7-10 Oct., 2001, Thessaloniki, Greece.
[41] H. M. El-Bakry, "Fast Face Detection Using Neural Networks and Image
Decomposition," Proc. of the 6th International Computer Science
Conference, Active Media Technology, Dec. 18-20, 2001, Hong Kong -
China, pp. 205-215, 2001.
[42] H. M. El-Bakry, "Face Detection Using Fast Neural Networks and Image
Decomposition," Proc. of INNS-IEEE International Joint Conference on
Neural Networks, 14-19 May, 2002, Honolulu, Hawaii, USA.
@article{"International Journal of Information, Control and Computer Sciences:60314", author = "Hazem M. El-Bakry", title = "A New High Speed Neural Model for Fast Character Recognition Using Cross Correlation and Matrix Decomposition", abstract = "Neural processors have shown good results for
detecting a certain character in a given input matrix. In this paper, a
new idead to speed up the operation of neural processors for character
detection is presented. Such processors are designed based on cross
correlation in the frequency domain between the input matrix and the
weights of neural networks. This approach is developed to reduce the
computation steps required by these faster neural networks for the
searching process. The principle of divide and conquer strategy is
applied through image decomposition. Each image is divided into
small in size sub-images and then each one is tested separately by
using a single faster neural processor. Furthermore, faster character
detection is obtained by using parallel processing techniques to test the
resulting sub-images at the same time using the same number of faster
neural networks. In contrast to using only faster neural processors, the
speed up ratio is increased with the size of the input image when using
faster neural processors and image decomposition. Moreover, the
problem of local subimage normalization in the frequency domain is
solved. The effect of image normalization on the speed up ratio of
character detection is discussed. Simulation results show that local
subimage normalization through weight normalization is faster than
subimage normalization in the spatial domain. The overall speed up
ratio of the detection process is increased as the normalization of
weights is done off line.", keywords = "Fast Character Detection, Neural Processors, Cross Correlation, Image Normalization, Parallel Processing.", volume = "2", number = "8", pages = "2776-20", }
