Assessment of Time-Lapse in Visible and Thermal Face Recognition

Although face recognition seems as an easy task for human, automatic face recognition is a much more challenging task due to variations in time, illumination and pose. In this paper, the influence of time-lapse on visible and thermal images is examined. Orthogonal moment invariants are used as a feature extractor to analyze the effect of time-lapse on thermal and visible images and the results are compared with conventional Principal Component Analysis (PCA). A new triangle square ratio criterion is employed instead of Euclidean distance to enhance the performance of nearest neighbor classifier. The results of this study indicate that the ideal feature vectors can be represented with high discrimination power due to the global characteristic of orthogonal moment invariants. Moreover, the effect of time-lapse has been decreasing and enhancing the accuracy of face recognition considerably in comparison with PCA. Furthermore, our experimental results based on moment invariant and triangle square ratio criterion show that the proposed approach achieves on average 13.6% higher in recognition rate than PCA.

Authors:

• Sajad Farokhi
• Siti Mariyam Shamsuddin
• Jan Flusser
• Usman Ullah Sheikh

Keywords:

• Infrared Face recognition
• Time-lapse
• Zernike moment invariants

References:

[1] Socolinsky, Selinger and Neuheisel, Face recognition with visible and
thermal infrared imagery. Computer Vision and Image Understanding,
2003. 91(1-2): p. 72-114.
[2] Störring, Andersen and Granum, Physics-based modelling of human skin
colour under mixed illuminants. Robotics and Autonomous Systems,
2001. 35(3-4): p. 131-142.
[3] Kong, Heo, Abidi, Paik, and Abidi, Recent advances in visual and
infrared face recognition--a review. Computer Vision and Image
Understanding, 2005. 97(1): p. 103-135.
[4] Xin Chen , Patrick J. Flynn and Bowyer. Visible-light and Infrared Face
Recognition. in The proceedings of Workshop on Multimodal User
Authentication. 2003. Santa Barbara, CA USA.
[5] Buddharaju, Pavlidis, Tsiamyrtzis, and Bazakos, Physiology-Based Face
Recognition in the Thermal Infrared Spectrum. IEEE Transactions on
Pattern Analysis and Machine Intelligence, 2007. 29(4): p. 613-626.
[6] Chen, Flynn and Bowyer, IR and visible light face recognition.
Computer Vision and Image Understanding, 2005. 99(3): p. 332-358.
[7] Joseph Wilder, P. Jonathon Phillips, Cunhong Jiang, and Wiener.
Comparison of visible and infra-red imagery for face recognition. in
Proceedings of the Second International Conference on Automatic Face
and Gesture Recognition. 1996.
[8] Xin Chen, Patrick J. Flynn and Bowyer. PCA-based face recognition in
infrared imagery: baseline and comparative studies. in IEEE
International Workshop on Analysis and Modeling of Faces and
Gestures. 2003.
[9] Yu, Zhihua, Zhijun, Jucheng, Shiqian, and Feng. Time-Lapse Data
Oriented Infrared Face Recognition Method Using Block-PCA. in 2010
International Conference on Multimedia Technology (ICMT). 2010.
[10] Jan Flusser, Moment Invariants in Image Analysis. Proceedings of
World Academy of Science, Engineering and Technology, 2006. 1307-
6884: p. 196-201.
[11] Jian, Zhang, Frangi, and Jing-yu, Two-dimensional PCA: a new
approach to appearance-based face representation and recognition.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004.
26(1): p. 131-137.
[12] M. Turk and Pentland, Eigenfaces for Recognition. Journal of Cognitive
Neuroscience, 1991. 3,No 1: p. 71-86.
[13] Jan Flusser, Tomas Suk and Zitova, Moments and Moment Invariants in
Pattern Recognition. First ed. 2009, chichester: wiley. 291.
[14] Zahran, Abbas, Dessouky, Ashour, and Sharshar. High performance face
recognition using PCA and ZM on fused LWIR and VISIBLE images on
the wavelet domain. in International Conference on Computer
Engineering & Systems. 2009.
[15] Lajevardi seyed mehdi and Hussain, Higher order orthogonal moments
for invariant facial expression recognition. Digital Signal Processing,
2010. 20(6): p. 1771-1779.
[16] Nabatchian, Makaremi, Abdel-Raheem, and Ahmadi. Pseudo-Zernike
Moment Invariants for Recognition of Faces Using Different Classifiers
in FERET Database. in Third International Conference on Convergence
and Hybrid Information Technology. 2008.
[17] Zhi and Ruan. A Comparative Study on Region-Based Moments for
Facial Expression Recognition. in Congress on Image and Signal
Processing. 2008.
[18] Ali Broumandnia and Shanbehzadeh, Fast Zernike wavelet moments for
Farsi character recognition. Image and Vision Computing, 2007. 25(5):
p. 717-726.
[19] Shen and Ip, Discriminative wavelet shape descriptors for recognition of
2-D patterns. Pattern Recognition, 1999. 32(2): p. 151-165.
[20] A. Marcano-Cedeño, J. Quintanilla-Domínguez, Cortina-Januchs, and
Andina. Feature selection using Sequential Forward Selection and
classification applying Artificial Metaplasticity Neural Network. in 36th
IEEE Annual Conference on Industrial Electronics Society. 2010.
[21] Durga Prasad Muni, Nikhil R. Pal and Das, Genetic programming for
simultaneous feature selection and classifier design. IEEE Transactions
on Systems, Man, and Cybernetics, Part B: Cybernetics, 2006. 36(1): p.
106-117.
[22] Gutierrez-Osuna, a lecture on sequential feature selection. 2008, A&M
University: Texas. p. 1-15.
[23] Nor'aini, Raveendran and Selvanathan. Human Face Recognition using
Zernike moments and Nearest Neighbor classifier. in 4th Student
Conference on Research and Development. 2006.
[24] Chao-Chun Liu, Dao-Qing Dai and Yan, Local discriminant wavelet
packet coordinates for face recognition. Journal of Machine Learning
Research, May 2007. Vol. 8: p. 1165-1195.
[25] Flynn, Bowyer and Phillips, Assessment of Time Dependency in Face
Recognition: An Initial Study Audio- and Video-Based Biometric Person
Authentication, J. Kittler and M. Nixon, Editors. 2003, Springer Berlin /
Heidelberg. p. 1057-1057.
[26] Viola and Jones. Rapid Object Detection Using a Boosted Cascade of
Simple Features. in Computer Vision and Pattern Recognition. 2001.
[27] Hrkać, Kalafatić and Krapac, Infrared-Visual Image Registration Based
on Corners and Hausdorff Distance Image Analysis, B. Ersb├©ll and K.
Pedersen, Editors. 2007, Springer Berlin / Heidelberg. p. 383-392.
[28] Socolinsky and Selinger. Thermal face recognition over time. in
Proceedings of the 17th International Conference on Pattern
Recognition. 2004.
[29] Sang-ki Kim, Hyobin Lee, Sunjin Yu, and Lee. Robust Face
Recognition by Fusion of Visual and Infrared Cues. in 1ST IEEE
Conference on Industrial Electronics and Applications. 2006.
[30] Buddharaju and Pavlidis, Multispectral Face Recognition: Fusion of
Visual Imagery with Physiological Information, in Face Biometrics for
Personal Identification, R. Hammoud, B. Abidi, and M. Abidi, Editors.
2007, Springer Berlin Heidelberg. p. 91-108.