A Survey on Facial Feature Points Detection Techniques and Approaches

Automatic detection of facial feature points plays
an important role in applications such as facial feature tracking,
human-machine interaction and face recognition. The majority of
facial feature points detection methods using two-dimensional or
three-dimensional data are covered in existing survey papers. In
this article chosen approaches to the facial features detection have
been gathered and described. This overview focuses on the class
of researches exploiting facial feature points detection to represent
facial surface for two-dimensional or three-dimensional face. In
the conclusion, we discusses advantages and disadvantages of the
presented algorithms.

Authors:

• Rachid Ahdid
• Khaddouj Taifi
• Said Safi
• Bouzid Manaut

Keywords:

• Facial feature points
• face recognition
• facial feature tracking
• two-dimensional data
• three-dimensional data.

References:

[1] S. Fazli, R. Afrouzian, and H. Seyedarabi. Fiducial facial points
tracking using particle lter and geometric features. In International
Congress on Ultra Modern Telecom-munications and Control Systems
and Workshops(ICUMT), 2010, pages 396-400; 2010.
[2] S. Nagamalla and B.C. Dhara. A novel face recognition method using
facial landmarks. In Seventh International Conference on Advances in
Pattern Recognition 2009(ICAPR ’09), pages 445-448, Feburary 2009.
[3] M.F. Valstar, B. Martinez, X. Binefa, and M. Pantic. Facial point
detection using Boosted Regression and Graph Models. In IEEE Int’l
Conf. Computer Vision and Pattern Recognition, pages 2729-2736, San
Francisco, USA, June 2010.
[4] M.P. Segundo, L. Silva, O.R.P. Bellon, and C.C. Queirolo. Automatic face
segmentation and facial landmark detection in range images. In IEEE
Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics,
volume 40, pages 1319-1330, September 2010.
[5] W.S. Lee and N. Magnenat-Thalmann. Fast head modeling for animation.
Image and Vision Computing, 18(4):355-364, March 2000.
[6] C. Hu, R. Feris, and M. Turk. Real-time view-based face alignment using
active wavelet networksn. In Proc. IEEE Intl Workshop Analysis and
Modeling of Faces and Gestures, pages 215-221. IEEE, 2003.
[7] R. Stiefelhagen, U. Meier, and J. Yang. Real-time lip-tracking for
lipreading. In Proceedings of the 2001 IEEE Computer Society
Conference on Computer Vision and Pattern Recognition, CVPR 2001.
[8] E. Holden and R. Owens. Automatic facial point detection. In Proc. Asian
Conf. Computer Vision, pages 731-736, 2002.
[9] B. Yip, W.Y. Sui, and J.S. Jin. Pose determination of human head
using one feature point based on head movement. In IEEE International
Conference on Multimedia and Expo, 2004(ICME ’04), pages 1183-1186,
June 2004.
[10] M. Pantic and L.J.M. Rothkrantz. Facial action recognition for facial
expression analysis from static face images. In IEEE Transactions on
Systems, Man and Cy- bernetics, Part B: Cybernetics, volume 34, No.3,
pages 1449-1461. IEEE, 2004.
[11] K. Grauman, M. Betke, J. Gips, and G.R. Bradski. Communication via
eye blinks-detection and duration analysis in real time. In Proceedings of
the 2001 IEEE Computer Society Conference on Computer Vision and
Pattern Recognition, CVPR 2001, volume 1, pages 1010-1017. IEEE,
2001.
[12] M.J.T. Reinders, et al., Locating Facial Features in Image Sequences
using Neural Networks, Proc. IEEE Intl Conf. Face and Gesture
Recognition, pp. 230-235, 1996.
[13] E. Holden, R. Owens, Automatic Facial Point Detection, Proc. Asian
Conf. Computer Vision, 2002.
[14] R.S. Feris, et al., Hierarchical Wavelet Networks for Facial Feature
Localization, Proc. IEEE Intl Conf. Face and Gesture Recognition, pp.
118-123, 2002.
[15] C. Hu, et al., Real-time view-based face alignment using active wavelet
networks, Proc. IEEE Intl Workshop Analysis and Modeling of Faces and
Gestures, pp. 215- 221, 2003.
[16] S. Yan, et al., Face Alignment using View-Based Direct Appearance
Models, Intl J. Imaging Systems and Technology, vol. 13, no. 1, pp.
106-112, 2003.
[17] L. Wiskott, et al., Face recognition by elastic bunch graph matching.
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7,
pp. 775779, 1997.
[18] D. Cristinacce, T. Cootes, Facial Feature Detection Using AdaBoost
With Shape Constrains, British Machine Vision Conference, 2003. [19] L. Chen, et al., 3D Shape Constraint for Facial Feature Localization
using Probabilistic-like Output, Proc. IEEE Intl Workshop Analysis and
Modeling of Faces and Gestures, pp. 302-307, 2004.
[20] T. Cootes, G. Edwards, and C. Taylor. Active appearance models. Pattern
Analysis and Machine Intelligence,IEEE Transactions on, 23(6):681685,
June 2001.
[21] D. Cristinacce and T. Cootes. A comparison of shape constrained
facial feature detectors. Automatic Face and Gesture Recognition, 2004.
Proceedings. Sixth IEEE International Conference on, pages 375380,
17-19 May 2004.
[22] A. Salah and L. Akarun. 3d facial feature localization for registration.
Multimedia Content Representation, Classification and Security, pages
338345, 2006.
[23] X. Lu and A. K. Jain. ”Multimodal facial feature extraction for automatic
3D face recognition,” Technical Report MSU-CSE-05-22, Department of
Computer Science, Michigan State University, East Lansing, Michigan,
August 2005.
[24] M. Yu and B. P. Tiddeman: ”Facial Feature Detection and Tracking with
a 3D Constrained Local Model”, WSCG 2010 conference proceedings,
Copyright UNION Agency Science Press, pp: 181-188, WSCG 2010.
[25] D. Vukadinovic and M. Pantic ; Fully Automatic Facial Feature Point
Detection Using Gabor Feature Based Boosted Classifiers; 2005 IEEE
International Conference on Systems, Man and Cybernetics Waikoloa,
Hawaii October 10-12, 2005.
[26] V. Bevilacqua, A. Ciccimarra, I. Leone and G. Mastronardi: ”Automatic
Facial Feature Points Detection”, Conference Paper September 2008 DOI:
10.1007/978-3-540-85984-0–137 Source: DBLP, pp:11421149 , 2008.
[27] M. R. Quiones, D. Masip and J. Vitria: ”Automatic Detection
of Facial Feature Points via HOGs and Geometric Prior Models”,
Conference Paper-June 2011, DOI: 10.1007/978-3-642-21257-4–46,
Source: DBLP Conference: Pattern Recognition and Image Analysis-5th
Iberian Conference, IbPRIA 2011.
[28] A. S. Md. Sohail and P. Bhattacharya:”Detection of Facial
Feature Points Using Anthropometric Face Model”, Signal Processing
for Image Enhancement and Multimedia Processing Volume 31
of the series Multimedia Systems and Applications Series,DOI
10.1007/978-0-387-72500-0–17 pp: 189-200, 2008.
[29] H. WU, J. INADA, T. SHIOYAMA, Q. CHEN and T. SIMADA:
” Automatic facial feature points detection with susan operator”. In
Proceedings of the Scandinavian Conference on Image Analysis, pp:
257-263, 2001.
[30] S. Jahanbin, A. C. Bovik, and H. Choi:” Automated facial feature
detection from portrait and range images”. In Image analysis and
interpretation, 2008. SSIAI 2008. IEEE southwest symposium on (pp.
25-28). IEEE. 2008.
[31] M. Yu, and B. Tiddeman: ”Face Feature Detection with 3D Models”,
2011.
[32] B. Tiddeman:”Facial feature detection with 3D convex local models”.
In Automatic Face and Gesture Recognition and Workshops (FG 2011),
2011 IEEE International Conference on (pp. 400-405). IEEE 2011.
[33] D. Colbry, G. Stockman, and A. Jain:”Detection of Anchor Points
for 3D Face Verification”, 2005 IEEE Computer Society Conference
on Computer Vision and Pattern Recognition (CVPR’05) - Workshops,
pp:25-25, June 2005.
[34] X. Lu, and A. K. Jain. :”Multimodal facial feature extraction for
automatic 3D face recognition”2. Department of Computer Science,
Michigan State University, East Lansing, Michigan, Tech. Rep.
MSU-CSE-05-22. 2005.