Adaptive Gaussian Mixture Model for Skin Color Segmentation

Skin color based tracking techniques often assume a static skin color model obtained either from an offline set of library images or the first few frames of a video stream. These models can show a weak performance in presence of changing lighting or imaging conditions. We propose an adaptive skin color model based on the Gaussian mixture model to handle the changing conditions. Initial estimation of the number and weights of skin color clusters are obtained using a modified form of the general Expectation maximization algorithm, The model adapts to changes in imaging conditions and refines the model parameters dynamically using spatial and temporal constraints. Experimental results show that the method can be used in effectively tracking of hand and face regions.

Authors:

• Reza Hassanpour
• Asadollah Shahbahrami
• Stephan Wong

Keywords:

• Face detection
• Segmentation
• Tracking
• Gaussian Mixture Model
• Adaptation.

References:

[1] A. A. Argyros and M. I. A. Lourakis. Real-Time Tracking of Multiple
Skin-Colored Objects with a Possibly Moving Camera. In Proc.
European Conference on Computer Vision (ECCV), pages 368-379,
2004.
[2] A. A. Argyros and M. I. A. Lourakis. Three-Dimensional Tracking
of Multiple Skin-Colored Regions by Moving Stereoscopic System.
Applied Optics, 43(2), January 2004.
[3] S. Birchfield. Elliptical Head Tracking Using Intensity Gradients and
Color Histograms. In Proc. on Computer Vision and Pattern Recognition,
pages 232-237, 1998.
[4] J. Brand and J. Mason. A Comparative Assessment of Three Approaches
to Pixel Level Human Skin Detection. In Proc. IEEE Int. Conf. on on
Pattern Recognition, pages 1056-1059, 2000.
[5] D. Chai and A. Bouzerdoum. A Bayesian Approach to Skin Color
Classification in YCbCr Color Space. In Proc. 10th IEEE Conf. on
Region, pages 421-424, 2000.
[6] B. S. Everitt and D. J. Hand. Finite Mixture Distribution, Monographs
on Applied Probability and Statistics. Chapman and Hall, 1981.
[7] R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain. Face detection in color
images. IEEE Transaction on Pattern Analysis and Machine Intelligence,
24(5):696-706, May 2002.
[8] M. Jones and J. M. Rehg. Statistical Color Models with Application
to Skin Detection. In Proc. IEEE Int. Conf. on Computer Vision and
Pattern Recognition, pages 274-280, 1999.
[9] J. Lee and S. Yoo. An Elliptical Boundary Model for Skin Color Detection.
In Proc. Int. Conf. on Imaging Science, System and Technology,
2002.
[10] C. Liu. A bayesian discriminating features method for face detection.
IEEE Transactions on Pattern Analysis and Machine Intelligence,
25(6):725-740, June 2003.
[11] S. J. McKenna, S. Gong, and Y. Raja. Modelling Facial Colour and
Identity with Gaussian Mixtures. In Proc. on Pattern Recognition, pages
1883-1892, 1998.
[12] K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text Classification
from Labeled and Unlabeled Documents Using EM. Machine Learning
Special Issue on Information Retrieval, 39(2):103-134, May-June 2000.
[13] N. Oliver, A. Pentland, and F. Berard. Lafter: Lips and Face Real Time
Tracker. In Proc. Computer Vision and Pattern Recognition, pages 123-
129, 1997.
[14] P. Perez, C. Hue, J. Vermaak, and M. Cangnet. Color-Based Probabilistic
Tracking. In Proc. European Conference on Computer Vision (ECCV),
pages 661-675, 2002.
[15] M. Sadeghi, J.V. Kittler, A. Kostin, and K. Messer. A Comparative
Study of Automatic Face Verification Algorithms on the BANCA
Database. In Proc. Int. Conf. on Audio and Video Based Person
Anthentication, pages 35-43, 2003.
[16] L. Sigal, S. Sclaroff, and V. Athitsos. Estimation and Prediction of
Evolving Color Distributions for Skin Segmentation Under Varying
Illumination. In Proc. IEEE Conf. on Computer Vision and Pattern
Recognition, pages 1883-1892, 2000.
[17] J. Terrillion, M. Shirazi, H. Fukamachi, and S. Akamatsu. Comparative
Performance of Different Skin Chrominance Models and Chrominance
Spaces for the Automatic Detection of Human Faces in Color Images. In
Proc. Int. Conf. on Face and Gesture Recognition, pages 54-61, 2000.
[18] H. Yang, D. Kriegman, and N. Ahuja. Detecting Faces in Images: A
Survey. IEEE Transaction on Pattern Analysis and Machine Intelligence,
24(1):34-58, 2002.
[19] D. Zarit, B. J. Super, and F. Queck. Comparison of Five Color Models
in Skin Pixel Classification. In Proc. Workshop on Recognition, Analysis
and Tracking of Faces and Gestures in Real-Time Systems, pages 58-63,
1999.