Vision Based Hand Gesture Recognition

With the development of ubiquitous computing, current user interaction approaches with keyboard, mouse and pen are not sufficient. Due to the limitation of these devices the useable command set is also limited. Direct use of hands as an input device is an attractive method for providing natural Human Computer Interaction which has evolved from text-based interfaces through 2D graphical-based interfaces, multimedia-supported interfaces, to fully fledged multi-participant Virtual Environment (VE) systems. Imagine the human-computer interaction of the future: A 3Dapplication where you can move and rotate objects simply by moving and rotating your hand - all without touching any input device. In this paper a review of vision based hand gesture recognition is presented. The existing approaches are categorized into 3D model based approaches and appearance based approaches, highlighting their advantages and shortcomings and identifying the open issues.

Authors:

• Pragati Garg
• Naveen Aggarwal
• Sanjeev Sofat

Keywords:

• Computer Vision
• Hand Gesture
• Hand Posture
• Human Computer Interface.

References:

[1] A. Mulder, "Hand gestures for HCI", Technical Report 96-1, vol. Simon
Fraster University, 1996
[2] F. Quek, "Towards a Vision Based Hand Gesture Interface", pp. 17-31,
in Proceedings of Virtual Reality Software and Technology, Singapore,
1994.
[3] Ying Wu, Thomas S Huang, " Vision based Gesture Recognition : A
Review", Lecture Notes In Computer Science; Vol. 1739 ,
Proceedings of the International Gesture Workshop on Gesture-Based
Communication in Human-Computer Interaction, 1999
[4] K G Derpains, "A review of Vision-based Hand Gestures", Internal
Report, Department of Computer Science. York University, February
2004
[5] Richard Watson, "A Survey of Gesture Recognition Techniques",
Technical Report TCD-CS-93-11, Department of Computer Science,
Trinity College Dublin, 1993.
[6] Y. Wu and T.S. Huang, "Hand modeling analysis and recognition for
vision-based human computer interaction", IEEE Signal Processing
Mag. - Special issue on Immersive Interactive Technology, vol.18, no.3,
pp. 51-60, May 2001
[7] H. Zhou, T.S. Huang, "Tracking articulated hand motion with Eigen
dynamics analysis", In Proc. Of International Conference on Computer
Vision, Vol 2, pp. 1102-1109, 2003 .
[8] JM Rehg, T Kanade, "Visual tracking of high DOF articulated
structures: An application to human hand tracking" ,In Proc. European
Conference on Computer Vision, 1994
[9] A. J. Heap and D. C. Hogg, "Towards 3-D hand tracking using a
deformable model", In 2nd International Face and Gesture Recognition
Conference, pages 140-145, Killington, USA,Oct. 1996.
[10] Y. Wu, L. J. Y., and T. S. Huang. "Capturing natural hand Articulation".
In Proc. 8th Int. Conf. on Computer Vision, volume II, pages 426-432,
Vancouver, Canada, July 2001.
[11] B. Stenger P. R. S. Mendonc┬©a R. Cipolla, "Model-Based 3D Tracking
of an Articulated Hand" , In proc. British Machine Vision Conference,
volume I, Pages 63-72, Manchester, UK, September 2001
[12] [Online] Available from: <http://en.wikipedia.org/wiki/Kalman_filter>
[11.09.2008]
[13] B. Stenger, A. Thayananthan, P.H.S. Torr, R. Cipolla , "Model-based
hand tracking using a hierarchical Bayesian filter" , IEEE transactions
on pattern analysis and machine intelligence, September 2006
[14] Elena Sánchez-Nielsen, Luis Antón-Canalís, Mario Hernández-Tejera,
"Hand Getsure recognition for Human Machine Intercation", In Proc.
12th International Conference on Computer Graphics, Visualization and
Computer Vision : WSCG, 2004
[15] B. Stenger, "Template based Hand Pose recognition using multiple
cues", In Proc. 7th Asian Conference on Computer Vision : ACCV 2006
[16] Lars Bretzner, Ivan Laptev and Tony Lindeberg, "Hand gesture
recognition using multiscale color features, hieracrchichal models and
particle filtering", in Proceedings of Int. Conf. on Automatic face and
Gesture recognition, Washington D.C., May 2002
[17] M. Black, & Jepson, " Eigen tracking: Robust matching and tracking of
articulated objects using a view-based representation", In European
Conference on Computer Vision, 1996.
[18] C C Wang, K C Wang, "Hand Posture recognition using Adaboost with
SIFT for human robot interaction", Springer Berlin, ISSN 0170-8643,
Volume 370/2008
[19] R. Lienhart and J. Maydt, "An extended set of Haar-like features for
rapid object detection," in Proc. IEEE Int. Conf. Image Process., 2002,
vol. 1, pp. 900-903.
[20] Andre L. C. Barczak, Farhad Dadgostar, "Real-time hand tracking using
a set of co-operative classifiers based on Haar-like features", Res. Lett.
Inf. Math. Sci., 2005, Vol. 7, pp 29-42
[21] Qing Chen , N.D. Georganas, E.M Petriu, "Real-time Vision based
Hand Gesture Recognition Using Haar-like features", IEEE
Transactions on Instrumentation and Measurement -2007
[22] P. Viola and M. Jones, "Robust real-time object detection," Cambridge
Res. Lab., Cambridge, MA, pp. 1-24, Tech. Rep. CRL2001/01, 2001.
[23] Ju, S., Black, M., Minneman, S., Kimber, D, "Analysis of Gesture and
Action in Technical Talks for Video Indexing", IEEE Conf. on
Computer Vision and Pattern Recognition, CVPR 97 ,1997
[24] Berry,G.: Small-wall, "A Multimodal Human Computer Intelligent
Interaction Test Bed with Applications", Dept. of ECE, University of
Illinois at Urbana-Champaign, MS thesis (1998)
[25] Zeller, M., et al, " A Visual Computing Environment for Very Large
Scale Biomolecular Modeling", Proc. IEEE Int. Conf. on Applicationspecific
Systems, Architectures and Processors (ASAP), Zurich, pp. 3-
12, 1997
[26] Thad Starner and Alex Pentland, "Real time American Sign Language
Recognition from Video using Hidden Markov Models", Technical
Report 375, MIT Media Lab,1995
[27] A Malima, E Ozgur, M Cetin, "A fast algorithm for Vision based hand
gesture recognition for robot control", 14th IEEE conference on Signal
Processing and Communications Applications, April 2006
[28] Hongmo Je Jiman Kim Daijin , "Hand Gesture Recognition to
Understand Musical Conducting Action" 16th IEEE International
Symposium on Robot and Human interactive Communication, 2007, ROMAN,
2007, pg 163-168
[29] Dong Guo Yonghua, " Vision-Based Hand Gesture Recognition for
Human-Vehicle Interaction", International Conference on Control,
Automation and Computer Vision, 1998
[30] Pickering, Carl A. Burnham, Keith J. Richardson, Michael J. Jaguar ,
"A research Study of Hand Gesture Recognition Technologies and
Applications for Human Vehicle Interaction", 3rd Conference on
Automotive Electronics, 2007
[31] Juan P. Wachs , Helman I. Stern, Yael Edan, Michael Gillam, Jon
Handler, Craig Feied, Mark Smith, "A Gesture-based Tool for Sterile
Browsing of Radiology Images", Journal of the American Medical
Informatics Association (2008; 15:321-323, DOI 10.1197/jamia.M24)
[32] [Online] Available from:
<http://www.xbitlabs.com/news/mobile/display/20080624203611_Toshi
ba_Formally_Unveils_Notebooks_with_SpursEngine_Chip.html>
[11.09.2008]