Usability Evaluation Framework for Computer Vision Based Interfaces

Human computer interaction has progressed considerably from the traditional modes of interaction. Vision based interfaces are a revolutionary technology, allowing interaction through human actions, gestures. Researchers have developed numerous accurate techniques, however, with an exception to few these techniques are not evaluated using standard HCI techniques. In this paper we present a comprehensive framework to address this issue. Our evaluation of a computer vision application shows that in addition to the accuracy, it is vital to address human factors

Authors:

• Muhammad Raza Ali
• Tim Morris

Keywords:

• Usability evaluation
• cognitive walkthrough
• think aloud
• gesture recognition.

References:

[1] V. Hayward, O.R. Astley, M.C-Hernandez, D. Grant and G. Torre,
"Haptic devices and interfaces". Sensor Review, vol 24(1), pp:16-29.
[2] Y. Wu and T. Huang, "Vision-based gesture recognition: a review". In
International Gesture Workshop (GW99), 1999.
[3] Y. Yin and D. R. Toward, Natural interaction in the real world: realtime
gesture recognition. In International Conference on Multimodal
Interfaces and the Workshop on Machine Learning for Multimodal
Interaction (ICMI-MLMI '10), 2010.
[4] R. Hassanpour, S. Wong and A. Shahbahrami, "Vision based hand
gesture recognition for human computer interaction: A review". In
IADIS International Conference on Interfaces and Human Computer
Interaction, 2008.
[5] R. Kjeldsen and J. Hartman, "Design issues for vision-based computer
interaction systems". In Proceedings of Perceptible User Interfaces,
2001.
[6] K. Li, Y. Du and Z. Fu. TreeHeaven: A table game using vision-based
gesture recognition. In RDURP-11, 2011.
[7] H. Ren and G. Xu, "Human action recognition in smart classroom". In
Proceedings of the Fifth IEEE International Conference on Automatic
Face and Gesture Recognition, pp. 417-422, 2000.
[8] G. Iannizzotto, F.L. Rosa, C. Costanzo, and P. Lanzafame, "A
multimodal perceptual user interface for video-surveillance
environments". In Proceedings of Multimodal Interfaces (ICMI-05), pp.
45-52, 2005.
[9] N. Stefanov, A. Galata, R. Hubbold, R., A. Group., and O. Road,
"Real-time hand tracking with variable-length markov models of
behaviour". In IEEE Int. Workshop on Vision for Human-Computer
Interaction (V4HCI), in conjunction with CVPR, 2005.
[10] S. Weiss, Handheld Usability. Wiley, 2002.
[11] P. Polson and C. Lewis, "Theory based design for easily learned
interfaces". Human Computer Interaction, vol. 5(2), pp. 191-220, 1990.
[12] B. Schneiderman, C. Plaisant, M. Cohen and S. Jacobs, Designing the
User Interface: Strategies for Effective Human-Computer Interaction..
Addison Wesley, 2009.
[13] R. Likert, "A technique for the measurement of attitudes". Archives of
Psychology, vol. 22(140), pp. 1-55, 1932.
[14] M.R.Ali and T. Morris, "Real Time Single and Multiuser Gesture
Recognition Based on Skin Colour and Optical Flow". To appear in
BMVW, 2012.
[15] J. Nielsen, Heuristic Evaluation. In Nielsen, J. and Mack, R.L. (Eds),
Usability Inspection Methods, John Wiley & sons, N.Y. 1994.
[16] C. Abras, D. Maloney-Krichmar and J. Preece. User-Centered Design.
In: Bainbridge W, editor. Encyclopedia of Human-Computer
Interaction. Sage; Thousand Oaks: 2004
[17] D.E. Norman, Cognitive engineering. In D. A. Norman and S. W.
Draper (eds) User Centered Systems Design, Hillsdale, NJ: Lawrence
Erlbaum Associates Inc., 1986.