Usability Evaluation Framework for Computer Vision Based Interfaces
Human computer interaction has progressed
considerably from the traditional modes of interaction. Vision based
interfaces are a revolutionary technology, allowing interaction
through human actions, gestures. Researchers have developed
numerous accurate techniques, however, with an exception to few
these techniques are not evaluated using standard HCI techniques. In
this paper we present a comprehensive framework to address this
issue. Our evaluation of a computer vision application shows that in
addition to the accuracy, it is vital to address human factors
[1] V. Hayward, O.R. Astley, M.C-Hernandez, D. Grant and G. Torre,
"Haptic devices and interfaces". Sensor Review, vol 24(1), pp:16-29.
[2] Y. Wu and T. Huang, "Vision-based gesture recognition: a review". In
International Gesture Workshop (GW99), 1999.
[3] Y. Yin and D. R. Toward, Natural interaction in the real world: realtime
gesture recognition. In International Conference on Multimodal
Interfaces and the Workshop on Machine Learning for Multimodal
Interaction (ICMI-MLMI '10), 2010.
[4] R. Hassanpour, S. Wong and A. Shahbahrami, "Vision based hand
gesture recognition for human computer interaction: A review". In
IADIS International Conference on Interfaces and Human Computer
Interaction, 2008.
[5] R. Kjeldsen and J. Hartman, "Design issues for vision-based computer
interaction systems". In Proceedings of Perceptible User Interfaces,
2001.
[6] K. Li, Y. Du and Z. Fu. TreeHeaven: A table game using vision-based
gesture recognition. In RDURP-11, 2011.
[7] H. Ren and G. Xu, "Human action recognition in smart classroom". In
Proceedings of the Fifth IEEE International Conference on Automatic
Face and Gesture Recognition, pp. 417-422, 2000.
[8] G. Iannizzotto, F.L. Rosa, C. Costanzo, and P. Lanzafame, "A
multimodal perceptual user interface for video-surveillance
environments". In Proceedings of Multimodal Interfaces (ICMI-05), pp.
45-52, 2005.
[9] N. Stefanov, A. Galata, R. Hubbold, R., A. Group., and O. Road,
"Real-time hand tracking with variable-length markov models of
behaviour". In IEEE Int. Workshop on Vision for Human-Computer
Interaction (V4HCI), in conjunction with CVPR, 2005.
[10] S. Weiss, Handheld Usability. Wiley, 2002.
[11] P. Polson and C. Lewis, "Theory based design for easily learned
interfaces". Human Computer Interaction, vol. 5(2), pp. 191-220, 1990.
[12] B. Schneiderman, C. Plaisant, M. Cohen and S. Jacobs, Designing the
User Interface: Strategies for Effective Human-Computer Interaction..
Addison Wesley, 2009.
[13] R. Likert, "A technique for the measurement of attitudes". Archives of
Psychology, vol. 22(140), pp. 1-55, 1932.
[14] M.R.Ali and T. Morris, "Real Time Single and Multiuser Gesture
Recognition Based on Skin Colour and Optical Flow". To appear in
BMVW, 2012.
[15] J. Nielsen, Heuristic Evaluation. In Nielsen, J. and Mack, R.L. (Eds),
Usability Inspection Methods, John Wiley & sons, N.Y. 1994.
[16] C. Abras, D. Maloney-Krichmar and J. Preece. User-Centered Design.
In: Bainbridge W, editor. Encyclopedia of Human-Computer
Interaction. Sage; Thousand Oaks: 2004
[17] D.E. Norman, Cognitive engineering. In D. A. Norman and S. W.
Draper (eds) User Centered Systems Design, Hillsdale, NJ: Lawrence
Erlbaum Associates Inc., 1986.
[1] V. Hayward, O.R. Astley, M.C-Hernandez, D. Grant and G. Torre,
"Haptic devices and interfaces". Sensor Review, vol 24(1), pp:16-29.
[2] Y. Wu and T. Huang, "Vision-based gesture recognition: a review". In
International Gesture Workshop (GW99), 1999.
[3] Y. Yin and D. R. Toward, Natural interaction in the real world: realtime
gesture recognition. In International Conference on Multimodal
Interfaces and the Workshop on Machine Learning for Multimodal
Interaction (ICMI-MLMI '10), 2010.
[4] R. Hassanpour, S. Wong and A. Shahbahrami, "Vision based hand
gesture recognition for human computer interaction: A review". In
IADIS International Conference on Interfaces and Human Computer
Interaction, 2008.
[5] R. Kjeldsen and J. Hartman, "Design issues for vision-based computer
interaction systems". In Proceedings of Perceptible User Interfaces,
2001.
[6] K. Li, Y. Du and Z. Fu. TreeHeaven: A table game using vision-based
gesture recognition. In RDURP-11, 2011.
[7] H. Ren and G. Xu, "Human action recognition in smart classroom". In
Proceedings of the Fifth IEEE International Conference on Automatic
Face and Gesture Recognition, pp. 417-422, 2000.
[8] G. Iannizzotto, F.L. Rosa, C. Costanzo, and P. Lanzafame, "A
multimodal perceptual user interface for video-surveillance
environments". In Proceedings of Multimodal Interfaces (ICMI-05), pp.
45-52, 2005.
[9] N. Stefanov, A. Galata, R. Hubbold, R., A. Group., and O. Road,
"Real-time hand tracking with variable-length markov models of
behaviour". In IEEE Int. Workshop on Vision for Human-Computer
Interaction (V4HCI), in conjunction with CVPR, 2005.
[10] S. Weiss, Handheld Usability. Wiley, 2002.
[11] P. Polson and C. Lewis, "Theory based design for easily learned
interfaces". Human Computer Interaction, vol. 5(2), pp. 191-220, 1990.
[12] B. Schneiderman, C. Plaisant, M. Cohen and S. Jacobs, Designing the
User Interface: Strategies for Effective Human-Computer Interaction..
Addison Wesley, 2009.
[13] R. Likert, "A technique for the measurement of attitudes". Archives of
Psychology, vol. 22(140), pp. 1-55, 1932.
[14] M.R.Ali and T. Morris, "Real Time Single and Multiuser Gesture
Recognition Based on Skin Colour and Optical Flow". To appear in
BMVW, 2012.
[15] J. Nielsen, Heuristic Evaluation. In Nielsen, J. and Mack, R.L. (Eds),
Usability Inspection Methods, John Wiley & sons, N.Y. 1994.
[16] C. Abras, D. Maloney-Krichmar and J. Preece. User-Centered Design.
In: Bainbridge W, editor. Encyclopedia of Human-Computer
Interaction. Sage; Thousand Oaks: 2004
[17] D.E. Norman, Cognitive engineering. In D. A. Norman and S. W.
Draper (eds) User Centered Systems Design, Hillsdale, NJ: Lawrence
Erlbaum Associates Inc., 1986.
@article{"International Journal of Information, Control and Computer Sciences:53308", author = "Muhammad Raza Ali and Tim Morris", title = "Usability Evaluation Framework for Computer Vision Based Interfaces", abstract = "Human computer interaction has progressed
considerably from the traditional modes of interaction. Vision based
interfaces are a revolutionary technology, allowing interaction
through human actions, gestures. Researchers have developed
numerous accurate techniques, however, with an exception to few
these techniques are not evaluated using standard HCI techniques. In
this paper we present a comprehensive framework to address this
issue. Our evaluation of a computer vision application shows that in
addition to the accuracy, it is vital to address human factors", keywords = "Usability evaluation, cognitive walkthrough, think
aloud, gesture recognition.", volume = "6", number = "10", pages = "1193-6", }