Usability and Functionality: A Comparison of Key Project Personnel's and Potential Users' Evaluations
Meeting users- requirements is one of predictors of project success. There should be a match between the expectations of the users and the perception of key project personnel with respect to usability and functionality. The aim of this study is to make a comparison of key project personnel-s and potential users- (customer representatives) evaluations of the relative importance of usability and functionality factors in a software design project. Analytical Network Process (ANP) was used to analyze the relative importance of the factors. The results show that navigation and interaction are the most significant factors,andsatisfaction and efficiency are the least important factors for both groups. Further, it can be concluded that having similar orders and scores of usability and functionality factors for both groups shows that key project personnel have captured the expectations and requirements of potential users accurately.
[1] M. Lu and W. Yeung, "A framework for effective commercial web
application development," Internet Research: Electronic Networking
Applications and Policy, vol.8, no. 2, pp. 166-173, 1998.
[2] J.C. Bertot, J.T. Snead, P.T. Jaeger, and C.R. McClure, "Functionality,
usability and accessibility," Performance Measurement and Metrics, vol.
7, no. 1, pp. 17-28, 2006.
[3] J. Nielsen, "Usability 101: Introduction to usability," Useit.com
Alertbox: Current Issues in Web Usability, August, 2003, available at:
www.useit.com/alertbox/20030825.html(accessed on 7 September
2008).
[4] C.S. Porter, J.M. Porter, and S. Chhibber, "Realpeople; capturing the
emotions of product users," in Meeting Diversity in Ergonomics, Ed.
Pikaar, Koningsveld, and Settels, NJ: Elsevier, 2007, ch. 12, pp. 187-
208.
[5] T.A. Yeung and R. Law, "Extending the modified heuristic usability
evaluation technique to chain and independent hotel websites,"
International Journal of Hospitality Management, vol. 23, pp. 307-313,
2004.
[6] A. Seffah, T. Mohamed, H. Habieb-Mammar, and A. Abran,
"Reconciling usability and interactive system architecture using
patterns," Journal of Systems and Software, vol. 81, pp. 1845-1852,
2008.
[7] L. Bass and B.E. John, "Linking usability to software architecture
patterns through general scenarios," Journal of Systems and Software,
vol. 66, pp. 187-197, 2003.
[8] S. Furnell, "Why users can not use security," Computers and Security,
vol. 24, pp. 274-279, 2005.
[9] C.D. Kavadias, S. Rupp, S.L. Tombros, and D.D., Vergados, "A P2P
technology middleware architecture enabling user-centric services
deployment on low-cost embedded networked devices," Computer
Communications, vol. 30, pp. 527-537, 2007.
[10] D.J.M. Saarloos, T.A. Arentze, A.W.J. Borgers, and H.J.P.
Timmermans, "A multi-agent paradigm as structuring principle for
planning support systems," Computers, Environment and Urban
Systems, vol. 32, pp. 29-40, 2008.
[11] R.B. Klein and A. Seffah, "Evaluation of integrated software
development environments: Challenges and results from three empirical
studies," International Journal of Human-Computer Studies, vol. 63, pp.
607-627, 2005.
[12] S. Petter, "Managing user expectations on software projects: lessons
from the trenches," International Journal of Project Management, vol.
26, pp. 700-712, 2008.
[13] J.D. Procaccino and J.M. Verner, "Software project managers and
project success: An exploratory study," Journal of Systems and
Software, vol. 79, pp. 1541-1551, 2006.
[14] D. White and J. Fortune, "Current practice in project management - an
empirical study," International Journal of Project Management, vol. 20,
pp. 1-11, 2002.
[15] R. Schmidt, K. Lyytinen, M. Keil, and P. Cule, "Identifying software
project risks: An international Delphi study," Journal of Management
Information Systems, vol. 17, no. 4, pp. 5-36, 2001.
[16] J.W. Palmer, "Web site usability, design, and performance metrics,"
Information Systems Research, vol. 13, no. 2, pp. 151-167, 2002.
[17] M.C. Roy, O. Dewit, and B.A. Aubert, "The impact of interface usability
on trust in web retailers," Internet Research: Electronic Networking
Applications and Policy, vol. 11, no. 5, pp. 388-398, 2001.
[18] G. Chakraborty, P. Srivastava, and D.L. Warren, "Understanding B2B
corporate web sites- effectiveness from North American and European
perspective," Industrial Marketing Management, vol. 34, pp. 420-429,
2005.
[19] C. Calero, J. Ruiz, and M. Piattini, "Classifying web metrics using the
web quality model," Online Information Review, vol. 29, no. 3, pp. 227-
248, 2005.
[20] J. Nielsen, "End of web design," Useit.com Alertbox: Current Issues in
Web Usability, July, 2000. available at:
www.useit.com/alertbox/20000723.html (accessed on 7 September
2008).
[21] J.M. Pearson, A. Pearson, and D. Green, "Determining the importance of
key criteria in web usability," Management Research News, vol. 30, no.
11, pp. 816-828, 2007.
[22] E.F. Reilly, T.J. Leibrandt, A.J. Zonno, M.J. Simpson, and J.B. Morris,
"General surgery residency program websites: usefulness and usability
for resident applicants," Current Surgery, vol. 61, no. 2, pp. 236-240,
2003.
[23] S.M. Ferreira and D.N. Pithan, "Usability of digital libraries," OCLC
Systems and Services, vol. 21, no. 4, pp. 311-323, 2005.
[24] A. Stefani, B. Vassiliadis, and M. Xenos, "On the quality assessment of
advanced e-learning services," Interactive Technology and Smart
Education, vol. 3, pp. 237-250, 2006.
[25] K. Kapoor and O.P. Goyal, "Web-based OPACs in Indian academic
libraries: a functional comparison," Program: Electronic Library and
Information Systems, vol. 41, no. 3, pp. 291-309, 2007.
[26] K. Waite and T. Harrison, "Internet archaeology: uncovering pension
sector web site evolution," Internet Research, vol. 17, no. 2, pp. 180-
195, 2007.
[27] T. Liang, H. Lai, and Y. Ku, "Personalized content recommendation and
user satisfaction: theoretical synthesis and empirical findings," Journal
of Management Information Systems, vol. 23, no. 3, pp. 45-70, 2007.
[28] T.L. Saaty, Decision-making with dependence and feedback: The
Analytic Network Process. Pittsburg, NJ: RWS Publishing, 1996.
[29] T.L. Saaty, Multicriteria decision-making: The analytic hierarchy
process. Pittsburg, NJ: RWS Publishing, 1980.
[30] R.W. Saaty, Decision making in complex environments. Pittsburgh:
Creative Decisions Foundation, 2003.
[31] A.A. Salo and R.P. Hamalainen, "On the measurement of preferences in
the analytic hierarchy process," Journal of Multi-Criteria Decision
Analysis, vol. 6, pp. 309-319, 1997.
[32] S. Jharkharia and R. Shankar, "Selection of logistics service provider:
An analytic network process (ANP) approach," Omega, vol. 35, pp. 274
- 289, 2007.
[33] H. Shyur and H. Shih, "A hybrid MCDM model for strategic vendor
selection," Mathematical and Computer Modeling, vol. 44, pp. 749-761,
2006.
[34] F. Calisir, A.E. Bayraktaroglu, C.A. Gumussoy, Y.I. Topcu, and T.
Mutlu, "The relative importance of usability and functionality factors for
online auction and shopping web sites," Online Information Review,
vol. 34(3), pp.420-439, 2010.
[1] M. Lu and W. Yeung, "A framework for effective commercial web
application development," Internet Research: Electronic Networking
Applications and Policy, vol.8, no. 2, pp. 166-173, 1998.
[2] J.C. Bertot, J.T. Snead, P.T. Jaeger, and C.R. McClure, "Functionality,
usability and accessibility," Performance Measurement and Metrics, vol.
7, no. 1, pp. 17-28, 2006.
[3] J. Nielsen, "Usability 101: Introduction to usability," Useit.com
Alertbox: Current Issues in Web Usability, August, 2003, available at:
www.useit.com/alertbox/20030825.html(accessed on 7 September
2008).
[4] C.S. Porter, J.M. Porter, and S. Chhibber, "Realpeople; capturing the
emotions of product users," in Meeting Diversity in Ergonomics, Ed.
Pikaar, Koningsveld, and Settels, NJ: Elsevier, 2007, ch. 12, pp. 187-
208.
[5] T.A. Yeung and R. Law, "Extending the modified heuristic usability
evaluation technique to chain and independent hotel websites,"
International Journal of Hospitality Management, vol. 23, pp. 307-313,
2004.
[6] A. Seffah, T. Mohamed, H. Habieb-Mammar, and A. Abran,
"Reconciling usability and interactive system architecture using
patterns," Journal of Systems and Software, vol. 81, pp. 1845-1852,
2008.
[7] L. Bass and B.E. John, "Linking usability to software architecture
patterns through general scenarios," Journal of Systems and Software,
vol. 66, pp. 187-197, 2003.
[8] S. Furnell, "Why users can not use security," Computers and Security,
vol. 24, pp. 274-279, 2005.
[9] C.D. Kavadias, S. Rupp, S.L. Tombros, and D.D., Vergados, "A P2P
technology middleware architecture enabling user-centric services
deployment on low-cost embedded networked devices," Computer
Communications, vol. 30, pp. 527-537, 2007.
[10] D.J.M. Saarloos, T.A. Arentze, A.W.J. Borgers, and H.J.P.
Timmermans, "A multi-agent paradigm as structuring principle for
planning support systems," Computers, Environment and Urban
Systems, vol. 32, pp. 29-40, 2008.
[11] R.B. Klein and A. Seffah, "Evaluation of integrated software
development environments: Challenges and results from three empirical
studies," International Journal of Human-Computer Studies, vol. 63, pp.
607-627, 2005.
[12] S. Petter, "Managing user expectations on software projects: lessons
from the trenches," International Journal of Project Management, vol.
26, pp. 700-712, 2008.
[13] J.D. Procaccino and J.M. Verner, "Software project managers and
project success: An exploratory study," Journal of Systems and
Software, vol. 79, pp. 1541-1551, 2006.
[14] D. White and J. Fortune, "Current practice in project management - an
empirical study," International Journal of Project Management, vol. 20,
pp. 1-11, 2002.
[15] R. Schmidt, K. Lyytinen, M. Keil, and P. Cule, "Identifying software
project risks: An international Delphi study," Journal of Management
Information Systems, vol. 17, no. 4, pp. 5-36, 2001.
[16] J.W. Palmer, "Web site usability, design, and performance metrics,"
Information Systems Research, vol. 13, no. 2, pp. 151-167, 2002.
[17] M.C. Roy, O. Dewit, and B.A. Aubert, "The impact of interface usability
on trust in web retailers," Internet Research: Electronic Networking
Applications and Policy, vol. 11, no. 5, pp. 388-398, 2001.
[18] G. Chakraborty, P. Srivastava, and D.L. Warren, "Understanding B2B
corporate web sites- effectiveness from North American and European
perspective," Industrial Marketing Management, vol. 34, pp. 420-429,
2005.
[19] C. Calero, J. Ruiz, and M. Piattini, "Classifying web metrics using the
web quality model," Online Information Review, vol. 29, no. 3, pp. 227-
248, 2005.
[20] J. Nielsen, "End of web design," Useit.com Alertbox: Current Issues in
Web Usability, July, 2000. available at:
www.useit.com/alertbox/20000723.html (accessed on 7 September
2008).
[21] J.M. Pearson, A. Pearson, and D. Green, "Determining the importance of
key criteria in web usability," Management Research News, vol. 30, no.
11, pp. 816-828, 2007.
[22] E.F. Reilly, T.J. Leibrandt, A.J. Zonno, M.J. Simpson, and J.B. Morris,
"General surgery residency program websites: usefulness and usability
for resident applicants," Current Surgery, vol. 61, no. 2, pp. 236-240,
2003.
[23] S.M. Ferreira and D.N. Pithan, "Usability of digital libraries," OCLC
Systems and Services, vol. 21, no. 4, pp. 311-323, 2005.
[24] A. Stefani, B. Vassiliadis, and M. Xenos, "On the quality assessment of
advanced e-learning services," Interactive Technology and Smart
Education, vol. 3, pp. 237-250, 2006.
[25] K. Kapoor and O.P. Goyal, "Web-based OPACs in Indian academic
libraries: a functional comparison," Program: Electronic Library and
Information Systems, vol. 41, no. 3, pp. 291-309, 2007.
[26] K. Waite and T. Harrison, "Internet archaeology: uncovering pension
sector web site evolution," Internet Research, vol. 17, no. 2, pp. 180-
195, 2007.
[27] T. Liang, H. Lai, and Y. Ku, "Personalized content recommendation and
user satisfaction: theoretical synthesis and empirical findings," Journal
of Management Information Systems, vol. 23, no. 3, pp. 45-70, 2007.
[28] T.L. Saaty, Decision-making with dependence and feedback: The
Analytic Network Process. Pittsburg, NJ: RWS Publishing, 1996.
[29] T.L. Saaty, Multicriteria decision-making: The analytic hierarchy
process. Pittsburg, NJ: RWS Publishing, 1980.
[30] R.W. Saaty, Decision making in complex environments. Pittsburgh:
Creative Decisions Foundation, 2003.
[31] A.A. Salo and R.P. Hamalainen, "On the measurement of preferences in
the analytic hierarchy process," Journal of Multi-Criteria Decision
Analysis, vol. 6, pp. 309-319, 1997.
[32] S. Jharkharia and R. Shankar, "Selection of logistics service provider:
An analytic network process (ANP) approach," Omega, vol. 35, pp. 274
- 289, 2007.
[33] H. Shyur and H. Shih, "A hybrid MCDM model for strategic vendor
selection," Mathematical and Computer Modeling, vol. 44, pp. 749-761,
2006.
[34] F. Calisir, A.E. Bayraktaroglu, C.A. Gumussoy, Y.I. Topcu, and T.
Mutlu, "The relative importance of usability and functionality factors for
online auction and shopping web sites," Online Information Review,
vol. 34(3), pp.420-439, 2010.
@article{"International Journal of Business, Human and Social Sciences:57006", author = "F. Calisir and C. A. Gumussoy and A. E. Bayraktaroglu and E. Saygivar", title = "Usability and Functionality: A Comparison of Key Project Personnel's and Potential Users' Evaluations", abstract = "Meeting users- requirements is one of predictors of project success. There should be a match between the expectations of the users and the perception of key project personnel with respect to usability and functionality. The aim of this study is to make a comparison of key project personnel-s and potential users- (customer representatives) evaluations of the relative importance of usability and functionality factors in a software design project. Analytical Network Process (ANP) was used to analyze the relative importance of the factors. The results show that navigation and interaction are the most significant factors,andsatisfaction and efficiency are the least important factors for both groups. Further, it can be concluded that having similar orders and scores of usability and functionality factors for both groups shows that key project personnel have captured the expectations and requirements of potential users accurately.
", keywords = "Functionality, software design, usability.", volume = "5", number = "11", pages = "1541-5", }
