Applying GQM Approach towards Development of Criterion-Referenced Assessment Model for OO Programming Courses

The most influential programming paradigm today is object oriented (OO) programming and it is widely used in education and industry. Recognizing the importance of equipping students with OO knowledge and skills, it is not surprising that most Computer Science degree programs offer OO-related courses. How do we assess whether the students have acquired the right objectoriented skills after they have completed their OO courses? What are object oriented skills? Currently none of the current assessment techniques would be able to provide this answer. Traditional forms of OO programming assessment provide a ways for assigning numerical scores to determine letter grades. But this rarely reveals information about how students actually understand OO concept. It appears reasonable that a better understanding of how to define and assess OO skills is needed by developing a criterion referenced model. It is even critical in the context of Malaysia where there is currently a growing concern over the level of competency of Malaysian IT graduates in object oriented programming. This paper discussed the approach used to develop the criterion-referenced assessment model. The model can serve as a guideline when conducting OO programming assessment as mentioned. The proposed model is derived by using Goal Questions Metrics methodology, which helps formulate the metrics of interest. It concluded with a few suggestions for further study.

Authors:

• Norazlina Khamis
• Sufian Idris
• Rodina Ahmad

Keywords:

• Object-oriented programming
• programmingassessment
• criterion-referenced assessment model
• goal questionsmetrics.

References:

[1] J. Bennedsen and E.M Carpersen, "A Competence Model for Object
Interaction in Introductory Programming" in Proceeding of 18th
Workshop of the Psychology of Programming Interest Group, 2006.
[2] J. Bennedsen and E.M Carpersen, "Teaching Object Oriented
Programming" in 18th European Object oriented Workshop, 2004.
[3] Biggs, J. "What the student does: Teaching for enhanced learning",
Higher EducationResearch and Development, 18(1), 57. 1999.
[4] C. Daly and J. Horgan, "Automatic Plagiarism Detection" Proceedings
of the International Conference in Applied Informatics. pp 255-259,
2001.
[5] C. Kelleher and R. Pausch, "Lowering the Barriers to Programming: A
Taxonomy of Programming Environments and Languages for Novice
Programmers", ACM Computing Surveys, 37(2), pp. 83-137, 2005.
[6] E. Lahtinen and T. Ahoniemi, "Visualisations to Support Programming
on Different Levels of Cognitive Development" in Proceedings of The
Fifth Koli Calling Conference on Computer Science Education.
[7] Computing Curricula 2001 Computer Science, Final Report, December
2001.
[8] M. McCracken, V. Almastrum, D. Diaz, M. Guzdial, D. Hagan, D.
Kolikant, C. Laver, L. Thomas, I. Utting, and T. Wilusz, " A multinational,
multi-institutional study of assessment of programming skills
of first-year CS students." In ACM Sigcse Bullettin, 33(4), pp 125-140.
2001.
[9] S. Robins, J. Rountree, and N. Rountree, "Learning and Teaching
Programming: A Review and Discussion", Computer Science Education,
13(2), pp. 137-172, 2003.
[10] F. Wei, H.S Moritz, M.S Parvez, and D.G Blank " A Student Mpdel For
Object Oriented Design and Programming" in Journal of Computing
Science in Colleges, Vol 20(5) p 260-273. 2005.
[11] V. R Basilli, Gianlugi. C and Rombach H. D "The Goal Question Metric
Approach" 1996 Available on http://wwwagse.informatik.unikl.
de/pubs/repository/basili94b/encyclo.gqm.pdf
[12] M. Kolling "The problem of Teaching Object-oriented Programming,
Part 1: Languages," Journal of Object Oriented Programming, 11(8), 8-
15, 1999.
[13] K.B. McKeithen, J.S. Reitman, H.H. Rueter, S.C. Hirtle, "Knowledge
Organization and Skills Differences in Computer Programmers,"
Cognitive Psychology, 307-325, 1981.
[14] H.B Graham and L.M Verbyla, "An Online programming Assessment
Tool," in Proceedings of the Fifth Australasian Conference on
Computing Education, Vol 20, Adelaide, Australia, 69 - 75, 2003.
[15] J.F Patenaude, E. Merlo, M. Dagenais, B Lague, "Extending Software
Quality Assessment Techniques to Java Systems," IWPC, Seventh
International Workshop on Program Comprehension, 49, 1999.
[16] M.E Califf and M. Goodwin, "Testing Skills and Knowledge:
Introducing a Laboratory Exam in CS1" in Proceedings of the 33rd
SIGCSE Technical Symposium on Computer Science Cincinnati,
Kentucky, 217 - 221, 2002.
[17] Norazlina Khamis and Sufian Idris, "Investigating Current Object
Oriented Programming Assessment method in Malaysia-s Universities",
in Proceeding of ICEEI 2007, Bandung, Indonesia, 2007.
[18] Erickson, B. L., and Strommer, D. W. Teaching College Freshmen. San
Francisco: Jossey-Bass, 1991.
[19] Norazlina K., and Sufian. Idris. "Issues with Object Oriented
Programming Assessment in Malaysia-s Univerisities" to be publish in
Proceeding of 1st International Malaysian Educational Technology
Convention, 2007.
[20] Dunn, L., Morgan, C., O-Reilly, M., & Parry, S. "The Student
Assessment Handbook", London: Routledge Falmer. 2004.
[21] Rust, C., Price, M., & O-Donovan, B. "Improving students- learning by
developing their understanding of assessment criteria and processes"
Assessment & Evaluation in Higher Education, 28(2), 147.2003.
[22] Ungku Harun AlRashid Ahmad. "Meeting The Demands of Global
Firms: Survey Finding" Presented at Workshop on Enhancing Graduates
Employability in A Globalised Economy, MDC. 2004.