Applying GQM Approach towards Development of Criterion-Referenced Assessment Model for OO Programming Courses
The most influential programming paradigm today
is object oriented (OO) programming and it is widely used in
education and industry. Recognizing the importance of equipping
students with OO knowledge and skills, it is not surprising that most
Computer Science degree programs offer OO-related courses. How
do we assess whether the students have acquired the right objectoriented
skills after they have completed their OO courses? What are
object oriented skills? Currently none of the current assessment
techniques would be able to provide this answer. Traditional forms of
OO programming assessment provide a ways for assigning numerical
scores to determine letter grades. But this rarely reveals information
about how students actually understand OO concept. It appears
reasonable that a better understanding of how to define and assess
OO skills is needed by developing a criterion referenced model. It is
even critical in the context of Malaysia where there is currently a
growing concern over the level of competency of Malaysian IT
graduates in object oriented programming. This paper discussed the
approach used to develop the criterion-referenced assessment model.
The model can serve as a guideline when conducting OO
programming assessment as mentioned. The proposed model is
derived by using Goal Questions Metrics methodology, which helps
formulate the metrics of interest. It concluded with a few suggestions
for further study.
[1] J. Bennedsen and E.M Carpersen, "A Competence Model for Object
Interaction in Introductory Programming" in Proceeding of 18th
Workshop of the Psychology of Programming Interest Group, 2006.
[2] J. Bennedsen and E.M Carpersen, "Teaching Object Oriented
Programming" in 18th European Object oriented Workshop, 2004.
[3] Biggs, J. "What the student does: Teaching for enhanced learning",
Higher EducationResearch and Development, 18(1), 57. 1999.
[4] C. Daly and J. Horgan, "Automatic Plagiarism Detection" Proceedings
of the International Conference in Applied Informatics. pp 255-259,
2001.
[5] C. Kelleher and R. Pausch, "Lowering the Barriers to Programming: A
Taxonomy of Programming Environments and Languages for Novice
Programmers", ACM Computing Surveys, 37(2), pp. 83-137, 2005.
[6] E. Lahtinen and T. Ahoniemi, "Visualisations to Support Programming
on Different Levels of Cognitive Development" in Proceedings of The
Fifth Koli Calling Conference on Computer Science Education.
[7] Computing Curricula 2001 Computer Science, Final Report, December
2001.
[8] M. McCracken, V. Almastrum, D. Diaz, M. Guzdial, D. Hagan, D.
Kolikant, C. Laver, L. Thomas, I. Utting, and T. Wilusz, " A multinational,
multi-institutional study of assessment of programming skills
of first-year CS students." In ACM Sigcse Bullettin, 33(4), pp 125-140.
2001.
[9] S. Robins, J. Rountree, and N. Rountree, "Learning and Teaching
Programming: A Review and Discussion", Computer Science Education,
13(2), pp. 137-172, 2003.
[10] F. Wei, H.S Moritz, M.S Parvez, and D.G Blank " A Student Mpdel For
Object Oriented Design and Programming" in Journal of Computing
Science in Colleges, Vol 20(5) p 260-273. 2005.
[11] V. R Basilli, Gianlugi. C and Rombach H. D "The Goal Question Metric
Approach" 1996 Available on http://wwwagse.informatik.unikl.
de/pubs/repository/basili94b/encyclo.gqm.pdf
[12] M. Kolling "The problem of Teaching Object-oriented Programming,
Part 1: Languages," Journal of Object Oriented Programming, 11(8), 8-
15, 1999.
[13] K.B. McKeithen, J.S. Reitman, H.H. Rueter, S.C. Hirtle, "Knowledge
Organization and Skills Differences in Computer Programmers,"
Cognitive Psychology, 307-325, 1981.
[14] H.B Graham and L.M Verbyla, "An Online programming Assessment
Tool," in Proceedings of the Fifth Australasian Conference on
Computing Education, Vol 20, Adelaide, Australia, 69 - 75, 2003.
[15] J.F Patenaude, E. Merlo, M. Dagenais, B Lague, "Extending Software
Quality Assessment Techniques to Java Systems," IWPC, Seventh
International Workshop on Program Comprehension, 49, 1999.
[16] M.E Califf and M. Goodwin, "Testing Skills and Knowledge:
Introducing a Laboratory Exam in CS1" in Proceedings of the 33rd
SIGCSE Technical Symposium on Computer Science Cincinnati,
Kentucky, 217 - 221, 2002.
[17] Norazlina Khamis and Sufian Idris, "Investigating Current Object
Oriented Programming Assessment method in Malaysia-s Universities",
in Proceeding of ICEEI 2007, Bandung, Indonesia, 2007.
[18] Erickson, B. L., and Strommer, D. W. Teaching College Freshmen. San
Francisco: Jossey-Bass, 1991.
[19] Norazlina K., and Sufian. Idris. "Issues with Object Oriented
Programming Assessment in Malaysia-s Univerisities" to be publish in
Proceeding of 1st International Malaysian Educational Technology
Convention, 2007.
[20] Dunn, L., Morgan, C., O-Reilly, M., & Parry, S. "The Student
Assessment Handbook", London: Routledge Falmer. 2004.
[21] Rust, C., Price, M., & O-Donovan, B. "Improving students- learning by
developing their understanding of assessment criteria and processes"
Assessment & Evaluation in Higher Education, 28(2), 147.2003.
[22] Ungku Harun AlRashid Ahmad. "Meeting The Demands of Global
Firms: Survey Finding" Presented at Workshop on Enhancing Graduates
Employability in A Globalised Economy, MDC. 2004.
[1] J. Bennedsen and E.M Carpersen, "A Competence Model for Object
Interaction in Introductory Programming" in Proceeding of 18th
Workshop of the Psychology of Programming Interest Group, 2006.
[2] J. Bennedsen and E.M Carpersen, "Teaching Object Oriented
Programming" in 18th European Object oriented Workshop, 2004.
[3] Biggs, J. "What the student does: Teaching for enhanced learning",
Higher EducationResearch and Development, 18(1), 57. 1999.
[4] C. Daly and J. Horgan, "Automatic Plagiarism Detection" Proceedings
of the International Conference in Applied Informatics. pp 255-259,
2001.
[5] C. Kelleher and R. Pausch, "Lowering the Barriers to Programming: A
Taxonomy of Programming Environments and Languages for Novice
Programmers", ACM Computing Surveys, 37(2), pp. 83-137, 2005.
[6] E. Lahtinen and T. Ahoniemi, "Visualisations to Support Programming
on Different Levels of Cognitive Development" in Proceedings of The
Fifth Koli Calling Conference on Computer Science Education.
[7] Computing Curricula 2001 Computer Science, Final Report, December
2001.
[8] M. McCracken, V. Almastrum, D. Diaz, M. Guzdial, D. Hagan, D.
Kolikant, C. Laver, L. Thomas, I. Utting, and T. Wilusz, " A multinational,
multi-institutional study of assessment of programming skills
of first-year CS students." In ACM Sigcse Bullettin, 33(4), pp 125-140.
2001.
[9] S. Robins, J. Rountree, and N. Rountree, "Learning and Teaching
Programming: A Review and Discussion", Computer Science Education,
13(2), pp. 137-172, 2003.
[10] F. Wei, H.S Moritz, M.S Parvez, and D.G Blank " A Student Mpdel For
Object Oriented Design and Programming" in Journal of Computing
Science in Colleges, Vol 20(5) p 260-273. 2005.
[11] V. R Basilli, Gianlugi. C and Rombach H. D "The Goal Question Metric
Approach" 1996 Available on http://wwwagse.informatik.unikl.
de/pubs/repository/basili94b/encyclo.gqm.pdf
[12] M. Kolling "The problem of Teaching Object-oriented Programming,
Part 1: Languages," Journal of Object Oriented Programming, 11(8), 8-
15, 1999.
[13] K.B. McKeithen, J.S. Reitman, H.H. Rueter, S.C. Hirtle, "Knowledge
Organization and Skills Differences in Computer Programmers,"
Cognitive Psychology, 307-325, 1981.
[14] H.B Graham and L.M Verbyla, "An Online programming Assessment
Tool," in Proceedings of the Fifth Australasian Conference on
Computing Education, Vol 20, Adelaide, Australia, 69 - 75, 2003.
[15] J.F Patenaude, E. Merlo, M. Dagenais, B Lague, "Extending Software
Quality Assessment Techniques to Java Systems," IWPC, Seventh
International Workshop on Program Comprehension, 49, 1999.
[16] M.E Califf and M. Goodwin, "Testing Skills and Knowledge:
Introducing a Laboratory Exam in CS1" in Proceedings of the 33rd
SIGCSE Technical Symposium on Computer Science Cincinnati,
Kentucky, 217 - 221, 2002.
[17] Norazlina Khamis and Sufian Idris, "Investigating Current Object
Oriented Programming Assessment method in Malaysia-s Universities",
in Proceeding of ICEEI 2007, Bandung, Indonesia, 2007.
[18] Erickson, B. L., and Strommer, D. W. Teaching College Freshmen. San
Francisco: Jossey-Bass, 1991.
[19] Norazlina K., and Sufian. Idris. "Issues with Object Oriented
Programming Assessment in Malaysia-s Univerisities" to be publish in
Proceeding of 1st International Malaysian Educational Technology
Convention, 2007.
[20] Dunn, L., Morgan, C., O-Reilly, M., & Parry, S. "The Student
Assessment Handbook", London: Routledge Falmer. 2004.
[21] Rust, C., Price, M., & O-Donovan, B. "Improving students- learning by
developing their understanding of assessment criteria and processes"
Assessment & Evaluation in Higher Education, 28(2), 147.2003.
[22] Ungku Harun AlRashid Ahmad. "Meeting The Demands of Global
Firms: Survey Finding" Presented at Workshop on Enhancing Graduates
Employability in A Globalised Economy, MDC. 2004.
@article{"International Journal of Information, Control and Computer Sciences:60258", author = "Norazlina Khamis and Sufian Idris and Rodina Ahmad", title = "Applying GQM Approach towards Development of Criterion-Referenced Assessment Model for OO Programming Courses", abstract = "The most influential programming paradigm today
is object oriented (OO) programming and it is widely used in
education and industry. Recognizing the importance of equipping
students with OO knowledge and skills, it is not surprising that most
Computer Science degree programs offer OO-related courses. How
do we assess whether the students have acquired the right objectoriented
skills after they have completed their OO courses? What are
object oriented skills? Currently none of the current assessment
techniques would be able to provide this answer. Traditional forms of
OO programming assessment provide a ways for assigning numerical
scores to determine letter grades. But this rarely reveals information
about how students actually understand OO concept. It appears
reasonable that a better understanding of how to define and assess
OO skills is needed by developing a criterion referenced model. It is
even critical in the context of Malaysia where there is currently a
growing concern over the level of competency of Malaysian IT
graduates in object oriented programming. This paper discussed the
approach used to develop the criterion-referenced assessment model.
The model can serve as a guideline when conducting OO
programming assessment as mentioned. The proposed model is
derived by using Goal Questions Metrics methodology, which helps
formulate the metrics of interest. It concluded with a few suggestions
for further study.", keywords = "Object-oriented programming, programmingassessment, criterion-referenced assessment model, goal questionsmetrics.", volume = "1", number = "8", pages = "2546-5", }