An Architectural Model of Multi-Agent Systems for Student Evaluation in Collaborative Game Software

The teaching of computer programming for beginners has been generally considered as a difficult and challenging task. Several methodologies and research tools have been developed, however, the difficulty of teaching still remains. Our work integrates the state of the art in teaching programming with game software and further provides metrics for the evaluation of student performance in a collaborative activity of playing games. This paper aims to present a multi-agent system architecture to be incorporated to the educational collaborative game software for teaching programming that monitors, evaluates and encourages collaboration by the participants. A literature review has been made on the concepts of Collaborative Learning, Multi-agents systems, collaborative games and techniques to teach programming using these concepts simultaneously.

Authors:

• Monica Hoedltke Pietruchinski
• Andrey Ricardo Pimentel

Keywords:

• Architecture of multi-agent systems
• collaborative evaluation
• collaboration assessment
• gamifying educational software.

References:

[1] V. C. O. Aureliano and P. C. d. A. R. Tedesco, “Ensino-aprendizagem
de programac¸ ˜ao para iniciantes: uma revis˜ao sistem´atica da literatura
focada no sbie e wie,” in Anais do Simp´osio Brasileiro de Inform´atica
na Educac¸ ˜ao, vol. 23, no. 1, 2012.
[2] A. Ribeiro, A. Coelho, and A. Aguiar, “Jogo s´erio colaborativo
para o ensino da programac¸ ˜ao a crianc¸as,” Ph.D. dissertation,
UNIVERSIDADE DO PORTO, 2012.
[3] C. Fernandez-Medina, V. M. Pe´rez-Pe´rez, Juan Ramo´n e A´ lvarez-Garc´ıa,
and M. Paule-Ruiz, “Assistance in computer programming learning using
educational data mining and learning analytics,” in Proceedings of the
18th ACM conference on Innovation and technology in computer science
education. ACM, 2013, pp. 237–242.
[4] M. Piteira and C. Costa, “Learning computer programming: study
of difficulties in learning programming,” in Proceedings of the 2013
International Conference on Information Systems and Design of
Communication. ACM, 2013, pp. 75–80.
[5] N. Tonin and J. Bez, “Uri online judge: A new interactive
learning approach,” Computer Science and Engineering Department,
Universidade Regional Integrada, Erechim, RS, Brazil. Computer
Technology and Application, vol. 4, pp. 34–38, 2013.
[6] E. V. B. Aguiar, “As novas tecnologias e o ensino-aprendizagem,”
V´ertices, vol. 10, no. 1, pp. 63–72, 2008.
[7] G. Bekebrede, H. Warmelink, and I. Mayer, “Reviewing the need for
gaming in education to accommodate the net generation,” Computers &
Education, vol. 57, no. 2, pp. 1521–1529, 2011.
[8] K. Kiili, “On educational game design: building blocks of flow
experience. 117f.” Ph.D. dissertation, Tampere University of Technology,
2005.
[9] M. Prensky, “Digital natives, digital immigrants.” On the Horizon, MCB
University Press, vol. 9, no. 5, pp. 1–6, 2001.
[10] G. Stahl, T. Koschmann, and D. Suthers, “Computer-supported
collaborative learning: An historical perspective,” Cambridge handbook
of the learning sciences, vol. 2006, 2006.
[11] R. Ibrahim, R. C. M. Yusoff, H. M. Omar, and A. Jaafar,
“Students perceptions of using educational games to learn introductory
programming,” Computer and Information Science, vol. 4, no. 1, pp.
205–216, 2010.
[12] D. W. Johnson and R. T. Johnson, “Learning together,” Handbook of
cooperative learning methods, vol. 51, p. 65, 1994.
[13] S. De Freitas and M. Oliver, “How can exploratory learning with games
and simulations within the curriculum be most effectively evaluated?”
Computers & Education, vol. 46, no. 3, pp. 249–264, 2006.
[14] J.-W. Strijbos, “Assessment of (computer-supported) collaborative
learning,” Learning Technologies, IEEE Transactions on, vol. 4, no. 1,
pp. 59–73, 2011.
[15] A. Jaques, Patr´ıcia e Andrade, J. Jung, R. Bordini, and R. Vicari,
“Using pedagogical agents to support collaborative distance learning,” in
Proceedings of the Conference on Computer Support for Collaborative
Learning: Foundations for a CSCL Community. International Society
of the Learning Sciences, 2002, pp. 546–547.
[16] L.-K. Soh and H. Khandaker, Nobel e Jiang, “I-minds: a multiagent
system for intelligent computer-supported collaborative learning and
classroom management,” International Journal of Artificial Intelligence
in Education, vol. 18, no. 2, pp. 119–151, 2008.
[17] R. B. Luz and A. Neto, “Usando dojos de programac¸ ˜ao para o ensino de
desenvolvimento dirigido por testes,” in Anais do Simp´osio Brasileiro
de Inform´atica na Educac¸ ˜ao, vol. 23, no. 1, 2012.
[18] D. Carmo and V. Braganholo, “Um estudo sobre o uso didtico de dojos
de programao.” in Anais do XX Workshop sobre Educao em Computao
WEI’2012, 2012.
[19] C. McDowell, H. Werner, Linda e Bullock, and J. Fernald, “The effects
of pair-programming on performance in an introductory programming
course,” in ACM SIGCSE Bulletin, vol. 34, no. 1. ACM, 2002, pp.
38–42.
[20] N. Nagappan, L. Williams, M. Ferzli, E. Wiebe, K. Yang, C. Miller,
and S. Balik, “Improving the cs1 experience with pair programming,”
in ACM SIGCSE Bulletin, vol. 35, no. 1. ACM, 2003, pp. 359–362.
[21] J. Moons and C. De Backer, “The design and pilot evaluation of
an interactive learning environment for introductory programming
influenced by cognitive load theory and constructivism,” Computers &
Education, vol. 60, no. 1, pp. 368–384, 2013.
[22] S. Russell and P. Norvig, Artificial intelligence:a modern approach.
Prentice-Hall, 1995.
[23] F. M. Cassapo, “Uma sociedade multiagente para o mapeamento
autom´atico inteligente de competˆencias em ambiente de colaborac¸ ˜ao.”
Ph.D. dissertation, Pontif´ıcia Universidade Cat´olica do Paran´a, 2004.
[24] M. Wooldridge, An introduction to multiagent systems. John Wiley &
Sons, 2009.
[25] G. T. A. Guedes, “Uma ferramenta para auxiliar na avaliac¸ ˜ao de textos
constru´ıdos colaborativamente em ambientes de ensino-aprendizagem,”
Master’s thesis, Universidade Federal do Rio Grande do Sul, 2002.
[26] N. Khandaker and L.-K. Soh, “Classroomwiki: A collaborative wiki
for instructional use with multiagent group formation,” Learning
Technologies, IEEE Transactions on, vol. 3, no. 3, pp. 190–202, 2010.
[27] P. P. de Oliveira, E. Ferneda, H. A. do Prado, and I. I. Bittencourt, “Um
modelo de integrac¸ ˜ao dos princ´ıpios de sistemas tutores inteligentes e
e-learning a jogos do tipo mmorpg,” in Anais do Simp´osio Brasileiro de
Inform´atica na Educac¸ ˜ao, vol. 23, no. 1, 2012.
[28] E. d. B. Costa, “Um modelo de ambiente interativo de aprendizagem
baseado numa arquitetura multi-agentes,” Ph.D. dissertation,
Universidade Federal da Paraıba-Departamento de Engenharia
El´etrica-Campina Grande, PB, 1997.
[29] N. P. Zea, J. L. G. S´anchez, F. L. Guti´errez, M. J. Cabrera, and
P. Paderewski, “Design of educational multiplayer videogames: A vision
from collaborative learning,” Advances in Engineering Software, vol. 40,
no. 12, pp. 1251–1260, 2009.
[30] G. Trentin, “Using a wiki to evaluate individual contribution to a
collaborative learning project,” Journal of Computer Assisted Learning,
vol. 25, no. 1, pp. 43–55, 2009.
[31] T. Judd, G. Kennedy, and S. Cropper, “Using wikis for collaborative
learning: Assessing collaboration through contribution,” Australasian
Journal of Educational Technology, vol. 26, no. 3, 2010.
[32] M. Dascalu, S. Trausan-Matu, and P. Dessus, “Utterances assessment
in chat conversations,” Research in Computing Science, vol. 46, pp.
323–334, 2010.
[33] T. Miller, “Latent semantic analysis and the construction of coherent
extracts,” Recent Advances in Natural Language Processing III, vol.
260, pp. 277–286, 2004.
[34] H. Nwana, “Intelligent tutoring systems: An overview.” Artificial
Intelligent, vol. 4, pp. 251–277, 1990.
[35] N. P. Zea, “Metodolog´ıa para el dise˜no de videojuegos educativos sobre
una arquitectura para el an´alisis del aprendizaje colaborativo,” Ph.D.
dissertation, PhD thesis, Universidad de Granada, 2011.