Defining Programming Problems as Learning Objects

Standards for learning objects focus primarily on content presentation. They were already extended to support automatic evaluation but it is limited to exercises with a predefined set of answers. The existing standards lack the metadata required by specialized evaluators to handle types of exercises with an indefinite set of solutions. To address this issue existing learning object standards were extended to the particular requirements of a specialized domain. A definition of programming problems as learning objects, compatible both with Learning Management Systems and with systems performing automatic evaluation of programs, is presented in this paper. The proposed definition includes metadata that cannot be conveniently represented using existing standards, such as: the type of automatic evaluation; the requirements of the evaluation engine; and the roles of different assets - tests cases, program solutions, etc. The EduJudge project and its main services are also presented as a case study on the use of the proposed definition of programming problems as learning objects.

Authors:

• José Paulo Leal
• Ricardo Queirós

Keywords:

• Content Packaging
• eLearning Services
• Interoperability
• Learning Objects.

References:

[1] Dagger, D., O'Connor, A., Lawless, S., Walsh, E., Wade, V.: Service Oriented eLearning Platforms: From Monolithic Systems to Flexible
Services (2007)
[2] Bryden, A.: Open and Global Standards for Achieving an Inclusive
Information Society.
[3] IMS Global Learning Consortium. URL: http://www.imsglobal.org
[4] IEEE Learning Technology Standards Committee. URL:
http://ieeeltsc.org
[5] ISO/IEC- International Organization for Standardization. URL:
http://standards.iso.org/ittf/PubliclyAvailableStandards/index.html
[6] Friesen, N.: Interoperability and Learning Objects: An Overview of ELearning Standardization". Interdisciplinary Journal of Knowledge and
Learning Objects. 2005.
[7] IMS-CP - IMS Content Packaging, Information Model, Best Practice
and Implementation Guide, Version 1.1.3 Final Specification IMS
Global Learning Consortium Inc., URL:
http://www.imsglobal.org/content/packaging.
[8] IMS-Metadata - IMS MetaData. Information Model, Best Practice and
Implementation Guide, Version 1.2.1 Final Specification IMS Global
Learning Consortium Inc., URL: http://www.imsglobal.org/metadata.
[9] IMS-QTI - IMS Question and Test Interoperability. Information Model,
Best Practice and Implementation Guide, Version 1.2.1 Final
Specification IMS Global Learning Consortium Inc., URL:
http://www.imsglobal.org/question/index.html.
[10] IMS DRI - IMS Digital Repositories Interoperability - Core Functions
Information Model, URL:
http://www.imsglobal.org/digitalrepositories/driv1p0/imsdri_infov1p0.ht
ml.
[11] Simon, B., Massart, D., van Assche, F., Ternier, S., Duval, E., Brantner,
S., Olmedilla, D., & Miklos, Z. (2005). A Simple Query Interface for
Interoperable Learning Repositories. In Proceedings of the WWW 2005
Conference, retrieved March 16, 2006 from http://nm.wu-wien.ac.at/elearning/
interoperability/www2005-workshop-sqi-2005-04-14.pdf
[12] Godby, C.J.: What Do Application Profiles Reveal about the Learning
Object Metadata Standard? Ariadne Article in eLearning Standards,
2004.
[13] IMS Application Profile Guidelines Overview, Part 1 - Management
Overview, Version 1.0. URL:
http://www.imsglobal.org/ap/apv1p0/imsap_oviewv1p0.html.
[14] ADL SCORM URL: http://www.adlnet.gov/Technologies/scorm
[15] IMS Common Cartridge Profile, Version 1.0 Final Specification. URL:
http://www.imsglobal.org/cc/ccv1p0/imscc_profilev1p0.html
[16] Clark, J, Murata, M.: RELAX NG Specification, OASIS Committee
Specification, December 2001, http://relaxng.org/spec-20011203.html
[17] Clark, J.: TREX - Tree Regular Expressions for XML. Thai Open
Source Software Center, 2001, http://www.thaiopensource.com/trex/.
[18] Murata, M.: RELAX (Regular Language description for XML).
INSTAC (Information Technology Research and Standardization
Center), 2001, http://www.xml.gr.jp/relax/.
[19] Moller, A.: Document Structure Description 2.0, BRICS, 2002,
http://www.brics.dk/DSD/dsd2.html.
[20] The Schematron, An XML Structure Validation Language using Patterns
in Trees, http://www.ascc.net/xml/resource/schematron/schematron.html.
[21] EduJudge project - Integrating On-line Judge into Effective E-learning.
URL: http://www.edujudge.eu
[22] ACM ICPC - International Collegiate Programming Contest. URL:
http://icpc.baylor.edu/icpc/
[23] Krafzig, D., Banke, K., Slama, D. Enterprise SOA: Service-Oriented
Architecture Best Practices. 1.ed. Estados Unidos da América: Prentice
Hall, 2004. ISBN 0131465759
[24] Leal, J.P., Queir├│s, R.: CrimsonHex: a Service Oriented Repository of
Specialised Learning Objects. In: ICEIS 2009: 11th International
Conference on Enterprise Information Systems, Milan (2009)
[25] Meier, W.: eXist: An Open Source Native XML Database. In: NODe
2002 Web and Database-Related Workshops, (2002)
[26] Regueras, L.M., Verd├║, E., Castro, J.P., Pérez, M.A., Verd├║, M.J.Design
of a Distributed and Asynchronous System for Remote Evaluation of
Students- Submissions in Competitive E-learning. In: ICEE 2008:
International Conference on Engineering Education, Budapest (2008).
[27] Cole, J., Foster, H.: Using Moodle - Teaching with the Popular Open
Source Course Management System, O'Reilly - Community Press.
[28] EduJudge MetaData (EJ MD) specification (version 2.0). URL:
http://mooshak.dcc.fc.up.pt/~edujudge/schemaDoc/examples/ejmd/ejmd
_v2.xsd