Using Heuristic Rules from Sentence Decomposition of Experts- Summaries to Detect Students- Summarizing Strategies

Summarizing skills have been introduced to English syllabus in secondary school in Malaysia to evaluate student-s comprehension for a given text where it requires students to employ several strategies to produce the summary. This paper reports on our effort to develop a computer-based summarization assessment system that detects the strategies used by the students in producing their summaries. Sentence decomposition of expert-written summaries is used to analyze how experts produce their summary sentences. From the analysis, we identified seven summarizing strategies and their rules which are then transformed into a set of heuristic rules on how to determine the summarizing strategies. We developed an algorithm based on the heuristic rules and performed some experiments to evaluate and support the technique proposed.

Authors:

• Norisma Idris
• Sapiyan Baba
• Rukaini Abdullah

Keywords:

• Summarizing strategies
• heuristic rules
• sentencedecomposition.

References:

[1] A. L. Brown, and J. D. Day, "Macrorules for summarizing texts: The development of expertise" Journal of Verbal Learning and Verbal
Behavior, 1983, Vol. 22, pp. 1-14.
[2] Gurdashan Kaur. "The Role of Summarization Instruction in the
Comprehension of Expository Texts", Unpublished Master dissertation. Faculty of Education, University of Malaya, 1997.
[3] I. Zipitria, A. Arruarte, J. A. Elorriaga, and A. Díaz de Ilarraza, "Towards a Cognitive Model of Summary Evaluation", in J. Mostow &
P. Tedesco (Eds.) Proceedings of the ITS-2004 on Modeling Human
Teaching Tactics and Strategies, 2004, pp. 25-34. Macei├│, Brazil.
[4] D. Wade-Stein, and E. Kintsch, "Summary Street: Interactive Computer
Support for Writing", Cognition and Instruction, 2004, Vol. 22, pp 333 -
362.
[5] M. Franzke, E. Kintsch, D. Caccamise, N. Johnson, and S. Dooley,
"Summary Street®: Computer support for comprehension and writing"
Journal Educational Computing Research, 2005, Vol. 33(1) 53-80.
[6] B. Lemaire, S. Mandin, P. Dessus, and G. Denhière, "Computational
cognitive models of summarization assessment skills", Proceedings of
the 27th Annual Meeting of the Cognitive Science Society (CogSci'
2005). Stresa, Italy, July 21-23, 2005, pp.1266-1271.
[7] P. Winograd, "Strategic Difficulties in Summarizing Texts", Reading
Research Quarterly. 1984, 19(4):404ÔÇö425.
[8] I. Norisma, Mohd. Sapiyan Baba, and Rukaini Abdullah, "An Analysis
on student-written summaries: A Step towards Developing an
Automated Summarization Assessment", International Conference on
Electrical Engineering and Informatics (ICEEI2007). Institut Teknologi
Bandung, Indonesia, June 17 - 19, 2007, pp. 550 - 553.
[9] I. Mani, Automatic Summarization. Amsterdam: John Benjamins
Publishing Company, 2001, Chapter 3.
[10] B. Endres-Niggemeyer, K. Haseloh, J. Miller, S. Peist, I. Santini de
Segel, A. Sigel, J. Wheeler, and B. Wollny, B. Summarizing
Information. Springer, Berlin, 1998.
[11] H. Jing, and K. McKeown, "Cut and Paste Text Summarization", In
Proceedings of the 1st Meeting of the North American Chapter of the
Association for Computational Linguistics, 2000, pp. 178-185.
[12] M. L. Nguyen, and S. Horiguchi, "Accuracy enhancement for the
decomposition of human-written summary", International Journal of
Computer Processing of Oriental Languages, 2005, Vol. 18, No. 1, pp
53-74.