An Empirical Analysis of the Influence of Application Experience on Working Methods of Process Modelers
In view of growing competition in the service sector,
services are as much in need of modeling, analysis and improvement
as business or working processes. Graphical process models are
important means to capture process-related know-how for an
effective management of the service process. In this contribution, a
human performance analysis of process model development paying
special attention to model development time and the working method
was conducted. It was found that modelers with higher application
experience need significantly less time for mental activities than
modelers with lower application experience, spend more time on
labeling graphical elements, and achieved higher process model
quality in terms of activity label quality.
[1] M. Weske, Business Process Management. Berlin: Springer, 2007.
[2] C. Houy, P. Fettke, P. Loos, "Empirical research in business process
management - analysis of an emerging field of research", Business
Process Management Journal, vol. 16, no. 4, pp. 619-661, 2010.
[3] J. Becker, D. Kahn, "Der Prozess im Fokus," in Prozessmanagement, J.
Becker, M. Kugeler, M. Rosemann, Eds. Berlin: Springer, 2008.
[4] H. A. Reijers, J. Recker, S. G. van de Wouw, "An Integrative
Framework of the Factors Affecting Process Model Understanding: A
Learning Perspective," in Proc. 16th Americas Conference on
Information Systems, Lima, 2010, pp. 1-10.
[5] J. Mendling, J. Recker, "Extending the Discussion of Model Quality:
Why Clarity and Completeness may not be enough," in CAiSE 2007
Workshop Proc. Vol. 1 - 11th international Workshop on Exploring
Modeling Methods in Systems Analysis and Design (EMMSAD),
Trondheim, 2007, pp. 109-121.
[6] K. Y. Wong, "Critical success factors for implementing knowledge
management in small and medium enterprises," Industrial Management
& Data Systems, vol. 105, pp. 261-279, 2005.
[7] M. Indulska, P. Green, J. Recker, M. Rosemann, " Business Process
Modeling: Perceived Benefits," in Conceptual Modeling - ER 2009, S.
Castano, U. Dayal, A. H. F. Laender, Eds. Gramado: Springer, 2009, pp.
458-471.
[8] W. M. P. van der Aalst, A. H. M. ter Hofstede, M. Weske, ÔÇ×Business
Process Management: A Survey," in Proc. Intl. Conf. on Business
process Management (BPM), Eindhoven, 2003.
[9] T. H. Davenport, J. E. Short, "The New Industrial Engineering
Information Technology and Business Process Redesign," Sloan
Management Review, vol. 31, no. 4, pp. 11-27, 1990.
[10] N. P. Dalal, M. Kamath. W. J. Kolarik, E. Sivaramann, "Toward an
Integrated Framework for Modeling Enterprise Processes,"
Communications of the ACM, vol. 47, no.3, pp. 83-87, March 2004.
[11] D. L. Moody, G. Sindre, T. Brasethvik, A. Solvberg, "Evaluating the
Quality of Process Models: Empirical Testing of a Quality Framework,"
in ER 2002, LNCS 2503, S. Spaccapietra, S. T. March, Y. Kambayashi,
Eds. Berlin: Springer, 2002, pp. 380-396.
[12] D. L. Moody, "Theoretical and practical issues in evaluating the quality
of conceptual models: current state and future directions," Data &
Knowledge Engineering, vol. 55, pp. 243-276, 2005.
[13] A. Maes, G. Poels, "Evaluating quality of conceptual modeling scripts
based on user perceptions," Data Knowledge & Engineering, vol. 63, pp.
701-724, 2007.
[14] J. R. Evans, W. M. Lindsay, Managing for Quality and Performance
Excellence. Mason, OH: Thomson South-Western, 2007.
[15] R. Schmitt, T. Pfeifer, Qualitätsmanagement: Strategien, Methoden,
Techniken. M├╝nchen: Carl-Hanser Verlag, 2010.
[16] R. Schuette, T. Rotthowe, ÔÇ×The Guidelines of Modeling - an approach
to enhance the quality in information models," in ER 1998, LNCS 1507,
T. W. Ling, S. Ram, M. L. Lee, Eds. Berlin: Springer, 1998, pp. 240-
254.
[17] O. I. Lindland, G. Sindre, A. Solvberg, ÔÇ×Understanding Quality in
Conceptual Modeling," IEEE Software, pp. 42-49, March 1994.
[18] J. Mendling, H. A. Reijers, W. M. P., ÔÇ×Seven Process Modeling
Guidelines (7PMG)", Information and Software Technology (IST), vol.
52, pp. 127-136, 2010.
[19] J. Mendling, J. Recker, H. A. Reijers, ÔÇ×Process modeling quality: a
framework and research agenda," BPM center reports, pp. 18-36, 2009.
[20] D. Z├ñhringer, P. Schneider, ÔÇ×Analyse der Modellierungsfunktion" in
Business Process Management Tools 2011, D. Spath, A. Weisbecker, D.
Kopperger, R. Nägele, Eds. Stuttgart: Fraunhofer IAO, 2011, pp. 37-60.
[21] P. Fettke, ÔÇ×How Conceptual Modeling Is Used," Communications oft he
Association for Information Systems, vol. 25, pp. 571-592, Dec. 2009.
[22] S. West, R. A. Brown, J. Recker, ÔÇ×Collaborative business process
modeling using 3D virtual environments," in 16th Americas Conference
in Information Systems: Sustainable IT Collaboration around the Globe,
Lima, 2010.
[23] M. Weidlich, A. Barros, J. Mendling, M. Weske, ÔÇ×Vertical Alignment of
Process Models- How Can We Get There?," in EMMSAD 2009, LNBIP
29, T. Haipin et al., Eds. Berlin: Springer, 2009, pp.71-84.
[24] M. Rosemann, ÔÇ×Potential pitfalls of process modeling: part A," Business
Process Management, vol. 12. no. 2, pp.249-254, 2006.
[25] J. Recker, A. Dreiling, ÔÇ× Does It Matter Which Process Modelling
Language We Teach or Use? An Experimental Study on Understanding
Process Modelling Languages without Formal Education," in 18th
Australasian Conference on Information Systems, Toowoomba, 2007.
[26] S. Smirnow, M. Weidlich, J. Mendling, M. Weske, ÔÇ×Action Patterns in
Business Process Models," in ICSOS-ServiceWave 2009, LNCS 5900, L.
Baresi, C. H. Chi, J. Suzuki, Eds. Berlin: Springer, 2009, pp.115-129.
[27] R. Laue, A. Gadatsch, ÔÇ×Measuring the Understandability of Business
Process Models - Are We Asking the Right Questions?," in 6th
International Workshop on Business Process Design (BPD), Hoboken,
2011.
[28] J. Mendling, H. A. Reijers, J. Cardoso, ÔÇ×What Makes Process Models
Understandable?," in BPM 2007, LNCS 4714, G. Alonso, P. Dadam, M.
Rosemann, Eds. Berlin: Springer, 2007, pp. 48-63.
[29] H. A. Reijers, J. Mendling, ÔÇ×Modularity in Process Models," in BPM
2008, LNCS 5240, M. Dumas, M. Reichert, M. C. Shan, Eds. Berlin:
Springer, 2008, pp. 20-35.
[30] I. Vanderfeesten, J. Cardoso, J. Mendling, H. A. Reijers, W. van der
Allst, ÔÇ×Quality Metrics for Business Process Models," in 2007 BPM and
workflow handbook, L. Fisher, Ed., Lighthouse-Point, 2008.
[31] H. A. Reijers, J. Mendling, ÔÇ×A Study Into the Factors That Influence the
Understandability of Business Process Models," IEEE Transactions on
Systems, Man, And Cibernetics - Part A: Systems and Humans, vol. 41,
no. 3, pp. 449-462, May 2011.
[32] J. Erickson, K. Siau, ÔÇ×Theoretical and Practical Complexity of Modeling
Methods," Communications of the ACM, vol. 50, no. 8, pp. 46-51, 2007.
[33] J. Recker, M. zur Muehlen, K. Siau, J. Erickson, M. Indulska,
ÔÇ×Measrung method complexity: UML versus BPMN," in 15th Americas
Conference in Information Systems, San Francisco, 2009.
[34] M. La Rosa, A. H. M. ter Hofstede, P. Wohed, H. A. Reijers, J.
Mendling, W. M. P. van der Aalst, ÔÇ×Managing process model
complexity via concrete syntax modifications," IEEE Transactions on
Industrial Informatics, vol. 7, no. 2, pp. 1-11, 2011.
[35] D. Birkmeier, S. Klöckner, S. Overhage, ÔÇ×An Empirical Comparison of
the Usability of BPMN and UML Activity Diagrams for Business
Users," in 18th European Conference on Information Systems, 2010.
[36] J. Recker, M. Rosemann, ÔÇ×Teaching Business Process Modelling:
Experiences and Recommendations," Communications of the
Association for Information Systems, vol. 25, pp. 379-394, Oct. 2009.
[37] M. zur Muehlen, J. Recker, ÔÇ×How Much Language Is Enough?
Theoretical and Practical Use of the Business Process Modeling
Notation," in CAiSE 2008, LNCS 5074, Z. Bellahsene, M. Leonard, Eds.
Berlin: Springer, 2008, pp. 465-479.
[38] J. Recker, ÔÇ×Opportunities and constraints: the current struggle with
BPMN," Business Process Management Journal, vol. 16, no. 1, pp.181-
201, 2010.
[39] Deutsche MTM Vereinigung e. V., MTM - Grundverfahren
Lehrgangsunterlage Teil 1. Hamburg, 2003.
[40] J. H. Quick, J. H. Duncan, J. A. Malcolm, Work-Factor Time Standards.
New York: The maple press company, 1962.
[41] K. B. Zandin, MOST Work Measurement Systems, 3 ed., New York:
Marcel Dekker.
[42] R. Papenfuß, K. -D. Theis, ÔÇ×Die WORK-FACTOR-Verfahren"
Angewandte Arbeitswissenschaft, pp. 3-18, 1988.
[43] C. Schlick, R- Bruder, H. Luczak, Arbeitswissenschaft. Berlin: Springer,
2010.
[44] J. H. Quick, J. H. Duncan, J. A. Malcolm, Jr., Das Work-Factor-Buch.
M├╝nchen: Carl-Hanser Verlag, 1965.
[45] H. Luczak, ÔÇ×Task Analysis," in Handbook of Human Factors and
Ergonomics - 2nd Edition, G. Salvendy, Ed. New York: Wiley-
Interscience, 1997, pp. 340-416.
[46] C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A.
Wesslen, ÔÇ×Experimentation in Software Engineering - An Introduction,"
in The Kluwer International Series in Software Engineering, V. R.
Basili, Ed. Boston: Kluwer Academic Publishers, 2000.
[47] A. Nielen, D. Költer, S. M├╝tze-Niewöhner, J. Karla, C. M. Schlick, ÔÇ×An
Empirical Analysis of Human Performance and Error in Process Model
Development," in ER 2011 Proc. of the 30th International Conference
on Conceptual Modeling, Brussels, 2011A, pp. 514-523.
[48] T. D. Cook, D. T. Campbell, Quasi-Experimentation - Design and
Analysis Issues for Field Settings.Boston: Houghton Mifflin Harcourt,
1979.
[49] A. Nielen, S. M├╝tze-Niewöhner, C.M. Schlick, ÔÇ×Identification and
Classification of Humand Error in Process Model Development," in
Industrial Engineering and Engineering Management (IEEM),
Singapore, 2011B.
[50] H. Luczak, Arbeitswissenschaft. Berlin: Springer, 1998.
[51] L. Schmidt, H. Luczak, ÔÇ×Model-based Design of Mobile Work
Systems," in Mobile Virtual Work - A New Paradigm?, J. H. E.
Andriessen, M. Vartiainen, Eds. Berlin: Springer, 2003, pp. 154-176.
[1] M. Weske, Business Process Management. Berlin: Springer, 2007.
[2] C. Houy, P. Fettke, P. Loos, "Empirical research in business process
management - analysis of an emerging field of research", Business
Process Management Journal, vol. 16, no. 4, pp. 619-661, 2010.
[3] J. Becker, D. Kahn, "Der Prozess im Fokus," in Prozessmanagement, J.
Becker, M. Kugeler, M. Rosemann, Eds. Berlin: Springer, 2008.
[4] H. A. Reijers, J. Recker, S. G. van de Wouw, "An Integrative
Framework of the Factors Affecting Process Model Understanding: A
Learning Perspective," in Proc. 16th Americas Conference on
Information Systems, Lima, 2010, pp. 1-10.
[5] J. Mendling, J. Recker, "Extending the Discussion of Model Quality:
Why Clarity and Completeness may not be enough," in CAiSE 2007
Workshop Proc. Vol. 1 - 11th international Workshop on Exploring
Modeling Methods in Systems Analysis and Design (EMMSAD),
Trondheim, 2007, pp. 109-121.
[6] K. Y. Wong, "Critical success factors for implementing knowledge
management in small and medium enterprises," Industrial Management
& Data Systems, vol. 105, pp. 261-279, 2005.
[7] M. Indulska, P. Green, J. Recker, M. Rosemann, " Business Process
Modeling: Perceived Benefits," in Conceptual Modeling - ER 2009, S.
Castano, U. Dayal, A. H. F. Laender, Eds. Gramado: Springer, 2009, pp.
458-471.
[8] W. M. P. van der Aalst, A. H. M. ter Hofstede, M. Weske, ÔÇ×Business
Process Management: A Survey," in Proc. Intl. Conf. on Business
process Management (BPM), Eindhoven, 2003.
[9] T. H. Davenport, J. E. Short, "The New Industrial Engineering
Information Technology and Business Process Redesign," Sloan
Management Review, vol. 31, no. 4, pp. 11-27, 1990.
[10] N. P. Dalal, M. Kamath. W. J. Kolarik, E. Sivaramann, "Toward an
Integrated Framework for Modeling Enterprise Processes,"
Communications of the ACM, vol. 47, no.3, pp. 83-87, March 2004.
[11] D. L. Moody, G. Sindre, T. Brasethvik, A. Solvberg, "Evaluating the
Quality of Process Models: Empirical Testing of a Quality Framework,"
in ER 2002, LNCS 2503, S. Spaccapietra, S. T. March, Y. Kambayashi,
Eds. Berlin: Springer, 2002, pp. 380-396.
[12] D. L. Moody, "Theoretical and practical issues in evaluating the quality
of conceptual models: current state and future directions," Data &
Knowledge Engineering, vol. 55, pp. 243-276, 2005.
[13] A. Maes, G. Poels, "Evaluating quality of conceptual modeling scripts
based on user perceptions," Data Knowledge & Engineering, vol. 63, pp.
701-724, 2007.
[14] J. R. Evans, W. M. Lindsay, Managing for Quality and Performance
Excellence. Mason, OH: Thomson South-Western, 2007.
[15] R. Schmitt, T. Pfeifer, Qualitätsmanagement: Strategien, Methoden,
Techniken. M├╝nchen: Carl-Hanser Verlag, 2010.
[16] R. Schuette, T. Rotthowe, ÔÇ×The Guidelines of Modeling - an approach
to enhance the quality in information models," in ER 1998, LNCS 1507,
T. W. Ling, S. Ram, M. L. Lee, Eds. Berlin: Springer, 1998, pp. 240-
254.
[17] O. I. Lindland, G. Sindre, A. Solvberg, ÔÇ×Understanding Quality in
Conceptual Modeling," IEEE Software, pp. 42-49, March 1994.
[18] J. Mendling, H. A. Reijers, W. M. P., ÔÇ×Seven Process Modeling
Guidelines (7PMG)", Information and Software Technology (IST), vol.
52, pp. 127-136, 2010.
[19] J. Mendling, J. Recker, H. A. Reijers, ÔÇ×Process modeling quality: a
framework and research agenda," BPM center reports, pp. 18-36, 2009.
[20] D. Z├ñhringer, P. Schneider, ÔÇ×Analyse der Modellierungsfunktion" in
Business Process Management Tools 2011, D. Spath, A. Weisbecker, D.
Kopperger, R. Nägele, Eds. Stuttgart: Fraunhofer IAO, 2011, pp. 37-60.
[21] P. Fettke, ÔÇ×How Conceptual Modeling Is Used," Communications oft he
Association for Information Systems, vol. 25, pp. 571-592, Dec. 2009.
[22] S. West, R. A. Brown, J. Recker, ÔÇ×Collaborative business process
modeling using 3D virtual environments," in 16th Americas Conference
in Information Systems: Sustainable IT Collaboration around the Globe,
Lima, 2010.
[23] M. Weidlich, A. Barros, J. Mendling, M. Weske, ÔÇ×Vertical Alignment of
Process Models- How Can We Get There?," in EMMSAD 2009, LNBIP
29, T. Haipin et al., Eds. Berlin: Springer, 2009, pp.71-84.
[24] M. Rosemann, ÔÇ×Potential pitfalls of process modeling: part A," Business
Process Management, vol. 12. no. 2, pp.249-254, 2006.
[25] J. Recker, A. Dreiling, ÔÇ× Does It Matter Which Process Modelling
Language We Teach or Use? An Experimental Study on Understanding
Process Modelling Languages without Formal Education," in 18th
Australasian Conference on Information Systems, Toowoomba, 2007.
[26] S. Smirnow, M. Weidlich, J. Mendling, M. Weske, ÔÇ×Action Patterns in
Business Process Models," in ICSOS-ServiceWave 2009, LNCS 5900, L.
Baresi, C. H. Chi, J. Suzuki, Eds. Berlin: Springer, 2009, pp.115-129.
[27] R. Laue, A. Gadatsch, ÔÇ×Measuring the Understandability of Business
Process Models - Are We Asking the Right Questions?," in 6th
International Workshop on Business Process Design (BPD), Hoboken,
2011.
[28] J. Mendling, H. A. Reijers, J. Cardoso, ÔÇ×What Makes Process Models
Understandable?," in BPM 2007, LNCS 4714, G. Alonso, P. Dadam, M.
Rosemann, Eds. Berlin: Springer, 2007, pp. 48-63.
[29] H. A. Reijers, J. Mendling, ÔÇ×Modularity in Process Models," in BPM
2008, LNCS 5240, M. Dumas, M. Reichert, M. C. Shan, Eds. Berlin:
Springer, 2008, pp. 20-35.
[30] I. Vanderfeesten, J. Cardoso, J. Mendling, H. A. Reijers, W. van der
Allst, ÔÇ×Quality Metrics for Business Process Models," in 2007 BPM and
workflow handbook, L. Fisher, Ed., Lighthouse-Point, 2008.
[31] H. A. Reijers, J. Mendling, ÔÇ×A Study Into the Factors That Influence the
Understandability of Business Process Models," IEEE Transactions on
Systems, Man, And Cibernetics - Part A: Systems and Humans, vol. 41,
no. 3, pp. 449-462, May 2011.
[32] J. Erickson, K. Siau, ÔÇ×Theoretical and Practical Complexity of Modeling
Methods," Communications of the ACM, vol. 50, no. 8, pp. 46-51, 2007.
[33] J. Recker, M. zur Muehlen, K. Siau, J. Erickson, M. Indulska,
ÔÇ×Measrung method complexity: UML versus BPMN," in 15th Americas
Conference in Information Systems, San Francisco, 2009.
[34] M. La Rosa, A. H. M. ter Hofstede, P. Wohed, H. A. Reijers, J.
Mendling, W. M. P. van der Aalst, ÔÇ×Managing process model
complexity via concrete syntax modifications," IEEE Transactions on
Industrial Informatics, vol. 7, no. 2, pp. 1-11, 2011.
[35] D. Birkmeier, S. Klöckner, S. Overhage, ÔÇ×An Empirical Comparison of
the Usability of BPMN and UML Activity Diagrams for Business
Users," in 18th European Conference on Information Systems, 2010.
[36] J. Recker, M. Rosemann, ÔÇ×Teaching Business Process Modelling:
Experiences and Recommendations," Communications of the
Association for Information Systems, vol. 25, pp. 379-394, Oct. 2009.
[37] M. zur Muehlen, J. Recker, ÔÇ×How Much Language Is Enough?
Theoretical and Practical Use of the Business Process Modeling
Notation," in CAiSE 2008, LNCS 5074, Z. Bellahsene, M. Leonard, Eds.
Berlin: Springer, 2008, pp. 465-479.
[38] J. Recker, ÔÇ×Opportunities and constraints: the current struggle with
BPMN," Business Process Management Journal, vol. 16, no. 1, pp.181-
201, 2010.
[39] Deutsche MTM Vereinigung e. V., MTM - Grundverfahren
Lehrgangsunterlage Teil 1. Hamburg, 2003.
[40] J. H. Quick, J. H. Duncan, J. A. Malcolm, Work-Factor Time Standards.
New York: The maple press company, 1962.
[41] K. B. Zandin, MOST Work Measurement Systems, 3 ed., New York:
Marcel Dekker.
[42] R. Papenfuß, K. -D. Theis, ÔÇ×Die WORK-FACTOR-Verfahren"
Angewandte Arbeitswissenschaft, pp. 3-18, 1988.
[43] C. Schlick, R- Bruder, H. Luczak, Arbeitswissenschaft. Berlin: Springer,
2010.
[44] J. H. Quick, J. H. Duncan, J. A. Malcolm, Jr., Das Work-Factor-Buch.
M├╝nchen: Carl-Hanser Verlag, 1965.
[45] H. Luczak, ÔÇ×Task Analysis," in Handbook of Human Factors and
Ergonomics - 2nd Edition, G. Salvendy, Ed. New York: Wiley-
Interscience, 1997, pp. 340-416.
[46] C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A.
Wesslen, ÔÇ×Experimentation in Software Engineering - An Introduction,"
in The Kluwer International Series in Software Engineering, V. R.
Basili, Ed. Boston: Kluwer Academic Publishers, 2000.
[47] A. Nielen, D. Költer, S. M├╝tze-Niewöhner, J. Karla, C. M. Schlick, ÔÇ×An
Empirical Analysis of Human Performance and Error in Process Model
Development," in ER 2011 Proc. of the 30th International Conference
on Conceptual Modeling, Brussels, 2011A, pp. 514-523.
[48] T. D. Cook, D. T. Campbell, Quasi-Experimentation - Design and
Analysis Issues for Field Settings.Boston: Houghton Mifflin Harcourt,
1979.
[49] A. Nielen, S. M├╝tze-Niewöhner, C.M. Schlick, ÔÇ×Identification and
Classification of Humand Error in Process Model Development," in
Industrial Engineering and Engineering Management (IEEM),
Singapore, 2011B.
[50] H. Luczak, Arbeitswissenschaft. Berlin: Springer, 1998.
[51] L. Schmidt, H. Luczak, ÔÇ×Model-based Design of Mobile Work
Systems," in Mobile Virtual Work - A New Paradigm?, J. H. E.
Andriessen, M. Vartiainen, Eds. Berlin: Springer, 2003, pp. 154-176.
@article{"International Journal of Mechanical, Industrial and Aerospace Sciences:63601", author = "A. Nielen and S. Mütze-Niewöhner and C. M. Schlick", title = "An Empirical Analysis of the Influence of Application Experience on Working Methods of Process Modelers", abstract = "In view of growing competition in the service sector,
services are as much in need of modeling, analysis and improvement
as business or working processes. Graphical process models are
important means to capture process-related know-how for an
effective management of the service process. In this contribution, a
human performance analysis of process model development paying
special attention to model development time and the working method
was conducted. It was found that modelers with higher application
experience need significantly less time for mental activities than
modelers with lower application experience, spend more time on
labeling graphical elements, and achieved higher process model
quality in terms of activity label quality.", keywords = "Model quality, predetermined motion time system,
process modeling, working method.", volume = "6", number = "10", pages = "2278-7", }
