A Systematic Method for Performance Analysis of SOA Applications
The successful implementation of Service-Oriented Architecture (SOA) is not confined to Information Technology systems and required changes of the whole enterprise. In order to adapt IT and business, the enterprise requires adequate and measurable methods. The adoption of SOA creates new problem with regard to measuring and analysis the performance. In fact the enterprise should investigate to what extent the development of services will increase the value of business. It is required for every business to measure the extent of SOA adaptation with the goals of enterprise. Moreover, precise performance metrics and their combination with the advanced evaluation methodologies as a solution should be defined. The aim of this paper is to present a systematic methodology for designing a measurement system at the technical and business levels, so that: (1) it will determine measurement metrics precisely (2) the results will be analysed by mapping identified metrics to the measurement tools.
[1] Erl, T., Service-Oriented Architecture: Concepts, Technology, and
Design, Prentice Hall, 2005.
[2] Newcomer, E. and Lomow, G., Understanding SOA with Web Services,
Addison Wesley Professional, 2004.
[3] Hubbard, D. W., How to Measure Anything Finding the Value of
"Intangibles" in Business, Wiley, 2007.
[4] Jain, R., the art of computer systems performance analysis: Techniques,
for Experimental Design, measurement, Simulation, and Modeling,
Wiley, 1984.
[5] Her, J. S., Choi, S. W., Oh, S. H., and Kim, S. D., A Framework for
Measuring Performance in Service-Oriented Architecture, Proceedings
of the NWeSP 2007, pp. 55-60, 2007.
[6] Song, M. and van der Aalst, W. M. P., Towards Comprehensive Support
for Organizational Mining, Decision Support Systems, v.46 n.1,pp.300-
317, 2008.
[7] DiMare, J., Service oriented architecture: A practical guide to measuring
return on investment, http://www.935.ibm.com/services/de/bcs/pdf/2007/soa_practical_guide.pdf, 2006.
[8] Barnes, M., Applied SOA: Measuring Business Value,
http://www.gartner.com/teleconferences/attributes/attr_150040_115.pdf,
2006.
[9] Johnson, P., et al., Extended Influence Diagrams for Enterprise
Architecture Analysis, in the Proceedings of the EDOC 2006, pp.3-12,
2006.
[10] Vasconcelos, A., et al.: An information system architectural framework
for enterprise application integration, in the Proceedings of the HICSS
2004, pp. 225-233, 2004.
[11] Khaddaj, S., Horgan, G., The Evaluation of Software Quality Factors in
Very Large Information Systems, Electronic Journal of Information
Systems Evaluation, pp. 43-48, 2004.
[12] Aier, S., Ahrens, M., Stutz, M., Bub, U., Deriving SOA Evaluation
Metrics in an Enterprise Architecture Context, in the Proceedings of the
ICSOC 2007, pp. 224 - 233, 2009.
[13] Smith, J., 10 Measures for Successful SOA Implementations,
http://soa.sys-con.com/node/631831, 2008.
[14] McKendrick, J., Justifying SOA: 12 key metrics to keep tabs on,
http://blogs.zdnet.com/service-oriented/?p=1950, 2009.
[15] http://www.processmining.org/
[16] A.K. Alves de Medeiros and C.W. Gunther, Process Mining: Using CPN
Tools to Create Test Logs for Mining Algorithms,
www.daimi.au.dk/CPnets/workshop05/cpn/.../AnaKarlaAlvesdeMedeiro
s.pdf, 2005.
[17] Medeiros, A. K. Alves de, and Weijters, A. J. M. M., ProM Framework
Tutorial,
http://prom.win.tue.nl/research/wiki/_media/tutorial/promtutorialv2.pdf?
id=tutorials&cache=cache, 2008.
[18] G├╝nther, C. W., van der Aalst, W. M. P., A Generic Import Framework
For Process Event Logs, Proceedings of the Business Process
Management Workshops Workshop on Business Process Intelligence
(BPI 2006), volume 4103, pp. 81-92, Springer LNCS, 2006.
[19] Van der Aalst, W. M. P., Stein, S., Zoeller, S. and et. al, Semantics
Utilized for Process management within and between Enterprises,
www.ip-super.org/res/Deliverables/M12/D2.2.pdf, 2007.
[20] Kannan, V., van der Aalst, W.M.P. and Voorhoeve, M., Formal
Modeling and Analysis by Simulation of Data Paths in Digital
Document Printers,
http://is.tm.tue.nl/staff/wvdaalst/publications/p538.pdf, 2008.
[1] Erl, T., Service-Oriented Architecture: Concepts, Technology, and
Design, Prentice Hall, 2005.
[2] Newcomer, E. and Lomow, G., Understanding SOA with Web Services,
Addison Wesley Professional, 2004.
[3] Hubbard, D. W., How to Measure Anything Finding the Value of
"Intangibles" in Business, Wiley, 2007.
[4] Jain, R., the art of computer systems performance analysis: Techniques,
for Experimental Design, measurement, Simulation, and Modeling,
Wiley, 1984.
[5] Her, J. S., Choi, S. W., Oh, S. H., and Kim, S. D., A Framework for
Measuring Performance in Service-Oriented Architecture, Proceedings
of the NWeSP 2007, pp. 55-60, 2007.
[6] Song, M. and van der Aalst, W. M. P., Towards Comprehensive Support
for Organizational Mining, Decision Support Systems, v.46 n.1,pp.300-
317, 2008.
[7] DiMare, J., Service oriented architecture: A practical guide to measuring
return on investment, http://www.935.ibm.com/services/de/bcs/pdf/2007/soa_practical_guide.pdf, 2006.
[8] Barnes, M., Applied SOA: Measuring Business Value,
http://www.gartner.com/teleconferences/attributes/attr_150040_115.pdf,
2006.
[9] Johnson, P., et al., Extended Influence Diagrams for Enterprise
Architecture Analysis, in the Proceedings of the EDOC 2006, pp.3-12,
2006.
[10] Vasconcelos, A., et al.: An information system architectural framework
for enterprise application integration, in the Proceedings of the HICSS
2004, pp. 225-233, 2004.
[11] Khaddaj, S., Horgan, G., The Evaluation of Software Quality Factors in
Very Large Information Systems, Electronic Journal of Information
Systems Evaluation, pp. 43-48, 2004.
[12] Aier, S., Ahrens, M., Stutz, M., Bub, U., Deriving SOA Evaluation
Metrics in an Enterprise Architecture Context, in the Proceedings of the
ICSOC 2007, pp. 224 - 233, 2009.
[13] Smith, J., 10 Measures for Successful SOA Implementations,
http://soa.sys-con.com/node/631831, 2008.
[14] McKendrick, J., Justifying SOA: 12 key metrics to keep tabs on,
http://blogs.zdnet.com/service-oriented/?p=1950, 2009.
[15] http://www.processmining.org/
[16] A.K. Alves de Medeiros and C.W. Gunther, Process Mining: Using CPN
Tools to Create Test Logs for Mining Algorithms,
www.daimi.au.dk/CPnets/workshop05/cpn/.../AnaKarlaAlvesdeMedeiro
s.pdf, 2005.
[17] Medeiros, A. K. Alves de, and Weijters, A. J. M. M., ProM Framework
Tutorial,
http://prom.win.tue.nl/research/wiki/_media/tutorial/promtutorialv2.pdf?
id=tutorials&cache=cache, 2008.
[18] G├╝nther, C. W., van der Aalst, W. M. P., A Generic Import Framework
For Process Event Logs, Proceedings of the Business Process
Management Workshops Workshop on Business Process Intelligence
(BPI 2006), volume 4103, pp. 81-92, Springer LNCS, 2006.
[19] Van der Aalst, W. M. P., Stein, S., Zoeller, S. and et. al, Semantics
Utilized for Process management within and between Enterprises,
www.ip-super.org/res/Deliverables/M12/D2.2.pdf, 2007.
[20] Kannan, V., van der Aalst, W.M.P. and Voorhoeve, M., Formal
Modeling and Analysis by Simulation of Data Paths in Digital
Document Printers,
http://is.tm.tue.nl/staff/wvdaalst/publications/p538.pdf, 2008.
@article{"International Journal of Information, Control and Computer Sciences:57650", author = "Marzieh Asgarnezhad and Ramin Nasiri and Abdollah Shahidi", title = "A Systematic Method for Performance Analysis of SOA Applications", abstract = "The successful implementation of Service-Oriented Architecture (SOA) is not confined to Information Technology systems and required changes of the whole enterprise. In order to adapt IT and business, the enterprise requires adequate and measurable methods. The adoption of SOA creates new problem with regard to measuring and analysis the performance. In fact the enterprise should investigate to what extent the development of services will increase the value of business. It is required for every business to measure the extent of SOA adaptation with the goals of enterprise. Moreover, precise performance metrics and their combination with the advanced evaluation methodologies as a solution should be defined. The aim of this paper is to present a systematic methodology for designing a measurement system at the technical and business levels, so that: (1) it will determine measurement metrics precisely (2) the results will be analysed by mapping identified metrics to the measurement tools.
", keywords = "Service-oriented architecture, metrics, performance,evaluation.", volume = "4", number = "2", pages = "265-7", }
