An Agent Oriented Approach to Operational Profile Management

Software reliability, defined as the probability of a software system or application functioning without failure or errors over a defined period of time, has been an important area of research for over three decades. Several research efforts aimed at developing models to improve reliability are currently underway. One of the most popular approaches to software reliability adopted by some of these research efforts involves the use of operational profiles to predict how software applications will be used. Operational profiles are a quantification of usage patterns for a software application. The research presented in this paper investigates an innovative multiagent framework for automatic creation and management of operational profiles for generic distributed systems after their release into the market. The architecture of the proposed Operational Profile MAS (Multi-Agent System) is presented along with detailed descriptions of the various models arrived at following the analysis and design phases of the proposed system. The operational profile in this paper is extended to comprise seven different profiles. Further, the criticality of operations is defined using a new composed metrics in order to organize the testing process as well as to decrease the time and cost involved in this process. A prototype implementation of the proposed MAS is included as proof-of-concept and the framework is considered as a step towards making distributed systems intelligent and self-managing.

Authors:

• Sunitha Ramanujam
• Hany El Yamany
• Miriam A. M. Capretz

Keywords:

• Software reliability
• Software testing
• Metrics
• Distributed systems
• Multi-agent systems

References:

[1] J. Musa, Software Reliability Engineering: More Reliable Software
Faster and Cheaper, McGraw-Hill. 2004.
[2] I. Sommerville, Software Engineering, Addison-Wesley, 7th Edition,
Chapter 24, 2004.
[3] J. Musa, "Operational Profile in Software Reliability Engineering,"
IEEE Software, Vol. 10, No. 2, Mar. 1993, pp. 14-32.
[4] R. V. Binder, "Automated Testing with an Operational Profile", The
Software Tech News, Vol. 8, No. 1. Dec. 2004, pp. 7-10.
[5] J. A. Whittaker and J. Voas, "Toward a more reliable theory of software
reliability", IEEE Computer, Vol. 33, No. 12, Dec. 2000, pp. 36-42.
[6] J. Voas, "Will the real operational profile please stand up", IEEE
Software, Vol. 17, No. 2, Mar./Apr. 2000, pp. 87-89.
[7] D. M. Woit, "Specifying operational profile for modules". In
Proceedings of the ACM International Symposium on Software Testing
and Analysis, ACM, 1993.
[8] D. M. Woit, "Operational profile specification, test case generation, and
reliability estimation for modules", Technical report, Queen-s
University, Kingston, Ontario Canada, 1994
[9] M. Gittens, H. Lutfiyya, and M. Bauer, "An Extended Operational
Profile Model", In the proceedings of the Fifteenth International
Symposium on Software Reliability Engineering, Nov. 2004.
[10] N. R. Jennings, K. Sycara, M. Wooldridge, "A Roadmap of Agent
Research and Development," Journal of Autonomous Agents and Multi-
Agent Systems, Vol. 1, No. 1, 1998, pp. 5-38.
[11] J. Lind, "Patterns in agent-oriented software engineering," in
Proceedings of AOSE Workshop, 2002, pp. 47-58.
[12] M. Wooldridge, "Agent-based software engineering," IEE Proceedings
Software Engineering, Vol. 144, 1997, pp. 26-37.
[13] Mitchell, B.; Zeil, S. J.: A Reliability Model Combining Representative
and Directed Testing, Technical Report TR 95-18, Old Dominon
University, 1995.
[14] M. Grottke and K.D-Zieger, "Systematic vs. Operational Testing: The
Necessity for Different Failure Models," in Proc. of the 5th Conference
on Quality Engineering in Software Technology, 2001, pp. 59 - 68.
[15] Critical Software Practices for Performance-Based Management:
Available: http://www.spmn.com/16CSP.html (URL).
[16] V. R. Basili, and W. L. Melo, "A Validation of Object Oriented Design
Metrics as Quality Indicators", IEEE Transactions on Software
Engineering, Vol. 22, No. 10, Oct. 1996, pp. 751-761.
[17] M. Wooldridge, N. R. Jennings and D. Kinny, The Gaia Methodology
for Agent-Oriented Analysis and Design in Journal of Autonomous
Agents and Multi-Agent Systems, Vol. 3, No.3, 2000, pp. 285-312.