A Multi-Objective Evolutionary Algorithm of Neural Network for Medical Diseases Problems

This paper presents an evolutionary algorithm for
solving multi-objective optimization problems-based artificial neural
network (ANN). The multi-objective evolutionary algorithm used in
this study is genetic algorithm while ANN used is radial basis
function network (RBFN). The proposed algorithm named memetic
elitist Pareto non-dominated sorting genetic algorithm-based RBFN
(MEPGAN). The proposed algorithm is implemented on medical
diseases problems. The experimental results indicate that the
proposed algorithm is viable, and provides an effective means to
design multi-objective RBFNs with good generalization capability
and compact network structure. This study shows that MEPGAN
generates RBFNs coming with an appropriate balance between
accuracy and simplicity, comparing to the other algorithms found in
literature.





References:
[1] C.M. Bishop, Neural networks for pattern recognition. Oxford, U.K.:
Oxford Univ., Press, 1995.
[2] D. Broomhead, D. Lowe, "Multivariable functional interpolation and
adaptive networks," Complex Systems, vol. 2, pp. 321–355, 1988.
[3] H.A. Abbass, "An evolutionary artificial neural networks approach for
breast cancer diagnosis", Artificial Intelligence in Medicine, vol. 25, no.
3,pp. 265–281, 2002.
[4] H.A. Abbass, "Speed up backpropagation using multi-objective
evolutionary algorithms," Neural Computation, vol. 15, no. 11,pp.
2705–2726, 2003.
[5] J.C. Caballero, F.J. Martínez, C. Hervás, P.A. Gutiérrez, "Sensitivity
versus accuracy in multiclass problems using memetic Pareto
evolutionary neural networks,"IEEE Transactions on Neural Networks,
vol. 21, no. 5, pp. 750–770, 2010.
[6] R.A. Teixeira, A.P. Braga, R.R. Saldanha, R.H.C. Takahashi,
"Improving generalization of MLPs with multi-objective optimization,"
Neurocomputing, vol. 35, pp. 189–194, 2000.
[7] I. Kokshenev, A.P. Braga, "A multi-objective approach to RBF network
learning," Neurocomputing, vol. 71, no. 7–9 , pp. 1203–1209, 2008.
[8] I. Kokshenev, A. P. Braga, "An efficient multi-objective learning
algorithm for RBF neural network,"Neurocomputing, vol. 73, no. 16–
18), pp. 2799–2808, 2010.
[9] N. Kondo, T. Hatanaka, K. Uosaki, "Pattern classification by
evolutionary RBF networks ensemble based on multi-objective
optimization," International Joint Conference on Neural Networks, pp.
2919–2925, 2006.
[10] G.G. Yen, Multi-objective evolutionary algorithm for radial basis
function neural network design. Springer-Verlag, vol. 16, 2006.
[11] V. Lefort, C. Knibbe, G. Beslon, J. Favrel, Simultaneous optimization of
weights and structure of an RBF neural network. Springer-Verlag,
LNCS, vol. 3871, pp. 49–60, 2006.
[12] J. González, I. Rojas, H. Pomares, J. Ortega, RBF neural networks,
multi-objective optimization and time series forecasting. Springer-
Verlag, LNCS, vol. 2084, pp. 498–505, 2001.
[13] N. Kondo, T. Hatanaka, K. Uosaki, "Non linear dynamic system
identification based on multi-objectively selected RBF networks,"
Proceedings of the IEEE Symposium on Computational Intelligence in
Multi-criteria Decision Making, pp. 112–127, 2007.
[14] P.M. Ferreira, A.E. Ruano, C.M. Fonseca, "Evolutionary multi-objective
design of radial basis function networks for greenhouse environmental
control," Proceedings of the 16th IFAC World Congress, 2005.
[15] S.N. Qasem, S.M. Shamsuddin, "Radial basis function network based on
time variant multi-objective particle swarm optimization for medical
diseases diagnosis," Applied Soft Computing, vol. 11, no. 1, pp. 1427–
1438, 2011.
[16] J.H. Holland, Adaptation in Natural and Artificial Systems. University of
Michigan Press, 1975.
[17] K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, "A fast and elitist multi
objective genetic algorithm: NSGA-II,"IEEE Transactions on
Evolutionary Computation, vol. 6, no. 2, pp. 182-197, 2002.
[18] K. Deb, R.B. Agrawal, "Simulated binary crossover for continuous
search space," Complex System, vol. 9, pp. 115–148, 1995.
[19] A. Asuncion, D. Newman, UCI machine learning repository, URL
(http://www.ics.uci.edu/~mlearn/MLRepository.html), 2007.
[20] Y. Jin, B. Sendhoff, "Pareto-based multi-objective machine learning: an
overview and case studies," IEEE Transactions on Systems, Man and
Cybernetics Part C: Applications and Reviews, vol. 38, no. 3, pp. 397–
415, 2008.
[21] C. Goh, E. Teoh, K.C. Tan, "Hybrid multi-objective evolutionary design
for artificial neural networks," IEEE Transactions on Neural Networks,
vol. 19, no. 9, pp. 1531-1548, 2008.
[22] W. Cai, S. Chen, D. Zhang, "A multi-objective simultaneous learning
framework for clustering and classification," IEEE Transactions on
Neural Networks, vol. 21, no. 2, pp. 185–200, 2010. [23] M.-L. Antonie, O.R. Zaiane, R.C. Holte, "Learning to use a learned
model: a two stage approach to classification," Proceedings of 6th
International Conference of Data Mining, pp. 33–42, 2006.