Ant Colony Optimization for Feature Subset Selection

The Ant Colony Optimization (ACO) is a metaheuristic inspired by the behavior of real ants in their search for the shortest paths to food sources. It has recently attracted a lot of attention and has been successfully applied to a number of different optimization problems. Due to the importance of the feature selection problem and the potential of ACO, this paper presents a novel method that utilizes the ACO algorithm to implement a feature subset search procedure. Initial results obtained using the classification of speech segments are very promising.

Authors:

• Ahmed Al-Ani

Keywords:

• Ant Colony Optimization
• ant systems
• feature selection
• pattern recognition.

References:

[1] A.L. Blum and P. "Langley. Selection of relevant features and examples
in machine learning". Artificial Intelligence, 97:245-271, 1997.
[2] M.A. Hall. Correlation-based feature selection for machine learning.
PhD thesis, The University of Waikato, 1999.
[3] R. Kohavi. Wrappers for performance enhancement and oblivious
decision graphs. PhD thesis, Stanford University, 1995.
[4] J. Kittler. "Feature set search algorithms". In C. H. Chen, editor, Pattern
Recognition and Signal Processing. Sijhoff and Noordhoff, the
Netherlands, 1978.
[5] P. Pudil, J. Novovicova, and J. Kittler. "Floating search methods in
feature selection". Pattern Recognition Letters, 15:1119-1125, 1994.
[6] P.M. Narendra and K. Fukunaga. "A branh and bound algorithm for
feature subset selection". IEEE Transactions on Computers, C-26: 917-
922, 1977.
[7] J. Yang and V. Honavar, "Feature subset selection using a genetic
algorithm," IEEE Transactions on Intelligent Systems, 13: 44-49, 1998.
[8] M. Gletsos, S.G. Mougiakakou, G.K. Matsopoulos, K.S. Nikita, A.S.
Nikita, and D. Kelekis. "A Computer-Aided Diagnostic System to
Characterize CT Focal Liver Lesions: Design and Optimization of a
Neural Network Classifier" IEEE Transactions on Information
Technology in Biomedicine, 7: 153-162, 2003.
[9] M. Dorigo, V. Maniezzo, and A. Colorni. "Ant System: Optimization by
a colony of cooperating agents". IEEE Transactions on Systems, Man,
and Cybernetics - Part B, 26:29-41, 1996.
[10] T. St├╝tzle and M. Dorigo. "The Ant Colony Optimization Metaheuristic:
Algorithms, Applications, and Advances". In F. Glover and G.
Kochenberger, editors, Handbook of Metaheuristics, Kluwer Academic
Publishers, Norwell, MA, 2002.
[11] G. Di Caro and M. Dorigo. "AntNet: Distributed stigmergetic control for
communications networks". Journal of Artificial Intelligence Research,
9:317-365, 1998.
[12] R.S. Parpinelli; H.S. Lopes; A.A. Freitas, "Data mining with an ant
colony optimization algorithm", IEEE Transactions on Evolutionary
Computation, 6: 321 - 332 2002.
[13] R. Montemanni, L.M. Gambardella, A.E. Rizzoli and A.V. Donati. "A
new algorithm for a Dynamic Vehicle Routing Problem based on Ant
Colony System". Proceedings of ODYSSEUS 2003, 27-30, 2003.
[14] A. Al-Ani, M. Deriche and J. Chebil. "A new mutual information based
measure for feature selection", Intelligent Data Analysis, 7: 43-57, 2003.