Chemical Reaction Algorithm for Expectation Maximization Clustering

Clustering is an intensive research for some years
because of its multifaceted applications, such as biology, information
retrieval, medicine, business and so on. The expectation maximization
(EM) is a kind of algorithm framework in clustering methods, one
of the ten algorithms of machine learning. Traditionally, optimization
of objective function has been the standard approach in EM. Hence,
research has investigated the utility of evolutionary computing and
related techniques in the regard. Chemical Reaction Optimization
(CRO) is a recently established method. So the property embedded
in CRO is used to solve optimization problems. This paper presents
an algorithm framework (EM-CRO) with modified CRO operators
based on EM cluster problems. The hybrid algorithm is mainly
to solve the problem of initial value sensitivity of the objective
function optimization clustering algorithm. Our experiments mainly
take the EM classic algorithm:k-means and fuzzy k-means as an
example, through the CRO algorithm to optimize its initial value, get
K-means-CRO and FKM-CRO algorithm. The experimental results
of them show that there is improved efficiency for solving objective
function optimization clustering problems.

Authors:

• Li Ni
• Pen ManMan
• Li KenLi

Keywords:

• Chemical reaction optimization
• expectation maximization
• initial
• objective function clustering.

References:

[1] Albert Y. S. Lam and Victor O. K. Li, Chemical reaction optimization:
a tutorial, Memetic Computing, Vol. 4, No. 1, 2013.
[2] Sanghamitra Bandyopadhyay, Genetic algorithms for clustering and
fuzzy clustering, WIREs Data Mining and Knowledge Discovery,
Volume 1, December 2011.
[3] Siripen Wikaisuksakul, A multi-objective genetic algorithm with fuzzy
c-means for automatic data clustering, Applied Soft Computing, Vol. 24,
2014.
[4] David Hallac Jure Leskovec, Stephen Boyd, Network Lasso: Clustering
and Optimization in Large Graphs, KDD15, August 2015.
[5] Grgoire A. Gallet and Fabio Pietrucci, Structural cluster analysis of
chemical reactions in solution, The Journal of Chemical Physics, Vol
139, 2013.
[6] P. C. Srinivasa Rao1.Haider Banka1, Novel chemical reaction
optimization based unequal clustering and routing algorithms for
wireless sensor networks, Wireless Netw, Vol 12, January 2016.
[7] Yoon Mi Hamrick and Michael D. Morse, Comparative Cluster Reaction
Studies of the V, Nb, and T a Series, The Journal of Physical Chemistry,
Vol. 93, No. 17, 1989.
[8] M.-S. YANG, A Survey of Fuzzy Clustering, Mathl. Comput Modelling,
Vol. 18, No. 11, 1993.
[9] Chenglong Tang Shigang Wang, Wei Xu, New fuzzy c-means clustering
model based on the data weighted approach, Data&Knowledge
Engineering, Vol. 69, 2010.
[10] Dan Li Hong Gu Liyong Zhang, A fuzzy c-means clustering algorithm
based on nearest-neighbor intervals for incomplete data, Expert Systems
with Applications, Vol 37, 2010.
[11] Matteo Brunelli Mario Fedrizzi Michele Fedrizzi, Fuzzy m-ary
adjacency relations in social network analysis, Information Fusion, Vol
17, 2014.
[12] Du-Ming Tsai Chung-Chan Lin, Fuzzy C-means based clustering for
linearly and nonlinearly separable data, Pattern Recognition, Vol 44,
2011. [13] Lun Hu and Keith C. C. Chan, Fuzzy Clustering in a Complex Network
Based on Content Relevance and Link Structures, IEEE Transactions on
Fuzzy Systems, vol. 24, No 2, 2016.
[14] Burhan Tu rksen, Review of fuzzy system models with an emphasis
on fuzzy functions, Transactions of the Institute of Measurement and
Control , Vol 31, 2009.
[15] Isabel Timn, Jess Soto, Horacio Prez-Snchez, Jos M. Cecilia, Parallel
implementation of fuzzy minimals clustering algorithm, Expert Systems
With Applications, Vol 41, 2016
[16] Tien Trong Nguyen, ZhiYong Li, ShiWen Zhang, Tung Khac Truong, A
hybrid algorithm based on particle swarm and chemical reaction, Expert
Systems with Applications 41 (2014).
[17] Liang Bai, Jiye Liang, Cluster validity functions for categorical data: a
solution-space perspective, Data Min Knowl Disc, 2014
[18] Raghu Krishnapuram,and James M. Keller, A Possibilistic Approach to
Clustering, IEEE Transactions on Fuzzy Systems, vol. 1, no. 2, May
1993
[19] Dempster, A P, Laird, N M, Rubin, D B. Maximum Likelihood for
Incomplete Data via the EM Algorithm (J). 1977.
[20] Hartigan J A, Wong M A. A K-means clustering algorithm.(J). Applied
Statistics, 2013, 28(1):100-108.