Approximate Bounded Knowledge Extraction Using Type-I Fuzzy Logic

Using neural network we try to model the unknown function f for given input-output data pairs. The connection strength of each neuron is updated through learning. Repeated simulations of crisp neural network produce different values of weight factors that are directly affected by the change of different parameters. We propose the idea that for each neuron in the network, we can obtain quasi-fuzzy weight sets (QFWS) using repeated simulation of the crisp neural network. Such type of fuzzy weight functions may be applied where we have multivariate crisp input that needs to be adjusted after iterative learning, like claim amount distribution analysis. As real data is subjected to noise and uncertainty, therefore, QFWS may be helpful in the simplification of such complex problems. Secondly, these QFWS provide good initial solution for training of fuzzy neural networks with reduced computational complexity.

• Syed Muhammad Aqil Burney
• Tahseen Ahmed Jilani
• C. Ardil

• Crisp neural networks
• fuzzy systems
• extraction of logical rules
• quasi-fuzzy numbers.

[1] Aqil Burney S.M., Jilani A. Tahseen and Cemal Ardil, "A comparative
study of first and second order training algorithms for artificial neural
networks", Int. Journal of Computational Intelligence, vol. 1, no.3,
2004, pp. 218-224.
[2] Aqil Burney S.M., Jilani A. Tahseen and Cemal Ardil, "Levenberg-
Marquardt algorithm for Karachi Stock Exchange share rates
forecasting", Int. J. of Computational Intelligence, vol. 1, no. 2, 2004, pp
168-173.
[3] Aqil Burney S.M., Jilani A. Tahseen, "Time Series forecasting using
artificial neural network methods for Karachi Stock Exchange", A
Project in the Dept. of Computer Science, University of Karachi. 2002.
[4] F. Scarselli and A. C. Tosi, "Universal approximation using feedforward
neural networks: A survey of some existing methods, and some new
results," Neural Networks, vol. 11, no. 1, 1998, pp. 15-37.
[5] G. Castellano and A.M. Fanelli, "Fuzzy inference and rule extraction
using a neural network", Neural Network World Journal, vol. 3, 2000,
pp. 361-371.
[6] H. Ishibuchi and M. Nii, "Numerical analysis of the learning of fuzzified
neural networks from if-then rules," Fuzzy Sets Syst., vol. 120, no. 2,
2001, pp. 281-307.
[7] H. Ishibuchi, Fujioka, and Tanaka, (1993), "Neural networks that learn
from fuzzy If-then rules", IEEE Transactions on Fuzzy Systems, vol. 1.
no. 2. 1993.
[8] J. Dunyak and D. Wunsch, "Training fuzzy numbers neural networks
with alpha-cut refinement," in Proc. IEEE Int. Conf. System, Man,
Cybernetics, vol. 1, 1997, pp. 189-194.
[9] J. J. Buckley and Y. Hayashi, "Neural networks for fuzzy systems,"
Fuzzy Sets and Systems 1995, pp. 265-276.
[10] Jang, Sun and Mizutani, Neuro-fuzzy logic and Soft Computing; A
computational approach to learning and machine intelligence. New
York: Practice-Hall, 2003, Chap. 2-4
[11] Jerry M. Mendel, Uncertainly Rule-Based Fuzzy Logic Systems.
Introduction and new Directions. New York: Prentice Hall PTR,
NJ.2001, chapter 1-7.
[12] L. A. Zadeh, "The concept of linguistic variable and its applications to
approximate reasoning", Parts I,II,III, Information Sciences, 8(1975)
199-251; 8(1975) 301-357; 9(1975) 43-80. 30.
[13] L. A. Zadeh, "Outline of a new approach to the analysis of complex
systems and decision processes", IEEE Trans. Systems, Man and
Cybernetics, 1973, vol. 3, pp. 28-44.
[14] Mir F. Atiya, Suzan M. El-Shoura, Samir I. Shaken, "A comparison
between neural network forecasting techniques- case study: river flow
forecasting". IEEE Trans. on Neural Networks. Vol. 10, No. 2. 1999.
[15] M. Bishop, Neural networks for pattern recognition. United Kingdom:
Clarendon Press, 1995, chapter 5-7.
[16] Nauck and R. Kruse, "Designing neuro-fuzzy systems through
backpropagation", in Fuzzy Modeling: Paradigms and Practice, Kluwer,
Boston, 1996. pp. 203-228.
[17] Nauck, Detlef and Kruse, Rudolf, "Designing neuro-fuzzy systems
through backpropagation", In Witold Pedryz, editor, Fuzzy Modeling:
Paradigms and Practice, 1996. pp. 203-228, Kluwer, Boston.
[18] Nilesh N. Karnik, Jerry M. Mendel and Qilian Liang, "Type-2 Fuzzy
Logic Systems", IEEE Trans. Fuzzy Syst., 1999, vol. 15, no. 3,pp. 643-
658.
[19] P. Eklund, J. Forsstrom, A. Holm, M. Nystrom, and G. Selen, "Rule
generation as an alternative to knowledge acquisition: A systems
architecture for medical informatics", Fuzzy Sets and Systems, vol. 66
1994, pp. 195-205.
[20] P. Eklund, "Network size versus preprocessing, Fuzzy Sets, Neural
Networks and Soft Computing" (Van Nostrand, New York, 1994, pp.
250-264.
[21] Puha, P. K. H. Daohua Ming, "Parallel nonlinear optimization
techniques for training neural networks.", IEEE Trans. on Neural
Networks, vol. 14, no. 6, 2003, pp 1460-1468.
[22] Puyin Liu and Hongxing, "Efficient learning algorithms for three-layer
regular feedforward fuzzy neural networks", IEEE Trans. Fuzzy Syst.,
vol. 15, no. 3, 2004, pp. 545-558.
[23] S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft
computing framework," IEEE Trans. Neural Networks., vol. 11, no. 3,
2000, pp. 748-768.
[24] S. M. Chen, "A weighted fuzzy reasoning algorithm for medical
diagnosis", Decision Support Systems, vol. 11, 1994, pp.37-43.
[25] Sungwoo Park and Taisook Han, "Iterative Inversion of Fuzzified
Neural Networks", IEEE Trans. Fuzzy Syst., vol. 8, no. 3, 2000, pp. 266-
280.
[26] T. Takagi and M. Sugeno, "Fuzzy identification of systems and its
applications to modeling and control", IEEE Trans. Syst. Man Cybernet.,
1985, pp. 116-132.
[27] Włodzisław Duch," Uncertainty of Data, Fuzzy Membership Functions,
and Multilayer Perceptrons", IEEE, Trans. on Neural Network, vol. 16,
no.1, 2005.
[28] Xinghu Zhang, Chang-Chieh Hang, Shaohua Tan and -Pei Zhuang
Wang," The Min-Max Function Differentiation and Training of Fuzzy
Neural Networks", IEEE Trans, Neural Networks, vol. 7. no. 5, 1996,
pp. 1139-1149.
[29] Y. Hayashi, J. J. Buckley, and E. Czogala, "Fuzzy neural network with
fuzzy signals and weight, "in Proc. Int. Joint Conf. Neural Networks,
vol. 2, Baltimore, MD, pp. 1992, pp. 696-701.