A fuzzy clustering-based genetic TSK system with fuzzy IF part parameters and nonlinear THEN part

Document Type : Research Paper

Authors

1 Mechanical Engineering Department, Amirkabir University of Technology (Tehran Polytechnic).

2 Department of Statistics, Faculty of Basic Science, University of Kurdistan, Sanandaj.

Abstract

Traditional TSK system employs standard membership functions with adjustable crisp parameters in the IF part and linear combinations of input variables in the THEN part, which leads to loss of data fuzziness. Moreover, linear THEN part of this system restricts the number of learning parameters. On the other hand, parameters of the system are tuned to meet a predefined error threshold, but the system does not necessarily display actual structure of data, which impairs its interpretability. This work proposes modifications to the TSK system to tackle these issues and improve its performance. Extended TSK System (ETSK) is presented by replacing crisp parameters of membership functions with fuzzy numbers and adopting arbitrary functions in THEN part of the system. In addition, a Clustering-based TSK system (CTSK) is proposed, which is established from fuzzy clustering algorithms and represents structures and patterns of the data. CTSK has no IF part parameters to tune, which makes the system much faster, but its THEN part is the same as ETSK. Finally, CETSK system is presented as a combination of CTSK and ETSK to study the possibility of further improvements of the systems. The IF parts of TSK, ETSK, and CETSK are tuned by genetic algorithms and their THEN parts are adjusted by the least-squares estimate method. Performance of the systems are studied using 22 datasets in terms of accuracy and runtime. On average, CTSK is 10.82% and 4.84% more accurate than TSK and CETSK; and 91.58% and 92.21% faster than these systems, respectively. CETSK is 6.27% more accurate than TSK, but 6.91% slower because fuzzy clustering and genetic algorithms are jointly employed to tune its IF part whereas only genetic algorithms is used in TSK for this purpose.
Keywords: Fuzzy systems, fuzzy clustering, genetic algorithms, gradient descent algorithm, particle swarm optimization, least-squares estimate method, TSK system, fuzzy numbers.

Keywords

Main Subjects


[1] M. Arefi, Geometric clustering fuzzy regression based on c-means clustering, Iranian Journal of Fuzzy Systems, 22
(2025), 87-101. https://doi.org/10.22111/ijfs.2025.51386.9078
[2] S. Askari, Oil reservoirs classification using fuzzy clustering, International Journal of Engineering, Transactions C:
Aspects, 30 (2017), 1391-1400. https://doi.org/10.5829/idosi.ije.2017.30.09c.12
[3] S. Askari, Fuzzy c-means clustering algorithm for data with unequal cluster sizes and contaminated with noise and
outliers: Review and development, Expert Systems with Applications, 165 (2021), 113856. https://doi.org/10.
1016/j.eswa.2020.113856
[4] S. Askari, Noise-resistant fuzzy clustering algorithm, Granular Computing, 6 (2021), 815-828. https://doi.org/
10.1007/s41066-020-00230-6
[5] S. Askari, N. Montazerin, A high-order multivariable fuzzy time series forecasting algorithm based on fuzzy clustering,
Expert Systems with Applications, 42 (2015), 2121-2135. https://doi.org/10.1016/j.eswa.2014.09.036
[6] S. Askari, N. Montazerin, M. H. F. Zarandi, A clustering based forecasting algorithm for multivariable fuzzy time
series using linear combinations of independent variables, Applied Soft Computing, 35 (2015), 151-160. https:
//doi.org/10.1016/j.asoc.2015.06.028
[7] S. Askari, N. Montazerin, M. H. F. Zarandi, Forecasting semi-dynamic response of natural gas networks to nodal
gas consumptions using genetic fuzzy systems, Energy, 83 (2015), 252-266. https://doi.org/10.1016/j.energy.
2015.02.020
[8] S. Askari, N. Montazerin, M. H. F. Zarandi, Generalized possibilistic fuzzy c-means with novel cluster validity indices
for clustering noisy data, Applied Soft Computing, 53 (2017), 262-283. https://doi.org/10.1016/j.asoc.2016.
12.049
[9] S. Askari, N. Montazerin, M. H. F. Zarandi, Modeling energy flow in natural gas networks using time series disaggregation and fuzzy systems tuned by particle swarm optimization, Applied Soft Computing, 92 (2020), 106332.
https://doi.org/10.1016/j.asoc.2020.106332
[10] S. Askari, N. Montazerin, M. H. F. Zarandi, E. Hakimi, Generalized entropy based possibilistic fuzzy c-means for
clustering noisy data and its convergence proof, Neurocomputing, 219 (2017), 186-202. https://doi.org/10.1016/
j.neucom.2016.09.025
[11] A. Banakar, M. F. Azeem, Parameter identification of TSK neuro-fuzzy models, Fuzzy Sets and Systems, 179
(2011), 62-82. https://doi.org/10.1016/j.fss.2011.05.003
[12] Z. Bian, J. Zhang, Y. Nojima, F. Chung, S. Wang, Hybrid-ensemble-based interpretable TSK fuzzy classifier for
imbalanced data, Information Fusion, 98 (2023), 101845. https://doi.org/10.1016/j.inffus.2023.101845
[13] I. D. Borlea, R. E. Precup, F. Dragan, A. B. Borlea, Centroid update approach to K-means clustering, Advances
in Electrical and Computer Engineering, 17 (2017), 3-10. https://doi.org/10.4316/AECE.2017.04001
[14] O. Cordon, F. Herrera, F. Hoffmann, L. Magdalena, Genetic fuzzy systems, Evolutionary tuning and learning of
fuzzy knowledge bases, Advances in Fuzzy Systems–Applications and Theory, World Scientific, 19 (2001). https:
//doi.org/10.1142/4177
[15] A. Dass, S. Srivastava, R. Kumar, A novel Lyapunov-stability-based recurrent-fuzzy system for the identification
and adaptive control of nonlinear systems, Applied Soft Computing, 137 (2023), 110161. https://doi.org/10.
1016/j.asoc.2023.110161
[16] Z. Deng, Y. Cao, Q. Lou, K. Choi, S. Wang, Monotonic relation-constrained Takagi-Sugeno-Kang fuzzy system,
Information Sciences, 582 (2022), 243-257. https://doi.org/10.1016/j.ins.2021.09.015
[17] M. Fazzolari, B. Gigli, R. Alcal´a, F. Marcelloni, F. Herrera, A study on the application of instance selection techniques
in genetic fuzzy rule-based classification systems: Accuracy-complexity trade-off, Knowledge-Based Systems,
54 (2013), 32-41. https://doi.org/10.1016/j.knosys.2013.07.011
[18] S. Huang, G. Zhao, Z. Weng, S. Ma, Trapezoidal Type-2 fuzzy inference system with tensor unfolding structure
learning method, Neurocomputing, 473 (2022), 54-67. https://doi.org/10.1016/j.neucom.2021.12.011
[19] M. Javadian, R. Vaziri, S. Haghzad Klidbary, A. Malekzadeh, Refining membership degrees obtained from fuzzy Cmeans by re-fuzzification, Iranian Journal of Fuzzy Systems, 17 (2020), 85-104. https://10.22111/ijfs.2020.5408
[20] E. M. Joo, D. Chang, Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning, IEEE Transactions
on Systems, Man, and Cybernetics, 34 (2004), 1478-1489. https://doi.org/10.1109/TSMCB.2004.825938
[21] U. Kilic, E. S. Essiz, M. K. Keles, Binary anarchic society optimization for feature selection, Romanian Journal of
Information Science and Technology, 26 (2023), 351-364. https://doi.org/10.59277/ROMJIST.2023.3-4.08
[22] Z. Mei, T. Zhao, X. Xie, Hierarchical fuzzy regression tree: A new gradient boosting approach to design a TSK
fuzzy model, Information Sciences, 652 (2024), 119740. https://doi.org/10.1016/j.ins.2023.119740
[23] J. Ning, Neural network-based pattern recognition in the framework of edge computing, Romanian Journal of Information Science and Technology, 27 (2024), 106-119. https://doi.org/10.59277/ROMJIST.2024.1.08
[24] H. Ouifak, A. Idri, On the performance and interpretability of Mamdani and Takagi-Sugeno-Kang based neurofuzzy
systems for medical diagnosis, Scientific African, 20 (2023), e01610. https://doi.org/10.1016/j.sciaf.
2023.e01610
[25] T. Pidikiti, Shreedevi, B. Gireesha, M. Subbarao, V. B. M. Krishna, Design and control of Takagi-Sugeno-Kang
fuzzy based inverter for power quality improvement in grid-tied PV systems, Measurement: Sensors, 25 (2023),
100638. https://doi.org/10.1016/j.measen.2022.100638
[26] R. E. Precup, A. T. Nguyen, S. Blazic, A survey on fuzzy control for mechatronics applications, International
Journal of Systems Science, 55 (2024), 771-813. https://doi.org/10.1080/00207721.2023.2293486
[27] B. Qin, F. Chung, Y. Nojima, H. Ishibuchi, S. Wang, Fuzzy rule dropout with dynamic compensation for wide
learning algorithm of TSK fuzzy classifier, Applied Soft Computing, 127 (2022), 109410. https://doi.org/10.
1016/j.asoc.2022.109410
[28] F. Salas-Molina, J. Reig-Mullor, D. Pla-Santamaria, A. Garcia-Bernabeu, A multidimensional approach to rank
fuzzy numbers based on the concept of magnitude, Iranian Journal of Fuzzy Systems, 20 (2023), 137-153. https:
//doi.org/10.22111/ijfs.2023.43939.7738
[29] Y. Shan, S. Li, F. Li, Y. Cui, S. Li, M. Chen, X. He, Fuzzy self-consistent clustering ensemble, Applied Soft
Computing, 151 (2024), 111151. https://doi.org/10.1016/j.asoc.2023.111151
[30] K. Siminski, FuBiNFS–fuzzy biclustering neuro-fuzzy system, Fuzzy Sets and Systems, 438 (2022), 84-106. https:
//doi.org/10.1016/j.fss.2021.07.009
[31] K. Siminski, Prototype based granular neuro-fuzzy system for regression task, Fuzzy Sets and Systems, 449 (2022),
56-78. https://doi.org/10.1016/j.fss.2022.03.001
[32] M. Sugeno, G. Kang, Structure identification of fuzzy model, Fuzzy Sets and Systems, 28 (1988), 15-33. https:
//doi.org/10.1016/0165-0114(88)90113-3
[33] M. Sugeno, T. Yasukawa, A fuzzy logic based approach to qualitative modeling, IEEE Transactions on Fuzzy Systems,
1 (1993), 1-24. https://doi.org/10.1109/TFUZZ.1993.390281
[34] T. Takagi, M. Sugeno, Fuzzy identification of systems and its application to modeling and control, IEEE Transactions
on Systems, Man, and Cybernetics, SMC-15, (1985), 116-132. https://doi.org/10.1109/TSMC.1985.
6313399
[35] A. Tewari, M. U. Macdonald, Knowledge-based parameter identification of TSK fuzzy models, Applied Soft Computing,
10 (2010), 481-489. https://doi.org/10.1016/j.asoc.2009.08.034
[36] D. Wu, J. M. Mendel, Aggregation using the linguistic weighted average and interval Type-2 fuzzy sets, IEEE
Transactions on Fuzzy Systems, 15 (2007), 1145-1161. https://doi.org/10.1109/TFUZZ.2007.896325
[37] R. Xie, S. Wang, A wide interpretable Gaussian Takagi-Sugeno-Kang fuzzy classifier and its incremental learning,
Knowledge-Based Systems, 241 (2022), 108203. https://doi.org/10.1016/j.knosys.2022.108203
[38] H. Yu, L. Jiang, J. Fan, S. Xie, R. Lan, A feature-weighted suppressed possibilistic fuzzy c-means clustering algorithm
and its application on color image segmentation, Expert Systems with Applications, 241 (2024), 122270. https:
//doi.org/10.1016/j.eswa.2023.122270
[39] Y. Zhang, W. Ding, Motor imagery classification via stacking-based Takagi-Sugeno-Kang fuzzy classifier ensemble,
Knowledge-Based Systems, 263 (2023), 110292. https://doi.org/10.1016/j.knosys.2023.110292
[40] Y. Zhang, G. Wang, X. Huang, W. Ding, TSK fuzzy system fusion at sensitivity-ensemble level for imbalanced data
classification, Information Fusion, 92 (2023), 350-362. https://doi.org/10.1016/j.inffus.2022.12.014
[41] Y. Zhang, G. Wang, T. Zhou, X. Huang, S. Lam, J. Sheng, K. Choi, J. Cai, W. Ding, Takagi-Sugeno-Kang
fuzzy system fusion: A survey at hierarchical, wide and stacked levels, Information Fusion, 101 (2024), 101977.
https://doi.org/10.1016/j.inffus.2023.101977