Support vector weighted fuzzy regression

Document Type : Research Paper

Authors

1 University of Sistan and Baluchestan, Zahedan, Iran

2 University of Tehran, Tehran, Iran

3 Sapienza University of Rome, Piazzale Aldo Moro, Rome, Italy

4 Department of Statistics, Faculty of Mathematical Sciences and Statistics, University of Birjand, Birjand, Iran

10.22111/ijfs.2026.54371.9634

Abstract

Based on the idea of Support Vector Machine (SVM) methodology, a new robust support vector linear regression modelling known as Support Vector Weighted Fuzzy Regression (SVWFR) is introduced, for the case when the values of response variable are fuzzy rather than crisp. The extension of the proposed method to the nonlinear case is investigated, too. In the proposed approach, a weighted operation is utilized to improve the robustness of usual support vector fuzzy regression models by assigning weights to the support hyperplanes constraints. While the fuzzy machine learning-based models are typically sensitive to outliers, the advantages of the proposed models are their robustness with respect to outlier data. The efficiency and applicability of the proposed models are investigated by using three data sets: a synthetic dataset including outliers, a textile engineering data set, and a stress-test simulation with artificially introduced anomalies. Across all cases, the introduced models consistently outperformed current fuzzy regression approaches, based on three well-known goodness of fit indices. Sensitivity analysis of nonlinear SVWFR parameters is examined, too.

Keywords

Main Subjects

References

[1] A. R. Arabpour, M. Tata, Estimating the parameters of a fuzzy linear regression model, Iranian Journal of Fuzzy
Systems, 5(2) (2008), 1-19.
[2] M. Arefi, Quantile fuzzy regression based on fuzzy outputs and fuzzy parameters, Soft Computing, 24 (2020), 311-320.
https://doi.org/10.1007/s00500-019-04424-2
[3] M. Arefi, S. M. Taheri, Weighted similarity measure on interval-valued fuzzy sets and its application to pattern
recognition, Iranian Journal of Fuzzy Systems, 11(5) (2014), 67-79.
[4] M. Asadollahi, M. G. Akbari, G. Hesamian, M. Arefi, A robust support vector regression with exact predictors and
fuzzy responses, International Journal of Approximate Reasoning, 132 (2021), 206-225. https://doi.org/10.1016/
j.ijar.2021.02.006
[5] J. Chachi, A weighted least-squares fuzzy regression for crisp input-fuzzy output data, IEEE Transactions on Fuzzy
Systems, 27(4) (2019), 739-748. https://doi.org/10.1109/TFUZZ.2018.2868554
[6] J. Chachi, S. M. Taheri, P. D’Urso, Fuzzy regression analysis based on M-estimates, Expert Systems with Applications,
187 (2022), 115891. https://doi.org/10.1016/j.eswa.2021.115891
[7] P. T. Chang, E. Stanley Lee, A generalized fuzzy weighted least-squares regression, Fuzzy Sets and Systems, 82
(1996), 289-298. https://doi.org/10.1016/0165-0114(95)00284-7
[8] P. Diamond, Fuzzy least squares, Information Sciences, 46(3) (1988), 141-157. https://doi.org/10.1016/
0020-0255(88)90047-3
[9] P. D’Urso, Linear regression analysis for fuzzy/crisp input and fuzzy/crisp output data, Computational Statistics
and Data Analysis, 42(1-2) (2003), 47-72. https://doi.org/10.1016/S0167-9473(02)00117-2
[10] P. D’Urso, J. Chachi, OWA fuzzy regression, International Journal of Approximate Reasoning, 142 (2022), 430-450.
https://doi.org/10.1016/j.ijar.2021.12.009
[11] P. D’Urso, T. Gastaldi, A least-squares approach to fuzzy linear regression analysis, Computational Statistics and
Data Analysis, 34(4) (2000), 427-440. https://doi.org/10.1016/S0167-9473(99)00109-7
[12] P. D’Urso, R. Massari, Weighted least squares and least median squares estimation for the fuzzy linear regression
analysis, Metron, 71 (2013), 279-306. https://doi.org/10.1007/s40300-013-0025-9
[13] P. D’Urso, R. Massari, A. Santoro, Robust fuzzy regression analysis, Information Sciences, 181(19) (2011), 4154-
4174. https://doi.org/10.1016/j.ins.2011.04.031
[14] B. Gu, W. S. Sheng, Z. Wang, D. Ho, S. Osman, S. Li, Incremental learning for v-support vector regression, Neural
Networks, 67 (2015), 140-150. https://doi.org/10.1016/j.neunet.2015.03.013
[15] S. R. Gunn, Support vector machines for classification and regression, ISIS Technical Report, 14(1) (1998), 5-16.
[16] P. Y. Hao, J. H. Chiang, Fuzzy regression analysis by support vector learning approach, IEEE Transactions on
Fuzzy Systems, 16(2) (2008), 428-441. https://doi.org/10.1109/TFUZZ.2007.896359
[17] T. Hastie, R. Tibshirani, J. Friedman, The elements of statistical learning, Springer New York, NY, (2008).
https://doi.org/10.1007/978-0-387-84858-7
[18] D. H. Hong, C. Hwang, Support vector fuzzy regression machines, Fuzzy Sets and Systems, 138(1) (2003), 271-281.
https://doi.org/10.1016/S0165-0114(02)00514-6
[19] G. Jin, F. Z. Wen, W. Cheng, G. W. Ping, L. X. Ming, C. M. Zhen, A minimum-of-maximum relative error support
vector machine for simultaneous reverse prediction of concrete components, Computers and Structures, 172 (2016),
59-70. https://doi.org/10.1016/j.compstruc.2016.05.003
[20] C. Kao, C. Chyu, A fuzzy linear regression model with better explanatory power, Fuzzy Sets and Systems, 126(3)
(2002), 401-409. https://doi.org/10.1016/S0165-0114(01)00069-0
[21] A. H. Khammar, M. Arefi, M. G. Akbari, A robust least squares fuzzy regression model based on kernel function,
Iranian Journal of Fuzzy Systems, 17(4) (2020), 105-119. https://doi.org/10.22111/ijfs.2020.5230
[22] A. H. Khammar, M. Arefi, M. G. Akbari, A general approach to fuzzy regression models based on different loss
functions, Soft Computing, 25 (2021), 835-849. https://doi.org/10.1007/s00500-020-05441-2
[23] J. Luo, Y. Zheng, T. Hong, A. Luo, X. Yang, Fuzzy support vector regressions for short-term load forecasting,
Fuzzy Optimization and Decision Making, 23 (2024), 363-385. https://doi.org/10.1007/s10700-024-09425-x+
[24] L. Nguyen, Tutorial on support vector machine, Applied and Computational Mathematics, 6(4-1) (2017), 1-15.
https://doi.org/10.11648/j.acm.s.2017060401.11
[25] Z. Qin, Q. Li, An uncertain support vector machine with imprecise observations, Fuzzy Optimization and Decision
Making, 22 (2023), 611-629. https://doi.org/10.1007/s10700-022-09404-0
[26] H. Tanaka, S. Uejima, K. Asai, Fuzzy linear regression model, Proc. Int. Conf. Appl. Syst. Res. Cybern., Acapulco,
Mexico, (1980), 12-15.
[27] H. Tanaka, S. Uejima, K. Asai, Linear regression analysis with fuzzy model, IEEE Transactions on Systems Man
Cybernet, 12(6) (1982), 903-907. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=4308925
[28] H. Tavanai, S. M. Taheri, M. Nasiri, Modeling of color yield in polyethylene terephthalate dyeing with statistical
and fuzzy regression, Iranian Polymer Journal, 14(11) (2005), 954-968.
[29] V. N. Vapnik, Statistical learning theory, Springer New York, NY, (1998). https://doi.org/10.1007/
978-1-4757-3264-1
[30] Wolfram Research, Inc., Mathematica 10.2, Wolfram Research, Inc. Champaign, Illinois, (2015).
[31] C. C. Yao, P. T. Yu, Fuzzy regression based on asymmetric support vector machines, Applied Mathematics and
Computation, 182(1) (2006), 175-193. https://doi.org/10.1016/j.amc.2006.03.046
[32] C. Yongqi, Least squares support vector fuzzy regression, Energy Procedia, 17(Part A) (2012), 711-716. https:
//doi.org/10.1016/j.egypro.2012.02.160
[33] W. Zeng, Q. Feng, J. Li, Fuzzy least absolute linear regression, Applied Soft Computing, 52 (2017), 1009-1019.
https://doi.org/10.1016/j.asoc.2016.09.029
[34] H. J. Zimmermann, Fuzzy set theory and its applications, 4th ed., Kluwer Nihoff, Boston, Springer Dordrecht,
(2001). https://doi.org/10.1007/978-94-010-0646-0
Iranian Journal of Fuzzy Systems
Volume 23, Issue 2
March and April 2026
Pages 177-195

Files

Share

How to cite

Statistics