Document Type : Research Paper
Authors
Department of Mathematics, CT. C., Islamic Azad University, Tehran, Iran.
Abstract
This paper presents a new hybrid prediction framework for evaluating student performance in advanced mathematics, thus overcoming the inherent constraints of classic Adaptive Neuro-Fuzzy Inference Systems (ANFIS). To improve predictive accuracy and model interpretability, our method combines ANFIS with advanced gradient boosting techniques, namely XGBoost and LightGBM. The proposed framework integrates fuzzy logic for input space partitioning with localized gradient boosting models as rule outcomes, effectively merging the interpretability of fuzzy systems with the strong non-linear modeling capabilities of machine learning. Comprehensive assessment reveals that both the ANFIS-XGBoost and ANFIS-LightGBM models substantially exceed the traditional ANFIS in various performance parameters. Feature selection, informed by SHAP analysis and XGBoost feature importance metrics, pinpointed essential predictors including the quality of previous mathematics education and core course grades. Enhancements in regression measures further highlight the effectiveness of the hybrid methodology. The findings indicate that the suggested framework provides a reliable and effective alternative for educational institutions to forecast student success, guide focused interventions, and enhance learning outcomes in advanced mathematical fields.
Keywords
- Adaptive Neuro-Fuzzy Inference Systems
- Feature selection
- Hybrid ANFIS-XGBoost model
- Hybrid ANFIS-LightGBM model
Main Subjects
[1] A. Abdi, A. Zandipayam, Prediction of academic performance based on dimensions of academic identity and flourishing among students of the university of medical sciences, Journal of Medical Education Development, 12(35)
(2019), 19-26. https://doi.org/10.29252/edcj.12.35.19
(2019), 19-26. https://doi.org/10.29252/edcj.12.35.19
[2] A. Ab´ın, J. C. N´u˜nez, C. Rodr´ıguez, M. Cueli, T. Garc´ıa, P. Ros´ario, Predicting mathematics achievement in
secondary education: The role of cognitive, motivational, and emotional variables, Frontiers in Psychology, 11
(2020). https://doi.org/10.3389/fpsyg.2020.00876
secondary education: The role of cognitive, motivational, and emotional variables, Frontiers in Psychology, 11
(2020). https://doi.org/10.3389/fpsyg.2020.00876
[3] T. Ahajjam, M. Moutaib, H. Aissa, M. Azrour, Y. Farhaoui, M. Fattah, Predicting students’ final performance using
artificial neural networks, Big Data Mining and Analytics, 5(4) (2022), 294-301. https://doi.org/10.26599/BDMA.
2021.9020030
artificial neural networks, Big Data Mining and Analytics, 5(4) (2022), 294-301. https://doi.org/10.26599/BDMA.
2021.9020030
[4] A. Alshanqiti, A. Namoun, Predicting student performance and its influential factors using hybrid regression
and multi-label classification, IEEE Access, 8 (2020), 203827-203844. https://doi.org/10.1109/ACCESS.2020.
3036572
and multi-label classification, IEEE Access, 8 (2020), 203827-203844. https://doi.org/10.1109/ACCESS.2020.
3036572
[5] T. J. V. Ark, E. Liebtag, N. McClennen, The power of place: Authentic learning through place-based education,
ASCD, (2020).
ASCD, (2020).
[6] R. S. J. D. Baker, K. Yacef, The state of educational data mining in 2009: A review and future visions, Journal of
Educational Data Mining, 1(1) (2009), 3-17. https://doi.org/10.5281/zenodo.3554657
Educational Data Mining, 1(1) (2009), 3-17. https://doi.org/10.5281/zenodo.3554657
[7] M. Castro, E. Exp´osito-Casas, E. L´opez-Mart´ın, L. Lizasoain, E. Navarro-Asencio, J. L. Gaviria, Parental involvement
on student academic achievement: A meta-analysis, Educational Research Review, 14 (2015), 33-46.
https://doi.org/10.1016/j.edurev.2015.01.002
on student academic achievement: A meta-analysis, Educational Research Review, 14 (2015), 33-46.
https://doi.org/10.1016/j.edurev.2015.01.002
[8] P. Chakurkar, D. Vora, An integrated deep learning and fuzzy logic system for road crack severity analysis, and
pedestrian fall risk prediction, Iranian Journal of Fuzzy Systems, 22(6) (2025), 103-123. https://doi.org/10.
22111/ijfs.2025.52137.9268
pedestrian fall risk prediction, Iranian Journal of Fuzzy Systems, 22(6) (2025), 103-123. https://doi.org/10.
22111/ijfs.2025.52137.9268
[9] T. Chen, C. Guestrin, XGBoost: A scalable tree boosting system, Proceedings of the 22nd ACM SIGKDD International
Conference on Knowledge Discovery and Data Mining, (2016), 785-794. https://doi.org/10.1145/
2939672.293978
Conference on Knowledge Discovery and Data Mining, (2016), 785-794. https://doi.org/10.1145/
2939672.293978
[10] X. Chen, B. Li, A. C. Worthington, Higher moments and US industry returns: Realized skewness and kurtosis,
Review of Accounting and Finance, 20(1) (2021), 13-22. https://doi.org/10.1108/RAF-06-2020-0171
Review of Accounting and Finance, 20(1) (2021), 13-22. https://doi.org/10.1108/RAF-06-2020-0171
[11] F. Cheng, Y. Liu, Y. Jia, Evaluation of students’ performance during the academic period using expert systems with
applications: The XGBoost classifier-enhanced AEO hybrid model, Expert Systems with Applications, 238 (2024),
122136. https://doi.org/10.1016/j.eswa.2023.122136
applications: The XGBoost classifier-enhanced AEO hybrid model, Expert Systems with Applications, 238 (2024),
122136. https://doi.org/10.1016/j.eswa.2023.122136
[12] H. J. Cho, M. R. Melloch, C. Levesque-Bristol, Enhanced student perceptions of learning and performance using
concept-point-recovery teaching sessions: A mixed-method approach, International Journal of STEM Education, 8(1)
(2021), 1-17. https://doi.org/10.1186/s40594-021-00276-1
concept-point-recovery teaching sessions: A mixed-method approach, International Journal of STEM Education, 8(1)
(2021), 1-17. https://doi.org/10.1186/s40594-021-00276-1
[13] P. S. Deri, S. Cahyadi, E. Susiati, How teacher support affects student engagement in learning math, Jurnal Neo
Konseling, 5(1) (2023), 21. https://doi.org/10.24036/00713kons2023
Konseling, 5(1) (2023), 21. https://doi.org/10.24036/00713kons2023
[14] A. Diseth, F. K. S. Mathisen, O. Samdal, A comparison of intrinsic and extrinsic motivation among lower and upper
secondary school students, Educational Psychology, 40(8) (2020), 961-980. https://doi.org/10.1080/01443410.
2020.1778640
secondary school students, Educational Psychology, 40(8) (2020), 961-980. https://doi.org/10.1080/01443410.
2020.1778640
[15] J. Friedman, Greedy function approximation: A gradient boosting machine, Annals of Statistics, 29(5) (2001),
1189-1232. https://doi.org/10.1214/aos/1013203451
1189-1232. https://doi.org/10.1214/aos/1013203451
[16] J. M. Froiland, M. L. Davison, The longitudinal influences of peers, parents, motivation, and mathematics coursetaking
on high school math achievement, Learning and Individual Differences, 50 (2016), 252-259. https://doi.
org/10.1016/j.lindif.2016.07.012
on high school math achievement, Learning and Individual Differences, 50 (2016), 252-259. https://doi.
org/10.1016/j.lindif.2016.07.012
[17] M. S. Hagger, K. Hamilton, Grit and self-discipline as predictors of effort and academic attainment, British Journal
of Educational Psychology, 89(2) (2018), 324-342. https://doi.org/10.1111/bjep.12241
of Educational Psychology, 89(2) (2018), 324-342. https://doi.org/10.1111/bjep.12241
[18] S. Hakkal, A. A. Lahcen, XGBoost to enhance learner performance prediction, Computers and Education: Artificial
Intelligence, (2024), Article 100254. https://doi.org/10.1016/j.caeai.2024.100254
Intelligence, (2024), Article 100254. https://doi.org/10.1016/j.caeai.2024.100254
[19] S. Hwang, T. Son, Students’ attitude toward mathematics and its relationship with mathematics achievement,
Journal of Education and Elearning Research, 8(3) (2021), 272-280. https://doi.org/10.20448/journal.509.
2021.83.272.280
Journal of Education and Elearning Research, 8(3) (2021), 272-280. https://doi.org/10.20448/journal.509.
2021.83.272.280
[20] J. S. R. Jang, ANFIS: Adaptive-network-based fuzzy inference system, IEEE Transactions on Systems, Man, and
Cybernetics, 23(3) (1993), 665-685. https://doi.org/10.1109/21.256541
Cybernetics, 23(3) (1993), 665-685. https://doi.org/10.1109/21.256541
[21] G. Ke, Q. Meng, T. Finley, T. Wang, W. Chen, W. Ma, T. Y. Liu, LightGBM: A highly efficient gradient boosting
decision tree, Advances in Neural Information Processing Systems, 30 (2017).
decision tree, Advances in Neural Information Processing Systems, 30 (2017).
[22] D. Ko¸c, A. N. El¸ci, The effect of mathematical modeling instruction on pre-service primary school teachers’ problemsolving skills and attitudes towards mathematics, Journal of Pedagogical Research, 6(4) (2022), 111-129. https:
//doi.org/10.33902/JPR.202217783
//doi.org/10.33902/JPR.202217783
[23] M. A. Kraft, Teacher effects on complex cognitive skills and social-emotional competencies, Journal of Human
Resources, 54(1) (2017), 1-36. https://doi.org/10.3368/jhr.54.1.0916.8265R3
Resources, 54(1) (2017), 1-36. https://doi.org/10.3368/jhr.54.1.0916.8265R3
[24] A. A. S. Maharani, N. Suarna, I. Ali, D. Solihudin, Application of decision tree algorithm to improve student
learning pattern classification model at Sempoa Sip Perjuangan, Journal of Artificial Intelligence and Engineering
Applications, 4(2) (2025), 1399-1403. https://doi.org/10.59934/jaiea.v4i2.915
learning pattern classification model at Sempoa Sip Perjuangan, Journal of Artificial Intelligence and Engineering
Applications, 4(2) (2025), 1399-1403. https://doi.org/10.59934/jaiea.v4i2.915
[25] C. M´arquez-Vera, A. Cano, C. Romero, S. Ventura, Predicting student failure at school using genetic programming
and different data mining approaches with high-dimensional and imbalanced data, Applied Intelligence, 38 (2013),
315-330. https://doi.org/10.1007/s10489-012-0374-8
and different data mining approaches with high-dimensional and imbalanced data, Applied Intelligence, 38 (2013),
315-330. https://doi.org/10.1007/s10489-012-0374-8
[26] S. H. Mercer, L. M. Nellis, R. S. Mart´ınez, M. Kirk, Supporting the students most in need: Academic self-efficacy
and perceived teacher support in relation to within-year academic growth, Journal of School Psychology, 49(3) (2011),
323-338. https://doi.org/10.1016/j.jsp.2011.03.006
and perceived teacher support in relation to within-year academic growth, Journal of School Psychology, 49(3) (2011),
323-338. https://doi.org/10.1016/j.jsp.2011.03.006
[27] H. C. Nguyen, Factors affecting student engagement: A model of how and why students learn, EDULEARN
Proceedings, (2019). https://doi.org/10.21125/edulearn.2019.0578
Proceedings, (2019). https://doi.org/10.21125/edulearn.2019.0578
[28] M. K. Nyatsikor, E. Sosu, P. Mtika, D. Robson, Teacher characteristics and children’s educational attainment
in Ghana: Do some teacher characteristics matter more for children attending disadvantaged schools, Frontiers in
Education, 5 (2020). https://doi.org/10.3389/feduc.2020.00162
in Ghana: Do some teacher characteristics matter more for children attending disadvantaged schools, Frontiers in
Education, 5 (2020). https://doi.org/10.3389/feduc.2020.00162
[29] F. Ofori, E. Maina, R. Gitonga, Using machine learning algorithms to predict students’ performance and improve
learning outcomes: A literature-based review, Journal of Information and Technology, 4(1) (2020), 33-55.
learning outcomes: A literature-based review, Journal of Information and Technology, 4(1) (2020), 33-55.
[30] M. Priyadharshini, B. Vanathi, Enhance data security with efficient anomaly detection in a real network environment,
Iranian Journal of Fuzzy Systems, 22(6) (2025), 1-20. https://doi.org/10.22111/ijfs.2025.49590.8748
Iranian Journal of Fuzzy Systems, 22(6) (2025), 1-20. https://doi.org/10.22111/ijfs.2025.49590.8748
[31] M. A. Quran, Efficient and effective anomaly detection in autonomous vehicles: A combination of gradient boosting
and ANFIS algorithms, International Journal of Fuzzy Systems, 27 (2025), 1421-1437. https://doi.org/10.1007/
s40815-024-01843-8
and ANFIS algorithms, International Journal of Fuzzy Systems, 27 (2025), 1421-1437. https://doi.org/10.1007/
s40815-024-01843-8
[32] F. H. Ramadhan, A. D. Lestari, Support vector machine on two-class classification problem to determine an otaku,
Journal of Student Research Exploration, 3(1) (2025), 17-22. https://doi.org/10.52465/josre.v3i1.358
Journal of Student Research Exploration, 3(1) (2025), 17-22. https://doi.org/10.52465/josre.v3i1.358
[33] C. Romero, S. Ventura, Educational data mining: A review of the state of the art, IEEE Transactions on Systems,
Man, and Cybernetics: Part C (Applications and Reviews), 40(6) (2010), 601-618. https://doi.org/10.1109/
TSMCC.2010.2053532
Man, and Cybernetics: Part C (Applications and Reviews), 40(6) (2010), 601-618. https://doi.org/10.1109/
TSMCC.2010.2053532
[34] D. Sabanal, M. Gako, H. D. Torre, J. Sabanal, et al, Predictive model for college students’ performance in higher
mathematics, Social Sciences and Humanities Open, 10 (2024), 101134. https://doi.org/10.1016/j.ssaho.2024.
101134
mathematics, Social Sciences and Humanities Open, 10 (2024), 101134. https://doi.org/10.1016/j.ssaho.2024.
101134
[35] T. S´anchez, R. Gilar-Corbi, J. L. Castej´on, J. Vidal, J. Le´on, Students’ evaluation of teaching and their academic
achievement in a higher education institution of Ecuador, Frontiers in Psychology, 11 (2020), 233. https://doi.
org/10.3389/fpsyg.2020.00233
achievement in a higher education institution of Ecuador, Frontiers in Psychology, 11 (2020), 233. https://doi.
org/10.3389/fpsyg.2020.00233
[36] T. Shen, Y. Zhang, A performance prediction model for newly enrolled university students based on the fusion of
K-Means and LightGBM algorithms, 2024 3rd International Conference on Cloud Computing, Big Data Application
and Software Engineering (CBASE), (2024), 40-44. https://doi.org/10.1109/CBASE64041.2024.10824518
K-Means and LightGBM algorithms, 2024 3rd International Conference on Cloud Computing, Big Data Application
and Software Engineering (CBASE), (2024), 40-44. https://doi.org/10.1109/CBASE64041.2024.10824518
[37] T. O. Soyoye, T. Chen, R. Hill, Predicting academic performance of university students using adaptive neuro fuzzy
inference system (ANFIS)-subtractive clustering algorithm (ANFIS-SC): A case study in the UK, UK Workshop on
Computational Intelligence, (2024), 315-333. https://doi.org/10.1007/978-3-031-78857-4-24
inference system (ANFIS)-subtractive clustering algorithm (ANFIS-SC): A case study in the UK, UK Workshop on
Computational Intelligence, (2024), 315-333. https://doi.org/10.1007/978-3-031-78857-4-24
[38] M. Sugeno, K. Tanaka, Successive identification of a fuzzy model and its applications to prediction of a complex
system, Fuzzy Sets and Systems, 42(3) (1991), 315-334. https://doi.org/10.1016/0165-0114(91)90110-C
system, Fuzzy Sets and Systems, 42(3) (1991), 315-334. https://doi.org/10.1016/0165-0114(91)90110-C
[39] R. Wakhata, S. Balimuttajjo, V. Mutarutinya, Relationship between students’ attitude towards, and performance
in mathematics word problems, PLoS ONE, 19(2) (2024), e0278593. https://doi.org/10.1371/journal.pone.
0278593
in mathematics word problems, PLoS ONE, 19(2) (2024), e0278593. https://doi.org/10.1371/journal.pone.
0278593
[40] C. Wang, L. Chang, T. Liu, Predicting student performance in online learning using a highly efficient gradient
boosting decision tree, International Conference on Intelligent Information Processing, (2022), 508-521. https:
//doi.org/10.1007/978-3-031-03948-5-41
boosting decision tree, International Conference on Intelligent Information Processing, (2022), 508-521. https:
//doi.org/10.1007/978-3-031-03948-5-41
[41] Y. M. Yesuf, S. A. Kebede, A. Zewdu, D. M. Gebru, Predictors of high school students’ mathematics self-efficacy
in Addis Ababa: The importance of educational expectations, Frontiers in Psychology, 13 (2023), 1-10. https:
//doi.org/10.3389/fpsyg.2022.927757
in Addis Ababa: The importance of educational expectations, Frontiers in Psychology, 13 (2023), 1-10. https:
//doi.org/10.3389/fpsyg.2022.927757
)