Comparing the Performance of Decision Tree and Artificial Neural Network in the Classification of National Exam Candidates

Document Type : Original Article

Authors

1 Assistant Professor, Department of Statistics, University of Sistan and Baluchestan,Sistan and Baluchestan, Zahedan, Iran

2 Associate Professor, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

3 Ph.D. Candidate, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

10.22034/emes.2023.545992.2335

Abstract

Objective: Comparison of capabilities of three different algorithms of decision tree and neural network model in order to choose the appropriate classification model to evaluate the performance of national exam candidates.
Methods: It is based on a quantitative approach and a survey method, and the variables of gender, academic records and balance scores of each course were used as effective variables in the classification.
Results: Considering all the variables without gender based on the neural network model, it was found that the specialized courses of mathematics, physics and chemistry, followed by the general courses of Persian and religion respectively, are the most important in the classification. The distance between the diploma and the national exam had the least effect. It was also found that if only variables related to test courses are considered, the order of importance of chemistry and physics courses will be shifted.
Conclusion: Based on the overall accuracy index, the neural network model algorithm with an accuracy greater than 0.95 has a higher performance than the decision tree algorithms. On the other hand, the inclusion of educational background variables has had a favorable effect on the accuracy of the neural network algorithm.

Keywords

Main Subjects


References

Abdulrazzaq, N., Kamal, M., Muhsen, A., Tareq, A., Al Zubaidi, R., & Al Mousawi, A. (2017). Academic Failure And Student's Viewpoint: the Influence of Individual, Internal and External Organizational Factors.
Abu Tair, M. M., & El-Halees, A. M. (2012). Mining educational data to improve students' performance: a case study. International Journal of Information, 2(2).
Afroz, G. (1375). Educational Psychology. Retrieved from
Angeline, D. M. D. (2013). Association rule generation for student performance analysis using apriori algorithm. The SIJ Transactions on Computer Science Engineering & its Applications (CSEA), 1(1), 12-16 .
Bakhshayesh, A. (1393). Investigating the relationship between thinking styles and learning strategies with academic performance in students. Research Quarterly in Curriculum Planning, 11(14), 135 - 146 .
Banik, P., & Kumar, B. (2019). Impact of information literacy skill on students’ academic performance in Bangladesh. International Journal of European Studies, 3(1), 27-33 .
Bin Mat, U., Buniyamin, N., Arsad, P. M., & Kassim, R. (2013). An overview of using academic analytics to predict and improve students' achievement: A proposed proactive intelligent intervention. Paper presented at the 2013 IEEE 5th conference on engineering education (ICEED).
Christian, T. M., & Ayub, M. (2014). Exploration of classification using NBTree for predicting students' performance. Paper presented at the 2014 international conference on data and software engineering (ICODSE).
Demuth, H., & Beale, M. (2000). Neural network toolbox user’s guide.
Eskandari, F. (1395). Categorical data analysis. Tehran: Allameh Tabatabai University.
Fataa, L., Azari, S., Baradaran, H., & Atlasi, R. (1392). A systematic review of the causes of academic failure of medical students. Journal of development steps in medical education, 10 (2), 31 - 38.
Golshani-Foomani, M. (1375). Sociology of Education: shifteh.
Applied Statistics Research Group. (1394). Constructing the total score of the national exam in the experimental group of mathematical and technical sciences in 2013 based on the actual distribution of scores and comparing it with the current method. Retrieved from Tehran
Han, J., Pei, J., & Kamber, M. (2011). Data mining: concepts and techniques: Elsevier.
Hassoun, M. H. (1995). Fundamentals of artificial neural networks: MIT press.
Ibrahim, Z., & Rusli, D. (2007). Predicting students’ academic performance: comparing artificial neural network, decision tree and linear regression. Paper presented at the 21st Annual SAS Malaysia Forum, 5th September.
Jishan, S. T., Rashu, R. I., Haque, N., & Rahman, R. M. (2015). Improving accuracy of students’ final grade prediction model using optimal equal width binning and synthetic minority over-sampling technique. Decision Analytics, 2(1), 1-25.
Kazeminezhad, M., Etemad-Shahidi, A., & Mousavi, S. (2005). Application of fuzzy inference system in the prediction of wave parameters. Ocean Engineering, 32(14-15), 1709-1725.
Lawrence, A., & Deepa, T. (2013). Emotional Intelligence and Academic Achievement of High School Students in Kanyakumari District. Online submission, 3(2), 101-107.
Li, K. F., Rusk, D., & Song, F. (2013). Predicting student academic performance. Paper presented at the 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive Systems.
Mau, W. C. (1997). Parental influences on the high school students' academic achievement: A comparison of Asian immigrants, Asian Americans, and White Americans. Psychology in the Schools, 34(3), 267-277 .
Meit, S. S., Borges, N. J., Cubic, B. A., & Seibel, H. R. (2004). Personality Differences in Incoming Male and Female Medical Students. Online submission.
Menhaj, M. (1397). Basics of Neural Networks - Volume One: Computational Intelligence. Tehran: Amirkabir University of Technology.
Meshkani, A., & Naazemi, A. (1388). An introduction to data mining. Mashhad: Ali Meshkani Publications in cooperation with Islamic Azad University, Neyshabur branch.
Mitchell, T. M. (1997). Does machine learning really work? AI magazine, 18(3), 11-11 .
Navidi, A. (1382). Investigating the joint and specific contribution of previous academic performance variables, academic self-concept and general intelligence in predicting students' academic progress. education and training, 19 (4), 97 - 129.
Oladokun, V., Adebanjo, A., & Charles-Owaba, O. (2008). Predicting students academic performance using artificial neural network: A case study of an engineering course.
Osmanbegovic, E., & Suljic, M. (2012). Data mining approach for predicting student performance. Economic Review: Journal of Economics and Business, 10(1), 3-12.
Patel, P., & Mistry, K. (2015). A review: Text classification on social media data. IOSR Journal of Computer Engineering, 17(1), 80-84.
Rahimi, M. (1387). Investigating the factors related to the academic decline of female high school students in Region 14. (Master's thesis), University of Tehran.,
Ramesh, V., Parkavi, P., & Ramar, K. (2013). Predicting student performance: a statistical and data mining approach. International journal of computer applications, 63(8).
Sadeghi-Jafari, J., Roshan, M., & Shakoori-Ganjavi, H. (1390). A comparative study of the academic performance of students of self-sacrifice quotas and regional quotas in daily courses of state universities. Higher education letter, 3 (10), 51- 75.
Sanie-Abadeh, M., Mahmoodi, S., & Taherpoor, M.(1391). Applied data mining. Tehran: need for knowledge.
Shahiri, A. M., & Husain, W. (2015). A review on predicting student's performance using data mining techniques. Procedia Computer Science, 72, 414-422.
Shahrabi, J., & ZolghadreShojae, A. (1390). Advanced data mining concepts and algorithms: Jihad University Publications of Amir Kabir University.
Simsek, A., & Balaban, J. (2010). Learning strategies of successful and unsuccessful university students. Contemporary Educational Technology, 1(1), 36-45.
Talebi, A., & Akbari, Z. (1392). Investigating the effectiveness of the decision tree model in estimating river suspended sediments (Case study: Ilam Dam Basin. Agricultural sciences and techniques and natural resources, 63, 109 - 121.
WANG, & LEE. (2006). Constructing a fuzzy decision tree by integrating fuzzy sets and entropy. WSEAS transactions on information science and applications.
Wendler, T., & Gröttrup, S. (2021). Data mining with SPSS modeler: theory, exercises and solutions: Springer.
Widyastuti, T., Kurniawan, A., & Chandra, N. P. (2017). Coping Strategies on Students After Experiencing Academic Failure: An Indigenous Study in Javanese Context. Work Pap Ser, 3, 22-26.