Predicting Kurdish EFL University Learners' Oral Reading Fluency Using Support Vector Machine

Araz Bashar Mohammed Ali; Jwan Abdulkhaliq Mohammed Ali; Amera Ismail Melhum

doi:10.33193/IJoHSS.39.2022.492

Araz Bashar Mohammed Ali Asst. Lecturer in Basic Education Department, Duhok University, Kurdistan Region- Iraq
Jwan Abdulkhaliq Mohammed Ali Lecturer in Computer Science Department, Duhok University, Kurdistan Region- Iraq
Amera Ismail Melhum Asst. Prof in Computer Science Department, Duhok University, Kurdistan Region- Iraq

DOI: https://doi.org/10.33193/IJoHSS.39.2022.492

الكلمات المفتاحية: Oral Reading Fluency, Support Vector Machine, MDFS, Machine Learning

الملخص

Investigating learners’ English Oral Reading Fluency (ORF) in the contexts where English is used as a foreign language (EFL) or second language (ESL) has recently become a trending subject. This study was carried out to predict the ORF of 100 Kurdish EFL university students of the English language department, college of Basic Education, university of Duhok, Iraq in 2020 during covid-19 using the support vector machine (SVM) technique. This technique is one of the supervised machine learning techniques, and it is considered the most powerful algorithm in machine learning in terms of high accuracy; therefore, it was employed in this study. Participants’ ORF was measured by two experienced human raters using the four dimensions of the Multidimensional Fluency Scale (MDFS) including expression & volume, phrasing, smoothness, and pacing, which were used as the input variables to predict the ORF as an output. Six kernels of the SVM were used in the prediction process. The results indicated that the highest accuracy of testing result was obtained on the use of SVM Linear kernel with a value of 96.2%. Confusion matrix was utilized to assess the outcomes of data classification. The results of precision, recall, and F1-score were the highest for the SVM linear kernel and their values were the same for all performance metrics with a value of 96.1%. Accordingly, it can be concluded that the performance of the SVM is considerably accurate in predicting the oral reading fluency.

المراجع

1. Amarappa, S. and Sathyanarayana, S.V. (2014). Data classification using Support vector Machine (SVM), a simplified approach. Int. J. Electron. Comput. Sci. Eng, 3: 435-445.
2. Ardington, C., Wills, G., Pretorius, E., Mohohlwane, N. and Menendez, A. (2021). Benchmarking oral reading fluency in the early grades in Nguni languages. International Journal of Educational Development, 84, p.102433.
3. Bailly, G., Godde, E., Piat-Marchand, A.L. and Bosse, M.L. (2022). Automatic assessment of oral readings of young pupils. Speech Communication, 138: 67-79.
4. Beck, J.E., Jia, P.E.N.G. and Mostow, J.A.C.K. (2004). Automatically assessing oral reading fluency in a computer tutor that listens. Technology Instruction Cognition and Learning, 2: 61-82.
5. Bolanos, D., Cole, R.A., Ward, W.H., Tindal, G.A., Schwanenflugel, P.J. and Kuhn, M.R. (2013). Automatic assessment of expressive oral reading. Speech Communication, 55(2): 221-236.
6. Cheng, J. (2018). Real-Time Scoring of an Oral Reading Assessment on Mobile Devices. Grantee Submission.
7. Day, R. R. & Yamanaka, J. (2007). Cover to cover1 reading comprehension and fluency. Oxford University Press.
8. Grabe, W. (2010). Fluency in reading—thirty-five years later. Reading in a Foreign Language, 22 (1): 71-83.
9. Haryanto, A.W. and Mawardi, E.K. (2018), September. Influence of word normalization and chi-squared feature selection on support vector machine (svm) text classification. In 2018 International Seminar on Application for Technology of Information and Communication (pp. 229-233). IEEE.
10. Ja’afar, H., Othman, W.M., Kesevan, H.V. and Budi, M.S. (2021). Enhancing Oral Reading Fluency (ORF) Through Computer Assisted Repeated Reading (CARR). Asian Journal of University Education, 17(1): 207-221.
11. Kecman, V. (2005). Support vector machines–an introduction. In Support vector machines: theory and applications (pp. 1-47). Springer, Berlin, Heidelberg.
12. Luo, H. and Paal, S.G. (2022). A data‐free, support vector machine‐based physics‐driven estimator for dynamic response computation. Computer‐Aided Civil and Infrastructure Engineering.
13. Markoulidakis, I., Rallis, I., Georgoulas, I., Kopsiaftis, G., Doulamis, A. and Doulamis, N. (2021). Multiclass Confusion Matrix Reduction Method and Its Application on Net Promoter Score Classification Problem. Technologies, 9(4), p.81.
14. Morrison, T., G. & Wilcox, B. (2020). Assessing expressive oral reading fluency. Education Sciences, 10 (59): 1-13.
15. Nation, P. (2014). Developing fluency. In T. Muller, J. Adamson, P. Brown, S. Herder. Exploring EFL Fluency in Asia. (pp. 11-25). Palgrave Macmillan.
16. Panja, S., Chatterjee, A. and Yasmin, G. (2018). July. Kernel Functions of SVM: A Comparison and Optimal Solution. In International Conference on Advanced Informatics for Computing Research (pp. 88-97). Springer, Singapore.
17. Panup, W., Ratipapongton, W. and Wangkeeree, R. (2022). A novel twin support vector machine with generalized pinball loss function for pattern classification. Symmetry, 14(2), p.289.
18. Pisner, D.A. and Schnyer, D.M. (2020). Support vector machine. In Machine learning (pp.101-121). Academic Press.
19. Rasinski, T. V. (2004). Assessing reading fluency. Pacific Resources for Education and Learning (PREL).

20. Samuels, J. (2012). Reading fluency: Its past, present and future. In T. Rasinski, C. Blachowicz, &K. Lems (Eds.), Fluency instruction: Research-based best practices (pp.7-20). New York, NY: The Guilford Press.
21. Savas, C. and Dovis, F. (2019). The impact of different kernel functions on the performance of scintillation detection based on support vector machines. Sensors, 19(23), p.5219.
22. Sen, J., Mehtab, S. and Engelbrecht, A. (2021). Machine Learning: Algorithms, Models and Applications. BoD–Books on Demand.
23. Varol, H.A., Mani, S., Compton, D.L., Fuchs, L.S. and Fuchs, D. (2009). Early prediction of reading disability using machine learning. In AMIA annual symposium proceedings (Vol. 2009, p. 667). American Medical Informatics Association.