Investigating EFL students’ linguistic problems using Grammarly as automated writing evaluation feedback

Anna Riana Suryanti Tambunan, Widya Andayani, Winda Setia Sari, Fauziah Khairani Lubis

Abstract


A plethora of previous studies has shown that corrective feedback can benefit students to progress in their learning. Due to technological advancement, there is a need to investigate the profile of corrective feedback to students’ writing via automated writing evaluation (AWE), particularly in the Indonesian higher education context. Therefore, this research aims to employ an AWE platform, Grammarly, to investigate the Indonesian English as a foreign language (EFL) students’ writing profiles in spelling, grammar, punctuation, enhancement suggestion, sentence structure, and style check. This ex post facto study explored the assignment written by 54 fourth-semester English department students enrolled in an academic writing course at an Indonesian university. The students’ writing profiles were classified, identified, and categorized using the Grammarly platform. Descriptive statistics were used to obtain the average, standard deviation, and significant differences according to the writing profiles between male and female students. The result stated that grammar is the major problem possessed by students. Furthermore, teachers are expected to provide online corrective feedback for students in the Academic Writing course learning process.


Keywords


Automated writing evaluation; corrective feedback; EFL; Grammarly; writing profile

Full Text:

PDF

References


AbuSeileek, A. F. (2013). Using track changes and word processor to provide corrective feedback to learners in Writing. Journal of Computer Assisted Learning, 29(4), 319-333. https://doi.org/10.1111/jcal.12004

AbuSeileek, A. F., & Abualsha’r, A. (2014). Using peer computer-mediated corrective feedback to support EFL learners’ writing. Language Learning & Technology, 18(1), 76-95. http://doi.org/10125/44355

Abushihab, I. (2014). An analysis of grammatical errors in writing made by Turkish learners of English as a foreign language. International Journal of Linguistics, 6(4), 213–223. https://doi.org/10.5296/ijl.v6i4.6190

Al-Ghabra, I. M. (2019). Analyzing errors committed in paragraph committed by Undergraduates. Journal of Language Teaching and Research, 10(2), 264-270. http://dx.doi.org/10.17507/jltr.1002.07

Ambarwati, E. K. (2021). Indonesian university students’ appropriating Grammarly for formative feedback. ELT in Focus, 3(1), 1-11, http://doi.org/10.35706/eltinfc.v4i1.5216

Attali, Y. (2004). Exploring the feedback and revision features of criterion [Paper presentation]. The National Council on Measurement in Education, San Diego, CA.

Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® V.2 Journal of Technology, Learning, and Assessment, 4(3), 1–30. https://ejournals.bc.edu/index.php/jtla/article/view/1650

Bai, L., & Hu, G. (2017). In the face of fallible AWE feedback: How do students respond? Educational Psychology, An International Journal of Experimental Educational Psychology, 37(1), 67–81. https://doi.org/10.1080/01443410.2016.1223275

Bailey, D., & Lee, A. A. (2020). An exploratory study of Grammarly in the language learning context: An analysis of test-based, textbook-based and Facebook corpora. TESOL International Journal, 15(2), 4–27.

Bitchener, J., Basturkmen, H., & East, M. (2010). The focus of supervisor written feedback to thesis/dissertation students. International Journal of English Studies, 10(2), 79-97. http://doi.org/10.6018/ijes.10.2.119201

Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assesment in Education: Principles, Policy & Practice, 5(1), 7-74. https://doi.org/10.1080/0969595980050102

Bloch, J. (2008). From the special issue editor. Language Learning & Technology, 12(2), 2-6. http://doi.org/10125/44137

Bostanci, H. B. (2019). Analysis and classification of frequent writing errors of Turkish Cypriot university students. Revista Inclusiones, 6, 224–237.

Celce-Murcia, M., & Larsen-Freeman, D. (1999). The grammar book - an ESL/EFL teachers’ course. Newbury House.

Chapelle, C. A., Cotos, E., & Lee, J. (2015). Validity arguments for diagnostic assessment using automated writing evaluation. Language Testing, 32(3), 385–405. https://doi.org/10.1177/0265532214565386

Chon, Y. V., Shin, D., & Kim, G. E. (2021). Comparing L2 learners’ writing against parallel machine-translated texts: Raters’ assessment, linguistic complexity and errors. System, 96, Article 102408, 1-12. https://doi.org/10.1016/j.system.2020.102408

Derakhshan, A., & Shirejini, R. K. (2020). An investigation of the Iranian EFL learners’ perceptions towards the most common writing problems. Sage Open, 1-10. https://doi.org/10.1177/2158244020919523

Dikli, S., & Bleyle, S. (2014). Automated essay scoring feedback for second language writers: How does it compare to instructor feedback? Assessing Writing, 22, 1–17. https://doi.org/10.1016/j.asw.2014.03.006

Ellis, R. (2009). A typology of written corrective feedback types. ELT Journal, 16(3), 97–107. https://doi.org/10.1093/elt/ccn023

Enright, M. K., & Quinlan, T. (2010). Complementing human judgment of essays written by English language learners with e-rater® scoring. Language Testing, 27(3), 317–334. https://doi.org/10.1177%2F0265532210363144

French, A. (2018). “Fail better”: Reconsidering the role of struggle and failure in academic writing development in higher education. Innovations in Education and Teaching International, 55(4), 408–416. https://doi.org/10.1080/14703297.2016.1251848

Fukuta, J., Tamura, Y., & Kawaguchi, Y. (2019). Written languaging with indirect feedback in writing revision: Is feedback always effective? Language Awareness, 28(1), 1–14. https://doi.org/10.1080/09658416.2019.1567742

Fukuta, J., & Yamasihta, J. (2015). Effects of task demands on attention orientation in L2 oral production. System, 53, 1-12. https://doi.org/10.1016/j.system.2015.06.010

Ghufron, M. A. (2019). Exploring an automated feedback program ‘Grammarly’ and teacher corrective feedback in EFL writing assessment: Modern vs. traditional assessment. Proceedings of the 3rd English Language and Literature International Conference, Indonesia. http://dx.doi.org/10.4108/eai.27-4-2019.2285308

Ghufron, M. A., & Rosyida, F. (2018). The role of Grammarly in assessing English as a foreign language (EFL) writing. Lingua Culture, 12(4), 395-403. https://doi.org/10.21512/lc.v12i4.4582

Graham, S., Hebert, M., & Harris, K. R. (2015). Formative assessment and writing: A meta-analysis. The Elementary School Journal, 115(4), 523–547

Godwin, M. (2016). International students use of technology for improving writing skills in college [Doctoral Dissertation, Walden University]. https://scholarworks.waldenu.edu/dissertations/3160

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102%2F003465430298487

Hasan, J., & Marzuki, M. (2017). An analysis of student’s ability in writing at Riau University Pekanbaru - Indonesia. Theory and Practice in Language Studies, 7(5), 380-388. http://doi.org/10.17507/tpls.0705.08

Hyland, K., & Hyland, F. (2006). Feedback on second language students’ writing. Language Teaching, 39(2), 83-101. https://doi.org/10.1017/S0261444806003399

Jabulani, S. (2015). Efficacy of written corrective feedback on university students’ writing. Journal of Social Sciences, 45(2), 84–95. https://doi.org/10.1080/09718923.2015.11893490

Lai, Y. (2010). Which do students prefer to evaluate their essays: Peers or computer program. British Journal of Educational Technology, 41(3), 432–454. https://doi.org/10.1111/j.1467-8535.2009.00959.x

Lee, I. (2013). Research into practice: Written corrective feedback. Language Teaching, 46 (1), 108 119. https://doi.org/10.1017/S0261444812000390

Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of Second Language Writing, 27, 1–18. https://doi.org/10.1016/j.jslw.2014.10.004

Li, Z., Feng, H., & Saricaoglu, A. (2017). The short-term and long-term effects of AWE feedback on ESL students’ development of grammatical accuracy. CALICO Journal, 34(3), 355–375. https://www.jstor.org/stable/90014700

Liao, H. (2015). Using automated writing evaluation to reduce grammar errors in writing. ELT Journal, 70(3), 308–319. https://doi.org/10.1093/elt/ccv058

Liardét, C. (2015). Academic literacy and grammatical metaphor: Mapping development. TESOL International Journal, 10(1), 29-46

Luft, C. D. B. (2014). Learning from feedback: The neural mechanisms of feedback processing facilitating better performance. Behavioural Brain Research, 261, 356–368. https://doi.org/10.1016/j.bbr.2013.12.043

Muchemwa, S., Amimo, C., & Allida, V. (2019). Analysis of teacher-written corrective feedback in second language writing pedagogy in secondary schools, Bulilima, Zimbabwe. Journal of Education, Society and Behavioural Science, 31(3), 1–13. https://doi.org/10.9734/jesbs/2019/v31i330150

Parra G., L., & Calero S., X. (2019). Automated Writing Evaluation Tools in the Improvement of the Writing Skill. International Journal of Instruction, 12(2), 209-226. http://dx.doi.org/10.29333/iji.2019.12214a

Prvinchandar, S., & Ayub, A. F. M. (2014). Comparison of the effectiveness of style writer and Microsoft word computer software to improve English writing skills. English Language Teaching. 7(1), 93–102. https://doi.org/10.5539/elt.v7n1p93

Phuket, P. R. N., & Othman, N. (2015). Understanding EFL students’ errors in writing. Journal of Education and Practice, 6(32), 99-106.

Qassemzadeh, A., & Soleimani, H. (2016). The impact of feedback provision by grammarly software and teachers on learning passive structures by Iranian EFL learners. Theory and Practice in Language Studies, 6(9), 1884-1894. https://doi.org/10.17507/tpls.0609.23

Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31(7), 653–674. https://doi.org/10.1080/09588221.2018.1428994

Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18, 119-144. https://doi.org/10.1007/BF00117714

Salkind, N. J. (2010). Encyclopedia of research design (Vol. 1). Sage Publications.

Schraudner, M. (2014). The online teacher’s assistant: Using automated correction programs to supplement learning and lesson planning. Core. https://core.ac.uk/download/pdf/72791567.pdf

Sermsook, K., Liamnimitr, J., & Pochkorn, R. (2017). An analysis of errors in written English sentences: A case study of Thai EFL students. English Language Teaching, 10(3), 101-110. http://doi.org/10.5539/elt.v10n3p101

Shintani, N., & Aubrey, S. (2016). The effectiveness of synchronous and asynchronous written corrective feedback on grammatical accuracy in a computer‐mediated environment. The Modern Language Journal, 100(l), 296-319. https://doi.org/10.1111/modl.12317

Sia, D., & Cheung, Y. L. (2017). Written corrective feedback in writing instruction: A qualitative synthesis of recent research. Issues in Language Studies, 6(1), 61-80. http://doi.org/10.33736/ils.478.2017

Simon, M. K., & Goes, J. (2018). Dissertation and scholarly research: Recipes for success. Seattle, Dissertation Success LLC

Stevenson, M., & Phakiti, A. (2019). Automated feedback and second language writing. In K. Hyland, & F. Hyland (Eds.), Feedback in second language writing: Contexts and issues (pp. 125–142). (2nd ed.). Cambridge University Press. https://doi.org/10.1017/9781108635547

Storch, G., & Wigglesworth, N. (2010). Learners’ processing, uptake, and retention of corrective feedback on writing. Studies in Second Language Acquisition, 32(2), 303–334. https://doi.org/10.1017/S0272263109990532

terzioğlu, Y., & Bostanci, H. B. (2020). A comparative study of 10th grade Turkish Cypriot students’ writing errors. SAGE Open, 10(1), 1-19. https://doi.org/10.1177%2F2158244020914541

Ware, P., & Warschauer, M. (2006). Electronic feedback and second language writing. Cambridge University Press

Wilson, J., & Czik, A. (2016). Automated essay evaluation software in English Language Arts classrooms: Effects on teacher feedback, student motivation, and writing quality. Computers & Education, 100, 94–109. https://doi.org/10.1016/j.compedu.2016.05.004

Xie, Q. (2019). Error analysis and diagnosis of ESL linguistic accuracy: Construct specification and empirical validation. Assessing Writing, 41, 47-62. https://doi.org/10.1016/j.asw.2019.05.002

Yunus, M. M., Salehi, H., & Chenzi, C. (2012). Integrating social networking tools into ESL writing classroom: Strengths and weaknesses. English Language Teaching, 5(8), 42–48. https://doi.org/10.5539/elt.v5n8p42

Yorke, M., & Longden, B. (2008). The first-year experience of higher education in the UK: Final Report. Escalate. http://escalate.ac.uk/downloads/3365.pdf

Zhang, Z. V., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102. https://doi.org/10.1016/j.asw.2018.02.004

Zhai, N., & Ma, X. (2021). Automated writing evaluation (AWE) feedback: a systematic investigation of college students’ acceptance. Computer Assisted Language Learning, Advanced publication, 1-26. https://doi.org/10.1080/09588221.2021.1897019




DOI: https://doi.org/10.17509/ijal.v12i1.46428

Refbacks

  • There are currently no refbacks.


View My Stats

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.