Effectiveness of ChatGPT in Improving English Writing Proficiency among Non-native English Speakers
DOI:
https://doi.org/10.59992/IJESA.2024.v3n4p2الكلمات المفتاحية:
ChatGPT، English as a Foreign Language، English as a Second Language، OpenAI، Saudi Arabia، Writing Proficiencyالملخص
The release of models like ChatGPT from research labs has created new opportunities for personalized feedback and engagement in language instruction, aligning with the needs of foreign language learners seeking to enhance their English writing skills. This study examined the effectiveness of ChatGPT in improving English writing proficiency among Saudi undergraduate students and their perceptions and experiences of using ChatGPT. The research utilized a mixed-methods approach, incorporating experimental pre-and post-tests, semi-structured interviews, and open-ended questionnaires, which were analyzed using thematic analysis. The study comprised two phases: an interactive phase, where participants utilized ChatGPT for writing tasks and feedback, and an assessment phase involving pre- and post-intervention writing assessments. The findings revealed that the integration of ChatGPT into language learning positively impacted English writing proficiency, offering personalized support and feedback to learners. The results also underscore the potential of AI-powered learning tools in facilitating language development as captured by the positive perceptions and experiences of the participants. In conclusion, the results of this study suggested that ChatGPT could be effective in enhancing the writing proficiency of Saudi English as a foreign language (EFL) learner, and their perceptions and experiences provided valuable insights into the integration of ChatGPT into language learning.
المراجع
- Almutairi, R. T. (2023). EFL students & amp; #39; reactions to peer versus teacher feedback to improve writing skills: a study at intermediate school level. English Language Teaching, 16(4), 88.
- Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745.
- Baskara, F. R. (2023). Integrating ChatGPT into EFL writing instruction: Benefits and challenges. International Journal of Education and Learning, 5(1), 44–55.
- Carless, D. and Boud, D. (2018). The development of student feedback literacy: enabling uptake of feedback. Assessment &Amp; Evaluation in Higher Education, 43(8), 1315-1325.
- Chen, Z., Chen, W., Jia, J., & Le, H. (2022). Exploring AWE-supported writing process: An activity theory perspective. Language Learning & Technology, 26, 129–148.
- dos Santos, A. E., Olesova, L., Vicentini, C., & de Oliveira, L. C. (2023). ChatGPT in ELT: Writing affordances and activities. TESOL Connections. http://newsmanager.commpartners.com/tesolc/print/2023-05-01/2.html
- Fitria, T. N. (2023). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. ELT Forum: Journal of English Language Teaching, 12(1), 44–58.
- García Sánchez, O. V. (2023). Uso y percepción de ChatGPT en la educación superior. Revista de Investigación en Tecnologías de la Información, 11, 98–107.
- Gielen, S., Tops, L., Dochy, F., Onghena, P., & Smeets, S. (2010). A comparative study of peer and teacher feedback and various peer feedback forms in a secondary school writing curriculum. British Educational Research Journal, 36(1), 143-162.
- Gikas, J., & Grant, M. M. (2013). Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media. The Internet and Higher Education, 19, 18–26.
- Haggag, M. H. (2023). A program based on chat generative pre-trained text transformer (ChatGPT) for enhancing EFL majors’ descriptive paragraph writing skills and their English grammar use.
مجلة کلية التربية، 39(6) , 1–29.
- Harunasari, S. Y. (2022). Examining the effectiveness of AI-integrated approach in EFL writing: A case of ChatGPT. International Journal of Progressive Sciences and Technology, 39(2), 357–368.
- Hassan Taj, I., Ali, F., Sipra, M., & Ahmad, W. (2017). Effect of technology enhanced language learning on vocabulary acquisition of EFL learners. International Journal of Applied Linguistics & English Literature, 6(3(.
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2927643.
- Herbold, S., Hautli-Janisz, A., Heuer, U., Kikteva, Z., & Trautsch, A. (2023). A large-scale comparison of human-written versus ChatGPT-generated essays. Scientific Reports, 13, 18617. https://doi.org/10.1038/s41598-023-45644-9.
- Huang, J., & Li, S. (2023). Opportunities and challenges in the application of ChatGPT in foreign language teaching. International Journal of Education and Social Science Research, 6(4), 75–89.
- Huisman, B., Saab, N., Driel, J. v., & Broek, P. v. d. (2018). Peer feedback on academic writing: undergraduate students’ peer feedback role, peer feedback perceptions and essay performance. Assessment &Amp; Evaluation in Higher Education, 43(6), 955-968.
- Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464.
- Jarrah, A. M., Wardat, Y., & Fidalgo, P. (2023). Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say? Online Journal of Communication and Media Technologies, 13(4), e202346.
- Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 37(1–2). https://doi.org/10.1080/09588221.2021.2021241.
- King, M. R., & ChatGPT. (2023). A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16, 1–2. https://doi.org/10.1007/s12195-022-00754-8.
- Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language learning and teaching. RELC Journal, 54(2), 1–14. https://doi.org/10.1177/00336882231162868.
- Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News. https://doi.org/10.2139/ssrn.4333415.
- MacNeil, S., Tran, A., Mogil, D., Bernstein, S., Ross, E., & Huang, Z. (2022). Generating diverse code explanations using the GPT-3 large language model. In Proceedings of the 2022 ACM Conference on International Computing Education Research (Vol. 2, pp. 37–39). https://doi.org/10.1145/3501709.3544280.
- Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J. M., & López-Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12(8), 153.
- Nicol, D. and McCallum, S. (2021). Making internal feedback explicit: exploiting the multiple comparisons that occur during peer review. Assessment &Amp; Evaluation in Higher Education, 47(3), 424-443.
- Ningrum, S. (2023). ChatGPT’s impact: The AI revolution in EFL writing. Borneo Engineering & Advanced Multidisciplinary International Journal, 2, 32–37.
- Orrù, G., Piarulli, A., Conversano, C., & Gemignani, A. (2023). Human-like problem-solving abilities in large language models using ChatGPT. Frontiers in Artificial Intelligence, 6, 1199350.
- Ortíz, D. C., Nogué, L., Serra, T., & Colomer, J. (2019). Supportive peer feedback in tertiary education: analysis of pre-service teachers’ perceptions. Education Sciences, 9(4), 280.
- Osorio, J. A. C. (2023). Explorando el potencial de ChatGPT en la escritura científica: Ventajas, desafíos y precauciones. Scientia et Technica, 28, 3–5.
- Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator, 78, 84–93.
- Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pretraining. https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf.
- Sanderson, K. (2023). GPT-4 is here: What scientists think. Nature, 615(7954), 773. https://doi.org/10.1038/d41586-023-00816-5.
- Savage, A., & Mayer, P. (2012). Effective academic writing 2 (2nd ed.). Oxford University Press.
- Shaikh, S., Yayilgan, S. Y., Klimova, B., & Pikhart, M. (2023). Assessing the usability of ChatGPT for formal English language learning. European Journal of Investigation in Health, Psychology and Education, 13(9), 1937–1960.
- Shin, D., Kim, H., Lee, J. H., & Yang, H. (2021). Exploring the use of an artificial intelligence chatbot as second language conversation partners. Korean Journal of English Language and Linguistics, 21, 375–391.
- Sippel, L. and Jackson, C. N. (2015). Teacher vs. peer oral corrective feedback in the german language classroom. Foreign Language Annals, 48(4), 688-705.
- Smith, B. (2018). Technology-enhanced language learning in action: A review of the literature on vocabulary acquisition. Language Learning & Technology, 22, 124–142.
- Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14.
- Steenbergen-Hu, S., & Cooper, H. (2014). A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. Journal of Educational Psychology, 106(2), 331–347.
- Susnjak, T. (2022). ChatGPT: The end of online exam integrity? arXiv. https://doi.org/10.48550/arXiv.2212.09292.
- Synopsys. (n.d.). What is reinforcement learning? https://www.synopsys.com/ai/what-is-reinforcement-learning.html.
- Wihastyanang, W. D., Kusumaningrum, S. R., Latief, M. A., & Cahyono, B. Y. (2020). Impacts of providing online teacher and peer feedback on students’ writing performance. Turkish Online Journal of Distance Education, 178-189.
- Xiao-ling, L. and Zhou, C. (2018). The effect of online feedback types on foreign language writing. Theory and Practice in Language Studies, 8(7), 733.
- Xiao, Y., & Zhi, Y. (2023). An exploratory study of EFL learners’ use of ChatGPT for language learning tasks: Experience and perceptions. Languages, 8(3), 212.
- Yaacoub, J. P. A., Noura, H. N., Salman, O., & Chehab, A. (2023). Ethical hacking for IoT: Security issues, challenges, solutions and recommendations. Internet of Things and Cyber-Physical Systems, 3, 280–308.
- Yan, D. (2023b). How ChatGPT’s automatic text generation impact on learners in a L2 writing practicum: An exploratory investigation. https://hal.science/hal-04037687.
- Yan, D. (2023a). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies, 28, 13943–13967. https://doi.org/10.1007/s10639-023-11742-4.
- Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34, 327–343.
- Zarfsaz, P. Y. E. (2021). The Impact of Positive Peer Feedback on Second Language Writing Accuracy. Journal of Turkish Studies, Volume 16 Issue 1(Volume 16 Issue 1), 409-426.
- Zhai, X. (2022). ChatGPT user experience: Implications for education. https://dx.doi.org/10.2139/ssrn.4312418.
