The role of Artificial Intelligence (AI) in tests and assessment from the perspective of teachers in Jeddah education
DOI:
https://doi.org/10.59992/IJESA.2025.v4n4p17الكلمات المفتاحية:
Artificial Intelligence (AI)، Tests، Assessment، Teacher، Educational Assessment، Personalized Feedback، Automated Grading، Ethical Considerationsالملخص
With AI's growing integration into various sectors, its potential to transform educational assessment practices is increasingly apparent. This research aims to examine how school teachers perceive the use of AI in creating, administering, and evaluating assessments, as well as its potential benefits and challenges. A quantitative-methods approach was employed, with 219 participants being surveyed. The results indicate that the perspectives of school teachers in Jeddah reveal a nuanced view of AI in educational assessments. The study also identifies several significant challenges that hinder the integration of AI in assessment in Jeddah’s educational sector. These challenges include a lack of training, financial and resource constraints, ethical concerns, resistance to change, and technical reliability issues. No significant differences were found in the perceptions of AI’s importance in assessment according to gender, school level, or experience. However, public-school teachers demonstrated significantly higher mean scores compared to private-school teachers, indicating a stronger belief in AI’s potential to enhance assessment practices.
المراجع
1. Alenezi, A. (2020). Barriers to implementing artificial intelligence in education: Perspectives from Saudi teachers. International Journal of Educational Research, 45(3), 45-58.
2. Al-Gahtani, S. S. (2016). Empirical investigation of e-learning acceptance and assimilation: A structural equation model. Applied Computing and Informatics, 12(1), 27-50.
3. Amano, T., Ramírez-Castañeda, V., Berdejo-Espinola, V., Borokini, I., Chowdhury, S., Golivets, M., González Trujillo, J. D., Montaño -Centellas, F., Paudel, K., White, R. L., & Veríssimo, D. (2023). The manifold costs of being a non-native English speaker in science. PLOS Biology, 21(7) [Online]. Available at: https://doi.org/10.1371/journal.pbio.3002184.
4. Anson, C. M. (2022). AI-Based Text Generation and the Social Construction of “Fraudulent Authorship”: A Revisitation. Composition Studies, 50, 37–46. [Online]. Available at: https://compositionstudiesjournal.files.wordpress.com/2022/07/anson.pdf.
5. Australian National University. (2023a). Lib Guides: Artificial Intelligence including generative AI: Welcome. The Australian National University. [Online]. Available at: https://libguides.anu.edu.au/c.php?g=960102&p=6969599.
6. Australian National University. (2023b). Chat GPT and other generative AI tools: What ANU academics need to know. [Online]. Available at: https://teaching.weblogs.anu.edu.au/files/2023/02/Chat_GPT_FAQ-1.pdf.
7. Baker, T., & Smith, L. (2019). Educ -AI-tion Rebooted? Exploring the future of artificial intelligence in schools and colleges. Nesta. [Online]. Available at: https://www.nesta.org.uk/report/education-rebooted/.
8. Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, 610–623. [Online]. Available at: https://doi.org/10.1145/3442188.3445922.
9. Binns, R. (2018). Fairness in machine learning: Lessons from political philosophy. Proceedings of the 2018 ACM Conference on Fairness, Accountability, and Transparency, 149–159. [Online]. Available at: https://proceedings.mlr.press/v81/binns18a.html.
10. Birks, D., & Clare, J. (2023). Linking artificial intelligence facilitated academic misconduct to existing prevention frameworks. International Journal for Educational Integrity, 19(1), 20. [Online]. Available at: https://doi.org/10.1007/s40979-02300142-3.
11. Bussell, C., Ehab, A., Hartle-Ryan, D., & Kapsalis, T. (2023). Generative AI for Immersive Experiences: Integrating Text-to-Image Models in VR-Mediated Co-design Workflows. In: C. Stephanidis, C., Antona, M., Ntoa, S., & Salvendy, G. (eds.). HCI International 2023 Posters: Book Subtitle 25th International Conference on Human-Computer Interaction. New York: Springer, 380–388.
12. Cheung, W., & Wong, N. (2023). Hong Kong universities relent to rise of ChatGPT, AI but keep eye out for cheats. South China Morning Post. [Online]. Available at: https://www.scmp.com/news/hongkong/education/article/3233269/hong-kong-universities-relent-rise-chatgpt-ai-tools-teaching-and-assignments keep-eye-out-plagiarism.
13. Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. [Online]. Available at: https://doi.org/10.1080/14703297.2023.2190148
14. Crawford, K. (2021). The atlas of AI: Power, politics, and the planetary costs of artificial intelligence. New Haven, CT: Yale University Press.
15. Cukurova, M., Luckin, R., & Mavrikis, M. (2020). Developing a framework for the ethical use of AI in education. Artificial Intelligence in Education, 33(1), 14-26.
16. Cummings, R. E., Monroe, S. M., & Watkins, M. (2024). Generative AI in first-year writing: An early analysis of affordances, limitations, and a framework for the future. Computers and Composition, 71. [Online]. Available at: https://www.sciencedirect.com/science/article/pii/S8755461524000033?via%3Dihub.
17. Duah, J. E., & McGivern, P. (2024). How generative artificial intelligence has blurred notions of authorial identity and academic norms in higher education, necessitating clear university usage policies. The International Journal of Information and Learning Technology. [Online]. Available at: https://doi.org/10.1108/IJILT-11-2023-0213.
18. Eynon, R. (2022). Datafication and the role of schooling: Challenging the status quo. In: Pangrazio, L. & Sefton-Green, J. (eds.), Learning to Live with Datafication: Educational case studies and initiatives from across the world. London: Routledge, 17-34.
19. Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., & Vayena, E. (2018). AI4People—an ethical framework for a good AI society: Opportunities, risks, principles, and recommendations. Minds and Machines, 28(4), 689-707.
20. Forero, M. G., & Herrera-Suárez, H. J. (2023). ChatGPT in the Classroom: Boon or Bane for Physics Students’ Academic Performance? [Online]. Available at: https://doi.org/10.48550/ARXIV.2312.02422.
21. Fowler, S., Korolkiewicz, M., & Marrone, R. (2023). First 100 days of ChatGPT at Australian universities: An analysis of policy landscape and media discussions about the role of AI in higher education. Learning Letters, 1, 1. [Online]. Available at: https://doi.org/10.59453/JMTN6001.
22. Freeman, J. (2024). Provide or punish? Students’ views on generative AI in higher education. HEPI. [Online]. Available at: https://www.hepi.ac.uk/2024/02/01/provide-or-punish-students-views-on-generative-ai-in-higher-education/.
23. Furze, L., Perkins, M., Roe, J., MacVaugh, J. The AI Assessment Scale (AIAS) In Action: A Pilot Implementation of GenAI Supported Assessment. Australian Journal of Educational Technology, 40(4), 38-55. [Online]. Available at: https://doi.org/10.14742/ajet.9434.
24. Gozalo-Brizuela, R., & Garrido-Merchan, E. C. (2023). ChatGPT is not all you need. A State of the Art Review of large Generative AI models. GRACE: Global Review of AI Community Ethics, 1(1). [Online]. Available at: https://doi.org/10.48550/ARXIV.2301.04655.
25. Group of Eight Australia. (2023). Group of Eight principles on the use of generative artificial intelligence. [Online]. Available at: https://go8.edu.au/group-of-eight-principles-on-the-use-of-generative-artificial-intelligence.
26. Harvard University. (n.d.). Generative Artificial Intelligence (AI). [Online]. Available at: https://huit.harvard.edu/ai.
27. Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
28. Holmes, W., Bialik, M., & Fadel, C. (2021). Artificial Intelligence in Education: Promises and Implications for Teaching and Learning. Boston: Center for Curriculum Redesign.
29. Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., & Koedinger, K. R. (2021). Ethics of AI in Education: Towards a Community-Wide Framework. International Journal of Artificial Intelligence in Education. [Online]. Available at: https://doi.org/10.1007/s40593-021-00239-1.
30. Kelly, A., Sullivan, M., & Strampel, K. (2023). Generative artificial intelligence: University student awareness, experience, and confidence in use across disciplines. Journal of University Teaching and Learning Practice, 20(6). [Online]. Available at: https://doi.org/10.53761/1.20.6.12.
31. Knight, S., Dickson-Deane, C., Heggart, K., Kitto, K., Çetindamar Kozanoğlu, D., Maher, D., Narayan, B., & Zarrabi, F. (2023). Generative AI in the Australian education system: An open data set of stakeholder recommendations and emerging analysis from a public inquiry. Australasian Journal of Educational Technology, 39(5), 101–124. [Online]. Available at: https://doi.org/10.14742/ajet.8922.
32. Knowles, A. M. (2024). Machine-in-the-loop writing: Optimizing the rhetorical load. Computers and Composition, 71. [Online]. Available at: https://doi.org/10.1016/j.compcom.2024.102826.
33. Leung, M., & Niazi, S. (2023). Universities on alert over ChatGPT and other AI-assisted tools. University World News. [Online]. Available at: https://www.universityworldnews.com/post.php?story=20230222132357841.
34. Liu, R., Zenke, C., Liu, C., Holmes, A., Thornton, P., & Malan, D. J. (2024). Teaching CS50 with AI: Leveraging Generative Artificial Intelligence in Computer Science Education. Proceedings of the 55th ACM Technical Symposium on Computer Science Education, 1(1), 1–7. [Online]. Available at: https://doi.org/10.1145/3626252.3630938.
35. Lodge, J., Howard, S., Bearman, M., & Dawson, P. (2023). Assessment reform for the age of Artificial Intelligence. Australian Government: Tertiary Education Quality and Standards Agency.
36. Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. London: Pearson Education.
37. Luo, J. (2024). A critical review of GenAI policies in higher education assessment: A call to reconsider the “originality” of students’ work. Assessment & Evaluation in Higher Education, 1–14. [Online]. Available at: https://doi.org/10.1080/02602938.2024.2309963.
38. Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent Tutoring Systems and Learning Outcomes: A Meta-Analysis. Journal of Educational Psychology, 106(4), 901-918.
39. Monash University. (2023). Using artificial intelligence. [Online]. Available at: https://www.monash.edu/student-academic-success/build-digital-capabilities/create-online/using-artificial-intelligence.
40. Nagoya University. (2023). 名古屋大学. 名古屋大学. [Online]. Available at: https://www.nagoya-u.ac.jp/.
41. OpenAI. (2023). GPT-4V (ision) system card. [Online]. Available at: https://openai.com/research/gpt-4v-system-card.
42. OpenAI. (2024). Video generation models as world simulators. [Online]. Available at: https://openai.com/research/video-generation-models-as-world-simulators.
43. Ozcan, S., Sekhon, J., & Ozcan, O. (2023). ChatGPT: what the law says about who owns the copyright of AI-generated content. The Conversation. [Online]. Available at: https://theconversation.com/chatgpt-what-the-law-says-about-who-ownsthe-copyright-of-ai-generated-content-200597.
44. Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching & Learning Practice, 20(2). [Online]. Available at: https://doi.org/10.53761/1.20.02.07.
45. Perkins, M., Furze, L., Roe, J., MacVaugh, J. (2024). The AI Assessment Scale (AIAS): A Framework for Ethical Integration of Generative AI in Educational Assessment. Journal of University Teaching & Learning Practice, 21(6). [Online]. Available at: https://doi.org/10.48550/arXiv.2312.07086.
46. Perrotta, C., Selwyn, N., & Ewin, C. (2022). Artificial intelligence and the affective labour of understanding: The intimate moderation of a language model. New Media & Society, 26(3), 1585-1609. [Online]. Available at: https://doi.org/10.1177/14614448221075296.
47. Plata, S., De Guzman, M. A., & Quesada, A. (2023). Emerging Research and Policy Themes on Academic Integrity in the Age of Chat GPT and Generative AI. Asian Journal of University Education, 19(4), 743–758. [Online]. Available at: https://doi.org/10.24191/ajue.v19i4.24697.
48. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 342-363. [Online]. Available at: https://doi.org/10.37074/jalt.2023.6.1.9.
49. Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. Cambridge: Polity Press.
50. Shermis, M. D., & Burstein, J. (eds.). (2013). Handbook of Automated Essay Evaluation: Current Applications and New Directions. London: Routledge.
51. Stanford University. (2024). Course Policies on Generative AI Use. [Online]. Available at: https://tlhub.stanford.edu/docs/course-policies-on-generative-ai-use/.
52. Sun, L., Wei, M., Sun, Y., Suh, Y. J., Shen, L., & Yang, S. (2024). Smiling Women Pitching Down: Auditing Representational and Presentational Gender Biases in Image Generative AI. Journal of Computer-Mediated Communication, 29(1). [Online]. Available at: https://doi.org/10.1093/jcmc/zmad045.
53. University of Adelaide. (2023). How to work with Artificial Intelligence. [Online]. Available at: https://www.adelaide.edu.au/student/academic-skills/ua/media/234/artificial-intelligence-student-slides-v0.1.pdf.
54. UNSW. (2024). Chat GPT & Generative AI at UNSW. [Online]. Available at: https://www.student.unsw.edu.au/skills/ai.
55. Uzun, L. (2023). ChatGPT and Academic Integrity Concerns: Detecting Artificial Intelligence Generated Content. Language Education and Technology, 3(1), 45-54. [Online]. Available at: https://www.langedutech.com/letjournal/index.php/let/article/view/49.
56. Van der Linden, W. J., & Glas, C. A. W. (eds.). (2018). Elements of Adaptive Testing. New York: Springer.
57. West, S.M., Whittaker, M. and Crawford, K. (2019). Discriminating Systems: Gender, Race and Power in AI. AI Now Institute. [Online]. Available at: https://ainowinstitute.org/ discriminatingsystems.html.
58. Williamson, B., & Eynon, R. (2020). The automation of education: AI and the future of learning, assessment, and teaching. Learning, Media and Technology, 45(3), 219-232.
59. Yale University. (2023). Guidelines for the Use of Generative AI Tools. [Online]. Available at: https://provost.yale.edu/news/guidelines-use-generative-ai-tools.
60. Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education. International Journal of Educational Technology in Higher Education, 16(1), 1-27.
