Using AI-based detectors to control AI-assisted plagiarism in ESL writing: “The Terminator Versus the Machines”

Language Testing in Asia

Research

Karim Ibrahim¹ 

[1] Gulf University for Science and Technology, Block 5, Building 1, Mubarak Al-Abdullah Area, West Mishref, Kuwait;

关键词: Generative AI;    AI-assisted plagiarism;    Language assessment;    Academic integrity;    ESL composition;   

DOI  :  10.1186/s40468-023-00260-2

 received in 2023-08-01, accepted in 2023-09-20,  发布年份 2023

来源: Springer

【 摘 要 】

The release of ChatGPT marked the beginning of a new era of AI-assisted plagiarism that disrupts traditional assessment practices in ESL composition. In the face of this challenge, educators are left with little guidance in controlling AI-assisted plagiarism, especially when conventional methods fail to detect AI-generated texts. One approach to managing AI-assisted plagiarism is using fine-tuned AI classifiers, such as RoBERTa, to identify machine-generated texts; however, the reliability of this approach is yet to be established. To address the challenge of AI-assisted plagiarism in ESL contexts, the present cross-disciplinary descriptive study examined the potential of two RoBERTa-based classifiers to control AI-assisted plagiarism on a dataset of 240 human-written and ChatGPT-generated essays. Data analysis revealed that both platforms could identify AI-generated texts, but their detection accuracy was inconsistent across the dataset.

【 授权许可】

CC BY   
© Springer Nature Switzerland AG 2023

【 图 表 】

12936_2017_1866_Article_IEq9.gif

Fig. 1

Fig. 3

Fig. 2

Fig. 2

12951_2015_155_Article_IEq37.gif

13690_2023_1196_Figa_HTML.png

12944_2023_1927_Article_IEq24.gif

12936_2017_2075_Article_IEq38.gif

Fig. 3

12944_2023_1927_Article_IEq6.gif