Source Code Plagiarism Detection in Academia with Information Retrieval: Dataset and the Observation
Source Code Plagiarism Detection in Academia with Information Retrieval: Dataset and the Observation
Author(s): Oscar Karnalim, Setia Budi, Hapnes TOBA, Mike JOYSubject(s): Methodology and research technology, ICT Information and Communications Technologies
Published by: Vilniaus Universiteto Leidykla
Keywords: source code plagiarism; dataset; programming; computer science education;
Summary/Abstract: Source code plagiarism is an emerging issue in computer science education. As a result, a number of techniques have been proposed to handle this issue. However, comparing these techniques may be challenging, since they are evaluated with their own private dataset(s). This paper contributes in providing a public dataset for comparing these techniques. Specifically, the dataset is designed for evaluation with an Information Retrieval (IR) perspective. The dataset consists of 467 source code files, covering seven introductory programming assessment tasks. Unique to this dataset, both intention to plagiarise and advanced plagiarism attacks are considered in its construction. The dataset's characteristics were observed by comparing three IR-based detection techniques, and it is clear that most IR-based techniques are less effective than a baseline technique which relies on Running-Karp-Rabin Greedy-String-Tiling, even though some of them are far more time-efficient.
Journal: Informatics in Education - An International Journal
- Issue Year: 18/2019
- Issue No: 2
- Page Range: 321-344
- Page Count: 23
- Language: English