French error type annotation for dictation: A platform with automatic error type annotation for French dictation exercises

Frontiers in Psychology

article

Ying Qin¹  Yumeng Luo¹  Yuming Zhai² 

[1] School of Information Science and Technology, Beijing Foreign Studies University;Beijing Foreign Studies University ,(BFSU) Artificial Intelligence and Human Languages Lab, Beijing Foreign Studies University

关键词: artificial intelligence;    AI program;    language learning;    Language education;    Instant feedback;    Independent study;   

DOI  :  10.3389/fpsyg.2022.1075932

学科分类：社会科学、人文和艺术（综合）

来源: Frontiers

【 摘 要 】

Dictation is considered an efficient exercise for testing the language proficiency of learners of French as a Foreign Language (FFL). However, the traditional teaching approach to dictation reduces the instructional feedback efficiency. To remedy this, this study adopts a design-based research approach and builds an automatic error type annotation platform for dictation practice named FRETA-D (FRench Error Type Annotation for Dictation) to pursue intelligent pedagogical feedback for both FFL teachers and students. FRETA-D can automatically identify error boundaries as well as classify the errors into fine-grained error types in learners’ dictation texts. FRETA-D features a dataset-independent classifier based on a framework with 25 main error types, which is generalized from French grammar rules and characteristics of frequent learner dictation errors. Five French teachers are invited to evaluate the appropriateness of automatically predicted error types of 147 randomly selected samples, and the acceptance rate reaches more than 85%. Automatic evaluation on 1,009 sentences by comparing with manually labeled references also shows promising results, reaching more than 85% consistency with human judgments. The accessibility of FRETA-D has also been confirmed by fifty Chinese undergraduate FFL learners with different professional backgrounds.

【 授权许可】

CC BY