Automatic Grammar Error Correction Model Based on Encoder-decoder Structure for English Texts

EAI Endorsed Transactions on Scalable Information Systems

article

Jiahao Wang¹  Guimin Huang¹  Yabing Wang¹ 

[1] Guilin University of Electronic Technology

关键词: Encoder-decoder;    Grammar Error Correction(GEC);    deep neural network;    attention mechanism;    beam search;   

DOI  :  10.4108/eetsis.v9i5.2011

学科分类：社会科学、人文和艺术（综合）

来源: Bern Open Publishing

【 摘 要 】

The role of information transmission in social life is irreplaceable, and language is a very important information carrier. Among all kinds of languages, English always occupies an important position. In the process of English learning, grammar error has become a difficult problem for most learners. In this paper, we propose an automatic grammar error correction model based on encoder-decoder structure. Different from traditional encoders, we design a dual-encoder structure to capture the information of source sentence and context sentence separately. The decoder is designed with a gated structure, it can effectively integrate output information of encoders. At the same time, the self-attention mechanism is combined to better solve the problem of long-distance information extraction. In addition, we propose a dynamic beam search algorithm to improve the accuracy of the word prediction process, and achieve dynamic extraction of the decoder output by combining kernel sampling techniques. We add a penalty factor to reduce the probability of generating repeated words, while suppressing the model's preference for generating shorter sentences. Finally, the proposed method is validated on the official English grammar error correction dataset. Experiments show that the dual encoder model in this paper has a good performance.

【 授权许可】

CC BY