Research on automatic proofreading of Chinese text based on Transformer model

Dianzi Jishu Yingyong

Lian Xiaoqin¹  Wang Jiaxin¹  Gong Yonggang¹  Pei Chenchen¹ 

[1] College of Computer and Information Engineering Beijing Key Laboratory of Food Safety Big Data Technology， Beijing Technology and Business University，Beijing 100048，China;

关键词: chinese text proofreading;    transformer model;    deep learning;   

DOI  :  10.16157/j.issn.0258-7998.191013

来源: DOAJ

【 摘 要 】

This paper proposes to apply Transformer model in the field of Chinese text automatic proofreading. Transformer model is different from traditional Seq2Seq model based on probability, statistics, rules or BiLSTM. This deep learning model improves the overall structure of Seq2Seq model to achieve automatic proofreading of Chinese text. By comparing different models with public data sets and using accuracy, recall rate and F1 value as evaluation indexes, the experimental results show that Transformer model has greatly improved proofreading performance compared with other models.

【 授权许可】

Unknown