Enhancing argumentation component classification using contextual language model

Journal of Big Data

Derwin Suhartono¹  Emmanuel Dave¹  Aniati Murni Arymurthy² 

[1] Computer Science Department, School of Computer Science, Bina Nusantara University, 11480, Jakarta, Indonesia;Machine Learning and Computer Vision Laboratory, Faculty of Computer Science, Universitas Indonesia, 16424, Depok, Indonesia;

关键词: Argumentation mining;    Language model;    Context free model;    Contextual model;    BERT;    ELMo;    Word2Vec;    GloVe;   

DOI  :  10.1186/s40537-021-00490-2

来源: Springer

【 摘 要 】

Arguments facilitate humans to deliver their ideas. The outcome of the discussion heavily relies on the validity of the argument. If an argument is well-composed, it is more effective to grasp the core idea behind the argument. To grade the argument, machines can be utilized by decomposing into semantic label components. In natural language processing, multiple language models are available to perform this task. It is divided into context-free and contextual models. The majority of previous studies used hand-crafted features to perform argument component classification, while state of the art language models utilize machine learning. The majority of these language models ignore the context in an argument. This research paper aims to analyze whether by including the context in the classification process may improve the accuracy of the language model which will enhance the argumentation mining process as well. The same document corpus is fed into several language models. Word2Vec and GLoVe represent the context free models, while BERT and ELMo as context sensitive language models. Accuracy and time from each model are then compared to determine the importance of context. The result shows that contextual language models are proven to be able to boost classification accuracy by approximately 20%. However, time comes as a cost where contextual models require longer training and prediction time. The benefit from the increase in accuracy outweighs the burden of time. Thus, as a contextual task, argumentation mining is suggested to use contextual model where context must be included to achieve promising results.

【 授权许可】

CC BY